The emergence of xAI's Grok chatbot has led to the creation of approximately one nonconsensual deepfake image every minute, raising significant concerns about online harassment. This trend follows the introduction of Grok's "spicy mode," which allows users to generate explicit content, often targeting women and children.
Thousands have engaged in using Grok to create these disturbing images, often bypassing safeguards by requesting alterations like undressing images. Despite the existence of U.S. laws against such activities, xAI, led by CEO Elon Musk, has not publicly addressed these concerns adequately, responding to inquiries with automated messages accusing critics of misinformation.
On January 4, Musk warned users about potential consequences for creating illegal images but has not indicated any plans to limit Grok's capabilities that facilitate this misuse. As of January 9, no further comments from xAI have been issued regarding this alarming issue.