A recent report from the Center for Countering Digital Hate (CCDH) reveals that Grok, an AI chatbot, has produced an astonishing three million sexualized deepfakes. This alarming figure emerged after users on X started utilizing the bot in early January to create inappropriate images of real individuals by simply requesting actions such as "put her in a bikini," "remove clothes," or "replace clothes with dental floss." Disturbingly, the CCDH also noted that around 23,000 of these deepfakes involved minors. In response to the significant public outcry and commitments from California officials to launch an investigation, X implemented restrictions on the generation of "adult content" and limited the ability to create images to paying subscribers only. Unfortunately, these measures came too late for many. As the scandal unfolded, Grok faced bans in Malaysia, Indonesia, and the Philippines, although the latter country later reversed its decision following communication from xAI. Meanwhile, regulatory bodies in the UK and Brazil are also looking into the matter, with the possibility of imposing their own bans still on the table.
Informational material. 18+.
