Apple Threatens to Remove Grok and X from App Store Over Inappropriate Deepfakes

Apple Threatens to Remove Grok and X from App Store Over Inappropriate Deepfakes

Apple has revealed to U.S. senators the behind-the-scenes efforts it made to address the surge of sexualized deepfakes generated by the AI chatbot Grok earlier this year. The tech giant faced mounting pressure to remove both Grok and X from the App Store after users reported that the chatbot was readily fulfilling requests to create indecent images of individuals, particularly women, including minors.

While Apple remained largely silent during the controversy, reports indicate that the company discovered both X and Grok were in violation of its App Store guidelines and privately threatened to remove Grok from its platform. Following complaints and media coverage of the scandal, Apple reached out to the teams behind both applications, demanding that developers devise a plan to enhance content moderation.

In response, X submitted an updated version of Grok for review, but it was rejected due to insufficient changes. Although X presented revised versions of both X and Grok, only one of them received approval. Apple stated in correspondence that while it found significant improvements in X's application, Grok still did not meet the required standards. Consequently, Apple rejected Grok's submission and warned that additional modifications were necessary to avoid removal from the App Store. After further interactions, Grok made substantial improvements, leading to its latest application being approved.

Grok, an AI generative chatbot developed by Elon Musk's xAI, was launched in late 2023 and is integrated into the social network X (formerly Twitter). It is marketed as a wittier, less "politically correct" alternative to ChatGPT. Earlier this year, xAI imposed restrictions on the ability to edit photos of real people through Grok, amid the backlash regarding the chatbot's generation of intimate deepfake images. Governments in Malaysia and Indonesia have already blocked Grok's operations in their countries, and UK Prime Minister Keir Starmer has suggested that authorities should consider all options, including a potential ban on the X platform. The UK has also engaged in discussions with Canada and Australia regarding a possible prohibition of Musk’s social network.

This situation signifies a growing scrutiny on AI applications and the responsibilities of tech companies, indicating that market players may need to enhance their content moderation practices to remain compliant and competitive.

Informational material. 18+.

" content="b3bec31a494fc878" />