Two countries have blocked the Grok app after it was widely used to generate non-consensual near-nude deepfakes of women and children. A third country is currently carrying out an investigation into the application's content generation capabilities. Three US senators have formally requested Apple to temporarily remove both X and Grok from the US App Store.

The legislators cited concerns over "sickening content generation" enabled by the AI tools. Apple has not yet publicly responded to the request. This situation highlights the escalating conflict between rapid AI deployment and the urgent need for content moderation and user safety. The incident underscores the vulnerability of women and children to digital exploitation via generative AI.

It also places significant pressure on platform gatekeepers like Apple to enforce stricter app review policies. The outcome could set a major precedent for how AI applications are regulated within major app ecosystems globally.