European Union officials are proposing a ban on AI-powered 'nudify' systems that create sexually explicit images of real people without consent. The proposed amendment would target platforms like Grok rather than just prosecuting individual users. The move comes amid growing concerns about AI-driven tools that facilitate image-based sexual violence and child sexual abuse material.

Currently, EU regulations focus on prosecuting users who create deepfake pornography, but the new approach would punish platforms that fail to implement effective safety measures. Lawmakers argue that individual perpetrators are often difficult to identify and prosecute under existing national laws. The Grok controversy on X has highlighted how major platforms can enable widespread abuse.

The amendment represents the EU's first policy specifically targeting AI platforms that produce non-consensual sexual content. With backing from Parliament members, the ban appears likely to pass, potentially forcing xAI to implement stricter controls or face penalties. Civil liberties committee member Michael McNamara said citizens expect such protections from their regulators.