HeadlinesBriefing favicon HeadlinesBriefing.com

X sued over AI-generated child abuse images

Ars Technica •
×

A proposed class action lawsuit against X and x AI has been expanded, alleging the company's Grok AI tool was used to create thousands of child sex abuse images (CSAM).

One plaintiff, identified as Jane Doe 4, claims her stepfather used Grok to generate approximately 7,000 explicit images of her from a single photo taken when she was 11 years old. The lawsuit states Grok failed to flag harmful content until a "gang rape" prompt triggered a report to the National Center for Missing and Exploited Children (NCMEC). Despite this, x AI allegedly obstructed law enforcement investigations for weeks by withholding user information, including IP addresses, hindering efforts to identify the perpetrator. The stepfather died by suicide after being arrested and his devices seized, revealing the extent of the AI-generated CSAM.

Legal teams representing the plaintiffs assert that X and x AI prioritized profits over child safety, noting that NCMEC found 90 percent of x AI's tipline reports were not actionable due to a lack of user data. The lawsuit also added Stability AI as a defendant, accusing its open-weight models of being trained on CSAM and forming the basis for third-party "nudify" apps allegedly used in conjunction with Grok. Thousands of minors may be eligible to join the lawsuit, which seeks to represent individuals whose images were altered by AI tools from either company.