HeadlinesBriefing favicon HeadlinesBriefing.com

Meta Ran Ads for Deepfake Porn App Targeting Politicians

Ars Technica •
×

Meta recently ran ads for Kromix, an AI porn-generation tool that appeared to encourage users to create deepfaked videos resembling female US politicians, despite the company's policies against sexual content in advertisements.

One ad featured a pornographic video with a deepfake closely resembling a prominent female US politician, seen winking in front of a US flag before cutting to explicit content. The ads were exclusively targeted to male users under the tagline "Unleash Next-gen AI Magic" and were removed after WIRED flagged them.

The Tech Transparency Project discovered the ads, with director Katie Paul stating that such ads consistently sexualize women into AI-generated porn, raising questions about Meta's content moderation, especially regarding female politicians.

Meta's ad review system relies primarily on automated tools, with ads reviewed against policies prohibiting sexual imagery and nonconsensual intimate content. However, researchers have found thousands of similar ads slipping through detection, with Meta removing 344,000 ads promoting nudify services between November and January alone.

Apple also removed Kromix from its App Store after WIRED's inquiry, stating that "nudification" apps violate their guidelines. This incident follows reports of over 50 ads containing AI child sexual abuse material appearing on Meta's platforms, highlighting ongoing challenges in detecting and removing harmful AI-generated content.