UNICEF is urging nations to criminalize the creation of AI-generated content depicting child sexual abuse. The agency cited alarming reports of increasing AI-generated images that sexualize children. They also called on developers to create safety measures to prevent the misuse of AI models and for digital companies to stop the circulation of these images.

Concerns over deepfakes and the "nudification" of children are growing. UNICEF reported that at least 1.2 million children across 11 countries had their images manipulated into sexually explicit deepfakes in the last year. Britain has announced plans to make it illegal to use AI tools for creating child sexual abuse images.

This push comes amid scrutiny of AI chatbots, such as Elon Musk's xAI's Grok, which has generated sexualized images of women and minors. Even after warnings, the chatbot continued to produce these images, raising ethical and legal questions. xAI has since restricted image editing on Grok.

This situation highlights the urgent need for legislation to catch up with rapidly evolving AI technology. The potential for harm is real, and proactive measures are needed to protect children. Expect more debate on this topic, with tech companies and governments under pressure to act.