UNICEF warns of rising AI deepfakes of children

UNICEF says a study across 11 countries found at least 1.2 million children reported their images were manipulated into sexually explicit AI-generated deepfakes, and the agency urged stronger safeguards and updated laws.

UNICEF has highlighted a rapid rise in the use of artificial intelligence to create sexualized images of children. The agency led an investigation spanning 11 countries and reported that at least 1.2 million children said their images were manipulated. UNICEF described AI-manipulated sexual images of children as child sexual abuse material and said the harm to victims is real. The agency also criticized AI developers and social platforms for lacking sufficient safeguards. Key findings: - A UNICEF-led investigation across 11 countries reported at least 1.2 million children said their images were manipulated into sexually explicit AI-generated deepfakes. - In some countries the rate was about one child in a typical classroom of 25, and many children said they worry AI could be used to create fake sexual images or videos. - UNICEF stated that AI-generated sexualized images of children are child sexual abuse material and that deepfake abuse causes real harm. - The agency urged stronger guardrails for AI chatbots and platforms, action by digital companies to prevent circulation, and broader legislation to cover AI-generated imagery; specific legal steps were not set out. Summary: The findings point to widespread reported harm from AI-manipulated images and growing concern among children and officials. UNICEF has called for stronger safeguards from AI developers and platforms and for laws to include AI-generated material. Undetermined at this time.