The Deepfake Nudes Crisis in Schools Is Much Worse Than You Thought (www.wired.com)

A troubling rise in the use of deepfake technology among school-age children is leading to severe instances of sexual abuse via manipulated images, primarily created by teenage boys. A new analysis indicates that this crisis, involving harmful "nudify" apps, has affected around 90 schools globally and over 600 students, particularly in high schools across 28 countries. The generative AI tools that enable this exploitation have become increasingly accessible, allowing adolescents to create and disseminate explicit deepfakes with alarming ease, often resulting in significant psychological harm to the victims. The implications of this phenomenon are profound for the AI/ML community and society at large. As the technical barriers for producing these images diminish, the fallout includes a surge in child sexual abuse material, with estimates from UNICEF suggesting that 1.2 million children had such content created about them last year. Current protective measures in schools and law enforcement remain inadequate, often leading to a woefully delayed response to incidents. The urgency of addressing this crisis escalates as the legal and educational systems struggle to keep pace with rapidly evolving technology. Efforts are being made to increase awareness and provide support for victims, but systemic changes are needed to effectively combat this emerging threat.