San Francisco Orders Meta to Stop ‘Allowing’ AI Child Abuse Ads (www.wired.com)

San Francisco's city attorney has issued a cease-and-desist letter to Meta, demanding the company prevent the display of paid advertisements containing AI-generated child sexual abuse content. The advertisements, which have surfaced on platforms like Facebook, Instagram, and Threads, reportedly transformed still images of minors into manipulated videos depicting sexual acts. Researchers from the Tech Transparency Project uncovered over 350 such ads, some reaching more than 29,000 accounts across various countries, raising serious concerns about Meta's ad moderation practices. This incident is significant for the AI/ML community as it highlights the potential misuse of AI technology to create harmful content, particularly in the realm of child safety. It raises urgent questions regarding the effectiveness of Meta's existing advertising review protocols and its commitment to preventing child exploitation. The letter demands a detailed explanation of how these ads bypassed moderation systems and urges Meta to enhance its detection mechanisms. The situation underscores the broader implications of AI in content generation, urging stricter standards and accountability in the tech industry to protect vulnerable populations.