San Francisco Demands Apple and Google Delete AI ‘Nudify’ Apps From App Stores (www.wired.com)

San Francisco’s city attorney, David Chiu, has issued cease-and-desist letters to Apple and Google, demanding the removal of 13 face-swapping apps from their app stores that generate non-consensual nude images. This action highlights growing concerns over the proliferation of harmful AI technologies that facilitate deepfake pornography, which have reportedly garnered millions in revenue for the tech giants through in-app payments. Chiu emphasized the legal inadmissibility of such apps under California law and the responsibility of these companies to prevent platforms that enable sexual abuse. The significance of this move transcends local legal implications; it calls attention to a wider issue within the AI/ML community concerning the dual-use nature of many apps that appear benign but can be exploited for harmful purposes. Research indicates that about 70% of tested face-swapping apps could be misused to create sexualized content, often without any safeguards in place. This situation underscores a pressing need for stronger moderating processes by tech companies, as well as increased accountability as the potential for AI-generated deepfakes continues to escalate, posing threats to individuals' reputations and mental health.