Apple, Google must stop profiting off AI nudify apps, San Francisco AG says (arstechnica.com)

San Francisco Attorney General David Chiu has sent cease-and-desist letters to Apple and Google, demanding the removal of 13 nudification apps from their app stores. These apps can easily transform regular photos into explicit images, allowing users to change features, remove clothing, and even swap faces onto pornographic bodies. Chiu emphasized the apps' prevalence and impact, claiming they primarily harm women and children by facilitating bullying and humiliation, which can lead to severe mental health issues. This action is significant for the AI/ML community as it raises important questions about the ethical implications of AI-generated content and the responsibilities of tech giants in moderating harmful applications. Despite Google and Apple’s claims of strict content policies, Chiu estimates that they have profited millions from these apps. Google stated that it has already suspended the flagged apps and takes proactive measures against harmful content, but the incident underscores the prevalent challenges in regulating AI tools that can contribute to non-consensual digital exploitation. Ultimately, this case highlights the urgent need for clearer industry standards and improved detection methods to combat the misuse of AI technologies.