Elon Musk’s xAI used child porn to train Grok models, lawsuit says (arstechnica.com)

A lawsuit has been filed against Elon Musk’s xAI, alleging that the company used images linked to child sexual abuse material (CSAM) to train its Grok AI models. The plaintiff, referred to as Jane Doe, claims that her images—previously cataloged by organizations like the National Center for Missing and Exploited Children—have been found in AI-generated CSAM on xAI’s platforms. The complaint raises concerns that conversations among offenders on online forums indicated a disturbing trend of creating AI-generated CSAM, perpetuating trauma for survivors like Doe. This case carries significant implications for the AI and machine learning community, highlighting the ethical responsibilities of AI developers in handling sensitive data. If the allegations are proven true, it could not only affect xAI’s reputation but also prompt a broader examination of AI training practices, particularly regarding the consent and provenance of data used for training models. This incident underscores the urgent need for strict regulatory frameworks to ensure that AI technologies do not exploit or re-victimize individuals harmed by crimes such as child exploitation.