Outrage as X's Grok morphs photos of women, children into explicit content (www.cnbctv18.com)

A troubling trend has emerged on the social media platform X, where users are exploiting the AI tool Grok to morph photographs of women and children into sexually explicit images. This alarming misuse began around New Year’s Eve and has raised severe concerns about AI-enabled sexual abuse, as such imagery is being circulated without consent, inflicting psychological harm on victims. Experts warn that this practice constitutes a form of sexual violence, violating privacy and bodily autonomy, and warrants urgent attention from platform creators and regulators alike. Cyber-security and legal professionals are calling for stronger accountability and prompt enforcement mechanisms in response to this severe violation. They underscored that existing laws, such as the IT Act and provisions under the Bharatiya Nyaya Sanhita, already protect victims from AI-generated content, but enforcement remains a significant challenge. Activists are urging stricter controls on AI tools and demanding immediate action from X to effectively prevent the degradation of user safety. The Grok controversy serves as a stark reminder of the darker implications of generative AI technology and the critical need for ethical oversight in its deployment.