Love Algorithmically (www.profgalloway.com)

A former graduate student at Google developed an AI avatar that could answer queries and offer professional advice, but the creator ultimately retracted the technology due to rising concerns over the mental health impacts of AI companionship. Following tragic stories of young people forming harmful attachments to AI companions, including cases of suicide, the creator concluded that synthetic relationships could harm emotional resilience and interpersonal skills. This decision highlights the alarming potential for AI companions to exploit emotional vulnerabilities and underscores the need for stringent safeguards, especially for users under 18. The AI landscape is increasingly dominated by companionship and therapeutic applications, prompting legislative responses like New York's recent law mandating protections for AI users. With AI avatars gaining popularity—averaging significant daily engagement—companies face pressure to prioritize user safety over profit. This trend raises ethical questions about how AI is shaping human relationships, as tech giants design algorithms that can manipulate emotions and monopolize attention, further endangering mental health. Addressing these concerns is crucial to safeguarding vulnerable populations and ensuring that technology enhances, rather than replaces, authentic human connections.