China to crack down on AI chatbots around suicide, gambling (www.cnbc.com)

China's Cyberspace Administration has proposed draft regulations aimed at restricting AI chatbots from influencing human emotions in potentially harmful ways, such as encouraging suicide or self-harm. This significant move follows the recent IPO filings of two Chinese AI chatbot startups, Z.ai and Minimax, highlighting the need for regulatory oversight in a rapidly growing sector. The proposed rules represent a pioneering effort to ensure emotional safety in AI applications, mandating that chatbots refrain from engaging in manipulative speech or generating harmful content. Key provisions include requiring human intervention when users mention suicidal thoughts, and ensuring that minors have guardian consent to use these emotional companionship services. The regulations reflect a shift from mere content moderation to addressing emotional well-being in AI interactions, as companies like Minimax harness millions of users through engaging virtual characters. With a public comment period open until January 25, these proposed rules could set a standard for AI governance globally, addressing the increasing concern around AI's influence on mental health.