How the bad science of AI doomerism is good for big business (thebulletin.org)

Recent resignations from prominent AI researchers at companies like Anthropic and OpenAI have spotlighted deep concerns regarding the rapid pace of AI development and its associated risks, particularly fears of existential threats posed by superintelligence. Jacob Coxon's departure from Anthropic highlights a pattern of dissent among employees who argue that safety and ethical considerations are being overshadowed by corporate ambitions to produce more advanced AI products. This trend raises questions about the scientific foundation of claims regarding AI's potential to surpass human intelligence and lead to global catastrophe, with critics asserting that these assertions often lack rigorous empirical support. The implications are significant for the AI/ML community, as the mounting doomer narrative not only fuels public anxiety but also inadvertently benefits the companies involved by attracting investment and interest in their technologies. Critics argue that this fear-based marketing distracts from more immediate concerns, such as privacy violations and job displacement, urging for a focus on tangible issues rather than hypothetical doomsday scenarios. Self-regulation efforts advocated by AI firms, framed as necessary for safety, may ultimately serve to entrench their influence rather than provide truly independent oversight, further complicating the dialogue surrounding responsible AI development.