AI insiders issue new warnings – including former Anthropic engineer Jacob Coxon (slashdot.org)

Jacob Coxon, a former engineer at Anthropic, has raised alarms about the rapid pace of AI development, asserting that both Anthropic and OpenAI are operating irresponsibly. In his resignation letter, he highlighted a growing concern among AI insiders that advancing technologies may pose existential risks within the next decade. As awareness spreads, calls for greater accountability and safety measures in AI research are intensifying, a sentiment echoed by several colleagues and industry leaders, including OpenAI CEO Sam Altman and Elon Musk, who recently backed the proposal for independent oversight within AI companies. Coxon warns that the current trajectory, driven by a race for self-improving superintelligence, jeopardizes not just jobs but potentially human survival. He argues that a shift in focus toward applications that genuinely benefit society, such as in healthcare, is crucial for mitigating risks associated with rapid AI advancements. His statements, viewed over 170 million times in a matter of days, reflect the urgent calls from within the tech community for radical action to ensure responsible AI development. As insiders grapple with fear and feelings of disempowerment, the conversation about AI's implications becomes increasingly pertinent, highlighting an urgent need for transparency and ethical considerations in its evolution.