The AI safety bottleneck: Save the world or get the bag (www.businessinsider.com)

Rishub Jain, a former safety researcher at Google DeepMind, has founded a nonprofit called Sampura Research in a bid to address urgent AI safety concerns from outside the corporate structure. Jain believes that despite the rhetoric and investment in AI safety from major tech companies, these efforts are insufficient, limiting genuine advancements in aligning AI with human values. His departure highlights a growing trend among AI safety experts leaving organizations like OpenAI and Anthropic due to concerns over prioritization and the corporate culture that often emphasizes rapid development over thorough safety reviews. The significance of this movement is underscored by a 91% increase in AI safety job postings in the past year, revealing a critical talent bottleneck in the field. Many view the rapid development of AI technologies as an existential threat, spurring a resurgence of interest in safety research and initiatives aimed at training professionals from diverse backgrounds to tackle these challenges. As funding floods in from philanthropic endeavors and anticipated IPOs, organizations like Kairos are actively recruiting and upskilling individuals, indicating that AI safety has emerged as one of the defining issues of our time, necessitating cross-disciplinary expertise to ensure responsible technology development.