Will AI really destroy humanity? Pioneers who created the tech weigh in (www.cnbc.com)

Researchers from OpenAI and Anthropic have raised alarms about the potential catastrophic risks associated with artificial intelligence (AI), sparking intense debate in Washington over the need for regulation. Pioneers in the field, including Yoshua Bengio and Geoffrey Hinton, have echoed these concerns, emphasizing the serious implications of unregulated AI advancements. Bengio warned that current AI systems already possess capabilities that could pose harm to human interests, while Hinton suggested a 10% chance that AI could lead to human extinction within a decade. Their insights underline the urgency of addressing AI's safety and ethical considerations. The discourse gained traction as prominent figures acknowledged the duality of AI's future, where proactive management could lead to a beneficial outcome, while negligence could unleash potential disasters. Aidan Gomez highlighted the unparalleled threat posed by AI as a cyber weapon, stressing that security vulnerabilities in deployment environments significantly affect safety. This collective call for caution and the demand for policies that consider varying risks from different AI systems marks a critical moment for the AI/ML community, urging collaborative efforts to ensure the technology develops in a safe and controlled manner.