🤖 AI Summary
More than 900 public figures — from AI pioneers Yoshua Bengio and Geoffrey Hinton to business leaders (Steve Wozniak, Richard Branson), entertainers (will.i.am), and political figures (Prince Harry, Steve Bannon) — signed a statement organized by the Future of Life Institute calling for a prohibition on developing “superintelligence” until there is broad scientific consensus that it can be done safely and with strong public buy-in. The signatories cite risks ranging from large-scale job displacement and loss of human control over systems to the extreme possibility of human extinction, concerns amplified by the rapid rollout of increasingly powerful models from companies like OpenAI and Google.
For the AI/ML community this is a renewed push for governance and technical safety: the statement urges concrete safety standards, research pauses or moratoria on capability escalation, and public oversight before pursuing systems that could surpass human intelligence. That would shift priorities toward alignment, robustness, interpretability and control mechanisms, and could slow competitive, scale-driven development unless agreement on safeguards emerges. Critics and some researchers (e.g., Yan LeCun) argue superintelligence is distant and controllable; supporters like Stuart Russell frame the demand not as an absolute ban but as a requirement for adequate safety measures given developers’ own estimates of catastrophic risk.
Loading comments...
login to comment
loading comments...
no comments yet