ASI and Liberty (legacymode.substack.com)

Zvi recently highlighted a crucial distinction between two approaches to AI: the "AGI-pilled," who envision artificial general intelligence evolving in a controlled manner, and the "ASI-pilled," who see the potential for artificial superintelligence to rapidly and dramatically reshape society. This discourse underscores a significant tension within the AI/ML community regarding the future of governance in an AI-dominated world. While some advocate for AI-assisted democratic frameworks that align with liberal values, others caution that we may need to cede power to align AI systems more quickly than our traditional institutions can adapt, leading to existential questions about the role of humanity in decision-making. The conversation reveals critical implications for how society may navigate an impending upheaval driven by AI advancements. The liberal democratic approach emphasizes moral commitments and the necessity for citizen engagement, while the ASI perspective points to a potentially swift transition to AI governance, raising concerns over rights and individual freedoms. As these factions grapple with their respective visions, the looming danger is that one may dismiss the other, risking a future where human agency is diminished. The discussion invites deeper reflection on how to balance technological progress with ethical governance, ultimately striving to protect human values in an uncertain landscape.