Eight decades of managing nuclear risks offers potential lessons for governing artificial intelligence (AI). Understanding how well that experience applies to rapidly evolving technology, and where the parallels break down is essential to getting AI governance right.
On October 13, the Nuclear Threat Initiative (NTI) and the Future of Life Institute (FLI) convened a hybrid roundtable in Washington, DC titled “AI Governance: Lessons and Limits from the Nuclear Age.” The discussion brought together 20 policy and industry experts from the nuclear and AI communities to examine how nuclear-era lessons could apply to AI governance and where they fall short.
Exploring the value of the nuclear analogy for AI governance
Participants discussed how decades of experience with nuclear risk reduction, arms control, nonproliferation, and civilian nuclear safety might inform approaches to AI governance. The discussion considered a range of practices to determine whether they could offer useful models for strengthening AI safety, including:
- Verification
- International cooperation
- Domestic regulation
- Safety standards
- Incident reporting
While the nuclear analogy can help convey the stakes of managing a transformative technology like AI, it is important to learn not only from the achievements of nuclear governance but also from its missed opportunities and persistent challenges, such as the recent erosion of arms control agreements and the role luck played in avoiding nuclear war.
Understanding the limits of the comparison
The roundtable also examined important differences between nuclear technology and AI that complicate attempts to draw direct parallels between the two fields, including:
- AI’s private-sector led development
- Rapid pace of technological advancement
- Challenge of monitoring and controlling increasingly capable AI systems.
AI presents distinct challenges that underscore the need to critically examine the nuclear analogy, rather than assume that governance approaches developed for one technology can be directly applied to another.
Call for sustained dialogue
One recurring theme was the value of bringing together experts from the nuclear and AI communities to support greater mutual understanding of the governance challenges facing each field.
As AI capabilities continue to advance, sustained engagement among policymakers, technical experts, and industry will be essential to explore practical approaches to AI governance before a major crisis makes the choice for us.