How to Avoid Two AI Catastrophes: Domination and Chaos (with Nora Ammann)

How to Avoid Two AI Catastrophes: Domination and Chaos (with Nora Ammann)

Published: January 7, 2026

Duration: 1:20:01

Nora Ammann is a technical specialist at the Advanced Research and Invention Agency in the UK. She joins the podcast to discuss how to steer a slow AI takeoff toward resilient and cooperative futures. We examine risks of rogue AI and runaway competition, and how scalable oversight, formal guarantees and secure code could support AI-enabled R&D and critical infrastructure. Nora also explains AI-supported bargaining and public goods for stability.

LINKS:

Nora Ammann siteARIA safeguarded AI program pageAI Resilience official siteGradual Disempowerment website

CHAPTERS:

(00:00) Episode Preview

(01:00) Slow takeoff expectations

(08:13...