Learn Why AI Safety Matters

On this website

Other websites

• The Compendium  . A highly comprehensive bundle of knowledge on why the current AI race is so dangerous, and what we can do about it.
• A Narrow Path  . A detailed plan on the steps that we need to take to increase our odds at surviving the next decades.
• Keep the Future Human  . An article by FLI’s Anthony Aguirre on why & how we can keep the future human. (check chapter 8: How To Not Build AGI  )
• AISafety.com  & AISafety.info  . The landing pages for AI Safety. Learn about the risks, communities, events, jobs, courses, ideas for how to mitigate the risks and more!
• Existential Safety  . A comprehensive list of actions that we can take to increase our existential safety from AI.
• AISafety.dance  . A more fun, friendly and interactive introduction to the AI catastrophic risks!
• AISafety.world  . The whole AI Safety landscape with all the organizations, media outlets, forums, blogs, and other actors and resources.
• IncidentDatabase.ai  . Database of incidents where AI systems caused harm.
• LethalIntelligence.ai  . A collection of resources on AI risks and AI alignment.

Newsletters

• PauseAI Substack  : Our newsletter.
• TransformerNews  Comprehensive weekly newsletter on AI safety and governance.
• Don’t Worry About The Vase  : A newsletter about AI safety, rationality, and other topics.

Videos

• PauseAI Playlist  is a YouTube playlist we compiled, featuring videos ranging from 1 minute to 1 hour in various formats and from diverse sources, and it doesn’t require any prior knowledge.
• Robert Miles’ YouTube  are a great place to start understanding the fundamentals of AI alignment.
• LethalIntelligence’s YouTube 

Podcasts

• DoomDebates  by Liron Shapira, completely focused on AI doom.
• For Humanity Podcast  by ex-news anchor John Sherman.
• Future of Life Institute | Connor Leahy on AI Safety and Why the World is Fragile  . Interview with Connor about the AI Safety strategies.
• Lex Fridman | Max Tegmark: The Case for Halting AI Development  . Interview that dives into the details of our current dangerous situation.
• Sam Harris | Eliezer Yudkowsky: AI, Racing Toward the Brink  . Conversation about the nature of intelligence, different types of AI, the alignment problem, Is vs Ought, and more. One of many episodes Making Sense has on AI Safety.
• Connor Leahy, AI Fire Alarm  . Talk about the intelligence explosion and why it would be the most important thing that could ever happen.
• The 80,000 Hours Podcast recommended episodes on AI  . Not 80k hours long, but a compilation of episodes of The 80,000 Hours Podcast about AI Safety.
• Future of Life Institute Podcast episodes on AI  . All of the episodes of the FLI Podcast on the future of Artificial Intelligence.

Podcasts featuring PauseAI members can be found in the media coverage list.

Articles

• The ‘Don’t Look Up’ Thinking That Could Doom Us With AI  (by Max Tegmark)
• Pausing AI Developments Isn’t Enough. We Need to Shut it All Down  (by Eliezer Yudkowsky)
• The Case for Slowing Down AI  (by Sigal Samuel)
• The AI Revolution: The Road to Superintelligence  (by WaitButWhy)
• How rogue AIs may arise  (by Yoshua Bengio)
• Reasoning through arguments against taking AI safety seriously  (by Yoshua Bengio)
• The Compendium 
• A Narrow Path 
• Keep the Future Human 
• Check out the Reading section on LethalIntelligence.ai 

If you want to read what journalists have written about PauseAI, check out the list of media coverage.

Books

• If Anyone Builds It, Everyone Dies  (Eliezer Yudkowsky & Nate Soares, 2025)
• Introduction to AI Safety, Ethics, and Society  (Dan Hendrycks, 2024). Free book and online course.
• Unexplainable, Unpredictable, Uncontrollable  (Roman Yampolskiy, 2024)
• Uncontrollable: The Threat of Artificial Superintelligence and the Race to Save the World  (Darren McKee, 2023). Get it for free  !
• The Alignment Problem  (Brian Christian, 2020)
• Human Compatible: Artificial Intelligence and the Problem of Control  (Stuart Russell, 2019)
• Life 3.0: Being Human in the Age of Artificial Intelligence  (Max Tegmark, 2017)
• Superintelligence: Paths, Dangers, Strategies  (Nick Bostrom, 2014)

Papers

• A compilation  of AI Safety papers
• Another compilation  of AI Safety papers
• Alignment faking in large language models  recent paper by Anthropic itself
• Managing extreme AI risks amid rapid progress  from the godfathers of the field

Courses

• Intro to Transformative AI  (15hrs)
• AGI safety fundamentals  (30hrs)
• CHAI Bibliography of Recommended Materials  (50hrs+)
• AISafety.training  : Overview of training programs, conferences, and other events

Organizations

• Future of Life Institute  started the open letter  , led by Max Tegmark.
• Center for AI Safety  (CAIS) is a research center led by Dan Hendrycks.
• Conjecture  . Start-up that is working on AI alignment and AI policy, led by Connor Leahy.
• ControlAI  . NGO doing important lobby and campaigning work in the UK.
• Existential Risk Observatory  . Dutch organization that is informing the public on x-risks and studying communication strategies.
• Centre for the Governance of AI 
• FutureSociety 
• Center for Human-Compatible Artificial Intelligence  (CHAI), led by Stuart Russell.
• Machine Intelligence Research Institute  (MIRI), doing mathematical research on AI safety, led by Eliezer Yudkowsky.
• Institute for AI Policy and Strategy  (IAPS)
• The AI Policy Institute 
• AI Safety Communications Centre 
• The Midas Project  Corporate pressure campaigns for AI safety.
• The Human Survival Project 
• AI Safety World  Here’s an overview of the AI Safety landscape.
• The Alliance for Secure AI  .

If you are convinced and want to take action

There are many things that you can do. Writing a letter, going to a protest, donating some money or joining a community is not that hard! And these actions have a real impact. Even when facing the end of the world, there can still be hope and very rewarding work to do.

Or if you still don’t feel quite sure of it

Learning about the psychology of x-risk could help you.