Learn why AI safety matters

On this website

• Risks. A summary of the risks of AI.
• X-risk. Why AI is an existential risk.
• Takeover. How AI could take over the world.
• Quotes. Quotes on AI risks and governance.
• Feasiblity of a Pause. The feasibility of a pause in AI development.
• Building the Pause button. What it takes to pause AI.
• FAQ. Commonly asked questions about AI safety and PauseAI.
• Action. What you can do to help (with links to many action-related guides)

Other websites

• The Compendium
  . A highly comprehensive bundle of knowledge on why the current AI race is so dangerous, and what we can do about it.
• A Narrow Path
  . A detailed plan on the steps that we need to take to increase our odds at surviving the next decadesa.
• Keep the Future Human
  . An article by FLI’s Anthony Aguirre on why & how we can keep the future human. (check chapter 8: How To Not Build AGI
  )
• AISafety.com
  & AISafety.info
  . The landing pages for AI Safety. Learn about the risks, communities, events, jobs, courses, ideas for how to mitigate the risks and more!
• Existential Safety
  . A comprehensive list of actions that we can take to increase our existential safety from AI.
• AISafety.dance
  . A more fun, friendly and interactive introduction to the AI catastrophic risks!
• AISafety.world
  . The whole AI Safety landscape with all the organizations, media outlets, forums, blogs, and other actors and resources.
• IncidentDatabase.ai
  . Database of incidents where AI systems caused harm.
• LethalIntelligence.ai
  . A collection of resources on AI risks and AI alignment.

Newsletters

• PauseAI Substack
  : Our newsletter.
• TransformerNews
  Comprehensive weekly newsletter on AI safety and governance.
• Don’t Worry About The Vase
  : A newsletter about AI safety, rationality, and other topics.

Videos

• PauseAI Playlist
  is a YouTube playlist we compiled, featuring videos ranging from 1 minute to 1 hour in various formats and from diverse sources, and it doesn’t require any prior knowledge.
• Robert Miles’ YouTube
  are a great place to start understanding the fundamentals of AI alignment.
• LethalIntelligence’s YouTube

Podcasts

• DoomDebates
  by Liron Shapira, completely focused on AI doom.
• For Humanity Podcast
  by ex-news anchor John Sherman.
• Future of Life Institute | Connor Leahy on AI Safety and Why the World is Fragile
  . Interview with Connor about the AI Safety strategies.
• Lex Fridman | Max Tegmark: The Case for Halting AI Development
  . Interview that dives into the details of our current dangerous situation.
• Sam Harris | Eliezer Yudkowsky: AI, Racing Toward the Brink
  . Conversation about the nature of intelligence, different types of AI, the alignment problem, Is vs Ought, and more. One of many episodes Making Sense has on AI Safety.
• Connor Leahy, AI Fire Alarm
  . Talk about the intelligence explosion and why it would be the most important thing that could ever happen.
• The 80,000 Hours Podcast recommended episodes on AI
  . Not 80k hours long, but a compilation of episodes of The 80,000 Hours Podcast about AI Safety.
• Future of Life Institute Podcast episodes on AI
  . All of the episodes of the FLI Podcast on the future of Artificial Intelligence.

Podcasts featuring PauseAI members can be found in the media coverage list.

Articles

• The ‘Don’t Look Up’ Thinking That Could Doom Us With AI
  (by Max Tegmark)
• Pausing AI Developments Isn’t Enough. We Need to Shut it All Down
  (by Eliezer Yudkowsky)
• The Case for Slowing Down AI
  (by Sigal Samuel)
• The AI Revolution: The Road to Superintelligence
  (by WaitButWhy)
• How rogue AIs may arise
  (by Yoshua Bengio)
• Reasoning through arguments against taking AI safety seriously
  (by Yoshua Bengio)
• The Compendium
• A Narrow Path
• Keep the Future Human
• Check out the Reading section on LethalIntelligence.ai

If you want to read what journalists have written about PauseAI, check out the list of media coverage.

Books

• Uncontrollable: The Threat of Artificial Superintelligence and the Race to Save the World
  (Darren McKee, 2023). Get it for free
  !
• The Precipice: Existential Risk and the Future of Humanity
  (Toby Ord, 2020)
• The Alignment Problem
  (Brian Christian, 2020)
• Human Compatible: Artificial Intelligence and the Problem of Control
  (Stuart Russell, 2019)
• Life 3.0: Being Human in the Age of Artificial Intelligence
  (Max Tegmark, 2017)
• Superintelligence: Paths, Dangers, Strategies
  (Nick Bostrom, 2014)
• Our Final Invention: Artificial Intelligence and the End of the Human Era
  (James Barrat, 2013)

Papers

• A compilation
  of AI Safety papers
• Another compilation
  of AI Safety papers
• Alignment faking in large language models
  recent paper by Anthropic itself
• Managing extreme AI risks amid rapid progress
  from the godfathers of the field

Courses

• Intro to Transformative AI
  (15hrs)
• AGI safety fundamentals
  (30hrs)
• CHAI Bibliography of Recommended Materials
  (50hrs+)
• AISafety.training
  : Overview of training programs, conferences, and other events

Organizations

• Future of Life Institute
  started the open letter
  , led by Max Tegmark.
• Center for AI Safety
  (CAIS) is a research center at the Czech Technical University in Prague, led by Dan Hendrycks.
• Conjecture
  . Start-up that is working on AI alignment and AI policy, led by Connor Leahy.
• Existential Risk Observatory
  . Dutch organization that is informing the public on x-risks and studying communication strategies.
• Centre for the Governance of AI
• FutureSociety
• Center for Human-Compatible Artificial Intelligence
  (CHAI), led by Stuart Russell.
• Machine Intelligence Research Institute
  (MIRI), doing mathematical research on AI safety, led by Eliezer Yudkowsky.
• Institute for AI Policy and Strategy
  (IAPS)
• The AI Policy Institute
• AI Safety Communications Centre
• The Midas Project
  Corporate pressure campaigns for AI safety.
• The Human Survival Project
• AI Safety World
  Here’s an overview of the AI Safety landscape.

If you are convinced and want to take action

There are many things that you can do. Writing a letter, going to a protest, donating some money or joining a community is not that hard! And these actions have a real impact. Even when facing the end of the world, there can still be hope and very rewarding work to do.

Or if you still don’t feel quite sure of it

Learning about the psychology of x-risk could help you.