Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.

If you take the existential risk seriously, as I now do, it might be quite sensible to just stop developing these things any further.

The development of full artificial intelligence could spell the end of the human race.

... we should have to expect the machines to take control.

If we pursue [our current approach], then we will eventually lose control over the machines

Rogue AI may be dangerous for the whole of humanity. Banning powerful AI systems (say beyond the abilities of GPT-4) that are given autonomy and agency would be a good start.