At the same time we have to ask ourselves, how are we going to contain (secure and control), let alone align (make it "care" enough about humans not to harm us) a system that is – by design – intended to keep getting smarter than us? We simply don't know what might emerge from autonomous, constantly evolving and improving systems that know every aspect of our science and society.
Exact quote, beginning
Mustafa Suleyman
CEO of Microsoft AI and co-founder of DeepMind
In a 2025 essay, Mustafa Suleyman wrote that continuously self-improving superintelligence would need containment and alignment constantly, in perpetuity.
Leader of the MAI Superintelligence Team at Microsoft AIPublished November 7, 2025 · date of remarks not establishedMustafa Suleyman official website
Context and checks
Surrounding words
It's how we discover new kinds of energy generation, new modes of entertainment. AI - HSI - is how we rebuild. Containment is necessary At the same time we have to ask ourselves, how are we going to contain (secure and control), let alone align (make it "care" enough about humans not to harm us) a system that is – by design – intended to keep getting smarter than us? We simply don't know what might emerge from autonomous, constantly evolving and improving systems that know every aspect of our science and society. And since this kind of superintelligence can continuously improve itself, we'll need to contain and align it not just once, but constantly, in perpetuity. And it gets more complicated. It's not just the "we" in today's frontier AI research labs that have to do it. All of humanity needs to do it, together, all the time.
What this quote does not say
- This is a qualitative warning, not a probability estimate or claim that harm is certain.
- The passage does not specify a particular failure scenario or forecast date.
How this was checked
- Quote located in the captured page; spacing normalised for display.
Reviewed by
an AI reviewer that read the whole source · an automatic character-by-character check
