This report recognizes the imperatives that inspire the U.S. military’s pursuit of technological superiority over all potential adversaries. These pages emphasize, however, that superiority is not synonymous with security. Experience with nuclear weapons, aviation, and digital information systems should inform discussion about current efforts to control artificial intelligence (AI), synthetic biology, and autonomous systems.
Exact quote, beginning
Richard Danzig
former U.S. secretary of the Navy
In a May 2018 CNAS report, Richard Danzig wrote that military technological superiority is not synonymous with security, and that on a number of occasions and in a number of ways the American national security establishment will lose control of what it creates.
Former Secretary of the Navy and Senior Advisor for the Johns Hopkins Applied Physics LaboratoryPublished May 30, 2018 · date of remarks not establishedTechnology Roulette: Managing Loss of Control as Many Militaries Pursue Technological Superiority
Context and checks
Surrounding words
Summary This report recognizes the imperatives that inspire the U.S. military’s pursuit of technological superiority over all potential adversaries. These pages emphasize, however, that superiority is not synonymous with security. Experience with nuclear weapons, aviation, and digital information systems should inform discussion about current efforts to control artificial intelligence (AI), synthetic biology, and autonomous systems. In this light, the most reasonable expectation is that the introduction of complex, opaque, novel, and interactive technologies will produce accidents, emergent effects, and sabotage. In sum, on a number of occasions and in a number of ways, the American national security establishment will lose control of what it creates. A strong justification for our pursuit of technological superiority is that this superiority will enhance our deterrent power. But deterrence is a strategy for reducing attacks, not accidents; it discourages malevolence, not inadvertence.
What this quote does not say
- The warning addresses AI together with synthetic biology and autonomous systems; it should not be represented as applying exclusively to AI.
- The report predicts loss of control and potentially severe consequences but does not estimate a probability or expressly predict human extinction.
How this was checked
- Quote matched character-for-character against the captured page.
Reviewed by
an AI reviewer that read the whole source · an automatic character-by-character check
