Why, then, is building AGI often framed as an unquestioned goal in the field of AI? In this paper, we argue that the normative framework that motivates much of this goal is rooted in the Anglo-American eugenics tradition of the twentieth century.
Exact quote, beginning
Timnit Gebru
founder of the Distributed AI Research Institute
In a 2024 paper, Timnit Gebru and Émile P. Torres wrote that efforts to build artificial general intelligence harm marginalized groups, centralize power, and use safety language to evade accountability.
Coauthor of The TESCREAL bundlePublished April 14, 2024 · date of remarks not establishedThe TESCREAL bundle: Eugenics and the promise of utopia through artificial general intelligence
Context and checks
Surrounding words
We argue that, unlike systems with specific applications which can be evaluated following standard engineering principles, undefined systems like “AGI” cannot be appropriately tested for safety. Why, then, is building AGI often framed as an unquestioned goal in the field of AI? In this paper, we argue that the normative framework that motivates much of this goal is rooted in the Anglo-American eugenics tradition of the twentieth century. As a result, many of the very same discriminatory attitudes that animated eugenicists in the past (e.g., racism, xenophobia, classism, ableism, and sexism) remain widespread within the movement to build AGI, resulting in systems that harm marginalized groups and centralize power, while using the language of “safety” and “benefiting humanity” to evade accountability. We conclude by urging researchers to work on defined tasks for which we can develop safety protocols, rather than attempting to build a presumably all-knowing system such as AGI.
What this quote does not say
- The passage is jointly authored with Émile P. Torres, so it establishes Gebru's authorship but not which coauthor drafted the sentence.
- The passage concerns present and structural harms from AGI development, not a probability estimate or endorsement of extinction-risk claims.
How this was checked
- Quote matched character-for-character against the captured page.
Reviewed by
an AI reviewer that read the whole source · an automatic character-by-character check
