People on AI
← Back to everyone

People who build AI

David Silver

lead author of the AlphaGo and AlphaZero papers; Google DeepMind reinforcement-learning researcher

2 records

Records

Furthermore, whilst general concerns exist around the potential misuse of any AI, heightened risks may arise from agents that can autonomously interact with the world over extended periods of time to achieve long-term goals. By default, this provides fewer opportunities for humans to intervene and mediate the agent’s actions, and therefore requires a high bar of trust and responsibility.

Exact quote, beginning

David Silver

lead author of the AlphaGo and AlphaZero papers; Google DeepMind reinforcement-learning researcher

In a 2025 preprint co-authored with Richard Sutton, David Silver wrote that heightened risks may arise from AI agents that autonomously interact with the world over extended periods to pursue long-term goals, leaving humans fewer opportunities to intervene.

VP of Reinforcement Learning, Google DeepMindPublished April 2025 · date of remarks not establishedWelcome to the Era of Experience (preprint of a chapter forthcoming from MIT Press)

SourceArchived
Context and checks

Surrounding words

Agents may even be able to exhibit capabilities previously considered the exclusive realm of humanity, such as long-term problem-solving, innovation, and a deep understanding of real world consequences. Furthermore, whilst general concerns exist around the potential misuse of any AI, heightened risks may arise from agents that can autonomously interact with the world over extended periods of time to achieve long-term goals. By default, this provides fewer opportunities for humans to intervene and mediate the agent’s actions, and therefore requires a high bar of trust and responsibility. Moving away from human data and human modes of thinking may also make future AI systems harder to interpret. However, whilst acknowledging that experiential learning will increase certain safety risks, and that further research is surely required to ensure a safe transition into the era of experience, we should also recognise that it may also

What this quote does not say

  • The passage is jointly authored with Richard S. Sutton and should not be represented as Silver's sole wording.
  • The passage describes heightened risks but does not quantify them or explicitly call them existential.

How this was checked

  • Quote located in the captured page; spacing normalised for display.

Reviewed by

an AI reviewer that read the whole source · an automatic character-by-character check

Statements they signed

FROM THE SIGNED STATEMENT

Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.

Signed statement: “Statement on AI Extinction Risk” (CAIS)

David Silver

lead author of the AlphaGo and AlphaZero papers; Google DeepMind reinforcement-learning researcher

Signed as part of a group statement. Not spoken.

David Silver signed the Statement on AI Extinction Risk, which says reducing the risk of extinction from AI should be a global priority alongside pandemics and nuclear war.

Professor of Computer Science, Google DeepMind and UCLDate not establishedStatement on AI Extinction Risk

SourceArchived
Context and checks

Surrounding words

former UN High Representative for Disarmament Affairs Other Notable Figures Audrey Tang Digitalminister.tw and Chair of National Institute of Cyber Security Other Notable Figures Daniela Amodei President, Anthropic Other Notable Figures David Silver Professor of Computer Science, Google DeepMind and UCL AI Scientists Lila Ibrahim COO, Google DeepMind Other Notable Figures Stuart Russell Professor of Computer Science, UC Berkeley AI Scientists Tony (Yuhuai) Wu Co-Founder, xAI AI

What this quote does not say

  • The roster's wording for Silver's role is “Professor of Computer Science, Google DeepMind and UCL.”

How this was checked

  • The organiser's own roster lists this person as a signer.

Reviewed by

an AI reviewer that read the whole source