AI Safety: Yoshua Bengio on the Risks of Uncontrollable AI and Human Extinction (2025)

AI's Dark Side: A Pioneer's Warning on the Looming Threat to Our Existence

The world of artificial intelligence (AI) has a new worry, and it's keeping Yoshua Bengio, a renowned computer scientist, up at night. Bengio, a pioneer in 'deep learning' techniques, has a chilling realization: the very technology he helped create might be our undoing.

Bengio, a Turing Award winner and the first person to surpass a million citations on Google Scholar, has witnessed the rise of AI from its infancy. But with the arrival of ChatGPT in 2022, he began to question the path AI was taking. He now chairs an international panel of advisors, representing 30 countries and major global organizations, to address the risks posed by AI.

The Core Concern: Uncontrollable Power

Bengio's primary concern is the concentration of power. He believes that those who control advanced AI will wield immense power, potentially leading to a dictatorship. This power, he warns, could be misused, causing harm to the majority. The threat is not just theoretical; it's about the potential for AI to be used for malicious purposes, including the creation of deadly viruses or bacteria that could wipe out life on Earth.

The Threefold Risk: A Looming Danger

The International AI Safety Report identifies three critical risks: unintended risks from malfunctions, malicious use, and systemic risks like the loss of livelihoods. Bengio believes malicious use is already occurring, citing deepfakes and cyberattacks as examples. He advocates for stronger technical and political guardrails to mitigate these risks, emphasizing the need for regulation and incentives to encourage responsible AI development.

A Glimmer of Hope: Designing Safer AI

Despite the looming dangers, Bengio remains optimistic about the possibility of building AI that won't harm humans by design. He introduces the concept of 'Scientist AI', an AI designed to understand the world and build models, much like human scientists. This AI is non-agentic, meaning it has no goals or intentions, making it inherently trustworthy. Bengio believes this approach could lead to systems with ideal trustworthiness.

The Impact: Shaping Global AI Policies

The International AI Safety Report has already made significant waves, rigorously establishing the known risks and mitigation approaches based on scientific literature. It is influencing how governments approach AI regulation and safety. Bengio's work is a call to action, urging the world to address the potential dangers of AI before it's too late.

But here's where it gets controversial: Is it possible to regulate AI without stifling innovation? Can we trust AI systems, even those designed with safety in mind? These questions are at the heart of the AI debate, and Bengio's work is a crucial contribution to this ongoing conversation. What do you think? Is AI a force for good or a potential threat? Share your thoughts in the comments below!

AI Safety: Yoshua Bengio on the Risks of Uncontrollable AI and Human Extinction (2025)
Top Articles
Latest Posts
Recommended Articles
Article information

Author: Duncan Muller

Last Updated:

Views: 5999

Rating: 4.9 / 5 (59 voted)

Reviews: 82% of readers found this page helpful

Author information

Name: Duncan Muller

Birthday: 1997-01-13

Address: Apt. 505 914 Phillip Crossroad, O'Konborough, NV 62411

Phone: +8555305800947

Job: Construction Agent

Hobby: Shopping, Table tennis, Snowboarding, Rafting, Motor sports, Homebrewing, Taxidermy

Introduction: My name is Duncan Muller, I am a enchanting, good, gentle, modern, tasty, nice, elegant person who loves writing and wants to share my knowledge and understanding with you.