AI's existential risks: Why Yoshua Bengio is warning the world

- YouTube

In this episode of GZERO AI, Taylor Owen, host of the Machines Like Us podcast, reflects on the growing excitement around artificial intelligence. At a recent AI conference he attended, Owen observes that while startups and officials emphasized AI's economic potential, prominent AI researcher Yoshua Bengio voiced serious concerns about its existential risks. Bengio, who's crucial to the development of the technology, stresses the importance of cautious public policy, warning that current AI research tends to prioritize power over safety.

A couple of weeks ago, I was at this big AI conference in Montreal called All In. It was all a bit over the top. There were smoke machines, loud music, and food trucks. It's clear that AI has come a long way from the quiet labs it was developed in. I'm still skeptical of some of the hype around AI, but there's just no question we're in a moment of great enthusiasm. There were dozens of startup founders there talking about how AI was going to transform this industry or that, and government officials promising that AI was going to supercharge our economy.

And then there was Yoshua Bengio. Bengio is widely considered one of the world's most influential computer scientists. In 2018, he and two colleagues won the Turing Award, the Nobel Prize of Computing for their work on deep learning, which forms the foundation of much of our current AI models. In 2022, he was the most cited computer scientist in the world. It's really safe to say that AI, as we currently know it, might not exist without Yoshua Bengio.

And I recently got the chance to talk to Bengio for my podcast, "Machines Like Us." And I wanted to find out what he thinks about AI now, about the current moment we're in, and I learned three really interesting things. First, Bengio's had an epiphany of sorts, as been widely talked about in the media. Bengio now believes that, left unchecked, AI has the potential to pose an existential threat to humanity. And so he's asking us, even if there's a small chance of this, why not proceed with tremendous caution?

Second, he actually thinks that the divide over this existential risk, which seems to exist in the scientific community, is being overplayed. Him and Meta's Yann LeCun, for example, who he won the Turing Prize with, differ on the timeframe of this risk and the ability of industry to contain it. But Bengio argues they agree on the possibility of it. And in his mind it's this possibility which actually should create clarity in our public policy. Without certainty over risk, he thinks the precautionary principle should lead, particularly when the risk is so potentially grave.

Third, and really interestingly, he's concerned about the incentives being prioritized in this moment of AI commercialization. This extends from executives like LeCun potentially downplaying risk and overstating industry's ability to contain it, right down to the academic research labs where a majority of the work is currently focused on making AI more powerful, not safer. This is a real warning that I think we need to heed. There's just no doubt that Yoshua Bengio's research contributed greatly to the current moment of AI we're in, but I sure hope his work on risk and safety shapes the next. I'm Taylor Owen and thanks for watching.

More from GZERO Media

U.S. President Donald Trump speaks with Democratic Republic of the Congo's Foreign Minister Therese Kayikwamba Wagner and Rwanda's Foreign Minister Olivier Nduhungirehe on June 27, 2025.
REUTERS

On June 27, the Democratic Republic of Congo and Rwanda signed a US-mediated peace accord in Washington, D.C., to end decades of violence in the DRC’s resource-rich Great Lakes region. The agreement commits both nations to cease hostilities, withdraw troops, and to end support for armed groups operating in eastern Congowithin 90 days.

What if the next virus isn’t natural, but deliberately engineered and used as a weapon? As geopolitical tensions rise and biological threats become more complex, health security and life sciences are emerging as critical pillars of national defense. In the premiere episode of “The Ripple Effect: Investing in Life Sciences”, leading experts explore the dual-use nature of biotechnology and the urgent need for international oversight, genetic attribution standards, and robust viral surveillance.

A woman lights a cigarette placed in a placard depicting Hungary's Prime Minister Viktor Orbán, during a demonstration, after the Hungarian parliament passed a law that bans LGBTQ+ communities from holding the annual Pride march and allows a broader constraint on freedom of assembly, in Budapest, Hungary, on March 25, 2025.
REUTERS/Marton Monus

Hungary’s capital will proceed with Saturday’s Pride parade celebrating the LGBTQ+ community, despite the rightwing national government’s recent ban on the event.

American President Donald Trump's X Page is seen displayed on a smartphone with a Tiktok logo in the background
Avishek Das / SOPA Images via Reuters Connect

In August 1991, a handful of high-ranking Soviet officials launched a military coup to halt what they believed (correctly) was the steady disintegration of the Soviet Union. Their first step was to seize control of the flow of information across the USSR by ordering state television to begin broadcasting a Bolshoi Theatre production ofSwan Lake on a continuous loop until further notice.