AI's existential risks: Why Yoshua Bengio is warning the world

- YouTube

In this episode of GZERO AI, Taylor Owen, host of the Machines Like Us podcast, reflects on the growing excitement around artificial intelligence. At a recent AI conference he attended, Owen observes that while startups and officials emphasized AI's economic potential, prominent AI researcher Yoshua Bengio voiced serious concerns about its existential risks. Bengio, who's crucial to the development of the technology, stresses the importance of cautious public policy, warning that current AI research tends to prioritize power over safety.

A couple of weeks ago, I was at this big AI conference in Montreal called All In. It was all a bit over the top. There were smoke machines, loud music, and food trucks. It's clear that AI has come a long way from the quiet labs it was developed in. I'm still skeptical of some of the hype around AI, but there's just no question we're in a moment of great enthusiasm. There were dozens of startup founders there talking about how AI was going to transform this industry or that, and government officials promising that AI was going to supercharge our economy.

And then there was Yoshua Bengio. Bengio is widely considered one of the world's most influential computer scientists. In 2018, he and two colleagues won the Turing Award, the Nobel Prize of Computing for their work on deep learning, which forms the foundation of much of our current AI models. In 2022, he was the most cited computer scientist in the world. It's really safe to say that AI, as we currently know it, might not exist without Yoshua Bengio.

And I recently got the chance to talk to Bengio for my podcast, "Machines Like Us." And I wanted to find out what he thinks about AI now, about the current moment we're in, and I learned three really interesting things. First, Bengio's had an epiphany of sorts, as been widely talked about in the media. Bengio now believes that, left unchecked, AI has the potential to pose an existential threat to humanity. And so he's asking us, even if there's a small chance of this, why not proceed with tremendous caution?

Second, he actually thinks that the divide over this existential risk, which seems to exist in the scientific community, is being overplayed. Him and Meta's Yann LeCun, for example, who he won the Turing Prize with, differ on the timeframe of this risk and the ability of industry to contain it. But Bengio argues they agree on the possibility of it. And in his mind it's this possibility which actually should create clarity in our public policy. Without certainty over risk, he thinks the precautionary principle should lead, particularly when the risk is so potentially grave.

Third, and really interestingly, he's concerned about the incentives being prioritized in this moment of AI commercialization. This extends from executives like LeCun potentially downplaying risk and overstating industry's ability to contain it, right down to the academic research labs where a majority of the work is currently focused on making AI more powerful, not safer. This is a real warning that I think we need to heed. There's just no doubt that Yoshua Bengio's research contributed greatly to the current moment of AI we're in, but I sure hope his work on risk and safety shapes the next. I'm Taylor Owen and thanks for watching.

More from GZERO Media

A 3D-printed miniature model depicting US President Donald Trump, the Chinese flag, and the word "tariffs" in this illustration taken on April 17, 2025.

REUTERS/Dado Ruvic

The US economy contracted 0.3% at an annualized rate in the first quarter of 2025, while China’s manufacturing plants saw their sharpest monthly slowdown in over a year. Behind the scenes, the world’s two largest economies are backing away from their extraordinary trade war.

A photovoltaic power station with a capacity of 0.8 MW covers an area of more than 3,000 square metres at the industrial site of the Chernobyl Nuclear Power Plant, Kyiv region, Ukraine, on April 12, 2025.
Volodymyr Tarasov/Ukrinform/ABACAPRESS.COM

Two months after their infamous White House fight, the US and Ukraine announced on Wednesday that they had finally struck a long-awaited minerals deal.

Indian paramilitary soldiers patrol along a road in Srinagar, Jammu and Kashmir, on April 29, 2025.
Firdous Nazir via Reuters Connect

Nerves are fraught throughout Pakistan after authorities said Wednesday they have “credible intelligence” that India plans to launch military strikes on its soil by Friday.

Palestinian Hamas and Islamic Jihad fighters form a human chain in front of the crowd gathered near the family home of slain Hamas leader Yahya Sinwar, where the Hamas militant group prepares to hand over Israeli and Thai hostages to a Red Cross team in Khan Yunis, on January 30, 2025, as part of their third hostage-prisoner exchange..
Photo by Majdi Fathi/NurPhot

Israel hunted Yahya Sinwar — the Hamas leader and mastermind of the Oct. 7 attack — for over a year. He was hidden deep within Gaza’s shadowy tunnel networks.

A gunman stands as Syrian security forces check vehicles entering Druze town of Jaramana, following deadly clashes sparked by a purported recording of a Druze man cursing the Prophet Mohammad which angered Sunni gunmen, as rescuers and security sources say, in southeast of Damascus, Syria April 29, 2025.
REUTERS/Yamam Al Shaar

Israel said the deadly drone strike was carried out on behalf of Syria's Druze community.

Britain's King Charles holds an audience with the Prime Minister of Canada Mark Carney at Buckingham Palace, on March 17, 2025.

Aaron Chown/Pool via REUTERS

King Charles is rumored to have been invited to Canada to deliver the speech from the throne, likely in late May, although whether he attends may depend on sensitivities in the office of UK Prime Minister Keir Starmer.

Getting access to energy, whether it's renewables, oil and gas, or other sources, is increasingly challenging because of long lead times to get things built in the US and elsewhere, says Greg Ebel, Enbridge's CEO, on the latest "Energized: The Future of Energy" podcast episode. And it's not just problems with access. “There is an energy emergency, if we're not careful, when it comes to price,” says Ebel. “There's definitely an energy emergency when it comes to having a resilient grid, whether it's a pipeline grid, an electric grid. That's something I think people have to take seriously.” Ebel believes that finding "the intersection of rhetoric, policy, and capital" can lead to affordability and profitability for the energy transition. His discussion with host JJ Ramberg and Arjun Murti, founder of the energy transition newsletter Super-Spiked, addresses where North America stands in the global energy transition, the implication of the revised energy policies by President Trump, and the potential consequences of tariffs and trade tension on the energy sector. “Energized: The Future of Energy” is a podcast series produced by GZERO Media's Blue Circle Studios in partnership with Enbridge. Listen to this episode at gzeromedia.com/energized, or on Apple, Spotify,Goodpods, or wherever you get your podcasts.