Emotional AI: More harm than good?

Emotional AI: More harm than good? | GZERO World

Generative AI mimics human-generated text, images, and video, and it's got huge implications for geopolitics, economics, and security. But that's not all - emotionally intelligent AI is on the rise.

And sometimes the results are ugly. Take the mental health nonprofit, KOKO, which used an AI chatbot to support counselors advising 4,000 people who were seeking counseling. The catch: The patients didn't know that a bot was generating the advice they were receiving. While users initially rated the bot-generated responses highly, the therapy lost its effectiveness once the patients were informed that they'd be talking to a fancy calculator.

The real question is: When does emotionally intelligent AI cross the line into emotionally manipulative territory?

This is not just a concern for virtual therapists -- politics could be impacted. And who knows, maybe even your favorite TV host will use generative AI to convince you to keep watching. Now there's an idea.

More from GZERO Media

Qatar's Emir Sheikh Tamim Bin Hamad Al Thani receives Syrian President Ahmed al-Sharaa, in Doha, Qatar, earlier this month. Qatar and Saudi Arabia have now jointly agreed to pay off Syria's World Bank debt.
Amiri Diwan/Handout via REUTERS

The country's interim president Ahmed al-Sharaa faces a tricky tradeoff when it comes to securing the country.

US President Donald Trump returns to the White House from his New Jersey golf club to Washington, DC, on April 27, 2024.

Sipa USA via Reuters Connect

With a cohesive team in the White House, Republican control of Congress, and a disoriented Democratic opposition, Donald Trump has pushed ahead rapidly on many fronts since inauguration. But opinion polls in recent weeks have shown a sharp decline in public support for the president, and the courts, financial markets, and other institutions have started curbing his actions. We asked Eurasia Group experts Clayton Allen and Noah Daponte-Smith where things are likely to go from here.

Rescuers search for a 17-year-old and his parents near an apartment building hit by a Russian missile strike, amid Russia's attack on Ukraine, in Kyiv, on April 24, 2025.
REUTERS/Valentyn Ogirenko

US Secretary of State Marco Rubio said Monday that this week is “very critical” for Donald Trump’s plan to end the war in Ukraine. Russia’s Vladimir Putin made news on Monday by offering a three-day ceasefire beginning on May 8, a move perhaps motivated by skeptical recent comments from Trump on Russia’s willingness to bargain in good faith.

- YouTube

On GZERO World with Ian Bremmer, two authors—Pulitzer Prize-winning novelist Viet Thanh Nguyen and historian Mai Elliottwith deeply personal ties to the Vietnam War, reflect on its lasting global impact and Vietnam's remarkable rise 50 years later.