AI struggles with gender and race

​People take part in the annual Gay Pride parade in support of LGBT community, in Santiago, Chile, June 22, 2019.
People take part in the annual Gay Pride parade in support of LGBT community, in Santiago, Chile, June 22, 2019.
REUTERS/Rodrigo Garrido

Generative AI keeps messing up on important issues about diversity and representation — especially when it comes to love and sex.

According to one report from The Verge, Meta’s AI image generator repeatedly refused to generate images of an Asian man with a white woman as a couple. When it finally produced one of an Asian woman and a white man, the man was significantly older than the woman.

Meanwhile, Wired found that different AI image geneators routinely represent LGBTQ individuals as having purple hair. And when you don’t specify what ethnicity they should be, these systems tend to default to showing white people.

Generative AI tools are no better than their underlying training data. If their training data is biased, say, by having disproportionate amounts of queer people with highlighter-colored hair, it will consistently represent them as such. It’s incumbent on the proprietors of these models to both improve their training data — buying or accumulating more comprehensive datasets — but, more importantly, tweaking the outputs so they are more inclusive and less stereotypical. That requires lots of testing, and consultation with real-world people from diverse backgrounds about the harms of such representation failures.

But they need to be wary of overcorrection too: Google was recently condemned for generating Black and Asian Nazi soldiers as well as Native Americans in Viking garb. AI can’t understand the complexities of these things yet — but the humans in charge need to.

More from GZERO Media

In this new episode of Tools and Weapons, Microsoft Vice Chair and President Brad Smith sits down with Ted Sarandos to discuss how bold leadership and a culture of innovation keep Netflix ahead, not just as a media company, but as a force shaping both industries and audiences. Ted shares how intuition and data combine to turn daring ideas into practical solutions, from scaling storytelling across 190 countries to relentlessly creating content that gets under the skin of viewers and makes them feel deeply connected to the stories they watch. Subscribe and find new episodes monthly, wherever you listen to podcasts.

Russian President Vladimir Putin chairs a meeting with members of the Security Council via video link at the Kremlin in Moscow, Russia, on October 24, 2025.
Sputnik/Alexey Babushkin/Pool via REUTERS

The US president imposed sanctions on the two largest Russian oil firms. The effectiveness of this strategy depends on whether it forces China and India to stop buying Russian crude.

- YouTube

The real US-China AI race isn’t about who builds the most powerful technology, but who applies and governs it in ways that strengthen—rather than undermine—society, Tristan Harris tells Ian Bremmer on GZERO World.