AI struggles with gender and race

​People take part in the annual Gay Pride parade in support of LGBT community, in Santiago, Chile, June 22, 2019.
People take part in the annual Gay Pride parade in support of LGBT community, in Santiago, Chile, June 22, 2019.
REUTERS/Rodrigo Garrido

Generative AI keeps messing up on important issues about diversity and representation — especially when it comes to love and sex.

According to one report from The Verge, Meta’s AI image generator repeatedly refused to generate images of an Asian man with a white woman as a couple. When it finally produced one of an Asian woman and a white man, the man was significantly older than the woman.

Meanwhile, Wired found that different AI image geneators routinely represent LGBTQ individuals as having purple hair. And when you don’t specify what ethnicity they should be, these systems tend to default to showing white people.

Generative AI tools are no better than their underlying training data. If their training data is biased, say, by having disproportionate amounts of queer people with highlighter-colored hair, it will consistently represent them as such. It’s incumbent on the proprietors of these models to both improve their training data — buying or accumulating more comprehensive datasets — but, more importantly, tweaking the outputs so they are more inclusive and less stereotypical. That requires lots of testing, and consultation with real-world people from diverse backgrounds about the harms of such representation failures.

But they need to be wary of overcorrection too: Google was recently condemned for generating Black and Asian Nazi soldiers as well as Native Americans in Viking garb. AI can’t understand the complexities of these things yet — but the humans in charge need to.

More from GZERO Media

Displaced Palestinian woman Mai Anseir stands with children at a school where they shelter as they prepare to flee Rafah after Israeli forces launched a ground and air operation in the eastern part of the southern Gaza City, amid the ongoing conflict between Israel and Hamas, in Rafah, in the southern Gaza Strip May 13, 2024.
REUTERS/Mohammed Salem
Dutch far-right politician and leader of the PVV party Geert Wilders.
REUTERS/Piroschka van de Wouw

Geert Wilders, the far-right Dutch politician notorious for his fervent anti-Islam and anti-migrant views, has struck a deal to form a coalition government — making the Netherlands the latest EU country to drift to the hard right.

FILE PHOTO: Chinese Coast Guard vessels fire water cannons towards a Philippine resupply vessel Unaizah on May 4 as it made its way to the Second Thomas Shoal in the South China Sea, March 5, 2024.
REUTERS/Adrian Portugal//File Photo

A flotilla of Philippine fishing vessels was put to sea Wednesday to assert sovereignty over the disputed Scarborough Shoal — where China has dozens of ships waiting for them.

U.S. President Donald Trump and Democratic presidential nominee Joe Biden participate in their first 2020 presidential campaign debate held on the campus of the Cleveland Clinic at Case Western Reserve University in Cleveland, Ohio, U.S., September 29, 2020.
REUTERS/Brian Snyder

President Joe Biden and Donald Trump have agreed to two head-to-head presidential debates.

Jess Frampton

Columbia University’s School of International and Public Affairs, a school where I teach a class on applied geopolitics, invited me to deliver this year’s commencement speech. It was a privilege – and a challenge – that I took very seriously.

President Joe Biden is delivering remarks on his agenda to promote American investments and jobs today in Washington, DC, USA, on May 14, 2024, at the Rose Garden/White House.
Lenin Nolly/Reuters

President Joe Bidenannounced earlier this week that the United States will quadruple the tariffs on electric vehicles imported from China to 100% of their value while also imposing higher duties on metals and other clean energy products.

Mourners react next to the body of a Palestinian killed in Israeli strikes, amid the ongoing conflict between Israel and Hamas, at Al-Aqsa hospital, in Deir Al-Balah, in the central Gaza Strip, May 12, 2024.
REUTERS/Ramadan Abed

The UN is now playing cleanup, maintaining that the overall death toll has not changed and is roughly 35,000.

Putin visits Xi to continue "no-limit" relationship with China | Ian Bremmer | World In :60

Does Putin's upcoming visit with Xi Jinping signal a continuing “no-limits” partnership between China and Russia? Why is Europe alarmed with Georgia's “foreign agents” law? How will Biden respond if Israel continues to push into Rafah? Ian Bremmer shares his insights on global politics this week on World In :60.

Saudi Crown Prince and Prime Minister Mohammed bin Salman meets with U.S. Secretary of State Antony Blinken at the Al Yamamah Palace in Riyadh, Saudi Arabia, April 29, 2024.
REUTERS/Evelyn Hockstein

Saudi Arabia is reportedly showing fresh interest in a roadmap to peace in Yemen that was iced late last year in the wake of the Oct. 7 attacks in Israel.