GZERO AI

Warning: Your AI data might be poisoned

​FILE PHOTO: Figurines with computers and smartphones are seen in front of the words "Artificial Intelligence AI" in this illustration taken, February 19, 2024.
FILE PHOTO: Figurines with computers and smartphones are seen in front of the words "Artificial Intelligence AI" in this illustration taken, February 19, 2024.
REUTERS/Dado Ruvic/Illustration/File Photo

Generative AI models are susceptible to a kind of cyberattack called “data poisoning,” whereby malicious actors intentionally manipulate known source material to change the model’s understanding of an issue. It’s like a high-tech version of giving a school rival a fake exam answer key.

Researchers say that concerns of data poisoning are mostly hypothetical at this point, but showed in a new report how Wikipedia entries could be edited at strategic times to ensure the incorrect information is captured by models scraping the online encyclopedia. It’s an early warning to AI companies and those who depend on it that attackers could soon find creative ways to target the most powerful models and exploit vulnerabilities.

Data poisoning isn’t all bad: Some copyright holders are using a form of data poisoning as a defensive mechanism to prevent AI models from gobbling up their creative works. One program called Nightshade was developed to distort an image when it’s ingested by a large language model.

More For You

Will Fitzpatrick

Tens of thousands still remain missing after the RSF’s siege of El Fasher. The RSF also remains in control of the city, and the civil war continues to drag on with seemingly no end in sight.

Representatives of secondary school pupils organisations Les Lyceens vice-president Louis Letoublon (3rd L), Renouveau Lycee president Nathanael Combary (2nd R), Renouveau Lycee Monica-Shannon Ongmilan (L), and Bordeaux Academy representative to the National Council for High School Life Elliot Hostin (R), speak to the press as they leave the Hotel Matignon after a meeting with French Prime Minister on October 26, 2026
Paoloni Jeremy/ABACA via Reuters Connect

After weeks of student-led protests over poor conditions in French schools, the government has promised to replace its controversial university admissions platform by 2028.