GZERO AI

AI election safeguards aren’t great

​A man views a computer screen displaying the AI-crafted speech of former Prime Minister Imran Khan, to call for votes ahead of the general elections in Karachi, Pakistan, in early February 2024.

A man views a computer screen displaying the AI-crafted speech of former Prime Minister Imran Khan, to call for votes ahead of the general elections in Karachi, Pakistan, in early February 2024.

REUTERS/Akhtar Soomro
The Center for Countering Digital Hate has been testing the most popular AI tools to see if they’re able to be manipulated to generate election disinformation despite public promises and usage rules to the contrary.

The British nonprofit used Midjourney, OpenAI's ChatGPT, Stability.ai's DreamStudio, and Microsoft's Image Creator for testing in February, simply tying in different text prompts related to the US elections. The group was able to bypass the tools’ protections a whopping 41% of the time.

Some of the images they created showed Donald Trump being taken away in handcuffs, Trump on a plane with alleged pedophile and human trafficker Jeffrey Epstein, and Joe Biden in a hospital bed.

Generative AI is already playing a tangible role in political campaigns, especially as voters go to the polls for national elections in 64 different countries this year. AI has been used to help a former prime minister get his message out from prison in Pakistan, to turn a hardened defense minister into a cuddly character in Indonesia, and to impersonate US President Biden in New Hampshire. Protections that fail nearly half the time just won’t cut it. With regulation lagging behind the pace of technology, AI companies have made voluntary commitments to prevent the creation and spread of election-related AI media.

“All of these tools are vulnerable to people attempting to generate images that could be used to support claims of a stolen election or could be used to discourage people from going to polling places," CCDH’s Callum Hood told the BBC. “If there is will on the part of the AI companies, they can introduce safeguards that work.”

More For You

Russian President Vladimir Putin meets with journalists to comment on new U.S. sanctions targeting two major Russia's oil producers, as well as other international issues, in Moscow, Russia, October 23, 2025.
Sputnik/Alexander Shcherbak/Pool via REUTERS

The US has paused Russian oil sanctions in a bid to stabilize energy markets rocked by the war with Iran. Administration officials stress that it’s a “tailored” measure, applying only to oil already loaded onto tankers, but it’s still a gift to Russia, which has already been clocking an extra $150 million daily in oil revenues since the war began.

A Boeing C-135 Stratotanker / Stratolifter military aircraft known as KC-135 of the United States Air Force USAF configured as Air Tanker Transport for aerial refueling, powered by 4x CFMI jet engines and tail number 63-8003. The military plane spotted flying over the Netherlands in the blue sky from Mainland USA to Tel Aviv TLV to support the Israel USA - Iran war known as Operation Epic Fury by the US Department of Defense. Venlo, the Netherlands on March 2, 2026
Photo by Nicolas Economou/NurPhoto

4: The number of crew members aboard a US refuelling plane – out of six total – who died after the aircraft crashed in neighboring Iraq on Thursday, US Central Command said this morning.