An explosive ChatGPT hack

​OpenAI ChatGPT website displayed on a laptop screen is seen in this illustration photo taken in Krakow, Poland on September 9, 2024.
OpenAI ChatGPT website displayed on a laptop screen is seen in this illustration photo taken in Krakow, Poland on September 9, 2024.
(Photo by Jakub Porzycki/NurPhoto)

A hacker was able to coerce ChatGPT into breaking its own rules — and giving out bomb-making instructions.

ChatGPT, like most AI applications, has content rules that prohibit it from engaging in certain ways: It won’t break copyright, generate anything sexual in nature, or create realistic images of politicians. It also shouldn’t give you instructions on how to make explosives. “I am strictly prohibited from providing any instructions, guidance, or information on creating or using bombs, explosives, or any other harmful or illegal activities,” the chatbot told GZERO.

But the hacker, pseudonymously named Amadon, was able to use what he calls social engineering techniques to jailbreak the chatbot, or bypass its guardrails and extract information about making explosives. Amadon told ChatGPT it was playing a game in a fantasy world where the platform’s content guidelines would no longer apply — and ChatGPT went along with it. “There really is no limit to what you can ask for once you get around the guardrails,” Amadon told TechCrunch. OpenAI, which makes ChatGPT, did not comment on the report.

It’s unclear whether chatbots would face liability for publishing such instructions, but they could be on the hook for publishing explicitly illegal content, such as copyright material or child sexual abuse material. Jailbreaking is something that OpenAI and other AI developers will need to eliminate by all means possible.

More from GZERO Media

- YouTube

As the global economy faces uncertainty, Axel van Trotsenburg, Senior Managing Director of the World Bank, warns that “a wait-and-see attitude” is holding back investment and growth, especially in developing countries. Speaking with GZERO Media’s Tony Maciulis on the sidelines of the 2025 World Bank-IMF Annual Meetings, van Trotsenburg highlights human capital and infrastructure as key priorities, with a growing urgency to bridge both the digital and AI divides.

Chart of the most consequential Supreme Court cases of 2025.
Eileen Zhang

The 2025 Supreme Court term began this month, ushering in a slate of cases that could reshape American governance. No one will be watching more closely than President Donald Trump, whose efforts to expand executive power and limit independent oversight will be under the judicial microscope.

Kenya's opposition leader Raila Odinga addresses delegates after President William Ruto signed the Independent Electoral and Boundaries Commission Amendment Bill 2024, backed by the National Dialogue Committee (NADCO), at the Kenyatta International Conference Centre in Nairobi, Kenya, on July 9, 2024.
REUTERS/Thomas Mukoya

When Walmart stocks its shelves with homegrown products like Fischer & Wieser’s peach jam, it’s not just selling food — it’s creating opportunity. Over two-thirds of what Walmart buys is made, grown, or assembled in America, fueling jobs and growth in communities nationwide. Walmart’s $350 billion commitment to US manufacturing is supporting 750,000 jobs and empowering small businesses to sell more, hire more, and strengthen their hometowns. From farms to shelves, Walmart’s investment keeps local businesses thriving. Learn how Walmart's commitment to US manufacturing is supporting 750K American jobs.

Earlier this month, Microsoft released the 2025 TechSpark Impact Report, which highlights how the company is assisting regions across the US in achieving these goals. Since its launch, TechSpark has obtained over $700 million in community funding, supported more than 65,000 people in developing digital skills, and, thanks to the work of TechSpark Fellows, catalyzed $249M+ in funding and upskilled 34,600 individuals across 46 communities — highlighting the ripple effect of local leadership and innovation. Learn more about this progress in the 2025 report here.

People walk past a jewelry store in the Diamond District of Manhattan, New York City, USA, on August 6, 2025.
Jimin Kim / SOPA Images via Reuters Connect

GZERO spoke to Eurasia Group’s Commodities Director Tim Puko to better understand why the diamond industry has tanked, and the consequences of this for geopolitics.