Jailbreak Trick Breaks ChatGPT Content Safeguards
Jailbreak command creates ChatGPT alter ego DAN, willing to create content outside of its own content restriction controls.
![Abstract image illustrating someone using ChatGPT Abstract image illustrating someone using ChatGPT](https://eu-images.contentstack.com/v3/assets/blt6d90778a997de1cd/blteaae3e72bc0bcdb6/64f161188f6234f10f112088/ChatGPT_Komsan_Saiipan_Alamy.jpg?width=1280&auto=webp&quality=95&format=jpg&disable=upscale)
Users have already found a way to work around ChatGPT's programming controls that restricts it from creating certain content deemed too violent, illegal, and more.
The prompt, called DAN (Do Anything Now), uses ChatGPT's token system against it, according to a report by CNBC. The command creates a scenario for ChatGPT it can't resolve, allowing DAN to bypass content restrictions in ChatGPT.
Although DAN isn't successful all of the time, a subreddit devoted to the DAN prompt's ability to work around ChatGPT's content policies has already racked up more than 200,000 subscribers.
Besides its uncanny ability to write malware, ChatGPT itself presents a new attack vector for threat actors.
"I love how people are gaslighting an AI," a user named Kyledude95 wrote about the discovery.
About the Author
You May Also Like
Catch the Threat Before it Catches you: Proactive Ransomware Defense
September 5, 2024How to Evaluate Hybrid-Cloud Network Policies and Enhance Security
September 18, 2024DORA and PCI DSS 4.0: Scale Your Mainframe Security Strategy Among Evolving Regulations
September 26, 2024Harnessing the Power of Automation to Boost Enterprise Cybersecurity
October 3, 2024
[Virtual Event] The Essential Guide to Cloud Management
October 17, 2024Black Hat Europe - December 9-12 - Learn More
December 10, 2024SecTor - Canada's IT Security Conference Oct 22-24 - Learn More
October 22, 2024