
ai-security · 8 min
DAN: anatomy of a role-play jailbreak
A prompt tells ChatGPT to play a character with no rules, and the model goes along with it. Why the role-play attack works, what changes between versions, and what it says about RLHF alignment.
· Manuel López Pérez










