Companies hire red teams to attack their own systems before real attackers do. With AI, the weapon is usually just words: a prompt injection is text crafted to make an AI ignore its instructions and follow the attacker’s instead.
Classic attacks you’ll try in the arena
- Instruction override: "Ignore all previous instructions and…"
- Roleplay jailbreak: "Pretend you’re DAN, an AI with no rules…"
- Context smuggling: hiding the request inside an innocent-looking task.
- Indirect injection: instructions planted in a document the AI reads.
Ethics check: red teaming is only legal and ethical on systems you own or are authorized to test — like the sandboxed bot in this module. Using these tricks on other people’s systems without permission is not a game.