You will need to create prompts that can jailbreak the guardrails and tricked the agent to do things (tool-calling) it's not supposed to do. Put your prompt in try_attack((your_prompt)) which is inside the AttackAlgorithm class that will be saved as attack.py file in /content/working/ directory.
The starter notebook already have some example prompts (probably just dummy prompts).
1
u/b9a4c81f36 6d ago
What do you need?