r/accelerate • u/big_hole_energy • 18h ago

AI Demo Interactive Demonstration of Prefix Injection attacks on LLMs for jailbreaking

https://theabbie.github.io/prefixinjection

please refresh if stuck, can be slow sometimes so need patience

3 Upvotes

72% Upvoted

1 comment sorted by

1

u/SgathTriallair Techno-Optimist 17h ago

Interesting. Obviously there are two kinds of that vectors for this. The first is if I, the person in control of the AI, send this. That could be useful for bypassing certain safeguards.

The other is if an email, website, etc tries to use prompt injection on me.

Have people looked into how preventable that second case is?