Damus
David Chisnall (*Now with 50% more sarcasm!*) profile picture
David Chisnall (*Now with 50% more sarcasm!*)
@David Chisnall (*Now with 50% more sarcasm!*)
I posted elsewhere, but I really don't like the term 'prompt injection' because it implies that a prompt is somehow special and separated from the rest of the token stream and that you're bypassing some level of separation that simply doesn't exist with LLMs. It's like saying 'authentication bypass' when you're talking about a system that doesn't do authentication.

So can we come up with a term that implies clearly that this is expected behaviour for LLMs?
4
Shane Celis · 3d
nostr:nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpqncxka2nmkqkndk4wkuf3tz3l39z9m8xax3aen3h8tvudwgjmf5mq4uv2v2 llmancy
Will · 3d
nostr:nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpqncxka2nmkqkndk4wkuf3tz3l39z9m8xax3aen3h8tvudwgjmf5mq4uv2v2 I use the word "prefix" sometimes (e.g. "prefix modification"), since that's exactly what it is: an LLM is a statistical prefix continuation machine, and all of the system prompt, user p...
Bart Smit △ ⲁⲗⲍⲓⲙⲟⲛ 🇪🇺🇺🇦 · 3d
nostr:nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpqncxka2nmkqkndk4wkuf3tz3l39z9m8xax3aen3h8tvudwgjmf5mq4uv2v2 overprompting?
Dave Wilburn :donor: · 3d
nostr:nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpqncxka2nmkqkndk4wkuf3tz3l39z9m8xax3aen3h8tvudwgjmf5mq4uv2v2 Prompt phreaking?