3 ms·
> Because it's true, right? No, while sometimes there are barriers that take a giant leap to cross, progress tends to involveots of steps that were simple, eve
by dragonwriter 3y ago
> Because it's true, right?
No, while sometimes there are barriers that take a giant leap to cross, progress tends to involveots of steps that were simple, even if time consuming to execute, once the preceding pieces were in place.
- simonw 3y agoIf there genuinely is a simple solution to prompt injection that's been eluding us all for 13 months I cannot wait to learn what it is!
- danShumway 3y agoAfter over a year of hearing people say this, at some point the burden of proof shifts to the people making the claim. There was a period where LLMs were extremely inaccessible to train where it would have been reasonable to say "the mitigation is easy, but OpenAI hasn't done it." But nowadays, indie models and freeware models are much more common, and there are even models with open datasets. Fine tuning can be done on a Macbook. Purchasing compute to fully replicate a smaller model is within reach of a lot of people. There is still a cost involved, it's not trivial -- but it's a lot more accessible than it used to be. So at what point is it reasonable to respond to the people saying, "it's easy, just do X" with "well, do it then."? If the training method you're describing works, then what is preventing someone from training a 7B model over the next week that's invulnerable to prompt injection?