3 ms·
Sure. But that's not what was being suggested in the comment I responded to. (There are also problems with what you're suggesting, though, such as the summary
by phyzome 3mo ago
Sure. But that's not what was being suggested in the comment I responded to.
(There are also problems with what you're suggesting, though, such as the summary report still being ripe for abuse in similar ways as the blog post describes.)
- angry_octet 3mo agoYou can structure the system to cause an LLM an answer structured questions, Y/N or from a structured list of options, or with numeric weights against labels, and then use classical parsing to enforce a compliant response submission, and you do that for random batches of comments, then have another LLM summarise the survey response. It is quite possible to extract sentiment and key topics. I don't think it's useful to throw your hands in the air and say LLM context statistics are ungovernable. Both context hardening and action shielding architectures are addressing this, and in combination with well designed pipelines the risk is controllable.
- phyzome 3mo agoSure, what you're describing should be relatively safe from prompt injection. It's a lot less capable than the original, of course. I'm not saying "it's impossible to get an LLM to do anything safely", just that you have to really scale back on your goal.