2 ms·
This type of behavior seems like it should be something that should be (relatively) easy to fix with some kind of external intervention layer. Google has been a
by Workaccount2 2y ago
This type of behavior seems like it should be something that should be (relatively) easy to fix with some kind of external intervention layer. Google has been able to answer queries without using LLMs for some time now, so maybe some kind of pre-check followed by a prompt injection to stiff-arm the LLM in the right direction.
- adw 2y agoWhenever you're building some ad-hoc non-differentiable circumstantial hacks around your learned model (regardless of whether it's an LLM or not), two alarms should go off in your head; a) Could this be made differentiable? End-to-end systems are nearly always stronger than systems made up of multiple models or models-plus-heuristics; b) is it appropriate to be using a statistical model here at all? External intervention layers are generally severe technical debt.
- arrowsmith 2y agoWhat does it mean to "make something differentiable"?
- adw 2y agoImplement it as part of the network, not as a discrete system outside of it.