Whenever you're building some ad-hoc non-differentiable circumstantial hacks around your learned model (regardless of whether it's an LLM or not), two alarms sh

Whenever you're building some ad-hoc non-differentiable circumstantial hacks around your learned model (regardless of whether it's an LLM or not), two alarms should go off in your head; a) Could this be made differentiable? End-to-end systems are nearly always stronger than systems made up of multiple models or models-plus-heuristics; b) is it appropriate to be using a statistical model here at all? External intervention layers are generally severe technical debt.