2 ms·
We broadly do. It's called multiple passes. It's just 2-3x more expensive to run a prompt and then the prompt and response though a secondary fine tuned model
by kromem 3y ago
We broadly do.
It's called multiple passes.
It's just 2-3x more expensive to run a prompt and then the prompt and response though a secondary fine tuned model to detect injection when the cost is so low impact.
So no one is doing it.