3 ms·
The downside is the pre prosessor probably need to be a LLM of equal or greater capacity, and if that is the case then costs are doubling. I suspect they do ha
by teruakohatu 3y ago
The downside is the pre prosessor probably need to be a LLM of equal or greater capacity, and if that is the case then costs are doubling.
I suspect they do have a heuristic or traditional NLP prompt checker, but it can only be so good before it becomes expensive.
Is leaking the prompt such a big deal to be worth extra cost? Anyone who works with LLMs could have written it, it is not special. Prompt injection is a far more serious problem.