3 ms·
Is that something easily handed off to a faster/cheaper LLM? I'm imagining something like running the main process through GPT-4 and hand of the hallucinations
by taberiand 3y ago
Is that something easily handed off to a faster/cheaper LLM? I'm imagining something like running the main process through GPT-4 and hand of the hallucinations to GPT 3 turbo.
If you could spot the need for it while streaming a response you could possibly even have it ready ahead of time