4 ms·
That's the thing. LLM's can be used as a real-time teaching layer and build systems that can operate at deterministic speeds and escape hatch into a LLM when co
by slrainka 13d ago
That's the thing. LLM's can be used as a real-time teaching layer and build systems that can operate at deterministic speeds and escape hatch into a LLM when confidence levels drop. This approach has helped us save more than $1 Million annually against the straight LLM classifiers at scale (and pass that on to the customers)
https://sureshsubasinghe.substack.com/p/how-to-cut-agent-llm-costs-by-85 https://sureshsubasinghe.substack.com/p/how-to-cut-agent-llm...
https://sureshsubasinghe.substack.com/p/the-god-model-fallacy-how-to-double https://sureshsubasinghe.substack.com/p/the-god-model-fallac...