4 ms·
RAG still has lots of benefits for anyone paying per input token (e.g. over APIs).
by drusepth 2y ago
RAG still has lots of benefits for anyone paying per input token (e.g. over APIs).
- azinman2 2y agoNot to mention latency
- disgruntledphd2 2y agoAnd grounding for the model. Smaller models with tend to hallucinate a little less (anecdotally).