3 ms·
> My take is that LLMs are actually much better at "reading" than they are at "writing", and RAG plays to that strength. They are certainly much faster at read
by cubefox 3y ago
> My take is that LLMs are actually much better at "reading" than they are at "writing", and RAG plays to that strength.
They are certainly much faster at reading than at writing. In fact, they re-read the entire context window for every token they write!
- rolisz 3y agoI think there is some caching of some of the computation