4 ms·
Cost is one aspect, but what about ingest time? You’re adding significant processing time to your pipeline with this method right?
by davedx 2y ago
Cost is one aspect, but what about ingest time? You’re adding significant processing time to your pipeline with this method right?
- simonw 2y agoI expect most implementations of RAG don't mind this too much - if you're dealing with only a few hundred more pages of documents a day the ingestion time from using fancy tricks like this is going to be measured in minutes.