3 ms·
I've also been eagerly wanting to know more about how openAI implemented the RAG their "knowledge base" feature is based on... but details are sadly lacking. It
by isoprophlex 3y ago
I've also been eagerly wanting to know more about how openAI implemented the RAG their "knowledge base" feature is based on... but details are sadly lacking. It's hard to figure out what it is doing, and how to consistently get results.
In contrast to simonw though I've had some luck, I uploaded all the text on grugbrain.dev and got a very passable grug brain to talk to..: https://chat.openai.com/g/g-GhXedKqCV https://chat.openai.com/g/g-GhXedKqCV
- fudged71 3y agoI saw somewhere recently that if the files are small enough they actually just get appended to the prompt. For larger files there is RAG with chunks that are embedded. They will be adding more fine-grained control over the chunking and RAG configuration in the near future.
- thoughtpeddler 3y agoI'm desperately looking for more documentation on the file size / token count thresholds for this.