4 ms·
I would have loved some elaboration on how "the data" came to be. It appears in the sample app that each document is some subset of technical docs? That can be
by phillipcarter 3y ago
I would have loved some elaboration on how "the data" came to be. It appears in the sample app that each document is some subset of technical docs? That can be helpful, but when each document is very large you run into token limitations and increased probability of hallucinations. That's what I ran into when I tried to build a similar application that offers "GPT over docs". Figuring out your strategy for splitting documents isn't trivial.
- ajcp 3y agoIt's not and that's why most of these solutions utilize an indexing/search service to provide more targeted data to feed into "context" instead of just burning tokens with whole/chunked docs.