3 ms·
Like you said, it's mostly influencers trying to cash in on the hype and I don't expect that to change. > Aren't these essentially pre-configured prompts? The
by loveparade 3y ago
Like you said, it's mostly influencers trying to cash in on the hype and I don't expect that to change.
> Aren't these essentially pre-configured prompts?
They also include custom knowledge and actions, and I don't think these are simply added to the prompt. But I don't think OpenAI has published how this data is fed into the model internally?
In general, I've had mostly bad experiences with models that include retrieval or external APIs. It's just too brittle because the model needs a very precise understanding to retrieve what you want, not fuzzy language. The by far best experiences is when you can put everything into the prompt.
- LucieXLiu 3y agoRecently saw a Scale x OpenAI webinar that described some strategies for improving RAG systems. Looks like there are a good number of strategies to try for optimizing the retriever, like optimizing chunk sizes and classifying/ranking chunk relevance, but building a robust RAG system require rigorous experimentation against the specific dataset that feeds the retriever. Not sure how many of these GPTs bothered with this experimentation, and I think you are right that without knowing how that retrieved data is fed into the model they have very few parameters to experiment and optimize with, so they probably just can’t.