4 ms·
It's not so easy. You seem to be under the assumption that there will be just one static system prompt doing all the work that you can customise to your needs.
by siva7 3y ago
It's not so easy. You seem to be under the assumption that there will be just one static system prompt doing all the work that you can customise to your needs. This may be true for some apps but many useful apps will usually do a bit heavier lifting.
- freedomben 3y agoI don't think even having multiple dynamic prompts removes the benefit, although for sure it gets a lot more complex to parse and understand as a human. Since the prompt(s) has/have to be rendered at some point though, even if at runtime immediately before use, it could still be made displayable to the user. Assuming this data is already in the database, it doesn't seem like an overly difficult feature to expose. And if it isn't, adding a column to capture it doesn't seem overly difficult either. Regardless, if there's a "view source" option available on GPTs that opt for it, I'm likely to check those out whereas an opaque one I'm likely going to pass on. Even if it won't work for 100% of cases, it's still an improvement to the status quo.
- siva7 3y agoI feel similiar in this regard but let's not kid ourselves. "View source" isn't something that the general population does as long as it works.
- simonw 3y agoView source is a power-user feature. Power users are important, because they're the people who figure out what something is capable of and help coach the general population in how to use it.
- IanCal 3y agoGPTs are a prompt, knowledge base (files) and external function calls. There's no dynamic system prompt. Edit - this is a simple fact, try making one yourself.
- DebtDeflation 3y ago>knowledge base (files) What is it actually doing with the files you upload? Is it just pasting the full text into the prompt? Or is it doing something RAG-like and dynamically retrieving some subset based on the query?
- simonw 3y agoThis is undocumented (frustrating) but it looks like it's chunking them, running embeddings on the chunks and storing the results in a https://qdrant.tech/ https://qdrant.tech/ vector database. We know it's Qdrant because an error message leaked that detail: https://twitter.com/altryne/status/1721989500291989585 https://twitter.com/altryne/status/1721989500291989585 It only applies that mechanism to some file types though - PDFs and .md files for example. Other file formats that you upload are stored and made available to Code Interpreter but are not embedded for vector search.
- IanCal 3y agoI've had good success putting code examples in a single txt file for our custom framework, and it seems to use that neatly for generating code. I'm surprised you've not had much success with them, I gave an assistant my wife's PhD thesis and while the API was working initially it seemed alright.
- wddkcs 3y agoDoes that error message really confirm qdrant for Chat? It's just failing to index a file called 'qdrant', and I don't see any further proof offered in that thread.
- simonw 3y agoThat's good enough evidence for me. They're clearly running a vector store (you can get further hints at that by spying on the JSON using browser DevTools). Qdrant is a very good vector store - it's powering all of the new Twitter features as of a few weeks ago. Seems much more likely to me that they're using Qdrant than this is a weird error message coincidence.