6 ms·
Oh! I think I understand. So your software takes a prompt from me, does non-GPT work to find additional context from your source (the books, parsed and re-str
by Waterluvian 4y ago
Oh! I think I understand.
So your software takes a prompt from me, does non-GPT work to find additional context from your source (the books, parsed and re-structured into word vectors or whatnot), and then asks GPT my prompt combined with the added context?
Like,
“What are the three foobars when considering these passages from a book <…> ?”
- bealuga 4y agoYeah more or less! I still use open ai for their embeddings (translating text into vector space) - Your question -> vectors with open ai embeddings - Text you uploaded before -> vectors with open ai embeddings Get the most similar above a certain threshold, and then add it to the prompt saying "From these articles / paragraphs, answer the user's question: What are the three foobars" So yep! I preprocess it
- Waterluvian 4y agoI think that’s a really clever idea. It feels like training is analogous to years of growing up and going school. And what you’ve done is taken that educated “mind” and said, “here’s a document. I’m going to quiz you on it.” That seems really practical compared to sending an AI back to school to learn all about some specific topic. I wonder if we will end up with a library of trained models, each of which went to different schools to obtain different focuses of knowledge. Maybe LiteratureGPT is better suited for this than General GPT or ProgrammerGPT. Okay I think I’ve stretched the analogy far enough.