4 ms·
how did you make this - was this done with embeddings? the brute force way (sending all the data as part of a chat context) seems unscalable at your level btw
by purplecats 4y ago
how did you make this - was this done with embeddings? the brute force way (sending all the data as part of a chat context) seems unscalable at your level
btw would love to see this for other subreddits or reddit in general where it weighs certain subreddits more heavily when answering questions tailored towards them
- norgie 4y agoSeems like calling it ChatGPT might be a little misleading, their description implies they fine-tuned another pretrained GPT model, like GPT-2/3/neo or something, which seems fine for this use case
- devel12 4y ago>Look up similar posts based on the question and summarize the answer They are matching the query with the document embeddings and summarizing the top few matches. I'm guessing, only the summarization step makes use of ChatGPT. Calling it a chatbot is slightly misleading. It's more of a question answering system over external documents.