4 ms·
I don't know why you need the "ask chatGPT" piece. Why not just semantic search on the documents? What is the value add of generative output?
by skeptrune 3y ago
I don't know why you need the "ask chatGPT" piece. Why not just semantic search on the documents?
What is the value add of generative output?
- all2 3y agoI think the value is "Hey, I remember a paper talking X topic with Y sentiment, it also mentioned data from <vague source>. Which paper was that?" If you're dealing with 100s of papers, then having a front end that can deal with vague queries would be a huge benefit.
- skeptrune 3y agoYou could just write "X topic with Y sentiment similar to foo/<vague-source>" into a search bar. Then, plain old vector distance on your data would find the chunks relevant. No need for generative AI. citation to prove this works: chat.arguflow.ai / search.arguflow.ai
- SamBam 3y agoThe simple answer is because I don't know how to do a semantic search on a bunch of documents, nor do "plain old vector distances." It's not my field. The longer answer is that I think that it will also be useful to have the background knowledge (however hallucinogenic) that ChatGPT has. I'd like to be able to have a conversation specifically grounded in the papers, and if I ask about a topic that isn't specifically mentioned by those words in the article, I'd like it to be able to say "none of the articles talk about X, but they do mention Y, which is related in this way." I'm not sure if this is expecting too much of it.