3 ms·
This is super cool, it feels like going in the direction of the "deep"/high level type of semantic searching I've been waiting for. I like their examples of bas
by OmarShehata 2y ago
This is super cool, it feels like going in the direction of the "deep"/high level type of semantic searching I've been waiting for. I like their examples of basically filtering documents for the "concept" of price increases, or even something as high level as a rhetorical question
I wonder how this compares to training/fine tuning a model on examples of rhetorical questions and asking it to find it in a given document. This is maybe faster/more accurate? Since it involves just looking at neural network activation, vs running it with input and having it generate an answer...?
- f0e4c2f7 2y agoExa is trying to do this. I've found some sort of interesting stuff this way but it honestly doesn't feel quite good enough yet to me. https://exa.ai/search?c=all https://exa.ai/search?c=all
- andai 2y agoExa's top hit for this article: https://openai.com/index/language-models-can-explain-neurons-in-language-models/ https://openai.com/index/language-models-can-explain-neurons...