3 ms·
this embeds words with word2vec, which is like 10 years old. at least use BERT or sentencetransformers :)
by swyx 1y ago
this embeds words with word2vec, which is like 10 years old. at least use BERT or sentencetransformers :)
- gthompson512 1y agoI have been thinking a bit lately about how much sense that makes compared to just using word vectors, since traditional queries are super short and often keyword based(like searching for "ground beef" when wanting "ground beef recipes I can cook easily tonight") and so lack most of the context that BERT or similar gives you. I know there are methods like using seperate embeddings for queries and such, but maybe a basic word based search could be more useful, especially with something like fastText for out of vocabulary terms.