3 ms·
Not to dogpile on all the other "isn't this just" messages, but isn't this just sparse embeddings?
by lgas 3y ago
Not to dogpile on all the other "isn't this just" messages, but isn't this just sparse embeddings?
- lmeyerov 3y agoYeah I'm struggling to understand at a fundamental level how this is better both in math + engineering, doubly so by the time you get to sentence embeddings . (Genuinely, it seems to use the same ideas, so curious what the specific trick is vs mature embedding packagings already doing much of this afaict.)
- mmcwilliams 3y agoYou're not wrong. This sounds curiously close to the ways I've seen word2vec used in production.