3 ms·
With longer (50k+) context lengths, is this just becoming a new form of search?
by AvAn12 4y ago
With longer (50k+) context lengths, is this just becoming a new form of search?
- jmole 4y agoI think the K,Q,V representation was what fundamentally gave rise to LLMs (from "Attention is all you need"), and I'm certain that it wouldn't have happened without the researchers having a background in search @ Google. Or in other words, it was always a new form of search.
- bckr 4y ago[Astronaut looking at earth with the logo of superhuman AI superimposed] Wait, it’s all just search? [astronaut with gun] Always has been
- intalentive 4y agoYes, now we just need it to provide citations.