3 ms·

I think the K,Q,V representation was what fundamentally gave rise to LLMs (from "Attention is all you need"), and I'm certain that it wouldn't have happened wit

by jmole 4y ago

I think the K,Q,V representation was what fundamentally gave rise to LLMs (from "Attention is all you need"), and I'm certain that it wouldn't have happened without the researchers having a background in search @ Google. Or in other words, it was always a new form of search.

bckr 4y ago
[Astronaut looking at earth with the logo of superhuman AI superimposed] Wait, it’s all just search? [astronaut with gun] Always has been