3 ms·
Yes, I read "Attention Is All You Need", and I understand that the multi-head generative pre-trained model talks about "tokens" rather than language specificall
by cratermoon 3y ago
Yes, I read "Attention Is All You Need", and I understand that the multi-head generative pre-trained model talks about "tokens" rather than language specifically. So in this case, I'm using "LLM" as shorthand for what OpenAI is doing with GPTs. I'll try to be more precise in the future.
That still leaves disagreement between Altman and Sutskever over whether or not the current technology will lead to AGI or "superintelligence", with Altman clearly turning towards skepticism.
- Chamix 3y agoFair enough, shame "Large Tokenized Models" etc never entered the nomenclature.
- cratermoon 3y agoSome terms I've seen used for the technology: Big-Data Statistical Models Stochastic Parrots or parrot-tech plausible sentence generators glorified auto-complete cleverbot "a Blurry JPEG of the Web" <https://www.newyorker.com/tech/annals-of-technology/chatgpt-is-a-blurry-jpeg-of-the-web https://www.newyorker.com/tech/annals-of-technology/chatgpt-...> and just plain ol' "machine learning"