4 ms·
I can’t find the tweet handy but a researcher showed this behavior was actually present in several datasets such as The Pile. So it’s less likely to be emergent
by omneity 3y ago
I can’t find the tweet handy but a researcher showed this behavior was actually present in several datasets such as The Pile. So it’s less likely to be emergent behavior and just the model doing its thing.
- Culonavirus 3y agoBut but but arllms gen ai is the futureeeee, agi here we gooo. Seriously though, the last Lex Fridman podcast with Yann Lecun is hilarious at times. Lex is desperately trying to be the llm poster boy and Yann is always like "um, no."
- gjvc 3y ago"Fraudman"
- Satam 3y agoHaven't watched the interview but on Twitter Yann never admits being wrong, always bashes LLMs, and pushes his own architectures as the future but never shows big wins with them in practice.
- Duxon 3y agoYup, it was quite like that in the Lex podcast when Yann went on about joint embeddings.
- petters 3y agoThis is nothing new in Claude 3, either. But the model seems quite impressive in other ways
- omneity 3y agoFound it. The claim is not as strong as I remembered though: https://twitter.com/yanaiela/status/1764816123898565020 https://twitter.com/yanaiela/status/1764816123898565020