3 ms·
I read Rodney's past predictions on LLM's. There's not a _single_ one that was high information. Not a single one that made me go "hey this was actually a good
by simianwords 2mo ago
I read Rodney's past predictions on LLM's. There's not a _single_ one that was high information. Not a single one that made me go "hey this was actually a good call, it was very hard to catch that in hindsight".
Almost all his predictions were low signal, just correcting the hype and doom from extremes.
If I'm wrong, please show me one thing he said (almost everyone has one thing tbh but lets see) that would make everyone go: yeah this guy had foresight.
Edit: he made some directional claims on LLM's: that they were so hyped that OpenAI was not even worth the $30 billion valuation in 2024[1]. It is now worth ~$1 trillion. For a pundit who puts his reputation on the line on single falsifiable claims like this, he has a really bad prediction pattern. Like, the one high signal claim he made turned out to be 25x incorrect!
What annoys me is that this archetype of anti-hypers had ONE job. That is to get the ONE hype correct. But they still miss that. Anyone can keep correcting the hype and they would be right 90% of the time.
[1] https://spectrum.ieee.org/gpt-4-calm-down https://spectrum.ieee.org/gpt-4-calm-down
- ghaff 2mo agoI think he's generally been right with autonomous driving skepticism even if, arguably, still too optimistic himself.
- simianwords 2mo agoSorry if I was not clear, I meant predictions within LLMs. I agree that he is directionally correct in self driving cars.
- myk9001 2mo ago> It is now worth ~$1 trillion... Oh, so they went public after all. When?
- simianwords 2mo agoThey didn't, its an estimate.
- jeffreyrogers 2mo ago> Like, the one high signal claim he made turned out to be 25x incorrect! He has dozens of high signal claims in his prediction blog posts. Picking out one of the ones he got wrong doesn't tell you much. Overall his track record is pretty good. Definitely better calibrated than most people, especially the very anti and very pro LLM people.