3 ms·
Not a huge fan of @sama, but he is quoted as saying: this is the worst these models will every be! Puts all criticism in a new perspective.
by 1024core 7mo ago
Not a huge fan of @sama, but he is quoted as saying: this is the worst these models will every be!
Puts all criticism in a new perspective.
- cactusplant7374 7mo agoThat assumes he is all knowing.
- slopinthebag 7mo agoThat's like Bill Gates saying XP is the worst Windows will ever be
- k1musab1 7mo agoAged like milk.
- usef- 7mo agoNot Windows: Operating systems. We did get more capable operating systems. The point of the quote is "this is the worst the SOTA will ever be". If Windows XP were fully supported today I still wouldn't use it, personally, despite having respect for it in its era. The core technology of how, eg OS sandboxing, security, memory, driver etc stacks are implemented have vastly improved in newer OSes.
- slopinthebag 7mo agoYou're just moving the goal posts unfortunately. The point is that positive progress is never actually guaranteed.
- usef- 7mo agoOf course not. But I believe your Windows example was implying fundamental tech got worse. The original "worst" quote is implying SOTA either stays the same (we keep using the same model) or gets better. People have been predicting that progress will halt for many years now, just like the many years of Moore's law. By all indications AI labs are not running short of ideas yet (even judging purely by externally-visible papers being published and model releases this week). We're not even throwing all of what is possible on current hardware technology at the issue (see the recent demonstration chips fabbed specifically for LLMs, rather than general purpose, doing 14k tokens/s). It's true that we may hit a fundamental limit with current architectures, but there's no indication that current architectures are at a limit yet.