14 ms·
Ok speed (202.7 tok/s) and value (1.25 -> 2.50) look great, with pretty decent intelligence.
by mythz 6mo ago
Ok speed (202.7 tok/s) and value (1.25 -> 2.50) look great, with pretty decent intelligence.
- pzo 6mo agoThe problem with speed is that they usually are very fast for first few weeks and then suddenly much slower. They did such trick when they advertised Grok 4 fast ( dropped from 200 tps to 60tps)
- victorbjorklund 6mo agoWow. That is a big drop.
- polski-g 6mo agoGrok 4.1 is still 110tps. The only other model that comes close is Gemini at 85tps.
- catcowcostume 6mo ago[flagged]
- MrDrDr 6mo agoPlease elaborate.
- nesk_ 6mo agoPrediction is not intelligence.
- mirekrusin 6mo agoMisprediction is?
- IshKebab 6mo agoSome people have this strange idea that only "whatever humans do" counts as intelligence, despite the fact that a) we don't really have a clue what humans do, and b) "intelligence" is definitely not that strictly defined. I think they're just trying to feel like they know some important truth that other people don't.
- MrDrDr 6mo agoAgreed. I see this debate as an active discussion as to what intelligence is, not how it's currently (poorly) defined This is a philosophical discussion, and there is no correct answer, but IMO some answers will prove more useful than others. I would like to define intelligence as the ability to solve problems. Lots of other life forms have this ability, and its clear that LLMs also have this. Now, while they may not be poetic (in the literal sense of the word), or conscious, in that 'they' do not experience the world. I think there is a strong case for arguing they conform to a meaningful definition of intelligence. They solve problems.
- exe34 6mo agoWhat does intelligence mean to you?
- kuboble 6mo agoI don't remember the source of the quote. But debating whether the models are intelligent is slim to debating whether a car can walk. You can offload to the model a lot of work that until recently we thought requires intelligence. The more and better of those tasks the model can do, it's fair to call it intelligence*
- NitpickLawyer 6mo ago"The question of whether a computer can think is no more interesting than the question of whether a submarine can swim." - Edsger Dijkstra
- Cakez0r 6mo ago202.7 tok/s is only OK speed? Which providers are you using that are significantly better than that?
- mritchie712 6mo agofor reference, it's the 2nd fastest model tracked in the "Highlights" section of https://artificialanalysis.ai/ https://artificialanalysis.ai/
- mythz 6mo agoI said speed was great, Cerebas and Groq can provide better performance, likewise Fast versions of Cursor's Composer and Claude. The reported speed like benchmarks is only a reported number on paper, we'll see how it holds up in real world usage, so far OpenRouter is only reporting 73tps [1] https://openrouter.ai/x-ai/grok-4.3 https://openrouter.ai/x-ai/grok-4.3
- energy123 6mo agoValue should be calculated some other way, like cost per task completion or something.
- XCSme 6mo agoTheir stats look ok, but when I tested it[0], it was 4x slower than 4.20. [0]: https://aibenchy.com/compare/x-ai-grok-4-20-medium/x-ai-grok-4-3-medium/ https://aibenchy.com/compare/x-ai-grok-4-20-medium/x-ai-grok...