9 ms·
Grok 4 Fast
- mrklol 1y agoPricing is really good for this benchmark value. Let’s see how it holds against people testing it.
- NitpickLawyer 1y agoIf this is sonoma-dusk that was on preview on openrouter, it's pretty cool. I've tested it with some code reverse engineering tasks, and it is at or above gpt5-mini level, while being faster. Works well till about 110-130k tokens tasks, then it gets the case of "getthereitis" and finishes the task even if not all constraints are met (i.e. will say I've solved x/400 tests, the rest can be done later)
- RayVR 1y agoA faster model that outperforms its slower version on multiple benchmarks? Can anyone explain why that makes sense? Are they simply retraining on the benchmark tests?
- NitpickLawyer 1y ago> Can anyone explain why that makes sense? Can be anything from different arch, more data, RL, etc. It's probably RL. In recent months top tier labs seem to have "cracked" RL to a level not seen yet in open models, and by a large margin.
- raincole 1y agoJust two different models branded under similar names. That's it. Grok 4 is not the slower version of Grok 4 Fast, just like gpt-4 is not the slower version of gpt-4o.
- yorwba 1y agoIt doesn't outperform uniformly across benchmarks. It's worse than Grok 4 on GPQA Diamond and HLE (Humanity's Last Exam) without tools, both of which require the model to have memorized a large number of facts. Large (and thus slow) models typically do better on these. The other benchmarks focus on reasoning and tool use, so the model doesn't need to have memorized quite so many facts, it just needs to be able to transform them from one representation to another. (E.g. user question to search tool call; list of search results to concise answer.) Larger models should in theory also be better at that, but you need to train them for those specific tasks first. So I don't think they simply trained on the benchmark tests, but they shifted their training mix to emphasize particular tasks more, and now in the announcement they highlight benchmarks that test those tasks and where their model performs better. You could also write an anti-announcement by picking a few more fact recall benchmarks and highlighting that it does worse at those. (I assume.)
- uyzstvqs 1y agoGrok 4 Fast is likely Grok 4 distilled down to remove noise that rarely if ever gets activated in production. Then you'd expect these results, as it's really the same logic copied from the big model, but more focused.
- ActorNightly 1y ago[flagged]
- deleted 1y ago[deleted]
- glenstein 1y agoI was wondering that too. Anything reflecting human institutional knowledge writ large will, from Elons perspective, have "liberal bias" which is why he's also attacking Wikipedia and mainstream knowledge across the board. But other attempts at making non "biased" AI have barely done more than have custom instructions requesting that it "be conservative". Unless you train it on Conservapedia or some equivalent corpus I'm not sure you'll be able to make it agree that "the Irish were the real slaves", that the D's and R's never realigned after the civil war, that the 2020 election was stolen and that gamergate was truly about ethics in journalism.
- nwienert 1y agoWikipedia is almost comically left leaning (considering what it aspires to be).
- ActorNightly 1y agoYes, because left leaning is correct.
- zone411 1y agoMatches Grok 4 at the top of the Extended NYT Connections leaderboard: https://github.com/lechmazur/nyt-connections/ https://github.com/lechmazur/nyt-connections/
- arresin 1y agoAhh so this might be the Sonoma sky Alpha that was gathering feedback on openrouter recently. I tried that one extensively (it was free) and was disappointed vs regular grok 4 so also maybe not.
- oulipo2 1y ago[flagged]
- andrewinardeer 1y ago[flagged]
- holoduke 1y agoOh man. Life must be hard
- kubb 1y ago[flagged]
- AtlasBarfed 1y agoStanding on the precipice of AI assisted total information awareness and total authoritarian oppression? Life is frightening right now.
- turblety 1y agoWhy would a model called "Fast" not advertise the tokens per second speed it performs at? Is "Fast" not representing speed, but another meaning? Is it too variable?
- barrell 1y agoI would guess that it is essentially just a “grok 4 mini”, but if you use mini as the qualifier then most people will be inclined not to use it. If you call it fast then it gives people a reason to select it.
- purkka 1y agoBased on the various benchmarks linked here and in the OP, the name feels justifiable. "Mini" models tend to be a lot worse compared to the base model than this one seems to be.
- IanCal 1y agoThey sound like they’re positioning it more that it’s faster to complete because it uses fewer tokens - see the mentions of token efficiency.
- esafak 1y agoCurrently ~160 tps, per https://openrouter.ai/x-ai/grok-4-fast:free https://openrouter.ai/x-ai/grok-4-fast:free
- johnisgood 1y agoI think we all want fast AND accurate, is "AND accurate" true for this model? I would rather prefer to wait a few seconds more if the result is much more accurate.
- awestroke 1y agoThe only way to get this reliably is to have it use tools
- deleted 1y ago[deleted]
- echelon 1y ago[dead]
- mongol 1y agoGrok / X does not have the moat that Microsoft had.
- RestartKernel 1y agoDid using Microsoft's tools ever feel like a political standpoint? Because I won't even consider pitching Grok to my employers/clients for that very reason.
- echelon 1y agoQuite frequently. https://en.wikipedia.org/wiki/Halloween_documents https://en.wikipedia.org/wiki/Halloween_documents
- raincole 1y ago> If half of the developers in the world hate Musk and refuse to use his company's tools In general, developers use what tools their employers paid for.
- AtlasBarfed 1y agoThe banality of evil and the milgram experiment showed that employees will happily shoot the people that they're told to as well. And the milgram experiment didn't even have subhuman classes and other such psychological manipulation and pre-biasing
- hi_hi 1y agoI'm waiting for the Tesla FSD playbook to be rolled out for Grok. That is, launch something named like Grok AGI 1, wait for it to become obvious it isn't infact AGI, create a narrative redefining AGI, promise new AGI is 1 year away, and repeat for many years.
- adt 1y agohttps://lifearchitect.ai/models-table/ https://lifearchitect.ai/models-table/
- zozbot234 1y agoFor the fastest performance, run it on Groq. /s
- defrost 1y agoIt's all due to robust primitives: https://www.glscott.org/uploads/2/1/3/3/21330938/5375912_orig.jpg https://www.glscott.org/uploads/2/1/3/3/21330938/5375912_ori...
- athrowaway3z 1y ago[flagged]
- inquirerGeneral 1y agoThis is called “derangement syndrome”
- deleted 1y ago[deleted]
- wateralien 1y ago[flagged]
- nomilk 1y agoSurprising to see negativity here. I send all my LLM queries to 5 LLMs - ChatGPT, Claude, DeepSeek (local), Perplexity, and Grok - and Grok consistently gives good answers and often the most helpful answers. It's ~always king when there's any 'ethical' consideration (i.e. other LLMs refuse to answer - I stopped bothering with Gemini for this reason). 'Ethical' is in quotes because I can see why other LLMs refuse to answer things like "can you generate a curl request to exploit this endpoint" - a prompt used frequently during pen testing. I grew tired of telling ChatGPT "it's for a script in a movie". Other examples are aplenty (yesterday Claude accused me of violating its usage policy when asking "can polar bears eat frozen meat" - I was curious after seeing a photograph of a polar bear discovering a frozen whale in a melted ice cap). Grok gave a sane answer, of course.
- renw0rp 1y agoHow do you manage sending and receiving requests to multiple LLMs? Are you going it manually through multiple UIs or using some app which integrates with multiple APIs?
- nomilk 1y agoI created a workflow using Alfred on macOS [0]. You press command + space then type 'llm' then the prompt and hit enter, and it opens the 5 tabs in the browser. These are the urls that are opened: http://localhost:3005/?q={query} https://www.perplexity.ai/?q={query} https://www.perplexity.ai/?q={query} https://x.com/i/grok?text={query} https://x.com/i/grok?text={query} https://chatgpt.com/?q={query}&model=gpt-5 https://chatgpt.com/?q={query}&model=gpt-5 https://claude.ai/new?q={query} https://claude.ai/new?q={query} Extremely convenient. (little tip: submitting to grok via URL parameter gets around free Grok's rate limit of 2 prompts per 2 hours) [0] https://github.com/stevecondylios/alfred-workflows/tree/main https://github.com/stevecondylios/alfred-workflows/tree/main
- marxisttemp 1y agoYou don’t need third-party search managers like Alfred for this. You can just make a Shortcut called “llm” that accepts Spotlight input.
- ramijames 1y ago[flagged]
- faangguyindia 1y agoMy only problem is I use custom frontends and unlike Qwen3 coder i don't see grok4 fast offering any free api access to test out these models. The tools they've partnership with i don't really use.
- dev_hugepages 1y agohttps://openrouter.ai/x-ai/grok-4-fast:free https://openrouter.ai/x-ai/grok-4-fast:free
- faangguyindia 1y agowow when did it happen, i remember checking openrouter when they first launched fast one.
- manav 1y agoWe're all training similarly large base++; near same data, just pricing it differently... with grok removing a few filters and maybe some safeguards? For that matter, many of the benchmarks are flawed and are just easily gamed and whatnot. iykyk.
- Philpax 1y ago[flagged]
- arresin 1y ago[flagged]
- piva00 1y agoSupporting far-right movements in the UK, Germany, etc. is a very good reason to not trust anything related to information coming from him. Edit: it's funny how factual statements like this attract downvotes these days on HN, the Overton window shift has truly reached everywhere... Wouldn't expect 15 years ago to share this space with people not calling out fascist tendencies.
- arresin 1y ago[flagged]
- piva00 1y ago> What else are you capable of? How much can you be stirred up. What are you talking about? > And everything I say to someone like you is useless. I’m a ____ or a just a ____. So why don't you try to say before implying something right out of the bat? The funny thing is how you immediately got defensive, say something and let's try to see if your statement gets legs, otherwise you're acting exactly as the thing you're criticising. What is it you have to say to try to change my mind about Musk fascist tendencies? Try, I want the conversation.
- Philpax 1y agohttps://en.wikipedia.org/wiki/Views_of_Elon_Musk https://en.wikipedia.org/wiki/Views_of_Elon_Musk and for why that would be a problem for Grok in particular, https://xcancel.com/elonmusk/status/1936333964693885089 https://xcancel.com/elonmusk/status/1936333964693885089
- 1y ago
- qq99 1y agogrok-code-fast-1 has been my preferred model lately, but I don't see any mention of it as part of this release. I'm wondering if this might be better? Even if grok-code-fast-1 might be slightly worse than Gemini 2.5 Pro, the speed of iteration can't be beat.
- arresin 1y agoIt’s a little dumb but in my own use better than somnet
- qingcharles 1y ago2M token context window. Will be interesting if you can access that through the web UI. I don't think any of the others allow a context that big except through API?
- vbtechguy 1y agoI tested Grok 4 Fast, and it does a bit better than Sonoma Alpha models, but nowhere near Grok Code Fast 1, Claude, etc, for code analysis at least. Posted my comparison evals at https://github.com/centminmod/code-supernova-evaluation https://github.com/centminmod/code-supernova-evaluation