3 ms·
Given the 750 tok/sec GPT 5.6 Sol Ultrafast (via Cerebras), the many-1000 tok/sec Chinese models, and the 15000 tok/sec Taalas HC1, I think we're well on the wa
by perching_aix 2mo ago
Given the 750 tok/sec GPT 5.6 Sol Ultrafast (via Cerebras), the many-1000 tok/sec Chinese models, and the 15000 tok/sec Taalas HC1, I think we're well on the way towards seeing that solved too. Combine the two, and yeah, wild ride incoming.
What's especially bewildering to me is that translated back to raw bandwidth, even 15000 tok/sec is just like what, 75 KB/s? Extremely meager amounts of data, moving mountains.
It's already kinda funny seeing LLMs throw out effort estimates in wall time terms. It's always some "hours, days, weeks" tier thing, when in reality, it's gone and done in minutes.
- cactusplant7374 2mo agoOne of my projects has an estimate of 3,000+ hours. It seems accurate. It has spent months working on it.
- perching_aix 2mo agoAround the clock?
- cactusplant7374 2mo agoYes, with a few exceptions. It's much easier now that the five hour limit has been removed from codex.
- wyre 2mo agoCan I ask what you are working on?
- cactusplant7374 2mo agoI'm working on emulators with AOT and JIT.
- newAccount2025 2mo agoHaha. Yeah. I somehow find Claude Code’s utter lack of time reasoning to be very fun. “The work we did two weeks ago…” oh friend that was this morning…