2 ms·
Ziphu has that many resources to be able to serve capacity for 1 quadrillion tokens per day on Nous portal? My bet is that it's a Composer model from Cursor run
by ggcr 1mo ago
Ziphu has that many resources to be able to serve capacity for 1 quadrillion tokens per day on Nous portal? My bet is that it's a Composer model from Cursor running on xAI cluster, they already did a Composer based on Kimi-K2.5
- LaurensBER 1mo agoThere's three options here: - The provider has a massive amount of (unused) hardware. Google or Cursor seem most likely - The model is extremely efficient, beyond anything we've seen so far - Whomever made the model has improved the cache efficiency in such a way that it's very cheap to serve. See e.g Deepseeks or Xiaomi caching (pre-price increase)
- re-thc 1mo agoOption 4: the claimed capacity is not true. Real world usage hasn’t reached anywhere close to it.
- johndough 1mo ago> 1 quadrillion tokens per day on Nous portal If you are referring to this number (https://xcancel.com/NousResearch/status/2090899914700054780 https://xcancel.com/NousResearch/status/2090899914700054780), they are either mistaken, or they mean that they can route 1 quadrillion tokens per day, but the provider behind Ox Alpha certainly can't provide that. Almost all of my requests have hit a rate limit so far.
- SyneRyder 1mo agoI was hitting 429 overloaded regularly with Ox on OpenRouter yesterday, but a lot of that turned out to be problems with my harness. I fixed some bugs, improved the back-off, and I haven't hit a 429 error since (touch wood). OpenRouter says they're doing 6 Trillion tokens a day with Ox Alpha so far, and it has been their biggest launch of all time. OpenCode claimed they had capacity for 100T a day. https://x.com/OpenRouter/status/2091912024922177562 https://x.com/OpenRouter/status/2091912024922177562 https://x.com/opencode/status/2090544355824038300 https://x.com/opencode/status/2090544355824038300