13 ms·
> with all of this traffic served on Chinese AI chips RIP Nivida shareholders
by sunbum 1mo ago
> with all of this traffic served on Chinese AI chips
RIP Nivida shareholders
- ChoosesBarbecue 1mo agoGod I wish I could’ve shorted NVIDIA right now
- browningstreet 1mo agoIt's earnings day for them...
- kingstnap 1mo agoWhats stopping you? You could buy puts right now. Get a 210 strike put contract and if your thesis is that nvidias current 10 day slide continues you could make some money.
- outworlder 1mo agoUnless NVidia craters you are likely to lose money given the IV crush that will happen today.
- Bluestein 1mo agoThis is the takeaway here: That's how they have been serving it at scale as Ox-Alpha. This is a definitional moment.- Further quote: "Compared with our initial baseline on the same hardware, we achieved a 3× improvement in end-to-end serving performance, reaching hardware efficiency and per-token cost comparable to mainstream NVIDIA GPUs. This demonstrates that Chinese chips can support frontier-model inference efficiently and economically at scale." https://z.ai/blog/glm-5.3-flash https://z.ai/blog/glm-5.3-flash
- xtracto 1mo agoAnyone knows what are those Chinese chips? Can they be bought? (Assuming im not i the US, And actually im in a 3rd world country).
- gunalx 1mo agoThey are high end really expensive Huawei ascend GPUs. It is kinda bruteforcing the performance on a older semiconductor processing tech, so total production is pretty low.
- ayewo 1mo agoPerhaps these may be Huawei Ascend chips. https://en.wikipedia.org/wiki/HiSilicon#Ascend_910 https://en.wikipedia.org/wiki/HiSilicon#Ascend_910 https://medium.com/@huaweiclouddevelper/a-brief-introduction-to-huawei-ascend-cloud-cbef8f25bc34 https://medium.com/@huaweiclouddevelper/a-brief-introduction...
- bean469 1mo ago> comparable to mainstream NVIDIA GPUs By this they probably mean RTX series GPUs? If so, then they are not comparing the hardware efficiency with the A100 / H100, etc. that are commonly used for training models
- rvz 1mo agoThis is no surprise [0] [1]. >> "They are already there on open weight models and Jensen knows that it is only a matter of time until China catches up with GPUs or other AI accelerators." It is also why Nvidia becoming a bank for other AI companies who are unable to find VCs to fund them isn't really a good thing and that is bearish. [0] https://news.ycombinator.com/item?id=49397204 https://news.ycombinator.com/item?id=49397204 [1] https://news.ycombinator.com/item?id=49431231 https://news.ycombinator.com/item?id=49431231
- ThouYS 1mo agoyay, I called it! :) (in the other thread)
- dannyw 1mo agoAnother self-inflicted own courtesy of US government policy. While I think China would always get to hardware self-sufficiency eventually, all export controls have done is (1) accelerate China's development, and (2) divert revenue that would've otherwise gone to NVIDIA/AMD/etc instead.
- ignoramous 1mo agoThe export controls were revoked before it triggered Chinese protectionism: https://www.silicon.co.uk/e-innovation/artificial-intelligence/china-nvidia-h200-627924 https://www.silicon.co.uk/e-innovation/artificial-intelligen... / https://archive.vn/B2pah https://archive.vn/B2pah
- mlinsey 1mo agoRevoked or not, just ever having those controls signals to the Chinese ecosystem that you're not necessarily a reliable supplier (Would you trust US export policy to remain stable for the next ~decade given the state of US politic?) and to the Chinese government just how strategically important you see these components. This isn't the kind of thing you can hash out in public and go back and forth on. Once you put it out there, the other party will take steps to make sure they don't have to rely on us in the long run.
- re-thc 1mo ago> The export controls were revoked before Zai is on another "export control" list outside the broader 1. Doesn't help.
- bigbadfeline 1mo agoThe export controls were not revoked, only reduced, and not before, but after China refused to buy low performing chips. Top gear was and is still sanctioned, as is any EUVL equipment.
- bigbadfeline 1mo agoAnd to add to the above: by building their own supply chain for chips, China is helping the unprivileged, those who can't front-run the market with long-term contracts. If China wasn't producing their own chips, the prices for us would be even higher. Similar to the war-pricing of oil, China's reduction of imports is actually helping to keep our inflation from going even higher.
- redox99 1mo agoNot really a brag: it ran like shit. Very slow (~20tps, VERY high latency) and it would timeout all the time. I'm sure the chips are fine, but they clearly didn't have enough capacity for the demand they had (that 100T/day claim was asbolute bs)
- nchmy 1mo agoseems unlikely that they'll get nearly as much demand now that it isnt free
- redox99 1mo agoSure, although I still expect it to become the most used model on openrouter.
- Implicated 1mo ago[flagged]
- Aurornis 1mo agoOx Alpha is a smaller model and it was running very slowly. Chinese AI accelerators are coming along, but nVidia’s lead is huge.
- Implicated 1mo ago> and it was running very slowly ... I'm at a loss for words here. It was being served for free. To the entire world.
- Aurornis 1mo agoGPT-5.6 Luna is also served for free to the entire world with a tokens per second rate nearly 10X higher. > ... I'm at a loss for words here No need to be so dramatic. I think it's great that they're developing chips, but the whole "RIP nVidia" claim was overly dramatic.
- computerex 1mo agoDo you know how much traffic luna was getting vs Ox Alpha?
- vitorgrs 1mo agoAre you really comparing chatbot to agentic/code work? Why is Luna not free on OpenRouter? :)
- knowaveragejoe 1mo agoHas there been any confirmation about what that model even is? Edit: Ah: > This stealth model was developed and operated by ZAI, revealed to be ZAI GLM-5.3-Flash.
- cortesoft 1mo agoIt's also in this very announcement, in the first paragraph: > Before release, we tested GLM-5.3-Flash anonymously as ox-alpha on OpenCode and OpenRouter to gather user feedback. It quickly became the most popular model of the week — with all of this traffic served on Chinese AI chips.
- WarmWash 1mo agoI don't see a situation where subscription payers move outside American LLMs (chatgpt, claude, gemini) And I don't see a situation where serious API payers are OK with handing the Chinese state all their data. Like manufactures of decades past did and learned a hard, even existential, lesson for it. The state mantra has been "Collect and Copy" for a long time now, tech just hasn't had that moment to experience it yet. So that leaves local hosting/leasing, but one of those has totally non-practical economics and the other doesn't have enough compute to meet any kind of real demand. I also have yet to meet a single person who isn't neck-deep in the tech space mention a Chinese LLM. It's 100% the big American three. If anything it's custom chips from the labs that threatens Nvidia.
- Jcampuzano2 1mo agoGenuine question but who do you put as the "three" in big three. Because I genuinely can't tell if you mean Google or SpaceX/X.ai lol.
- WarmWash 1mo agoGoogle probably serves more tokens then OAI and Anthropic combined, even if many of those tokens aren't from explicit gemini requests, but from AI overviews and other service integrations. xAI is already selling spare compute, and basically exists just to gas spacex's perceived valuation.
- pianopatrick 1mo agoI can easily see a situation where most non American AI usage is on Chinese models on Chinese chips though.
- uhfraid 1mo agoWhat about the current situation, where serious API payers are increasingly OK with using open-weight models running on US providers? https://www.ft.com/content/32a70a3c-7d28-40b4-808e-36edb58c7d01 https://www.ft.com/content/32a70a3c-7d28-40b4-808e-36edb58c7...
- rapind 1mo ago
- bityard 1mo agoMost US companies that have anything to do with government, finance, medical, etc. already have contractual or regulatory obligations which prevent them from using Chinese hardware or services, even before the AI boom. That's a huge market. Nvidia will do just fine. (Disclaimer: not a shareholder. At least, not directly.)
- cheema33 1mo ago> Most US companies that have anything to do with government, finance, medical, etc... That's a huge market. Compared to the rest of the world?
- bityard 1mo agoI don't have any pie charts in front of me, but yes, I would estimate it's a decently big slice of the world market.
- itemize123 1mo agobigger than RotW
- saberience 1mo agoNot really. Chinese AI companies were never using NVidia AI chips. This announcement doesn't really mean anything at all. It means the very few people who are already using Z.ai's API will continue to do so, but the vast majority of money going to Nvidia is through the massive amount of business going to Anthropic, OpenAI, and other western cloud providers and inference providers, who are mostly using NVidia chips for inference. Also, NVidia chips are still sold out and supply constrained.