3 ms·

So you think they’re running the same types of state of the art Nvidia deployments?

• onlyrealcuzzo 5mo ago
  It's supposed to be even MORE expensive: Nvidia H100: Typically priced around $25,000–$30,000 (global MSRP). Huawei Ascend 910C: Reported to cost roughly $28,000, yet it delivers only 60% of the inference performance of the Nvidia H100. Google's TPUs are significantly cheaper for Google for inference. That's pretty much it. There's a reason nVidia has an 80% margin right now.
  • thrownthatway 5mo ago
    MSRP is irrelevant in this context.