3 ms·
Exactly. And that means you not only save the 22% but also a large chunk of the Nvidia margin.
by bjornsing 2y ago
Exactly. And that means you not only save the 22% but also a large chunk of the Nvidia margin.
- Animats 2y agoAnd, sure enough, there's a new AI chip from Intellifusion in China that's supposed to be 90% cheaper. 48 TOPS in int8 training performance for US$140.[1] [1] https://www.tomshardware.com/tech-industry/artificial-intelligence/chinese-chipmaker-launches-14nm-ai-processor-thats-90-cheaper-than-gpus https://www.tomshardware.com/tech-industry/artificial-intell...
- pfdietz 2y agoI wonder what the cost of power to run these chips is. If the power cost ends up being large compared to the hardware cost, it could make sense to buy more chips and run them when power is cheap. They could become a large source of dispatchable demand.
- pclmulqdq 2y agoInt8 training has very few applications, and int8 ops generally are very easy to implement. Int8 is a decent inference format, but supposedly doesn't work well for LLMs that need a wide dynamic range.