4 ms·
China's Taichi-II Chip: First Optical AI Processor Outperforms Nvidia H100
- yogrish 2y agoCan any expert in this domain validate the claimed performance over H100? Any pointers on how optical processors work and how mature they are over traditional processors.
- doodlebugg 2y agoI would be shocked if nvidia didn’t use optical interconnects in their next iteration. My understanding is that the big power loss in these racks comes from having to bus the data around. The article only seems to mention the power savings and speed, both of which are obvious benefits over traditional electrical circuits. Optical computing isnt constrained by the speed of light or the efficiency of a fiber, it’s that components are orders of magnitude larger and have low to no manufacturing support. Don’t get me wrong, I’m hyped for the eventual PIC revolution, i just don’t think this is it.
- justinclift 2y ago"... which outperforms the Nvidia H100 in energy efficiency". Very unlike what the headline was saying. The article doesn't seem to really state how much real world performance this thing actually has. Seems pretty dodgy?
- creer 2y agoThis is the FFM paper, one of the papers in question (since no mention of a TAICHI here): https://www.nature.com/articles/s41586-024-07687-4 https://www.nature.com/articles/s41586-024-07687-4 A Tsinghua page mentions only this paper. https://media.au.tsinghua.edu.cn/info/1016/1419.htm https://media.au.tsinghua.edu.cn/info/1016/1419.htm And this is one from one year ago from the same group, also photonic chip. https://www.nature.com/articles/s41586-023-06558-8 https://www.nature.com/articles/s41586-023-06558-8 I haven't read any of this yet.