4 ms·
Some of the numbers in that table do not make any sense and makes me question the quality of the entire article. Where are the numbers for the Cerebras chip co
by cracker_jacks 7y ago
Some of the numbers in that table do not make any sense and makes me question the quality of the entire article.
Where are the numbers for the Cerebras chip coming from?:
- How do you have a TDP of 180W for an entire wafer of chips?
- Why is there a peak FP32 number when they are clearly working with FP16?
Each of these chips is a completely different architecture and it makes no sense to compare them at this level. The only meaningful comparison is actual performance in applications because that reflects how the entire system will be used.
- inetsee 7y agoOne of the numbers that jumped out at me as being very unusual about the Cerebrus chip was this one: "Speculated clock speed of ~1 GHz and 15 kW power consumption." 15 kW power consumption for 1 chip?!?
- gwern 7y agoIt's a very big chip. Comes with fancy custom water-cooling to handle the heat, they say.
- borramakot 7y agoReportedly, it's an insanely large (whole wafer) single chip. But, then, why is it listed with a size that's not commensurate with that?
- akhilcacharya 7y agoI heard that from an engineer there. He was aghast too.
- deleted 7y ago[deleted]
- jwhanlon 7y agoIn the table, the figures are for a single die in the wafer. This is to make a meaningful comparison with the other chips listed (there is a table footnote for this). The 15 KW is the power consumption of the whole wafer (a detail I think was mentioned in the Hot Chips presentation). Why are they clearly working with FP16? Are there any public details on this?