4 ms·
How much do 568 chips cost? What’s the cost ratio of it comparing to setup with roughly the same throughput using A100?
by WiSaGaN 3y ago
How much do 568 chips cost? What’s the cost ratio of it comparing to setup with roughly the same throughput using A100?
- benchess 3y agoThey’re for sale on Mouser for $20625 each https://www.mouser.com/ProductDetail/BittWare/RS-GQ-GC1-0109?qs=ST9lo4GX8V2eGrFMeVQmFw%3D%3D https://www.mouser.com/ProductDetail/BittWare/RS-GQ-GC1-0109... At that price 568 chips would be $11.7M
- tome 3y agoYeah, I don't know what the cost to us is to build out our own hardware but it's significantly less expensive than retail.
- WiSaGaN 3y agoThat seems to be per card instead of chip. I would expect it has multiple chips on a single card.
- renewiltord 3y agoFrom the description that doesn't seem to be the case, but I don't know this product well > Accelerator Cards GroqCard low latency AI/ML Inference PCIe accelerator card with single GroqChip
- WiSaGaN 3y agoMissed that! Thanks for pointing out!
- fennecbutt 3y agoI presume that's because it's a custom asic not yet in mass production? If they can get costs down and put more dies into each card then it'll be business/consumer friendly. Let's see if they can scale production. Also, where tf is the next coral chip, alphabet been slacking hard.
- bethekind 3y agoI think Coral has been taken to the wooden shed out back. Nothing new out of them for years sadly
- fennecbutt 3y agoYeah. And it's a real shame bc even before LLMs got big I was thinking, couple generations down the line and coral would be great for some home automation/edge AI stuff. Fortunately LLMs and hard work of clever peeps running em on commodity hardware are starting to make this possible anyway. Because Google Home/Assistant just seems to keep getting dumber and dumber...