3 ms·
Groq is legitimate. Cerebras so far doesn't scale (wide) nearly as good as Groq. We'll see how it goes.
by icelancer 2y ago
Groq is legitimate. Cerebras so far doesn't scale (wide) nearly as good as Groq. We'll see how it goes.
- hendler 2y agoGoogle TPUs, Amazon, a YC funded ASIC/FPGA company, a Chinese Co. all have custom hardware too that might scale well.
- throwawaymaths 2y agoHow exactly does groq scale wide well? Last I heard it was 9 racks!! to run llama-2 70b Which is why they throttle your requests
- pama 2y agoWell, Cerebras pretty much needs a data center to simply fit the 405B model for inference.
- throwawaymaths 2y agoI guess this just shows the insanity of venture led AI hardware hype and shady startup messaging practices