3 ms·
It's not really a lie though. They require 20x more chips (storing all the weights in sram instead of hbm is expensive!) than Nvidia GPUs for a ~2x speed increa
by ipsum2 3y ago
It's not really a lie though. They require 20x more chips (storing all the weights in sram instead of hbm is expensive!) than Nvidia GPUs for a ~2x speed increase. Overall the power cost is more expensive for groq than GPUs.
- rattray 3y agoSource? Or how do you know that?
- wmf 3y agoThis was discussed extensively in previous threads, e.g. https://news.ycombinator.com/item?id=39431989 https://news.ycombinator.com/item?id=39431989
- ethbr1 3y agoAre power and 20x 14-nm chip capacity limiting factors currently? It's not inconceivable that's a better trade-off than leading-node and HBM requirements.
- ipsum2 3y agoEdit: 200x more chips, not 20x.