3 ms·
The LPU (Language Processing Unit)
- peter_d_sherman 10mo agoRelated: "What is a Language Processing Unit (LPU)?": https://groq.com/blog/the-groq-lpu-explained https://groq.com/blog/the-groq-lpu-explained >"Groq on-chip SRAM has memory bandwidth upwards of 80 terabytes/second , while GPU off-chip HBM clocks in at about eight terabytes/second. That difference alone gives LPUs up to a 10X speed advantage, on top of the boost LPUs get from not having to go back and forth to a separate memory chip to retrieve data."