4 ms·
Cerebras is truly one of the maddest technical accomplishments that Silicon Valley has produced in the last decade or so. I met Andy seven or eight years ago an
by pjs_ 1y ago
Cerebras is truly one of the maddest technical accomplishments that Silicon Valley has produced in the last decade or so. I met Andy seven or eight years ago and I thought they must have been smoking something - a dinner plate sized chip with six tons of clamping force? They made it real, and in retrospect what they did was incredibly prescient
- cherryteastain 1y agoThe concept is super cool but does anyone actually use them instead of just buying Nvidia?
- vFunct 1y agoWafer-scale integration was done decades before.
- throwawaymaths 1y agonah, it was designed for hpc and raw flops. llm inference really requires memory bandwidth.
- HumanOstrich 1y agoMemory bandwidth, eh? You should learn the basics about what Cerebras does. https://www.cerebras.ai/chip https://www.cerebras.ai/chip
- adamtaylor_13 1y agoSheeeesh. 21 petabytes per second of memory bandwidth? That’s bonkers.
- cgdl 1y agoI'd say llm inference requires both memory capacity and bandwidth. Cerebras provides bandwidth with on-chip SRAM, but not capacity (an entire wafer has only 44GB SRAM).
- nickpsecurity 1y agoIt's a modern take on an old idea. I first saw it in European research for wafer-scale, analog, neural networks. I found another project while looking for it. I'll share both. https://www.kip.uni-heidelberg.de/Veroeffentlichungen/download.php/4713/ps/1856.pdf https://www.kip.uni-heidelberg.de/Veroeffentlichungen/downlo... https://archive.ll.mit.edu/publications/journal/pdf/vol02_no1/2.1.5.neuromorphicsystems.pdf https://archive.ll.mit.edu/publications/journal/pdf/vol02_no... The second's patents would also be long-expired since it's from 1989.