5 ms·
Cerebras just uses SRAM instead of DRAM. An ASIC would instead hardwire the neural network.
by cubefox 8mo ago
Cerebras just uses SRAM instead of DRAM. An ASIC would instead hardwire the neural network.
- joefourier 8mo agoSurely it's more of a spectrum? From a CPU, to a TPU, to a chip that hardwires softmax attention but lets you store arbitrary weights, to one that hardwires the weights directly.