4 ms·
Can their system attach memory? from what I read, it doesn't seem to be able to: https://www.reddit.com/r/mlscaling/comments/1csquky/with_wafer_scale_chips_beco
by billconan 2y ago
Can their system attach memory? from what I read, it doesn't seem to be able to: https://www.reddit.com/r/mlscaling/comments/1csquky/with_wafer_scale_chips_becoming_more_popular/ https://www.reddit.com/r/mlscaling/comments/1csquky/with_waf...
- wmf 2y agoI think they do have external memory that they use for training.
- winwang 2y agoSurprising. DRAM (and more importantly high-bandwidth DRAM) seems to be scaling significantly better than SRAM -- and I'm not sure if that could be seriously expected to shift.
- anon291 2y agoFormer Cerebras engineer. At the time I was there, it could not.