4 ms·
It's interesting to think about some of the earliest machines we could have run a pretty great LLM on. A Cray XMP-EA from 1986 could address up to 2GW, which wo
by mechagodzilla 3y ago
It's interesting to think about some of the earliest machines we could have run a pretty great LLM on. A Cray XMP-EA from 1986 could address up to 2GW, which would have been 16GB. The XMP or earlier Cray-1 lines could also use multiple solid-state SRAM disks that were up to 1GB in size and could stream at ~1GB/sec.
- emchammer 3y agoIt's interesting to think about how computers might be different had SRAM generally developed and become prolific instead of DRAM.
- mechagodzilla 3y agoWhat do you mean? It did continue to develop (right up to the latest 3nm process!), it’s just inherently lower density due to its structure.
- emchammer 3y agoIt is not typically used outside of L1 cache. I imagine a computer using bistable memory cells as being more resilient, and a more elegant design than memory that needs circuitry to constantly refresh it.