4 ms·
>> The demand for large memory capacity RDIMMs is being primarily driven by the sudden emergence of large-language models (LLMs) for generative AI and increasin
by phkahler 3y ago
>> The demand for large memory capacity RDIMMs is being primarily driven by the sudden emergence of large-language models (LLMs) for generative AI and increasing CPU core counts.
I know LLMs are undergoing rapid change, but what if someone (say Apple) wanted to commit a large model to an actual masked ROM? What kind of density can be achieved on a similar process as DRAM, and what kind of interface would such a thing use?
- dragontamer 3y agoNo one uses ROM anymore. Its all Flash RAM, which is denser, cheaper, lower-power in practice. And Flash is likely too slow in any case, so people will prefer DRAM.
- dist-epoch 3y agoYou can store the weights in ROM. But you also have input dependent activations. You need RAM for these.