4 ms·
Wouldn't this restrict memory to 128GB, wasting M3 Ultra potential?
by storus 1y ago
Wouldn't this restrict memory to 128GB, wasting M3 Ultra potential?
- alexandercheema 1y agoBlog author here. Actually, no. The model can be streamed into the DGX Spark, so we can run prefill of models much larger than 128GB (e.g. DeepSeek R1) on the DGX Spark. This feature is coming to EXO 1.0 which will be open-sourced soonTM.
- storus 1y agoExcellent! Good luck!