3 ms·
So if this all streamed from the internal NVME would you expect better performance?
by grosswait 17d ago
So if this all streamed from the internal NVME would you expect better performance?
- Argonautlabs 17d agoJust internal 2Tb Macbook M5 Max drive it came in at roughly half the four-drive speed (0.535 vs 1.038 tok/s at 128 tokens), since one fast drive still has to serve all 16 reads per layer while four drives split the load https://raw.githubusercontent.com/argonautlabsai/deltafin/main/k3-public-bench/results/charts/drive-draw.svg https://raw.githubusercontent.com/argonautlabsai/deltafin/ma...
- cousinbryce 17d agoThink the M7 will have some storage parallelization?