3 ms·
So if this all streamed from the internal NVME would you expect better performance?
by grosswait 2mo ago
So if this all streamed from the internal NVME would you expect better performance?
- Argonautlabs 2mo agoJust internal 2Tb Macbook M5 Max drive it came in at roughly half the four-drive speed (0.535 vs 1.038 tok/s at 128 tokens), since one fast drive still has to serve all 16 reads per layer while four drives split the load https://raw.githubusercontent.com/argonautlabsai/deltafin/main/k3-public-bench/results/charts/drive-draw.svg https://raw.githubusercontent.com/argonautlabsai/deltafin/ma...
- cousinbryce 2mo agoThink the M7 will have some storage parallelization?