3 ms·
I missed the explanation for how the SSDs are connected. Maybe a dumb question.
by bluechair 26d ago
I missed the explanation for how the SSDs are connected.
Maybe a dumb question.
- Argonautlabs 26d agoSSDs are connected via Thunderbolt 5 enclosures. I have one Gen4 and three Gen5 ssds inside enclosures. You can see specs here https://github.com/argonautlabsai/deltafin/tree/main/k3-public-bench https://github.com/argonautlabsai/deltafin/tree/main/k3-publ...
- grosswait 25d agoSo if this all streamed from the internal NVME would you expect better performance?
- Argonautlabs 25d agoJust internal 2Tb Macbook M5 Max drive it came in at roughly half the four-drive speed (0.535 vs 1.038 tok/s at 128 tokens), since one fast drive still has to serve all 16 reads per layer while four drives split the load https://raw.githubusercontent.com/argonautlabsai/deltafin/main/k3-public-bench/results/charts/drive-draw.svg https://raw.githubusercontent.com/argonautlabsai/deltafin/ma...
- cousinbryce 25d agoThink the M7 will have some storage parallelization?
- _zoltan_ 25d agoWhat exact enclosure are you using?
- Argonautlabs 25d agoOWC Express 1M2 (Thunderbolt 5, single M.2 NVMe) — three of them, two on the Mac's own ports and one behind an OWC Thunderbolt 5 hub since the machine has three ports. Each enclosure tops out at about 7.1 GB/s on whole-file reads regardless of the drive inside (a 2 TB SN8100 measures the same as the 1 TB); the drive behind the hub reads 5.7 GB/s and falls with queue depth. Details in the README's hardware section
- _zoltan_ 25d agoThank you!