3 ms·
Running local LLMs split across machines. Pretty sure the author has some other posts about doing that. Edit: https://www.jeffgeerling.com/blog/2025/15-tb-vram
by andy99 2mo ago
Running local LLMs split across machines. Pretty sure the author has some other posts about doing that.
Edit: https://www.jeffgeerling.com/blog/2025/15-tb-vram-on-mac-studio-rdma-over-thunderbolt-5/ https://www.jeffgeerling.com/blog/2025/15-tb-vram-on-mac-stu...
- logicallee 2mo agocorrect me if I'm wrong but wouldn't a Thunderbolt 5 cable $79 from Apple[1] work better for that? It gets 80 Gbps and doesn't need any extra equipment. [1] https://www.apple.com/shop/product/mdw94am/a/thunderbolt-5-usb%E2%80%91c-pro-cable-1-m https://www.apple.com/shop/product/mdw94am/a/thunderbolt-5-u...