3 ms·
So the idea of networking multiple Mac Minis via RDMA over Thunderbolt 5 to run local LLMs is intriguing, but doesn't really seem reasonable at this price point
by senderista 2mo ago
So the idea of networking multiple Mac Minis via RDMA over Thunderbolt 5 to run local LLMs is intriguing, but doesn't really seem reasonable at this price point? What are the more cost-effective alternatives?
- shepherdjerred 2mo agoHonestly, waiting 5 years until the supply constraints are lesser