3 ms·
>massive PD disaggregated cluster of B300s connected via NVLink. So a headless server. Macs were mentioned because that's what the post is about. It could be
by redox99 1mo ago
>massive PD disaggregated cluster of B300s connected via NVLink.
So a headless server.
Macs were mentioned because that's what the post is about. It could be a PC (I use a 2x3090 PC). The point is that it's a better experience to have a box dedicated to the LLM than running it in your system. Obviously in your home, so local.
- qeternity 1mo agoHas nothing to do with being headless. That's just a natural outcome. If someone wanted to use an 8x B300 as their daily driver...go ahead. It would still be the best way to serve a given model.