2 ms·
There is definitely a market for it - though a small one. I had a 3x pi cluster and found the 8GB limiting. So made those the controlling nodes and bought oran
by Havoc 2y ago
There is definitely a market for it - though a small one.
I had a 3x pi cluster and found the 8GB limiting. So made those the controlling nodes and bought orange pis 32gb for the worker nodes. And those were well north of 120.
But that kind of usage case is quite niche. For most people minipcs are probably a better fit in that price class.
I'm unconvinced by the LLM argument...even if the model fits...it's already slow for 8GB class models.