10 ms·
Anyone know the Wattage this will pull? Assuming the CPU is just ARM it should run pretty decently low on idle, might work for a homeserver.
by apexalpha 2y ago
Anyone know the Wattage this will pull?
Assuming the CPU is just ARM it should run pretty decently low on idle, might work for a homeserver.
- mdavidn 2y agoIf you need an LLM on your home server, sure. If not, there are much more sensible home server options based on Intel’s N100 or Microsoft’s SQ3 chipsets.
- apexalpha 2y agoYeah I do need the LLM. Currently running 2 old Tesla M40's for 48GB of VRAM. While cheaper than this it has its limitations. Running a 200B model locally is very attractive though. Excited for the future.