4 ms·
If you need an LLM on your home server, sure. If not, there are much more sensible home server options based on Intel’s N100 or Microsoft’s SQ3 chipsets.
by mdavidn 2y ago
If you need an LLM on your home server, sure. If not, there are much more sensible home server options based on Intel’s N100 or Microsoft’s SQ3 chipsets.
- apexalpha 2y agoYeah I do need the LLM. Currently running 2 old Tesla M40's for 48GB of VRAM. While cheaper than this it has its limitations. Running a 200B model locally is very attractive though. Excited for the future.