3 ms·
Local LLMs are improving for fixed hardware, though - a 30b parameter model now is markedly better on the same hardware than one from a year ago.
by bertmuthalaly 1mo ago
Local LLMs are improving for fixed hardware, though - a 30b parameter model now is markedly better on the same hardware than one from a year ago.