3 ms·
> a delusional future where capable OS models fit on consumer grade hardware 48 gb is enough for a capable LLM. Doing that on consumer grade hardware is entir
by otabdeveloper4 5mo ago
> a delusional future where capable OS models fit on consumer grade hardware
48 gb is enough for a capable LLM.
Doing that on consumer grade hardware is entirely possible. The bottleneck is CUDA and other intellectual property moats.