4 ms·
The Q4 quantization requires about 600GB of RAM without context, not exactly consumer hardware friendly.
by cbg0 5mo ago
The Q4 quantization requires about 600GB of RAM without context, not exactly consumer hardware friendly.
loading thread…
4 ms·