3 ms·
It might have been a typo, as the current llama.cpp / alpaca.cpp included quantizers default to 4 bits.
by DrJosiah 4y ago
It might have been a typo, as the current llama.cpp / alpaca.cpp included quantizers default to 4 bits.
loading thread…
3 ms·