3 ms·
238GB is the 4-bit quantized version, with an accuracy loss of about one tier compared to the original. For running complex logical reasoning, it's still recomm
by aurenvale 4mo ago
238GB is the 4-bit quantized version, with an accuracy loss of about one tier compared to the original. For running complex logical reasoning, it's still recommended to use the original version~