3 ms·
True. The only problem with lower quantization though is that the model fails to understand long prompts.
by elorant 2y ago
True. The only problem with lower quantization though is that the model fails to understand long prompts.
loading thread…