3 ms·
Its 256k context window. Quantization is orthogonal. We cant really tell directly so it could be quantized.
by DSingularity 2mo ago
Its 256k context window. Quantization is orthogonal. We cant really tell directly so it could be quantized.
3 ms·