3 ms·
At what quantization? And if it is in fact quantized below fp8, how is the performance impacted on all the various benchmarks?
by lordofgibbons 11mo ago
At what quantization? And if it is in fact quantized below fp8, how is the performance impacted on all the various benchmarks?
- antonvs 11mo agoThey claim they don't use quantization. The reason for their speed is this chip: https://www.cerebras.ai/chip https://www.cerebras.ai/chip