2 ms·
At what quantization? And if it is in fact quantized below fp8, how is the performance impacted on all the various benchmarks?
by lordofgibbons 1y ago
At what quantization? And if it is in fact quantized below fp8, how is the performance impacted on all the various benchmarks?
- antonvs 1y agoThey claim they don't use quantization. The reason for their speed is this chip: https://www.cerebras.ai/chip https://www.cerebras.ai/chip