4 ms·
Are there benchmarks that effectively measure this? This is essential information when speccing out an inference system/model size/quantization type.
by solarkraft 10mo ago
Are there benchmarks that effectively measure this? This is essential information when speccing out an inference system/model size/quantization type.