3 ms·
Is this due to entirely to economies of scale?
Is this due to entirely to economies of scale?
Economies of scale and years of optimization, some of which likely have not been publicly shared.
Not entirely. There are many ways to optimize models for deployment both at the software and hardware levels: some are public such as quantization/fusing, others are not.