3 ms·
The weight size depends on the accuracy you are running the model at, you usually do not run a model at fp16 as it would be wasteful.
by GaggiX 2y ago
The weight size depends on the accuracy you are running the model at, you usually do not run a model at fp16 as it would be wasteful.