2 ms·
If it really got faster and worse at the same time, the most likely reason is obvious: They used methods to shrink the model down, in order to lower inference
by cubefox 3y ago
If it really got faster and worse at the same time, the
most likely reason is obvious: They used methods to shrink the model down, in order to lower inference cost. Side effect is higher speed and some loss in quality.