2 ms·
They can still run a lot more users on the same number of GPUs (and they don't have a lot) using distilled models.
by adastra22 2y ago
They can still run a lot more users on the same number of GPUs (and they don't have a lot) using distilled models.