4 ms·
You can amortise the training cost across billions of inference requests though. It's the marginal cost for inference that's most interesting here.
by ascorbic 1y ago
You can amortise the training cost across billions of inference requests though. It's the marginal cost for inference that's most interesting here.