2 ms·
What's different today is the divide between training and inference. Inference is ridiculously cheap compared to training, and we're still early days with optim
by fragmede 3y ago
What's different today is the divide between training and inference. Inference is ridiculously cheap compared to training, and we're still early days with optimizations across the whole of the stack, so we'll have to see how it develops. Once constant training gets figured out, then we're really in for a ride.