2 ms·
inference is easy, but training is hard That's often true for classification models (like image recognition), but it the generation models (SD, Llama and GPT-4
by rahimnathwani 3y ago
inference is easy, but training is hard
That's often true for classification models (like image recognition), but it the generation models (SD, Llama and GPT-4) everyone is excited about use a lot of compute for inference.
- kramerger 3y agoIt may be "a lot" in relative terms, but still a few order of magnitude lower than training.