3 ms·
> but inference is in the long run gonna get the lion share of the work. I'm not sure - might not the equilibrium state be that we are constantly fine-tuning m
by wyager 2y ago
> but inference is in the long run gonna get the lion share of the work.
I'm not sure - might not the equilibrium state be that we are constantly fine-tuning models with the latest data (e.g. social media firehose)?
- NoahZuniga 2y agoHead of groq said that in his experience at google training was less than 10% of compute.
- lostmsu 2y agoIsn't Groq still more expensive than GPU-based providers?