3 ms·
Are you sure about that ? Because the very next tweet says: > Distillation can be legitimate: AI labs use it to create smaller, cheaper models for their cust
by devnonymous 7mo ago
Are you sure about that ? Because the very next tweet says:
> Distillation can be legitimate: AI labs use it to create smaller, cheaper models for their customers.
- davidgomes 7mo agoThat's just in reference to the technique itself. They're basically saying it's okay for Google to use distillation to train Gemini N Flash using Gemini N-1 Pro (which they do).