4 ms·
If your claim is so solid, you'll have no problem pointing out data or evidence.
by epolanski 4mo ago
If your claim is so solid, you'll have no problem pointing out data or evidence.
- TeMPOraL 4mo agoDeepSeek R1 was a famous case - not only it briefly beat then-SOTA on the cheap, it was also released with distilled versions that preserved bulk of the improvements but could be run on higher-end consumer hardware. And of course Gemma models are said to be distillations of Gemini.
- epolanski 4mo agoThe distillation you're talking about is about cutting the number of weights, it has nothing to do with extracting QAs from another model.