3 ms·
They say all the models were distilled from a teacher model but they didn't specify what that teacher model is. Interesting thing to hide.
by YetAnotherNick 2y ago
They say all the models were distilled from a teacher model but they didn't specify what that teacher model is. Interesting thing to hide.
- LeoPanthera 2y agoIt's a safe bet that it's either one of the Gemini models or a relative of it.
- YetAnotherNick 2y agoThat's what I thought. And it could be pulicity of Gemini as well that it is so good that it can teach students say 5x faster. If it is Gemini, there isn't any reason to hide. My bet is it is some unreleased Gemma or some model.