4 ms·
> 7B parameter Orca-2.5 model aligned by DNO achieves the state-of-the-art win-rate against GPT-4-Turbo of 33% on AlpacaEval 2.0 (even after controlling for res
by tosh 3y ago
> 7B parameter Orca-2.5 model aligned by DNO achieves the state-of-the-art win-rate against GPT-4-Turbo of 33% on AlpacaEval 2.0 (even after controlling for response length), an absolute gain of 26% (7%→33%) over the initializing model. It outperforms models with far more parameters, including Mistral Large, Self-Rewarding LM (70B parameters), and older versions of GPT-4
edit: updated quote w/ more context
- firejake308 3y agoStill only 33% though. Which is impressive for a 7B model, but the student has not yet surpassed the teacher
- danielcampos93 3y agoIf you only emulate the teacher can you ever become an master?
- tosh 3y agoIt works in many competitive fields
- Twirrim 3y agoSurely it needs more than just emulating the teacher, though, it would require exploring beyond those limitations?
- CapeTheory 3y agoBut eventually your human mentor diminishes with age. And then you can crush them.
- corbyrosset 3y agoauthor here; yea the goal is to try and get the student to surpass the teacher, but if it can't, this is the best way to get close. For these contrastive losses, our intuition is that the model isn't trying to emulate the teacher so much as learning from the 'delta' between itself and the teacher