3 ms·
Strategy distillation seems like gradient update in a way? Or would that be at a higher abstract level.
by lurker919 2y ago
Strategy distillation seems like gradient update in a way? Or would that be at a higher abstract level.
- eigenvalue 2y agoYou’re right that it’s analogous in concept, but strategy distillation happens at a higher level: it encodes and transfers successful latent reasoning patterns as reusable “strategies,” without necessarily requiring direct gradient updates to the original model weights.