3 ms·
Context self-distillation does exist, but as is, it's used mostly in training rather than as a part of a continuous learning mechanism.
by ACCount37 4mo ago
Context self-distillation does exist, but as is, it's used mostly in training rather than as a part of a continuous learning mechanism.