4 ms·
My guess is that something that looks like the "teacher and student" model. I know there were methods in the past to utilize the token distribution to "retrain"
by ddtaylor 9mo ago
My guess is that something that looks like the "teacher and student" model. I know there were methods in the past to utilize the token distribution to "retrain" one model with another, kind of like an auto fine-tuning, but AFAIK those are for offline model usage since you need the token distribution. There do appear to be similar methods for online-only models?