3 ms·
How does such a distillation work in theory? They don’t have weights from OpenAI’s models, and can only call their APIs, right? So how can they actually build o
by blackeyeblitzar 2y ago
How does such a distillation work in theory? They don’t have weights from OpenAI’s models, and can only call their APIs, right? So how can they actually build off of it?
- moralestapia 2y agoLike RLHF but the HF part is GPT4 instead.
- KarraAI 2y agoHow do you ensure the student model learns robust generalizations rather than just surface-level mimicry?
- moralestapia 2y agoNo idea as I don't work on that, but my guess would be that the higher the 'n' the more model A approaches model B.