3 ms·
Like RLHF but the HF part is GPT4 instead.
by moralestapia 2y ago
Like RLHF but the HF part is GPT4 instead.
- KarraAI 2y agoHow do you ensure the student model learns robust generalizations rather than just surface-level mimicry?
- moralestapia 2y agoNo idea as I don't work on that, but my guess would be that the higher the 'n' the more model A approaches model B.