3 ms·
The latest models create information from base models by randomly creating candidate responses then pruning the bad ones using an evaluation function. The good
by esafak 2y ago
The latest models create information from base models by randomly creating candidate responses then pruning the bad ones using an evaluation function. The good responses improve the model.
It is not distillation. It's like how you can arrive at new knowledge by reflecting on existing knowledge.