3 ms·
See also Self-Play Fine-Tuning (SPIN) https://arxiv.org/abs/2401.01335 https://arxiv.org/abs/2401.01335 that (per authors) tunes as well as Direct Preference Op
by ignoramous 3y ago
See also Self-Play Fine-Tuning (SPIN) https://arxiv.org/abs/2401.01335 https://arxiv.org/abs/2401.01335 that (per authors) tunes as well as Direct Preference Optimization (DPO).