Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
manny_c
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
2 ms
·
1.
▲
by
manny_c
2y ago
Ollama 3.1 405B model already uses synthetic data for SFT. They basically trained a bunch of models to generate, correct, and reject synthetic data for various tasks. They cover it in section 4.3 in the "The Llama 3 Herd of Models"