3 ms·
From the NY Times article: > As long as you can get over the synthetic data event horizon, where the model is smart enough to make good synthetic data, everyth
by kristianp 3y ago
From the NY Times article:
> As long as you can get over the synthetic data event horizon, where the model is smart enough to make good synthetic data, everything will be fine,” Mr. Altman said.
This seems intuitively incorrect to me. How can you advance the capabilities of a model by using the output of a model of the same level?
- Tenoke 3y agoHow can AlphaGo advance capabilities by using the output of a model of the same level? It's not as simple in this domain but there are ways.
- rightbyte 3y agoGo can be modeled with perfect accuracy. The feedbackloop is perfect. LLMs have no feedback loop with reality if it is short circuited with itself. It needs fresh training data.
- willj 3y agoI think that’s different. AlphaGo is using reinforcement learning in a context in which there is a clear evaluation function— did a strategy lead to a win or loss.
- Tenoke 3y agoI said it's not as simple but there are ways - e.g. you can generate more of your best quality of data, you can try to model the direction of quality or an objective, you can have minor human input at some points to judge which direction performs better, you can objectively verify some of your input to use as a partial objective - code, math, logic etc.