3 ms·
OpenAI showed they can do capability extrapolate/predict (training loss) for the amount of compute they put in [1, see Predictable Scaling section]. This is als
by huijzer 3y ago
OpenAI showed they can do capability extrapolate/predict (training loss) for the amount of compute they put in [1, see Predictable Scaling section]. This is also in line with earlier findings. Furthermore, there is no evidence at this point that there is an end in sight.
[1]: https://openai.com/research/gpt-4 https://openai.com/research/gpt-4
- randmeerkat 3y ago> OpenAI showed they can do capability extrapolate/predict (training loss) for the amount of compute they put in [1, see Predictable Scaling section]. This is also in line with earlier findings. That’s interesting if it’s actually true. I think it’s important to keep in mind that it’s also their own marketing materials…