4 ms·
>We can say a lot of things about what may happen next, but the main one is that AI is going to get better with scale. Could anyone elaborate on this? Further
by seri4l 2y ago
>We can say a lot of things about what may happen next, but the main one is that AI is going to get better with scale.
Could anyone elaborate on this? Further down he talks about the necessity of bringing the cost of computing down. Is that really the bottleneck?
- kneel 2y agoFew short learning performance scales with model size. Afaik they don't see a plateau yet and the race is on the ingest more data and come up with better tuning techniques. https://splab.sdu.edu.cn/GPT3.pdf https://splab.sdu.edu.cn/GPT3.pdf
- ks2048 2y ago"AI is going to get better with scale" to me says almost nothing at all. It includes anything from we 100x the scale and get 1% improvement to 2x the scale and get "AGI".