2 ms·
Epoch has a pretty good analysis of bottlenecks here: https://epoch.ai/blog/can-ai-scaling-continue-through-2030 https://epoch.ai/blog/can-ai-scaling-continue-
by bubblelicious 11mo ago
Epoch has a pretty good analysis of bottlenecks here:
https://epoch.ai/blog/can-ai-scaling-continue-through-2030 https://epoch.ai/blog/can-ai-scaling-continue-through-2030
There is plenty of data left, we don’t just train with crawled text data. Power constraints may turn out to be the real bottleneck but we’re like 4 orders of magnitude away