3 ms·
> So, you're betting on no significant cost reduction of compute hardware? Seems implausible to me. This is not about compute, but about data. https://arxiv.o
by thesz 2y ago
> So, you're betting on no significant cost reduction of compute hardware? Seems implausible to me.
This is not about compute, but about data.
https://arxiv.org/abs/2404.04125 https://arxiv.org/abs/2404.04125
"...our study reveals an exponential need for training data which implies that the key to "zero-shot" generalization capabilities under large-scale training paradigms remains to be found."