3 ms·
> leading AI model makers have got way more training data already than they could do anything with. Citation needed.
by rpcope1 2y ago
> leading AI model makers have got way more training data already than they could do anything with.
Citation needed.
- nullc 2y agoIf you include multimodal data then I think it's pretty obvious that training is compute limited. Also current SOTA models are good enough that you can generate endless training data by letting the model operate stuff like a C compiler, python interpreter, Sage computer algebra, etc.