4 ms·
Ilya Sutskever: LLM Pre-training as we know it will end, data is not growing
- deleted 2y ago[deleted]
- cranberryturkey 2y agoHow can data not be growing
- curious_curios 2y agoSpecifically it’s data useful for training language models. Using text generated by another model has been shown to be counterproductive. This is why so many companies are trying to lock down access to their user generated content and set up data sale agreements for access to data prior to the major release of large language models.
- cranberryturkey 2y agoyeah i can see that. blogs are all ai crap now.