4 ms·
Would you be worried if the amount of data required to train LLMs went down significantly, but scaling benefits continue to hold? I.e. if it turns out that by m
by dwohnitmok 4y ago
Would you be worried if the amount of data required to train LLMs went down significantly, but scaling benefits continue to hold? I.e. if it turns out that by more efficiently using data there are 2-3 more orders of magnitude's worth of training possible.
What if LLMs can be used to train themselves on how to collect data from more diverse and plentiful sources?