3 ms·
> LLM scaling laws tell us that more parameters make models better, in general. That depends heavily on the amount and complexity of training data you have. Th
by bluish29 3y ago
> LLM scaling laws tell us that more parameters make models better, in general.
That depends heavily on the amount and complexity of training data you have. This is actually one of the things than OpenAI have advantage, they scraped a lot of data on the internet before now it became too hard for new players to get.