3 ms·
Why would the gap grow? There is no more training data to acquire, frontier model are training on the entire internet. Everything from now on is just fine-tunin
by weregiraffe 5mo ago
Why would the gap grow? There is no more training data to acquire, frontier model are training on the entire internet. Everything from now on is just fine-tuning.
- kvam 5mo agoYour statement assumes training data is the only thing that matters for the big players, while not considering it limiting for the small Norwegian model. That’s a fallacy.
- weregiraffe 5mo agoNowhere in the article does it say the Norwegian LLM will train _only_ on Norwegian data.
- xadhominemx 5mo agoOrders of magnitude less compute for pre- and post-training than the the frontier labs.