3 ms·
This model is going to start miles behind the frontier and the gap will only grow.
by xadhominemx 4mo ago
This model is going to start miles behind the frontier and the gap will only grow.
- weregiraffe 4mo agoWhy would the gap grow? There is no more training data to acquire, frontier model are training on the entire internet. Everything from now on is just fine-tuning.
- kvam 4mo agoYour statement assumes training data is the only thing that matters for the big players, while not considering it limiting for the small Norwegian model. That’s a fallacy.
- weregiraffe 4mo agoNowhere in the article does it say the Norwegian LLM will train _only_ on Norwegian data.
- xadhominemx 4mo agoOrders of magnitude less compute for pre- and post-training than the the frontier labs.