3 ms·
there are no other obvious mechanisms to explain why a smaller model with same or similar architecture would be better than a larger one. Overfitting?
by WithinReason 4y ago
there are no other obvious mechanisms to explain why a smaller model with same or similar architecture would be better than a larger one.
Overfitting?
- Der_Einzige 4y agoThe consensus seems to be that the majority of LMs are undertrained not overfitting though.