3 ms·
> However, it was severely undertrained by modern standards. at the time, it was trained according to neural scaling laws oai believed to hold.
by swyx 2y ago
> However, it was severely undertrained
by modern standards. at the time, it was trained according to neural scaling laws oai believed to hold.
- reissbaker 2y agoSure, at the time everyone misunderstood Chinchilla. Nonetheless it was severely undertrained, even if they didn't know it back then.