2 ms·
Co-author here, happy to answer any questions/chat about stuff we did not cover in this overview!
by andreyk 4y ago
Co-author here, happy to answer any questions/chat about stuff we did not cover in this overview!
- puttycat 4y agoHi! Great post. See my comment below about scaling down.
- andreyk 4y agoThanks! I'll take a look, those do look interesting.
- benlivengood 4y agoIt would be great to see more focus on Chinchilla's result that most large models were quite undertrained with respect to optimal reduction in test loss.
- andreyk 4y agoagreed, we did not discuss that sufficiently
- deleted 4y ago[deleted]