3 ms·
It's worth noting that this is a comparatively small model (1.6B params from memory). It'll be interesting what capabilities emerge as they grow that model cap
by nl 4y ago
It's worth noting that this is a comparatively small model (1.6B params from memory).
It'll be interesting what capabilities emerge as they grow that model capacity.
- kenjackson 4y agoThat’sa good point. There’s a paper that talks about the non-linear nature of these models. That is at some very large size they seem to show a leap in ability.