4 ms·
I’m surprised that no one has answered for three hours! The answer is at https://github.com/kingoflolz/mesh-transformer-jax https://github.com/kingoflolz/mesh-
by sillysaurusx 5y ago
I’m surprised that no one has answered for three hours!
The answer is at https://github.com/kingoflolz/mesh-transformer-jax https://github.com/kingoflolz/mesh-transformer-jax
It has detailed comparisons and a full breakdown of the performance, courtesy of Eleuther.
- 6gvONxR4sf7o 5y agoI was so frustrated when that was first announced because it didn't include those metrics, and everyone ate it up like the models were equivalent.