3 ms·
I was going to say it could affect the scaling if the speedup changes with model size. But I checked the paper and it's about a 2x speedup on the 8B model too.
by Dylan16807 4y ago
I was going to say it could affect the scaling if the speedup changes with model size.
But I checked the paper and it's about a 2x speedup on the 8B model too.