4 ms·
There is a paper saying that around 6-7 billion params, something happened that makes the larger transformer qualitative different than the smaller one. I forgo
by NhanH 3y ago
There is a paper saying that around 6-7 billion params, something happened that makes the larger transformer qualitative different than the smaller one. I forgot which paper it was though