4 ms·
> Is there a reason projects seem to be standardizing on specific parameter sizes within larger buckets? AFAICT, it is because science: most of them are resear
by dragonwriter 3y ago
> Is there a reason projects seem to be standardizing on specific parameter sizes within larger buckets?
AFAICT, it is because science: most of them are research artifacts and intended to support further research, and the fewer of parameter count, model architecture, training set, etc., that change substantially between models, the easier it is to evaluate the effects each element changing.