3 ms·
> What does that get you? Cheaper model training runs? Ability to scale training to larger model sizes without extending training time?
by awestroke 22d ago
> What does that get you?
Cheaper model training runs? Ability to scale training to larger model sizes without extending training time?
- pvillano 22d agoYes, but a 10x larger model is only marginally better, and 10x cheaper training runs is only useful if you can find a use for 10x as many.
- aaronblohowiak 22d agomore experiments.