3 ms·
Unregulated output at small scales. The really big training runs will still cost millions.
by FeepingCreature 2y ago
Unregulated output at small scales. The really big training runs will still cost millions.
- worstspotgain 2y agoNot when we're talking asymptotically. The linked paper for instance claims 14- to 118-fold cost reductions. 1-2 GPU generations from now you'll train this model for $0.12.
- impossiblefork 2y agoSurely not $0.12. Maybe $100.
- moffkalast 2y agoPeople are casually dropping thousands on cloud GPUs making random fine tunes over at r/localllama, the threshold will be met far sooner. Plus datacenters selling away their collection of A100s and eventually H100s when they become EoL for their standards.
- impossiblefork 2y agoYes, but that doesn't mean that things are suddenly incredibly cheap. It just means that people have hardware. $0.12 I feel is extremely superlative and I feel that $100 is more reasonable.