2 ms·
Not when we're talking asymptotically. The linked paper for instance claims 14- to 118-fold cost reductions. 1-2 GPU generations from now you'll train this mode
by worstspotgain 2y ago
Not when we're talking asymptotically. The linked paper for instance claims 14- to 118-fold cost reductions. 1-2 GPU generations from now you'll train this model for $0.12.
- impossiblefork 2y agoSurely not $0.12. Maybe $100.
- moffkalast 2y agoPeople are casually dropping thousands on cloud GPUs making random fine tunes over at r/localllama, the threshold will be met far sooner. Plus datacenters selling away their collection of A100s and eventually H100s when they become EoL for their standards.
- impossiblefork 2y agoYes, but that doesn't mean that things are suddenly incredibly cheap. It just means that people have hardware. $0.12 I feel is extremely superlative and I feel that $100 is more reasonable.