4 ms·
That' what the buzz focused on, strange as we don't actually know what it cost them. While inference optimization is a fact and is even more impactful since t
by hirako2000 1y ago
That' what the buzz focused on, strange as we don't actually know what it cost them. While inference optimization is a fact and is even more impactful since training costs benefit from economics of scale.
- CjHuber 1y agoI don't think that's strange at all, it's a much more palatable narrative for the mass who doesn't know what inference and training is and who think having conversations=training
- hirako2000 1y agoI agree nothing surprising in that, also back then inference wasn't as much questioned as today with regards to being sold at a loss.