4 ms·
My argument wasn’t that the well-funded entities were optimizing to reduce training costs, but the opposite: they need creative ways to spend $1B that provide s
by svnt 2y ago
My argument wasn’t that the well-funded entities were optimizing to reduce training costs, but the opposite: they need creative ways to spend $1B that provide some tangible advantage. But they need operating costs to be low or they lose money and try to somehow make it up on volume.
I would roll data acquisition/cleaning processes into training costs for purposes of this because what else is the data for if not training?
If 4o wasn’t an optimization for model operation costs what was it?