3 ms·
Model inference compute over model lifetime is ~10x of model training compute now for major providers. Expected to climb as demand for AI inference rises.
by ACCount37 6mo ago
Model inference compute over model lifetime is ~10x of model training compute now for major providers. Expected to climb as demand for AI inference rises.
- howdareme9 6mo agoThey are constantly training and getting rid of older models, they are losing money
- ACCount37 6mo agoWhich part of "over model lifetime" did you not understand?
- adgjlsfhk1 6mo agoThat's not a sufficient condition for profitability if both inference and scaling costs continue to increase over time.
- Glemllksdf 6mo agoFor sure and growth also costs money for buying DCs etc.