3 ms·
no they dont because inference stacks are getting more efficient and models are getting more intelligent per parameter.
by anthonypasq 1mo ago
no they dont because inference stacks are getting more efficient and models are getting more intelligent per parameter.
- vlovich123 1mo agoI would posit there’s no way in hell they’re getting sufficiently cheaper on a short enough time frame vs how much demand is sky rocketing. AI companies are seeing quarterly doubling of revenue if not more.