4 ms·
That's not really an error, that's a fundamental feature of unit economics. Fixed costs can't be rolled into the unit economics because the divisor is continua
by Aurornis 10mo ago
That's not really an error, that's a fundamental feature of unit economics.
Fixed costs can't be rolled into the unit economics because the divisor is continually growing. The marginal costs of each incremental token/query don't depend on the training cost.
- AndrewDucker 10mo agoYou can absolutely have a stab at it. Estimate how long models last for, amortise over that time/number of calls. We've seen enough models go out of fashion for that to be reasonably done.