4 ms·
But inference costs scale per task whereas platform services like postgres typically amortize across tasks. If you are selling tasks done by inference, then com
by charlieflowers 3mo ago
But inference costs scale per task whereas platform services like postgres typically amortize across tasks. If you are selling tasks done by inference, then compute is part of your COGS and it scales per task.
- SoftTalker 3mo agoMuch more so, I would agree. A bit like how mainframe batch jobs might have once been charged back based on "cycles" used for a job or other tracked metrics.