4 ms·
Relevant post: https://modal.com/blog/dollars-per-token-considered-harmful https://modal.com/blog/dollars-per-token-considered-harmful (disclaimer: I work with
by amitprasad 6mo ago
Relevant post: https://modal.com/blog/dollars-per-token-considered-harmful https://modal.com/blog/dollars-per-token-considered-harmful
(disclaimer: I work with the author)
- nixpulvis 6mo agoI completely agree that requests are what should be charged for. But I think there are two things, given that requests aren't all going to cost the same amount: 1. Estimate free invoicing the requests and letting users figure it out after the fact. 2. Somehow estimating cost and telling users how much a request will cost. We have 1, we want 2.