3 ms·
I see your prices page lists the average cost per million tokens. Is that because you are using the formula you describe, which depends on hardware time and thr
by sharkjacobs 1y ago
I see your prices page lists the average cost per million tokens. Is that because you are using the formula you describe, which depends on hardware time and throughput?
> API Price ≈ (Hourly Hardware Cost / Throughput in Tokens per Hour) + Margin