3 ms·
This is a good way to do math. But honestly, how many products actually have 100% utilisation. I did some math a few months ago but mostly on the basis of activ
by agcat 2y ago
This is a good way to do math. But honestly, how many products actually have 100% utilisation. I did some math a few months ago but mostly on the basis of active users, on what would be the % difference if you have 1k to 10K users/mo. You can run this as low as $0.3K/mo on Serverless GPUs and $0.7K/mo on EC2.
The pricing is outdated now.
Here is the piece -https://www.inferless.com/learn/unraveling-gpu-inference-costs-for-llms-openai-aws-and-inferless https://www.inferless.com/learn/unraveling-gpu-inference-cos...