2 ms·
A significant part of that is the GPU cost: a lambda box with 8xNVIDIA A100 is $12/h. $12/h * 24 h * 90 days = $25,920 for 3 months That just the inference co
by visarga 4y ago
A significant part of that is the GPU cost: a lambda box with 8xNVIDIA A100 is $12/h.
$12/h * 24 h * 90 days = $25,920 for 3 months
That just the inference cost, add OpenAI's model development costs on top.