2 ms·
$2k through the API Which costs them $200 to serve.
by wmf 3mo ago
$2k through the API
Which costs them $200 to serve.
- helloplanets 3mo agoYes, it is a 10x markup on the API prices. Depending on whether you factor in cooling costs, data center staff, etc. Or GPU costs and the electricity the GPUs are using only. Either way, inference is very much where the money is made, training is where the money is lost.