4 ms·
At this point the costs of hosting the trained model probably surpass the training cost.
by bobleeswagger 4y ago
At this point the costs of hosting the trained model probably surpass the training cost.
- delijati 4y agohas anyone numbers on how many queries/second in inference time chatGPT can serve?
- paulluuk 4y agoIt might, I'm not sure. It depends on many factors: how much cloud discount are they getting, for example? And do you count the cost of training all previous models before chatGPT, or just the cost of training chatGPT itself? But you might be right, chatGPT is insanely popular right now.