4 ms·
In machine learning, generally the expensive part is training the model, not running the model.
by paulluuk 4y ago
In machine learning, generally the expensive part is training the model, not running the model.
- bobleeswagger 4y agoAt this point the costs of hosting the trained model probably surpass the training cost.
- delijati 4y agohas anyone numbers on how many queries/second in inference time chatGPT can serve?
- paulluuk 4y agoIt might, I'm not sure. It depends on many factors: how much cloud discount are they getting, for example? And do you count the cost of training all previous models before chatGPT, or just the cost of training chatGPT itself? But you might be right, chatGPT is insanely popular right now.