3 ms·
You can get 1M tokens of inference because it's subsidized by VC money. The whole point of the parent comment is that this is closer to the actual cost to provi
by dymk 2y ago
You can get 1M tokens of inference because it's subsidized by VC money. The whole point of the parent comment is that this is closer to the actual cost to provide a service.
- lurk2 2y agoHe could be right, I have no idea what search costs.