4 ms·
The biggest obstacle is gpt cost per query. How are you planning to scale this?
by gopi 4y ago
The biggest obstacle is gpt cost per query. How are you planning to scale this?
- andyk 4y agoGood question. We are betting that the cost per LLM inference will continue to go down for given level of performance as the market matures over the next few years.