4 ms·
> should you just cut out the middle-model and be using ChatGPT as your classifier? And hope OpenAI forever provides the service, and at a reasonable price, la
by danuker 3y ago
> should you just cut out the middle-model and be using ChatGPT as your classifier?
And hope OpenAI forever provides the service, and at a reasonable price, latency, and volume?
- arbuge 3y agoBesides that, there's the issue of efficiency. Better quality training data might enable you to build a leaner more efficient model than is far cheaper to implement and run than the expensive model used to generate the data to train it. See for example: https://twitter.com/SebastienBubeck/status/1671326369626853376 https://twitter.com/SebastienBubeck/status/16713263696268533...
- selcuka 3y ago> And hope OpenAI forever provides the service, and at a reasonable price, latency, and volume? They are enjoying the be the market leader for now, but OpenAI will soon be facing real competition, and LLM services will become a commodity product. That must be partly why they seeked Microsoft backing: to be a part of the "big tech".