3 ms·
> Couldn’t someone say prototype the entire product on some lower-quality LLM and occasionally pass requests to GPT4 to validate behavior? This, infact, might
by ignoramous 3y ago
> Couldn’t someone say prototype the entire product on some lower-quality LLM and occasionally pass requests to GPT4 to validate behavior?
This, infact, might be a better way to do inference anyway: https://twitter.com/Francis_YAO_/status/1675967988925710338 https://twitter.com/Francis_YAO_/status/1675967988925710338
> So, to return to the point, can’t people just build their product with openAI or other and plan to move away based on the cost and fit for their circumstances?
Depends. There are signs that folks are buying into GPT-specific APIs (like function calls) which may not be as easy to migrate away from.
- bredren 3y agoAsking because I have not implemented these yet: is there anything unique about the syntax that it can't just be copied?
- ignoramous 3y agoSome (not all) projects are indeed "copying" the OpenAI APIs; ex: https://github.com/go-skynet/LocalAI/issues/588 https://github.com/go-skynet/LocalAI/issues/588