4 ms·
Going to got against the naysaying here. I understand that it might not follow best practices, but I can see a lot of benefit to this. Imagine I want to test s
by burcs 3y ago
Going to got against the naysaying here. I understand that it might not follow best practices, but I can see a lot of benefit to this.
Imagine I want to test something fully offline, but my app was built using OpenAI's API's ideally I can do a quick swap now and have an offline compatible model.
Additionally, let's say I want to offer a free version of AI to my non-paying users, but for my paying users I can afford to allow them to use OpenAI, this will allow for an easier swap without having to rewrite everything.
- laborcontract 3y agoExactly this. There are many of us who are running solo operations and the only alternative to quick a/b testing in the broader scheme of your entire application follow is to either write your own wrappers or use some humongous horrendous abstraction layer like langchain, which is going to cost you 2x time in the future. I’ve added support for multiple apis in my app but it’s definitely a non trivial task to test new ones, especially with so many on the market.
- brucethemoose2 3y agoThere are dozens of local openai endpoints already. The best one depends on your hardware and available time.
- deleted 3y ago[deleted]