3 ms·
Exactly this. There are many of us who are running solo operations and the only alternative to quick a/b testing in the broader scheme of your entire applicati
by laborcontract 3y ago
Exactly this.
There are many of us who are running solo operations and the only alternative to quick a/b testing in the broader scheme of your entire application follow is to either write your own wrappers or use some humongous horrendous abstraction layer like langchain, which is going to cost you 2x time in the future.
I’ve added support for multiple apis in my app but it’s definitely a non trivial task to test new ones, especially with so many on the market.
- brucethemoose2 3y agoThere are dozens of local openai endpoints already. The best one depends on your hardware and available time.