2 ms·
> I think the ability to swap out APIs just isn't the bottleneck.. like ever It's a massive pain in the arse for testing though. Checking which out of X number
by IanCal 1y ago
> I think the ability to swap out APIs just isn't the bottleneck.. like ever
It's a massive pain in the arse for testing though. Checking which out of X number of things performs the best for your use case is quite annoying if you have to have X implementations. Having one set that you swap out keys and some vars makes this massively easier.
- kfajdsl 1y agoThis is easily solved with a thin wrapper for calling openai/anthropic/google/whatever that has the same interface between model providers (except for unique capabilities). You don't need a whole framework for this.