3 ms·
It uses hidden models, mostly Claude and open ai models. They try to check the prompt and route to the model that is capable of it, thus saving money.
by rusticpenn 20d ago
It uses hidden models, mostly Claude and open ai models. They try to check the prompt and route to the model that is capable of it, thus saving money.
- pytlicek 20d agoI think this is it ^^^ Routing and optimizations :)