3 ms·
Ans: we rarely switch, often times it's just a "switch to using this model for your agent"
by SilenN 29d ago
Ans: we rarely switch, often times it's just a "switch to using this model for your agent"
- akshay_akula 29d agoYou guys should look into ngrok ai gateway. We have some small models running on local hardware that we tried to use but it was too painful. Just wanted to not waste all the compute hit one endpoint and be done but as a team.