3 ms·

I love it! I want to do the same, I guess mostly just concerned with hitting limits super quick, is there anyway you can see that info on telegram/whatsapp and

by edifil 4mo ago

I love it! I want to do the same, I guess mostly just concerned with hitting limits super quick, is there anyway you can see that info on telegram/whatsapp and route to different models? or are you building that into the tools and just using telegram as conversational

hackerbone 4mo ago
So the model route layer should be something that you would have to internally build on the inference POV - like opting for an OpenRouter or creating your own AI Gateway. I've created an ai gateway myself with fallback models - this manages TPM/RPM rate limits and works seamlessly!