4 ms·

<Rant> I have been working on a product for months and for 1 of the specific models have become the number 3 user and very likely soon the number 2. Its a goog

<Rant> I have been working on a product for months and for 1 of the specific models have become the number 3 user and very likely soon the number 2. Its a google model. The edge cases are crazy to deal with and have taken a long time to find. I am also finding that since it has no fallbacks but no published rate limit I am single handedly taking the model down on what I thought were a reasonable amount of request. There is no other fallback that isn't google. I'm worried that with sustained usage from my users on launch in a few days. Clearly google can't be making that much money on it it im like 10% of the usage and the top 2-3 user of it spending several hundred a month in pre launch testing. So why would they care to help a small time start up? I will have to jump to a cost effective different model and find the footguns all over again at somepoint. Not sure where im going with this but just wanted to let others know </rant>

voakbasda 24d ago
Building a product that depends on a Google product seems like folly at this point. They are notoriously unreliable about keeping products alive. I hope you don’t get burned.
- memoryleakgame 24d ago
  Me too, im a bit nervous because I also have evals proving that flash models are actually getting worse at specific task on newer versions and one of my prime use cases peak around flash 3 and tanks in 3.8. So it would be very very horrible for me if they kill old flash models on open router. Yay google, love living in fear of a vendor that they will rug pull me at any point because they can.
jwxz 24d ago
For a Google model you might be better off directly using their API, which is unfortunately far more painful than using OpenRouter, but it might at least be more reliable for your product. I think the rate limit issue happens because of OpenRouter sending so many requests to Google.
danielmarkbruce 24d ago
You are hitting the google model through openrouter or directly?
- memoryleakgame 22d ago
  Openrouter its just so much easier to use openrouter

voakbasda 24d ago

Building a product that depends on a Google product seems like folly at this point. They are notoriously unreliable about keeping products alive. I hope you don’t get burned.

memoryleakgame 24d ago
Me too, im a bit nervous because I also have evals proving that flash models are actually getting worse at specific task on newer versions and one of my prime use cases peak around flash 3 and tanks in 3.8. So it would be very very horrible for me if they kill old flash models on open router. Yay google, love living in fear of a vendor that they will rug pull me at any point because they can.

jwxz 24d ago

For a Google model you might be better off directly using their API, which is unfortunately far more painful than using OpenRouter, but it might at least be more reliable for your product. I think the rate limit issue happens because of OpenRouter sending so many requests to Google.

danielmarkbruce 24d ago

You are hitting the google model through openrouter or directly?

memoryleakgame 22d ago
Openrouter its just so much easier to use openrouter