4 ms·
Oh hey, afaik all of this LLM traffic goes through my service! Set up not too long ago, and afaik pretty load-bearing for this. Feels great, just don’t ask me
by Mond_ 1y ago
Oh hey, afaik all of this LLM traffic goes through my service!
Set up not too long ago, and afaik pretty load-bearing for this. Feels great, just don’t ask me any product-level questions. I’m not part of the Gemini CLI team, so I’ll try to keep my mouth shut.
Not going to lie, I’m pretty anxious this will fall over as traffic keeps climbing up and up.
- asadm 1y agodo you mean the genai endpoints?
- paradite 1y agoI chanced up some endpoint that mentioned "makersuite" that seems to be what's behind genai. It's interesting to see how one team / product gets rebranded to another in Google.
- cperry 1y agothank you for your service. I too have been anxious all day :)