3 ms·
Is there an undocumented hardcoded timeout for Gemini responses even in streaming mode? JSON output according to a schema can get quite lengthy, and I can't see
by troupo 2y ago
Is there an undocumented hardcoded timeout for Gemini responses even in streaming mode? JSON output according to a schema can get quite lengthy, and I can't seem to get all of it for some inputs because Gemini seemingly terminates requests
- NoahZuniga 2y agoThis is probably just you hitting the model's internal output length maximum. Its 65,536 tokens for 2.5 pro and flash. For other models, see this link and open up the collapsed section for your specific model: https://ai.google.dev/gemini-api/docs/models https://ai.google.dev/gemini-api/docs/models
- troupo 2y agoThanks! It might just be that!