3 ms·
Can we avoid weekend changes to the API? I know it's all non-GA, but having `includeThoughts` suddenly work at ~10AM UTC on a Sunday and the raw thoughts being
by Deathmax 1y ago
Can we avoid weekend changes to the API? I know it's all non-GA, but having `includeThoughts` suddenly work at ~10AM UTC on a Sunday and the raw thoughts being returned after they were removed is nice, but disruptive.
- chrisheecho 1y agoCan you tell me the exact instance when this happened please? I will take this feedback back to my colleagues. But in order to change how we behave I need a baseline and data
- Deathmax 1y agoThoughts used to be available in the Gemini/Vertex APIs when Gemini 2.0 Flash Thinking Experimental was initially introduced [1][2], and subsequently disabled to the public (I assume hidden behind a visibility flag) shortly after DeepSeek R1's release [3] regardless of the `include_thoughts` setting. At ~10:15AM UTC 04 May, a change was rolled out to the Vertex API (but not the Gemini API) that caused the API to respect the `include_thoughts` setting and return the thoughts. For consumers that don't handle the thoughts correctly and had specified `include_thoughts = true`, the thinking traces then leaked into responses. [1]: https://googleapis.github.io/python-genai/genai.html#genai.types.ThinkingConfig.include_thoughts https://googleapis.github.io/python-genai/genai.html#genai.t... [2]: https://ai.google.dev/api/generate-content#ThinkingConfig https://ai.google.dev/api/generate-content#ThinkingConfig [3]: https://github.com/googleapis/python-genai/blob/157b16b8df40095b81e7206c7a16d03188744c37/google/genai/tests/models/test_generate_content_thought.py#L49 https://github.com/googleapis/python-genai/blob/157b16b8df40...