4 ms·
Buried in the announcement is the real gem — they’re releasing a new SDK that actually looks like it follows modern best practices. Could be a game-changer for
by serjester 2y ago
Buried in the announcement is the real gem — they’re releasing a new SDK that actually looks like it follows modern best practices. Could be a game-changer for usability.
They’ve had OpenAI-compatible endpoints for a while, but it’s never been clear how serious they were about supporting them long-term. Nice to see another option showing up. For reference, their main repo (not kidding) recommends setting up a Kubernetes cluster and a GCP bucket to submit batch requests.
[1]https://github.com/googleapis/python-genai https://github.com/googleapis/python-genai
- pkkkzip 2y agoits interesting that just as the LLM hype appears to be simmering down, DeepMind is making big strides. I'm more excited by this than any of OpenAI's announcements.
- deleted 2y ago[deleted]
- redrix 2y agoOh wow, it supports directly specifying a Pydantic model as an output schema that it will adhere to for structured JSON output. That’s fantastic! https://github.com/googleapis/python-genai?tab=readme-ov-file#json-response-schema https://github.com/googleapis/python-genai?tab=readme-ov-fil...
- jcheng 2y agoFYI all the LLM Python SDKs that support structured output can use Pydantic for the schema—at least all the ones I can think of.
- mark_l_watson 2y agoI looked carefully at the SDK earlier today - it does look very nice, but it is also a work in progress.