3 ms·
We built the OpenAI Compatible API (https://cloud.google.com/vertex-ai/generative-ai/docs/multimodal/call-vertex-using-openai-library https://cloud.google.com/v
by chrisheecho 1y ago
We built the OpenAI Compatible API (https://cloud.google.com/vertex-ai/generative-ai/docs/multimodal/call-vertex-using-openai-library https://cloud.google.com/vertex-ai/generative-ai/docs/multim...) layer to help customers that are already using OAI library to test out Gemini easily with basic inference but not as a replacement library for the genai sdk (https://github.com/googleapis/python-genai https://github.com/googleapis/python-genai). We recommend using th genai SDK for working with Gemini.
- mike_hearn 1y agoSo, to be clear, Google only supports Python as a language for accessing your models? Nothing else?
- chrisheecho 1y agoWe have Python/Go in GA. Java/JS is in preview (not ready for production) and will be GA soon!
- troupo 1y agoWhat about providing an actual API people can call without needing to rely on Google SDKs?
- logankilpatrick 1y agoyou can do so with the AI SDK from Vercel, open router, etc or just sending raw http requests