4 ms·

I wouldn't even say Gemini Pro 2.5 is the best model. Certainly not when you do multimodal or function calling, which is what actually matters in industry appli

I wouldn't even say Gemini Pro 2.5 is the best model. Certainly not when you do multimodal or function calling, which is what actually matters in industry applications. Plain chatbots are nice, but I don't think they will decide who wins the race. Google is also no longer in the mindset to really innovate. You'll hear surprisingly similar POVs from ex-Googlers and ex-OpenAI guys. I'd actually say OpenAI still has an edge in terms of culture, even through it fell deep.

tgsovlerkhgsel 2y ago
> Certainly not when you do multimodal or function calling Who is? (Genuine question, it's hard to keep up given how quickly the field moves.)
- mjirv 2y ago
  Claude 3.7 Sonnet for function calling, and it’s not particularly close in my experience. Not sure about multimodal as it’s not what I work on.
- stavros 2y ago
  If you want an LLM to interface with other systems, function calling is absolutely essential.
mark_l_watson 2y ago
I have found function calling and ‘roll my own agents’ work much better now with Gemini than they did late last year, but I also do a lot of function calling experiments with small open models using Ollama - much more difficult to work with to get a robust system.
PunchTornado 2y ago
really? all of my friends and everyone I know actually hates openai. they managed to be the bad guy in AI.
int_19h 2y ago
I did some experiments with Gemini Pro 2.5 vs Sonnet 3.7 for coding assistants, and, at least as far as code quality and ability to understand complexities in existing codebase goes, Gemini is noticeably stronger.