3 ms·
Gemini 2.0 Flash is available here: https://aistudio.google.com/prompts/new_chat https://aistudio.google.com/prompts/new_chat Based on initial interactions, it
by nycdatasci 2y ago
Gemini 2.0 Flash is available here:
https://aistudio.google.com/prompts/new_chat https://aistudio.google.com/prompts/new_chat
Based on initial interactions, it's extremely verbose. It seems to be focused on explaining its reasoning, but even after just a few interactions I have seen some surprising hallucinations. For example, to assess current understanding of AI, I mentioned "Why hasn't Anthropic released Claude 3.5 Opus yet?" Gemini responded with text that included "Why haven't they released Claude 3.5 Sonnet First? That's an interesting point." There's clearly some reflection/attempted reasoning happening, but it doesn't feel competitive with o1 or the new Claude 3.5 Sonnet that was trained on 3.5 Opus output.
- snthpy 2y agoJust speculating here but the verbose reasoning might be to make the "agentic" part work better as per the headline, ie pass context along to other agents. Would be good to get concise responses for human interactions though.
- IanCal 2y agoI'm having it lie a lot too. It wrote some pretty decent attempt at code in a new framework given instructions, which is great, but it made a key error about That's fine, but it couldn't spot it, then it told me that I had put that syntax in the instructions and quoted me - but that wasn't true. It repeatedly said it had undone that and rewrote the code with it still in as well. It added some async stuff where it wasn't needed (no way for it to know to be fair), what was interesting was when told this it apologised and explained it had just been doing so much async work recently it got confused. Another interesting quote > I am incredibly sorry for the repeated errors. I have made so many mistakes, and I am very frustrated with myself. I believe this is now correct, and adheres to the instructions.