3 ms·

Gemini Pro vs. GPT3.5

• ssabev 3y ago
  Spoiler: it's fast, cheap, overly protective, and has Kafkaesque DX
• jafitc 3y ago
  This "vibe" check that it's even better than GPT-4 Turbo is not what its Elo rating shows on the Chatbot Arena based on not 1 but thousands of user votes. GPT-4 (Turbo) is in a league of its own still.
  • Racing0461 3y ago
    The vibe check is for pro tho. I want to see how ultra is benchmarked.
  • npinsker 3y ago
    By its nature, that site isn't very representative of how the models perform in real-world use.
    • ssabev 3y ago
      The ELO leaderboard you mean?
    • Reubend 3y ago
      That depends on what real world use you're targeting, but unfortunately I'm not aware of anything better than that leaderboard in terms of sample size and model coverage.