4 ms·
It’s so annoying that everyone just points to the Artificial Analysis index (or even worse, Epoch AI, where part of the score is how good the AI is at chess) as
by thereitgoes456 11d ago
It’s so annoying that everyone just points to the Artificial Analysis index (or even worse, Epoch AI, where part of the score is how good the AI is at chess) as a proxy for “how good” the model is.
- owebmaster 11d agoMost people talking about Gemini quality do so by experience.
- verdverm 11d agosounds vibes and bias laden
- brazukadev 11d agowhat's your solution? force people to use gemini until they like it? or hire them as googlers?
- verdverm 10d agomy approach is to not use closed weight models, I'm not trying to solve for how to get people to use gemini, quite the opposite actually
- dbbk 11d agoAt least AA have a dedicated speech model index, of which this is now the leader: https://artificialanalysis.ai/speech-to-speech https://artificialanalysis.ai/speech-to-speech
- polski-g 11d agoIts 200-300 TPS. GPT is at 50-60. And its like 5% worse? Yeah that is a good tradeoff.
- verdverm 11d agoAre you watching/waiting on your agents? I care zero about t/sec, quality is far more important that quantity or latency, but they run in the background and I check in from time to time