4 ms·

Have you used Google search at all on the past few months? Every single search brings up a live chat prompt. They're serving fast AI to billions of users at hu

Have you used Google search at all on the past few months? Every single search brings up a live chat prompt. They're serving fast AI to billions of users at huge scale everyday And they're making money doing it. Perhaps they don't have the best coding model right now (although 3.8 flash is arguably SOTA at some benchmarks), but is that the be-all and end-all of AI? Only coding matters?

thereitgoes456 20d ago
It’s so annoying that everyone just points to the Artificial Analysis index (or even worse, Epoch AI, where part of the score is how good the AI is at chess) as a proxy for “how good” the model is.
- owebmaster 19d ago
  Most people talking about Gemini quality do so by experience.
  - verdverm 19d ago
    sounds vibes and bias laden
    - brazukadev 19d ago
      what's your solution? force people to use gemini until they like it? or hire them as googlers?
      - verdverm 19d ago
        my approach is to not use closed weight models, I'm not trying to solve for how to get people to use gemini, quite the opposite actually
- dbbk 20d ago
  At least AA have a dedicated speech model index, of which this is now the leader: https://artificialanalysis.ai/speech-to-speech https://artificialanalysis.ai/speech-to-speech
- polski-g 19d ago
  Its 200-300 TPS. GPT is at 50-60. And its like 5% worse? Yeah that is a good tradeoff.
  - verdverm 19d ago
    Are you watching/waiting on your agents? I care zero about t/sec, quality is far more important that quantity or latency, but they run in the background and I check in from time to time
verdverm 19d ago
> brings up a live chat prompt. They're serving fast AI to billions of users Just because it shows up does not mean it is being used. I only click the feedback button to tell them how much I dislike their Ai summaries. They have removed that feedback button this week. Can't take the heat I suppose. I've also never know anyone who finds them trustworthy nor heard someone say anything besides how they also dislike them
- c0nducktr 19d ago
  A lot of my friends will say "Well, the google AI says this" so they're using it, and maybe they don't trust the answers, but I think the thing is that they're using it. "It's AI but anyway", seems to be a way to use it, but not promote that your using it? There's a significant amount of people in my friend group who don't like "AI", but everyone seems to use what google's doing, even if they add the "the AI said this" disclaimer to it. Even the people who don't like 'AI', will still reference the LLM output, which seems like they're just slow to accept it, I guess.
  - verdverm 19d ago
    there's a difference between reading the ai generated summary, almost certainly cached for many questions just like trad search results, and actually clicking and interacting with the Ai, where the suggested billions people having gemini sessions. Google's own reported token volume would not indicate billions of people are chatting with gemini

thereitgoes456 20d ago

It’s so annoying that everyone just points to the Artificial Analysis index (or even worse, Epoch AI, where part of the score is how good the AI is at chess) as a proxy for “how good” the model is.

owebmaster 19d ago
Most people talking about Gemini quality do so by experience.
- verdverm 19d ago
  sounds vibes and bias laden
  - brazukadev 19d ago
    what's your solution? force people to use gemini until they like it? or hire them as googlers?
    - verdverm 19d ago
      my approach is to not use closed weight models, I'm not trying to solve for how to get people to use gemini, quite the opposite actually
dbbk 20d ago
At least AA have a dedicated speech model index, of which this is now the leader: https://artificialanalysis.ai/speech-to-speech https://artificialanalysis.ai/speech-to-speech
polski-g 19d ago
Its 200-300 TPS. GPT is at 50-60. And its like 5% worse? Yeah that is a good tradeoff.
- verdverm 19d ago
  Are you watching/waiting on your agents? I care zero about t/sec, quality is far more important that quantity or latency, but they run in the background and I check in from time to time

verdverm 19d ago

> brings up a live chat prompt. They're serving fast AI to billions of users Just because it shows up does not mean it is being used. I only click the feedback button to tell them how much I dislike their Ai summaries. They have removed that feedback button this week. Can't take the heat I suppose. I've also never know anyone who finds them trustworthy nor heard someone say anything besides how they also dislike them

c0nducktr 19d ago
A lot of my friends will say "Well, the google AI says this" so they're using it, and maybe they don't trust the answers, but I think the thing is that they're using it. "It's AI but anyway", seems to be a way to use it, but not promote that your using it? There's a significant amount of people in my friend group who don't like "AI", but everyone seems to use what google's doing, even if they add the "the AI said this" disclaimer to it. Even the people who don't like 'AI', will still reference the LLM output, which seems like they're just slow to accept it, I guess.
- verdverm 19d ago
  there's a difference between reading the ai generated summary, almost certainly cached for many questions just like trad search results, and actually clicking and interacting with the Ai, where the suggested billions people having gemini sessions. Google's own reported token volume would not indicate billions of people are chatting with gemini