4 ms·

Based on the Gemini release it’s hard to take what Google claims at face value.

petesergeant 2y ago
Almost as bad as stuff branded IBM Watson for over promising
amazingamazing 2y ago
Totally different constraints. It’s like saying Nobel prize winning physicists can’t be trusted because they get basic arithmetic wrong Gemini is fast food - it’s not supposed to be the best.
- itake 2y ago
  what about Google's flu prediction model release? https://blogs.ucl.ac.uk/pcph-blog/2018/01/23/google-flu-trends-is-dead-long-live-google-trends/ https://blogs.ucl.ac.uk/pcph-blog/2018/01/23/google-flu-tren...
- moralestapia 2y ago
  Your analogy doesn't make sense. Nobel winning physicists can definitely perform arithmetic.
  - Maxatar 2y ago
    It's trendy for accomplished people to talk down about themselves as a way to sound cute. It's similar to software developers who like to say "I don't know what I'm doing, I just Google and Stackoverflow all day." It has a certain charm to it, and certainly there are some people for whom it's true, but overall it's just a misguided attempt at being modest but ultimately a horribly misleading statement. "Do not worry about your difficulties in mathematics, I assure you that mine are greater" - Albert Einstein
  - amazingamazing 2y ago
    I didn’t say they can’t perform it. I’ve seen a laureate get plenty of trival math wrong. It doesn’t matter.
- rurp 2y ago
  A Nobel physicist that couldn't do basic arithmetic would definitely raise my eyebrows, but even taking your analogy at face value Gemini was not marketed as fast food slop. Google can't be trusted to hype products in a reliable way, regardless of their technical details.
  - cozzyd 2y ago
    Well, I'm not going to name names, but let's just say I've met O(10) Nobel laureates in physics and at least one was terrible at arithmetic.
fldskfjdslkfj 2y ago
what did Google claim about Gemini?
computerex 2y ago
Google's work on Alphafold produced a Nobel prize.
- soperj 2y ago
  [flagged]
  - computerex 2y ago
    How is that even remotely relevant? Besides, work on Alphafold produced a Nobel prize in Chemistry.
    - Dylan16807 2y ago
      The implication is that "producing a Nobel prize" is not reliably all that impressive.
  - seizethecheese 2y ago
    A hard science Nobel is very different from the peace prize, obviously.
    - Dylan16807 2y ago
      > obviously It's not obvious to me. Care to elaborate? The only one that strikes me as "obviously" different is the Nobel prize that isn't really a Nobel prize, the one for economics.
      - margalabargala 2y ago
        Some people see it as obvious that hard science and politics have glaring differences that makes the meaningfulness of an award for being very good at one or the other very different.
      - CSMastermind 2y ago
        It is not obvious to me either. I will point out that Physics and Chemistry are awarded by the Royal Swedish Academy of Sciences while the Peace Prize is awarded by a separate Norwegian committee, so it is plausible that one would be more respectable than the other. Literature is a completely different institution as is Physiology/Medicine. The Peace prize and Literature prizes have far more questionable winners in my view than the Physics and Chemistry ones. Economics wasn't added until the 1970s, and has had some extremely suspect winners.
crowcroft 2y ago
Aside from the fact you're conflating two very different things comparing this to Gemini, what exactly is the problem with the Gemini? Specifically just that the release was a bit awkward and had some problems? I've found the latest model releases to be very good compared to other frontier models.
- urbandw311er 2y ago
  Probably a reference to when Google was widely perceived to rush out the first Gemini release, neglecting to mention it did lots of weird racist stuff.
kolinko 2y ago
Their Alpha* work from DeepMind is actually quite good and has a good track record. LLM/Gemini - yeah, what you said, I wouldn't trust a word their team says.
bronco21016 2y ago
They released the work as open source to Github. I guess you could validate their findings?

Almost as bad as stuff branded IBM Watson for over promising

Totally different constraints. It’s like saying Nobel prize winning physicists can’t be trusted because they get basic arithmetic wrong Gemini is fast food - it’s not supposed to be the best.

itake 2y ago
what about Google's flu prediction model release? https://blogs.ucl.ac.uk/pcph-blog/2018/01/23/google-flu-trends-is-dead-long-live-google-trends/ https://blogs.ucl.ac.uk/pcph-blog/2018/01/23/google-flu-tren...
moralestapia 2y ago
Your analogy doesn't make sense. Nobel winning physicists can definitely perform arithmetic.
- Maxatar 2y ago
  It's trendy for accomplished people to talk down about themselves as a way to sound cute. It's similar to software developers who like to say "I don't know what I'm doing, I just Google and Stackoverflow all day." It has a certain charm to it, and certainly there are some people for whom it's true, but overall it's just a misguided attempt at being modest but ultimately a horribly misleading statement. "Do not worry about your difficulties in mathematics, I assure you that mine are greater" - Albert Einstein
- amazingamazing 2y ago
  I didn’t say they can’t perform it. I’ve seen a laureate get plenty of trival math wrong. It doesn’t matter.
rurp 2y ago
A Nobel physicist that couldn't do basic arithmetic would definitely raise my eyebrows, but even taking your analogy at face value Gemini was not marketed as fast food slop. Google can't be trusted to hype products in a reliable way, regardless of their technical details.
- cozzyd 2y ago
  Well, I'm not going to name names, but let's just say I've met O(10) Nobel laureates in physics and at least one was terrible at arithmetic.

fldskfjdslkfj 2y ago

what did Google claim about Gemini?

computerex 2y ago

Google's work on Alphafold produced a Nobel prize.

soperj 2y ago
[flagged]
- computerex 2y ago
  How is that even remotely relevant? Besides, work on Alphafold produced a Nobel prize in Chemistry.
  - Dylan16807 2y ago
    The implication is that "producing a Nobel prize" is not reliably all that impressive.
- seizethecheese 2y ago
  A hard science Nobel is very different from the peace prize, obviously.
  - Dylan16807 2y ago
    > obviously It's not obvious to me. Care to elaborate? The only one that strikes me as "obviously" different is the Nobel prize that isn't really a Nobel prize, the one for economics.
    - margalabargala 2y ago
      Some people see it as obvious that hard science and politics have glaring differences that makes the meaningfulness of an award for being very good at one or the other very different.
    - CSMastermind 2y ago
      It is not obvious to me either. I will point out that Physics and Chemistry are awarded by the Royal Swedish Academy of Sciences while the Peace Prize is awarded by a separate Norwegian committee, so it is plausible that one would be more respectable than the other. Literature is a completely different institution as is Physiology/Medicine. The Peace prize and Literature prizes have far more questionable winners in my view than the Physics and Chemistry ones. Economics wasn't added until the 1970s, and has had some extremely suspect winners.

crowcroft 2y ago

Aside from the fact you're conflating two very different things comparing this to Gemini, what exactly is the problem with the Gemini? Specifically just that the release was a bit awkward and had some problems? I've found the latest model releases to be very good compared to other frontier models.

urbandw311er 2y ago
Probably a reference to when Google was widely perceived to rush out the first Gemini release, neglecting to mention it did lots of weird racist stuff.

kolinko 2y ago

Their Alpha* work from DeepMind is actually quite good and has a good track record. LLM/Gemini - yeah, what you said, I wouldn't trust a word their team says.

bronco21016 2y ago

They released the work as open source to Github. I guess you could validate their findings?