4 ms·

Google regrets publishing this paper!

by dzign 3y ago

mensetmanusman 3y ago
It’s probably Nobel worth based on its world impact.
- numbers_guy 3y ago
  World impact is not how Nobels are won. If that was the case Elon Musk, Jeff Bezos, Zuckerberg and others would all have multiple ones. I honestly do not see this paper as being in the same magnitude of brilliance as a typical Nobel would be. Not to mention that it barely counts as science (actually it probably does not). Don't get me wrong. It is a huge achievement for both the machine learning research field and for humanity as a whole, but putting along the achievements of Nobel physicists and such feels wrong.
  - dvngnt_ 3y ago
    objectively speaking what makes them so much better?
- deleted 3y ago
  [deleted]
- dinvlad 3y ago
  What impact?
  - esafak 3y ago
    It's used in all sorts of advanced models, like LLMs and image generators. They lie at the heart of so called foundation models. https://en.wikipedia.org/wiki/Foundation_models https://en.wikipedia.org/wiki/Foundation_models
    - dinvlad 3y ago
      Right, but what is their "world impact"?
      - esafak 3y ago
        That of allowing people to generate, synthesize, and transform all major modalities of media, from text, to audio and video, for peanuts, instantly. They create immense economic value and increase productivity.
        KptMarchewa 3y ago
        It's deniable right now. Future looks bright for them, but impact _now_ is more smoke than actual effect.
        dinvlad 3y ago
        On top of that, they face massive lawsuits for violating existing IP etc. It's far from a proven business model indeed (heck, OpenAI isn't even profitable yet), and even further as a technology (because it is so inherently unreliable - no matter the model size). So atm they just sell hype, and not much more.
- dzign 3y ago
  You mean a Turing Award...
  - deleted 3y ago
    [deleted]
- akomtu 3y ago
  Nobel is a vanity certificate. The author of that paper must have made more money than whatever the Nobel committee would have given to him.
  - mensetmanusman 3y ago
    Isn’t Nobel like $1M?
abhishekjha 3y ago
Not sure if sarcasm or not.
- nothrowaways 3y ago
  Why do you think it's sarcasm?
- dzign 3y ago
  https://www.washingtonpost.com/technology/2023/05/04/google-ai-stop-sharing-research/ https://www.washingtonpost.com/technology/2023/05/04/google-...
Alifatisk 3y ago
Here’s the thing, if google didn’t publish this paper, it would probably just collect dust somewhere at Google. OpenAi (ClosedAi) saw the potential and demonstrated its impressive and unbelievable capabilities! If Google never shared the transformer model with the world, we would probably not have what we have today.
- dzign 3y ago
  https://www.washingtonpost.com/technology/2023/05/04/google-ai-stop-sharing-research/ https://www.washingtonpost.com/technology/2023/05/04/google-...
- hn_throwaway_99 3y ago
  Very much disagree. Google clearly saw the potential of this as well, and did a ton of work and created a lot of leading models based on this. The big difference between Google and OpenAI is that Google "had a ton more to lose" so to speak and went forward much more cautiously. See all the hullaballoo they had to deal with e.g. with their "Ethical AI" group and the Timnit Gebru fiasco, as well as cases like where that dim bulb Google employee claimed that LaMDA was sentient. OpenAI, on the other hand, was "full speed ahead" from the get-go. As a result, many of the top AI researchers left Google. After all, wouldn't you rather work at a place where you could see your work productized as fast as you could build it, rather than at a place where other sizable teams in your company were actively working in an adversarial role to put up roadblocks and vetoes wherever they could?
  - moralestapia 3y ago
    Very sensible comment, agree with it. I still think that the big cos. (Google, MS, Oracle, ...) will win the AI race in the medium/long term as they have a huge momentum behind them, so they didn't really "miss" anything. ChatGPT is much better than Google Search, though!
    - KptMarchewa 3y ago
      OpenAI is basically front for Microsoft now.
random3 3y ago
Maybe, but it would have surfaced regardless, either directly or through related things. While the transformer may evolve into the next thing, it's equaly likely the next evolution will be unrelated to transformer. Moreover while the transformers and current LLMs are a leap, the monoculture around them is not necessarily a good thing, defocusing many good researchers from otherwise promising tech. Finally, cross-polination of ideas is where the magic happens.
deleted 3y ago
[deleted]

Google regrets publishing this paper!

by dzign 3y ago

Google regrets publishing this paper!

mensetmanusman 3y ago

It’s probably Nobel worth based on its world impact.

numbers_guy 3y ago
World impact is not how Nobels are won. If that was the case Elon Musk, Jeff Bezos, Zuckerberg and others would all have multiple ones. I honestly do not see this paper as being in the same magnitude of brilliance as a typical Nobel would be. Not to mention that it barely counts as science (actually it probably does not). Don't get me wrong. It is a huge achievement for both the machine learning research field and for humanity as a whole, but putting along the achievements of Nobel physicists and such feels wrong.
- dvngnt_ 3y ago
  objectively speaking what makes them so much better?
deleted 3y ago
[deleted]
dinvlad 3y ago
What impact?
- esafak 3y ago
  It's used in all sorts of advanced models, like LLMs and image generators. They lie at the heart of so called foundation models. https://en.wikipedia.org/wiki/Foundation_models https://en.wikipedia.org/wiki/Foundation_models
  - dinvlad 3y ago
    Right, but what is their "world impact"?
    - esafak 3y ago
      That of allowing people to generate, synthesize, and transform all major modalities of media, from text, to audio and video, for peanuts, instantly. They create immense economic value and increase productivity.
      - KptMarchewa 3y ago
        It's deniable right now. Future looks bright for them, but impact _now_ is more smoke than actual effect.
        dinvlad 3y ago
        On top of that, they face massive lawsuits for violating existing IP etc. It's far from a proven business model indeed (heck, OpenAI isn't even profitable yet), and even further as a technology (because it is so inherently unreliable - no matter the model size). So atm they just sell hype, and not much more.
dzign 3y ago
You mean a Turing Award...
- deleted 3y ago
  [deleted]
akomtu 3y ago
Nobel is a vanity certificate. The author of that paper must have made more money than whatever the Nobel committee would have given to him.
- mensetmanusman 3y ago
  Isn’t Nobel like $1M?

abhishekjha 3y ago

Not sure if sarcasm or not.

nothrowaways 3y ago
Why do you think it's sarcasm?
dzign 3y ago
https://www.washingtonpost.com/technology/2023/05/04/google-ai-stop-sharing-research/ https://www.washingtonpost.com/technology/2023/05/04/google-...

Alifatisk 3y ago

Here’s the thing, if google didn’t publish this paper, it would probably just collect dust somewhere at Google. OpenAi (ClosedAi) saw the potential and demonstrated its impressive and unbelievable capabilities! If Google never shared the transformer model with the world, we would probably not have what we have today.

dzign 3y ago
https://www.washingtonpost.com/technology/2023/05/04/google-ai-stop-sharing-research/ https://www.washingtonpost.com/technology/2023/05/04/google-...
hn_throwaway_99 3y ago
Very much disagree. Google clearly saw the potential of this as well, and did a ton of work and created a lot of leading models based on this. The big difference between Google and OpenAI is that Google "had a ton more to lose" so to speak and went forward much more cautiously. See all the hullaballoo they had to deal with e.g. with their "Ethical AI" group and the Timnit Gebru fiasco, as well as cases like where that dim bulb Google employee claimed that LaMDA was sentient. OpenAI, on the other hand, was "full speed ahead" from the get-go. As a result, many of the top AI researchers left Google. After all, wouldn't you rather work at a place where you could see your work productized as fast as you could build it, rather than at a place where other sizable teams in your company were actively working in an adversarial role to put up roadblocks and vetoes wherever they could?
- moralestapia 3y ago
  Very sensible comment, agree with it. I still think that the big cos. (Google, MS, Oracle, ...) will win the AI race in the medium/long term as they have a huge momentum behind them, so they didn't really "miss" anything. ChatGPT is much better than Google Search, though!
  - KptMarchewa 3y ago
    OpenAI is basically front for Microsoft now.

random3 3y ago

Maybe, but it would have surfaced regardless, either directly or through related things. While the transformer may evolve into the next thing, it's equaly likely the next evolution will be unrelated to transformer. Moreover while the transformers and current LLMs are a leap, the monoculture around them is not necessarily a good thing, defocusing many good researchers from otherwise promising tech. Finally, cross-polination of ideas is where the magic happens.

deleted 3y ago

[deleted]