4 ms·

Remember when GPT-2 was “too dangerous to release” in 2019? That could have still been the state in 2026 if they didn’t YOLO it and ship ChatGPT to kick off thi

Remember when GPT-2 was “too dangerous to release” in 2019? That could have still been the state in 2026 if they didn’t YOLO it and ship ChatGPT to kick off this whole race.

jefftk 8mo ago
That's rewriting history. What they said at the time: > Nearly a year ago we wrote in the OpenAI Charter : “we expect that safety and security concerns will reduce our traditional publishing in the future, while increasing the importance of sharing safety, policy, and standards research,” and we see this current work as potentially representing the early beginnings of such concerns, which we expect may grow over time. This decision, as well as our discussion of it, is an experiment: while we are not sure that it is the right decision today, we believe that the AI community will eventually need to tackle the issue of publication norms in a thoughtful way in certain research areas. -- https://openai.com/index/better-language-models/ https://openai.com/index/better-language-models/ Then over the next few months they released increasingly large models, with the full model public in November 2019 https://openai.com/index/gpt-2-1-5b-release/ https://openai.com/index/gpt-2-1-5b-release/ , well before ChatGPT.
- IshKebab 8mo ago
  They said: > Due to concerns about large language models being used to generate deceptive, biased, or abusive language at scale, we are only releasing a much smaller version of GPT‑2 along with sampling code (opens in a new window). "Too dangerous to release" is accurate. There's no rewriting of history.
  - tecleandor 8mo ago
    Well, and it's being used to generate deceptive, biased, or abusive language at scale. But they're not concerned anymore.
    - girvo 8mo ago
      They've decided that the money they'll make is too important, who cares about externalities... It's quite depressing.
    - bethekidyouwant 8mo ago
      Link?
      - tecleandor 8mo ago
        Link for what?
- gordonhart 8mo ago
  > Due to our concerns about malicious applications of the technology, we are not releasing the trained model. As an experiment in responsible disclosure, we are instead releasing a much smaller model for researchers to experiment with, as well as a technical paper. I wouldn't call it rewriting history to say they initially considered GPT-2 too dangerous to be released. If they'd applied this approach to subsequent models rather than making them available via ChatGPT and an API, it's conceivable that LLMs would be 3-5 years behind where they currently are in the development cycle.
minimaxir 8mo ago
They didn't YOLO ChatGPT. There were more than a few iterations of GPT-3 over a few years which were actually overmoderated, then they released a research preview named ChatGPT (that was barely functional compared to modern standards) that got traction outside the tech community because it was free, and so the pivot ensued.
nikcub 8mo ago
I also remember when the playstation 2 required an export control license because it's 1GFLOP of compute was considered dangerous that was also brilliant marketing
WarmWash 8mo ago
I was just thinking earlier today how in an alternate universe, probably not too far removed from our own, Google has a monopoly on transformers and we are all stuck with a single GPT-3.5 level model, and Google has a GPT-4o model behind the scenes that it is terrified to release (but using heavily internally).
- nsxwolf 8mo ago
  It would have been nice for me to be able to work a few more years and be able to retire
  - dimitrios1 8mo ago
    will your retirement be enjoyable if everyone else around you is struggling?
    - nsxwolf 8mo ago
      What does that mean? Everyone was going to struggle because I still had my 9 to 5 middle class job?
- brador 8mo ago
  Now think about how often the patent system has stifled and stalled and delayed advancement for decades per innovation at a time. Where would we be if patents never existed?
  - cma 8mo ago
    To be fair, Google has a patent on the transformer architecture. Their page rank patent monopoly probably helped fund the R&D.
    - dboreham 8mo ago
      They also had a patent on map/reduce.
  - 8mo ago
ModernMech 8mo ago
Yeah, and Jurassic Park wouldn't have been a movie if they decided against breeding the dinosaurs.
gildenFish 8mo ago
In 2019 the technology was new and there was no 'counter' at that time. The average persons was not thinking about the presence and prevalence of ai in the way we do now. It was kinda like a having muskets against indigenous tribes in the 14-1500s vs a machine gun against a modern city today. The machine gun is objectively better but has not kept up pace with the increase in defensive capability of a modern city with a modern police force.
Aerroon 8mo ago
I think the diffusion model race would've kicked off anyway. Didn't it even start before ChatGPT was released? I think the spark would've been lit either way. It's kind of funny how both of these things kicked off within a few months.

Remember when GPT-2 was “too dangerous to release” in 2019? That could have still been the state in 2026 if they didn’t YOLO it and ship ChatGPT to kick off this whole race.

jefftk 8mo ago

That's rewriting history. What they said at the time: > Nearly a year ago we wrote in the OpenAI Charter : “we expect that safety and security concerns will reduce our traditional publishing in the future, while increasing the importance of sharing safety, policy, and standards research,” and we see this current work as potentially representing the early beginnings of such concerns, which we expect may grow over time. This decision, as well as our discussion of it, is an experiment: while we are not sure that it is the right decision today, we believe that the AI community will eventually need to tackle the issue of publication norms in a thoughtful way in certain research areas. -- https://openai.com/index/better-language-models/ https://openai.com/index/better-language-models/ Then over the next few months they released increasingly large models, with the full model public in November 2019 https://openai.com/index/gpt-2-1-5b-release/ https://openai.com/index/gpt-2-1-5b-release/ , well before ChatGPT.

IshKebab 8mo ago
They said: > Due to concerns about large language models being used to generate deceptive, biased, or abusive language at scale, we are only releasing a much smaller version of GPT‑2 along with sampling code (opens in a new window). "Too dangerous to release" is accurate. There's no rewriting of history.
- tecleandor 8mo ago
  Well, and it's being used to generate deceptive, biased, or abusive language at scale. But they're not concerned anymore.
  - girvo 8mo ago
    They've decided that the money they'll make is too important, who cares about externalities... It's quite depressing.
  - bethekidyouwant 8mo ago
    Link?
    - tecleandor 8mo ago
      Link for what?
gordonhart 8mo ago
> Due to our concerns about malicious applications of the technology, we are not releasing the trained model. As an experiment in responsible disclosure, we are instead releasing a much smaller model for researchers to experiment with, as well as a technical paper. I wouldn't call it rewriting history to say they initially considered GPT-2 too dangerous to be released. If they'd applied this approach to subsequent models rather than making them available via ChatGPT and an API, it's conceivable that LLMs would be 3-5 years behind where they currently are in the development cycle.

minimaxir 8mo ago

They didn't YOLO ChatGPT. There were more than a few iterations of GPT-3 over a few years which were actually overmoderated, then they released a research preview named ChatGPT (that was barely functional compared to modern standards) that got traction outside the tech community because it was free, and so the pivot ensued.

nikcub 8mo ago

I also remember when the playstation 2 required an export control license because it's 1GFLOP of compute was considered dangerous that was also brilliant marketing

WarmWash 8mo ago

I was just thinking earlier today how in an alternate universe, probably not too far removed from our own, Google has a monopoly on transformers and we are all stuck with a single GPT-3.5 level model, and Google has a GPT-4o model behind the scenes that it is terrified to release (but using heavily internally).

nsxwolf 8mo ago
It would have been nice for me to be able to work a few more years and be able to retire
- dimitrios1 8mo ago
  will your retirement be enjoyable if everyone else around you is struggling?
  - nsxwolf 8mo ago
    What does that mean? Everyone was going to struggle because I still had my 9 to 5 middle class job?
brador 8mo ago
Now think about how often the patent system has stifled and stalled and delayed advancement for decades per innovation at a time. Where would we be if patents never existed?
- cma 8mo ago
  To be fair, Google has a patent on the transformer architecture. Their page rank patent monopoly probably helped fund the R&D.
  - dboreham 8mo ago
    They also had a patent on map/reduce.
- 8mo ago

ModernMech 8mo ago

Yeah, and Jurassic Park wouldn't have been a movie if they decided against breeding the dinosaurs.

gildenFish 8mo ago

In 2019 the technology was new and there was no 'counter' at that time. The average persons was not thinking about the presence and prevalence of ai in the way we do now. It was kinda like a having muskets against indigenous tribes in the 14-1500s vs a machine gun against a modern city today. The machine gun is objectively better but has not kept up pace with the increase in defensive capability of a modern city with a modern police force.

Aerroon 8mo ago

I think the diffusion model race would've kicked off anyway. Didn't it even start before ChatGPT was released? I think the spark would've been lit either way. It's kind of funny how both of these things kicked off within a few months.