4 ms·

Standards have shifted as well. Gpt2 used to be considered “large” but it is half the size of this. Oh and also Sam Altman said it was too dangerous to release.

Standards have shifted as well. Gpt2 used to be considered “large” but it is half the size of this. Oh and also Sam Altman said it was too dangerous to release. At this point I consider anything too big to run on consumer grade hardware to be large, but an exact definition is a little silly to argue about.

a_wild_dandan 1y ago
Altman released GPT-2 despite expressing that doing so was a bad idea? That's wild.
- Alifatisk 1y ago
  I think Altman meant it's too dangerous to open-source GPT-2, therefore locked it in behind a service.
  - janalsncm 1y ago
    It’s not locked behind a service though. https://huggingface.co/openai-community/gpt2/blob/main/model.safetensors https://huggingface.co/openai-community/gpt2/blob/main/model...
    - Alifatisk 1y ago
      That’s only 124M param
      - thatjoeoverthr 1y ago
        Behold https://huggingface.co/openai-community/gpt2-xl https://huggingface.co/openai-community/gpt2-xl
        Alifatisk 1y ago
        Wow!!!
creshal 1y ago
"consumer grade hardware" is a rather loose definition too, what with RAM on consumer devices being anything between 2GB (low-end phones) and >100GB (high-end laptops/desktops) these days.