3 ms·
Question for someone who follows this space: are there any significant models/tech/etc that OpenAI has made open? Either before or after they changed business m
by fenomas 4y ago
Question for someone who follows this space: are there any significant models/tech/etc that OpenAI has made open? Either before or after they changed business models. What they've kept private is well-known, but are there any checkboxes in the other column?
- kragen 4y agowhisper
- polygamous_bat 4y agoOff the top of my head, CLIP the vision-language model, and Whisper, the audio to text model, have their trained weights and the architectures open. They did not open source the training dataset, although I fear it may be too much of an ask given all the possible legal issues.
- deleted 4y ago[deleted]
- scottydog51834 4y agoGPT-2 Here is one cool (and recent) research project using GPT-2 model weights. https://www.lesswrong.com/posts/cgqh99SHsCv3jJYDS/we-found-an-neuron-in-gpt-2 https://www.lesswrong.com/posts/cgqh99SHsCv3jJYDS/we-found-a...
- fenomas 4y agoTFA claims GPT-2 isn't open. Is it that the trained weights are open but the project that did the training isn't?
- alwayslikethis 4y agoRealistically the most difficult part of training a LLM is curating a good data set. OpenAI never published their training data.
- retrac 4y agoWhisper. Speech recognition and translation. Probably the best general-purpose speech recognition available right now. Certainly the best you can run on your own hardware. Open-sourced code and publicly free and available models. https://github.com/openai/whisper https://github.com/openai/whisper