4 ms·
prepared to see all these companies "invent" these techniques. fwiw people believe OpenAI "invented" chatgpt, whereas the inventors of the transformer model ind
by hackernewds 3y ago
prepared to see all these companies "invent" these techniques. fwiw people believe OpenAI "invented" chatgpt, whereas the inventors of the transformer model individually worked at competing companies during the research (Google Brain) and presently founded competing companies now.
- vinni2 3y agoThe novelty of chatgpt was instruction tuning of transformers using reinforcement learning with human feedback and finding right dataset as well as annotations for it. before this transformers were good for some tasks but not so good for generating text. Even though OpenAI didn’t invent transformers they did invent the technique needed to make chatgpt possible.