4 ms·
Minor correction: the article describes Chain of Density as "First introduced by Salesforce's AI Research wing" -- however the 1st author (who is a PhD student)
by jph00 3y ago
Minor correction: the article describes Chain of Density as "First introduced by Salesforce's AI Research wing" -- however the 1st author (who is a PhD student) and senior author are both at Columbia; only one of the 5 authors is at Salesforce.
- hackernewds 3y agoprepared to see all these companies "invent" these techniques. fwiw people believe OpenAI "invented" chatgpt, whereas the inventors of the transformer model individually worked at competing companies during the research (Google Brain) and presently founded competing companies now.
- vinni2 3y agoThe novelty of chatgpt was instruction tuning of transformers using reinforcement learning with human feedback and finding right dataset as well as annotations for it. before this transformers were good for some tasks but not so good for generating text. Even though OpenAI didn’t invent transformers they did invent the technique needed to make chatgpt possible.
- jxnlco 3y agoI'll fix this now!
- deleted 3y ago[deleted]