5 ms·
As someone who has been playing with neural networks since 2011, the results of gpt2 and gpt3 are really impressive. Things have been getting better at a stead
by dave_sullivan 6y ago
As someone who has been playing with neural networks since 2011, the results of gpt2 and gpt3 are really impressive.
Things have been getting better at a steady pace and all the recent work builds on previous work. I know we will see even more impressive results in years to come.
People saying things like “this isn’t different from what we had before” or “it’s hype” are failing to see the progress that has occurred and the field that has developed around these ideas.
- jandrese 6y agoWhat will impress me is when a GPT or something can maintain a train of thought for more than a paragraph, or especially work towards a point. Right now it seems to be good at slinging words together that work grammatically, but invariably wanders all over the place like its being written by a fruit fly with Alzheimers.