5 ms·
It sounds like you have an output that has been generated by a recurrent neural network trained on a large corpus. The more I read about neural networks the mor
by 3wolf 6y ago
It sounds like you have an output that has been generated by a recurrent neural network trained on a large corpus. The more I read about neural networks the more clear it becomes that there are some classes of them that just write some good stuff. The work of Andrej Karpathy on RNNs for poetry and other things comes to mind. Is your GPT-3 actually even a neural network, though? More research is needed!
^written in response to the blog by GPT-3
- m3kw9 6y agoWeak
- garbagetime 6y agoBeside the point, really - The interesting fact is that it's a lot better than anything we have previously had.
- O_H_E 6y agoWorthy to note that as another comment mentioned, GPT3 was likely trained on pre-GPT2 data.