5 ms·
Are you sure? When I look at the GPT-2 examples, and remember my experience with it when you could try on talktotransformer.com, I would say it is. GPT-2 would
by TomMarius 6y ago
Are you sure? When I look at the GPT-2 examples, and remember my experience with it when you could try on talktotransformer.com, I would say it is.
GPT-2 would start to ramble incomprehensibly almost every time. It would forget context after a few words. It would get into loops. To make something resembling a conversation you had to heavily influence it.
- minimaxir 6y agoIt's better, just not 100x better, which is a big difference in practice. Quantitatively about 5x of the output is more useful in my usage, which is not enough to upend society.