3 ms·
If he didn't put in the last line ("plot twist ...") I'm pretty sure no one here on HN would have guessed it. In fact, while reading that comment I started to
by p1esk 6y ago
If he didn't put in the last line ("plot twist ...") I'm pretty sure no one here on HN would have guessed it.
In fact, while reading that comment I started to wonder why no one has tried to use GPT to generate text one character at a time. Or if someone has, what are the advantages and disadvantages over the BPE approach.
- foobarbecue 6y agoYour second paragraph is GPT-3?
- O_H_E 6y agoOk, now this is getting deep and I don't like it.
- Scarblac 6y agoI assume both previous comments, and this one, are also GPT-3? Edit: it is amusing to think that soon the way to distinguish them will be that human comments have weird errors caused by smartphone keyboard "spell checking" in them...
- p1esk 6y agoYou really think my comment above was GPT-3 generated? Wow. Did I really make so little sense?
- deleted 6y ago[deleted]
- foobarbecue 6y agoOn a re-read, I'm not sure why I thought that, sorry. Context: I don't know much about machine learning and when I was scanning through comments, doing text generation one character at a time seemed silly and I must have been in the grips of "everything could be GPT!" hysteria. My robot detector needs work, clearly. Need to get educated.
- croddin 6y agoBut then if the models are trained on that dataset they might make the same errors to better approximate humans on the forum.
- deleted 6y ago[deleted]
- more-coffee 6y agoThis entire thread is surrealistic and giving me Blade Runner vibes.. I love it.
- che_shirecat 6y agoWhat if the plot twist line is also GPT-3?
- killerstorm 6y agoWell, you'd need to train it from scratch to operate on character level. And it would have smaller context, thus lower quality. So if you want same quality, you need much bigger context. Still, would be an interesting experiment. Gwern swears it would improve stuff, so worth trying and comparing, I guess
- the_other 6y agoI’ve not studied neural nets and ML since undergrad level in 1998. So I am almost as knowledgeable as a random person on the street. The quality of writing was very high, so I was convinced I was reading something put together by a human with agency... except it didn’t pass my gut-feeling “how IT works”. It made me suspect that either the algorithm (the described one, not the AI responsible) was off, or that I just didn’t understand AI any more. As I know I don’t have up to date AI knowledge, the algorithm appeared more believable. I hiked deep down the uncanny valley with that one.
- p1esk 6y agoThis comment didn’t pass my gpt filter.