3 ms·
I am just wondering, if they trained the model exclusively with real-world data, where are the nonsense answers? People don't always answer seriously. Think red
by choeger 4y ago
I am just wondering, if they trained the model exclusively with real-world data, where are the nonsense answers? People don't always answer seriously. Think reddit threads. Handpicking would probably not be feasible, so how did they do it? Or is there a snarky reddit response somewhere deep inside the model for every question?
- realaleris149 4y agoIt’s a language model. You can think about it this way: What follows after “the”? A: almost anything. What follows after “the apple is”? It could be red, yellow or rotten. What follows after “the apple color is”? Now is most likely a color, because in the training data there are numerous examples like these. Still could be red, yellow, green, but probably not black or white. Or maybe there was a fantasy story somewhere where an apple was black. Even if not, it is most likely a color next, and in other contexts black pops up as a color. And so on. Is very simplistic but essentially something very similar is at work.