3 ms·
Isn't it also that in human writing (and training) the most common or correct response/followup to a prompt structured as a question often is a complete "x is y
by notahacker 6y ago
Isn't it also that in human writing (and training) the most common or correct response/followup to a prompt structured as a question often is a complete "x is y" sentence? GPT-3 appears to consistently parse these question prompts as requiring it to include certain strongly associated words in its output, but not consistently as trivia questions implying terse, associated-word-only answers
It's the opposite of the 'know all' the blog describes, it's GPT-3 knowing where to find the answers without even understanding it's a quiz!