It is a common misconception that #GPT3 generates truth, or even tries to do so. It does not. It generates an autocompletion. If the corpus usually contains a w

It is a common misconception that #GPT3 generates truth, or even tries to do so. It does not. It generates an autocompletion. If the corpus usually contains a wrong answer, it is likely to generate that. It is a challenge to form a prompt to nudge it to generate the best guess. ... So for me "So you drink it. > You are now dead." is a great autocompletion (a detective story? Game of Thrones?). Calling is "biological reasoning" is plain dumb.