This video[1] cleared up a lot of questions for me as to the issues I've seen with ChatGPT. My current operating theory goes thusly: Think back to "This Perso

This video[1] cleared up a lot of questions for me as to the issues I've seen with ChatGPT. My current operating theory goes thusly: Think back to "This Person does not Exist" [2], a site which generates a simulated human face. This works by randomly picking a vector into the latent space of human faces from a trained model, and showing it to the user. When you're using ChatGPT, you're getting a simulated assistant, at random. The quality of the answer is highly dependent on how that portion of the latent space (and thus that particular simulated assistant) was trained. Thus, as you get a wide variety of faces from this-person-does-not-exist, you'll get a wide variety of simulated assistants from ChatGPT. For me, this explains the schizophrenic nature of ChatGPT. As for the Bullshit it seems to spew, it is working against a rating system (another AI) trained to act like a human rating text. If those humans didn't know something, they had no way to express it, they simply had "pick which is best", which removes all the other dimensions of consideration, and quashes it into a scalar. The optimum strategy for the rating system is to try to BS its way through things, which then teaches ChatGPT to BS its way through things as well. Much like rating systems on HN, and all social media, this destroys information and tends to dis-incentivize nuance. [1] https://www.youtube.com/watch?v=viJt_DXTfwA https://www.youtube.com/watch?v=viJt_DXTfwA [2] https://thispersondoesnotexist.com/ https://thispersondoesnotexist.com/