A friend of mine coined a beautiful definition of what GPT is: a bullshit engine. It is heavily [over?]trained on a criteria of it's output being human-like. I

A friend of mine coined a beautiful definition of what GPT is: a bullshit engine. It is heavily [over?]trained on a criteria of it's output being human-like. I don't know what the loss function looked like, but it seems to me that first-level comprehensiveness was it's main component, like "output is a correct and valid phrase". That's the definition of bullshit: visually valid and comprehensive text without inner logic or consistency.