> The larger web is an ocean of bullshit, and that is where the bullshit within LLMs comes from. Not only that: there's also the fact that LLMs do not "fact ch

> The larger web is an ocean of bullshit, and that is where the bullshit within LLMs comes from. Not only that: there's also the fact that LLMs do not "fact check" their output against any data source. They just generate text based on relative frequencies of different kinds of text in their training data. They don't even have the concept of text being related to other things in the world; in fact they don't even have the concept of "other things in the world". Any text generator built that way will output bullshit, no matter how accurate its training data is. "Bullshit" does not mean the output is necessarily wrong; it means, just as Frankfurt said, that the thing generating the output doesn't care about whether it's true or not. LLMs meet that criterion: they don't care about anything other than relative frequencies in their training data.