If LLMs just output the most likely next word, then there must exist enough documents out on the Internet with people in similar situations to make the response

If LLMs just output the most likely next word, then there must exist enough documents out on the Internet with people in similar situations to make the responses Gemini generated highly probably. Which is a pretty dark probability.