Anyone who has raised a child knows they hallucinate constantly when they are young because they are just doing probabilistic output of things they have heard p

Anyone who has raised a child knows they hallucinate constantly when they are young because they are just doing probabilistic output of things they have heard people say in similar situations and saying words they don't actually understand. LLMs likely have a similar problem.