Very silly question, no doubt, but why don't we train LLM's language skills on internet fluff, and actual knowledge only on some reputable sources like Wikipedi

Very silly question, no doubt, but why don't we train LLM's language skills on internet fluff, and actual knowledge only on some reputable sources like Wikipedia and Britannica?