The problem is the grading is trash. In some sub-reddits the grading is literally inversely proportional to the quality of the content. In others its inversely

The problem is the grading is trash. In some sub-reddits the grading is literally inversely proportional to the quality of the content. In others its inversely proportional to traditional grammar rules. In some places it's highly correlated with misogyny. Like how often do you want your LLM to slowly transition it's response to a question into the Fresh Prince of Bel Air meme?[1] Compare it to other forms of content - news sources and journals which are extremely well curated, digitized books - a massive back catalogue of well edited and well structured data, Wikipedia - extremely high quality. I would put it this way, training an LLM on reddit is like teaching a child to play piano entirely by exposing them to freeform jazz. [1]: https://knowyourmeme.com/memes/bel-air-fresh-prince https://knowyourmeme.com/memes/bel-air-fresh-prince