5 ms·
Reddit and HN are among the highest quality sources of training text and are probably weighted very heavily as "probably human" in the mainstream models. Any s
by smt88 1y ago
Reddit and HN are among the highest quality sources of training text and are probably weighted very heavily as "probably human" in the mainstream models.
Any source of text with huge amounts of automated and community moderation will be better quality than, say, Twitter.
- what 1y agoReddit is anything but high quality.
- jibal 1y ago"among the highEST" is comparative; it doesn't entail "high".
- mh- 1y agoOld Reddit was.
- Auracle 1y agoOh man, someone should train an LLM on pre-Digg death Reddit and modern Reddit and have them chat. It’d be a hoot.
- Jepacor 1y agoThat depends heavily on the subreddits you browse. There absolutely are places with high quality content, though it feels like they are getting sparser and sparser.
- kelnos 1y agoNot in that sense; high quality in the sense that there are a lot of actual, real people posting there, and those people tend to come from a pretty diverse set of backgrounds.
- FiniteField 1y agoPerhaps on the smaller subreddits, but have a look at /r/all on any given day and it's obvious that real people, and diverse backgrounds, it is not. Every single subreddit that goes above a certain activity threshold collapses into the exact same state of astroturfed, mass-produced political slop targeted towards low IQ people.
- AlexeyBelov 1y agoYeah, there is still a lot of manoshpere / rightoid adjacent content on Reddit. It used to be worse though.