It'd be interesting to see what models like Grok are using as training data - how it breaks down into different categories of sources, as well as specific ones

It'd be interesting to see what models like Grok are using as training data - how it breaks down into different categories of sources, as well as specific ones such as Twitter, Reddit, etc. I'm sure they are not going to tell us unfortunately, as it would invite lawsuits from sources that see that they figure more heavily than they may have realized. Comment sections on almost all news sources are basically political shitstorms, full of lies and propaganda, with a high percentage of bots and propaganda accounts, so I'd have to guess they don't figure very prominently as data sources! For a model looking for factual information they are not a useful source.