3 ms·
But isn't it the case that all that could be scrapped from Reddit before ChatGPT came on-line already has been scrapped, and is publicly available? Anything pos
by TeMPOraL 3y ago
But isn't it the case that all that could be scrapped from Reddit before ChatGPT came on-line already has been scrapped, and is publicly available? Anything post-ChatGPT is going to be increasingly worthless, as there's an unknown amount of LLM-generated content mixed in it, which is going to be wasteful, and potentially poisonous when used in training next-gen LLMs (some early studies already indicate that training LLMs on LLM output leads to visible degradation very quickly).
- CodesInChaos 3y agoYes, there is a publicly available 2TB dump containing every post/comment until Feb 2023.
- Applejinx 3y agoAstonishing that it's only 2 TB…
- bombcar 3y agoI thick Reddit management believes they’re able to close this barn door and that additional horses will appear because Reddit content will continue to remain high quality and LLM-free. Wow that sentence was hard to write with a straight face.