3 ms·
Yeah, all the publicly available reddit data is freely available and the cat has been out of the bag for a while. Reddit has a lot of other private information
by screye 3y ago
Yeah, all the publicly available reddit data is freely available and the cat has been out of the bag for a while.
Reddit has a lot of other private information though. The entire corpus of moderated / censored comments is the internet's best alignment dataset. The real upvote/downvote numbers make for perfect RLHF.
Hell, Reddit could remove ads and replace them with paid RLHFing bots. Charge OpenAI money to selectively deploy AI bots to certain QA subreddits. All AI generated comments get deleted within a week. That way it doesn't lead to comment spam, but the bot still gets amazing upvote/downvote feedback and a ton of direct comment-reply feedback. 3rd party apps can't 'ad block' it either, since only Reddit knows which comments are fake.
(psst, reddit, if you're gonna steal my idea, I want to be paid for it)