7 ms·
You shouldn't be trusting random comments as truth in the first place. Maybe learn to identify high value first? Then you can just train on high value targets.
by chrischen 4y ago
You shouldn't be trusting random comments as truth in the first place. Maybe learn to identify high value first? Then you can just train on high value targets. Just because (hypothetically) 4-chan is full of humans doesn't make it suddenly a good training target for AI.
- jacquesm 4y agoRandom comments attached to accounts with good reputation count for something. If those get replaced by random comments written by bots attached to accounts with good reputation then that would be a problem. High value has many signals, reputation is one of them. 4chan is/was a very mixed bag, and just like there are garbage HN comments so there were excellent 4chan comments.
- YetAnotherNick 4y agoOpenAI training data oversamples sites which got 3 reddit likes[1], because it improves model. Most large scale training data has some filter on commoncrawl. [1]: https://paperswithcode.com/dataset/webtext https://paperswithcode.com/dataset/webtext