2 ms·
It does matter. For instance, what will you train your future AI on? If AI ends up eating its own tail it will end up amplifying its errors and the end result i
by jacquesm 4y ago
It does matter. For instance, what will you train your future AI on? If AI ends up eating its own tail it will end up amplifying its errors and the end result is that you won't be able to trust anything that wasn't written down before this hit.
- chrischen 4y agoYou shouldn't be trusting random comments as truth in the first place. Maybe learn to identify high value first? Then you can just train on high value targets. Just because (hypothetically) 4-chan is full of humans doesn't make it suddenly a good training target for AI.
- jacquesm 4y agoRandom comments attached to accounts with good reputation count for something. If those get replaced by random comments written by bots attached to accounts with good reputation then that would be a problem. High value has many signals, reputation is one of them. 4chan is/was a very mixed bag, and just like there are garbage HN comments so there were excellent 4chan comments.
- YetAnotherNick 4y agoOpenAI training data oversamples sites which got 3 reddit likes[1], because it improves model. Most large scale training data has some filter on commoncrawl. [1]: https://paperswithcode.com/dataset/webtext https://paperswithcode.com/dataset/webtext
- p1esk 4y agoMy hope is that future AI will become smarter, not just trained on more data, and as a result it will be capable to perhaps “rate” the quality of any text, based on fact checking, reputation of the commenter, content of all their other comments, frequency of the previous comments, consistency of the style, availability of particular LLMs at the time, etc. It won’t be good enough to detect AI of the same level, but might be good enough to filter out most of the earlier AI’s comments. GPT-5 might be able to detect comments generated by GPT-3, even if its training dataset included a small fraction of GPT-3 generated content, or even if it was trained on the same corpus as GPT-4 (up to 2021).
- jacquesm 4y agoThat's a great point. Thank you.