3 ms·
1. Get huge amounts of raw, unfiltered, unmoderated data to feed model 2. Apologize, claim there's no way they could have possibly obtained better, moderated,
by ldoughty 2y ago
1. Get huge amounts of raw, unfiltered, unmoderated data to feed model
2. Apologize, claim there's no way they could have possibly obtained better, moderated, or filtered data despite having all the money in the world.
3. Profit... while telling people to kill themselves...
I get that a small team, universities, etc. might not be able to obtain moderated data sets.. but companies making billions on top of billions should be able to hire a dozen or two people to help filter this data set.
This reads a lot like an internet troll comment, and I'm sure an AI trained on such would flag this that way... which could then be filtered out of the training model. You could probably hire a grad student to make this filter for this kind of content before ingestion.
- deleted 2y ago[deleted]
- ninetyninenine 2y agoMakes sense that trolls always refer to other people as humans. That freaking explains it. The model was trained on this. Seriously. There’s no explanation for this. You humans think you can explain everything with random details as if you know what’s going on. You don’t.
- GuB-42 2y agoGood thing I am not your grad student... filtering out the worst humanity has to offer is a terrible job. But anyways, even filtering out bad content is not going to guarantee the LLM won't say terrible things. LLMs can do negation, and can easily turn sources that are about preventing harm into doing harm. And there is also fictional work, we are fine with terrible things in fiction because we understand it is fiction and furthermore, it is the bad guy doing it. If a LLM acts like a fictional bad guy, it will say terrible things because it is what bad guys do. They do use people to filter the output though, it is called RLHF, all of the major publicly available LLMs do it.