4 ms·
Can't say our machines are trained based on facts, but purely data. What you get out of it is from what you feed into it. The challenge we are going to face in
by alvis 9y ago
Can't say our machines are trained based on facts, but purely data. What you get out of it is from what you feed into it.
The challenge we are going to face in this AI era is that the training data can be biased or include some morally/politically incorrect information. Someone can intentionally manipulate the data and make us feel that the response from the machine is trustworthy and factual, which can be devastating if it is used by a dictating government. Mind the alternative facts!!!
- reader5000 9y agoThis is not like a "fundamental" AI problem; just dont feed the AI shitty data.
- oldsj 9y agoRight but what you call "shitty data" is subjective and can easily differ based on opinion.
- reader5000 9y agoIt's really an outdated concern anyway since most AIs run in realtime and are fed data direct from clickstreams / other realtime pipelines. It's unclear what a 'biased' data source means.
- simias 9y agoLook at 4chan's successful "attacks" on chatbots: https://www.washingtonpost.com/news/the-intersect/wp/2016/03/24/the-internet-turned-tay-microsofts-fun-millennial-ai-bot-into-a-genocidal-maniac/ https://www.washingtonpost.com/news/the-intersect/wp/2016/03... You'll be hard pressed to find a single fact that would be considered so by the entire human population. There are people who are seriously disputing that the earth is round.
- zxcmx 9y agoI think that's a good example. Yes or no, is the world "round"? Well, it's sort of a very slightly lumpy oblate spheroid... it also ties into whether we agree on what "round" means. There's a knowledge problem involved - when answering a question you really have to understand the knowledge and intent of the speaker, establish a conversational frame. The first years of university are often spent learning certain "facts" and theories, which are technically incorrect (but useful), which will be torn down and shown as approximations later. Even things that look like "hard" facts are very often a matter of perspective.
- johnny22 9y agothis isn't about it being lumpy. this is about whether it's flat.
- Analemma_ 9y agoWhat counts as "shitty data" is a subjective question; worse, it's often a political question. So "don't use shitty data" is a reductive and completely unhelpful strategy.
- reader5000 9y agoData is shitty if it's intentionally adversarial, otherwise it's fine. Problem solved.
- danharaj 9y agoIntent has no bearing on the intrinsic quality of the data.
- reader5000 9y agoSure it does. If I intentionally doctor data then it is low quality.
- danharaj 9y agoAnd what if you unintentionally doctor data?
- deleted 9y ago[deleted]
- losteric 9y agoI feel like that's still an open problem for human intelligence...
- rhcom2 9y agoA good article on this: https://www.propublica.org/article/breaking-the-black-box-how-machines-learn-to-be-racist https://www.propublica.org/article/breaking-the-black-box-ho... We can UNintentionally manipulate the data too even when we are trying our best to be honest.