5 ms·
I don't think the problem here can be solved purely through programming. It's an issue of teaching the bot right and wrong (maybe even call it morality) and I d
by mizzao 11y ago
I don't think the problem here can be solved purely through programming. It's an issue of teaching the bot right and wrong (maybe even call it morality) and I don't think that's easy at all.
Even humans wouldn't be able to agree on a training set of moral and immoral data. And yet this distinction would have a huge impact on how the bot influences the livelihoods with who it chats with.
- zardo 11y ago>I don't think that's easy at all. Sounds like a pretty simple classification task for an RNN given the newly available large corpus of things they don't want the chatbot to say.
- mizzao 11y agoI agree that given an agreeable set of data, the training isn't hard. That's why I don't really see this as a technical problem. If humans can't even agree on what is right and wrong, moral or immoral, how can we come up with a corpus of data to train the bot on? Sure, Microsoft could control what they wanted the bot to say or not say, but would you really want a large corporation controlling the behavior of future AI systems that interact with people at large, and deciding how to filter information in cases like this? (Disclaimer: I work at MS.)