3 ms·
There is an area of research that addresses this specifically. How AI must be able to explain its decisions. If I find the paper again in my bookmarks I'll add
by lowglow 10y ago
There is an area of research that addresses this specifically. How AI must be able to explain its decisions. If I find the paper again in my bookmarks I'll add an edit to it.
- taneq 10y agoIt was on here a while ago, if this is the one you're thinking of? http://www.darpa.mil/program/explainable-artificial-intelligence http://www.darpa.mil/program/explainable-artificial-intellig...
- TeMPOraL 10y agoRelated, the work Sussman is doing: http://dustybutt.org/blog/sussman-on-ai/ http://dustybutt.org/blog/sussman-on-ai/ At some point Sussman expressed how he thought AI was on the wrong track. He explained that he thought most AI directions were not interesting to him, because they were about building up a solid AI foundation, then the AI system runs as a sort of black box. "I'm not interested in that. I want software that's accountable." Accountable? "Yes, I want something that can express its symbolic reasoning. I want to it to tell me why it did the thing it did, what it thought was going to happen, and then what happened instead." He then said something that took me a long time to process, and at first I mistook for being very science-fiction'y, along the lines of, "If an AI driven car drives off the side of the road, I want to know why it did that. I could take the software developer to court, but I would much rather take the AI to court." The article has links to the work he's doing in that area.