8 ms·
You know what this reminds me of? Those trained neural-net things which, however many training examples you give it, always seem to find some way to “cheat” an
by teddyh 10y ago
You know what this reminds me of? Those trained neural-net things which, however many training examples you give it, always seem to find some way to “cheat” and not do what you want while still obeying all your training data correctly.
Something like this: Suppose we have a table of strings of digits, some including spaces, and we’d like to remove the spaces. From
123 456
234567
345 678
to
123456
234567
345678
Now, what happens if it encounters, say
4567890
Would the result be unchanged (as we would probably want), or would it “cheat” and remove the middle “7” character, giving “456890”?
- function_seven 10y agoThis is why I want any ML device to be able to explain itself. It could train on your before-and-after examples and come up with a list of what it thinks you want it to do. For your example, it could list: “Remove interior spaces from each item” or it could say: “Remove the middle character from any 7-character strings to make them 6 characters in length” You would be able to do something with that.
- ChristianBundy 10y agoIIRC you _can_ get this, but it's a huge algorithm that doesn't do things in a way that would probably make sense to a human. It would be amazing to be able to transform code into human language.
- function_seven 10y agoI was sloppy in my own examples. I’d be perfectly satisfied with an AST, or regex, or other non-English explanation. But something that I can audit is what I’m after. Otherwise this tool would never be trustworthy enough to let lose on billions of rows of data, with silent errors occurring throughout. (Well, I guess it depends on the nature and importance of the data. Cat photos, meh. Drug prescriptions? Ahh!)
- jononor 10y agoMaybe also synthesize and suggest property based tests, by one specify also some invalid examples. Then these checks could be ran for each transformation. For instance: - 123 456 = 123456 valid - 1234567 = 123567 not valid (dropped 4) Properties: - output may not contain whitespace - no number characters may be dropped - characters may not be reordered
- paulddraper 10y agoNeural nets are infamous for not doing this. Learning algorithms that produce decision trees are usually used in this situation.
- allenz 10y agoIt's theoretically possible for a neural net to do this; the network just needs to have the explanation as an output. I agree that decision trees would be more reliable and easier to train, but I'm not sure if hardcoding every feature is scalable.
- function_seven 10y agoHow do you know that the explanation jives with the other outputs, though? It seems like a turtles-all-the-way-down situation, because now I want to see how it was properly introspective of its own decision making. Also seems like it’s another magnitude of complexity in the neural net to have it not only train and learn on your inputs, but also train and learn on its own training and learning.
- snaky 10y ago>How do you know that the explanation jives with the other outputs, though? The third neural net would do the checking, obviously.
- allenz 10y agoNeural networks don't do anything as sophisticated as self-referential introspection. They just fit the outputs you train them with. The training data you provide would have to include the desired explanations. Consistency is enforced by the dataset, and also by the model. Both outputs would read from the same hidden layer--the one that encodes the desired transformation.
- randomsearch 10y ago> the network just needs to have the explanation as an output And how would you evaluate whether the explanation was correct or not?
- zitterbewegung 10y agoSome ML systems (like decision trees) can give you a comprehenable way that they made the decision (would give you a list of if conditionals). Unfortunately many can't do this (random forests) . Having an AI that can explain itself in every situation why it does it also has to do with the underlying techniques. For instance random forests generate a random sample of the features and creates decision trees. So the explanation wouldn't be much useful to you.
- nerdponx 10y agoNot true. Look up "partial dependence plots".
- jnpatel 10y agoDataWrangler [0] (now productionized as Trifacta Wrangler [1]) does pretty much that. It gives you suggested lists of transformations such as "Cut from position 18-25 as the Year column", that you can chain together as your data cleaning pipeline. [0]: http://vis.stanford.edu/wrangler/ http://vis.stanford.edu/wrangler/ [1]: https://www.trifacta.com/products/wrangler/ https://www.trifacta.com/products/wrangler/
- pishpash 10y agoThis add-on already does that. (Did nobody try it??) It shows in the pane a list of candidate transforms, seemingly ranked in some descending plausibility order. They have semi-readable names. You get to choose one to apply.
- randomsearch 10y ago> This is why I want any ML device to be able to explain itself. This is the problem of lacking explanatory mechanisms in ML. Note that some techniques that are very out of vogue at the moment, such as Genetic Programming, are much better than neural nets in this regard.
- OscarTheGrinch 10y agoYes, this system should do have an intermediate step of spiting out a checklist of clear rules and the user can select the best fit, saving the human the time it would take to search from a bloated dropdown of all possible rules.
- sundarurfriend 10y agoThis is the stated goal of the Explainable AI initiative, (spearheaded afaik by DARPA, though Google tells me corporates have also began work on it). I hope it works out well because there's going to be a lot of AI code in the near future, and the thought of them all being inscrutable black boxes is pretty scary.
- teddyh 10y agoBut, you know, if you saw something like, all your visible examples were like the strings 123 456 234567 345 678 and the program replies with something like what you wrote: “Remove the middle character from any 7-character strings to make them 6 characters in length”, it would actually take a programmer’s mind to be able to envision why this might in some cases be wrong. Most people who are not programmers would, I think, see this as equivalent to “Remove interior spaces from each item”. I suspect that the skill required to choose an algorithm correctly is the exact same skill required to actually being a programmer. All this then buys you is that you don’t have to remember the function names.
- Giroflex 10y agoThis isn't the machine's fault, though; for a small number of linearly independent examples there exists an enormous number of possible functions that match the training data. It has no way of guessing, really.
- thomasahle 10y agoIf the machine had a large background knowledge of what humans would typically like to do, it would help.
- tonmoy 10y agoMS had been experimenting with this for a while[1]. They even included this in Excel 2013 as "FlashFill". It does not use any NN/ML at all. It uses "program synthesis", which by definition can tell you exactly what "program" it has synthesized to convert you data. In fact in you example it would not cheat, rather leave the string unchanged as explained in the paper. [1] https://www.microsoft.com/en-us/research/publication/automating-string-processing-spreadsheets-using-input-output-examples/ https://www.microsoft.com/en-us/research/publication/automat...
- randomsearch 10y agoMore generally, anything by Sumit Gulwani's group at MSR should be of interest.
- teddyh 10y agoBut maybe I did want it to remove the middle character! Using my training data, there’s no way for the system to actually know for sure what I meant. There is also no way (in general) for it to detect “outliers” and ask me about them, because there is no good way to know what is an outlier and what is not.
- vanderZwan 10y agoYou can modify the output of the program synthesis to fit your needs. See this CurryOn! talk from 2015 by Sumit Gulwani https://www.youtube.com/watch?v=uqV9BlxEG5s https://www.youtube.com/watch?v=uqV9BlxEG5s
- TuringTest 10y agoThis is why this kind of software should have an interactive 'feedback' function that allows the user to select among several, equally likely rules. The experimental Lapis editor[1] did exactly this, by the way. [1] https://en.wikipedia.org/wiki/Lapis_(text_editor) https://en.wikipedia.org/wiki/Lapis_(text_editor)
- randomsearch 10y agoSounds like you're talking about over-fitting the data. Or perhaps just not providing an evaluation function that is sufficiently general. All ML can fall into this trap.
- dimaggiosghost 10y agoI agree, thank you for peovoking this thought. It is raw and if so I apologize. This is where hinting is important. Metadata. That sequence if I know it's a phone number, or a sequence of increasing digits, depends a lot on metadata. Given some reasonable sample size, i believe machine learning could provide hints as to some of the common types of formats. Semi automated data hinting or structuring? There is a bidirectional connection between interpreting your data and how your data is structured Is it possible to use your data column to statistically hint at metadata characteristics by some sort of clustering, then use that to automatically clean input data?
- thewarrior 10y agoYou don't realise how big this is. This is the beginning of the automation of coding.
- coldtea 10y agoWe had such things for decades. Besides, it depends on the slope of "coding". If it gets really difficult really quick (exponentially say), this could just be forever stuck in the "low hanging fruit" stage.
- teddyh 10y agoNo, assembly language was the beginning of automation of coding. Almost nobody codes using raw machine code anymore. Everything since is just more added abstractions.
- ke1vin 10y agoWhen you only provide the system with a few examples, there are many possible transformations which satisfy the examples. One way to eliminate this ambiguity is to also provide a natural language description of what you want, e.g. "remove the spaces". In the natural language processing community, we call this semantic parsing. But sometimes the semantic parser can misinterpret the language too and generate a program which still "cheats" in the same manner as you described. We call these "spurious programs". Shameless plug-- my group has been working on how to deal with these spurious programs: From Language to Programs: Bridging Reinforcement Learning and Maximum Marginal Likelihood https://arxiv.org/abs/1704.07926 https://arxiv.org/abs/1704.07926