3 ms·
I just want to note that article's main point is that generic machine learning fails. Why? "The Netflix prize is a good example: the last 10% reduction in RMS
by joe_the_user 16y ago
I just want to note that article's main point is that generic machine learning fails.
Why?
"The Netflix prize is a good example: the last 10% reduction in RMSE wasn’t due to more powerful generic algorithms, but rather due to some very clever thinking about the structure of the problem; observations like “people who rate a whole slew of movies at one time tend to be rating movies they saw a long time ago” from BellKor."
That's kind of hand-wavy in the sense that you haven't produced the factor which prevents a generic machine learning algorithm from "being very clever" or determining the specific useful observation. Sure, there's an intuition we have about this but that's it.
And that is kind of inevitable - if we could get an exact measure of why current machine learning algorithms fail, we could probably build new one that succeeded.
- bermanoid 16y agoThe “people who rate a whole slew of movies at one time tend to be rating movies they saw a long time ago” example is wonderful, actually: it indicates exactly the reason that humans can guide choices of algorithms in a way better than machines can: the data that a human uses to to come up with that hypothesis is quite literally unavailable to the machine. It's completely outside the dataset that's under analysis, and comes from a human's experience dealing with humans, and his assumptions about how they act. Most humans would probably mark that statement as "probably true" without even investigating the data, and that's an extremely valuable prior that a ML algorithm has no access to (unless we explicitly program it in). Sure, you might argue that the hypothesis is implicit in the data set, and (though I'm not familiar with the actual Netflix data, so I'm not sure) that might be true - if it's in there in some form, then it's even conceivable that some algorithm might eventually pick it up. But a human would likely never even dream of advancing that hypothesis without at least some vague sense that other humans would probably act that way, and in many cases, without that high prior probability that comes from our knowledge of psychology it wouldn't be proper to consider that factor. So in a sense, we're cheating every time we use our external domain knowledge to push our ML algos to a better spot in hypothesis space. This doesn't say that generic ML fails; it merely says that "the sum total of human knowledge + ML algo applied to data set" > "ML algo applied to data set", especially when "data set" has something to do with shit that humans know very well, like ourselves.