5 ms·
> it's hard to compare learning a colour histogram to learning concepts such as couch, floor, and open door The output of most machine learning algorithms is j
by ModernMech 10y ago
> it's hard to compare learning a colour histogram to learning concepts such as couch, floor, and open door
The output of most machine learning algorithms is just a belief function. Deep learning is nice, because it basically removes the need to manually choose features, which can be the hardest part of applying machine learning to solve a classification task. But the output is still a belief function.
Machine learning as we generally know it today isn't about making a computer understand "concepts" or anything higher order like that. I think it is easy to compare learning a color histogram to learning classifications (e.g. couch, floor) because the two algorithms do exactly the same task in different ways.
The parent is saying that the function the robot needs to learn is linear. It doesn't matter that it's a drone, and the deep learning apparatus in the middle is overkill, because learning linear functions is easy (you don't need much data to figure out which way is up on a line)
- alexleegk 10y agoYou could also use deep features (pre-trained for ImageNet classification) and use them in your Q-function approximator in such a way that the Q-function is linear wrt some high-level features. Then, you get the best of both: being able to process complex visual input while being able to do reinforcement learning with very few training trajectories. See [1] for an example (in simulation). [1] http://rll.berkeley.edu/visual_servoing/ http://rll.berkeley.edu/visual_servoing/
- eli_gottlieb 10y ago>The output of most machine learning algorithms is just a belief function. It's not even a belief function, in the sense of a normalized probability distribution that respects conditionalization properly. It's basically just a one-hot vector for classification.