4 ms·
NNs/learning/function approximation are compression.
by the8472 2y ago
NNs/learning/function approximation are compression.
- johanvts 2y agoI think more often it’s about translation. From image to classification ex. with no hope of mapping back.
- the8472 2y agoThe classifier still has to learn a model, which is a lossy, compressed representation of the world. Classifiers can be very lossy. The outputs from Google's Deepdream are the kind of things that a classifier would "uncompress" to.
- nightski 2y agoYes, but not solely. They are also generalization.
- plorg 2y agoIf you let your eyes roll to the back of your head and let the spice take over generalization and compression are two sides of the same coin.
- nightski 2y agoThere are plenty of compression methods that have zero generalization. There are also methods of generalization that do not compress at all. It seems to me that they are orthogonal concerns, even if they may make sense to use together.