4 ms·
Playing Around with Noise as Targets
- a008t 8y agoCan someone please ELI5 what this does and why/where it is/can be useful?
- tempodox 8y agoDon't trust any machine learning algorithm that you haven't faked yourself. You can make random noise mean anything you want.
- cgearhart 8y agoHis stated purpose was image compression (although I didn’t see evidence that it worked). If the distribution encoded by the is smaller than your image, then you can send the small set of model parameters (instead of the image) and then use the model to reconstruct the target image.
- avaku 8y agoThanks for posting this. This looks like something genuinely new. Going to look into it.
- DoctorOetker 8y agoI didn't read the referenced 2017 paper yet, but mapping the training data to noise (gaussian and/or other) is exactly what the RevNet paper does, with the advantage of deterministic reversibility such that the trained RevNet is also generative (without having to do gradient descent for each generated image)
- dtjohnnyb 8y agoThe intro to the paper has a nice comparison to other similar methods (generative and non-generative) and the blog post linked in this article by inFERNCe https://www.inference.vc/unsupervised-learning-by-predicting-noise-an-information-maximization-view-2 https://www.inference.vc/unsupervised-learning-by-predicting... has a nice comparison at the end to different unsupervised methods and where this method adds novelty (or doesn't!)
- DoctorOetker 8y ago>has a nice comparison at the end to different unsupervised methods I don't see the comparisons at the end of the inFERENCe link?
- smittywerben 8y ago> looks like something genuinely new I fear those words
- zygotic12 8y agoI think I'm missing the point? A visual proof that neural nets can compute any function: http://neuralnetworksanddeeplearning.com/chap4.html http://neuralnetworksanddeeplearning.com/chap4.html