3 ms·
I like it. I've seen experiments that break out eigenvectors of a neural network, which is like being given a dictionary in a foreign language. It's precise, bu
by sp332 9y ago
I like it. I've seen experiments that break out eigenvectors of a neural network, which is like being given a dictionary in a foreign language. It's precise, but you still have to figure out what each eigenvector means. This technique is like having a translating dictionary. It's less precise but it lets you reason about the network with a familiar visual vocabulary.
- amelius 9y agoHow are eigenvectors/values defined for nonlinear systems, and are their properties as useful as in the linear case?
- sp332 9y agoI was thinking of https://en.wikipedia.org/wiki/Eigenface https://en.wikipedia.org/wiki/Eigenface (I like slide 66 of https://www.slideshare.net/MostafaGMMostafa/neural-networks-principal-component-analysis-pca https://www.slideshare.net/MostafaGMMostafa/neural-networks-... "Not magic: Can only capture linear variations".) But you can do things like Google's Deep Dream, where you pick the classification first and feed it backward to see what aspects of the image are important to a class. You can even do it for different layers to see what each layer is looking for. https://research.googleblog.com/2015/06/inceptionism-going-deeper-into-neural.html https://research.googleblog.com/2015/06/inceptionism-going-d...