7 ms·
This is an approach I'm taking to the data I'm working with, but the problem is that unsupervised learning doesn't reconstruct features the way you want, into i
by astazangasta 10y ago
This is an approach I'm taking to the data I'm working with, but the problem is that unsupervised learning doesn't reconstruct features the way you want, into intelligible human-friendly categories, it reconstructs features to minimize some cost function.
This means the features are weird mathematical intersections that might have something to do with something you can connect to semantic meaning, but they might not. The exercise of discovering what a feature "is" then becomes its own fraught exercise in inspection and discovery.
- visarga 10y agoI think there is a way to train an unsupervised model and make it represent some interesting features explicitly in the top level vector.
- astazangasta 10y agoYes, however, there is no way to connect this to human-friendly categories of meaning, since (1) the method is unsupervised and (2) it might be difficult to impose that sort of supervision on the training, as human semantic meaning is often difficult to encode.