4 ms·
Definitely tried to figure out if the dimensions mean anything -- as far as I can tell they don't really mean much :(
by maxlam 9y ago
Definitely tried to figure out if the dimensions mean anything -- as far as I can tell they don't really mean much :(
- Maybestring 9y agoIf you want them to be meaningful without changing the model... Couldn't you rotate the basis to minimize the distance between each basis vector and it's nearest neighbor?
- maxlam 9y agoHaven't tried this but this is definitely a good idea for visualizing what's going on!
- loxias 9y agoOne of the fascinating things about neural embedding such as these is that the individual component dimensions have NO "real" semantic meaning to us humans. It's better to think of them as single points in a higher dimensional space. (of course, with a clever network design you could probably FORCE "meaning" onto some components)