Yes! And, also, I swear I've seen this method done before. I can't remember the paper. Can anyone help? Basically, instead of making neural word embeddings,

Yes! And, also, I swear I've seen this method done before. I can't remember the paper. Can anyone help? Basically, instead of making neural word embeddings, much like you describe, the objects being embedded in a vector space were "hit|noun(1)" "hit|noun(2)" "hit|verb", and so on. I believe they used WordNet or some ontology, or maybe a POS corpus like Penn Treebank....