4 ms·

Thanks for the reference and I stand corrected. And yes I had looked at it a long time ago and will give it another read. But I think it is saying that RNNs are

Thanks for the reference and I stand corrected. And yes I had looked at it a long time ago and will give it another read. But I think it is saying that RNNs are a means of approximating a statistical property of a collection of text. That property is what we today think of as "completion"? That is, glorified auto complete, and not "distributed representations" of the world. Would you agree?

microtonal 10mo ago
distributed representations Distributional representations, not distributed. https://en.wikipedia.org/wiki/Distributional_semantics#Distributional_semantic_modeling_in_vector_spaces https://en.wikipedia.org/wiki/Distributional_semantics#Distr...
- Peteragain 10mo ago
  This is the problem. I am arguing there are no distributed representations (cf Harnad's original symbol grounding problem paper, Hinton, and others). There are "distributional representations" by definition (cf the Wikipedia entry)