4 ms·
As I understand it, Hinton has also referred to capsules as "thought vectors". (I think) a capsule is an encoding of information in a persistent mobile form th
by randcraw 9y ago
As I understand it, Hinton has also referred to capsules as "thought vectors". (I think) a capsule is an encoding of information in a persistent mobile form that allows it to be reused in other contexts / nets / knowledgebases -- like a word2vec word definition vector which contains the scores of the most informative n (principal) component words for the given word.
Another obvious attraction of capsules would be the potential to recognize, tune, and maybe even manually introduce labeled concepts in nets during training -- perhaps enabling one shot learning?
- p1esk 9y agoAnother obvious attraction of capsules would be the potential to recognize, tune, and maybe even manually introduce labeled concepts in nets during training -- perhaps enabling one shot learning? This is not obvious to me at all. Can you please explain?