I feel his explanation of activity vectors closely resembles/indicates Hebbian learning rules (due to the dependence on co-occurrences). Pierre Balid from UCI

I feel his explanation of activity vectors closely resembles/indicates Hebbian learning rules (due to the dependence on co-occurrences). Pierre Balid from UCI has a paper coming soon about the theory behind learning rules; I think it might present some interesting ideas for this work from Hinton.