4 ms·
Thats a lot less cheaty, biologically speaking, than full backprop. This Hinton guy sounds like he knows what he's talking about. "Context drift as data distri
by sdwr 4y ago
Thats a lot less cheaty, biologically speaking, than full backprop. This Hinton guy sounds like he knows what he's talking about.
"Context drift as data distribution changes" sounds a hell of a lot like real life to me.
Normalized = hedonic treadmill on long view
At the micro scale, data that overflows the normalization is stored in emotional state, creating an orthogonal source of truth that makes up for the lack of full connected learning.