3 ms·
This seems to so far only address learning in a context where the reward appears shortly after the behavior which caused it. That is valuable to understand, but
by afarrell 7y ago
This seems to so far only address learning in a context where the reward appears shortly after the behavior which caused it. That is valuable to understand, but seems like it fails to yet explain how Executive Functions work.
> What happens if an individual's brain “listens” selectively to optimistic versus pessimistic dopamine neurons? Does this give rise to impulsivity, or depression?
My intuition is that impulsivity would arise as a result of giving much greater weight to the signals of a very recently-trained network than to a less-recently trained network.
This all raises a few questions for me:
1) How does a brain recognize reward in order to fire the signal which trains a dopamine network? It seems straightforward for the taste of food, a hug from a fellow-tribesman, or a bell from playing a video game for 5 hours straight (in a simulated Atari environment).
How does a brain recognize reward while it is (for example) writing a teacher-assigned essay for an unclear audience or a python program without Test-Driven Development?
What does the brain use as its leading-KPIs?
2) How does a brain select how much it listens to different networks which predict rewards from different actions so it is "robust to changes in the environment or changes in the policy". How does the brain adjust its attention in response to changing context?
- pizza 7y agoMere speculation but maybe there are multiplexed temporal-difference-ish networks that correlate different reward frequencies per basis (like the different x[k] for the Fourier transform of a signal x[n])