4 ms·
One of the most plausible interpretations is that dopamine's primary role in cognition isn't to model reward, but to predict uncertainty. This seems to be roug
by dcolkitt 6y ago
One of the most plausible interpretations is that dopamine's primary role in cognition isn't to model reward, but to predict uncertainty.
This seems to be roughly in line with how subjects with excessively high or low dopamine behave. Those on heroic doses of amphetamines become convinced of the most harebrained ideas. ("I know the CIA is listening to me through the toaster, better take it apart.") Whereas schizophrenic catatonia, a lack of will to even move, is often caused by impaired dopamine receptors.
This clarifies why dopamine drives addiction and compulsion, without a corresponding reward in terms of actual satisfaction. The evolutionary environment heavily incentives risk aversion. The downsides of any major risk almost always outweigh the upsides. Keep pursuing a more nourishing but unpredictable food source and you'll eventually starve, regardless of how well fed you are in good times. Keep fighting opponents that are even matches, and eventually you'll get your head bashed in.
Our brains are heavily wired to seek out small but certain rewards to the exclusion of large but risky ones. This is confirmed in behavioral economics, where subjects will instinctually and irrationally prefer low-risk, low-reward bets even when the payoffs are measured in pennies.
If you feel shitty and depressed, then eating ice cream, banging heroin, or scrolling social media won't fix all your problems. But you know for sure it will make you feel a little better right away. In contrast taking positive steps to improve your life, like exercising, eating better, developing relationships, or mastering marketable skills are ultimately more rewarding but risky. You can put in a lot of effort for a long time and still have no guarantee of seeing any tangible payoff.
- NortySpock 6y agoEspecially with video games you can cause, say, opening chests to always have a small positive reward (1 rupee, etc) and sometimes contain giant rewards (1000 rupee + AwesomeSword), making it always a dopamine hit even with low-risk activities like opening a chest.
- JamesBarney 6y agoHeroin and ice cream work on opioid receptors too which is more directly linked to pleasure/happiness/reward than dopamine.
- ravi-delia 6y agoWhich makes sense; both of them are pleasurable experiences unto themselves. However, pretty much anything addictive does something weird to dopamine in the brain, so it would seem to be the common factor.
- nmfisher 6y agoThis reminds me of a lecture I saw a while back from Robert Sapolsky: https://www.youtube.com/watch?v=GY1x8k79bZE&ab_channel=ChristianG https://www.youtube.com/watch?v=GY1x8k79bZE&ab_channel=Chris... TLDR[0]: dopamine is released during anticipation of reward, not when the reward is actually obtained, and the amount correlates with the uncertainty attached to the risk. [0] It's been a while since I saw it and I don't have time to go through it again, so hopefully I'm summarizing accurately.
- oehtXRwMkIs 6y agoThis is because dopamine measures prediction error, not uncertainty. Honestly did not want to read the lengthy grandparent comment that was probably wrong but here I can say confidently that these days it's pretty well known that the phenomena you mentioned is due to prediction error. Weird thing though is that it seems to only be measuring positive prediction error, complicating our understanding of how our brains carry out temporal difference learning.