50 ms·
Humans optimize for activating the opioid receptor. These receptors are distributed all over the brain and tied into all sorts of subtle neural networks. That
by narrator 7y ago
Humans optimize for activating the opioid receptor. These receptors are distributed all over the brain and tied into all sorts of subtle neural networks. That's why opioid addicts don't do much when they're high. As far as the entire structure of the brain is concerned, an opioid addict's brain is done optimizing and the fitness function is pegged at 1.
I think an AGI will end up being like an AI that plays the Sims except we're the Sims and it's optimizing for our happiness probably by remotely monitoring our opioid receptor activation and some parameters of general health.
- sneak 7y agoSo, opiate synthesis and delivery?
- narrator 7y agoI imagine the AGI system of the future would not make humans happy via that method in that its decision would be counteracted by including physical health indicators in the fitness function.
- stevenwoo 7y agoIsn't this backwards a bit or did I get it wrong - not sure if I am phrasing this right. But to simplify from a laymen's perspective a reading of The Selfish Gene - all creatures will work to continue their genetic line unless misdirected as you describe. So if in some way continuing their genetic offspring is something that activates their opioid receptor, that's what we'll do, creating and raising offspring or as grandparents/cousins/aunts/uncles, helping raise relatives. This can be applied generally to all life on earth.
- throwawayhhakdl 7y agoSuccessful propagation strategies propagate, and therefore become prevalent. Life has no goal; it doesn’t try to propagate. It’s just the result of an evolved process that happens to correlate strongly with propagation. Most processes in organisms have an arbitrary first order objective like getting those happy chemicals. The fact that these first order objectives have a second order effect of survival and reproduction is a wholly unsurprising coincidence.
- narrator 7y agoYou ever think that cattle are exploiting humans to genetically propagate themselves more successfully than any other large mammal besides Humans?
- chillacy 7y agoI must be doing a poor job at being a human, given that I have passed the opportunity to activate my opioid receptors several times in my life so far (leftovers from surgeries).
- narrator 7y agoExogenous opioids are an exploit of our human AI system not a beneficial feature of it.
- throwawayhhakdl 7y agoOne could argue that’s true, and that being bad at things is part of what makes general intelligence (artificial or otherwise) so powerful. Optimizing for goals about goals and redefining the objective Problem space on the fly
- homonculus1 7y agoPerhaps the thought of future addiction fails to activate your opioid receptors in the moment of your decision.