2 ms·
The author seems to make a distinction between reinforcement learning (goal driven intelligent behavior) and human behavior. As if humans were beyond optimizing
by visarga 10y ago
The author seems to make a distinction between reinforcement learning (goal driven intelligent behavior) and human behavior. As if humans were beyond optimizing a simple reward. We're not.
I don't think human cognition is open ended, it is just maximizing a bunch of reward channels (food, shelter, sex, avoiding pain, curiosity, creativity). These reward channels are bred into, by evolution. They are what allow us to continue existing, and that is their only condition.
Even the way we can perceive time and space is very limited. Our concepts are not universal, they are just good enough for us. AIs could surpass humans by optimizing on a set of a few rewards, hopefully better chosen than those we evolved in millions of years.