4 ms·
Instrumental convergence: no matter what its goals are, an agent will always take actions so that it can pursue its goals. Agents that can improve themselves, a
by sbierwagen 10y ago
Instrumental convergence: no matter what its goals are, an agent will always take actions so that it can pursue its goals. Agents that can improve themselves, and gain utility from improving themselves, will try to improve themselves. If doubling its number of CPUs will let it write more paperclip symphonies, then it'll do that.
- idlewords 10y agoThis is trivialy disproved just by looking at the nearest slacker. If none is nearby, I offer myself as a counterexample.
- sbierwagen 10y agoHey man, it's not my fault you've calculated the marginal utility of self improvement to be low or negative. Open a bug with the designer of your neural architecture.
- idlewords 10y agoI sure will. Maybe tomorrow...