4 ms·
The neural network doesn't want to minimize its loss function any more than you want to maximize your inclusive genetic fitness. The neural network training pr
by mitthrowaway2 3y ago
The neural network doesn't want to minimize its loss function any more than you want to maximize your inclusive genetic fitness.
The neural network training process wants to minimize the neural network's loss function. The neural network, if it "wants" anything, will have such wants as were embedded in its weights through the process of minimize its loss function, which will mostly be "wants" whose satisfactions correlate with reduced loss function. Of course this is using the term "want" in a behaviourally-descriptive sense, not a subjective-experience sense.
For example, AlphaGo's training routine wants to minimize AlphaGo's loss function. AlphaGo wants to beat you at Go.
- FeepingCreature 3y agoSee also: Reward is not the optimization target https://www.greaterwrong.com/posts/pdaGN6pQyQarFHXF4/reward-is-not-the-optimization-target https://www.greaterwrong.com/posts/pdaGN6pQyQarFHXF4/reward-...