2 ms·
Why would this be true for simulated annealing?
by hellohello2 5mo ago
Why would this be true for simulated annealing?
- sdenton4 5mo agoBecause it improves the loss! The gradient is the direction in which loss improves the fastest. Moving in a direction with a positive dot product with the gradient just means that you're (locally) improving the loss.