I don't think that's the case. Depending on your dataset and objective function, for some (too small) values of k, kNN will settle into local minima and not loc

I don't think that's the case. Depending on your dataset and objective function, for some (too small) values of k, kNN will settle into local minima and not locate the globally optimal solution (I believe).