Is there a qualitative difference? I was under the impression that neuro networks worked by converging to a solution BY randomly stumbling into it? Is my rudime

Is there a qualitative difference? I was under the impression that neuro networks worked by converging to a solution BY randomly stumbling into it? Is my rudimentary understanding off this off?