If you start with the same weights, then the neurons with similar connections will learn the same things. Random initialization is what gets them started in dif

If you start with the same weights, then the neurons with similar connections will learn the same things. Random initialization is what gets them started in different directions.