then all the remaining weights are set to the same value During quantization, weights are set to different values, in the extreme case just 2 different values

then all the remaining weights are set to the same value During quantization, weights are set to different values, in the extreme case just 2 different values (binarization). In this case, they are using multiple activation functions to provide various paths for signals to be modified (effectively playing the same role as weights).