Really cool project! I’m curious about the factorization of the optimizer parameters, do you have a functional way of thinking about / tuning each of the terms

Really cool project! I’m curious about the factorization of the optimizer parameters, do you have a functional way of thinking about / tuning each of the terms? Why write `'bias_decay': .85 * 4.8e-4 * batchsize/bias_scaler` instead of `'bias_decay': 4.08e-4 * batchsize/bias_scaler`? https://github.com/tysam-code/hlb-CIFAR10/blob/84ced1ac1dc70332a384f0c4ee37d2ca883abbe5/main.py#L49 https://github.com/tysam-code/hlb-CIFAR10/blob/84ced1ac1dc70...