4 ms·
I was wondering, what are these magic numbers on line 84[1]? [1] https://github.com/tysam-code/hlb-CIFAR10/blob/main/main.py#L84 https://github.com/tysam-code/
by newswasboring 4y ago
I was wondering, what are these magic numbers on line 84[1]?
[1] https://github.com/tysam-code/hlb-CIFAR10/blob/main/main.py#L84 https://github.com/tysam-code/hlb-CIFAR10/blob/main/main.py#...
- tysam_and 4y agoOh! Ack! Thanks! Very good question. I'll try to remember to put a 'learning comment' for that on the next go-around. Those are the means and standard deviations of each channel in the training set -- normalizing them up front helps us expect that we have a 0 mean and variance of 1 with our images going into our neural network. This is helpful as we don't need a BatchNorm in front of our first layer that way (and I'm sure for other reasons too). Many thanks for asking, that's a very great question! I was super scared for a minute that I somehow had a naked hyperparameter untagged, but these certainly are very ~mysterious~ numbers indeedy!~ :D <3 <3 <3 <3 :D :D :D :)))
- bravura 4y agoConsider asking chatgpt on davinci latest model to explain and comment your code, and then manually triage its output.
- newswasboring 4y agoYou have to be the happiest and dare I say giddiest poster on HN. Thanks for the answer. I will probably spend a few more days understanding it.
- deleted 4y ago[deleted]