4 ms·
Sure initialization helps, but are there also results about long term training dynamics? Even the paper you suggested had to use some sort of normalization to k
by blackbear_ 2y ago
Sure initialization helps, but are there also results about long term training dynamics? Even the paper you suggested had to use some sort of normalization to keep things stable