3 ms·
Toying around with a smaller model for hyperparameter search is nothing ground-breaking.
by wewxjfq 4y ago
Toying around with a smaller model for hyperparameter search is nothing ground-breaking.
- buildbot 4y agoIt’s not 1:1, understanding how the hypers scale with the model is also important. See https://arxiv.org/abs/2203.03466 https://arxiv.org/abs/2203.03466