3 ms·
https://x.com/jaschasd/status/1756930247633825827 https://x.com/jaschasd/status/1756930247633825827 : > So it shouldn't (post-hoc) be a surprise that hyperpara
by westurner 3y ago
https://x.com/jaschasd/status/1756930247633825827 https://x.com/jaschasd/status/1756930247633825827 :
> So it shouldn't (post-hoc) be a surprise that hyperparameter landscapes are fractal. This is a general phenomenon: in these panes we see fractal hyperparameter landscapes for every neural network configuration I tried, including deep linear networks.