3 ms·
Per some offline discussion, I'll note that while this paper is about the structure of hyperparams, it also starts with the analogy between Mandelbrot & Julia s
by pmayrgundter 3y ago
Per some offline discussion, I'll note that while this paper is about the structure of hyperparams, it also starts with the analogy between Mandelbrot & Julia sets, Julia as the hyperparam space for Mandelbrot, the param space
Well, they both also have similar fractal dimensions. Mandlebrot's Hausdorff dimension is 2, Julia is 1-2.
I won't argue it here but just suggest that this is an important complexity relationship and that the neural net being fit may also have similar fractal complexity, and that the distinction between param and hyper-param in this sense may be somewhat a red-herring
- taneq 3y ago> Julia as the hyperparam space for Mandelbrot It’s kind of the opposite, no? The Mandelbrot set is the set of points where the Julia set for that point includes that point.
- pmayrgundter 3y agoYeah, think you're right.. was reading the intro to the paper wrong. Just saw the acko visualization and was reminded your point https://acko.net/blog/how-to-fold-a-julia-fractal/ https://acko.net/blog/how-to-fold-a-julia-fractal/ Cheers!