4 ms·
This area definitely needs deeper investigation. It is compelling from an intuitive sense and we see tons of practical evidence of chaos being handy in the real
by bionhoward 6y ago
This area definitely needs deeper investigation. It is compelling from an intuitive sense and we see tons of practical evidence of chaos being handy in the real world. I’ve been using EoC initialization for Transformer networks in RL recently and look forward to try it in the helmholtz machine adaptation of the same. One thing I see (anecdotally) is it can easily break, but if it doesn’t, it works better (in terms of performance), so these approaches are probably a lot more useful in systems which do have some homeostasis, such that they can robustly pull themselves back from the abyss