4 ms·
I think you can explain it even more clearly with smooth relative shifts, rather than sharp bump functions. I made a quick demo: https://www.desmos.com/calcula
by mkl 8y ago
I think you can explain it even more clearly with smooth relative shifts, rather than sharp bump functions. I made a quick demo: https://www.desmos.com/calculator/rfaqogkbmy https://www.desmos.com/calculator/rfaqogkbmy
Drag the sliders for w and n to change how step-like the sigmoids are and how many are combined. The purple lines are the sigmoids, relative changes at each (regularly spaced) position, which are added together to make the blue approximation to the red function. You can change the function f(x) to see how it handles other possibilities, including piecewise/discontinuous ones like "{x<.5: 0, x>=5: x}".
- Gravityloss 8y agoThis deserves its own submission. Maybe the number of neurons slider could be logarithmic?
- mkl 8y agoDone: https://news.ycombinator.com/item?id=19711416 https://news.ycombinator.com/item?id=19711416 I couldn't find a nice way of making the slider logarithmic (in Desmos the only way to do it is with an intermediate variable, which is kind of confusing), so I reduced the maximum number on the slider. I also fixed a bug.