colah3

20 ms·

151.
by colah3 12y ago
I have to load some non-trivial datasets for the interactive visualizations. It may take a minute for javascript to fully load.
152.
by colah3 12y ago
There "the defining property" if you want to mod out isometries. :) They're nice, because they encode the geometry of the data. You could very reasonably try things like cosine distance. And I did some experiments, to good re
153.
by colah3 12y ago
I cut the following sections, on user interface and machine learning, because they were too speculative. But they might be of interest here, so I'll post them. === Perhaps you are now persuaded that deep learning has something helpful
154.
by colah3 12y ago
Thanks, xtacy! > If "simpler" models cluster close to more complex models, the simpler models are more desirable. Well, it would suggest you aren't winning very much for your more complex model, at the very least. > I w
155.
by colah3 12y ago
Thanks! That was one of the most exciting parts of the post for me. It would be really cool to have something, like the Google Books ngram viewer [1], which would allow you to see how this changes over time, using a huge corpus. I imagine a
156.
by colah3 12y ago
Certainly! * The biggest one is probably just train for a very long time. Competitive neural nets for many tasks are trained on GPUs, clusters, or GPU clusters, for days or weeks. * Using convolutional layers really helps. Roughly, convolut
157.
by colah3 12y ago
Good intuition! What you are describing sounds like a technique called pretraining (in particular, greedy, layer-wise pretraining). Five years ago, pretraining was how everyone attacked this problem, although they usually did a different ki
158.
by colah3 12y ago
Author here. While I do have Google Analytic, it's just regular Google Analytic and is definitely not responsible for the slow down. The reason the page is slow is because it does live visualization of a bunch of algorithms on fairly l