akyu

16 ms·

121.
by akyu 10y ago
I was using Keras pretty heavily, but I have switched over to fully using TensorFlow. Once you build a decent library of boiler plate, Tensorflow becomes very usable. Packages like prettytensor may even surpass Keras in terms of usability.
122.
by akyu 10y ago
>composable, hierarchical generative models and probabilistic inference. Deep neural networks are basically just huge continuous circuit approximators. These two things are not mutually exclusive.
123.
by akyu 10y ago
I'm not sure which I find more annoying; the AI hypers, or the who people who insist that machine learning is "basically just matrix multiplication". As a researcher none of it makes a difference to me either way.
124.
by akyu 10y ago
No, it will still happen. The learned features will just be "overfit" to that small dataset.
125.
by akyu 10y ago
This was true maybe 10 years ago. Not so much anymore.
126.
by akyu 10y ago
You can use gradient descent one example at a time. It still works just fine. The gradients are more unstable, but you will still converge eventually.
127.
by akyu 10y ago
Yes SVMs are still great models. The advantage neural nets have over them are that they can do automatic feature extraction. By the time you get to the last layer of a neural net, you are basically just doing a simple logistic classificatio
128.
by akyu 10y ago
I really love this effort. Research papers are low bandwidth way to get information into our brains. They take a lot of effort to read, even if the ideas are not particularly complicated. Often when reading complicated material, I have to c
129.
by akyu 10y ago
Well, my ego has been sufficiently deflated enough for one night....
130.
by akyu 10y ago
No you're human.
131.
Brain Computation Is Organized via Power-Of-Two-Based Permutation Logic(journal.frontiersin.org)
17 points by akyu 10y ago|0 comments
132.
by akyu 10y ago
It would be worth it just to have LINQ
133.
by akyu 10y ago
You are right that the learning process which ANNs use is pretty much nothing like the brain. But an argument can be made that the feature representations which they learn are quite brain like. For example in visual cortex, you will find fe
134.
by akyu 11y ago
Maxwell wrote that Faraday was "a mathematician of a very high order" despite his lack of formal education. I always found that fascinating.
135.
by akyu 11y ago
Has anyone else noticed that they instinctively build these mind palaces with file systems on your computer? I regularly find my self recalling a fact about our code base by mentally diving through the file structure. It seems like our brai
136.
by akyu 11y ago
I love spicy food so this is great news. But lately I've been wondering about the potential effect of spicy food on gut bacteria. Anyone who's had a painful bowl movement after eating some high Scoville level hot sauce knows what
137.
by akyu 11y ago
This seems to agree quite nicely with Jeff Hawkins theories. Mainly that our brains are primarily doing temporal pattern recognition and language is no exception according to Hawkins. By minimizing the temporal gap between related items, yo
138.
by akyu 11y ago
https://xkcd.com/979/
139.
by akyu 11y ago
It seems like theres a kind of taboo against HTM in the ML community. I guess it stems from their lack of impressive benchmarks, but I think that's kind of missing the point when it comes to HTM. Maybe HTM isn't the right solution
140.
by akyu 11y ago
So he is basically saying Jeff Hawkins was right all along. At least on SDRs
141.
by akyu 11y ago
This seems like trying to understand how a car engine works by listening to the pitch of the sound it makes. Sure you can deduce somethings, but you aren't really going to understand the engine.
142.
by akyu 12y ago
Very Cool. I did a similar project using a Neural Network instead of a look up table, similar to how deepmind did their Atari game system. The neural network adds some overhead to the training time because of backprop, so for small state sp
143.
by akyu 12y ago
Learn the hotkeys/keybindings, and the equivalent in real life applications. In other words, invest some time in learning the most efficient manner to do seemingly mundane things. It pays off in the long run.
144.
by akyu 12y ago
>fleet of Teslas These guys are on top of their buzz game
145.
by akyu 12y ago
A lot of these sound like ideas that Jeff Hawkins has been pushing with his Cortical Learning Algorithm
146.
by akyu 12y ago
Can you elaborate? I don't understand.