jimfleming

10 ms·

61.
by jimfleming 10y ago
Look into computational neuroscience, neural engineering, spiking neurons and spike-timing dependent plasticity (STDP). These are more accurate models of biological neurons and their synaptic interactions. From the Hodgkin-Huxley (HH) neuro
62.
by jimfleming 10y ago
I agree, but I guess my point (in this comment and others) would be that we should stop thinking of intelligence, consciousness, free-will and other attributes as a hard line but rather gradients or quantities.
63.
by jimfleming 10y ago
> Only at such a high level of abstraction as to be meaningless. I'm not sure what this means or how the abstractions are meaningless? From Gabor filters to concepts like "dog", the abstractions are quite meaningful (in th
64.
by jimfleming 10y ago
For #2 you've touched on the "AI Effect"[0] or moving goal posts. [0] https://en.wikipedia.org/wiki/AI_effect
65.
by jimfleming 10y ago
The core learning method in biological neurons is believed to be something like STDP (Spike-Timing-Dependent Plasticity). Basically, the arrival time of a spike at the post-synaptic end of a neuron is compared to the arrival time of a spike
66.
by jimfleming 10y ago
Games. Good texture synthesis can augment or replace the texture creation process in games which often rely on hand-painting and manual seam-removal in Photoshop[0][1]. [0] https://www.allegorithmic.com/products/substan
67.
Before AlphaGo there was TD-Gammon(medium.com)
2 points by jimfleming 11y ago|0 comments
68.
by jimfleming 11y ago
"Solved" is pretty broad (as is "AI") but deep learning, specifically, performs well (SotA) on a number of benchmarks in speech, language and image recognition. Some challenges immediately come to mind: 1. The pace of pu
69.
by jimfleming 11y ago
For one, more compression during parameter transfer in data parallelism scenarios.
70.
by jimfleming 11y ago
I don't agree with the premise of the article but the 5-0 results refer to Fan Hui's match ("Europe’s top Go player"). The article describes the outcome of Lee Sedol's match correctly: > Lee went on to lose all b
71.
by jimfleming 11y ago
There's also Gitxiv[0] which matches up Arxiv papers with code. TensorTalk seems to have a wider focus (world generation and Twitter bots) while Gitxiv tends to be focused on active ML research. [0] http://gitxiv.com/
72.
by jimfleming 11y ago
From that page: > Supported cards include but are not limited to[...]
73.
by jimfleming 11y ago
Can you expand on that? As far as I'm aware that's not true (anymore). It runs quite fine on AWS which uses older NVIDIA cards and I know several people use it on older-gen GPU-enabled MBPs. EDIT: clarification
74.
by jimfleming 11y ago
It's nice to see Leaf coming along so well. Part of me would love to be able to build models in rust. For more benchmarks (including updated TensorFlow performance with cudnn v4) see https://github.com/soumith/conv
75.
by jimfleming 11y ago
One benefit of using cloud GPUs is the ability to train multiple models simultaneously. This is difficult to do with your own hardware at a reasonable cost, especially since a large portion of your time will be spent on hyperparameter tunin
76.
by jimfleming 11y ago
Chris Olah also has a great introduction: http://colah.github.io/posts/2015-08-Understanding-LSTMs/
77.
by jimfleming 11y ago
Hello! I'm one of the creators of Fomoro and this is something we've been building over the last couple of weeks. I have a Macbook Pro with no GPU so I frequently use AWS to train models. While AWS doesn't have the best GPUs
78.
Show HN: Training as a service for TensorFlow deep learning models(fomoro.com)
8 points by jimfleming 11y ago|1 comments
79.
by jimfleming 11y ago
DeepMind/Google has a hosted copy: https://storage.googleapis.com/deepmind-data/assets/papers/d...
80.
Loading a TensorFlow graph with the C++ API(medium.com)
4 points by jimfleming 11y ago|0 comments
81.
by jimfleming 11y ago
Check out NeuroAnimator[0] from 1997 (also early work from Hinton). It covers some of this using local-spaced hierarchies of neural networks that predict the deltas for the next time-step. [0] http://web.cs.ucla.edu/~dt&#x2F
82.
by jimfleming 11y ago
It appears to be based on Navier-Stokes, from the abstract: > We designed a feature vector, directly modelling individual forces and constraints from the Navier-Stokes equations, giving the method strong generalization properties to reli
83.
by jimfleming 11y ago
Here's the most recent video that I could find: http://pchiusano.github.io/2015-03-17/unison-update5.html A few of the other posts have videos too: http://pchiusano.github.io/unison/
84.
by jimfleming 11y ago
Ok, so I spent about an hour casually reading the posts, watching the demo videos and glancing at the code. I agree with your premise and I like a lot of the implementation so far. It's great to see more innovation and research in this
85.
by jimfleming 11y ago
> By default AI will optimize the universe to the greatest extent possible towards it's values. Hmm, I'm not sure I understand this line of thinking. Intelligence is complex, soft, and can even conflict with itself. Why do you
86.
by jimfleming 11y ago
I have to agree on a few points as well: We're much closer than we were a year ago but not as close as many think we are w.r.t self-driving cars, killer robots or even reliable speech recognition. Safe-guards are probably a good idea b
87.
by jimfleming 11y ago
Here's a rather lengthy discussion of a similar redesign that began in LA: https://news.ycombinator.com/item?id=8923196
88.
by jimfleming 12y ago
Perhaps linters, auto-formatters, auto-complete, etc. I could understand that it could look like "self-correcting code" to a non-programmer.
89.
by jimfleming 12y ago
I'd love for someone who knows more to chime in but its my understanding that gradient descent does not perform well on non-differentiable functions and only finds local optima. Wikipedia seems to confirm this: http://en.wik
90.
by jimfleming 12y ago
Write it all down. What do you need to do? What do you want to do? What things don't really matter to you? Organize it on paper or whatever medium makes sense. I like OneNote and Trello. I've found its one of the easiest ways to r

More ›