4 ms·

If I'm interested in Neural Networks, and I've mainly been working in web development (I know Java, C, and Python). Where would be a good place for me to start

by vertoc 11y ago

If I'm interested in Neural Networks, and I've mainly been working in web development (I know Java, C, and Python). Where would be a good place for me to start so that I can eventually make something like this project?

deet 11y ago
Andrej Karpathy's blog is excellent as a first introduction. Start with http://karpathy.github.io/neuralnets/ http://karpathy.github.io/neuralnets/ He also has a fantastic article specifically about recurrent neural networks here: http://karpathy.github.io/2015/05/21/rnn-effectiveness/ http://karpathy.github.io/2015/05/21/rnn-effectiveness/
- karpathy 11y ago
  Thanks! I'm really enjoying seeing the huge variety of domains people have applied char-rnn to. I haven't anticipated response at this scale, to both the original blog post and the code release. (I try to keep a somewhat up to date list of responses on the bottom of the blog - cooking recipes, music, obama speeches, magic cards...) In terms of learning, I would also encourage people to try the materials from our CS231n class - this is a class I taught at Stanford last quarter with my adviser. It's technically about Convolutional Networks, but most of the class material is building up generic Neural Networks, backprop, and so on. You can also try our IPython Notebook assignments. Course notes: http://cs231n.github.io/ http://cs231n.github.io/ Syllabus with slides too: http://cs231n.stanford.edu/syllabus.html http://cs231n.stanford.edu/syllabus.html Another good pointer is Andrew Ng's Coursera class - that's a thorough introduction as well.
- vertoc 11y ago
  Awesome, thanks for this! I started reading the first link and I'm hooked, that's some extremely interesting stuff
testing3212 11y ago
Matlab has a neural network toolbox that you can use to train small recurrent networks. There is a book that I can link if you are interested.
- shocks 11y ago
  I am interested :)
  - testing3212 11y ago
    This is from one of the people who helped write the toolbox in Matlab. There is a page limit on the Amazon publishing service, so that is why it's posted here[1]. Chapter 14 describes notation for the recurrent networks and explains their training. [1]:http://hagan.okstate.edu/NNDesign.pdf http://hagan.okstate.edu/NNDesign.pdf
  - bkd9 11y ago
    If you are comfortable in MATLAB this tutorial is great: https://theclevermachine.wordpress.com/2014/09/11/a-gentle-introduction-to-artificial-neural-networks/ https://theclevermachine.wordpress.com/2014/09/11/a-gentle-i...
desp 11y ago
I've found http://neuralnetworksanddeeplearning.com http://neuralnetworksanddeeplearning.com by Michael Neilson to be an excellent resource.
- madvoid 11y ago
  This is the one I've always recommended as well. It's a little longer, but very in-depth.
- vertoc 11y ago
  Awesome, will look into, Thanks!
fchollet 11y ago
Keras http://keras.io/ http://keras.io/ is a neural networks library for Python that is rather easy to get started with compared to the alternatives. I also recommend the tutorials on http://deeplearning.net/tutorial/ http://deeplearning.net/tutorial/ (Python / Theano) And Andrej Karpathy's blog is also a great resource for explanations of deep learning concepts in simple terms: https://karpathy.github.io/ https://karpathy.github.io/

by vertoc 11y ago

deet 11y ago

Andrej Karpathy's blog is excellent as a first introduction. Start with http://karpathy.github.io/neuralnets/ http://karpathy.github.io/neuralnets/ He also has a fantastic article specifically about recurrent neural networks here: http://karpathy.github.io/2015/05/21/rnn-effectiveness/ http://karpathy.github.io/2015/05/21/rnn-effectiveness/

karpathy 11y ago
Thanks! I'm really enjoying seeing the huge variety of domains people have applied char-rnn to. I haven't anticipated response at this scale, to both the original blog post and the code release. (I try to keep a somewhat up to date list of responses on the bottom of the blog - cooking recipes, music, obama speeches, magic cards...) In terms of learning, I would also encourage people to try the materials from our CS231n class - this is a class I taught at Stanford last quarter with my adviser. It's technically about Convolutional Networks, but most of the class material is building up generic Neural Networks, backprop, and so on. You can also try our IPython Notebook assignments. Course notes: http://cs231n.github.io/ http://cs231n.github.io/ Syllabus with slides too: http://cs231n.stanford.edu/syllabus.html http://cs231n.stanford.edu/syllabus.html Another good pointer is Andrew Ng's Coursera class - that's a thorough introduction as well.
vertoc 11y ago
Awesome, thanks for this! I started reading the first link and I'm hooked, that's some extremely interesting stuff

testing3212 11y ago

Matlab has a neural network toolbox that you can use to train small recurrent networks. There is a book that I can link if you are interested.

shocks 11y ago
I am interested :)
- testing3212 11y ago
  This is from one of the people who helped write the toolbox in Matlab. There is a page limit on the Amazon publishing service, so that is why it's posted here[1]. Chapter 14 describes notation for the recurrent networks and explains their training. [1]:http://hagan.okstate.edu/NNDesign.pdf http://hagan.okstate.edu/NNDesign.pdf
- bkd9 11y ago
  If you are comfortable in MATLAB this tutorial is great: https://theclevermachine.wordpress.com/2014/09/11/a-gentle-introduction-to-artificial-neural-networks/ https://theclevermachine.wordpress.com/2014/09/11/a-gentle-i...

desp 11y ago

I've found http://neuralnetworksanddeeplearning.com http://neuralnetworksanddeeplearning.com by Michael Neilson to be an excellent resource.

madvoid 11y ago
This is the one I've always recommended as well. It's a little longer, but very in-depth.
vertoc 11y ago
Awesome, will look into, Thanks!

fchollet 11y ago

Keras http://keras.io/ http://keras.io/ is a neural networks library for Python that is rather easy to get started with compared to the alternatives. I also recommend the tutorials on http://deeplearning.net/tutorial/ http://deeplearning.net/tutorial/ (Python / Theano) And Andrej Karpathy's blog is also a great resource for explanations of deep learning concepts in simple terms: https://karpathy.github.io/ https://karpathy.github.io/