3 ms·
Little bit confusing on what this actually is. Is this 1) Cloud GPU computation where you upload some special model code that is run on the neural network? ie.
by RyanZAG 14y ago
Little bit confusing on what this actually is. Is this
1) Cloud GPU computation where you upload some special model code that is run on the neural network? ie. your own code
2) Upload data and run some pre-specified models on it, such as in the example you have a '-d model=spanish_speech_recognizer' - in which case the offering is all about how many and how good your pre-defined models are.
The two different use cases are for completely different target audiences.
- fiatmoney 14y agoLooks like you spec some parts of the node layout & maybe types, and it fits that spec against your data. So no support for fully custom layouts / fitting methods, but you can parameterize with for instance more or less layers or number of hidden units. Parameterizing & fitting these networks (both in having a good underlying representation, and deciding which actual parameterization to use) gets tricky & requires some domain knowledge when you start doing things like conditional or continuous RBMs.
- dave_sullivan 14y agoSure, I see the confusion. So basically, you bring the data, pick the neural network architecture you want to use, and set its parameters. The model trains on the data you've given it using a GPU cluster (which still takes a while) 'spanish_speech_recognizer' is the name of the model you just trained, where 'MRNN' is the actual architecture (a multiplicative recurrent neural network as described in http://www.cs.toronto.edu/~ilya/pubs/2011/LANG-RNN.pdf http://www.cs.toronto.edu/~ilya/pubs/2011/LANG-RNN.pdf) used in the example. So the models themselves aren't pre-defined, but the architectures you can use are. You can play with a lot of different parameters (if you want), but you don't have to worry about optimizing the code for GPU or making sure your implementation of the algo itself is correct. At least that's the idea.
- snippyhollow 14y agoJust curious, are you using an existing library like Theano, Torch or some other GPU-enabled lib?
- dave_sullivan 14y agoTheano mostly--it really is good at what it does
- hosh 14y agoThanks for explaining it this way.
- tmadar 14y agoVery well explained. Hope you don't mind that I pimped your comment on my personal blog http://www.blogoftravis.com/ http://www.blogoftravis.com/