5 ms·
Ha very nice! I made a vary similar (but much rougher around the edges) project for fun a few months ago using a smaller french corpus of press releases from L
by jaster 9y ago
Ha very nice!
I made a vary similar (but much rougher around the edges) project for fun a few months ago using a smaller french corpus of press releases from La Quadrature du Net (a non-profit lobbying for net neutrality in France and Europe).
There is a live demo at http://jorquera.net/quadra_neural/ http://jorquera.net/quadra_neural/. You can press tab to auto-complete word-by-word, or just start typing and the suggestions update on the fly. Instead of "Weirdness" I called my cursor "Drunkenness" :)
I used keras-js (https://github.com/transcranial/keras-js https://github.com/transcranial/keras-js) to run my model in the browser.
If you are interested in this kind of experiments, do go for it! It's quite accessible, and projects of this scale do not require heavy hardware (I generated my models using a GTX 770).
If you need a kickstart, in addition to the repo from the OP all the code for my project is Free Software (https://github.com/tomjorquera/quadra_neural https://github.com/tomjorquera/quadra_neural), and I tried to document the generation process in a jupyter notepad https://github.com/tomjorquera/quadra_neural/blob/master/generation/model_gen.ipynb https://github.com/tomjorquera/quadra_neural/blob/master/gen.... While I did it on a french corpus, it should work with any language.
I used two main resources for inspiration :
- http://karpathy.github.io/2015/05/21/rnn-effectiveness/ http://karpathy.github.io/2015/05/21/rnn-effectiveness/
- https://github.com/fchollet/keras/blob/master/examples/lstm_text_generation.py https://github.com/fchollet/keras/blob/master/examples/lstm_...