2 ms·
> As an example try to build a character level Markov chain for text generation. It does appear that you would benefit from such an excercise yourself. No real
by srean 8y ago
> As an example try to build a character level Markov chain for text generation.
It does appear that you would benefit from such an excercise yourself. No really, just try it.
A well trained higher order hidden Markov model would function no less impressively than an RNN and with good reason.
- raverbashing 8y agoLooking at this, I'm almost convinced https://nbviewer.jupyter.org/gist/yoavg/d76121dfde2618422139 https://nbviewer.jupyter.org/gist/yoavg/d76121dfde2618422139 (but to me it still seems a LSTM can do a better job)
- srean 8y agoYup LSTMs can capture distant context, but they arent generic RNNs though. A significant part of "Deep" fanboyism comes from lack of knowledge about capabilities of conventional methods. I dont blame them entirely, there is a lot of diengenuous marketing that should claim partial credit.