It's very impressive as an AI demo. While it's far from perfect, it seems to have a much better grasp of English than previous examples I have seen. It's pickin

It's very impressive as an AI demo. While it's far from perfect, it seems to have a much better grasp of English than previous examples I have seen. It's picking up on small subtleties, it's grammar and spelling are decent, and it's even remembering long strings of arbitrary characters. Which a difficult task for RNNs, which have to learn many "memory cells" from scratch using millions of floating point ops. And it's doing all that with an insect sized brain. I don't know why this is. Perhaps training on dictionaries is a really good way to teach NN's about English. Who would have guessed?