4 ms·
Any pointers on where to get started? I've messed with Karpathy's RNN example using Shakespeare and PG essays, but don't know where to go from there.
by choxi 10y ago
Any pointers on where to get started? I've messed with Karpathy's RNN example using Shakespeare and PG essays, but don't know where to go from there.
- olavgg 10y agoKarpathy's example tries to predict the next character, there is a fork of it that tries to predict the next word. https://github.com/larspars/word-rnn https://github.com/larspars/word-rnn RNN is great approach if you want to play around with text generation with deep learning. But for a chatbot, deep learning alone is not there yet. We create our own intents based on the domain and predict the intent of each question. We have also made it looks smarter by creating an intent hierarchy where we try to do multiple predictions for a question with a goal to drill the question down in the intent tree. In that way we know that the question is about a bank card and can figure out if you want a new one, block it, increase credit, set limits and so on.