4 ms·
One possible angle for improvement of this technology: use a deep learning net to conjure up a different feature vector than the one I handcrafted from language
by parrt 9y ago
One possible angle for improvement of this technology: use a deep learning net to conjure up a different feature vector than the one I handcrafted from language/grammar expertise. I believe this was your idea. :) Glad to have you on board teaching and doing research!
- nl 9y agoI'm pretty sure this would work really well. I've trained CharCNN on log files, and it generates really good examples files. To me that shows that even a comparatively simple model can capture syntax rules, so I'd imagine a LSTM would generate really good feature vectors.