2 ms·
This is neat. Are you doing your own crawling / indexing or is this data pulled in from somewhere else?
by peak-of-irony 8y ago
This is neat. Are you doing your own crawling / indexing or is this data pulled in from somewhere else?
- voltaire 8y agoCustom python crawler staging data in S3, extractors pick it up from there enriching it using DeepMoji & Fasttext pretrained models for sentiment along with some custom trained SVMs to measure influence, data gets staged in Mongo, then sent to Elastic.
- peak-of-irony 8y agoAny particular reason you didn't opt for scrapy...