2 ms·
I like the idea - would probably use it in the future - can you talk a little bit about what technologies you are using?
by misiti3780 11y ago
I like the idea - would probably use it in the future - can you talk a little bit about what technologies you are using?
- jancurn 11y agoThank you! The crawler is currently based on PhantomJS, there is a pool of worker nodes that distribute the crawling to more machines. We use Node.js + MongoDB backend and Meteor for front-end.