3 ms·

Currently, the scraping code to extract data is in JavaScript, but what I am building is a mechanism to "record and replay" solution (like Selenium), that can d

• malandrew 14y ago
  If that's your product idea, then you may be asking the wrong people. I would imagine that the audience of people who want scraping but can't code resides elsewhere. Plus, even if this tool does fill a need would you expect the audience to set up their own data store as well? Generally people who are going to scrape data eventually plan on doing something with that data and I can't think of a scenario where a non-coder would would to scrape a lot of data and consume it in a way that doesn't require technical chops. FWIW, I'm working on a scraping project that I will probably open source and the feature that is most valuable to me is being informed when it breaks. In my case it's a real time scraper pulling data on demand, so immediate alert when a scraping formula fails is super important. If you want more feedback, I'd be happy to try it out. Email in profile.