5 ms·

This would be super amazing if it crawled entire sites.

• sthambyah 12y ago
  Thanks for the feedback. This features us actually in testing right now and should be released shortly. The plan is to spider the site at a less frequent interval (say, once a day), and aggregate everything that's changes across all pages in a nice report. The hypothesis is that this would be useful for people with large content based sites and CMS's.
  • chatmasta 12y ago
    I think you're targeting the wrong use case. Sure, some people will want to monitor their own sites for breaking changes. But I assume far more people want to monitor multiple (as in dozens, hundreds) of other websites looking for changes. Think price changes, etc. In fact I had to implement a similar system before any of these nice technologies existed. I was working at a small company in Texas that managed your electricity bill for you in the complicated and deregulated Texas utility market. When I got there, they were manually checking ~100 different utility websites for price changes once a week. When I left, thanks to a system like this, they spent 20 minutes a day manually inputting the price change only on the plans that the system alerted them had changed.
    • richardbrevig 12y ago
      Agreed. This is the first system that checks websites I've seen that isn't focusing on competitive intelligence. Maybe that's their idea, is that they're going to a different market. I'll be interested to see this progress, whether they maintain or pivot. However, a service like this that charges per check, and allows API access...and allows you to check multiple/unlimited pages/sites...very powerful in competitive intelligence.
  • eglover 12y ago
    Good to hear. Thanks to the reply. :D