I created a web application and set of scripts late last year to snapshot sites like that on a daily/hourly/minutely interval. Also set up the web app to manage

I created a web application and set of scripts late last year to snapshot sites like that on a daily/hourly/minutely interval. Also set up the web app to manage the captured images and turn them into videos. Some of the interesting things I found: - interesting to compare news sites coverage of the same news stories - see who publishes stories first and where on the page... - quickly analyse site ad and content refresh rates - instant time lapse videos from web cam sites - some interesting artistic effects as content changes and moves on sites - "photographic record" of web sites was interesting to see some sites not update or be broken at times - very easy to generate gigabytes of content in small amounts of time! I have't have time to extend the project further right now, but I still have jobs running capturing some of the top sites daily to get some year-long web-time-lapse videos and do something with the content. If anyone has ideas to commercialize the content or technology, let me know. Note: Technologies used - Ubuntu, bash, CutyCapt, JSP, ImageMagick