> Our scraper back then was light years ahead of any others, both in regards to performance (think checkpointing of program state) + accuracy of parsing and JS

> Our scraper back then was light years ahead of any others, both in regards to performance (think checkpointing of program state) + accuracy of parsing and JS execution (back then the target goal was a complete emulation of IE6+, sans ActiveX (exception being various host objects such as XMLHttpRequest)) If you don't mind, can you tell me the name of the software? I was very much into scraping business myself around 2008. One of things I failed to do was to scrape a site made in ASP.NET Webforms. I was looking for software that could emulate Javascript and I think can recall something of that sorts that I saw.