I say go for it. I'm building that exact kind of application right now in my spare time targeted towards firearms and ammunition (should be launching in the ne

I say go for it. I'm building that exact kind of application right now in my spare time targeted towards firearms and ammunition (should be launching in the next couple months). I've contacted a couple sites and one of them even gave me a dedicated JSON feed that I could use instead of scraping, although I opted not to use it over data integrity concerns. I'm being very careful to write polite crawlers, but if a site really doesn't want me to crawl their site, I would of course de-list them. Your site model might be a bit different since you say you're targeting the retailers as users, but I don't anticipate much trouble from my approach as I'm targeting the consumers and simply driving them towards the retailers' sites. If anything it's like free advertising for the retailers' products. edit: also if you're really targeting retailers, Semantics3[1] might already be doing what you're planning to do (depending on the industry) [1]: https://www.semantics3.com/ https://www.semantics3.com/