Thanks, that's so true! We learned this the hard way building Monitoro[0] and large data scraping pipelines in the past, so we had the opportunity to build up t

Thanks, that's so true! We learned this the hard way building Monitoro[0] and large data scraping pipelines in the past, so we had the opportunity to build up the required muscle. One thing to note, there are different "tiers" of websites, each requiring different counter-measures. Not everyone is pursuing the high competition websites, and most importantly as we learned in several cases scraping is fully consensual or within the rights of the user. For example: * Many of our users scrape their own websites to send notifications to their discord community. It's a super easy way to create alerts without code. * Sometimes users are locked in their own providers, for example some companies have years of job posting information in their ATS they cannot get out. We do help with that. * Public data websites who are underutilized precisely because the data is difficult to access. We help make that data operational and actionable. We had for example a sailor setup alerts on buoys to stay safe in high waters. A random example[1] 0: https://monitoro.co https://monitoro.co 1: https://wavenet.cefas.co.uk/details/312/EXT https://wavenet.cefas.co.uk/details/312/EXT