3 ms·
Web Scraping Is a Commodity
- squatrito23 3y agoDefinition: There is no intrinsic value difference on who is doing it, as long as it's done well.
- JohnFen 3y agoI hope that commercial web scraping gets centralized enough so only a few companies do it. It would make it that much easier to block.
- penjelly 3y agosounded great but the data sample data format is this https://s3.eu-central-1.amazonaws.com/databoutique.com/publish/AKIAS3CAQLRALYZ5JHVJ/recA8XgZ7jM1Qrp3q/2023-06-27/sample_file.txt https://s3.eu-central-1.amazonaws.com/databoutique.com/publi... i don't like the structure, also this data quickly goes out of date, however it would be useful for grabbing a snapshot of a store site at a given time