4 ms·
Why scrape at all if there are agreements in place. Seems like a API task
by Havoc 5y ago
Why scrape at all if there are agreements in place. Seems like a API task
- selcuka 5y ago> None of this gets around over-eager Cloudflare or Akamai rules set up years ago by some contractor that the businesses have no real ability to change. If the business has no ability to even change the CloudFlare settings I don't expect them to be able to provide an API.
- hestefisk 5y agoIn that case, the web site IS the API… only difference is data is wrapped in HTML not JSON.
- danpalmer 5y agoOnly about 1 in 20 of our partners has the in-house tech necessary to provide us an API. In other words, we were able to accerelate our integrations by 20x by scraping.