2 ms·
> If non-intrusive browsers existed, which could run Javascript, is that considered acceptable to go to JS sites? User agents need not be browsers. What if we
by matheusmoreira 4y ago
> If non-intrusive browsers existed, which could run Javascript, is that considered acceptable to go to JS sites?
User agents need not be browsers. What if we had a scraper for every site? What if we had reverse engineered free software clients for every website's API endpoints? We'd be in full control.
People maintain humongous repositories of ad blocker filters and executable countermeasures against "clever" websites. Perhaps it would be feasible to maintain a collection of scrapers and custom clients too.