3 ms·
If you don't have an "officially recognized" UA string some websites will assume you're a scraper/crawler/bot/ and rightfully so.
by spurgu 8y ago
If you don't have an "officially recognized" UA string some websites will assume you're a scraper/crawler/bot/ and rightfully so.
- threatofrain 8y agoThat's just a heuristic of the times. Soon bots will be much smarter than that.
- seba_dos1 8y agoThey already are.
- ndnxhs 8y agoIf I was ever trying to scrape a website that blocked my user agent I would just set the user agent to chrome on windows. Every library I have used supports setting whatever UA you want.