3 ms·
Selenium, Puppeteer, Playwright, Cypress, etc can all drive "real" browsers - although note by default config is altered for performance / testing reasons and t
by kypro 3y ago
Selenium, Puppeteer, Playwright, Cypress, etc can all drive "real" browsers - although note by default config is altered for performance / testing reasons and this can be detected in some cases.
But assuming you're driving a real browser you're probably being "detected" because of your behaviour.
Humans are slow. They follow certain browsing patterns. They interact with the site in a certain way (scrolling, moving the mouse cursor, keyboard presses).
If a client is hitting a site many times a minute without much scrolling or mouse movement and seemingly doing things in an unusual or systematic way it will often trigger security measures like Captchas.
What you're describing here is the product of an arms race between people who want to scrape and exploit websites using automated tools and the websites themselves who want to offer the best service possible to legitimate users.
It's partly why so much of the internet today requires people to login and verify phone numbers / email addresses. It's also why we see captchas and other tactics to slow users down and screen out bots.
If you built something completely undetectable the bad guys would love it and sites would then need to find new ways to detect / stop whatever you're doing.