Some parts are outdated now. Bot detection vs web scraping is an ever evolving arms race. Anyway, incolumnitas blog is a great source of information about bot

Some parts are outdated now. Bot detection vs web scraping is an ever evolving arms race. Anyway, incolumnitas blog is a great source of information about bot detection and techniques to avoid being detected. We have implemented many successful methods based on it in https://scrapingfish.com/ https://scrapingfish.com/.