> it is trivial to spoof user-agent It's also trivial to detect spoofed user agents via fingerprinting. The best defense against scrapers is done in layers, wi

> it is trivial to spoof user-agent It's also trivial to detect spoofed user agents via fingerprinting. The best defense against scrapers is done in layers, with user-agent name block as the bare minimum.