3 ms·
“It looks like someone at Apple is running a web crawler written in Go.” Likely explains [1] from last year (see [2] for HN thread). [1] http://jan.moesen.nu/
by beltex 11y ago
“It looks like someone at Apple is running a web crawler written in Go.”
Likely explains [1] from last year (see [2] for HN thread).
[1] http://jan.moesen.nu/2014/11/06/apple-crawler.txt http://jan.moesen.nu/2014/11/06/apple-crawler.txt
[2] https://news.ycombinator.com/item?id=8567205 https://news.ycombinator.com/item?id=8567205
- _lce0 11y agonice catch! I remember some thread from the Safari's early ages where they hid the user-agent, to avoid raising attention.