23 ms·
Ask HN: Israeli Search engine?
My site has been getting slammed with connections from 82.80.249.173 and 192.114.71.13 today. Both of these IPs appear to be owned by Bezeq International. It looks very much like when Google or Bing initially indexed my site, basically crawling every link on the site, four or five requests a second.
What is interesting is that all these requests are using real browser user-agents (Firefox 24 (Mozilla/5.0 (Windows NT 6.1; rv:24.0) Gecko/20100101 Firefox/24.0), Chrome 32 (Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/32.0.1700.72 Safari/537.36), IE 10 (Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.1; Trident/6.0)), Opera 9 (Opera/9.80 (Windows NT 6.1; WOW64) Presto/2.12.388 Version/12.16), etc), rather than a spider, or the more common bots I see that will specify FireFox or Chrome with no version.
Any idea what is going on here?
- mtmail 11y agoCycling through a couple of user agent strings to pretend to be a real user takes only few lines of code. Are images requested and Javascript executed? I wouldn't read too much into this. There are lots of crawler/spiders around. From product search engines, people search engines, image or audio, generic or research, some crawlers' whole purpose is to point to your referrers (ads) or maybe your competition hired somebody to crawl you. Once you have a website for a while those crawlers are as usual as programs that try to login or look for old Wordpress vulnerabilities (/wp-admin, /cgi-bin/ etc).
- bbcbasic 11y agoWhats this? Stack exchange?
- megaman22 11y agoNo, the topic has stayed unlocked too long for that :-)