4 ms·
Really? I was always taught that search engines only do "get" requests, and anything that modifies data is in a "post" request. Are there really that many bro
by derekp7 13y ago
Really? I was always taught that search engines only do "get" requests, and anything that modifies data is in a "post" request. Are there really that many broken web sites out there, that hasn't already fallen victim to crawlers that ignore robots.txt?
- greglindahl 13y agoYes, there are a lot of broken websites out there.
- blueblob 13y agoI noticed this today. Googling "united check in" and clicking the link "check" gave me a link that told me the confirmation number that I entered was invalid though I never entered one.