There have been a few discussions about this topic in the past, and in the end it boils down to the developer being smart about the way he does requests. I'm q

There have been a few discussions about this topic in the past, and in the end it boils down to the developer being smart about the way he does requests. I'm quite sure (wish I could remember where I read it) the crawler only actually performs GETs (which makes total sense because GET was always meant for retrieving and listing data), so a smart developer would use other HTTP methods (PUT, POST, DELETE) for actions that have modify existing application data.