> Perhaps Google also needs to learn to search those closed gardens better. There's a hard limit at what is allowed by robots.txt since Google abides by this s

> Perhaps Google also needs to learn to search those closed gardens better. There's a hard limit at what is allowed by robots.txt since Google abides by this standard.