5 ms·

Something interesting to do from now on: Search in Google `site:https://cloudcraft.co/view` https://cloudcraft.co/view` You will see the shared links from exist

• Rezo 11y ago
  Sorry to spoil the fun, but I've disallowed /view/ from robots.txt to prevent accidental shares. I think this one must have been from someone sharing on Twitter or some other public place where Google would have picked it up.
  • swalberg 11y ago
    robots.txt only tells spiders not to request a certain path. The search engine can still infer the content of the page from the link or surrounding text, and show it. Google usually annotates these in the SERPs with something like "Google is not displaying the contents of the page because it's been blocked with robots.txt"
  • mariocesar 11y ago
    An open library will be something really cool to have! Give it a though, I'm eager to see what others diagrams