2 ms·
To nitpick: FYI robots.txt is not enough. In fact, to make sure stuff doesn't show up at all in Google, you must not use robots.txt blocking, but allow everythi
by jakub_g 9y ago
To nitpick: FYI robots.txt is not enough. In fact, to make sure stuff doesn't show up at all in Google, you must not use robots.txt blocking, but allow everything, and use noindex meta tag.
Otherwise you might have uncrawled, but indexed entries in search results, if a URL is popular for some reason (linked somewhere else etc.)
See https://youtu.be/KBdEwpRQRD0 https://youtu.be/KBdEwpRQRD0