2 ms·
Useless in the sense it doesn't really need to mention Bing. Blocking /css and /js makes sense because they don't add value in being crawled. Not necessary, bu
by pierrefar 17y ago
Useless in the sense it doesn't really need to mention Bing.
Blocking /css and /js makes sense because they don't add value in being crawled. Not necessary, but doesn't hurt.
Best practice: Always have a robots.txt file, even if it's empty.
- beza1e1 17y agoWhat is the reason for your Best Practice advice?