3 ms·
robots.txt is malformed in this example: Disallow: /*/blackhole/* This line won't work even for good robots (robots.txt doesn't have wildcard characters).
by rarestblog 16y ago
robots.txt is malformed in this example:
Disallow: /*/blackhole/*
This line won't work even for good robots (robots.txt doesn't have wildcard characters).