4 ms·

You can block them in your robot.txt if you desire... it’s not the same thing, websites want to be indexed