3 ms·

All the comments there seem to suggest that there has been no change and that robots.txt isn't required.