4 ms·

Checkout youtube.com/robots.txt !

• dabit 13y ago
  For the lazy: http://www.youtube.com/robots.txt http://www.youtube.com/robots.txt
  • Mindless2112 13y ago
    And for those who don't know the reference: http://www.youtube.com/watch?v=WGoi1MSGu64 http://www.youtube.com/watch?v=WGoi1MSGu64