3 ms·
Odd to prohibit crawling PDFs; modern search engines handle those just fine.
by JoshTriplett 10y ago
Odd to prohibit crawling PDFs; modern search engines handle those just fine.
- John23832 10y agoThey probably just want to avoid having to serve them.