4 ms·
> at least some parser will choke on them Ah the never ending joy I get by putting a 1GB file as the robots.txt or even having a 1GB `favicon.ico` file.
by vmoore 5y ago
> at least some parser will choke on them
Ah the never ending joy I get by putting a 1GB file as the robots.txt or even having a 1GB `favicon.ico` file.
- marginalia_nu 5y agoDunno how other search engines do it, but I only ever read 512Kb from a connection :P
- vmoore 5y agoI once renamed a Ubuntu .ISO file to favicon.ico and placed it in the root. Some greedy bots choked on it, others had more sense and timed out.