3 ms·
From my recollection of randomly curling sites to look at their headers, many sites don't respond to HEAD with a valid content length for web pages (presumably
by chc 15y ago
From my recollection of randomly curling sites to look at their headers, many sites don't respond to HEAD with a valid content length for web pages (presumably because their CMS doesn't bother to generate the page for HEAD requests).
Quickly checking with curl -LI www.google.com www.apple.com, I see neither of them do. And weirdly, it looks like Cloudflare chops it off all the time.
- SchizoDuckie 15y agoI've also dreamt up some tests, and I have a theory: I could be okay, since I will be downloading mostly ZIP files. These will most likely not be served through a serversided scripted proxy, but allowed to be handled as a raw file, so HEAD might work. Now just to find the time to do these tests :) I hope to whip something up tomorrow.
- toomuchtodo 15y agoSounds like an awesome idea for an API: Submit a URL/URI and get back metadata without your app or mobile device having to do the heavy lifting.