3 ms·

It's hosted on gitlab.com: $ curl -sS -D- -o/dev/null \ https://youtube-dl.org/downloads\ /latest/youtube-dl-2020.11.12.tar.gz HTTP/1.1 3

by jefftk 6y ago

It's hosted on gitlab.com: $ curl -sS -D- -o/dev/null \ https://youtube-dl.org/downloads\ /latest/youtube-dl-2020.11.12.tar.gz HTTP/1.1 302 Found Date: Mon, 16 Nov 2020 15:04:10 GMT Server: Apache/2.2.15 (CentOS) Location: https://youtube-dl.org/downloads\ /2020.11.12/youtube-dl-2020.11.12.tar.gz Content-Length: 3 Connection: close Content-Type: text/html; charset=iso-8859-1 $ curl -sS -D- -o/dev/null \ https://youtube-dl.org/downloads/\ 2020.11.12/youtube-dl-2020.11.12.tar.gz HTTP/1.1 302 Found Date: Mon, 16 Nov 2020 15:05:03 GMT Server: Apache/2.2.15 (CentOS) Location: https://gitlab.com/dstftw/\ youtube-dl/uploads/99d745f22ca3c2a8e9a2\ 3def5446289a/youtube-dl-2020.11.12.tar.gz Content-Length: 3 Connection: close Content-Type: text/html; charset=iso-8859-1

JosephRedfern 6y ago
Weird. It's hosted by github.com when I run identical commands: (base) /tmp curl -sS -D- -o/dev/null https://youtube-dl.org/downloads/latest/youtube-dl-2020.11.12.tar.gz HTTP/1.1 302 Found Date: Mon, 16 Nov 2020 15:52:13 GMT Server: Apache/2.2.15 (CentOS) Location: https://youtube-dl.org/downloads/2020.11.12/youtube-dl-2020.11.12.tar.gz Content-Length: 3 Connection: close Content-Type: text/html; charset=iso-8859-1 (base) /tmp curl -sS -D- -o/dev/null https://youtube-dl.org/downloads/2020.11.12/youtube-dl-2020.11.12.tar.gz HTTP/1.1 302 Found Date: Mon, 16 Nov 2020 15:52:27 GMT Server: Apache/2.2.15 (CentOS) Location: https://github.com/ytdl-org/youtube-dl/releases/download/2020.11.12/youtube-dl-2020.11.12.tar.gz Content-Length: 3 Connection: close Content-Type: text/html; charset=iso-8859-1
- detaro 6y ago
  Either they just switched back, or they have it pick from multiple mirrors.
  - JosephRedfern 6y ago
    Yeah, makes sense!
    - jefftk 6y ago
      Either way, though, they are not hosting it on their website contra the GGGGP (https://news.ycombinator.com/item?id=25112011 https://news.ycombinator.com/item?id=25112011)
theli0nheart 6y ago
This is a little meta, but you can use the the -I / --head argument to tell curl to download headers only. This will ignore the rest of the response and means you can eliminate all of those other flags. E.g.: $ curl -I https://youtube-dl.org/downloads/latest/youtube-dl-2020.11.12.tar.gz HTTP/1.1 302 Found Date: Mon, 16 Nov 2020 19:10:37 GMT Server: Apache/2.2.15 (CentOS) Location: https://youtube-dl.org/downloads/2020.11.12/youtube-dl-2020.11.12.tar.gz Connection: close Content-Type: text/html; charset=iso-8859-1
- jefftk 6y ago
  Not quite: when you pass "-I" curl makes a HEAD request instead of a GET request: $ curl -sS -v -I \ https://www.jefftk.com 2>&1 | grep '^>' > HEAD / HTTP/1.1 > Host: www.jefftk.com > User-Agent: curl/7.58.0 > Accept: */* $ curl -sS -v -D- -o/dev/null \ https://www.jefftk.com 2>&1 | grep '^>' > GET / HTTP/1.1 > Host: www.jefftk.com > User-Agent: curl/7.58.0 > Accept: */* > It turns out that, often enough to be worth worrying about, servers do not return the same headers in response to a HEAD request as a GET request, so I always send a GET request when debugging strange behavior.

by jefftk 6y ago

JosephRedfern 6y ago

Weird. It's hosted by github.com when I run identical commands: (base) /tmp curl -sS -D- -o/dev/null https://youtube-dl.org/downloads/latest/youtube-dl-2020.11.12.tar.gz HTTP/1.1 302 Found Date: Mon, 16 Nov 2020 15:52:13 GMT Server: Apache/2.2.15 (CentOS) Location: https://youtube-dl.org/downloads/2020.11.12/youtube-dl-2020.11.12.tar.gz Content-Length: 3 Connection: close Content-Type: text/html; charset=iso-8859-1 (base) /tmp curl -sS -D- -o/dev/null https://youtube-dl.org/downloads/2020.11.12/youtube-dl-2020.11.12.tar.gz HTTP/1.1 302 Found Date: Mon, 16 Nov 2020 15:52:27 GMT Server: Apache/2.2.15 (CentOS) Location: https://github.com/ytdl-org/youtube-dl/releases/download/2020.11.12/youtube-dl-2020.11.12.tar.gz Content-Length: 3 Connection: close Content-Type: text/html; charset=iso-8859-1

detaro 6y ago
Either they just switched back, or they have it pick from multiple mirrors.
- JosephRedfern 6y ago
  Yeah, makes sense!
  - jefftk 6y ago
    Either way, though, they are not hosting it on their website contra the GGGGP (https://news.ycombinator.com/item?id=25112011 https://news.ycombinator.com/item?id=25112011)

theli0nheart 6y ago

This is a little meta, but you can use the the -I / --head argument to tell curl to download headers only. This will ignore the rest of the response and means you can eliminate all of those other flags. E.g.: $ curl -I https://youtube-dl.org/downloads/latest/youtube-dl-2020.11.12.tar.gz HTTP/1.1 302 Found Date: Mon, 16 Nov 2020 19:10:37 GMT Server: Apache/2.2.15 (CentOS) Location: https://youtube-dl.org/downloads/2020.11.12/youtube-dl-2020.11.12.tar.gz Connection: close Content-Type: text/html; charset=iso-8859-1

jefftk 6y ago
Not quite: when you pass "-I" curl makes a HEAD request instead of a GET request: $ curl -sS -v -I \ https://www.jefftk.com 2>&1 | grep '^>' > HEAD / HTTP/1.1 > Host: www.jefftk.com > User-Agent: curl/7.58.0 > Accept: */* $ curl -sS -v -D- -o/dev/null \ https://www.jefftk.com 2>&1 | grep '^>' > GET / HTTP/1.1 > Host: www.jefftk.com > User-Agent: curl/7.58.0 > Accept: */* > It turns out that, often enough to be worth worrying about, servers do not return the same headers in response to a HEAD request as a GET request, so I always send a GET request when debugging strange behavior.