3 ms·

This is my issue with it as well - it's basically their geo-sniffing magic routing you towards the closest officially listed mirrors for that country (glorified

This is my issue with it as well - it's basically their geo-sniffing magic routing you towards the closest officially listed mirrors for that country (glorified proxy); it makes the mistake of presuming that all those mirrors listed in the Arch country-mirrorlist are created equal in terms of reliability and performance, but they're not (we have a whole web page just to track out of date mirrors).

capableweb 6y ago
"geo-sniffing magic routing", Also known as BGP + CloudFlare Argo (https://www.cloudflare.com/learning/performance/routing-vs-smart-routing/ https://www.cloudflare.com/learning/performance/routing-vs-s...)
Havoc 6y ago
Yeah Arch mirrors in particular seem all over the place on quality. In true Arch spirit you def want to configure that yourself
iforgotpassword 6y ago
I'd guess if this gains traction, the caching on Cloudflare's side will usually make up for this, and if it hits the actual mirror behind it, the load on that one should be lower than before. It reads like they will try to proxy multiple local mirrors so time will tell how well they will pick amongst them. I'm switching for now to see how it will perform over a longer period.
- gravitas 6y ago
  The difficulty is if the mirror itself is behind, Cloudflare's cache for that specific endpoint will be correct (functional, working) but out of date compared to another mirror. Example: around the end of June this year the mirrors.kernel.org infra was failing to sync (DNS issues of some sort) the latest content, so your upgrade would appear to have no new packages because the stale content was a valid repo, when in fact there were many updates and other mirrors were in sync.
  - iforgotpassword 6y ago
    Right that makes sense, so Cloudflare would actually have to make the caching context-aware, not just classic HTTP proxying.
    - gravitas 6y ago
      I'm not aware of the technical how, but the Arch infrastructure seems to measure this successfully; a hook into this data might be a great way for the two to interoperate (so that Cloudflare always serves the freshest cache/mirrors). https://www.archlinux.org/mirrors/status/ https://www.archlinux.org/mirrors/status/
      - Foxboron 6y ago
        The relevant code can be found here I believe: https://github.com/archlinux/archweb/blob/master/mirrors/management/commands/mirrorcheck.py https://github.com/archlinux/archweb/blob/master/mirrors/man...

capableweb 6y ago

"geo-sniffing magic routing", Also known as BGP + CloudFlare Argo (https://www.cloudflare.com/learning/performance/routing-vs-smart-routing/ https://www.cloudflare.com/learning/performance/routing-vs-s...)

Havoc 6y ago

Yeah Arch mirrors in particular seem all over the place on quality. In true Arch spirit you def want to configure that yourself

iforgotpassword 6y ago

I'd guess if this gains traction, the caching on Cloudflare's side will usually make up for this, and if it hits the actual mirror behind it, the load on that one should be lower than before. It reads like they will try to proxy multiple local mirrors so time will tell how well they will pick amongst them. I'm switching for now to see how it will perform over a longer period.

gravitas 6y ago
The difficulty is if the mirror itself is behind, Cloudflare's cache for that specific endpoint will be correct (functional, working) but out of date compared to another mirror. Example: around the end of June this year the mirrors.kernel.org infra was failing to sync (DNS issues of some sort) the latest content, so your upgrade would appear to have no new packages because the stale content was a valid repo, when in fact there were many updates and other mirrors were in sync.
- iforgotpassword 6y ago
  Right that makes sense, so Cloudflare would actually have to make the caching context-aware, not just classic HTTP proxying.
  - gravitas 6y ago
    I'm not aware of the technical how, but the Arch infrastructure seems to measure this successfully; a hook into this data might be a great way for the two to interoperate (so that Cloudflare always serves the freshest cache/mirrors). https://www.archlinux.org/mirrors/status/ https://www.archlinux.org/mirrors/status/
    - Foxboron 6y ago
      The relevant code can be found here I believe: https://github.com/archlinux/archweb/blob/master/mirrors/management/commands/mirrorcheck.py https://github.com/archlinux/archweb/blob/master/mirrors/man...