2 ms·
> Finished setting up the Malaysia mirror site, generously hosted by the Malaysian Research & Education Network. Traffic from Oceania and parts of Asia is now g
by astrange 6y ago
> Finished setting up the Malaysia mirror site, generously hosted by the Malaysian Research & Education Network. Traffic from Oceania and parts of Asia is now going to this mirror instead of farther away sites like Japan and California.
I see open source projects still listing a bunch of download mirrors in different countries - but this doesn't actually matter, surely, and I don't see how it even mattered in the 90s unless you're in Australia. Is there some technical reason they can't use anycast or similar load balancing?
- edoceo 6y agoCost, complexity, not available from the provider who is donating their space/network
- astrange 6y agoMaintaining an HTTP redirect load balancer does have issues, but it seems like if the mirrors have similar enough behavior (like they agree to all take the same URL path), you could run DNS anycast without involving them too much. This seems better than asking the users to pick their preferred mirror (how do they know who's good?) and maintain it when the list changes. I wonder if anyone provides this as a service without the rest of the CDN.
- jrwr 6y agoYou would be surprised how bad peering and back haul networks are still today. A normal business line here in the united states can still see sub 10Mbit/s going even out to hosters like OVH or Hetzner in France / Germany. For large projects like this, its always a good idea to have global mirrors if you can help it.
- etaioinshrdlu 6y agoI wonder if you could build yourself a VPN to the nearest AWS/google region, and then uses that cloud's private fiber network to accelerate your internet speed to worldwide regions?
- naniwaduni 6y agoTo the extent that you're willing to pay their data transfer fees.
- astrange 6y agoThat's what Cloudflare Warp does.
- unixhero 6y agoRedundancy. Geo Redundancy.
- mbreese 6y agoI assume you aren’t questioning why there are globally distributed mirrors, but rather why they have to be explicitly listed, as opposed to automatically used. I think we can all agree that distributed mirrors are a good idea. They reduce load on undersea cables, can often offer more bandwidth, and have lower latency. But, as for why they are listed... my guess is pretty simple: advertising. These are open source projects that don’t purchase space at these providers, the space is donated. The companies that give them space still need to get something in return. An open source project doesn’t have money, but they can offer eyeballs. So in addition to generally being good citizens, they can also get a little bit of good advertising.
- riffraff 6y ago> and I don't see how it even mattered in the 90s unless you're in Australia I remember choosing a nearby mirror from a list when downloading stuff in the early 00s in Europe, it seemed to make a significant difference.