3 ms·

They are probably already using something like GCS to store the data at the cache nodes. I was not talking about how the nodes store data, but about a central

They are probably already using something like GCS to store the data at the cache nodes. I was not talking about how the nodes store data, but about a central cache. Purely architecture wise, it doesn't make sense to introduce a central storage that just mirrors Sourcehut (and all other Git repositories). Sourcehut is already that central storage. You would just create a detour. It's also not an easy problem. If the cache nodes try to synchronize writes to the central cache, you are effectively linearizing the problem. Then you might as well just have the one central cache access Sourcehut etc. directly. But then of course you lose total throughput. I guess the technically "correct" solution would be to put the cache right in front of the Sourcehut server.

politician 4y ago
Go's Proxy service is already a detour for reasons of trust mentioned in the article. They are in a position to return non-authentic modules if necessary (e.g. court order). That settles all architecture arguments about sources-of-record vs sources-of-truth. The proxy service is a source of truth. If Google is going to blindly hammer something because they must have their Google scale shared nothing architecture pointed at some unfortunate website, then they should deploy a gitea instance that mirrors sr.ht to Google Cloud Storage, and hammer that. It's unethical to foist the egress costs onto sr.ht when the solution is so so simple. Some intern could get this going on GCP in their 20% time and then some manager could hook the billing up to the internal account.