3 ms·
And people told me I was crazy for hard-coding IP addresses for s3.amazonaws.com and sdb.amazonaws.com into the Tarsnap code... :-)
by cperciva 17y ago
And people told me I was crazy for hard-coding IP addresses for s3.amazonaws.com and sdb.amazonaws.com into the Tarsnap code... :-)
- justinsb 17y agoAwesome ... was that for security or for redundancy? Did you have a solution for what would happen if the IP address changed?
- cperciva 17y agoMostly security -- DNS is one of the worst offenders when it comes to protocols with security problems, both in terms of protocol issues and bugs in implementations. Amazon doesn't move endpoints very often, and I round-robin requests to several endpoints; so in the rare cases an AWS endpoint changes I see a slight decrease in Tarsnap performance and can make the Tarsnap server stop using the dead endpoint before any users are likely to notice.
- esja 17y agoHmmm... should I trust my backups to generic software vendor X, or to someone who clearly takes nothing for granted... tough choice. Signing up now.
- akl 17y agoYou are crazy for doing that - one instance of downtime doesn't justify ignoring all the advantages DNS brings.
- cperciva 17y agoWhen I made that design decision I wasn't considering the possibility of DNS outages at all; I was just thinking in terms of "there's a huge number of places between me and ultradns where someone could insert a spoofed DNS response".
- jacquesm 17y agoWhat if amazon gets a new netblock assigned ? Can you forcibly upgrade the software in that case ?
- cperciva 17y agoOf course I can upgrade the software; and there's nothing forcible about it. We're talking about code I'm running on my server here...
- jacquesm 17y agoAh, my bad, sorry I thought you meant in the tarsnap client. Then I really don't know why people would make a fuss over you hardcoding the ips in there. All you need to do is keep an eye out in case they change them (which you could even automate).
- cperciva 17y agoAll you need to do is keep an eye out in case they change them Exactly, and that's what I do. (With the caveat that I look for AWS endpoints being taken out of service, not for changes in what DNS tells me.)
- derefr 17y agoAre there DNS servers that support versioning? The best solution I could imagine would simply be to set Tarsnap to normally use the current DNS records for S3, but be able to rollback to a valid zone record if they encounter an update that makes the servers stop resolving.
- cperciva 17y agoThe Tarsnap client only talks to the Tarsnap server, but I do cache that lookup in order to avoid problems with glitchy DNS resolution. I could have the Tarsnap server cache DNS lookups if I was only worried about working around DNS outages -- but as I said, that wasn't something I was considering at all when I made the decision to eschew DNS.
- maw 17y agoSome DNS caches will continue to try giving out expired records if no newer ones can be found. Unclear that it's worth it, though.
- baq 17y agoyou can expect such downtimes every Christmas. why? ask yourself how much protection money UltraDNS was told to pay.