brongondwana

10 ms·

31.
by brongondwana 2y ago
SPF has challenges with shared infrastructure - if you are sending from a large service and using SPF then anyone else on that service and spoof you unless the service has outbound controls to restrict which addresses you can send from. Fas
32.
by brongondwana 2y ago
Made it to NZ for the first time in my life just over a year ago. Love it, definitely gotta get back (and visit Les Mills in Auckland again of course... always nice to get to the place where my OTHER job came from)
33.
by brongondwana 2y ago
Legitimately is, it's been a challenge at time but pretty happy with it. Pity LeBron came along and stole my googlability
34.
by brongondwana 2y ago
Sadly, they weren't quite prescient enough to realise the importance of different initials, so we have to use TWO letters for card game scoresheets; but nah. Pity.
35.
by brongondwana 2y ago
Me too! My parents thought it was a cool word, so they named me after it. There's 5 of us, and we all have different surnames. Hippy parents, man.
36.
Fastmail celebrates 25 years to wrap up 2024 Advent series(fastmail.com)
2 points by brongondwana 2y ago|0 comments
37.
by brongondwana 2y ago
I do believe we are talking past each other here. Of course ceph does data consistency, but it sure doesn't assert that a modseq is monotonically increasing or that an mailbox/uidvalidity/uid triple doesn't change diges
38.
by brongondwana 2y ago
IMAP is both excellent and, annoyingly inconsistent so it's much more of a pain to develop reliable parsers for. I'm pretty happy to use IMAP generally, but I'm also... MODSEQ is wrapped with a () in some places, not but STA
39.
by brongondwana 2y ago
The big benefit with JMAP is the state strings and /changes operation which allows even in the face of failures to recovery quite cleanly. It's really more a data synchronising protocol (RFC8620) with email support on top (RFC862
40.
by brongondwana 2y ago
I mean, I'm happy to have this argument. CEPH is content agnostic and that's fantastic most of the time. Cyrus replication is data aware, so it's not just replicating the data, it's doing integrity checking and data mo
41.
by brongondwana 2y ago
Yeah, if you don't have levels of redundancy, then you're pretty screwed. We could theoretically lose 2/3 of our systems and have sufficient capacity, because our metric is 2N primary plus N secondary, and we can run with ha
42.
by brongondwana 2y ago
If I didn't see it, it didn't happen... OK, I stand corrected. We lose one or two NVMe drives per year :)
43.
by brongondwana 2y ago
There's various articles on our blog about our stack!
44.
by brongondwana 2y ago
Ceph is most certainly not the only game in town. It's good and stuff, but it's just tech. We're using protocol level replication for each of our data stores.
45.
by brongondwana 2y ago
We also did our own web framework :p https://github.com/fastmail/overture
46.
by brongondwana 2y ago
Yeah, we have good vendor relationships, good datacenter relationships, and we've made mis-steps along the way for sure. Own hardware isn't for everyone, but it's been great for us. YMMV
47.
by brongondwana 2y ago
yeah, we use Cyrus replication still - it's protocol specific so it detects changes very efficiently as well, using the internal MODSEQ system also used for the JMAP /changes and IMAP CONDSTORE/QRESYNC. Plus it has protocol c
48.
by brongondwana 2y ago
1. hoping to have a JMAP archive format at some point which should cover that. I'd hope that normally you'd be fetching a delta update rather than the whole thing. We've got enough bandwidth for a few people do to it, but I
49.
by brongondwana 2y ago
PHL to STL these days, but same design: https://www.fastmail.com/blog/moving-house-new-datacentre/
50.
by brongondwana 2y ago
Yeah, we're only using ZFS replication for logs; we're using the Cyrus replication for emails because it has other sanity checks and data model consistency enforcement which is really valuable. (And both are async. We'd need
51.
by brongondwana 2y ago
Unlinking gets done asynchronously on the weekends from Cyrus, using the `cyr_expire` tool. Right now it only runs one unlinking process at a time on the whole machine due to historical ext4 issues ... but maybe we should revisit that now
52.
by brongondwana 2y ago
Emails are stored in cyrus-imapd. For now, the "file storage" product is a Node tree in mysql, with content stored in a content-addressed blob store, which is some custom crap I wrote 15 years ago that is still going strong becaus
53.
by brongondwana 2y ago
We're (very boring I know) just putting it all in a git repository with a Makefile which deploys it, plus some basic orchestration to run 'make diff' across the cluster and see what's out of sync, and 'make install&
54.
by brongondwana 2y ago
My beard isn't entirely grey yet! The new NVMe drives we've only had for a few years, but so far there's only been a single failure across the whole fleet, and we keep spares in stock. It's been very reliable, not like
55.
by brongondwana 2y ago
Yeah, we know about the ZFS encryption with send/receive bug, it's frustrating our attempts to get really nice HA support on our logging system... but so far it appears that just deleting the offsending snapshot and creating a new
56.
by brongondwana 2y ago
Jeremy is all the Fast things!
57.
by brongondwana 2y ago
We adopted SSD for the current week's email and rust for the deeper storage many years ago. A few years ago we switched to everything on NVMe, so there's no longer two tiers of storage. That's when the pricing switched to m
58.
by brongondwana 2y ago
Sadly someone flagged the hilarious response "...spamming every online discussion about selfhosting email, [just go with Fastmail, it's greeaaaat!] or like that." before I got back to it. True fact, many of us do love reading
59.
by brongondwana 2y ago
We have a much better account recovery process than, say, Protonmail where if you lose your encryption key then you really are screwed. Obviously, the more information we have about you, the easier it is for you to prove your identity! Oft
60.
by brongondwana 2y ago
Thanks! We're all pretty happy to keep doing what we're doing for a long time yet :) Have plenty of new stuff on the go (see the email work happening at IETF, a lot of it's being led or shepherded by someone from Fastmail)

More ›