4 ms·
While there's a lot there that's true, we should be careful to note that Mark Crispin isn't universally correct on how email should work, and has, occasionally,
by geofft 14y ago
While there's a lot there that's true, we should be careful to note that Mark Crispin isn't universally correct on how email should work, and has, occasionally, some fundamental misunderstandings. Here's why IDLE support was never implemented for pine:
https://groups.google.com/forum/?fromgroups=#!topic/comp.mail.pine/UrJS0JRqvOY https://groups.google.com/forum/?fromgroups=#!topic/comp.mai...
"I think that you misinterpret the purpose of IDLE. There is no reason to believe that IDLE gets you new mail notifications any faster. It may, but only if the server's new mail announce interval through IDLE is faster than the client's polling interval when not using IDLE."
Somehow he completely fails to grasp the concept of event-based notification and assumes that a server that supports IDLE must do so via polling -- a reasonable assumption for the traditional MDA/mail repository split on aging UNIX boxes, but not a correct one on UNIX boxes with push-based notification of modifications to files, and definitely not a correct one if the mail store and the mail delivery agent are connected. SMTP is real-time and event-based, and there's no reason for IMAP to assume that it can't be.
This is symptomatic of a more general assumption that the way that UW imapd handles things is the only correct way of doing things, and a bias against newer, larger-scale email servers like Gmail and Exchange -- servers that, I'm sure, would happily support IMAP in a conformant way if it were at all possible for them to do so. IMAP is a great standard for something like UW imapd and the assumptions it embeds, and a terrible standard for something like Gmail or Exchange, and the extent to which they do support IMAP is a credit to them and a sign of how terrible the protocol is. You might want to see Courier's documentation of Mark Crispin's FUD:
http://www.courier-mta.org/fud/ http://www.courier-mta.org/fud/
I have no stake in that particular debate either way. I'm a heavy user of alpine, and I love it, but I've come to see that the incompatibilities between it and Exchange are as much the fault of alpine as they are of Exchange, and in reading the IMAP protocol, I'm impressed anyone other than the reference implementation is able to comply as well as they do. It's true there's a lot that Mark Crispin did for the state of the Internet -- but there's a lot more that could have been done if he were a little more gracious about understanding how other people besides him want to use email and want to implement mail clients.
- saurik 14y ago> ...and a bias against newer, larger-scale email servers like Gmail and Exchange -- servers that, I'm sure, would happily support IMAP in a conformant way if it were at all possible for them to do so... I do not know of anything in IMAP that would be difficult for Gmail to theoretically implement efficiently except for how EXPUNGE interacts with message sequence numbers (which actually came up on the imap-protocol mailing list a few days ago, although I had seen the problem myself with my server a few months ago; I even came up with something that might be a good solution to it for a Gmail-style infrastructure, although I haven't implemented this evil magic yet and if I do will probably not tell anyone how I did it for a while). Can you thereby please explain what it is that is so difficult about IMAP to implement that is holding back these companies? It seems much easier to fathom that they simply don't care much, as there are very few real IMAP clients out there other than Thunderbird; Microsoft managed to get everyone to just let them implement ActiveSync into their clients (even the iPhone comes with an ActiveSync implementation by default), and Google has gone on record as saying they only care about what Thunderbird and Outlook bother doing with the protocol. That said, though, as far as I understand (from having read all of the related discussions I could get my hands on a few months ago), the primary (and totally benign) reason that Gmail doesn't support IMAP terribly well is actually an even simpler reason than even that: it is just because they don't want to spend the resources to go back through old e-mail and fix weird mistakes and old decisions in how various e-mails were parsed (there was a good quote about this somewhere, but I'm having a difficult time finding it :(); though, these are kind of inane details that I'm not even certain you are complaining about. As some examples, they did weird LF->CRLF conversions only some of the time that cause their "how many bytes is this part of the message" to be inaccurate and they didn't parse through RFC822 attachments and so cannot return envelope structures for them. Otherwise, they are actually pretty good: their known incompatibilities list is actually very short. The one everyone pokes them about are things involving not supporting IMAP flags, but they aren't even really incompatible with their implementation: just "strange" for people who like older clients. Now, yes: it would be nice if they supported CONDSTORE/QRESYNC, but that would require storing more data per message, keeping an extra secondary index, and changing some of the transaction management code for how they store flags, and they don't seem prepared to do that: however, IMAP works fine without those extensions, and those extensions surround offline synchronization (something that one can appreciate Gmail not having been designed from the beginning to ever support). Ok, and I guess also combined with some amount of "dunno" on behalf of the Gmail team. ;P """Yes, we have an open bug for this one, I'm not sure why there hasn't been any progress on it.""" -- Brandon Long (Gmail) http://mailman2.u.washington.edu/pipermail/imap-protocol/2011-May/001417.html http://mailman2.u.washington.edu/pipermail/imap-protocol/201... As for pine+IDLE, while Mark often has expansive explanations for what people are trying to with IDLE and how it caused interactions and problems with other systems over the years, I think you totally mischaracterize the "why IDLE was never implemented for pine" situation... as far as I could ever tell it always, in the end, came down to a technical detail of his existing codebase and API; his server, certainly, supported it, and even worked around bugs he found quite irritating in the Outlook implementation of the feature. """I'll look at it, but I can't promise that I would adopt it. Nor can I promise that if I adopt it, that it wouldn't have a different interface. c-client is fundamentally synchronous in its implementation of IMAP, and IDLE is very much asynchronous. It'll need careful consideration.""" -- http://mailman2.u.washington.edu/pipermail/imap-uw/2005-December/000357.html http://mailman2.u.washington.edu/pipermail/imap-uw/2005-Dece... Please give this guy the benefit of the doubt here: he's been doing this very long, and seems to actually be quite intelligent with regards to not just how these features were planned to be used but how they ended up being used in practice. The IMAP protocol isn't actually that difficult to implement: it might seem daunting if you don't know much about implementing parsers, but it took about two quick days for me to, entirely from scratch, write a parser combinator library implementation and IMAP->structure parser; everything else was just mapping inputs to outputs. If nothing else, this seems like a mean time to be disparaging about someone over such little things. :(
- rachelbythebay 14y agoI did not realize he had written UW imapd. All I knew about that was that it was full of holes, and it's the number one reason I avoided IMAP for as long as I did. When running servers for my users, I only offered POP3 for as long as possible since someone (Solar Designer) had gone to the trouble of designing popa3d with security as a first-class requirement. Perhaps these holes were related to what you said about failing to grasp the event-based notification scheme. It assumes a certain level of knowledge about how the underlying system works. Maybe his talents were elsewhere.
- X-Istence 14y agoDovecot is an IMAP server that is designed with security in mind...