8 ms·
I think it is absolutely hilarious (and infuriating) that in their opening paragraph they forgot to list spam blacklists, like themselves, as being perhaps the
by Someone1234 12y ago
I think it is absolutely hilarious (and infuriating) that in their opening paragraph they forgot to list spam blacklists, like themselves, as being perhaps the biggest hurdle for small companies and individuals running mail servers.
I ran a mail server for almost five years, and 9/10 of the issues I had to resolve were various anti-spam blacklists or individual hosts blocking our emails and then having customers complaining because we never emailed them.
There was never any reason given for the blocks, and our logs didn't show any outgoing spam. However all of these spam blacklists would accept a "donation" if you didn't want to wait the 24-72 hours for them to unblock you. Essentially it is a shakedown.
I've just given up self-hosting and I recommend others do the same. The issue isn't the spam, it is how much time you'll waste fighting the anti-spam blacklists and large email hosts. A job better left to e.g. SendGrid or SES.
PS - We sent tens of thousands of emails a day.
- EvanAnderson 12y agoI have a number of Customers who have been self-hosting email since the late 1990's. The only blacklist that I've regularly had any problems with has been one-- ahem-- "fishy" company who, at least in the past, seemed to run their blacklist like a protection racket.
- vacri 12y agoI have this problem at one company at the moment. We use gmail with spf and dkim, and have a low mail count and no mass marketing that I'm aware of. We're on two blacklists. One gives zero reason for being on it, and has a 'contact us for reevaluation' form which I've submitted. No feedback, no change, no idea what to do next. The other blacklist suggests that it's our commercial site that's hosted with a provider who uses linode, and the linode CIDR block our company website is on has been 'banned with no recourse to remove' due to the huge amounts of spam it has sent. For that list, it apparently doesn't matter that our mail comes from google, not linode. When I get some free time, I'll try to move that website. What do you do when the vigilantes screw you?
- fsniper 12y agochanging your ip is the solution in these situations. And that's why self hosting is a real hurdle.
- logn 12y agoI just set up Postfix to use an SMTP relay and then send them through a provider specializes in transactional emails (even though the emails I send through them are all hand written).
- sloop 12y agowhich blacklist gives you zero reason? there are certainly some rogue blacklists out there, and some blacklists should not be used by companies
- vacri 12y agoRFC-Clueless ('abuse' and 'postmaster'). Reading over their site http://rfc-clueless.org/ http://rfc-clueless.org/ again I see that there is the information to the policies for listing, but I just didn't happen to follow the correct series of links to get there. It's really not very clear with that site, and ironic that a list apparently named after people who aren't compliant with docs has such poor presentation of information. The documentation is clear... eventually, if you pick the right path. I'll take this on the chin as my misreading, but unclear documentation isn't helpful (particularly if you're juggling a few other fires at the same time...) Edit: Yes, I was correct. gmail does come with 'postmaster' and 'abuse' built in: https://support.google.com/a/answer/33389?hl=en https://support.google.com/a/answer/33389?hl=en Edit 2: I forgot I removed the line where I mentioned that I thought postmaster was baked in :) Edit 3: It looks like the domain I'm using with gmail has a screwed up abuse and postmaster. It's a domain alias, one of two. I made new mail groups for abuse/postmaster (the goog still monitors them, re: the link above) and noticed that only one domain alias was covered by them, when all other mail groups listed both. Sending test mails confirmed that setup. After a lengthy goog support chat, it seems that the way to fix it may be to remove and re-add the faulty domain alias. I both love and hate these long chains of cause-and-effect that we get in IT...
- saurik 12y agoYeah :/. I have tons of operational knowledge of email and have been running my own email setup since 1998. My email servers were ever only used for email I typed manually by hand (due to being dumb I never even used shortcuts to auto type repetitive responses to customer messages). Then, one day a couple years ago, I realize no one @yahoo.com is getting my email anymore. Talking to Yahoo, I get barely any response and certainly no explanation. I can easily believe that my entire IP block was cut for being a hosting provider. I now pay some company to deliver my personal mail, which is just dumb, and clearly isn't caused by them being better about spam (as I sent no spam): it is caused by a militarized anti-spam-crazed group of people who have managed to build a system that essentially requires an oligopoly for email to function. A lot of these people don't even consider it a problem to use "report as spam" as a ways to punish companies for things that aren't even sending spam (which is something I only bring up as it demonstrates the "militant" comment). The reality is that an open internet where people can talk to each other without going through third parties requires a world in which you, heaven forbid, receive some spam. It is actually a similar construction as the one for why we should have network neutrality: large internet carriers in the world of email should, if you really believe in open access, not be allowed to say "these people can't send mail because they are too small and not paying someone". We all need to accept at least a little spam to guarantee everyone can send mail. If this means that you have to get better at dealing with spam, as some of the heavy-handed techniques people have put in place for dealing with spam are no longer possible, well: so be it; and if that means you need to turn off the notifications for new email on your phone to keep from getting angry when you receive some spam (which tends to come up as a reason to hate spam), I hope people realize that they caused their own reason to be upset, and that getting notifications for anything is probably unhealthy, at least for you, anyway. Sadly, the large companies who have slowly come to "own email" have no incentive to break this cycle, whether in action or in words, as the current state of affairs is what is giving them their power: whether they build solutions that can solve spam in a way that is both fair and federated, or they just try to educate users about how to better deal with spam and decrease the stress in their lives (including telling people to stop letting email interrupt them), it will just harm them. This doesn't sound like something the private sector can solve.
- JoshTriplett 12y ago
- eps 12y ago> We sent tens of thousands of emails a day. The subject is self-hosting a _small_ email server. When you get into 10K/day range, you are bound to have false positive spam reports - both automatic and from pissed users - and this in turn can lead to RBL listings. I've been running a mail server since 2004 and not once had I have any issues with RBLs. It's a low-volume server though, perhaps several thousand emails per month.
- DrStalker 12y agoIt's not even a matter of raw volume. The system I'm looking after sends just short of a thousand external emails a day but none of those are marketing or email blasts; it's all people mailing other people and reports being sent to specific addresses that have requested them. The occasional marketing type bulk email is always sent through an external company. This means I never have to worry about getting blacklisted by those messages.
- dredmorbius 12y agoNote that the "addresses that requested them" out has a number of problems. I've worked for any number of shops that had quite putatively legitimate notification emails that they sent out regularly. Which at one point some person had double-opt-in confirmed.... ... but for which there was clearly no valid reason for the mails being sent any more. As in, "the domain expired five years ago and is now a block hole", or "AT&T retired that domain a decade ago and migrated all its users elsewhere", or "that former email provider has had its domain parked on some Russian server for years". If you're not periodically revalidating your email lists, checking for retired domains, and/or processing bounces properly, you are sending spam, I can guarantee it. Quite possibly not spam that anyone particularly cares about, but it's creating traffic for somebody's email system (starting with your own).
- jwr 12y agoI've been running my own mail server since 2001 (and other servers before then). The only time when I had a problem with blacklists was when I used a colocation/server provider that didn't give much care to RBLs blacklisting his entire subnets (so, check your provider's reputation before signing up!). Except for this problem, blacklists have never been a problem for me. I guess it's different if you send newsletters or other mass-marketing mail.
- mike-cardwell 12y agoSame scenario here. Blacklists have never been a problem for me, but they have been incredibly useful for keeping the spam out. Email wouldn't work without them.
- muppetman 12y agoI've run one since 2000 and the same, I've only had one problem and that was because I (stupidly) ran a TOR node on the server to play with and got myself blacklisted for a while.
- Sami_Lehtinen 12y agoI've been running my mail server since 1997. I've got once blacklisted due to someone spamming URL to my web site around. It seems that your email can get blacklisted, even if you don't send any email.
- reality_czech 12y agoYeah, you would have to be stupid to self-host email these days. If you're an individual person, it's way too time-consuming to set everything up properly. If you're a company, there is a very high risk that you'll get put on some anti-spam blacklist or other for doing one of 10,000 harmless things (or even not doing anything wrong at all, but just sharing a block of IPs with a bad guy). And then your mails will get silently dropped, and you might never know that it happened. You just... won't get replies from customers or business partners that you were expecting. The anti-spam zealots ruined email for everyone, and they don't even have the honesty to admit what they did. "Hilarious and infuriating" is right.
- jobposter1234 12y agoIt's the anti-spam zealots, and not the spammers themselves, that "ruined email for everyone"?
- codinghorror 12y agoMore of a Mutually Assured Destruction scenario.
- fizgig 12y agoIt's both. The spam war causes a lot of collateral damage. For a decade I ran a mail server for a small client. Yes, they ran a ~15k membership newsletter, yes some cranky people would flag as spam since they were too lazy to click UNSUBSCRIBE, but that's small business for you. Self hosting was once fun; now I hate it. Now I would only ever recommend getting a business gmail setup and using something like Mail Chimp. Not because I like either option, but fighting with blacklist operators and arrogant mail admins jaded me and now I refuse to support email servers for people. Don't get me started on the web hosting side of this equation. The raw mail flow may be useless without filtering, but blocking legit mail from a tainted IP addresses (tough to avoid anymore for the small business) is simply counter-productive. Our job as mail admins is to send and receive mail. We should let the receiving mail server tag the mail and let the mail clients filter. We should never, never, never reject a message during the SMTP transaction. Just never. There should be a new Fry meme: Shut up and accept my SMTP connection!