3 ms·

Does GMAIL does something similar too? This should be standard feature of mail softwares. At my organization, whenever a 2MB file is mailed by management to en

Does GMAIL does something similar too? This should be standard feature of mail softwares. At my organization, whenever a 2MB file is mailed by management to entire organization mail system crawls for some times. EDIT: Our mail system is hosted in-house.

nso 10y ago
This only deals with storage of the file. Your SMTP-server still has to deal with every email and every file, and your mail server still has to receive every one of those before it could even start to consider deduping. This is probably what's murdering your email system. Quickest solution for your problem would be to put the file on a share accessible for all recepients and just link to it from the email text.
jodrellblank 10y ago
Organisations have different concerns; Microsoft Exchange used to deduplicate email attachments internally with SIS (Single Instance Storage). It did it within a mailbox database, not company-wide. But when there was a single attachment and lots of people wanted to get it, it generated a lot of disk IO looking up where the attachment was stored and going to get it. Storage space is cheap, disk IO is more expensive, and in Exchange 2007 to 2010 timeframe - seven or eight years ago - they took SIS out of Exchange and it no longer does this. Now every user reads their mailbox and all the data is right there and the disk IO is reduced. Disk IO went down, the storage design of Exchange changed to the point where it's recommended to be run on cheaper SATA disks entirely, which is a bigger saving than reducing storage size a bit. https://social.technet.microsoft.com/Forums/exchange/en-US/e41d1146-0d00-45b5-a939-84b83db81e96/why-microsoft-remove-sis-features-from-exchange-2010?forum=exchange2010 https://social.technet.microsoft.com/Forums/exchange/en-US/e... Mail.ru has different needs to a company internal mail server, companies can enforce quotas and provide alternative file storage.
mike-cardwell 10y ago
Willing to bet that your mail system is configured in a suboptimal way such that the email gets scanned for virus/spam once per recipient instead of just once over all. Internal to internal mail shouldn't even need spam filtering. Should probably have virus scanning on though to stop the spread of malware through an org. Or could be something entirely different.

nso 10y ago

This only deals with storage of the file. Your SMTP-server still has to deal with every email and every file, and your mail server still has to receive every one of those before it could even start to consider deduping. This is probably what's murdering your email system. Quickest solution for your problem would be to put the file on a share accessible for all recepients and just link to it from the email text.

jodrellblank 10y ago

Organisations have different concerns; Microsoft Exchange used to deduplicate email attachments internally with SIS (Single Instance Storage). It did it within a mailbox database, not company-wide. But when there was a single attachment and lots of people wanted to get it, it generated a lot of disk IO looking up where the attachment was stored and going to get it. Storage space is cheap, disk IO is more expensive, and in Exchange 2007 to 2010 timeframe - seven or eight years ago - they took SIS out of Exchange and it no longer does this. Now every user reads their mailbox and all the data is right there and the disk IO is reduced. Disk IO went down, the storage design of Exchange changed to the point where it's recommended to be run on cheaper SATA disks entirely, which is a bigger saving than reducing storage size a bit. https://social.technet.microsoft.com/Forums/exchange/en-US/e41d1146-0d00-45b5-a939-84b83db81e96/why-microsoft-remove-sis-features-from-exchange-2010?forum=exchange2010 https://social.technet.microsoft.com/Forums/exchange/en-US/e... Mail.ru has different needs to a company internal mail server, companies can enforce quotas and provide alternative file storage.

mike-cardwell 10y ago

Willing to bet that your mail system is configured in a suboptimal way such that the email gets scanned for virus/spam once per recipient instead of just once over all. Internal to internal mail shouldn't even need spam filtering. Should probably have virus scanning on though to stop the spread of malware through an org. Or could be something entirely different.