[Dovecot] Duplicate Elimination
Hi All,
In my mail server i have two groups and one user is belonging to both the groups. Previously i was using cyrus at that time when i am sending a mail to the two groups there will only one mail in the user mailbox . But now the user is getting one more copy of same mail. Is there is a way i can avoid this.
Rgds,
Aravind M D
Am 24.02.2010 12:58, schrieb Aravind Divakaran:
Hi All,
In my mail server i have two groups and one user is belonging to both the groups. Previously i was using cyrus at that time when i am sending a mail to the two groups there will only one mail in the user mailbox . But now the user is getting one more copy of same mail. Is there is a way i can avoid this.
Rgds,
Aravind M D
Hi cant think that dovecot itself is the source of your problem check sieve and/or forward rules as well as your smtp server logs sometimes i.e amavis etc doubles mail
On 2010-02-24 6:58 AM, Aravind Divakaran wrote:
In my mail server i have two groups and one user is belonging to both the groups. Previously i was using cyrus at that time when i am sending a mail to the two groups there will only one mail in the user mailbox . But now the user is getting one more copy of same mail. Is there is a way i can avoid this.
One possibility - did you specify the users home directory?
Output of dovecot -n would have answered this question ahead of time.
From the wiki:
"Some uses for home directory are:
* By default Sieve scripts are in user's home directory.
* Duplicate mail check database is in user's home directory.
Duplicate suppression won't work if home directory isn't
specified."
http://wiki2.dovecot.org/VirtualUsers/Home
On Wed, 24 Feb 2010 13:11:04 +0100, Robert Schetterer robert@schetterer.org wrote:
Am 24.02.2010 12:58, schrieb Aravind Divakaran:
Hi All,
In my mail server i have two groups and one user is belonging to both the groups. Previously i was using cyrus at that time when i am sending a mail to the two groups there will only one mail in the user mailbox . But now the user is getting one more copy of same mail. Is there is a way i can avoid this.
Rgds,
Aravind M D
Hi cant think that dovecot itself is the source of your problem check sieve and/or forward rules as well as your smtp server logs sometimes i.e amavis etc doubles mail
Actually as i told there were two groups i have created in my mailserver which contain a common emailid. For example
group1: user1@example.com,user2@example.com group2: user1@example.com,user3@example.com
If i am sending a mail to group1 and group2. It is going two times a single mail to the user1 mailbox. But in dovecot it is not eliminating since it has the same message-id. Previously i was able to accomplish this task with cyrus duplicate elimination.
Am 24.02.2010 14:02, schrieb Aravind Divakaran:
On Wed, 24 Feb 2010 13:11:04 +0100, Robert Schetterer robert@schetterer.org wrote:
Am 24.02.2010 12:58, schrieb Aravind Divakaran:
Hi All,
In my mail server i have two groups and one user is belonging to both the groups. Previously i was using cyrus at that time when i am sending a mail to the two groups there will only one mail in the user mailbox . But now the user is getting one more copy of same mail. Is there is a way i can avoid this.
Rgds,
Aravind M D
Hi cant think that dovecot itself is the source of your problem check sieve and/or forward rules as well as your smtp server logs sometimes i.e amavis etc doubles mail
Actually as i told there were two groups i have created in my mailserver which contain a common emailid. For example
group1: user1@example.com,user2@example.com group2: user1@example.com,user3@example.com
If i am sending a mail to group1 and group2. It is going two times a single mail to the user1 mailbox. But in dovecot it is not eliminating since it has the same message-id. Previously i was able to accomplish this task with cyrus duplicate elimination.
what about logs and configs, nobody is able to help if you dont show them, by what magic dovecot should eliminate doubles ? try find out what process doubles
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
On Wed, 24 Feb 2010, Aravind Divakaran wrote:
Actually as i told there were two groups i have created in my mailserver which contain a common emailid. For example
group1: user1@example.com,user2@example.com group2: user1@example.com,user3@example.com
If i am sending a mail to group1 and group2. It is going two times a single mail to the user1 mailbox. But in dovecot it is not eliminating since it has the same message-id. Previously i was able to accomplish this task with cyrus duplicate elimination.
"two times a single mail to the user1 mailbox" actually I do expect that the MTA detects the duplication of the two aliases and does NOT send the mail two times to user1.
I mean what happens if you alias like so:
group1: user1,group2 group2: user1,group1
unless the MTA removes duplicates, you've created a mail storm.
Are they "real" MTA-level aliases or are they driven by a mailing list software? Or is one recipient of groupX forwards to an external recipient, then that one forwards back to user1?
Regards,
Steffen Kaiser
On 24.2.2010, at 16.15, Steffen Kaiser wrote:
group1: user1@example.com,user2@example.com group2: user1@example.com,user3@example.com
If i am sending a mail to group1 and group2. It is going two times a single mail to the user1 mailbox. But in dovecot it is not eliminating since it has the same message-id. Previously i was able to accomplish this task with cyrus duplicate elimination.
"two times a single mail to the user1 mailbox" actually I do expect that the MTA detects the duplication of the two aliases and does NOT send the mail two times to user1.
Yeah, I think that's what I answered before too. Dovecot currently has no duplicate elimination code.
(I hate the whole concept of dropping incoming messages as duplicates based on Message-ID. I would definitely want it disabled for my own mails, for example that would mean I couldn't filter messages to mailing lists based on List-ID: header, because the first mail usually comes directly from the other user, and then the second mail with the List-ID: would get dropped.)
On Mit, 2010-02-24 at 16:51 +0200, Timo Sirainen wrote: [...]
(I hate the whole concept of dropping incoming messages as duplicates based on Message-ID. I would definitely want it disabled for my own mails, for example that would mean I couldn't filter messages to mailing lists based on List-ID: header, because the first mail usually comes directly from the other user, and then the second mail with the List-ID: would get dropped.)
Aren't those usually two separate mails with different message-ids as one comes directly by the sender and the other generated by the mailinglist manager?
Bernd
On Wed, 24 Feb 2010 16:10:11 +0100 Bernd Petrovitsch wrote:
On Mit, 2010-02-24 at 16:51 +0200, Timo Sirainen wrote: [...]
(I hate the whole concept of dropping incoming messages as duplicates based on Message-ID. I would definitely want it disabled for my own mails, for example that would mean I couldn't filter messages to mailing lists based on List-ID: header, because the first mail usually comes directly from the other user, and then the second mail with the List-ID: would get dropped.)
Aren't those usually two separate mails with different message-ids as one comes directly by the sender and the other generated by the mailinglist manager?
I guess you are wrong. Mailing list software does not change the Message-ID.
--Frank Elsner
On 2010-02-24 9:51 AM, Timo Sirainen wrote:
Yeah, I think that's what I answered before too. Dovecot currently has no duplicate elimination code.
Obviously you would know... so, what is this talking about:
"Some uses for home directory are:
* By default Sieve scripts are in user's home directory.
* Duplicate mail check database is in user's home directory.
Duplicate suppression won't work if home directory isn't
specified."
http://wiki2.dovecot.org/VirtualUsers/Home
?
On 24.2.2010, at 18.14, Charles Marcus wrote:
Obviously you would know... so, what is this talking about:
"Some uses for home directory are:
- By default Sieve scripts are in user's home directory.
- Duplicate mail check database is in user's home directory. Duplicate suppression won't work if home directory isn't specified."
It's about not sending rejections/vacation replies to same destination too often. I guess the wiki could be clarified :)
On 2010-02-24 12:01 PM, Timo Sirainen wrote:
It's about not sending rejections/vacation replies to same destination too often. I guess the wiki could be clarified :)
Oh, right... I should have been able to figure that out...
Thanks for being so gentle with the clue-bat... ;)
On 2/24/10 4:51 PM +0200 Timo Sirainen wrote:
On 24.2.2010, at 16.15, Steffen Kaiser wrote:
group1: user1@example.com,user2@example.com group2: user1@example.com,user3@example.com
If i am sending a mail to group1 and group2. It is going two times a single mail to the user1 mailbox. But in dovecot it is not eliminating since it has the same message-id. Previously i was able to accomplish this task with cyrus duplicate elimination.
If this is the only dup concern, you "just" need to have the MTA unalias the recipients before delivery. sendmail, e.g., does it that way.
If your dup concern is more general, e.g. a direct reply plus a mailing list reply, the above obviously won't change things.
(I hate the whole concept of dropping incoming messages as duplicates based on Message-ID. I would definitely want it disabled for my own mails, for example that would mean I couldn't filter messages to mailing lists based on List-ID: header, because the first mail usually comes directly from the other user, and then the second mail with the List-ID: would get dropped.)
Not a problem if you filter on List-ID, at least not a problem with how cyrus handles duplicate elimination. It only eliminates duplicates in the same mailbox. If you filter on List-ID, each message would go to a different mailbox and you would receive both.
I think "hate" is a bit strong, yes?
-frank
On 24.2.2010, at 16.15, Steffen Kaiser wrote:
group1: user1@example.com,user2@example.com group2: user1@example.com,user3@example.com
If i am sending a mail to group1 and group2. It is going two times a single mail to the user1 mailbox. But in dovecot it is not eliminating since it has the same message-id. Previously i was able to accomplish this task with cyrus duplicate elimination.
"two times a single mail to the user1 mailbox" actually I do expect that the MTA detects the duplication of the two aliases and does NOT send the mail two times to user1.
Yeah, I think that's what I answered before too. Dovecot currently has no duplicate elimination code.
(I hate the whole concept of dropping incoming messages as duplicates based on Message-ID. I would definitely want it disabled for my own mails, for example that would mean I couldn't filter messages to mailing lists based on List-ID: header, because the first mail usually comes directly from the other user, and then the second mail with the List-ID: would get dropped.)
Thanks for your valuable information. Actually its not a mailing list, its just an aliases created in my mail server. I had made changes in my mta to handle duplicate mails.
Rgds, Aravind M D
participants (8)
-
Aravind Divakaran
-
Bernd Petrovitsch
-
Charles Marcus
-
Frank Cusack
-
Frank Elsner
-
Robert Schetterer
-
Steffen Kaiser
-
Timo Sirainen