July 2010 - dovecot - dovecot.org

[Dovecot] mdbox: Cannot create subfolder called "dbox-Mails" (2.0beta5)
by William Blunn 06 Sep '10

06 Sep '10

I am trying out "mdbox" under Dovecot 2.0beta5. Looking in the "mailboxes" directory under the mdbox storage root ("~/dbox" in my case), I can see that the mail folders are mapped into filesystem directories. But Dovecot seems to put all the message list information ("dovecot.index.cache", "dovecot.index.log") for any given mail folder into a directory called "dbox-Mails"... But this directory name exists in the same namespace as that used for mail subfolders... So this means we cannot create a mail subfolder whose name is "dbox-Mails"! I concede that this eventuality may be unlikely, but when designing in a green field, surely we should avoid such obvious pitfalls? Surely we would want to make it so that these objects exist in different namespaces, so that mail folders can be created with any name? So perhaps the directory "dbox-Mails" should use a character in its name which could not be used in mail folder names. Or mail folder names could have a non-identity mapping into directory names such that the directory name can never be "dbox-Mails". Regards, Bill

4 14

[Dovecot] Exim+Dovecot LDA - How can I catch the crash?
by Odhiambo Washington 12 Aug '10

12 Aug '10

Hello list I am testing mdbox with Dovecot from http://hg.dovecot.org/dovecot-2.0-sis/.and my MTA is Exim. It appears to crash, but I am not sure how to capture the actual crash. What I get in Exim logs is: 2010-07-28 19:55:13 1Oe9uT-000KmG-Oz ** /var/spool/virtual/ titan.co.ke/wash/Maildir <wash(a)titan.co.ke> R=virtual_domains T=dovecot_virtual_delivery: Child process of dovecot_virtual_delivery transport (running command "/opt/dovecot2/libexec/dovecot/deliver -d $local_part@$domain -f $sender_address") was terminated by signal 11 (segmentation fault) This crash does not happen with RC3 of Dovecot. I know I shouldn't be using bleeding edge code, but strangely enough, I need to use this one to satisfy my curiosity, and to help me learn one or two new tricks. With rc3, here is what I have in dovecot.log: mail# less /var/log/dovecot.log Jul 28 20:04:36 master: Info: Dovecot v2.0.rc3 starting up Jul 28 20:05:04 lda: Debug: Loading modules from directory: /opt/dovecot2/lib/dovecot Jul 28 20:05:04 lda: Debug: Module loaded: /opt/dovecot2/lib/dovecot/lib10_quota_plugin.so Jul 28 20:05:04 lda: Debug: auth input: wash(a)titan.co.ke home=/var/spool/virtual/titan.co.ke/wash uid=26 gid=26 quota=maildir:storage=0 Jul 28 20:05:04 lda: Debug: Added userdb setting: plugin/quota=maildir:storage=0 Jul 28 20:05:04 lda(wash(a)titan.co.ke): Debug: Effective uid=26, gid=26, home=/var/spool/virtual/titan.co.ke/wash Jul 28 20:05:04 lda(wash(a)titan.co.ke): Debug: Quota root: name=storage=0 backend=maildir args= Jul 28 20:05:04 lda(wash(a)titan.co.ke): Debug: fs: root=/var/spool/virtual/ titan.co.ke/wash/mdbox, index=, control=, inbox= Jul 28 20:05:04 lda(wash(a)titan.co.ke): Debug: Namespace : Using permissions from /var/spool/virtual/titan.co.ke/wash/mdbox: mode=0700 gid=-1 Jul 28 20:05:04 lda(wash(a)titan.co.ke): Debug: none: root=, index=, control=, inbox= Jul 28 20:05:04 auth: Debug: Loading modules from directory: /opt/dovecot2/lib/dovecot/auth Jul 28 20:05:04 auth: Debug: master in: USER 1 wash(a)titan.co.ke service=lda Jul 28 20:05:04 auth: Debug: passwd(wash(a)titan.co.ke): lookup Jul 28 20:05:04 auth: Info: passwd(wash(a)titan.co.ke): unknown user Jul 28 20:05:04 auth: Debug: master out: USER 1 wash(a)titan.co.ke home=/var/spool/virtual/titan.co.ke/wash uid=26 gid=26 quota=maildir:storage=0 Jul 28 20:05:04 auth: Debug: Loading modules from directory: /opt/dovecot2/lib/dovecot/auth Jul 28 20:05:04 auth: Info: mysql: Connected to localhost (exim4u) Jul 28 20:05:04 auth: Debug: sql(wash(a)titan.co.ke): SELECT pop AS home, 26 AS uid, 26 AS gid, CONCAT('maildir:storage=', quota*1024) AS quota FROM users WHERE username = 'wash(a)titan.co.ke' AND enabled = '1' Jul 28 20:05:04 lda(wash(a)titan.co.ke): Info: msgid=< E1OeA40-000OZ6-2O(a)mail.mediselkenya.com>: saved mail to INBOX .. while with dovecot-2.0-sis, I get: mail# less /var/log/dovecot.log Jul 28 20:08:46 master: Info: Dovecot v2.0.rc3 (8e511be90b4b) starting up Jul 28 20:08:50 lda: Debug: Loading modules from directory: /opt/dovecot2/lib/dovecot Jul 28 20:08:50 lda: Debug: Module loaded: /opt/dovecot2/lib/dovecot/lib10_quota_plugin.so Jul 28 20:08:50 auth: Debug: Loading modules from directory: /opt/dovecot2/lib/dovecot/auth Jul 28 20:08:50 auth: Debug: master in: USER 1 wash(a)titan.co.ke service=lda Jul 28 20:08:50 auth: Debug: passwd(wash(a)titan.co.ke): lookup Jul 28 20:08:50 auth: Info: passwd(wash(a)titan.co.ke): unknown user Jul 28 20:08:50 auth: Debug: Loading modules from directory: /opt/dovecot2/lib/dovecot/auth Jul 28 20:08:50 auth: Info: mysql: Connected to localhost (exim4u) Jul 28 20:08:50 auth: Debug: sql(wash(a)titan.co.ke): SELECT pop AS home, 26 AS uid, 26 AS gid, CONCAT('maildir:storage=', quota*1024) AS quota FROM users WHERE username = 'wash(a)titan.co.ke' AND enabled = '1' Jul 28 20:08:50 auth: Debug: master out: USER 1 wash(a)titan.co.ke home=/var/spool/virtual/titan.co.ke/wash uid=26 gid=26 quota=maildir:storage=0 Jul 28 20:08:50 lda: Debug: auth input: wash(a)titan.co.ke home=/var/spool/virtual/titan.co.ke/wash uid=26 gid=26 quota=maildir:storage=0 Jul 28 20:08:50 lda: Debug: Added userdb setting: plugin/quota=maildir:storage=0 Jul 28 20:08:50 lda(wash(a)titan.co.ke): Debug: Effective uid=26, gid=26, home=/var/spool/virtual/titan.co.ke/wash Jul 28 20:08:50 lda(wash(a)titan.co.ke): Debug: Quota root: name=storage=0 backend=maildir args= Jul 28 20:08:50 lda(wash(a)titan.co.ke): Debug: fs: root=/var/spool/virtual/ titan.co.ke/wash/mdbox, index=, control=, inbox= Jul 28 20:08:50 lda(wash(a)titan.co.ke): Debug: Namespace : Using permissions from /var/spool/virtual/titan.co.ke/wash/mdbox: mode=0700 gid=-1 Attached is my doveconf output. I need to find out what is killing the lda. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254733744121/+254722743223 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ "If you have nothing good to say about someone, just shut up!." -- Lucky Dube

3 11

[Dovecot] Thunderbird namespace handling
by Thomas Hummel 10 Aug '10

10 Aug '10

Hello, I've noticed that Thunderbird (3.0.3) seems to wrongly "repeat" the namespace prefix when selecting the top level maildir of a namesapce. It doesn't occur if "list=yes" and TB has no clue about the namespace prefix. But it seems to happen only when TB is aware of the namespace prefix, either via the NAMESPACE command (so in "hidden=no" setups) or via hard setting it up in the "Account Settings". For instance, if location = maildir:/courriel/boites/test:CONTROL=/courriel/meta/test hidden = no list = yes Trying to select the mailbox which appears as "#test" in the UI gives 4 select "#test/#test" in rawlogs, giving for the user a "Mailbox doesn't exist" error, whereas, via telnet, I can : x select "#test" * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 2 EXISTS * 0 RECENT * OK [UIDVALIDITY 1271768576] UIDs valid * OK [UIDNEXT 3] Predicted next UID * OK [HIGHESTMODSEQ 3] Highest x OK [READ-WRITE] Select completed. The same happens with any combination of (hidden=, list=, "Allow Server to override [the namesapce] settings") where TB knows about the namespace. Any ideas ? Thanks. -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

2 24

[Dovecot] Dovecot and Active Directory separate domain data stores.
by Andrew Bruce 09 Aug '10

09 Aug '10

Hi, I've got Dovecot setup to auth my AD users fine via Winbind and I've also tried it using LDAP and can get this working also. The problem lies in the way we store our email for our virtual users in this setup. We run a flat domain for AD (lets call it newzealand.local), and then under each users account that gets email, in the E-mail field in AD, they have an email address like user1@auckland, user2@wellington, user3@chch and so on. With Postfix, I've set it up so that each email domain ends up being stored in a different path - /mail/auckland/user1, /mail/wellington/user2, /mail/chch/user3. This was done using a query filter that returned a person's email address from AD, chopped it into separate user/domain parts around the '@' symbol and using these to determine where the mail should be stored. This seems to work well for our purposes. But now I need to get Dovecot to be able to do the same thing in order to present the email to the user. I'm fairly certain this isn't going to work with Winbind, so I implemented the LDAP passdb and got that working, but I can't seem to quite work out how to get it to work with the domain part from the email address. Could someone give me a pointer in the right direction if this is possible. I'm thinking it has to do with the user_attrs variable, but can't quite workout how I would split this. Or is there a better way to do this? Thanks, Andrew

2 3

[Dovecot] IMAP IDLE, Virtual mailboxes
by Patrick Nagel 05 Aug '10

05 Aug '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, K-9 Mail (on Android) has been mentioned on this list multiple times recently, I think it's definitely an IMAP client "on the rise". :) It supports IMAP IDLE, and so brings "push mail" to Android mobile phone users. To bring this into the context of this mailing list: I guess a lot of people on this list are making use of server-side filtering (using sieve), so that mails from certain persons or mailing lists end up in the right mailboxes, right on delivery. Now, this is all great, but there are issues when server-side filtering and IMAP IDLE come together: Only one mailbox can be "watched" with one IMAP IDLE connection. So, people who have set up elaborate server-side filtering with say, 50 different sieve "fileinto" calls, will constantly have a *lot* of IMAP IDLE connections open, if they really want to get informed of any mail arriving in any of their mailboxes. Keeping those 50 IMAP connections open wouldn't cost much bandwidth, and who cares about the Internet router's connection tables getting unnecessarily big, anyway? But then there is the "problem" of a mobile phone being carried around constantly, switching physical connections (from WLAN access point 1 to WLAN access point 2 to 3G to 2G to no connection at all and back), every time needing to terminate* those 50 IMAP connections, and then establish 50 new ones (with SSL handshake overhead and all). So, all in all, not an optimal solution. *) (which does not always happen the way it should, see http://code.google.com/p/k9mail/issues/detail?id=1255) I see two ways to improve the situation (one of them quite dovecot-centric): 1) A new extension of the IMAP protocol: IMAP MULTI-IDLE, which somehow allows a client to get notified of changes to more than one mailbox within one IMAP connection. This conflicts with the basic IMAP design though, AFAIK, and is thus not likely to be feasible. 2) Enhancing dovecot's Virtual plugin, so virtual mailboxes do not only get updated on select and expunge, but also when anything changes that affects the set of messages shown in the virtual mailbox. I guess that would have an impact on performance, and thus should be optional. Let me explain the second one: With the help of the Virtual plugin, it is possible to pull all those 50 mailboxes that receive incoming mail together again, just like the INBOX of the pre-server-side-filtering times - the user could configure a virtual mailbox to show all unread mails from those 50 mailboxes. Now the mobile IMAP IDLE users could just watch that one virtual mailbox, needing only one IMAP IDLE connection. After having read the mail (directly in the virtual mailbox), it would disappear, but of course still be in the "real" mailbox, determined by the sieve filter on delivery. Patrick. - -- STAR Software (Shanghai) Co., Ltd. http://www.star-group.net/ Phone: +86 (21) 3462 7688 x 826 Fax: +86 (21) 3462 7779 PGP key E883A005 https://stshacom1.star-china.net/keys/patrick_nagel.asc Fingerprint: E09A D65E 855F B334 E5C3 5386 EF23 20FC E883 A005 -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.12 (GNU/Linux) Comment: Using GnuPG with SUSE - http://enigmail.mozdev.org/ iEYEARECAAYFAku+ydsACgkQ7yMg/OiDoAXV9ACdF+BEstnjfUeJlR/JQKFf6N7n yxYAnAnuD2popWYLfZNCCtlpkAP4SQww =L33A -----END PGP SIGNATURE-----

7 19

[Dovecot] OT dovecot w/postfix, mysql , postfix does unnecessary lookups
by Noel Butler 04 Aug '10

04 Aug '10

I know this unnecessary lookups question is really a postfix one, but I'm curious if anyone else sees the behaviour of postfix continuing looking up users after it clearly have got its answer that it is "not a local domain" response. (this msg is an extract from what I sent to WV some time ago, with him showing absolutely no interest, I got bored tonight so thought I'd throw it on this list since the question remains valid today) 30 Query SELECT 1 FROM virtual_domains WHERE name='example.net' AND active ='1' 31 Query SELECT destination FROM view_aliases WHERE email='someuser(a)example.net' Should that not have ended its lookups at Q30 and not gone on to ask Q31 which it now knows is not local? Secondly, it seems to do "double lookups" of destination and email before it gets to dovecots deliver, has anyone else ran a log on mysql and seen same? I'm trying to work out why, since it already has its answer by Q54 and Q55, it is doing Q56 and Q57, which seem pointless... 54 Connect 54 Query SELECT destination FROM view_aliases WHERE email='laura(a)example.com' 55 Connect 55 Query SELECT email FROM view_users WHERE email='laura(a)example.com' 56 Connect 56 Query SELECT destination FROM view_aliases WHERE email='laura(a)example.com' 57 Connect 57 Query SELECT email FROM view_users WHERE email='laura(a)example.com' So, it to me appears postifx does more work then it needs too since it already knows the answer, I consider this a flaw in postfix, yet perhaps I am the only one seeing it hence why WV couldnt give a shit. just curious if anyone has noted same or not....

3 4

[Dovecot] AntiSpam Plugin
by Leander S. 04 Aug '10

04 Aug '10

P.S. I just tried it with 1.2.13 as well - still the same issue. Am I doing something wrong, or is this really a bug now!? Best Regards Leander S. Hi, Has anyone got the chance to get this running? I'm permanently getting this Serverbug error ... ;( *"[SERVERBUG] failed to send email"* ... This happens when I try to drag&drop mails from one to the other folder within a IMAP-session. What version of Dovecot must I have to get this plugin working? Or will it generally be broken in upcoming new releases of Dovecot? Best Regards Leander S.

8 16

[Dovecot] problem with mail_full_filesystem_access = yes
by Ladislav Pašek 03 Aug '10

03 Aug '10

Hello, I have configured Dovecot 1.2.12 with Postfix 2.6.5 and everything is working fine. But tomorrow I wanted to run IMAP ALCs and from log I found that this plugin is conflicting with parameter mail_full_filesystem_access = yes in my config. But when I set mail_full_filesystem_access = no it stops authorization for postfix with this message: <pasek(a)valbek.cz>: Command died with signal 11: "/usr/libexec/dovecot/deliver" Does anybody know what could be wrong in my config? I've spend a night with it but without success. You can see my Dovecot here: http://www.volny.cz/vykupitel/Pictures/mail/dovecot.conf http://www.volny.cz/vykupitel/Pictures/mail/dovecot-ldap.conf and Postfix here: http://www.volny.cz/vykupitel/Pictures/mail/main.cf http://www.volny.cz/vykupitel/Pictures/mail/master.cf http://www.volny.cz/vykupitel/Pictures/mail/ldap-users.cf http://www.volny.cz/vykupitel/Pictures/mail/ldap-groups.cf Thanks in Advance Ladislav

4 7

[Dovecot] Convert plugin
by Egbert 03 Aug '10

03 Aug '10

Hi, I'm trying to convert users from a sendmail server to a postfix/dovecot server. All works fine but one of the last things is to rescue the messages in /var/mail/<user> on the old server. This seems very straitforward using the convert plugin but with the settings from the wiki, nothing happens when the user logs in. Do I need a private namespace for this as suggested elsewhere in the wiki? I experimented with mb2md.pl and that seems to do what we need but having the old mail converted upon login is much more attractive. In that way we hope that we can also find some 'dead' users. TIA Egbert Jan

3 12

[Dovecot] Plugin Handle input messages
by Alex Baule 03 Aug '10

03 Aug '10

Hi Timo.... I try to change my plugin to read the input email to increase a header line and one \r\n. But i need help to get this input.... My plugin is based in zlib plugin. In "static int zlib_permail_get_stream" function, have it. if (imail->data.stream != NULL || (_mail->uid == 0 && zuser->save_handler == NULL)) { return zmail->super.get_stream(_mail, hdr_size, body_size, stream_r); } I think this is the line that return the stream that is the stream sent by client. I try to change this line and put inside this IF , a call to my function to handle with the input email from client. But i got some errors about the input part. In other email, Timo said, to get the S and W flags in the email name, i need to intercept the email input from client to dovecot, in this part is done the W and S calculation. Timo, where is the part that i can get the input from client ?

2 4