August 2011 - dovecot

[Dovecot] Thunderbird caching problem
by Chris Cappuccio 03 Sep '11

03 Sep '11

Using a fairly simple dovecot config (which obviously needs some max limit tweaking) we have problems with IMAP synchronization between thunderbird clients. Two TB clients in the same IMAP mailbox will, from time to time, show different views of the same INBOX folders, when TB caching is enabled. The only fix is to right-click on the folder, go to "Properties" and use the "Repair Folder" option which repairs the local TB .msf cache file. Is there any server-side fix/workaround that would keep TB from regularly going out-of-sync ? This happens with TB3 and newer versions, in concert with either dovecot 1 or 2. The obvious fix is to disable TB local caching, which unfortunately also disables certain search features and can be a pain for large mailboxes. # dovecot -n # 2.0.13: /etc/dovecot/dovecot.conf doveconf: Warning: service auth { client_limit=4096 } is lower than required under max. load (7168) doveconf: Warning: service anvil { client_limit=2048 } is lower than required under max. load (3075) # OS: OpenBSD 5.0 amd64 ffs auth_default_realm = dovecot.org auth_mechanisms = plain digest-md5 cram-md5 apop auth_username_translation = :@ default_client_limit = 2048 default_internal_user = _dovecot default_login_user = _dovenull default_process_limit = 1024 disable_plaintext_auth = no first_valid_gid = 125 first_valid_uid = 125 mail_location = maildir:/mail/%d/%n/ managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl mmap_disable = yes passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_path = /etc/dovecot/default.sieve } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { user = mail } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl_cert = </etc/balls/balls-cert.pem ssl_key = </etc/balls/balls-key.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = sieve } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags mail_max_userip_connections = 50 } protocol pop3 { mail_max_userip_connections = 50 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_save_uidl = yes pop3_uidl_format = %v-%u }

4 4

[Dovecot] Kerberos GSSAPI - proper item name in keytab
by Stanislav Klinkov 02 Sep '11

02 Sep '11

Hello, ALL. I am trying to organize a transparent single sign-on concept for my Active Directory users into Dovecot via IMAP. On the user's desktop I use Thunderbird 6.0 as a mail client (MUA), Windows XP as an operating system. Domain is controlled by Windows 2008 Server SP2 with Active Directory. I have installed on my Mail server Debian GNU/Linux 6.0.2 (Squeeze) and Dovecot 2.0.13 from official "wheezy" repositories of it with all dependencies. I ran into in a problem with generating proper "/etc/krb5.keytab" file for successful kerberos authentication against AD controller. I has performed all the steps described in official dovecot wiki here: http://wiki2.dovecot.org/Authentication/Kerberos I have generated a service ticket with name "imap/efim.test.local(a)MYORG.LAN" exactly as described in wiki. ("MYORG.LAN" is my kerberos realm.) But this does not work. I see in debug logs something like this: ******** main service logs ******** Aug 29 16:05:14 auth: Info: gssapi(?,192.168.4.12): While processing incoming data: Unspecified GSS failure. Minor code may provide more information Aug 29 16:05:14 auth: Info: gssapi(?,192.168.4.12): While processing incoming data: Wrong principal in request ************************************* ******** auth debug logs ********* Aug 29 16:05:14 auth: Debug: gssapi(?,192.168.4.12): Obtaining credentials for imap(a)efim.test.local Aug 29 16:05:14 auth: Debug: client out: CONT 1 Aug 29 16:05:14 auth: Debug: client in: CONT<hidden> Aug 29 16:05:16 auth: Debug: client out: FAIL 1 ************************************* But (!). If I define << auth_gssapi_hostname = "$ALL" >> instead of << auth_gssapi_hostname = efim.test.local >> then everything works fine. I decided to find out where is the problem, so I dig into source code of gssapi module, "mech-gssapi.c". For versions 2.0.13 and 2.0.14 of dovecot I see there the following: ********* mech-gssapi.c ********* static OM_uint32 obtain_service_credentials(struct auth_request *request, gss_cred_id_t *ret_r) /* blah-blah-blah */ principal_name = t_str_new(128); str_append(principal_name, service_name); str_append_c(principal_name, '@'); str_append(principal_name, request->set->gssapi_hostname); auth_request_log_debug(request, "gssapi", "Obtaining credentials for %s", str_c(principal_name)); inbuf.length = str_len(principal_name); inbuf.value = str_c_modifiable(principal_name); major_status = gss_import_name(&minor_status, &inbuf, GSS_C_NT_HOSTBASED_SERVICE, &gss_principal); ********************************* So, according to source code, Dovecot tries to find in krb5.keytab a principal named "imap@hostname". However wiki says to create the principal named "imap/hostname@REALM". Please, clarify where is the error: in source code, in wiki, or I have misunderstood something. Respectfully, Stanislav Klinkov.

7 19

[Dovecot] OT - small hd recommendation
by Daniel L. Miller 02 Sep '11

02 Sep '11

A little OT - but I've seen a few opinions voiced here by various admins and I'd like to benefit. Currently running a single combined server for multiple operations - fileserver, mailserver, webserver, virtual server, and whatever else pops up. Current incarnation of the machine, after the last rebuild, is an AMD Opteron 4180 with a Supermicro MB using ATI SB700 chipset - which means it supports SATA 3.0. Current storage is one o/s drive, and a 4-drive RAID10 array. The RAID10 is using the Linux softraid via mdadm. The drives are Seagates - ST3160811AS. So it's 320GB of storage, and SATA 1.5. I'm seeing some warnings & errors in my logs & dmesg - and Google tells me this can the result of several factors, including the hard drives. I haven't seen any SMART warnings as yet - but I am getting a little nervous and thinking about upgrading the storage. At this time, I'm just interested in recommendations for hard drives & partitioning strategy. At the time I created the RAID10 array - I was still in the early stages of learning these technologies (not that I know that much more now!) so I probably didn't take advantage of any of the advanced settings such as stripe size, cluster size, etc. I am using XFS. As part of the potential upgrade, I'm considering changing to RAID6 - seems a bit more efficient use of space. I see no reason for SSD - I think a set of reasonable 7200rpm drives should be just fine. What I don't know is, compared to my current 4 drive RAID10 with SATA 1.5, would even a single SATA 3 drive be comparable in terms of seek performance? Should I stick with the RAID-10? -- Daniel

6 7

[Dovecot] thunderbird and subscriptions with sieve
by Kristen J. Webb 02 Sep '11

02 Sep '11

Hi All, I'm a newbie trying to move mail out of my ISP onto a ubuntu (lucid) dovecot 1.2.9 server. Is there any way to automatically add folders created by sieve (GNU Mailutils 2.1) to the subscriptions file for a user? I'm currently testing spam, and if sieve created the folder with the first message, the thunderbird user does not see the new folder. Even more interesting, if the user then tries to create the Spam directory it thunderbird seems to quietly ignore the request and the user still cannot see the folder, but I digress... I can manually subscribe with thunderbird, but this won't scale for more complex sieve later by making the user responsible for finding everything. I can turn off subscription view in advanced settings on thunderbird, but we are trying to wean ourselves of of individual mail clients and I don't want to have to test this everywhere. Many thanks in advance! Kris -- Mr. Kristen J. Webb Teradactyl LLC. PHONE: 1-505-242-1091 EMAIL: kwebb(a)teradactyl.com VISIT: http://www.teradactyl.com Home of the True incremental Backup System

6 6

[Dovecot] dovecot imap permission denied
by Daminto Lie 02 Sep '11

02 Sep '11

Hi, I received the following error from mail.log Aug 31 13:50:57 server1 dovecot: IMAP(mike_lee): mkdir(/home/mike_lee/Maildir/.INBOX.Sent/cur) failed: Permission denied (euid=1004 egid=1003(companyusergroup) missing +w perm: /home) What I have tried to do is changing the permission for /home by typing "sudo chmod 755 /home" and this does not work. What does it mean by missing +w perm: /home? and wonder how to get around it? This is what I have in main.cf from Postfix myhostname = server1 myorigin = /etc/mailname relayhost = mynetworks = 127.0.0.0/8, 192.168.1.0/24 inet_interfaces = all inet_protocols = ipv4 home_mailbox = Maildir/ smtpd_sasl_type = dovecot #smtpd_sasl_path = private/auth-client smtpd_sasl_path = private/auth smtpd_sasl_auth_enable = yes smtpd_recipient_restrictions = permit_sasl_authenticated,permit_mynetworks,reject_unauth_destination #smtpd_sender_login_maps = ldap:/etc/postfix/ldap_senders.cf broken_sasl_auth_clients = yes #dovecot_destination_recipient_limit = 1 debug_peer_list = 127.0.0.1 debug_peer_level = 5 Any help is very much appreciated. Thank you

2 6

[Dovecot] Segmentation fault in dovecot director lmtp service
by Reinhard Vicinus 01 Sep '11

01 Sep '11

Hi, the lmtp service of our dovecot director installation quits with a segmentation fault if a lot of mails are simultaneously delivered. For example if the postfix mailqueue is filled (for whatever reason) and postqueue -f is run the lmtp service quits with a segmentation fault: Program terminated with signal 11, Segmentation fault. #0 o_stream_cork (stream=0x0) at ostream.c:75 75 if (unlikely(stream->closed)) (gdb) backtrace #0 o_stream_cork (stream=0x0) at ostream.c:75 #1 0x00007fa6e6af45d9 in lmtp_client_send_more (client=0x2435870) at lmtp-client.c:596 #2 0x0000000002434170 in ?? () #3 0x00000000004070d9 in proxy_send_more (proxy=0x2435870) at lmtp-proxy.c:390 #4 lmtp_proxy_data_input (proxy=0x2435870) at lmtp-proxy.c:444 #5 0x00007fa6e6af456f in lmtp_client_send_data (client=0x24347a0) at lmtp-client.c:306 #6 0x0000000002434f98 in ?? () #7 0xffffffffe6af73c5 in ?? () #8 0x0000000002434840 in ?? () #9 0x0000000000000000 in ?? () I don't have any ideas why the stream is 0. The configuration of the dovecot director installation is attached. Please let me know if i shall provide any more information or test something. Kind regards Reinhard

4 5

[Dovecot] lmtp bouncing -- Invalid parameters (in reply to MAIL FROM command)
by Jan-Frode Myklebust 01 Sep '11

01 Sep '11

I just configured postfix' virtual_transport to point at my dovecot director, but am seeing occational problems like this: Aug 31 11:50:06 smtpgw postfix/lmtp[5339]: 69E2F5410D: to=<email(a)example.net>, relay=loadbalancers.example.net[192.168.42.17]:24, delay=0.15, delays=0.14/0.01/0/0, dsn=5.5.4, status=bounced (host loadbalancers.example.net[192.168.42.17] said: 501 5.5.4 Invalid parameters (in reply to MAIL FROM command)) but can't find anything interesting in the dovecot logs.. Anybody have ideas for how to make postfix play nice with dovecot's lmtp ? smtpgws% rpm -q postfix postfix-2.3.3-2.1.el5_2 loadbalancers% rpm -q dovecot dovecot-2.0.13-2 backendmailstorers% rpm -q dovecot dovecot-2.0.13-2 -jf

2 3

[Dovecot] Proprietary mail storage.
by Alex Cherniak 01 Sep '11

01 Sep '11

I have a large existing read-only collection of mails packaged in individual zip files as <rfc822 file>+<some additional info>. Is it possible (and how difficult) to create a proprietary plugin (like gzip) which will open a zip file, extract mail and pass it back to Dovecot? Where do I start? If plugin is not the right approach, what is? Another question is how will this affect Dovecot performance and how to avoid any significant degradation. Any help is appreciated.Thanks.

3 9

Re: [Dovecot] Multiple domains to one inbox and temporary redirects...
by Nick Rosier 01 Sep '11

01 Sep '11

Simon Brereton wrote: > Hi > > Can anyone point me to a howto to arrange for multiple domains to deliver to one inbox with Dovecot? For example, user1(a)example.com and user1(a)example.net should both be delivered to /var/spool/mail/virtual/example.net/user1 > > Currently, I have the dovecot LDA set as: > > dovecot unix - n n - - pipe > flags=DRhu user=mailsystem argv=/usr/lib/dovecot/deliver -f ${sender} -d ${user}@${nexthop} > > > and in dovecot.conf: > > mail_location: maildir:/var/spool/mail/virtual/%d/%n > > For some domains only, I need to override that mail_location. > > > Related to that, when user1 leave and user2 would like to receive user1's email, how can I get it so that email to user1(a)example.com is delivered to user2(a)example.com? Previously when I was using Postfix to deliver the mails, I could change the maildirloc in the DB - but I’m not sure how to accomplish this with dovecot LDA. > > I'm using Postfixadmin to manage users and have server alias-domains. All mail sent to an alias-domain is delivered to the other domain. Quite easy if you've got postfixadmin already setup. Otherwise I think you could configure virtual_alias_maps in postfix to something like hash:virtual_domains virtual_domains: @example.net @example.com N.

4 3

[Dovecot] sorting order changed during migration from courier
by Micah Anderson 01 Sep '11

01 Sep '11

Hello, I've been working to migrate to dovecot (debian stable: 1:1.2.15-7) from courier (debian old-stable: 4.4.0-2). I've setup everything and migrated a test user over to the new system, and ran the courier-dovecot-migrate.pl script. The user is using alpine (the free version of pine) and their sort order changed on move to dovecot. Originally it was the default in alpine, which is to sort based on arrival. If he changes the sort order in alpine to sort based on date, then things are back to how he expects it. I noticed that there are no known issues with pine (http://wiki.dovecot.org/Clients#Pine). Ideally, I would prefer if all the users who are migrated aren't presented with a different sort order than they were used to, as the support burden will be quite high. What is it about this migration that could have caused that, and more importantly, how can I fix it? I moved the mail from the original system to this system via rsync -a. The old system was an i686 machine and ext3, this new one is amd64 and ext4. thanks for any ideas! micah # dovecot -n # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.2 protocols: imap imaps pop3 pop3s disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_greeting: howdy, ready. login_processes_count: 10 login_max_processes_count: 256 first_valid_uid: 8 last_valid_uid: 8 first_valid_gid: 8 last_valid_gid: 8 mail_uid: 8 mail_gid: 8 mail_location: maildir:~/ maildir_copy_preserve_filename: yes maildir_very_dirty_syncs: yes mbox_write_locks: fcntl dotlock mail_executable(default): /maildir/postlogin_imap mail_executable(imap): /maildir/postlogin_imap mail_executable(pop3): /maildir/postlogin_pop mail_process_size: 512 mail_plugins(default): expire quota imap_quota mail_plugins(imap): expire quota imap_quota mail_plugins(pop3): expire quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 imap_client_workarounds(default): tb-extra-mailbox-sep delay-newmail imap_client_workarounds(imap): tb-extra-mailbox-sep delay-newmail imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes lda: postmaster_address: postmaster(a)riseup.net auth default: default_realm: riseup.net verbose: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch dict: expire: mysql:/etc/dovecot/dovecot-dict-expire.conf --

1 0