- dovecot - dovecot.org

newbie userdb lookup problem
by Michael Fox 23 Jun '16

23 Jun '16

I'm new to Dovecot and I'm having trouble getting basic, flat file userdb lookups to work. This must have been asked before, but if so, I can't find it. I'm following the basic setup here: http://wiki2.dovecot.org/HowTo/SimpleVirtualInstall with a few minor differences. Output of doveconf -n is below, as well as relevant entries from postfix main.cf and master.cf. When I send a message to a virtual user that will be handled by Dovecot, Postfix hands it off to Dovecot LDA. But I get the following error in the log: Jun 22 20:53:33 xxxxx dovecot: lda: Error: userdb lookup: connect(/var/run/dovecot/auth-userdb) failed: Permission denied (euid=5000(vmail) egid=5000(vmail) missing +r perm: /var/run/dovecot/auth-userdb, dir owned by 0:0 mode=0755) /var/run/dovecot/ is indeed owned by root:root with 0755 permissions. The actual passwd file used for userdb/passdb is currently owned by root:vmail with 0640 permissions. I read http://wiki2.dovecot.org/UserIds but I just don't understand the section on "Authentication process user". It's very vague. It doesn't explain which service is used for which circumstances or how to correlate the userdb/passdb file permissions with the service user/group settings for best security. The http://wiki2.dovecot.org/HowTo/SimpleVirtualInstall link mentions nothing about having to modify the auth or auth-worker services. And the http://wiki2.dovecot.org/HowTo/VirtualUserFlatFilesPostfix page mentions a new "doveauth" user which isn't described elsewhere and sets service auth to user postfix and group postfix, something not mentioned anywhere else. /etc/doveconf/10-master.conf says that the service auth socket is typically readable only by root. Uhm. OK. Well, my passwd file is owned by root. I don't know how that relates to the socket. So I don't understand the problem. Bottom line, each information source seems to say something completely different. I can't correlate the information in the above sources into any actionable result. Questions: Basically, can someone please explain how the permissions for userdb and passdb lookup work (i.e. file permissions vs. service permissions)? What's the best solution to solve the above problem permission problem in the most secure way? Adjust the config of service auth? If so, how and why? Or adjust my passwd file ownership? If so, how and why? I'm really trying to understand the why, not just the what. Thanks much. Michael Output of doveconf -n follows: # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-86-generic i686 Ubuntu 12.04.5 LTS auth_verbose = yes disable_plaintext_auth = no mail_gid = vmail mail_location = maildir:~/Maildir mail_uid = vmail passdb { driver = pam } passdb { args = username_format=%n /var/vmail/auth.d/%d/passwd driver = passwd-file } pop3_uidl_format = %08Xv%08Xu protocols = pop3 ssl = no ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } userdb { args = username_format=%n /var/vmail/auth.d/%d/passwd driver = passwd-file } protocol lda { postmaster_address = postmaster@xxxxx } Postfix main.cf: virtual_alias_maps = hash:/etc/postfix/virtual virtual_mailbox_domains = xxxx virtual_mailbox_maps = hash:/etc/postfix/vmailbox virtual_transport = dovecot Postfix master.cf: # Dovecot LDA # Ref: http://wiki2.dovecot.org/LDA/Postfix # Allows user+extension(a)domain.com (recipient_deliminter = + in main.cf) dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/dovecot-lda -f ${sender} -d ${user}@${nexthop} -m ${extension}

2 3

Pluggable SNI?
by Felipe Gasper 23 Jun '16

23 Jun '16

Hello, How feasible would it be to have a “pluggable” Dovecot setup that would permit arbitrary logic for fetching TLS/SNI certificates and key, rather than having to hard-code each domain’s resources in a configuration file? A couple scenarios that I envision such a framework being able to accommodate: 1) An internal TLS service that accepts queries via a UNIX socket by domain name and returns certificate/key. 2) A directory where these resources are stored, indexed by domain name. Thank you! -FG

2 2

post-login script and original remote ip in proxy mode
by j.emerlik 22 Jun '16

22 Jun '16

Hi, i have similar problem like this: "On Mon, 2013-05-27 at 23:40 +0300, Ibrahim Harrani wrote: > Hi, > > I am running dovecot on 3 qmail-ldap server backend. > dovecot configured to use auth_pop3 wrapper for authentication. > Users logins to the qmail-ldap pop3&imap pools randomly. If a user is > mailhost is not the connected server, dovecot proxies the connection to the > user mailhost. In this case, I can not get the original client IP address > via post-logins script on user host. I see only the first connected server > IP as $IP environment. Set login_trusted_networks setting pointing to the proxies' IPs/network and you'll get the original IP. Requires v2.1.2+ to work with pop3 proxying." What can I do in case if dovecot proxy is installed ona same server ? Setting of login_trusted_networks causes issue like: dovecot: imap-login: proxy(xxx): Login failed to xxx:9993: [UNAVAILABLE] Account is temporarily unavailable. dovecot: imap-login: Disconnected (internal failure, 1 successful auths) on port 9993 works service dovecot imap on port 8993 works service courier imap proxy works on 993

1 0

Storage upgrade maildir suggestions?
by Götz Reinicke - IT Koordinator 22 Jun '16

22 Jun '16

Hi, we start to run out of diskspace soon as our users start to keep mails for longer time periods. That's fine, but space consuming. The maildirs are about 1 TB in total, and not long ago we enabled zlib which is very nice. Now I have some thoughts about the next steps: a) Migrating the whole system to a new server with more storage? b) Install a virtual server for the mailsystem and an extra storage system may be NFS? c) Stay with the current server and move all mails to a bigger NFS storage. The last option c) would be the most easy one for me as I currently have NFS space. Any thoughts? Hints regarding the NFS storage? Pros Cons? I have seen the dovecot wiki on NFS already and for now we will stay with one single dovecot server. Thanks and regards . Götz

3 4

autocreate: We need "auto=init"!
by Peer Heinlein 22 Jun '16

22 Jun '16

There had been several discussions about the common problem, that there's need for a autocreate-function that creates mailboxes ONLY for new users that had never been logged in before. The reason: Existing users already HAVE "special folders" with localized names. Creating "standard names" at every login will produce confusion, because then they have multiple Sent-Folders and aren't be able to delete them, because they'll always be recreated. I would love to have: 1) auto = init Create the folders ONLY if the whole Storage-Folder (e.g.: ~/Maildir or e.g. `/mdbox) is create (=creation of the INBOX itself). Don't create any folder if the main INBOX already exists. Since there has to be a hook to autoreate a non-existing INBOX it should be able to use this action to also create the folders with auto=init at the same time. 2) auto by type Create that "special folder" only if no other special folder exists. If we have "Sent" and "Sent Items" we could set "mailbox Sent { auto=create-by-type }" so this folder will only be created if no other "\Sent" folder (like "Sent Items") already exists. Dovecot could make sure, that there is AT LEAST ONE or JUST ONE of the special folder \Draft, \Trahs, \Sent. Personally: I would prefere (1) -- and that's what several users already requestet here at the list in the last two years. Function (1) is the only way to change the behavior on a complex, already running system with existing users. That's the way how to introduce new folders for new users without breaking everything for existing users. Any chance for us the get this? Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

Dovecot 2.2.24 coredump client_check_command_hangs()
by Peter Eriksson 22 Jun '16

22 Jun '16

I’m seeing core dumps from Dovecot’s imap process (around 1/day currently) from client_check_command_hangs(). Dovecot 2.2.24 OS: Solaris 10 CPU: x86 Filesystem: Local ZFS Most crashes are associated with one user (with 25GB of mail in his mailboxes) but some (two) are also associated with other user with “just” 10GB mail. Please find enclosed various log files/traces. Let me know if there is something else I might be able to provide that might give more insight into this. The output is from one of the “25GB”-user crashes. He is able to access mail normally most of the time though so the client recovers and he hasn’t reported this issue to us. — [Lı.U] SysAdmin KITVS-IFM & ITI-NET IT.LiU.SE +46-13-28 2786

2 1

Fedora + Dovecot - only one client can connect per user?
by Thomas Cameron 20 Jun '16

20 Jun '16

Howdy - I am running dovecot-2.2.24-1.fc23.x86_64 on Fedora 23. It's up to date as of last night. When I log in from a desktop using Thunderbird on Linux, my Android phone (Nexus 6P) stops receiving mail. It happens if I'm on my laptop or my desktop. My wife has the same problem using Thunderbird on Windows. If she leaves the house and forgets to shut down her MUA, her phone can't retrieve messages. Is this expected behavior? Can I change it? I feel like it's pretty common for folks to have multiple devices which access the same mail account. Between phones, tablets, PCs, etc., this seems like a pretty common scenario. It's a pretty vanilla setup: [root@wintermute ~]# dovecot -n # 2.2.24 (a82c823): /etc/dovecot/dovecot.conf # OS: Linux 4.4.4-301.fc23.x86_64 x86_64 Fedora release 23 (Twenty Three) mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_cipher_list = PROFILE=SYSTEM ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } Thanks! Thomas

2 1

Recipient delimiter and lmtp proxying
by Dave 20 Jun '16

20 Jun '16

Hi, I'm attempting to proxy lmtp using director to hash to the same backend as pop3/imap. My pop3/imap users are of the form: username and my lmtp users are of the form: <username@domain> Where domain is fairly redundant but does carry some useful information. Now, I can proxy lmtp using user=%{username} and destuser=%{orig_user}, and this all appears to work correctly. However, if I also try to pass a detail part through to the backend the lmtp users now take the form: <username+detail@domain> I can still use user=%{username} with recipient_delimiter = +, and the detail is correctly stripped, hashing works as expected. However, I can no longer use destuser=%{orig_user} Because recipient_delimiter = +, destuser becomes: <username@domain> And the detail part never reaches the backend. There doesn't appear to be any variables suitable for the destuser expansion - %{auth_user} is unsupported (UNSUPPORTED_VARIABLE_auth_user) on override_fields and in the sql passdb driver. Is there any "correct" way to do this? I can think of a couple of approaches that may work, but both seem like hacks to me: 1. Unset recipient_delimiter and manually strip the detail from the username in the passdb lookup. 2. Give up on passing detail via the login and instead pass the detail via a message header to sieve. Any thoughts/suggestions? -- Dave

1 2

Migrate Dovecot email archive
by Marco Usai 20 Jun '16

20 Jun '16

Yesterday I'vemigrated Dovecot mail archive between two servers using the procedure below: 1) Createon the new server the same email accounts existing on the old server. 2) Transferthe "tarred" mail folder from the old to the new server. For testingpurposes, on Outlook 2007 I've deleted a .pst cache file, forcing the client todownload all emails again. The switchwas absolutely transparent without any problem. All the emails were availableand Outlook 2007 noticed no changes. Can Iconsider this a correct procedure or should I use some tools like Dsync ?

3 3

Increased errors "Broken MIME parts" in log file
by Alessio Cecchi 20 Jun '16

20 Jun '16

Hi, after the last upgrade to Dovecot 2.2.24.2 (d066a24) I see an increased number of errors "Broken MIME parts" for users in dovecot log file, here an example: Jun 01 15:25:29 Error: imap(alessio.cecchi(a)skye.it): Corrupted index cache file /home/domains/skye.it/alessio.cecchi/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 34 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=410000005b070000000000007b07000000000000fc0a000000000000400b0000000000000300000048000000800700000000000060000000000000006400000000000000200000000000000021000000000000000100000040000000260800000000000027000000000000002900000000000000ea00000000000000f000000000000000440000005d090000000000001e000000000000002000000000000000b308000000000000e0080000000000002d00000001000000410000007b09000000000000b208000000000000de080000000000000000000000000000000000000000000000000000) Jun 01 15:25:29 Error: imap(alessio.cecchi(a)skye.it): Corrupted index cache file /home/domains/skye.it/alessio.cecchi/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 35 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=410000005b070000000000007b07000000000000fd0a000000000000410b0000000000000300000048000000800700000000000060000000000000006400000000000000200000000000000021000000000000000100000040000000260800000000000027000000000000002900000000000000eb00000000000000f100000000000000440000005e090000000000001e000000000000002000000000000000b308000000000000e0080000000000002d00000001000000410000007c09000000000000b208000000000000de080000000000000000000000000000000000000000000000000000) Jun 01 15:25:29 Error: imap(alessio.cecchi(a)skye.it): unlink(/home/domains/skye.it/alessio.cecchi/Maildir/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Jun 01 15:25:29 Error: imap(alessio.cecchi(a)skye.it): Corrupted index cache file /home/domains/skye.it/alessio.cecchi/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 49 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=) Jun 01 15:25:29 Error: imap(alessio.cecchi(a)skye.it): unlink(/home/domains/skye.it/alessio.cecchi/Maildir/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Jun 01 15:25:29 Error: imap(alessio.cecchi(a)skye.it): Corrupted index cache file /home/domains/skye.it/alessio.cecchi/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 50 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=) Jun 01 15:25:29 Error: imap(alessio.cecchi(a)skye.it): unlink(/home/domains/skye.it/alessio.cecchi/Maildir/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Jun 01 15:25:29 Error: imap(alessio.cecchi(a)skye.it): Corrupted index cache file /home/domains/skye.it/alessio.cecchi/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 54 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=) Jun 01 15:25:29 Error: imap(alessio.cecchi(a)skye.it): unlink(/home/domains/skye.it/alessio.cecchi/Maildir/dovecot.index.cache) failed: No such file or directory (in mail-cache.c:28) Jun 01 15:25:29 Error: imap(alessio.cecchi(a)skye.it): Corrupted index cache file /home/domains/skye.it/alessio.cecchi/Maildir/dovecot.index.cache: Broken MIME parts for mail UID 55 in mailbox INBOX: Cached MIME parts don't match message during parsing: Cached header size mismatch (parts=) I try to run: - doveadm index -u alessio.cecchi(a)skye.it INBOX - doveadm force-resync -u alessio.cecchi(a)skye.it INBOX - delete all dovecot.* files for user but the error reappears always (for the same UID) when I do "search" from webmail. All works fine for the users but I don't think is good to have these errors in log file. My configuration: # dovecot -n # 2.2.24.2 (d066a24): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.14 (5986a78) # OS: Linux 2.6.32-642.el6.x86_64 x86_64 CentOS release 6.8 (Final) auth_cache_negative_ttl = 2 mins auth_cache_size = 20 M auth_cache_ttl = 20 mins auth_master_user_separator = * auth_mechanisms = plain login auth_worker_max_count = 50 deliver_log_format = msgid=%m, from=%f, subject="%s": %$ dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_gid = 89 first_valid_uid = 89 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_idle_notify_interval = 29 mins imap_logout_format = in=%i out=%o session=<%{session}> imap_max_line_length = 2 M last_valid_gid = 89 last_valid_uid = 89 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 10.0.0.157 login_trusted_networks = 10.0.0.0/24 mail_fsync = always mail_location = maildir:~/Maildir mail_plugins = quota acl expire zlib maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vnd.dovecot.duplicate mmap_disable = yes namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = username_format=%Ld /etc/dovecot/extra/alias-domains-denylogin.txt deny = yes driver = passwd-file } passdb { args = /etc/dovecot/dovecot-deny-sql.conf.ext deny = yes driver = sql } passdb { args = /etc/dovecot/extra/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl antispam_backend = mailtrain antispam_mail_notspam = --ham antispam_mail_sendmail = /usr/bin/sa-learn antispam_mail_spam = --spam antispam_spam = Spam antispam_trash = Trash expire = Trash expire2 = Spam expire_dict = proxy::expire fts = solr fts_solr = url=http://10.0.0.5:8983/solr/ quota = maildir:UserQuota quota2 = dict:Quota Usage::noenforcing:proxy::sqlquota quota_grace = 10M quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/before.sieve sieve_dir = ~/sieve sieve_extensions = +vnd.dovecot.duplicate -vacation zlib_save = gz zlib_save_level = 6 } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o, session=<%{session}> protocols = imap pop3 sieve sendmail_path = /var/qmail/bin/sendmail service anvil { unix_listener anvil-auth-penalty { mode = 00 } } service auth { client_limit = 6524 unix_listener auth-userdb { group = vchkpw mode = 0660 user = vpopmail } } service dict { process_limit = 500 unix_listener dict { group = vchkpw mode = 0660 user = vpopmail } } service imap-login { process_min_avail = 4 service_count = 0 } service imap-postlogin { executable = script-login /etc/dovecot/scripts/imap-postlogin.sh unix_listener imap-postlogin { group = vchkpw mode = 0660 user = vpopmail } user = vpopmail } service imap { executable = imap imap-postlogin process_limit = 5000 vsz_limit = 384 M } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { process_min_avail = 4 service_count = 0 } service pop3-postlogin { executable = script-login /etc/dovecot/scripts/pop3-postlogin.sh unix_listener pop3-postlogin { group = vchkpw mode = 0660 user = vpopmail } user = vpopmail } service pop3 { executable = pop3 pop3-postlogin process_limit = 1024 } service quota-warning { executable = script /etc/dovecot/scripts/quota-warning.sh unix_listener quota-warning { user = vpopmail } user = vpopmail } service stats { fifo_listener stats-mail { group = vchkpw mode = 0660 user = vpopmail } } ssl = no ssl_protocols = !SSLv2 !SSLv3 submission_host = 127.0.0.1 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lda { mail_fsync = optimized mail_location = maildir:~/Maildir:INDEX=MEMORY mail_plugins = quota acl expire zlib sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = quota acl expire zlib imap_quota imap_acl imap_zlib } protocol sieve { mail_max_userip_connections = 2 } protocol pop3 { mail_max_userip_connections = 15 } -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice

5 9