May 2016 - dovecot - dovecot.org

IMAP Timeouts
by Vince42 30 May '16

30 May '16

Hi, from time to time the IMAP login times out ... my external monitoring says "connection reset by peer (SSL)" and Thunderbird tries to connect forever. After a short while everything returns back to normal operation. The system resources are plenty, there are no error messages and no greedy background tasks running. I read a little about tweaking imap-login - but all the default parameters seem to be set more generously than what was recommended. Where should I start the debugging process? I really wish there was some "dovecot optimizer tool" ... :P -- Cheers, \\|// Vince (o o) ----------------------------ooO-(_)-Ooo------------------------- ''' (o)_(o) [ ][0][ ] ô¿ô (=°o°=) World Domination by Copy and Paste [ ][ ][0] - (")_(") [0][0][0] () ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments Ooo. ---------------------------.ooO----( )------------------------- ( ) (_/ \_)

3 4

[PATCH 0/7] Fixes for lib-mail message-address
by Pali Rohár 30 May '16

30 May '16

Hello, I borrowed dovecot parser for email addresses and going to use it in new perl module as replacement for Email::Address. During implementation and testing I found bugs in dovecot parser & generator. So I'm sending my patches together with tests. Pali Rohár (7): lib-mail: message_address_write: Fix generating empty group list lib-mail: message_address_write: Fix generating group list with empty name lib-mail: parse_addr_spec: Like in rfc822_skip_comment() check if last_comment is not NULL lib-mail: parse_addr_spec: Email address without local-part is invalid lib-mail: parse_mailbox: Set display name instead mailbox when parsing failed lib-mail: message_address_write: Quote and escape strings if needed lib-mail: Update tests for message address src/lib-mail/message-address.c | 99 +++++++++++++++++++++++++++++++---- src/lib-mail/test-message-address.c | 11 +++- 2 files changed, 98 insertions(+), 12 deletions(-) -- 1.7.9.5

4 13

pread() failures when using mdbox on btrfs
by Marc Joliet 28 May '16

28 May '16

(Note: I am not subscribed to this ML, so please be sure to CC me in replies.) Hello, I see a strange bug when running dovecot under btrfs with a mailbox in mdbox format. At some point, which can take a few minutes or more than a day, dovecot starts logging pread() failures, like so: Apr 02 23:43:42 thetick dovecot[570]: imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/LinuxAudio/User/dbox- Mails/dovecot.index.log: Input/output error These would trigger when getmail runs (which in turn is configured to use dovecot-lda). It's only ever the *.index.log files, and it would usually happen to the same one many times in a row. To demonstrate, this is the full list of unique pread() failures on one host (my desktop PC): # journalctl -u dovecot -p 3 -o cat | sort -u | grep pread imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/BTRFS/dbox-Mails/dovecot.index.log: Input/output error imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/Gentoo/User/dbox-Mails/dovecot.index.log: Input/output error imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.log: Input/output error imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/LinuxAudio/User/dbox-Mails/dovecot.index.log: Input/output error imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/Newsletters/dbox-Mails/dovecot.index.log: Input/output error imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/SCons/User/dbox-Mails/dovecot.index.log: Input/output error imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/storage/dovecot.map.index.log: Input/output error and on the current host (a home server): # journalctl -u dovecot -p 3 -o cat | sort -u | grep pread imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/Privat/dbox-Mails/dovecot.index.log: Input/output error imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/storage/dovecot.map.index.log: Input/output error Rebooting the system would make it go away (without loss of mails), though remounting the file system should have worked, too. I tried a variety of options, but the only one that helped was to convert the mailbox from mdbox to maildir. I have not seen any pread() failures in the two weeks since. I originally wrote to the btrfs ML, see the thread at [0], in particular my messages [1] and [2], for additional details, including references to what little I could find on the web. However, nothing much came of that thread, so I am now posting here. My dovecot configuration: # doveconf -n # 2.2.19: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.9 (357ac0a0e68b+) # OS: Linux 4.4.8-gentoo x86_64 Gentoo Base System release 2.2 auth_mechanisms = plain login mail_location = maildir:~/.maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = * driver = pam } plugin { sieve = file:~/.sieve;active=~/.dovecot.sieve } postmaster_address = root@diefledermaus protocols = imap sieve service imap-login { inet_listener imap { port = 10087 } inet_listener imaps { port = 10887 } } ssl = required ssl_cert = </etc/ssl/dovecot/dovecot.pem ssl_key = </etc/ssl/dovecot/dovecot.key userdb { driver = passwd } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = sieve } protocol sieve { managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date } I used to use claws-mail, then switched to KMail in September 2015. So the errors happened with both clients. [0] http://thread.gmane.org/gmane.comp.file-systems.btrfs/49637 [1] http://article.gmane.org/gmane.comp.file-systems.btrfs/49647 [2] http://article.gmane.org/gmane.comp.file-systems.btrfs/55552 Greetings -- Marc Joliet -- "People who think they know everything really annoy those of us who know we don't" - Bjarne Stroustrup

2 3

first_valid_uid
by Vince42 28 May '16

28 May '16

Hi, I have error log entries like dovecot: lmtp(22155, mail): Error: user mail: Mail access for users with UID 8 not permitted (see first_valid_uid in config file, uid from userdb lookup). This obviously tells me that the user mail (UID 8) is trying to access the LMTP daemon. How can I find out why he is doing so and how I can get rid of this error message? The mail system (Ubuntu 14.04 LTS : Postfix + Dovecot) is working - but probably not properly configured. -- Cheers, \\|// Vince (o o) ----------------------------ooO-(_)-Ooo------------------------- ''' (o)_(o) [ ][0][ ] ô¿ô (=°o°=) World Domination by Copy and Paste [ ][ ][0] - (")_(") [0][0][0] () ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments Ooo. ---------------------------.ooO----( )------------------------- ( ) (_/ \_)

2 4

ot: migrating TB user's email to new laptop
by voytek＠sbt.net.au 25 May '16

25 May '16

another OT: setting up new W10 laptop with TBird: user has three accounts, several hundred emails on old laptop BUT NO LONGER on server two of the accounts are on my Dovecot server, one on ISP server what's best way to transfer local emails: transfer TBird files laptop to laptop ? or, is there some way to sync old laptop to server, then retrieve on new laptop ? thanks, V

6 7

Unable to view shared mailbox
by dev 25 May '16

25 May '16

Hi All, I have a mailing list I'd like to archive and share with a handful of users. The users are all in OpenLDAP. 10-auth-system.conf.ext is setup with "driver=pam" so it appears anyone in LDAP who already is able to SSH into the server may also connect to dovecot with same username/password they use in LDAP. I have a shared mailbox directory called LISTS_Archive. The system directory is /home/shared_imap. I can connect to dovecot using LDAP credentials (using Thunderbird) and this shared folder (LISTS_Archive) is grayed out. I assume I have acls wrong? What I want is for users in LDAP to access the LISTS_Archive imap folder as a shared folder for everyone. Only R/O access however (which is 'lr' in acl file I think). Would someone please point out what I've missed? Thank you. # # egrep -v '(^$|\#)' /etc/dovecot/conf.d/10-mail.conf # mail_location = maildir:~/.maildir namespace inbox { type = private separator = / inbox = yes } mail_plugins = acl plugin { acl = vfile:/etc/dovecot/acls } namespace { hidden = no inbox = no location = maildir:/home/shared_imap/:INDEX=~/Maildir/shared/%%u:INDEXPVT=~/Maildir/shared/%%u prefix = LISTS_Archive/ separator = / type = public list = yes subscriptions = no } # # egrep -v '(^$|\#)' /etc/dovecot/conf.d/20-imap.conf # protocol imap { mail_plugins = $mail_plugins imap_acl } # # dir /home/shared_imap/ # total 8 drwxr-xr-x 7 root root 4096 May 25 10:26 .. -rw-rw-r-- 1 user384 mail-user 0 May 25 10:43 dovecot-acl-list drwxrwsr-x 2 root mail-user 4096 May 25 10:43 . # # cat /etc/dovecot/acls # * user=user384 lr

1 0

ot: selfcert IMAP StartTLS 143 Win10 Tbird woes
by voytek＠sbt.net.au 25 May '16

25 May '16

I was trying to set up a replacement laptop running W10/64 to replace a Win7 laptop, installed TBird, and, attempted normal setup: IMAP StartTLS 143, SMTP StartTLS 587 (like on old laptop), and, to cut a long story, eventually discovered it won't work till I changed IMAP SSL/TLS 993 ? SMTP seems OK, only IMAP didn't (I recall earlier similar type of issues with either Outlook or OE or WLive?) is this the self certified part ? or what is it ? what's the best way around ? or just leave it as 993 ? thanks for any hints , pointers or even words of encouragement

2 1

Re: New feature: HTTP API
by aki.tuomi＠dovecot.fi 25 May '16

25 May '16

> On April 5, 2016 at 9:27 AM Tom Sommer <mail(a)tomsommer.dk> wrote: > > > On 2016-04-04 20:22, aki.tuomi(a)dovecot.fi wrote: > > > Since the API is still a little beta, it will not return anything in > > case > > doveadm does not like the arguments (that is, calls i_fatal). Also, > > success is > > often indicated with 200 OK along with [["doveadmResponse",[],"c01"]]. > > I don't see the "doveadm proxy kick" command in the list? Not all commands are included, unfortunately. Also, the list only shows commands that are available with doveadm as per configuration. Aki

4 7

Error: Filename keeps changing
by Ward Romp 24 May '16

24 May '16

Dear all, Two days ago, my ldap server (for authentication) crashed and I had to set up a new one. Everything works fine except the mailbox for one user (let's name him debugger). When I try to access his mail whatever way, dovecot complains about "Error: maildir_file_do(........): Filename keeps changing" For example, a command "doveadm copy -u debugger(a)boontje.net Archive mailbox Netspar" returns doveadm(debugger(a)boontje.net): Error: maildir_file_do(/var/mail/vmail/boontje.net/debugger/mail/Netspar/cur/14230…: Filename keeps changing doveadm(debugger(a)boontje.net): Error: Copying message UID 1 from 'Netspar' failed: Internal error occurred. Refer to server log for more information. [2016-05-24 13:19:58] doveadm(debugger(a)boontje.net): Error: maildir_file_do(/var/mail/vmail/boontje.net/debugger/mail/Netspar/cur/14472…: Filename keeps changing doveadm(debugger(a)boontje.net): Error: Copying message UID 2 from 'Netspar' failed: Internal error occurred. Refer to server log for more information. [2016-05-24 13:19:58] doveadm(debugger(a)boontje.net): Error: maildir_file_do(/var/mail/vmail/boontje.net/debugger/mail/Netspar/cur/14472…: Filename keeps changing doveadm(debugger(a)boontje.net): Error: Copying message UID 3 from 'Netspar' failed: Internal error occurred. Refer to server log for more information. [2016-05-24 13:19:58] doveadm(debugger(a)boontje.net): Error: maildir_file_do(/var/mail/vmail/boontje.net/debugger/mail/Netspar/cur/14498…: Filename keeps changing doveadm(debugger(a)boontje.net): Error: Copying message UID 4 from 'Netspar' failed: Internal error occurred. Refer to server log for more information. [2016-05-24 13:19:58] It does this on ALL mailboxes of this user and only this user. Other users give no problems. Accessing the mails via a mail client (Roundcube, Thunderbird, etc...) give the same error. Dovecot runs on a virtual machine and the mailboxes are stored via a CIFS-share on a NAS. I rebooted both machines, checked the filesystem (no errors), CIFS-share, directories and mail files are readable and writeable by dovecot user (vmail on the mail server). The mails are intact, cat <filename> shows the full mail. I'm baffled, any suggestions? Kind regards, Ward Romp The configuration etc.... ================================================ # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 4.2.0-36-generic x86_64 Ubuntu 14.04.4 LTS cifs auth_mechanisms = plain login auth_verbose = yes listen = * mail_home = /var/mail/vmail/%d/%n mail_location = maildir:/var/mail/vmail/%d/%n/mail:LAYOUT=fs managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/conf.d/ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_after = /var/mail/vmail/sieve-after sieve_before = /var/mail/vmail/sieve-before sieve_dir = ~/sieve } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/private/mail.boontje.net-chain.crt ssl_cipher_list = ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+3DES:DH+3DES:RSA+AES:RSA+3DES:!ADH:!AECDH:!MD5:!DSS ssl_client_ca_dir = /etc/ssl/certs ssl_key = </etc/ssl/private/mail.boontje.net.key userdb { args = uid=5000 gid=5000 home=/var/mail/vmail/%d/%n allow_all_users=yes driver = static } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 10 } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve postmaster_address = webmaster(a)boontje.net quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r

1 0

Growing number of dovecot processes
by John Oliver 24 May '16

24 May '16

OS is CentOS 6, dovecot-2.0.9-19 Just started using this server as a replacement for an old Debian server running an old dovecot. The number of dovecot processes just grows and grows until there are 100 concurrent login processes (we have maybe 40 or 50 users), and then nobody can log in any more. A reload resets, but the number of stuck processes climbs very quickly. We're authenticating against an OpenLDAP. Unfortunately, this system is not connected to the Internet so I cannot paste logs or output of commands. I've been Googling, but aren't hitting on the right phrase to describe this issue to uncover possible answers :-( If anyone can get me pointed in the right direction, I'd appreciate it. -- *********************************************************************** * John Oliver http://www.john-oliver.net/ * * * ***********************************************************************

2 1