April 2015 - dovecot - dovecot.org

Please help: error after upgrade to version 2.1.16
by Harald Langner 18 Apr '15

18 Apr '15

Hallo I can not find a forum at dovecot.org and I get a problem I can not solve. After Updating to the version dovecot2 2.1.16 I can no more get eMails with my eMail-client. All has been working fine before. Server: FreeBSD 10.0-RELEASE-p18, with perl 5, version 18, subversion 4 (v5.18.4) It seems it is an authentication problem with my server. The errors are: #cat dovecot.log Apr 17 22:19:37 imap-login: Error: Timeout waiting for handshake from auth server. my pid=41810, input bytes=0 Apr 17 22:19:58 auth: Error: auth: environment corrupt; missing value for DOVECOT_ Apr 17 22:19:58 auth: Fatal: unsetenv(RESTRICT_SETUID) failed: Bad address Apr 17 22:19:58 master: Error: service(auth): command startup failed, throttling for 60 secs Apr 17 22:24:04 auth: Error: auth: environment corrupt; missing value for DOVECOT_ Apr 17 22:24:04 auth: Fatal: unsetenv(RESTRICT_SETUID) failed: Bad address Apr 17 22:24:04 master: Error: service(auth): command startup failed, throttling for 60 secs I have google and has nothing found about "..environment corrupt; missing value for DOVECOT_" and about "auth: Fatal: unsetenv(RESTRICT_SETUID) failed: Bad address" I have make a reinstall - but doesn't help. I get the same error. I have not forget to create new certs with the dovecote shell-script after installation. I'm using passwd (virtual users). Make a cat on passwd shows that it is not empty. Also the date of the file show that the update installation has it not changed. So I have not create the dovecot users again. here are some other logs: #cat dovecot-info.log Apr 17 22:29:03 imap-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 1 secs): user=<>, rip=85.181.222.126, lip=78.47.225.20, TLS handshaking Apr 17 22:29:33 imap-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 30 secs): user=<>, rip=85.181.222.126, lip=78.47.225.20, TLS Apr 17 22:29:33 imap-login: Info: Disconnected: Auth process broken (disconnected before auth was ready, waited 30 secs): user=<>, rip=85.181.222.126, lip=78.47.225.20, TLS #cat dovecot-debug.log Apr 17 22:30:03 auth: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Apr 17 22:30:03 auth: Debug: Read auth token secret from /var/run/dovecot//auth-token-secret.dat Apr 17 22:34:01 auth: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Apr 17 22:34:01 auth: Debug: Read auth token secret from /var/run/dovecot//auth-token-secret.dat Apr 17 22:34:01 imap-login: Debug: SSL: where=0x10, ret=1: before/accept initialization [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: before/accept initialization [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: SSLv3 read client hello A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write server hello A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write certificate A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write key exchange A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: SSLv3 write server done A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: SSLv3 flush data [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2001, ret=1: SSLv3 read client certificate A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2002, ret=-1: SSLv3 read client key exchange A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2002, ret=-1: SSLv3 read client key exchange A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2002, ret=-1: SSLv3 read client key exchange A [85.181.222.126] Apr 17 22:34:01 imap-login: Debug: SSL: where=0x2002, ret=-1: SSLv3 read client key exchange A [85.181.222.126] ######################################################################################## My configuration is sendmail(MTA) -> procmail(LDA) -> dovecot(IMAP) with TLS and Maildir (no DB) Authentification been done with dovecot password file (no real user, no OpenLDAP, no other DB-User) #dovecot -n # 2.2.16: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.0-RELEASE-p18 amd64 ufs auth_debug = yes auth_mechanisms = digest-md5 plain login auth_verbose = yes auth_verbose_passwords = plain base_dir = /var/run/dovecot/ debug_log_path = /var/log/dovecot-debug.log default_internal_user = vmail default_login_user = vmail deliver_log_format = msgid=%m: %$ %f %s disable_plaintext_auth = no first_valid_uid = 1000 hostname = swdevil.de info_log_path = /var/log/dovecot-info.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot.log login_greeting = IMAPd ready. login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_access_groups = mailnull mail_debug = yes mail_location = maildir:/home/vmail/%d/%n/:INBOX=/home/vmail/%d/%n/.INBOX mail_plugins = " virtual" mail_temp_dir = /tmp/mail namespace inbox { inbox = yes location = prefix = } passdb { args = scheme=DIGEST-MD5 username_format=%n /usr/local/etc/dovecot/pass driver = passwd-file } service auth-worker { group = wheel user = root } service imap-login { group = dovenull inet_listener imap { port = 0 } inet_listener imaps { port = 993 } } service imap { process_limit = 100 } service pop3-login { group = dovenull inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } service pop3 { process_limit = 100 } ssl = required ssl_cert = </usr/local/etc/dovecot/certs/dovecot_ssl_crt.pem ssl_key = </usr/local/etc/dovecot/certs/dovecot_ssl_key.pem userdb { args = uid=vmail gid=vmail home=/home/vmail/%d/%n driver = static } verbose_proctitle = yes verbose_ssl = yes protocol pop3 { pop3_uidl_format = %08Xu%08Xv } Many thanks for Your advice what could be wrong. Harald Langner EU (Germany)

2 3

Problem: mail moved by thunderbird script is invisible to mail clients, but in cur directory
by David Gessel 18 Apr '15

18 Apr '15

Over the last year I've had a script moving old mail (120 days) into my annual archive folder. This is the first year I've done this with Dovecot, previously it was running against Cyrus. There's nothing particularly clever: a few conditions to match, then "move message to" the appropriate archive folder. There's one for every year from 2000 to 2015. 2015 is just barely ahead of need. 2014 has about a year's mail in the cur directory. The 2000-2013 folders were filled by Cyrus and were migrated over using IMAP Migrate. They're fine, and read normally. The 2014 layout looks normal to me # ls cur dovecot-uidlist dovecot.index.cache dovecot.index.log.2 new dovecot-keywords dovecot.index dovecot.index.log maildirfolder tmp Permissions are the same as every other folder, as is owner: drw-r----- 2 vmail vmail 9.6K Apr 12 21:13 cur and # ls | wc -l 9822 I've checked with Thunderbird, Mulberry, Claws, and Sylpheed - none can read the directory. The files look normal: 2014/cur 1426411329.M123928P26360.host.domain.com,S=3523,W=3591:2,R More or less the same as a working directory: 2013/cur 1405500734.M958596P27867.host.domain.com,S=794,W=819:2,RS I've run # doveadm force-resync -u user .archives.2014 and nothing changed. I'm at a bit of a loss since no client can read them, something like moving them to another folder and back is a little complicated. Any hints?

3 3

ManageSieve Dovecot v2 listen on localhost only
by trash＠skrilnetz.net 17 Apr '15

17 Apr '15

Hi, How can I only listen on localhost for ManageSieve? I tried: port = localhost:4190 still listening *: tcp 0 0 0.0.0.0:4190 0.0.0.0:* LISTEN 0 515675 20540/dovecot Would did I not get here? Thanks,

3 5

Replace autocreate after upgrading
by trash＠skrilnetz.net 17 Apr '15

17 Apr '15

Hi, I just upgraded to 2.2.9 and found out that autocreate should not be used any more. I had a look at http://wiki2.dovecot.org/MailboxSettings and I tried to replace my old config but I had no success. Would somebody be so and help me to change my config? Here is my old config: http://pastebin.com/zFUAQmV3 Thanks,

2 1

Potentially breaking dict-proxy (dict-sql) backwards compatibility
by Timo Sirainen 17 Apr '15

17 Apr '15

Looks like the dict-proxy code doesn't currently do escaping newlines properly, but it still accidentally happens to work, because the data is stored in the escaped form. I'm thinking about fixing this, but this might break somebody's existing dict usage. But then again maybe nobody is actually using it now, especially because it hasn't been working exactly as expected. So, can anybody tell me if they're currently using a combination of: - dict proxy (especially to dict sql) - containing values which can contain LFs (or TABs) I guess this mainly means storing Sieve scripts or IMAP METADATA to SQL. Or maybe somebody is using dict (via proxy) for their own purposes?..

1 0

Calendar and address book with Dovecot
by mimicafe＠gmail.com 16 Apr '15

16 Apr '15

Hi guys Thanks for all your input. I'll feedback later... Mimi

1 0

Thunderbird sync time? (reverse quota warning)
by E.B. 16 Apr '15

16 Apr '15

For reverse quota warning, it looks like webmail works nice. quota_warning3 = -storage=100%% quota-warning below %u # user is no longer over quota But using thunderbird I deleted enough messages to go below quota and I deleted them from trash folder too. But mail log does not show thunderbird connecting to imap to actually delete mails and get the trigger below quota warning msg. It's i thinks a thundrbrd behavior but i wonder if anyone on this list knows how it works? Do i just keep waiting for it to sync eventually? or??????? TIA!

2 3

Dovecot and recipient_delimiter
by J. Echter 16 Apr '15

16 Apr '15

Hi, we're using thunderbird as our client, it has the functionality to sort spamassassin tagged mails in a folder called 'Junk'. I have this folder on my dovecot server and i'd like to use the recipient_delimiter feature to get my spam/junk mails directly to this folder. what i have done yet: dovecot.conf: plugin { recipient_delimiter = + } postfix: master.cf dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail null_sender= argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${user}@${nexthop} -e -m ${extension} postfix: main.cf recipient_delimiter = + what i get: Apr 14 13:46:50 mule postfix/pickup[22664]: 71ED53C05EE: uid=0 from=<testuser(a)testdomain.test> Apr 14 13:46:50 mule postfix/cleanup[1408]: 71ED53C05EE: message-id=<552cfe2a.tR3wZK7y16RgA548%testuser(a)testdomain.test> Apr 14 13:46:50 mule postfix/qmgr[12559]: 71ED53C05EE: from=<testuser(a)testdomain.test>, size=465, nrcpt=2 (queue active) Apr 14 13:46:50 mule dovecot: lda(testuser(a)testdomain.test): msgid=<552cfe2a.tR3wZK7y16RgA548%testuser(a)testdomain.test>: save failed to junk: Mailbox doesn't exist: junk Apr 14 13:46:50 mule dovecot: lda(testuser(a)testdomain.test): msgid=<552cfe2a.tR3wZK7y16RgA548%testuser(a)testdomain.test>: saved mail to INBOX Apr 14 13:46:50 mule postfix/pipe[10898]: 71ED53C05EE: to=<testuser+Junk(a)testdomain.test>, relay=dovecot, delay=0.04, delays=0.02/0/0/0.02, dsn=2.0.0, status=sent (delivered via dovecot service) Apr 14 13:46:50 mule postfix/qmgr[12559]: 71ED53C05EE: removed here is my complete dovecot -n output: dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-504.12.2.el6.x86_64 x86_64 CentOS release 6.6 (Final) ext4 auth_cache_negative_ttl = 0 auth_cache_size = 50 M auth_verbose = yes base_dir = /var/run/dovecot/ imap_id_log = * imap_id_send = * log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_gid = 5000 mail_home = /DATEN/vmail/%d/%n mail_location = maildir:/DATEN/vmail/%d/%n/mail/ mail_plugins = " zlib" mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { autocreate = Junk autosubscribe = Junk recipient_delimiter = + sieve = /DATEN/vmail/%d/%n/.dovecot.sieve sieve_dir = /DATEN/vmail/%d/%n/sieve zlib_save = gz zlib_save_level = 6 } protocols = sieve imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } user = root } service imap-login { chroot = login executable = /usr/libexec/dovecot/imap-login inet_listener imap { port = 0 } process_min_avail = 4 user = dovecot } service imap { executable = /usr/libexec/dovecot/imap } service managesieve-login { chroot = login user = dovecot } service pop3-login { chroot = login user = dovecot } ssl = required ssl_cert = </shared/config/dovecot/certs/dovecot.pem ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!EXPORT ssl_key = </shared/config/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } valid_chroot_dirs = /var/spool/vmail protocol lda { mail_plugins = sieve postmaster_address = postmaster } any hints on what i do wrong here? thanks juergen

2 4

Disk space usage with mdbox
by Alexandros Soumplis 15 Apr '15

15 Apr '15

Hello, I am using dovecot with mdbox+sis and I notice an ever increasing disk space usage since I converted mailboxes from Maildir to mdboxes. I have checked with a user and while it actually uses only 65K, his mdbox files on disk are more than 6G. The backup of his mailbox is just 64K. Any suggestions ? Below are some relevant commands: [root@mail ~]# doveadm quota get -u test Quota name Type Value Limit % User quota STORAGE 10135 31457280 0 User quota MESSAGE 186 - 0 [root@mail ~]# du -k --max-depth=1 /mdboxes/test/ 220 /mdboxes/test/mailboxes 6029348 /mdboxes/test/storage 6029592 /mdboxes/test/ [root@mail ~]# doveadm purge -u test [root@mail ~]# du -k --max-depth=1 /mdboxes/test/ 220 /mdboxes/test/mailboxes 6029348 /mdboxes/test/storage 6029592 /mdboxes/test/ [root@mail ~]# doveadm backup -u test mdbox:/tmp/MDBOX_TEMP/ [root@mail ~]# du -k --max-depth=1 /tmp/MDBOX_TEMP/ 16 /tmp/MDBOX_TEMP/mailboxes 65540 /tmp/MDBOX_TEMP/storage 65568 /tmp/MDBOX_TEMP/

4 9

setting service_count results in Permission denied
by Micah Anderson 15 Apr '15

15 Apr '15

The load on our machines has gotten too high, so I started to see log messages that directed me to look at this page for config changes: https://pad.riseup.net/redirect#http%3A//wiki2.dovecot.org/SocketUnavailable One of the things I wanted to do on that page was to set the: service imap { service_count = 100 } but when I added that to the service imap block, and restarted dovecot, I see this in the logs: Error: net_connect_unix(/run/dovecot/imap-postlogin) failed: Permission denied I dont understand how this impacts permissions. Its clearly this setting, because when I remove it, things work again. I found nothing else in the logs indicating a configuration problem. This is what the config block looked like: service imap { # Most of the memory goes to mmap()ing files. You may need to increase this # limit if you have huge mailboxes. #vsz_limit = 256M # Max. number of IMAP processes (connections) process_limit = 4096 service_count = 100 executable = imap imap-postlogin } service imap-postlogin { # the script process runs as the user specified here (v2.0.14+): #user = $default_internal_user executable = script-login /usr/local/sbin/postlogin_imap # this UNIX socket listener must use the same name as given to imap executable unix_listener imap-postlogin { } } This is with dovecot 2.2.13, thanks for any help you can provide! micah

4 3