- dovecot - dovecot.org

Re: v2.2.30 released
by Joseph Tam 31 May '17

31 May '17

Timo wrote: >>> + If dovecot.index.cache corruption is detected, reset only the one >>> corrupted mail instead of the whole file. >> >> Is this a big performance win? I still have users with jumbo mailboxes >> who insist on direct mailbox file access using procmail or mail readers, >> which trigger index rebuilds when dovecot accesses them. > > What does Dovecot log then? But probably doesn't affect that. It's > only when Dovecot logs something about dovecot.index.cache corruption > that this helps. It logs stuff like this (Lots of this ...) May 26 15:22:50 server dovecot: pop3(user): Warning: Transaction log file /{cachedir}/dovecot.index.log was locked for 43 seconds (rotating while syncing) May 27 16:57:18 server dovecot: imap(user): Warning: Transaction log file /{cachedir}/dovecot.index.log was locked for 105 seconds (Mailbox was synchronized) (... and some this this ...) May 26 15:43:07 server dovecot: imap(user): Error: Next message unexpectedly corrupted in mbox file /var/mail/user at 9627641 (... but very rarely this ...) May 8 17:05:59 server dovecot: imap(user): Error: Corrupted index cache file /{cachedir}/dovecot.index.cache: Broken virtual size for mail UID 12032 in mailbox INBOX: read(/var/mail/user): FETCH BODY[] got too little data: 6199 vs 6201 >From what you say, the changes would only affects the latter, so no big change. Thanks for the info. Joseph Tam <jtam.home(a)gmail.com>

2 1

shared folder and private index file problems
by Thomas Robers 31 May '17

31 May '17

Hello, I'm using Dovecot 2.2.30 with Pideonhole 0.4.18 and I'm having some problems, perhaps someone can give an hint on how to solve them. When I try to create a folder in the toplevel directory of a shared mailbox, i get a "permission denied" although I have the rights, example: 1.doveadm -f table acl rights -u bob(a)example.com shared/bill(a)example.com Rights lookup read write write-seen write-deleted insert post expunge create delete admin 2.doveadm mailbox create -u bob(a)example.com "shared/bill(a)example.com" doveadm(bob(a)example.com): Error: Can't create mailbox shared/bill(a)example.com: Permission denied Creating an subfolder of a folder which already exists works fine: 1.doveadm -f table acl rights -u bob(a)example.com shared/bill(a)example.com /Drafts Rights lookup read write write-seen write-deleted insert post expunge create delete admin 2.doveadm mailbox create -u bob(a)example.com "shared/bill(a)example.com /Drafts/Test" (no output) 3.doveadm -f table acl rights -u bob(a)example.com shared/bill(a)example.com /Drafts/Test Rights lookup read write write-seen write-deleted insert post expunge create delete So this works, but creating a folder directly in the inbox of the shared mailbox doesn't work and I don't know why. Is this not supported? Or do I miss something important? Another problem I have is, that the private index files in shared folders are often to always marked as inconsistent in the dovecot log file, an example of such log messages look like: - imap(bob(a)example.com): Error: /export/home/imap/bob(a)example.com/shared /bill(a)example.com/.Templates/dovecot.index.pvt view is inconsistent - imap(bob(a)example.com): Error: /export/home/imap/bob(a)example.com/shared /bill(a)example.com/.Templates/dovecot.index.pvt view is inconsistent - imap(bob(a)example.com): Error: /export/home/imap/bob(a)example.com/shared /bill(a)example.com/.Trash/dovecot.index.pvt view is inconsistent - imap(bob(a)example.com): Error: /export/home/imap/bob(a)example.com/shared /bill(a)example.com/.Trash/dovecot.index.pvt view is inconsistent And this is logged for almost every user who has access to a shared mailbox and I don't know how to stop getting the indexes inconsistent. Here's my Dovecot configuration: # 2.2.30 (8acbc67): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.18 (29cc74d) # OS: Linux 2.6.32-642.4.2.el6.x86_64 x86_64 CentOS release 6.9 (Final) ext4 auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no mail_debug = yes mail_location = maildir:/export/home/imap/%Lu/Maildir mail_plugins = acl zlib mail_log notify mailbox_idle_check_interval = 10 secs mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mbox_write_locks = fcntl namespace { hidden = no ignore_on_failure = no inbox = no list = children location = maildir:%%h/Maildir:INDEXPVT=%h/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX/ separator = / type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/export/home/shared-db/shared-mailboxes mail_log_events = append delete undelete expunge copy mailbox_delete mailbox_rename flag_change mail_log_fields = uid box msgid size from flags sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global = /var/lib/dovecot/sieve/global/ sieve_user_log = ~/.dovecot.sieve.log zlib_save = gz zlib_save_level = 6 } protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service imap-login { process_limit = 500 process_min_avail = 20 } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl = required ssl_cert = </etc/pki/dovecot/certs/mail.tutech.de.crt_chain ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!EXPORT ssl_key = # hidden, use -P to show it ssl_protocols = !SSLv3 !SSLv2 syslog_facility = local6 userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap } protocol lmtp { mail_plugins = acl zlib mail_log notify sieve } protocol imap { mail_max_userip_connections = 100 mail_plugins = acl zlib mail_log notify imap_zlib imap_acl } Any help is appreciated. Many Thanks & best regards Thomas

1 0

Still trouble with vpopmail
by Bobber 31 May '17

31 May '17

Getting this error: > In file included from ../../src/lib/lib.h:6:0, > from auth-common.h:4, > from userdb-vpopmail.c:5: > ../../config.h:791:0: note: this is the location of the previous > definition > #define VERSION "2.2.30" > ^ > userdb-vpopmail.c: In function ‘userdb_vpopmail_get_quota’: > userdb-vpopmail.c:72:6: error: too many arguments to function ‘var_expand’ > if (var_expand(quota, template, tab, error_r) < 0) > ^ > In file included from auth-request.h:5:0, > from userdb.h:89, > from userdb-vpopmail.c:6: > ../../src/lib/var-expand.h:18:6: note: declared here > void var_expand(string_t *dest, const char *str, > ^ > userdb-vpopmail.c:72:2: error: void value not ignored as it ought to be > if (var_expand(quota, template, tab, error_r) < 0) -- *Bob Wooldridge* Blog: http://kc0dxf.net/blog/

3 3

Re: v2.2.30 released
by Joseph Tam 31 May '17

31 May '17

Timo Sirainen announced > + If dovecot.index.cache corruption is detected, reset only the one > corrupted mail instead of the whole file. Is this a big performance win? I still have users with jumbo mailboxes who insist on direct mailbox file access using procmail or mail readers, which trigger index rebuilds when dovecot accesses them. Joseph Tam <jtam.home(a)gmail.com>

2 1

mailserver.users does not exist
by Amaechi Janneh 31 May '17

31 May '17

Hello. It appears that I have an issue with my dovecot setup. When trying to authenticate, i get this error: May 28 20:18:26 AmaechiJ dovecot[10516]: imap-login: Login: user=< aj(a)example.com>, method=PLAIN, rip=, lip=, mpid=10879, TLS, ses...QOQBg9rlR> May 28 20:18:42 AmaechiJ dovecot[10516]: imap(aj(a)example.com): Connection closed in=116 out=1311 May 28 20:20:32 AmaechiJ dovecot[10516]: auth-worker(10892): Warning: mysql: Query failed, retrying: Table 'mailserver.users' doesn't exist May 28 20:20:32 AmaechiJ dovecot[10516]: auth-worker(10892): Error: sql( aj(a)example.com,) User query failed: Table 'mailserver.users' doesn't exist May 28 20:20:32 AmaechiJ dovecot[10516]: imap-login: Login: user=< aj(a)example.com>, method=PLAIN, rip=, lip=, mpid=10894, TLS, ses...QZwBg9rlR> But I already have the users data under virtual_users. So what should I do? Regards, Amaechi Janneh

2 1

Re: SSL problem - no banner
by Joseph Tam 30 May '17

30 May '17

Marcio Merlone <marcio.merlone(a)a1.ind.br> writes: > Only openssl s_client -connect localhost:993 works fine and fast, while > all MUA's and telnet does not. Telnet timeouts waiting for banner after > a minute or so: > > root@netuno:~# openssl s_client -connect localhost:993 > ... > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready. > ... > root@netuno:~# telnet localhost 993 > Trying 127.0.0.1... > Connected to localhost. > Escape character is '^]'. > (about 1 minute later...) > Connection closed by foreign host. You misundertand how SSL (or TLS) vs STARTTLS works. SSL/TLS (on port 993) starts negotiating a secure session protocol right after connection, which involves binary exchange of data, certificates, etc.. This is what "openssl s_client ..." does, but telnet does not. Only after the SSL handshake completes will you get banners, etc. STARTTLS starts out as a unencrypted session and thus, you'll get the initial banner. The client is then expected to initiate a secure session by issuing a STARTTLS directive, whereupon client and server starts the secure session negotiation like above. To test this, you would use openssl s_client -starttls imap -connect localhost:143 So telnet doesn't work because it does not do SSL. Your MUA don't work because of the same misunderstanding, or there's some network issue at play. You need to align your clients to use the security protocol you've enabled. Joseph Tam <jtam.home(a)gmail.com>

1 0

Fatal error with IMAP MOVE from a shared mailbox to Trash folder
by Daniele Barresi 30 May '17

30 May '17

Hello everyone. I have a problem using Dovecot 2.2.26 with ACL plugin and deleting e-mails from a shared mailbox. My user doesn't have the "expunge" permission on the shared mailbox, but it has the "write-deleted" permission. So, when I delete a message from the shared mailbox using a client that implements the IMAP MOVE command, it tries to move the message to my Trash folder. Then the server closes the connection to the client (process aborted) and I get three lines in the log file with a backtrace and "Fatal" error. In this case the message doesn't get copied or moved from the shared folder and the client complaints. I found the same thing happens whenever I try to move anything between folders of the shared mailbox itself, while logged in with my user. I can move messages inside my own mailbox just fine. If I try the same operation from a client that uses the IMAP COPY + DELETE commands, no errors are logged and the outcome is as expected: the message gets copied from the shared folder to my Trash and gets the flag "\Deleted" set on the shared folder. My setup is as follows: Dovecot: 2.2.26.0 OS: Ubuntu 16.04.1 LTS CPU architecture: x86_64 Filesystem: ext4 The relevant lines from mail.err log: Dec 27 15:21:18 dovecot dovecot: imap(danielebarresi): Panic: file mail-storage.c: line 2143 (mailbox_save_context_reset): assertion failed: (ctx->copying_via_save) Dec 27 15:21:18 dovecot dovecot: imap(danielebarresi): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x9438e) [0x7fbcd478538e] -> /usr/lib/dovecot/libdovecot.so.0(+0x9447c) [0x7fbcd478547c] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbcd471ea4e] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x41b78) [0x7fbcd4a50b78] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x73) [0x7fbcd4a53d73] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so(+0xe142) [0x7fbcd3f1d142] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x4516d) [0x7fbcd4a5416d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_move+0x23) [0x7fbcd4a54333] -> dovecot/imap(+0xf9c5) [0x557cf98629c5] -> dovecot/imap(command_exec+0xa6) [0x557cf986f196] -> dovecot/imap(+0x1a4c2) [0x557cf986d4c2] -> dovecot/imap(+0x1a550) [0x557cf986d550] -> dovecot/imap(client_handle_input+0x195) [0x557cf986d915] -> dovecot/imap(client_input+0x85) [0x557cf986de25] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7fbcd4799bdc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x10a) [0x7fbcd479b09a] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7fbcd4799c65] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fbcd4799e08] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fbcd4724f53] -> dovecot/imap(main+0x322) [0x557cf9860ca2] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7fbcd4348830] -> dovecot/imap(+0xde1f) [0x557cf9860e1f] Dec 27 15:21:18 dovecot dovecot: imap(danielebarresi): Fatal: master: service(imap): child 6907 killed with signal 6 (core dumped) Dovecot configuration (doveadm -n): # 2.2.26.0 (23d1de6): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.4.0-57-generic x86_64 Ubuntu 16.04.1 LTS auth_cache_negative_ttl = 10 mins auth_cache_size = 2 M auth_master_user_separator = * auth_mechanisms = plain login first_valid_uid = 12 last_valid_uid = 12 mail_location = maildir:~/Maildir mail_plugins = acl quota notify mail_log stats lazy_expunge managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace casellecondivise { list = children location = maildir:%%h/Maildir:INDEXPVT=~/Maildir/shared/%%u prefix = Caselle condivise/%%u/ separator = / subscriptions = no type = shared } namespace expunged { hidden = yes list = no location = maildir:/var/expunged/%n/Expunged prefix = EXPUNGED/ separator = / } namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/etc/dovecot/shared/shared-mailboxes lazy_expunge = EXPUNGED/ lazy_expunge_only_last_instance = yes mail_log_events = delete copy flag_change save undelete expunge mail_log_fields = uid box msgid size quota = maildir:user quota quota_exceeded_message = (Quota exceeded) La casella di posta elettronica del destinatario è piena. quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=100%% quota-warning 100 %u sieve = file:~/sieve;active=~/.dovecot.sieve stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 32 M stats_refresh = 30 secs stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours } protocols = " imap sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = mail mode = 0666 user = postfix } unix_listener auth-userdb { group = mail user = mail } } service dict { unix_listener dict { group = mail mode = 0600 user = mail } } service imap-login { process_limit = 300 process_min_avail = 2 } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /etc/dovecot/scripts/quota-warning.sh unix_listener quota-warning { group = mail user = mail } } service stats { fifo_listener stats-mail { mode = 0600 user = mail } } ssl = required ssl_cert = </etc/ssl/certs/pac.apg23.org.pem ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-sql.conf.ext default_fields = uid=mail gid=mail home=/var/mail/%u master_user=%u driver = sql } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext default_fields = uid=mail gid=mail home=/var/mail/%u master_user=%u driver = ldap } protocol lda { mail_plugins = acl quota notify mail_log stats lazy_expunge sieve } protocol imap { mail_max_userip_connections = 25 mail_plugins = acl quota notify mail_log stats lazy_expunge imap_quota imap_stats } I tested this with different users with the same result. I tested and reproduced the error with Thunderbird and Roundcube. The Apple Mail client uses IMAP COPY + DELETE, instead of IMAP MOVE, and no errors are reported. So I think it's related to the IMAP MOVE implementation on Dovecot server. Has anyone seen the same error? Any suggestions? Is this a Dovecot bug? --- Daniele Barresi

3 4

virtual folder: how to store in mysql?
by dovecot＠avv.solutions 30 May '17

30 May '17

Hello Community, Now that virtual folders seem to work fine, I stil lhave 2 questions : 1° Is it possible to store the virtual folder definition (aka content of Folder/dovecot-virtual) in mysql? 2° I have duplicates in my "Unseen", which both correctly disappear once handled one of them Example: !Inbox * -Inbox (tried this but does not succeed -Trash -Trash/* Public/* Unseen 2°bis :) I tried to put the "common defs" in a shared folder (/etc/dovecot/virtual) using personal index location = virtual:/etc/dovecot/virtual:INDEX=/sd/MAIL_IMAP_POP/%d/%n/__Virtual/ This does not work, I have to *copy* (even symlinks do not succeed) the definitions and use location = virtual:/sd/MAIL_IMAP_POP/%d/%n/__Virtual:INDEX=/sd/MAIL_IMAP_POP/%d/%n/__Virtual/ I already tried to set perms on /etc/dovecot/virtual to: vmail.vmail rw(x)------ Thank you! Cheers

1 0

Question about how to serve many imap users on some mailbox.
by Oleksandr Lystopad 30 May '17

30 May '17

Hi, dear dovecot users! I am running 2.2.29.1 (e0b76e3) on FreeBSD. In my case, one mailbox info(a)example.com is shared between 5-10 managers. Sometimes they complains that no new messages displayed in folder message count list in brackets (bold number if new messages exists), but when they click on the imap folder (for example Inbox) they could see many new mails. There not only Inbox folder, they have 10-30 folders with quite big flow of new messages. Almost all users are using Microsoft Outlook MUA. Please, help me to solve the issue. My config could be found bellow (dovecot -n): auth_failure_delay = 12 secs auth_mechanisms = login cram-md5 plain auth_verbose = yes disable_plaintext_auth = no first_valid_gid = 26 first_valid_uid = 26 lda_mailbox_autocreate = yes listen = * login_greeting = imap/pop mailserver ready mail_location = maildir:~/Maildir mail_max_userip_connections = 50 mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf driver = sql } protocols = pop3 imap sieve service auth { unix_listener auth-client { group = mailnull mode = 0600 user = mailnull } unix_listener auth-login { group = mailnull mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mailnull mode = 0600 user = mailnull } unix_listener auth-userdb { group = mailnull mode = 0600 user = mailnull } user = root } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 } } service imap { process_limit = 512 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 } } service pop3 { process_limit = 512 } ssl_cert = </usr/local/etc/SSL/my.crt ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep } protocol lda { mail_plugins = sieve }

2 1

MySQL issue
by Amaechi Janneh 30 May '17

30 May '17

Hello. It appears that I have an issue with my dovecot setup. When trying to authenticate, i get this error: May 28 20:18:26 AmaechiJ dovecot[10516]: imap-login: Login: user=< aj(a)example.com>, method=PLAIN, rip=, lip=, mpid=10879, TLS, ses...QOQBg9rlR> May 28 20:18:42 AmaechiJ dovecot[10516]: imap(aj(a)example.com): Connection closed in=116 out=1311 May 28 20:20:32 AmaechiJ dovecot[10516]: auth-worker(10892): Warning: mysql: Query failed, retrying: Table 'mailserver.users' doesn't exist May 28 20:20:32 AmaechiJ dovecot[10516]: auth-worker(10892): Error: sql( aj(a)example.com,) User query failed: Table 'mailserver.users' doesn't exist May 28 20:20:32 AmaechiJ dovecot[10516]: imap-login: Login: user=< aj(a)example.com>, method=PLAIN, rip=, lip=, mpid=10894, TLS, ses...QZwBg9rlR> But I already have the users data under virtual_users. So what should I do? Regards, Amaechi Janneh I am running dovecot 2.2.13 Debian 8

3 4