- dovecot - dovecot.org

[Dovecot] lmtp-proxying in 2.1 slower than in 2.0.14 ?
by Jan-Frode Myklebust 05 Feb '13

05 Feb '13

We upgraded our two dovecot directors from v2.0.14 to dovecot-ee 2.1.10.3 this week, and after that mail seems to be flowing a lot slower than before. The backend mailstores are untouched, on v2.0.14 still. After the upgrade we've been hitting process_limit for lmtp a lot, and we're struggeling with large queues in the incoming mailservers that are using LMTP virtual transport towards our two directors. I seem to remember 2.1 should have a new lmtp-proxying code. Is there anything in this that maybe needs to be tuned that's different from v2.0 ? I'm a bit scheptical to just increasing the process_limit for LMTP proxying, as I doubt running many hundreds of simultaneous deliveries should work that much better against the backend storage.. ###### doveconf -n ########## # 2.1.10.3: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-194.32.1.el5 x86_64 Red Hat Enterprise Linux Server release 5.5 (Tikanga) default_client_limit = 4000 director_mail_servers = 192.168.42.7 192.168.42.8 192.168.42.9 192.168.42.10 192.168.42.28 192.168.42.29 director_servers = 192.168.42.15 192.168.42.17 disable_plaintext_auth = no listen = * lmtp_proxy = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = proxy=y nopassword=y driver = static } protocols = imap pop3 lmtp sieve service anvil { client_limit = 6247 } service auth { client_limit = 8292 unix_listener auth-userdb { user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 5515 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director process_limit = 4096 process_min_avail = 4 service_count = 0 vsz_limit = 256 M } service lmtp { inet_listener lmtp { address = * port = 24 } process_limit = 100 } service managesieve-login { executable = managesieve-login director inet_listener sieve { address = * port = 4190 } process_limit = 50 } service pop3-login { executable = pop3-login director process_limit = 2048 process_min_avail = 4 service_count = 0 vsz_limit = 256 M } ssl_cert = </etc/pki/tls/certs/pop.example.com.cert.ca-bundle ssl_key = </etc/pki/tls/private/pop.example.com.key protocol lmtp { auth_socket_path = director-userdb } ################ -jf

2 5

[Dovecot] dsync-local(user): Error: proxy client timed out
by Metro Domain Admin 05 Feb '13

05 Feb '13

Hello, I have an intermittent but frequent problem using dsync backup. The command outputs: dsync-local(user): Error: proxy client timed out Then dies with exit code 75. Any subsequent attempts to re-run the backup invariably fail like this: dsync-local(user): Warning: Destination mailbox INBOX has been modified, need to recreate it before we can continue syncing dsync-local(user): Error: read() from worker server failed: EOF dsync-local(user): Error: msg-copy returned invalid input: dsync-local(user): Error: remote: dsync-remote(user(a)domain.com): Error: Can't delete mailbox INBOX: INBOX can't be deleted. dsync-remote(l_user(a)domain.com): Error: command MSG-SAVE failed dsync-local(user): Warning: Mailbox changes caused a desync. You may want to run dsync again. The syntax I am using is: dsync -u $user backup \ ssh -i <idfile> <user@host> \ dsync -u l_$user We have this running in a script that loops through all users. The error happens mostly on the larger mailboxes but I've seen it succeed on the largest ones then fail on smaller. One mid-sized account now fails consistently. The backup is running from a Mac OS PPC server running 2.1.12 The target is a Linux Intel box running 2.1.13, but I had the same problem sending to a Mac OS Intel on 2.1.12. Mdbox in all cases. Thanks, Tony

2 1

[Dovecot] METADATA / ANNOTATE extensions
by list＠airstreamcomm.net 05 Feb '13

05 Feb '13

According to the roadmap http://wiki2.dovecot.org/Roadmap implementation of the METADATA / ANNOTATE extensions is fairly high on the list. I was just curious if there is a target release in mind for this functionality?

2 1

[Dovecot] Overloading IMAP Server
by Harford, Ken 04 Feb '13

04 Feb '13

Hi All, I am having an issue with dovecot IMAP reading and writing to one specific mailbox. I have a check email delivery script that sends out a email and then logs into dovecot to check if the mailbox that the message has been delivered to. However, the servers that send these messages send them in bunches depending on how many postfix spools it is checking. So I could get 60 messages all being sent to 1 mailbox and then having to read that same mailbox to check if the message actually got delivered. I am using postfix as the MTA and dovecot is actually delivering the message to the mailbox I am getting a lot of errors such as the following: Could not connect to IMAP server imap failed: IMAP RECEIVE CRITICAL - Could not select INBOX Any ideas as to what I can tweak in dovecot to allow these messages to be verified. Thanks for any information or help you could provide!! Ken

3 5

[Dovecot] cmsg cancel <keh8l6$3c9$1@de-l.enfer-du-nord.net>
by Michael Grimm 01 Feb '13

01 Feb '13

ignore Article cancelled by slrn 1.0.1

1 0

[Dovecot] Reviewing end-user ham/spam submissions before feeding them to sa-learn via Dovecot Antispam plug-in
by Ben Johnson 01 Feb '13

01 Feb '13

Currently, I'm using the Dovecot Antispam plug-in with great success. Everything works as expected. However, I would like to change the plug-in's behavior such that it simply sends a copy of a message that is moved from Inbox -> Junk (or Junk -> Inbox) to an administrator, instead of calling sa-learn (I'm using SpamAssassin) automatically. Basically, I would like to be able to review messages that end-users submit for training before they are actually fed to sa-learn. Has anyone had a similar need? If the Antispam plug-in already supports this, if the necessary commands can simply be added to the shell script that Antispam calls, or if there is a better method altogether, any help is greatly appreciated. Thank you! -Ben

2 4

[Dovecot] Dovecot Director Doveadm fails when there are a lot of output information
by Ramon Frontera 31 Jan '13

31 Jan '13

Hi, we are running dovecot 2.1.13 We have 2 proxies with director and 4 mail servers. we use LDAP when we execute doveadm-quota -A and doveadm with few output lines, its works fine. When we use doveadm-search or doveadm-mailbox with a lot of output information the command stops the execution and the command no ends. The connection to one of the 4 mailserver has finished at this moment. I have made some tests and i have found that if we use only one mailserver the commands works fine. I put the gdm bt output hope it help you. (the proxy thats executes the command) (gdb) bt full #0 0x0000003872ee86f3 in __epoll_wait_nocancel () from /lib64/libc.so.6 No symbol table info available. #1 0x0000003873a534b8 in io_loop_handler_run (ioloop=0x2364120) at ioloop-epoll.c:181 ctx = 0x236b080 events = <value optimized out> event = <value optimized out> list = <value optimized out> io = <value optimized out> tv = {tv_sec = 59, tv_usec = 389208} msecs = 59390 ret = <value optimized out> i = <value optimized out> call = <value optimized out> #2 0x0000003873a52488 in io_loop_run (ioloop=0x2364120) at ioloop.c:398 No locals. #3 0x0000003873a3de43 in master_service_run (service=0x2363fd0, callback=<value optimized out>) at master-service.c:544 No locals. #4 0x0000000000413d6e in doveadm_server_flush_one () No symbol table info available. #5 0x0000000000414741 in doveadm_mail_server_user () No symbol table info available. ---Type <return> to continue, or q <return> to quit--- #6 0x000000000040e6bc in doveadm_mail_next_user () No symbol table info available. #7 0x000000000040ed7c in doveadm_mail_cmd () No symbol table info available. #8 0x000000000040f00c in doveadm_mail_try_run () No symbol table info available. #9 0x00000000004162b1 in main () No symbol table info available. Thanks in advance! -- ------------------------------------------ Ramon Frontera Universitat de les Illes Balears

1 0

[Dovecot] Dovecot 2.2.beta1 errors
by Andreas Kasenides 31 Jan '13

31 Jan '13

From the command >doveadm log errors we get > Jan 31 15:41:12 imap(xxxx): Panic: Buffer full (8221 > 8192, pool > <none>) Jan 31 15:41:12 imap(xxxx): Error: Raw backtrace: > /usr/local/lib/dovecot/libdovecot.so.0(+0x5b83a) [0x7ffbaa3a783a] -> > /usr/local/lib/dovecot/libdovecot.so.0(+0x5b886) [0x7ffbaa3a7886] -> > /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7ffbaa36adaf] -> > /usr/local/lib/dovecot/libdovecot.so.0(+0x57cfc) [0x7ffbaa3a3cfc] -> > /usr/local/lib/dovecot/libdovecot.so.0(+0x5134f) [0x7ffbaa39d34f] -> > /usr/local/lib/dovecot/libdovecot.so.0(+0x4a02d) [0x7ffbaa39602d] -> > /usr/local/lib/dovecot/libdovecot.so.0(+0x4a0ca) [0x7ffbaa3960ca] -> > /usr/local/lib/dovecot/libdovecot.so.0(i_stream_read+0x64) > [0x7ffbaa3af924] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x6844c) > [0x7ffbaa3b444c] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x685f1) > [0x7ffbaa3b45f1] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x686d0) > [0x7ffbaa3b46d0] -> > /usr/local/lib/dovecot/libdovecot.so.0(i_stream_read+0x64) > [0x7ffbaa3af924] -> > /usr/local/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x52) > [0x7ffbaa3afc32] -> > /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x987ba) > [0x7ffbaa69a7ba] -> > /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_binary_stream+0x135) > [0x7ffbaa69ac45] -> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_get_binary_stream+0x61) > [0x7ffbaa674481] -> > /usr/local/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0xb0) > [0x7ffbaa6cf980] -> dovecot/imap() [0x418619] -> dovecot/imap() > [0x4166e2] -> dovecot/imap(imap_fetch_more+0x31) [0x416911] -> > dovecot/imap(cmd_fetch+0x41f) [0x40cd9f] -> > dovecot/imap(command_exec+0x3d) [0x414e2d] -> dovecot/imap() > [0x41402e] -> dovecot/imap(client_handle_input+0x11d) [0x41431d] -> > dovecot/imap(client_input+0x6f) [0x41468f] -> > /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) > [0x7ffbaa3b5fe6] -> > /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) > [0x7ffbaa3b7027] -> > /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) > [0x7ffbaa3b5f88] Jan 31 15:41:12 imap(xxxx): Fatal: master: > service(imap): child 2236 killed with signal 6 (core dumped) where xxxx is the offending user name. The error repeats at random intervals, I guess related to the activity. Since we are using Horde 5 on the front end we get the following errors from it: > Jan 31 15:02:59 thalia HORDE: [imp] Mail server closed the connection > unexpectedly. [pid 6402 on line 390 of > "/sys-data/WebData/horde/imp/lib/Imap.php"] Jan 31 15:02:59 thalia > HORDE: [imp] Operation failed due to a lack of a secure connection. > [pid 6402 on line 390 of "/sys-data/WebData/horde/imp/lib/Imap.php"] > Jan 31 15:02:59 thalia HORDE: [imp] Operation failed due to a lack of > a secure connection. [pid 6402 on line 390 of > "/sys-data/WebData/horde/imp/lib/Imap.php"] Jan 31 15:02:59 thalia > HORDE: [imp] Operation failed due to a lack of a secure connection. > [pid 6402 on line 94 of > "/sys-data/WebData/horde/imp/lib/Imap/Exception.php"] We believe these are related to the above Dovecot error since they happens together. Is this a Dovecot problem? Config attached. Thanx -- Andreas Kasenides Senior IT Officer Dept. of Computer Science, University of Cyprus Tel: 22892714, Fax: 22892701

2 1

[Dovecot] sieve_max_redirects=0 not working as documented
by Arnaud Abélard 31 Jan '13

31 Jan '13

Hello I'm trying to keep my users from using the "redirect" action with pigeonhole from dovecot 2.0.21. As documented in http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration I configured sieve like this: plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_max_redirects = 0 } (and doveconf indeed shows the new setting for sieve_max_redirects) Unfortunately I can still use the redirect action: lda(dummy(a)univ-nantes.fr): Debug: sieve: executing script from /vmail/d/u/dummy/.dovecot.svbin lda(dummy(a)univ-nantes.fr): sieve: msgid=<510A758D.1030305(a)univ-nantes.fr>: forwarded to <xxxx(a)xxxxx.com> what could I have missed? Thanks, Arnaud -- Arnaud Abélard (jabber: arnaud.abelard(a)univ-nantes.fr) Administrateur Système - Responsable Services Web Direction des Systèmes d'Informations Université de Nantes - ne pas utiliser: trapemail(a)univ-nantes.fr

2 1

[Dovecot] Cleanups in HG f11ae64365b5 break Authentication
by Thomas Leuxner 31 Jan '13

31 Jan '13

==> /var/log/dovecot/dovecot.log <== Jan 30 19:57:51 spectre dovecot: master: Warning: SIGHUP received - reloading configuration Jan 30 19:58:48 spectre dovecot: imap-login: Login: user=<tlx(a)leuxner.net>, method=PLAIN, rip=1.2.3.4, lip=5.6.7.8, mpid=15572, TLS, session=<o4WxGYbUsQBeT5Qc> Jan 30 19:58:48 spectre dovecot: imap(tlx(a)leuxner.netuid=5000): Error: user tlx(a)leuxner.netuid=5000: Couldn't drop privileges: User is missing UID (see mail_uid setting) Jan 30 19:58:48 spectre dovecot: imap(tlx(a)leuxner.netuid=5000): Error: Internal error occurred. Refer to server log for more information.

2 2