- dovecot - dovecot.org

[Dovecot] Segfault with passwd as a second userdb at auth_fields_rollback
by Jan Kończak 11 May '14

11 May '14

Hello, I've been trying to set up dovecot to support passwd-file + passwd/PAM auth. I made an unusual config (passwd-file as userdb failed to work for me), which uses static as userdb: =============== passdb { driver = passwd-file args = username_format=%u scheme=CRYPT /etc/dovecot/users } userdb { driver = static default_fields = uid=vmail gid=vmail home=/var/spool/mail/%d/%n } passdb { driver = pam } userdb { driver = passwd } =============== While passwd-file+static worked well, passwd/PAM caused trouble: $ doveadm user xxx doveadm(root): Error: userdb lookup(xxx): Disconnected unexpectedly field value If passwd-file had the user, check went fine; otherwise it segfaulted. The crash has been accompanied by a syslog message: kernel: auth[9788]: segfault at 18 ip 0000000000416391 sp 00007fffd11a3d90 error 4 in auth[400000+44000] Translating address lead me to: 0000000000416390 <auth_fields_rollback>: 416390: 53 push %rbx 416391: 48 83 7f 18 00 cmpq $0x0,0x18(%rdi) I was using packages from http://packages.atrpms.net/dist/el6/dovecot/ To be precise, dovecot-2.2.10-1_14.el6.x86_64.rpm I tampered with the src.rpm, upgraded spec&sources to match 2.2.12. It didn't help, so I tries to "workaround" this. The bug has gone when in src/auth/auth-fields.c:210 I added check if the field ptr is not null. As it's a userdb query, it seems that for some reason (static?) in src/auth/auth-request.c:1058 the function auth_fields_rollback is called with null request->userdb_reply Now it works fine: $ doveadm user xxx field value uid 1000 gid 100 home /home/xxx mail maildir:~/.maildir system_groups_user xxx $ doveadm user jkonczak@ast... field value uid 103 gid 103 home /var/spool/mail/ast.../jkonczak mail maildir:~/.maildir So now virtual users get vmail uid/gid, system users get their uid/gid, home is fine etc. Below I attach the patch + full config. Regards, Jan Kończak =============================================== $ cat SOURCES/dovecot-2.2.12-auth_fields_rollback-nullptr_check.patch --- src/auth/auth-fields.c.orig 2014-05-11 16:17:49.755258666 +0200 +++ src/auth/auth-fields.c 2014-05-11 16:18:24.704946586 +0200 @@ -207,6 +207,7 @@ void auth_fields_rollback(struct auth_fields *fields) { + if (fields==NULL) return; if (array_is_created(&fields->snapshot_fields)) { array_clear(&fields->fields); array_append_array(&fields->fields, &fields->snapshot_fields); =============================================== $ dovecot --version 2.2.12 $ doveconf # passdb/userdb/auth related passdb { args = username_format=%u scheme=CRYPT /etc/dovecot/users default_fields = deny = no driver = passwd-file master = no override_fields = pass = no result_failure = continue result_internalfail = continue result_success = return-ok skip = never } passdb { args = default_fields = deny = no driver = pam master = no override_fields = pass = no result_failure = continue result_internalfail = continue result_success = return-ok skip = never } service auth { chroot = client_limit = 0 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-client { group = mode = 0600 user = $default_internal_user } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = mode = 0666 user = $default_internal_user } unix_listener login/login { group = mode = 0666 user = } unix_listener token-login/tokenlogin { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } userdb { args = default_fields = uid=vmail gid=vmail home=/var/spool/mail/%d/%n driver = static override_fields = result_failure = continue result_internalfail = continue result_success = return-ok skip = never } userdb { args = default_fields = driver = passwd override_fields = result_failure = continue result_internalfail = continue result_success = return-ok skip = never } ===============================================

2 1

[Dovecot] "doveadm penalty -a" doesn't work?
by Peer Heinlein 11 May '14

11 May '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 We're running multiple instances on the same server. While doveadm penalty works: root@host:/etc/dovecot# doveadm penalty IP penalty last_penalty last_update 93.180.xxx.xxx 4 2014-05-10 12:21:08 12:21:08 80.153.xxx.xxx 0 2014-05-10 12:21:12 12:21:12 a seperate anvil-Socket doesn't work at all: root@host:/etc/dovecot# doveadm penalty -a /var/run/dovecot-example/anvil doveadm penalty [-a <anvil socket path>] [<ip/bits>] It just shows up the help message. (Dovecot 2.2.12) Peer - -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBAgAGBQJTbf41AAoJEAOLLpq5E82H/h4H/2VpFfrqG+dcW73dS8CAWXVM thWcj5/GKUDaE/MYKsATDmNenlPuKIHsC8+hM7pyB3kfA0d7EDP/aNcaOWdw16XE fq7PSoLWiPJcsTG6ArzyuJMYiCwb2TuFIimFjjlZWVqnB+iAVv0y7ESJ9De/dmzM eE3ct/JmuY+0MrRAKSNdDX/Dbaakh03/JQ3/GvAwYeTFgviCfa3D5hsYCfhDZbPC 2vE3A9D46SqhmrediuWdtnj6rAhYwfjS+77jXaK6NyYru0WtYf9ozgtt5pbb89Hd EKzdNyKdKsZEnQ1ubv7cj5671OwL1ikp/d8tJr3/l4tgRHWf2+BmuGJIoo8AFwE= =2gZD -----END PGP SIGNATURE-----

2 1

[Dovecot] ECDSA certificate support
by SIW 11 May '14

11 May '14

Does the latest version of Dovecot support ECDSA certificates? I had a look in: http://wiki2.dovecot.org/SSL but it didn't answer my question. Can someone please help or point me in the right direction? I'd also like to know if I can run an RSA cert AND an ECDSA certificate at the same time in Dovecot (like you can in Postfix). Many thanks.

1 0

[Dovecot] LDA can't read dovecot.conf
by Hit4er 11 May '14

11 May '14

Hi, i have a problem with lda with this error what i doing wrong? -- View this message in context: http://dovecot.2317879.n4.nabble.com/LDA-can-t-read-dovecot-conf-tp47853.ht… Sent from the Dovecot mailing list archive at Nabble.com.

4 5

[Dovecot] dovecot 2.2.9 - ssl_cert and ssl_key ignored
by Alexandru Bostina 11 May '14

11 May '14

Hello, It seems that Dovecot ignores the new /ssl_cert and ssl_key /settings. Using them in the dovecot configuration results in the error: Fatal: Couldn't parse private ssl_key: error:0906D06C:PEM routines:PEM_read_bio:no start line: Expecting: ANY PRIVATE KEY] Using the old /ssl_//cert//_file/ and /ssl_key_file/ results in their being obsolete warning but no fatal error.

3 4

[Dovecot] Only part of sieve script works
by Sebastian Schlingmann 10 May '14

10 May '14

Hi, I am using Dovecot 2.2.11 with Pigeonhole on Arch Linux. I have a partly working sieve script (pasted to the end of this mail) which sorts mail into various imap folders. The first, third and fourth if blocks work just fine. The second and fifth block do not sort any mails. However, if I apply the script with sieve-test to mails the second and fifth block seem to work. How is the manual check with sieve-test different from the sieve filtering during mail delivery? I am thankful for any hints. Sebastian this is the sieve script I am talking about require "fileinto"; # Musik wegsortieren if anyof ( header :comparator "i;ascii-casemap" :contains "Subject" "Mixing.DJ", header :comparator "i;ascii-casemap" :contains "Subject" "John B", header :comparator "i;ascii-casemap" :contains "Subject" "FLOSS Weekly", header :comparator "i;ascii-casemap" :contains "Subject" "BrainStuff", header :comparator "i;ascii-casemap" :contains "Subject" "Nerdy Show", header :comparator "i;ascii-casemap" :contains "Subject" ["My Brother", " My Brother And Me"], header :comparator "i;ascii-casemap" :contains "Subject" "MoJoMenace", header :comparator "i;ascii-casemap" :contains "Subject" "GWJ Conference Call", header :comparator "i;ascii-casemap" :contains "Subject" "Welcome to Night Vale", header :comparator "i;ascii-casemap" :contains "Subject" "International Waters" ) { fileinto "Feeds.music"; stop; } # Youtube wegsortieren if address :all :comparator "i;ascii-casemap" :contains "From" "noreply(a)youtube.com" { fileinto "Feeds.Youtube"; stop; } # Awesomer wegsortieren if header :comparator "i;octet" :contains "Subject" "[The Awesomer]" { fileinto "Feeds.Awesomer"; stop; } # Feeds sortieren if address :all :comparator "i;octet" :contains "From" "sebi+feedmailer(a)mighty.selfhost.bz" { fileinto "Feeds"; stop; } # AIStA wegsortieren if header :comparator "i;ascii-casemap" :contains "Received" "webmail.awista.net" { fileinto "AIStA"; stop; }

2 1

[Dovecot] Denial of Service attacks against Dovecot v1.1+
by Timo Sirainen 10 May '14

10 May '14

There's an upper limit to how many IMAP/POP3 connections can exist that haven't logged in (and separate limits for post-login). Normally when this limit is reached, the oldest connection gets disconnected. There is of course some potential to try to DoS Dovecot by doing a lot of IMAP/POP3 connections, but because the oldest connection always gets destroyed this requires quite a lot of activity from the attacker. This "destroy oldest connection" however hasn't been working in v1.1+ releases for connections that have started SSL/TLS handshake, but haven't finished it. So an attacker could just do a bunch of TCP connections to port 993 and leave them hanging around and Dovecot would pretty quickly reach the upper limit without being able to disconnect any of the oldest connections. Here are patches to fix this: http://hg.dovecot.org/dovecot-2.2/rev/41622541a7a3 http://hg.dovecot.org/dovecot-2.1/rev/b7ac23b4d339 http://hg.dovecot.org/dovecot-2.0/rev/48f90e7e92dc http://hg.dovecot.org/dovecot-1.2/rev/8ba4253adc9b http://hg.dovecot.org/dovecot-1.1/rev/fe0e6550585c The fix will be in v2.2.13. Maybe also in v2.1.18 if I decide to release it. For older releases you need to patch it yourself. For people who are using dovecot-ee releases the fix is also in v2.2.12.12 and v2.1.7.7 releases.

3 2

[Dovecot] Strange behavior on with "listescape" and "lda_mailbox_autocreate" - double entries
by Patrick De Zordo 09 May '14

09 May '14

Hello Guys, we are using Dovecot since years; all working flawless but one strange behavior: Let me explain.. - we have enabled the "listescape" plugin in "15-lda.conf", "10-mail.conf" and "20-imap.conf". - we use the following default namespace in "10-mail.conf": --------------- 10-mail.conf ----------------------------------------- namespace { type = private prefix = separator = / inbox = yes subscriptions = yes } ---------------------------------------------------------------------------------------- - we use a sieve script that automatically generates folders in the following form (example): ---------------------------------------------------------------------------------------- ".INBOX.2014.05.patrick.incoming" for user "patrick(a)xx.com" ".INBOX.2014.05.patrick.outgoing" for user "patrick(a)xx.com" ".INBOX.2014.05.p\2edezordo.incoming" for user "p.dezordo(a)xx.com" ---------------------------------------------------------------------------------------- This is ok, but the automatically generated "subscriptions"-file of the user contains double lines (the second line is something strange?!); the second one should not be created, its totally wrong..! --------------- subscriptions ----------------------------------------- Trash Sent INBOX.2014.05.patrick.incoming INBOX.2014.05.patrick.outgoing INBOX.2014.05.p\2edezordo.incoming INBOX\2e2014\2e05\2ep\5c2edezordo\2eincoming <----- this line!?!?!? ---------------------------------------------------------------------------------------- Have you any ideas whats going on? Could this be a bug, or misconfiguration? Thanks in advance!! Greeting from Italy! Patrick.

2 6

[Dovecot] Disable IMAP for ONE user only
by SIW 09 May '14

09 May '14

I use MySQL to store my virtual users passwords and I am running the latest version of Dovecot. What I need to do is have one particular user have ONLY access to their email via Roundcube (webmail) and no IMAP/SMTP access. Therefore, how do I disable IMAP/SMTP access for just one user?

8 23

[Dovecot] Lifetime of redirect info stored by Sieve in .dovecot.lda-dupes
by Axel Luttgens 09 May '14

09 May '14

Hello, A quick question. How long are the Message-ID and recipient of forwarded messages (thru the redirect action) kept in .dovecot.lda-dupes? According to the code, it could be 24 hours; am I right? TIA, Axel

2 6

[Dovecot] Migrate from LDA to LMTP
by Davide 09 May '14

09 May '14

Hi to all, i have qmail installed on my system with dot-qmail files format to deliver to mailbox (maildir format with dovecot 2.2.12); currently i use LDA to delivery agent but we would migrate to LMTP is it possible? and if yes someone could bring me to the right direction to implement this? thanks. -- *Davide Marchi* *T*eorema *F*errara *Srl* Via Spronello, 7 - Ferrara - 44121 Tel. *0532783161* Fax. *0532783368* E-m@il: *davide.marchi(a)mail.cgilfe.it* Skype: *davide.marchi73* Web: *http://www.cgilfe.it* *CONFIDENZIALITA'* *Ai sensi del D.Lgs. 196/2003 si precisa che le informazioni contenute in questo messaggio sono riservate ed a uso esclusivo del destinatario/dei destinatari. Qualora il messaggio in parola Le fosse pervenuto per errore, La invitiamo ad eliminarlo senza copiarlo e a non inoltrarlo a terzi, dandocene gentilmente comunicazione.* *Per favore, pensa all'ambiente. Stampa questa email solo se necessario.*

6 9

[Dovecot] imapc with Outlook.com transfers max 22-23 messages per mailbox!?
by Nicholas Riley 08 May '14

08 May '14

Hi, I'm trying to migrate a user from Outlook.com IMAP to Dovecot. I'm using a setup similar to that on http://wiki2.dovecot.org/Migration/Dsync: imapc_host = imap-mail.outlook.com imapc_user = [...](a)hotmail.com imapc_password = [...] imapc_features = rfc822.size fetch-headers mail_prefetch_count = 20 imapc_port = 993 imapc_ssl = imaps imapc_ssl_verify = yes ssl_client_ca_dir = /etc/ssl # this needs fixing on the wiki page Here's how I sync a single mailbox, which should have a few hundred messages in it: % doveadm -D -v -c [...] sync -1 -R -u [...] -m Avalon imapc: Output is at http://sabi.net/temp/sync.txt But every mailbox contains at most 22-23 messages. % for i in Maildir/**/cur; do echo $i $(ls -1 $i | wc -l) done Maildir/Alaska/cur 23 Maildir/Avalon/cur 22 Maildir/Christine Scott/cur 22 Maildir/Cornell/cur 22 Maildir/Coupons/cur 10 Maildir/Deleted/cur 22 [...] I was using 2.2.9 but I also tried with the dovecot-2.2 hg tip and did not see any difference. Is there a rawlog equivalent for imapc? I'm hoping that there is a simple protocol usage change that could let me get entire mailboxes. -- Nicholas Riley <njriley(a)illinois.edu>

3 4

[Dovecot] segfault with shared namespace version > 2.1.16
by Tom Lieuallen 08 May '14

08 May '14

We're currently running 2.1.16. I've been wanting to update to a 2.2.X version, but have been running into problems, even with the latest (2.2.12). I'm not sure at what version this issue appeared, but I believe I've tried 2.2.10, 2.2.11, and now 2.2.12. We have a shared maildir setup. With that configuration in place and with a user in the dovecot-acl file, I can do the following to make it segfault every time. Note if I comment out the shared namespace config, it does not segfault. /private/dovecot/libexec/dovecot/imap -u tom2 * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in as tom2 l list "" * Segmentation fault (core dumped) The /a1 and /a2 mentioned here for shared folders and indexes are both local ext4 file systems. =========== Here is the output of dovecot -n: # 2.2.12: /private/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.el6.x86_64 x86_64 CentOS release 6.5 (Final) first_valid_uid = 100 listen = * mail_location = mbox:~/mail:INBOX=/var/mail/%u:INDEX=/a2/imap-index/%u mail_plugins = quota acl namespace { hidden = yes inbox = no list = children location = maildir:/a1/dove-shared:INDEX=/a2/imap-index/dove-shared/%u prefix = sharedimap/ separator = / type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /private/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = scheme=CRYPT username_format=%u /private/dovecot/etc/passwd driver = passwd-file } plugin { acl = vfile quota = fs:INBOX:mount=/a1 quota2 = fs:Home quota:mount=%h } protocols = imap lmtp service imap-login { process_limit = 500 process_min_avail = 16 service_count = 1 } service imap { process_limit = 2048 } ssl_cert = </private/ssl/certs/mail.engr.oregonstate.edu.pem ssl_key = </private/ssl/certs/mail.engr.oregonstate.edu.pem userdb { args = /private/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } userdb { args = username_format=%u /private/dovecot/etc/passwd driver = passwd-file } ============== I've got core dumps from it. I assume the gdb examples give a reverse trace of the calls. If more is needed, I can supply. Core was generated by `/private/dovecot/libexec/dovecot/imap -u tom2'. Program terminated with signal 11, Segmentation fault. #0 mailbox_settings_find (user=0x6866c0, vname=0x670800 "sharedimap/support-reports") at mail-storage.c:624 624 { Missing separate debuginfos, use: debuginfo-install glibc-2.12-1.132.el6.x86_64 sssd-client-1.9.2-129.el6.x86_64 (gdb) bt full #0 mailbox_settings_find (user=0x6866c0, vname=0x670800 "sharedimap/support-reports") at mail-storage.c:624 box_set = <value optimized out> ns = <value optimized out> #1 0x00007f1cb0323fd0 in mailbox_list_get_storage (list=0x7fff73b39088, vname=<value optimized out>, storage_r=0x7fff73b39080) at mailbox-list.c:821 set = <value optimized out> #2 0x00007f1cb03164a7 in mail_namespace_find_shared ( namespaces=<value optimized out>, mailbox=0x670800 "sharedimap/support-reports") at mail-namespace.c:651 list = 0x68ea30 storage = 0x0 #3 mail_namespace_find (namespaces=<value optimized out>, mailbox=0x670800 "sharedimap/support-reports") at mail-namespace.c:669 ns = 0x68ad70 __FUNCTION__ = "mail_namespace_find" .... .... thank you Tom Lieuallen Oregon State University

2 3

[Dovecot] Error Panic: file mail-storage.c
by Davide 08 May '14

08 May '14

Hi to all, i have dovecot 2.2.12 compiled from source on debian 6 i find this errors on errorlog ...... 2014-05-08 12:44:21 imap(XXXXXXXXX): Panic: file mail-storage.c: line 2141 (mailbox_copy): assertion failed: (!ctx->unfinished) 2014-05-08 12:44:21 imap(XXXXXXXXX): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6f47a) [0x7f54671e847a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x6f4f6) [0x7f54671e84f6] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f546719d9ef] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x899f8) [0x7f54674d79f8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_move+0x1d) [0x7f54674d7a2d] -> dovecot/imap() [0x40d797] -> dovecot/imap(command_exec+0x3d) [0x419c0d] -> dovecot/imap() [0x418c00] -> dovecot/imap() [0x418d15] -> dovecot/imap(client_handle_input+0x125) [0x4191a5] -> dovecot/imap(client_input+0x6f) [0x419a5f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f54671f8fc6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x95) [0x7f54671fa345] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f54671f8f38] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f54671a2ed3] -> dovecot/imap(main+0x2a7) [0x423907] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f5466e35c8d] -> dovecot/imap() [0x40bcc9] 2014-05-08 12:44:21 imap(XXXXXXXXX): Fatal: master: service(imap): child 23777 killed with signal 6 (core dumps disabled) 2014-05-08 12:44:21 imap(XXXXXXXXX): Panic: file mail-storage.c: line 2141 (mailbox_copy): assertion failed: (!ctx->unfinished) 2014-05-08 12:44:21 imap(XXXXXXXXX): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6f47a) [0x7f31fc2ae47a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x6f4f6) [0x7f31fc2ae4f6] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f31fc2639ef] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x899f8) [0x7f31fc59d9f8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_move+0x1d) [0x7f31fc59da2d] -> dovecot/imap() [0x40d797] -> dovecot/imap(command_exec+0x3d) [0x419c0d] -> dovecot/imap() [0x418c00] -> dovecot/imap() [0x418d15] -> dovecot/imap(client_handle_input+0x125) [0x4191a5] -> dovecot/imap(client_input+0x6f) [0x419a5f] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f31fc2befc6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x95) [0x7f31fc2c0345] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f31fc2bef38] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f31fc268ed3] -> dovecot/imap(main+0x2a7) [0x423907] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f31fbefbc8d] -> dovecot/imap() [0x40bcc9] 2014-05-08 12:44:21 imap(XXXXXXXXX): Fatal: master: service(imap): child 23779 killed with signal 6 (core dumps disabled) ..... Some advice to resolve the problem? -- *Davide Marchi* *T*eorema *F*errara *Srl* Via Spronello, 7 - Ferrara - 44121 Tel. *0532783161* Fax. *0532783368* E-m@il: *davide.marchi(a)mail.cgilfe.it* Skype: *davide.marchi73* Web: *http://www.cgilfe.it* *CONFIDENZIALITA'* *Ai sensi del D.Lgs. 196/2003 si precisa che le informazioni contenute in questo messaggio sono riservate ed a uso esclusivo del destinatario/dei destinatari. Qualora il messaggio in parola Le fosse pervenuto per errore, La invitiamo ad eliminarlo senza copiarlo e a non inoltrarlo a terzi, dandocene gentilmente comunicazione.* *Per favore, pensa all'ambiente. Stampa questa email solo se necessario.*

1 0

[Dovecot] Dsync via dovecot proxy
by mtrainer＠cloud-free.com 08 May '14

08 May '14

Hi All, I need to import mailboxes into my Director NFS setup via one of my director proxy's as doing a direct dsync to the backend mailstores appears to giving me NFS locking issues. It looks like it may be possible to do this using doveadm listeners. I have setup doveadm listeners on a test proxy and backend mailstore. I am not sure how to make the dsync proxy through to the backend mailstore - it doesn't appear to be doing so below. My dovecot configs follow further below. Any help would be greatly appreciated. Murray dsync -v -D -u test1(a)example777.com mirror ssh root@mailproxy-test01 dsync -c /etc/dovecot/dovecot.conf -u test1(a)example777.com doveadm(test1(a)example777.com): Debug: Added userdb setting: mail=maildir:/home/user1/mail/example777.com/test1 doveadm(test1(a)example777.com): Debug: Added userdb setting: plugin/quota=maildir:storage=0 doveadm(test1(a)example777.com): Debug: Effective uid=501, gid=502, home=/home/user1/mail/example777.com/test1 doveadm(test1(a)example777.com): Debug: Namespace : type=private, prefix=INBOX., sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/user1/mail/example777.com/test1 doveadm(test1(a)example777.com): Debug: maildir++: root=/home/user1/mail/example777.com/test1, index=, indexpvt=, control=, inbox=/home/user1/mail/example777.com/test1, alt= doveadm(test1(a)example777.com): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none doveadm(test1(a)example777.com): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= doveadm(test1(a)example777.com): Debug: Namespace INBOX.: Using permissions from /home/user1/mail/example777.com/test1: mode=0751 gid=default root@mailproxy-test01's password: doveadm(test1(a)example777.com): Error: user test1(a)example777.com: Initialization failed: Initializing mail storage from environment MAIL failed: Ambiguous mail location setting, don't know what to do with it: /var/mail/root (try prefixing it with mbox: or maildir:) doveadm(test1(a)example777.com): Fatal: User init failed dsync-local(test1(a)example777.com): Debug: brain M: in state=master_recv_handshake dsync-local(test1(a)example777.com): Error: read(remote) failed: EOF (version not received) dsync-local(test1(a)example777.com): Debug: brain M: out state=master_recv_handshake changed=0 # 2.2.9: /etc/dovecot/dovecot-director.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.1 auth_cache_size = 32 M auth_cache_ttl = 2 hours auth_debug = yes auth_mechanisms = plain login auth_verbose = yes base_dir = /var/run/dovecot/ director_mail_servers = 27.54.95.50 director_servers = 27.54.95.36 disable_plaintext_auth = no doveadm_allowed_commands = all doveadm_password = xxxxxxxxxxx lmtp_proxy = yes log_path = /var/log/dovecot.log mail_debug = yes passdb { args = nopassword=y proxy=y driver = static } protocols = " imap lmtp pop3" service auth-worker { user = dovecot } service auth { client_limit = 4096 unix_listener auth-userdb { group = mail mode = 0666 user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = 27.54.95.36 port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { executable = doveadm-server director inet_listener doveadm-server { port = 24245 } } service imap-login { chroot = login executable = imap-login director inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 2048 process_min_avail = 32 service_count = 1 user = dovecot vsz_limit = 256 M } service imap { process_limit = 4096 vsz_limit = 256 M } service ipc { unix_listener ipc { mode = 0666 user = dovecot } } service lmtp { inet_listener lmtp { address = 27.54.95.36 port = 24 } process_limit = 2048 process_min_avail = 32 } service pop3-login { chroot = login executable = pop3-login director inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_limit = 2048 process_min_avail = 32 service_count = 1 user = dovecot vsz_limit = 256 M } service pop3 { process_limit = 4096 vsz_limit = 256 M } ssl_cert = ssl_key = userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { auth_socket_path = director-userdb lmtp_save_to_detail_mailbox = yes recipient_delimiter = + } protocol doveadm { auth_socket_path = director-userdb } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep imap_logout_format = bytes=%i/%o imap_max_line_length = 128 k mail_max_userip_connections = 50 mail_plugins = quota imap_quota } protocol pop3 { mail_max_userip_connections = 50 mail_plugins = quota pop3_client_workarounds = outlook-no-nuls pop3_fast_size_lookups = yes pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_uidl_format = %08Xu%08Xv } # 2.2.9: /etc/dovecot/dovecot-mailstore.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.1 auth_cache_size = 64 M auth_cache_ttl = 2 hours auth_debug = yes auth_debug_passwords = yes auth_failure_delay = 0 auth_mechanisms = plain login auth_verbose = yes auth_worker_max_count = 256 base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_gid = 1001 first_valid_uid = 1001 mail_debug = yes mail_fsync = always mail_location = maildir:~/ mmap_disable = yes namespace { inbox = yes location = mailbox Drafts { special_use = Drafts } mailbox Junk { special_use = Junk } mailbox Sent { special_use = Sent } mailbox "Sent Messages" { special_use = Sent } mailbox Trash { special_use = Trash } prefix = subscriptions = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_log_fields = uid box msgid size quota = maildir:User quota sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp pop3" service anvil { client_limit = 4106 } service auth-worker { user = dovecot } service auth { client_limit = 4096 unix_listener auth-userdb { group = mail mode = 0666 user = dovecot } } service doveadm { inet_listener doveadm-server { port = 24245 } user = root } service imap-login { chroot = login inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 2048 process_min_avail = 32 service_count = 1 user = dovecot vsz_limit = 256 M } service imap { process_limit = 4096 vsz_limit = 256 M } service lmtp { inet_listener lmtp { address = 27.54.95.50 port = 24 } process_min_avail = 32 } service pop3-login { chroot = login inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_limit = 2048 process_min_avail = 32 service_count = 1 user = dovecot vsz_limit = 256 M } service pop3 { process_limit = 4096 vsz_limit = 256 M } ssl_cert = ssl_key = userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes verbose_ssl = yes protocol imap { imap_client_workarounds = tb-extra-mailbox-sep imap_logout_format = bytes=%i/%o imap_max_line_length = 128 k mail_max_userip_connections = 50 mail_plugins = quota imap_quota } protocol pop3 { mail_max_userip_connections = 50 mail_plugins = quota pop3_client_workarounds = outlook-no-nuls pop3_fast_size_lookups = yes pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_uidl_format = %08Xu%08Xv } local 27.54.95.32/27/27 { doveadm_password = xxxxxxxxxx }

2 1

[Dovecot] dsync replication does not replicate new subfolders
by Nikolaos Milas 08 May '14

08 May '14

Hello, Although this issue has been raised in another thread: https://www.mail-archive.com/dovecot@dovecot.org/msg57281.html I decided I should create a new one dedicated on it because that thread includes other issues as well, and the issue in question still remains unresolved although it is an important one (and I am hoping to attract Timo's attention on it, too ;-) ). The problem is that when dsync is configured between two servers (master/master), messages do get replicated, but newly created subfolders do not get replicated; as a result, when messages are moved by users from existing folders to newly created ones, replication results in chaos. Manually running a dsync command does not resolve the issue. See details of debug log on the above thread. I remind you that the configs of the two master/master installations (2.2.12) are available at: Primary Master: https://www.mail-archive.com/dovecot@dovecot.org/msg57298.html Secondary Master: https://www.mail-archive.com/dovecot@dovecot.org/msg57304.html The questions: 1. Is it an expected dsync behavior that newly created subfolders do not get replicated? 2. If yes, how can we replicate those? 3. If not, what is going wrong in the replication process? Does our configuration need a fix (which?) or does Dovecot needs one? Please advise! Sincerely, Nick

2 1

[Dovecot] Dovecot quoting problem?
by Gerhard Wiesinger 07 May '14

07 May '14

Hello Timo, I think the following commit makes problems: http://hg.dovecot.org/dovecot-2.2/rev/68a8b650578e # Doesn't work A01 LIST "" ~/Mail/Gesendet # OK with quoted mailbox A02 LIST "" "~/Mail/Gesendet" Details: imap * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in as user A01 LIST "" ~/Mail/Gesendet A01 BAD Error in IMAP command LIST: literal8 not allowed here A02 LIST "" "~/Mail/Gesendet" * LIST (\NoInferiors \UnMarked) "/" ~/Mail/Gesendet A02 OK List completed. A03 STATUS ~/Mail/Gesendet (MESSAGES UNSEEN RECENT) A03 BAD Error in IMAP command STATUS: literal8 not allowed here A04 STATUS "~/Mail/Gesendet" (MESSAGES UNSEEN RECENT) * STATUS ~/Mail/Gesendet (MESSAGES 0 RECENT 0 UNSEEN 0) A04 OK Status completed. Is this a bug of dovecot or a bug of the IMAP client (roundcube mail)? Thank you Ciao, Gerhard

2 2

[Dovecot] TCP Cluster replication headache
by FUSTE Emmanuel 07 May '14

07 May '14

Hello, After going crazy building a dovecot cluster, I finally see the light ;-)) But some things are "strange" and could probably be fixed/enhanced. First : I follow the wiki doc, setting global doveadm_port. Things did not work, I've got: dovecot: doveadm(X1234567): Error: sync: /var/run/dovecot/auth-userdb: Configured passdbs don't support crentials lookups (to see if user is proxied, because doveadm_port is set) Same kind of error too when trying to use doveadm on the command line to get the replica status. My user/auth db is LDAP with "auth_bind = yes", but I don't understand the message in these context and did'nt know how to fix this. I tried to hardcode proxy/proxy_maybe property in the passdb declaration etc... Finally, I remove the global "doveadm_port 12345" and add ":12345" at the end of my "mail_replica =" line and all began to work ! Is it a wanted and expected error/fix ? Secondly: Now all is working and "doveadm replicator status '*' " correctly list all my users and the status, but after a few seconds (after replication kick in), I see all user listed twice. One time, as declared in the userdb with letters in uppercase : "X1234567" One time, in lowercase : "x1234567" On disk, all is OK, with only one replica in an uppercase directory. I initially think that it was a mismatch between userdb and passdb users return, but it was in fact the default value of auth_username_format that was the culprit. After going from the default %Lu to %u doveadm replicator status show only one entry per user as expected. Is it wanted and expected too? why auth_username_format is used/interact with/in the replication process and/or the replicator status command ? Not all is functionally tested, I go back to work. My is conf at the end of this message. Thanks Simo for this great piece of software. Emmanuel # 2.2.12.7 (f7731356530e+): /etc/dovecot/dovecot.conf # OS: Linux 3.11.0-19-generic x86_64 Ubuntu 12.04.4 LTS auth_master_user_separator = * auth_username_format = %u doveadm_password = xxxxxxxxxxx lda_mailbox_autocreate = yes listen = * mail_gid = vmail mail_location = maildir:~/Maildir mail_plugins = quota notify replication mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { hidden = no inbox = no list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_anyone = allow acl_shared_dict =file:/appli/vmail/shared-mailboxes mail_replica = tcp:thsmytmbx02p.online.corp.thales:12345 quota = dict:userquota::file:/appli/vmail/local_userquota/%%h/dovecot-quota quota_rule = *:storage=100M quota_rule2 = INBOX:storage=+20%% quota_rule3 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap sieve service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth { unix_listener auth-userdb { group = vmail mode = 0660 } } service doveadm { inet_listener { port = 12345 } user = vmail } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl = no userdb { args = /etc/dovecot/dovecot-users-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = quota sieve } protocol imap { mail_plugins = quota imap_quota } dovecot-users-ldap.conf.ext: dovecot-ldap.conf.ext: uris = ldapi:/// dn = uid=dovecot,dc=mydomain,dc=com dnpass = xxxxxxxxxxxx auth_bind = yes ldap_version = 3 base = ou=users,dc=mydomain,dc=com user_attrs = =home=/appli/vmail/%{ldap:uid} user_filter = (&(objectClass=inetOrgPerson)(|(uid=%u)(mail=%u))) pass_attrs = =user=%{ldap:uid} pass_filter = (&(objectClass=inetOrgPerson)(uid=%u)(!(pwdReset=TRUE))) iterate_attrs = uid=user iterate_filter = (objectClass=inetOrgPerson)

1 1

[Dovecot] BUG report: doveadm HEADER <field> <pattern> when concatenating with another Search key
by megodin＠inboxalias.com 07 May '14

07 May '14

Hey there, I'm pretty sure I've found a bug with doveadm when concatenating with another search key. While doveadm HEADER <field pattern> works fine when not using additional search keys, it doesn't work properly when concatenating with other serarch keys - it then simply seems to ignore the additional HEADER <field pattern> search key. It's reproduceable, also with different user accounts on 2 different productive systems. Testing it on latest dovecot-ee 2.2.9.2 and 2.2.5.5. I think it's best explained with showing some examples: doveadm search -u exampleuser SUBJECT Silvester (outputs correctly 10 matches) 5a09f50926daef51b50e000025ab05f8 1106 5a09f50926daef51b50e000025ab05f8 1107 5a09f50926daef51b50e000025ab05f8 1579 5a09f50926daef51b50e000025ab05f8 4092 5a09f50926daef51b50e000025ab05f8 5330 5a09f50926daef51b50e000025ab05f8 9773 5a09f50926daef51b50e000025ab05f8 11460 5a09f50926daef51b50e000025ab05f8 12718 5a09f50926daef51b50e000025ab05f8 15653 5a09f50926daef51b50e000025ab05f8 15697 doveadm search -u exampleuser SUBJECT Silvester HEADER Return-Path someuser(a)example.com (gives exactly the same output - but this is WRONG, as the given Subject AND Return-Path is really only found in 1 Message - uid 15697) 5a09f50926daef51b50e000025ab05f8 1106 5a09f50926daef51b50e000025ab05f8 1107 5a09f50926daef51b50e000025ab05f8 1579 5a09f50926daef51b50e000025ab05f8 4092 5a09f50926daef51b50e000025ab05f8 5330 5a09f50926daef51b50e000025ab05f8 9773 5a09f50926daef51b50e000025ab05f8 11460 5a09f50926daef51b50e000025ab05f8 12718 5a09f50926daef51b50e000025ab05f8 15653 5a09f50926daef51b50e000025ab05f8 15697 doveadm search -u exampleuser HEADER Return-Path someuser(a)example.com (showing that Return-Path as standalone search key is working fine - note that message uid 15697 with subject "Silvester" is also found of course. I manually checked all Mails showing up here, they all contained the Return-Path "someuser(a)example.com" as they should): 5a09f50926daef51b50e000025ab05f8 14080 5a09f50926daef51b50e000025ab05f8 14814 5a09f50926daef51b50e000025ab05f8 14815 5a09f50926daef51b50e000025ab05f8 14820 5a09f50926daef51b50e000025ab05f8 14825 5a09f50926daef51b50e000025ab05f8 14830 5a09f50926daef51b50e000025ab05f8 14832 5a09f50926daef51b50e000025ab05f8 14833 5a09f50926daef51b50e000025ab05f8 15427 5a09f50926daef51b50e000025ab05f8 15428 5a09f50926daef51b50e000025ab05f8 15430 5a09f50926daef51b50e000025ab05f8 15431 5a09f50926daef51b50e000025ab05f8 15697 Further testing with: doveadm search -u exampleuser HEADER Return-Path completegarbageforsurenotinheaders (Correctly no output was given.) doveadm search -u exampleuser SUBJECT Silvester HEADER Return-Path completegarbageforsurenotinheaders (again ignoring the additional HEADER and showing all uids which just match the SUBJECT) 5a09f50926daef51b50e000025ab05f8 1106 5a09f50926daef51b50e000025ab05f8 1107 5a09f50926daef51b50e000025ab05f8 1579 5a09f50926daef51b50e000025ab05f8 4092 5a09f50926daef51b50e000025ab05f8 5330 5a09f50926daef51b50e000025ab05f8 9773 5a09f50926daef51b50e000025ab05f8 11460 5a09f50926daef51b50e000025ab05f8 12718 5a09f50926daef51b50e000025ab05f8 15653 5a09f50926daef51b50e000025ab05f8 15697 Moreove, when playing with HEADER Reply-To it shows some strange behaviour, note the differences with the ":" : doveadm search -u exampleuser SUBJECT blubbs HEADER Reply-to kacke(a)example.com f64cf50926daef51b50e000025ab05f8 2231 f64cf50926daef51b50e000025ab05f8 2781 5a09f50926daef51b50e000025ab05f8 13620 5a09f50926daef51b50e000025ab05f8 15763 doveadm search -u exampleuser SUBJECT blubbs HEADER Reply-to: kacke(a)example.com f64cf50926daef51b50e000025ab05f8 2231 5a09f50926daef51b50e000025ab05f8 13620 Can you please have a look at this and fix it? Thanks in advance, Megodin -- mailstorage @ NFS with nfsvers=3 (NetApp) # 2.2.5.5 (e5350245ad9b): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.4 (Santiago) nfs import_environment = TZ DEBUG_OUTOFMEM DOVECOT_HOSTDOMAIN # 2.2.9.2 (8d71ef248a6e): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 CentOS release 6.5 (Final) nfs _________________________________________________________________ Send and receive anonymous emails to your inbox with InboxAlias. http://www.inboxalias.com

2 1

[Dovecot] New global ACL mailbox pattern feature in HG
by Thomas Leuxner 07 May '14

07 May '14

Hi, I played around with changeset 9376bf098692 a bit. Right now I'm unsure how to describe a namespace using this feature. Using something like 'Public/*" doesn't seem to work while 'Public*" does, but would also potentially alter non-related mailboxes elsewhere: $ cat global-acl INBOX owner lrwstiekxap Public* group=PublicMailboxAdmins lrwsik Regards Thomas

2 8

[Dovecot] Corrupted mailbox, how to fix?
by Ralf Hildebrandt 07 May '14

07 May '14

>From my log: May 06 16:26:49 imap(loginname): Error: zlib.read(/var/mail/loginname/mdbox/storage/m.94): gz trailer has wrong CRC value at 2412347 May 06 16:26:49 imap(loginname): Error: read() failed: Invalid argument (FETCH for mailbox INBOX UID 3434) How do I fix that? -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

2 1

[Dovecot] SSL/TLS handshake stays forever without timeout
by morrison 07 May '14

07 May '14

Hi, I am a system admin and I am evaluating using dovecot as our email server. In my test, I found that if I telneted to 993 port and did not do anything or I telneted to 143 port, sent starttls command and then did not do anything, the connection stayed forever without timeout. This will make our mail server vulnerable to DOS attack. I dig into dovecot Wiki and did not find any solution. This seems to me that dovecot does not handle SSL/TLS handshake timeout. I am wondering if this is a known issue and will be fixed in near future. Thanks,

6 5

[Dovecot] Panic: file mail-index-map.c: line 547 (mail_index_map_lookup_seq_range): assertion failed: (first_uid > 0)
by Hardy Flor 07 May '14

07 May '14

Version: 2.2.12 OS: Debian wheezy x86_64 2014 Mar 11 20:06:53 ptb-test imap(flor_hardy): Panic: file mail-index-map.c: line 547 (mail_index_map_lookup_seq_range): assertion failed: (first_uid > 0) 2014 Mar 11 20:06:53 ptb-test imap(flor_hardy): Fatal: master: service(imap): child 2760 killed with signal 6 (core dumped) GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later<http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/lib/dovecot/imap...Reading symbols from /usr/lib/debug/usr/lib/dovecot/imap...done. done. [New LWP 2760] warning: Can't read pathname for load map: Eingabe-/Ausgabefehler. [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. #0 0x00007f32d28b4475 in raise () from /lib/x86_64-linux-gnu/libc.so.6 (gdb) bt full #0 0x00007f32d28b4475 in raise () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #1 0x00007f32d28b76f0 in abort () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #2 0x00007f32d2c78345 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0x186d768 "/usr/lib/dovecot/libdovecot.so.0(+0x6b34f) [0x7f32d2c7834f] -> /usr/lib/dovecot/libdovecot.so.0(+0x6b3ae) [0x7f32d2c783ae] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f32d2c31e8e] -> /usr/lib/d"... #3 0x00007f32d2c783ae in i_internal_fatal_handler (ctx=0x7fff8d12aa30, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f32d2c31e8e in i_panic (format=format@entry=0x7f32d2fbc098 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fff8d12ab20, reg_save_area = 0x7fff8d12aa60}} #5 0x00007f32d2fa03b2 in mail_index_map_lookup_seq_range (map=<optimized out>, first_uid=0, last_uid=<optimized out>, first_seq_r=<optimized out>, last_seq_r=<optimized out>) at mail-index-map.c:549 __FUNCTION__ = "mail_index_map_lookup_seq_range" #6 0x00007f32d2fa856d in tview_lookup_seq_range (view=0x18a6850, first_uid=0, last_uid=0, first_seq_r=0x18a79e0, last_seq_r=0x18a79e0) at mail-index-transaction-view.c:178 tview = 0x18a6850 rec = <optimized out> seq = <optimized out> __FUNCTION__ = "tview_lookup_seq_range" #7 0x00007f32d2fb17c2 in mail_index_lookup_seq (view=<optimized out>, uid=<optimized out>, seq_r=seq_r@entry=0x18a79e0) at mail-index-view.c:522 No locals. #8 0x00007f32d2f809b4 in index_mail_get_pvt (_mail=_mail@entry=0x18a78a0) at index-mail.c:158 No locals. #9 0x00007f32d2f81082 in index_mail_get_pvt (_mail=0x18a78a0) at index-mail.c:152 mail = 0x18a78a0 #10 index_mail_get_flags (_mail=0x18a78a0) at index-mail.c:177 mail = 0x18a78a0 rec = <optimized out> flags = MAIL_ANSWERED pvt_flags_mask = <optimized out> #11 0x00007f32d18371a4 in mail_log_append_mail_message_real (desc=0x7f32d1837504 "save", event=MAIL_LOG_EVENT_SAVE, mail=0x18a78a0, ctx=0x18c62f0) at mail-log-plugin.c:297 muser = <optimized out> msg = 0x18c6308 text = 0x186d310 size = 224891 #12 mail_log_append_mail_message (desc=0x7f32d1837504 "save", event=MAIL_LOG_EVENT_SAVE, mail=0x18a78a0, ctx=0x18c62f0) at mail-log-plugin.c:335 _data_stack_cur_id = 3 #13 mail_log_append_mail_message (ctx=0x18c62f0, mail=0x18a78a0, event=MAIL_LOG_EVENT_SAVE, desc=0x7f32d1837504 "save") at mail-log-plugin.c:320 muser = <optimized out> #14 0x00007f32d1c3c51b in notify_contexts_mail_save (mail=mail@entry=0x18a78a0) at notify-plugin.c:63 ctx = 0x1886fc0 mail_txn = <optimized out> #15 0x00007f32d1c3d4b0 in notify_save_finish (ctx=<optimized out>) at notify-storage.c:145 lbox = <optimized out> dest_mail = 0x18a78a0 #16 0x00007f32d2f64582 in mailbox_save_finish (_ctx=_ctx@entry=0x189a280) at mail-storage.c:2073 ctx = 0x18a9590 t = 0x18ab220 keywords = 0x0 pvt_flags = MAIL_SEEN copying_via_save = false ret = <optimized out> __FUNCTION__ = "mailbox_save_finish" #17 0x000000000040cef1 in cmd_append_continue_message (cmd=0x189a120) at cmd-append.c:858 lit_offset = 228081 client = 0x1899540 ctx = 0x189a228 ret = <optimized out> #18 0x00000000004183cc in command_exec (cmd=0x189a120) at imap-commands.c:158 hook = 0x18760f0 ret = <optimized out> #19 0x000000000040c9a3 in client_input_append (cmd=0xac8) at cmd-append.c:116 ctx = 0x189a228 client = 0x1899540 reason = <optimized out> finished = <optimized out> lit_offset = <optimized out> __FUNCTION__ = "client_input_append" #20 0x00007f32d2c88ab6 in io_loop_call_io (io=0x18ab150) at ioloop.c:388 ioloop = 0x1875740 t_id = 2 #21 0x00007f32d2c89957 in io_loop_handler_run (ioloop=ioloop@entry=0x1875740) at ioloop-epoll.c:220 ctx = 0x18763d0 events = 0x0 event = 0x1877230 list = 0x1877e00 io = <optimized out> tv = {tv_sec = 5, tv_usec = 398615} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #22 0x00007f32d2c885c8 in io_loop_run (ioloop=0x1875740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #23 0x00007f32d2c37233 in master_service_run (service=0x18755d0, callback=callback@entry=0x420c50 <client_connected>) at master-service.c:566 No locals. #24 0x000000000040c128 in main (argc=1, argv=0x1875390) at main.c:400 set_roots = {0x4287c0, 0x0} login_set = {auth_socket_path = 0x186d048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x420ae0 <login_client_connected>, failure_callback = 0x4207f0 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> ******************************************************** In the "Projekte" folder several subfolderswere created. Now, when a user wants to save more e-mails in this subfolder does this Stop message. The e-mails are all but saved.

3 2

[Dovecot] imap process and indexer-worker crash while creating folders
by Michael Kliewe 07 May '14

07 May '14

Hi, our dovecot processes sometimes crash when we create new folders. The "imap" process and the "indexer worker" process is crashing. We can reproduce this, we have a java program with multiple threads, and sometimes 2 threads try to create the same folder for the same user, and if both collide, dovecot processes crash. We don't see this happening in the real world if "normal" imap clients are connected, but our special java program trying to create folders in parallel is producing these crashes. Below you can see the log entries and gdb "bt full" output, one for an "imap" process and one for an "indexer worker" process. We are using dovecot 2.2.9, and I did not find anything in the changelog regarding this problem. Does ist make sense to try the newest version 2.2.12? Thanks Michael ================== Apr 1 19:58:28 dovecot01 dovecot: imap(user(a)domain.de): Panic: file mail-index-transaction-export.c: line 117 (log_append_ext_intro): assertion failed: (intro->ext_id == idx || idx == (uint32_t)-1) Apr 1 19:58:28 dovecot01 dovecot: imap(user(a)domain.de): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x66ab1) [0x7f0028259ab1] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x66b8e) [0x7f0028259b8e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f00282153ce] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb9c72) [0x7f002857ec72] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_export+0x200) [0x7f002857f140] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb932f) [0x7f002857e32f] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x9d) [0x7f002857e78d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit+0xc) [0x7f002857e82c] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x3e1ea) [0x7f00285031ea] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x3e44c) [0x7f002850344c] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x90a15) [0x7f0028555a15] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_metadata+0x95) [0x7f0028542345] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync_name+0x2a4) [0x7f0028556324] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync+0x10a) [0x7f002855694a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_refresh+0x9e) [0x7f002855184e] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_iter_init+0x129) [0x7f0028553169] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_iter_init_multiple+0x29) [0x7f0028556ec9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x93179) [0x7f0028558179] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x91baf) [0x7f0028556baf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_iter_next+0x334) [0x7f00285577c4] -> dovecot/imap [user(a)domain.de 10.0.121.43 LIST]() [0x40f089] -> dovecot/imap [user(a)domain.de 10.0.121.43 LIST](cmd_list_full+0x4de) [0x40f8ce] -> dovecot/imap [user(a)domain.de 10.0.121.43 LIST](command_exec+0x3c) [0x416adc] -> dovecot/imap [user(a)domain.de 10.0.121.43 LIST]() [0x415b3f] -> dovecot/imap [user(a)domain.de 10.0.121.43 LIST]() [0x415bf5] -> dovecot/imap [user(a)domain.de 10.0.121.43 LIST](client_handle_input+0x115) [0x415ef5] -> dovecot/imap [user(a)domain.de 10.0.121.43 LIST](client_input+0x72) [0x416282] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7f0028269a87] Apr 1 19:58:28 dovecot01 dovecot: imap(user(a)domain.de): Fatal: master: service(imap): child 3928 killed with signal 6 (core dumped) ================== Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. #0 0x00007f0027e61f77 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 56 ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory. (gdb) bt full #0 0x00007f0027e61f77 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 resultvar = 0 pid = 3928 selftid = 3928 #1 0x00007f0027e655e8 in __GI_abort () at abort.c:90 save_stage = 2 act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {11509168, 0, 139638656126069, 1, 0, 4283381, 139638645923048, 140736983670273, 0, 11764224, 139638656153381, 0, 139638646863616, 139638652804256, 11513608, 140736983669916}}, sa_flags = 4096, sa_restorer = 0x7f0027e79134 } sigs = {__val = {32, 0 }} #2 0x00007f0028259ad8 in default_fatal_finish (type=, status=status@entry=0) at failures.c:192 backtrace = 0xaf9eb8 "/usr/local/lib/dovecot/libdovecot.so.0(+0x66ab1) [0x7f0028259ab1] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x66b8e) [0x7f0028259b8e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f0028215"... #3 0x00007f0028259b8e in i_internal_fatal_handler (ctx=0x7fffe1eb1e30, format=, args=) at failures.c:653 status = 0 #4 0x00007f00282153ce in i_panic (format=format@entry=0x7f0028597088 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:264 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffe1eb1f20, reg_save_area = 0x7fffe1eb1e60}} #5 0x00007f002857ec72 in log_append_ext_intro (ctx=ctx@entry=0x7fffe1eb2040, ext_id=ext_id@entry=5, reset_id=0, hdr_size_r=hdr_size_r@entry=0x7fffe1eb2018) at mail-index-transaction-export.c:117 t = 0xb3dd30 intro = 0xb3cd04 resizes = 0xb3cca0 buf = 0xaf9db0 idx = 0 count = 6 __FUNCTION__ = "log_append_ext_intro" #6 0x00007f002857f140 in mail_transaction_log_append_ext_intros (ctx=0x7fffe1eb2040) at mail-index-transaction-export.c:283 resize = ext_reset = {new_reset_id = 0, preserve_data = 0 '\000', unused_padding = "\000\000"} resize_count = ext_count = 6 hdrs = hdrs_count = 6 ext_id = 5 reset_count = 0 hdr_size = 0 reset = 0x0 reset_buf = {data = 0x7fffe1eb2020, used = 8, priv = {0x7fffe1eb2020, 0x0, 0x8, 0x0, 0x0}} t = reset_id_count = 0 reset_id = reset_ids = 0x0 #7 mail_index_transaction_export (t=t@entry=0xb3dd30, append_ctx=0xb43570) at mail-index-transaction-export.c:409 null4 = "\000\000\000" change_mask = (unknown: 0) ctx = {trans = 0xb3dd30, append_ctx = 0xb43570} __FUNCTION__ = "mail_index_transaction_export" #8 0x00007f002857e32f in mail_index_transaction_commit_real (commit_size_r=0x7fffe1eb2180, t=0xb3dd30) at mail-index-transaction.c:165 _data_stack_cur_id = 7 ctx = 0xb43570 log_seq2 = 0 log_offset1 = 0 log = 0xb38e00 trans_flags = ---Type to continue, or q to quit--- log_seq1 = 11763008 log_offset2 = 7 #9 mail_index_transaction_commit_v (t=0xb3dd30, result_r=0x7fffe1eb2170) at mail-index-transaction.c:203 index = 0xb37d40 changed = true ret = __FUNCTION__ = "mail_index_transaction_commit_v" #10 0x00007f002857e78d in mail_index_transaction_commit_full (_t=_t@entry=0x7fffe1eb21b0, result_r=result_r@entry=0x7fffe1eb2170) at mail-index-transaction.c:262 t = 0xb3dd30 index = 0xb37d40 index_undeleted = false #11 0x00007f002857e82c in mail_index_transaction_commit (t=t@entry=0x7fffe1eb21b0) at mail-index-transaction.c:236 result = {log_file_seq = 0, log_file_offset = 0, commit_size = 0, ignored_modseq_changes = 0} #12 0x00007f00285031ea in mdbox_write_index_header (box=box@entry=0xb37170, update=update@entry=0x0, trans=0xb3dd30, trans@entry=0x0) at mdbox-storage.c:312 mbox = 0xb37170 new_trans = 0x0 view = 0x0 hdr = 0xb39350 uid_validity = 1306175967 uid_next = 0 #13 0x00007f002850344c in mdbox_mailbox_get_guid (guid_r=0x7fffe1eb2370 "", mbox=0xb37170) at mdbox-storage.c:391 need_resize = true ret = 0 idx_hdr = hdr = {map_uid_validity = 0, mailbox_guid = '\000' , flags = 0 '\000', unused = "\000\000"} #14 mdbox_mailbox_get_metadata (box=0xb37170, items=, metadata_r=0x7fffe1eb2370) at mdbox-storage.c:411 items = metadata_r = 0x7fffe1eb2370 box = 0xb37170 mbox = 0xb37170 #15 0x00007f0028555a15 in index_list_get_metadata (box=0xb37170, items=MAILBOX_METADATA_GUID, metadata_r=0x7fffe1eb2370) at mailbox-list-index-status.c:202 ibox = 0xb37a70 #16 0x00007f0028542345 in mailbox_get_metadata (box=0xb37170, items=items@entry=MAILBOX_METADATA_GUID, metadata_r=metadata_r@entry=0x7fffe1eb2370) at mail-storage.c:1544 __FUNCTION__ = "mailbox_get_metadata" #17 0x00007f0028556324 in node_lookup_guid (ctx=, guid_r=0x7fffe1eb2358 "", node=0xb22780) at mailbox-list-index-sync.c:25 box = 0xb37170 vname = str = 0xaf9920 ns_sep = metadata = {guid = '\000' , virtual_size = 0, cache_fields = 0x0, precache_fields = (unknown: 0), backend_ns_prefix = 0x0, backend_ns_type = (unknown: 0)} #18 node_add_to_index (seq_r=0x7fffe1eb2330, node=0xb22780, ctx=0xb34ef0) at mailbox-list-index-sync.c:45 _data_stack_cur_id = 6 irec = {name_id = 65, parent_uid = 0, guid = '\000' , uid_validity = 0} seq = 11759984 #19 mailbox_list_index_node_add (seq_r=0x7fffe1eb2330, name=, parent=, ctx=0xb34ef0) at mailbox-list-index-sync.c:87 node = 0xb22780 dup_name = 0xb227b0 "GoogleMail 01.04.2014 19:58" #20 mailbox_list_index_sync_name (ctx=ctx@entry=0xb34ef0, name=, node_r=node_r@entry=0x7fffe1eb2418, created_r=created_r@entry=0x7fffe1eb240b) at mailbox-list-index-sync.c:125 path = 0xaf9808 empty_path = {0x7f00285982ff "", 0x0} node = parent = i = 0 seq = 0 ---Type to continue, or q to quit--- __FUNCTION__ = "mailbox_list_index_sync_name" #21 0x00007f002855694a in mailbox_list_index_sync_list (sync_ctx=0xb34ef0) at mailbox-list-index-sync.c:318 name = _data_stack_cur_id = 5 iter = 0xb352c0 info = 0xb35340 flags = (unknown: 0) node = 0xb21c40 seq = patterns = {0x7f00285a55d3 "*", 0x0} created = false #22 mailbox_list_index_sync (list=list@entry=0xb15df0) at mailbox-list-index-sync.c:390 sync_ctx = 0xb34ef0 ret = 0 #23 0x00007f002855184e in mailbox_list_index_refresh (list=0xb15df0) at mailbox-list-index.c:380 ilist = 0xb16288 view = 0xb27890 ret = #24 0x00007f0028553169 in iter_use_index (ctx=0xb26dc0, ctx=0xb26dc0) at mailbox-list-index-iter.c:25 ilist = 0xb16288 #25 mailbox_list_index_iter_init (list=0xb15df0, patterns=0xb26c88, flags=(MAILBOX_LIST_ITER_RETURN_CHILDREN | MAILBOX_LIST_ITER_RETURN_SPECIALUSE)) at mailbox-list-index-iter.c:52 ilist = 0xb16288 ctx = 0xb26dc0 pool = 0xb26da0 ns_sep = #26 0x00007f0028556ec9 in mailbox_list_iter_init_multiple (list=0xb15df0, patterns=, flags=(MAILBOX_LIST_ITER_RETURN_CHILDREN | MAILBOX_LIST_ITER_RETURN_SPECIALUSE)) at mailbox-list-iter.c:173 ctx = ret = 0 #27 0x00007f0028558179 in mailbox_list_ns_iter_try_next (info_r=, _ctx=0xb269b0) at mailbox-list-iter.c:574 ctx = 0xb269b0 info = errstr = has_children = ns = error = MAIL_ERROR_NONE #28 mailbox_list_ns_iter_next (_ctx=0xb269b0) at mailbox-list-iter.c:645 info = #29 0x00007f0028556baf in mailbox_list_iter_next_call (ctx=ctx@entry=0xb269b0) at mailbox-list-iter.c:941 info = set = #30 0x00007f00285577c4 in mailbox_list_iter_next (ctx=0xb269b0) at mailbox-list-iter.c:1012 _data_stack_cur_id = 4 info = #31 0x000000000040f089 in cmd_list_continue (cmd=cmd@entry=0xb24190) at cmd-list.c:229 ctx = 0xb242a8 info = flags = str = 0xaf93a0 mutf7_name = 0xaf94f0 name = ret = #32 0x000000000040f8ce in cmd_list_full (cmd=0xb24190, lsub=) at cmd-list.c:463 client = args = 0xb04a98 ---Type to continue, or q to quit--- list_args = 0x0 arg_count = 32512 ctx = 0xb242a8 patterns = {arr = {buffer = 0xb24300, element_size = 8}, v = 0xb24300, v_modifiable = 0xb24300} ref = 0xb242d8 "" pattern = 0xb242e0 "GoogleMail 01.04.2014 19:58" str = #33 0x0000000000416adc in command_exec (cmd=0xb24190) at imap-commands.c:158 hook = 0xb020f0 ret = #34 0x0000000000415b3f in client_command_input (cmd=0xb24190) at imap-client.c:780 client = 0xb235b0 command = __FUNCTION__ = "client_command_input" #35 0x0000000000415bf5 in client_command_input (cmd=0xb24190) at imap-client.c:841 client = 0xb235b0 command = __FUNCTION__ = "client_command_input" #36 0x0000000000415ef5 in client_handle_next_command (remove_io_r=, client=0xb235b0) at imap-client.c:879 No locals. #37 client_handle_input (client=client@entry=0xb235b0) at imap-client.c:891 _data_stack_cur_id = 3 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #38 0x0000000000416282 in client_input (client=0xb235b0) at imap-client.c:933 cmd = 0xb16a70 output = 0xb23fe0 bytes = 42 __FUNCTION__ = "client_input" #39 0x00007f0028269a87 in io_loop_call_io (io=0xb240b0) at ioloop.c:388 ioloop = 0xb01730 t_id = 2 #40 0x00007f002826a817 in io_loop_handler_run (ioloop=ioloop@entry=0xb01730) at ioloop-epoll.c:220 ctx = 0xb023d0 list = 0xb03e00 io = tv = {tv_sec = 1799, tv_usec = 999837} events_count = msecs = ret = 1 i = 0 call = __FUNCTION__ = "io_loop_handler_run" #41 0x00007f0028269628 in io_loop_run (ioloop=0xb01730) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #42 0x00007f002821a5c3 in master_service_run (service=0xb015c0, callback=callback@entry=0x41ec00 ) at master-service.c:566 No locals. #43 0x000000000040b03f in main (argc=1, argv=0xb01390) at main.c:400 set_roots = {0x4269a0 , 0x0} login_set = {auth_socket_path = 0xaf9058 "(", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x41efb0 , failure_callback = 0x41ece0 , request_auth_token = 1} service_flags = storage_service_flags = username = 0x0 ---Type to continue, or q to quit--- c = ================== Apr 1 20:19:42 dovecot01 dovecot: indexer-worker(user(a)domain.de): Panic: file mail-index-transaction-export.c: line 117 (log_append_ext_intro): assertion failed: (intro->ext_id == idx || idx == (uint32_t)-1) Apr 1 20:19:42 dovecot01 dovecot: indexer-worker(user(a)domain.de): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x66ab1) [0x7f77b4f2aab1] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x66b8e) [0x7f77b4f2ab8e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f77b4ee63ce] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb9c72) [0x7f77b524fc72] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_export+0x200) [0x7f77b5250140] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb932f) [0x7f77b524f32f] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x9d) [0x7f77b524f78d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit+0xc) [0x7f77b524f82c] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x3e1ea) [0x7f77b51d41ea] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x3e44c) [0x7f77b51d444c] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x90a15) [0x7f77b5226a15] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_metadata+0x95) [0x7f77b5213345] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync_name+0x2a4) [0x7f77b5227324] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync+0x10a) [0x7f77b522794a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_refresh+0x9e) [0x7f77b522284e] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9072e) [0x7f77b522672e] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x909a3) [0x7f77b52269a3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_deinit+0x22) [0x7f77b5211ef2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x39) [0x7f77b5211fa9] -> dovecot/indexer-worker [user(a)domain.de INBOX]() [0x4022f7] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7f77b4f3aa87] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7f77b4f3b817] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f77b4f3a628] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f77b4eeb5c3] -> dovecot/indexer-worker [user(a)domain.de INBOX](main+0xe3) [0x401f03] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f77b4b1dde5] -> dovecot/indexer-worker [user(a)domain.de INBOX]() [0x401fc2] Apr 1 20:19:42 dovecot01 dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for user(a)domain.de Apr 1 20:19:42 dovecot01 dovecot: indexer-worker(user(a)domain.de): Fatal: master: service(indexer-worker): child 8806 killed with signal 6 (core dumped) ================== Core was generated by `dovecot/indexer-worker'. Program terminated with signal 6, Aborted. #0 0x00007f77b4b32f77 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 56 ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory. (gdb) bt full #0 0x00007f77b4b32f77 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 resultvar = 0 pid = 8806 selftid = 8806 #1 0x00007f77b4b365e8 in __GI_abort () at abort.c:90 save_stage = 2 act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {12654816, 0, 140152119483509, 140149077835777, 0, 4202243, 140152109280488, 140733744696321, 0, 12801792, 140152119510821, 0, 140152110221056, 140152116161696, 12659256, 140733744696092}}, sa_flags = 4096, sa_restorer = 0x7f77b4b4a134 } sigs = {__val = {32, 0 }} #2 0x00007f77b4f2aad8 in default_fatal_finish (type=, status=status@entry=0) at failures.c:192 backtrace = 0xc119e8 "/usr/local/lib/dovecot/libdovecot.so.0(+0x66ab1) [0x7f77b4f2aab1] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x66b8e) [0x7f77b4f2ab8e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f77b4ee6"... #3 0x00007f77b4f2ab8e in i_internal_fatal_handler (ctx=0x7fff20dc4cb0, format=, args=) at failures.c:653 status = 0 #4 0x00007f77b4ee63ce in i_panic (format=format@entry=0x7f77b5268088 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:264 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fff20dc4da0, reg_save_area = 0x7fff20dc4ce0}} #5 0x00007f77b524fc72 in log_append_ext_intro (ctx=ctx@entry=0x7fff20dc4ec0, ext_id=ext_id@entry=5, reset_id=0, hdr_size_r=hdr_size_r@entry=0x7fff20dc4e98) at mail-index-transaction-export.c:117 t = 0xc6d700 intro = 0xc6dac4 resizes = 0xc6da60 buf = 0xc118e0 idx = 0 count = 6 __FUNCTION__ = "log_append_ext_intro" #6 0x00007f77b5250140 in mail_transaction_log_append_ext_intros (ctx=0x7fff20dc4ec0) at mail-index-transaction-export.c:283 resize = ext_reset = {new_reset_id = 0, preserve_data = 0 '\000', unused_padding = "\000\000"} resize_count = ext_count = 6 hdrs = hdrs_count = 6 ext_id = 5 reset_count = 0 hdr_size = 0 reset = 0x0 reset_buf = {data = 0x7fff20dc4ea0, used = 8, priv = {0x7fff20dc4ea0, 0x0, 0x8, 0x0, 0x0}} t = reset_id_count = 0 reset_id = reset_ids = 0x0 #7 mail_index_transaction_export (t=t@entry=0xc6d700, append_ctx=0xc6dcd0) at mail-index-transaction-export.c:409 null4 = "\000\000\000" change_mask = (unknown: 0) ctx = {trans = 0xc6d700, append_ctx = 0xc6dcd0} __FUNCTION__ = "mail_index_transaction_export" #8 0x00007f77b524f32f in mail_index_transaction_commit_real (commit_size_r=0x7fff20dc5000, t=0xc6d700) at mail-index-transaction.c:165 _data_stack_cur_id = 6 ctx = 0xc6dcd0 log_seq2 = 0 log_offset1 = 140733744697296 log = 0xc35bb0 trans_flags = ---Type to continue, or q to quit--- log_seq1 = 24 log_offset2 = 140733193388038 #9 mail_index_transaction_commit_v (t=0xc6d700, result_r=0x7fff20dc4ff0) at mail-index-transaction.c:203 index = 0xc35190 changed = true ret = __FUNCTION__ = "mail_index_transaction_commit_v" #10 0x00007f77b524f78d in mail_index_transaction_commit_full (_t=_t@entry=0x7fff20dc5030, result_r=result_r@entry=0x7fff20dc4ff0) at mail-index-transaction.c:262 t = 0xc6d700 index = 0xc35190 index_undeleted = false #11 0x00007f77b524f82c in mail_index_transaction_commit (t=t@entry=0x7fff20dc5030) at mail-index-transaction.c:236 result = {log_file_seq = 0, log_file_offset = 0, commit_size = 0, ignored_modseq_changes = 0} #12 0x00007f77b51d41ea in mdbox_write_index_header (box=box@entry=0xc345c0, update=update@entry=0x0, trans=0xc6d700, trans@entry=0x0) at mdbox-storage.c:312 mbox = 0xc345c0 new_trans = 0x0 view = 0x0 hdr = 0xc45e00 uid_validity = 1306175995 uid_next = 3038592790 #13 0x00007f77b51d444c in mdbox_mailbox_get_guid (guid_r=0x7fff20dc51f0 "", mbox=0xc345c0) at mdbox-storage.c:391 need_resize = true ret = 0 idx_hdr = hdr = {map_uid_validity = 0, mailbox_guid = '\000' , flags = 0 '\000', unused = "\000\000"} #14 mdbox_mailbox_get_metadata (box=0xc345c0, items=, metadata_r=0x7fff20dc51f0) at mdbox-storage.c:411 items = metadata_r = 0x7fff20dc51f0 box = 0xc345c0 mbox = 0xc345c0 #15 0x00007f77b5226a15 in index_list_get_metadata (box=0xc345c0, items=MAILBOX_METADATA_GUID, metadata_r=0x7fff20dc51f0) at mailbox-list-index-status.c:202 ibox = 0xc34ed0 #16 0x00007f77b5213345 in mailbox_get_metadata (box=0xc345c0, items=items@entry=MAILBOX_METADATA_GUID, metadata_r=metadata_r@entry=0x7fff20dc51f0) at mail-storage.c:1544 __FUNCTION__ = "mailbox_get_metadata" #17 0x00007f77b5227324 in node_lookup_guid (ctx=, guid_r=0x7fff20dc51d8 "", node=0xc30110) at mailbox-list-index-sync.c:25 box = 0xc345c0 vname = str = 0xc11428 ns_sep = metadata = {guid = '\000' , virtual_size = 0, cache_fields = 0x0, precache_fields = (unknown: 0), backend_ns_prefix = 0x0, backend_ns_type = (unknown: 0)} #18 node_add_to_index (seq_r=0x7fff20dc51b0, node=0xc30110, ctx=0xc25bb0) at mailbox-list-index-sync.c:45 _data_stack_cur_id = 5 irec = {name_id = 86, parent_uid = 76, guid = '\000' , uid_validity = 0} seq = 12797376 #19 mailbox_list_index_node_add (seq_r=0x7fff20dc51b0, name=, parent=, ctx=0xc25bb0) at mailbox-list-index-sync.c:87 node = 0xc30110 dup_name = 0xc30140 "Drafts" #20 mailbox_list_index_sync_name (ctx=ctx@entry=0xc25bb0, name=, node_r=node_r@entry=0x7fff20dc5298, created_r=created_r@entry=0x7fff20dc528b) at mailbox-list-index-sync.c:125 path = 0xc11310 empty_path = {0x7f77b52692ff "", 0x0} node = parent = i = 1 seq = 0 ---Type to continue, or q to quit--- __FUNCTION__ = "mailbox_list_index_sync_name" #21 0x00007f77b522794a in mailbox_list_index_sync_list (sync_ctx=0xc25bb0) at mailbox-list-index-sync.c:318 name = _data_stack_cur_id = 4 iter = 0xc31b30 info = 0xc31bb0 flags = (unknown: 0) node = 0xc2ff18 seq = patterns = {0x7f77b52765d3 "*", 0x0} created = false #22 mailbox_list_index_sync (list=list@entry=0xc49360) at mailbox-list-index-sync.c:390 sync_ctx = 0xc25bb0 ret = 0 #23 0x00007f77b522284e in mailbox_list_index_refresh (list=0xc49360) at mailbox-list-index.c:380 ilist = 0xc497f8 view = 0xc275a0 ret = #24 0x00007f77b522672e in index_list_update_mailbox (box=box@entry=0xc4a1a0) at mailbox-list-index-status.c:363 ilist = 0xc497f8 list_sync_ctx = 0xc27270 list_view = 0xc48c20 list_trans = 0x7f77b5213a75 changes = {status = {messages = 256, recent = 0, unseen = 12890576, uidvalidity = 0, uidnext = 65, first_unseen_seq = 0, first_recent_uid = 12886432, last_cached_seq = 0, highest_modseq = 140733744698432, highest_pvt_modseq = 12888328, keywords = 0xc49718, permanent_flags = 3025012879, permanent_keywords = 1, allow_new_keywords = 1, nonpermanent_modseqs = 1, have_guids = 0, have_save_guids = 1, have_only_guid128 = 1}, guid = "\360\261\304\000\000\000\000\000p\247\304\000\000\000\000", seq = 12890576, rec_changed = false, msgs_changed = false, hmodseq_changed = false} ret = __FUNCTION__ = "index_list_update_mailbox" #25 0x00007f77b52269a3 in index_list_sync_deinit (ctx=0x0, status_r=0x7fff20dc5440) at mailbox-list-index-status.c:470 box = 0xc4a1a0 ibox = #26 0x00007f77b5211ef2 in mailbox_sync_deinit (_ctx=_ctx@entry=0x7fff20dc5448, status_r=status_r@entry=0x7fff20dc5440) at mail-storage.c:1691 ctx = box = 0xc4a1a0 errormsg = error = MAIL_ERROR_NONE ret = #27 0x00007f77b5211fa9 in mailbox_sync (box=, flags=) at mail-storage.c:1717 ctx = 0x0 status = {sync_delayed_expunges = 0} #28 0x00000000004022f7 in index_mailbox (what=0xc0f07e "i", max_recent_msgs=0, mailbox=0xc0f076 "INBOX", user=0xc52f00, conn=0xc1bfb0) at master-connection.c:161 box = 0xc4a1a0 status = {messages = 5000, recent = 0, unseen = 3035915435, uidvalidity = 32631, uidnext = 64, first_unseen_seq = 0, first_recent_uid = 12679056, last_cached_seq = 0, highest_modseq = 5000, highest_pvt_modseq = 213, keywords = 0x7f77b4f01ac0 , permanent_flags = 12838464, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, have_guids = 0, have_save_guids = 0, have_only_guid128 = 0} errstr = ret = 0 ns = path = 0xc11048 "/mnt/filestorage01/team.mail.de/m.kliewe/maildir/mailboxes/INBOX/dbox-Mails" error = MAIL_ERROR_NONE sync_flags = #29 master_connection_input_line (line=, conn=0xc1bfb0) at master-connection.c:208 str = max_recent_msgs = 0 ---Type to continue, or q to quit--- ret = args = input = {module = 0x4029ff "mail", service = 0x4029f0 "indexer-worker", username = 0xc0f060 "m.kliewe(a)team.mail.de", session_id = 0x0, local_ip = {family = 0, u = {ip6 = { __in6_u = {__u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = { family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = (unknown: 0), flags_override_remove = (unknown: 0), no_userdb_lookup = 0} service_user = 0xc1f098 user = 0xc52f00 error = 0x7fff20dc5620 "\002" #30 master_connection_input (conn=0xc1bfb0) at master-connection.c:245 _data_stack_cur_id = 3 line = #31 0x00007f77b4f3aa87 in io_loop_call_io (io=0xc1bff0) at ioloop.c:388 ioloop = 0xc17730 t_id = 2 #32 0x00007f77b4f3b817 in io_loop_handler_run (ioloop=ioloop@entry=0xc17730) at ioloop-epoll.c:220 ctx = 0xc1a560 list = 0xc1c040 io = tv = {tv_sec = 0, tv_usec = 0} events_count = msecs = ret = 1 i = 0 call = __FUNCTION__ = "io_loop_handler_run" #33 0x00007f77b4f3a628 in io_loop_run (ioloop=0xc17730) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #34 0x00007f77b4eeb5c3 in master_service_run (service=0xc175c0, callback=callback@entry=0x402090 ) at master-service.c:566 No locals. #35 0x0000000000401f03 in main (argc=1, argv=0xc17390) at indexer-worker.c:78 storage_service_flags = (MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT | MAIL_STORAGE_SERVICE_FLAG_USERDB_LOOKUP | MAIL_STORAGE_SERVICE_FLAG_TEMP_PRIV_DROP | MAIL_STORAGE_SERVICE_FLAG_NO_IDLE_TIMEOUT) c = ==================

3 2

[Dovecot] sieve - different sieve scripts
by Héctor Moreno Blanco 07 May '14

07 May '14

Hello everybody, We have Dovecot 2.1.6 and PigeonHole 0.3.0. Is possible to have two different sieve scripts working at the same time? My sieve configuration in dovecot.conf: ... managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify ... sieve = %h/.dovecot.sieve sieve_dir = %h/sieve sieve_extensions = +imapflags +notify } protocols = imap pop3 sieve ... service managesieve-login { executable = /usr/local/dovecot/libexec/dovecot/managesieve-login inet_listener sieve { address = * port = 4190 } inet_listener sieve_deprecated { address = * port = 12000 } user = vmail } service managesieve { executable = /usr/local/dovecot/libexec/dovecot/managesieve } ... protocol sieve { managesieve_implementation_string = dovecot Pigeonhole managesieve_logout_format = bytes ( in=%i : out=%o ) managesieve_max_line_length = 65536 } Thank you very much in advanced. Kind regards. Héctor Moreno Blanco. P Please consider the environment before printing this e-mail. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________

5 5

[Dovecot] WG: on High Load using IMAPSYNC : Panic: file ostream-lzma.c: line 147: unreached. Dovecot 2.2.12 with zlib/XZ compression
by Robert Nowotny 07 May '14

07 May '14

when syncing Mailboxes with IMAPSYNC, using xz compression the dbox file gets corrupted. the same configuration was working ok on low load with xz compression. Dovecot Version 2.2.12 Linux Mint 16 EXT4 Filesystem another dovecot user already reported the same problem on the mailinglist, using dsync. That user switched to bz2 compression what worked for him. the answer was : > are you on latest patchlevel ? > there are some dsync fixes since 2.2.12 but it is not a problem of dsync. when looking at the code, we get here an unexpected returnvalue when flushing. I propose it would be good practice to write some logging in the default switch cases, to see the unexpected returnvalues in the errorlog. something like : ostream-lzma.c : -- Line 147 : i_unreached(); ++ Line 147 : i_fatal("unexpected lzma errorcode when flushing : %s", ret); after that modification the errorlog shows : May 6 14:03:05 vm-imap dovecot: imap(test): Fatal: lzma errorcode when flushing : (null) maybe You can also investigate and let me know when fixed. Here the log : May 5 14:53:10 vm-imap dovecot: imap(rrernboeck): Panic: file ostream-lzma.c: line 147: unreached May 5 14:53:10 vm-imap dovecot: imap(rrernboeck): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x67450) [0x7ff99d8ce450] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x6752e) [0x7ff99d8ce52e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7ff99d88955e] -> /usr/local/lib/dovecot/lib20_zlib_plugin.so(+0x4f0a) [0x7ff99ce87f0a] -> /usr/local/lib/dovecot/libdovecot.so.0(o_stream_flush+0x3e) [0x7ff99d8e6dbe] -> /usr/local/lib/dovecot/libdovecot.so.0(o_stream_nflush+0xf) [0x7ff99d8e71df] -> /usr/local/lib/dovecot/libdovecot.so.0(o_stream_nfinish+0x9) [0x7ff99d8e7229] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(dbox_save_end+0x29) [0x7ff99db7cfa9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mdbox_save_finish+0x39) [0x7ff99db76619] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_finish+0x4d) [0x7ff99dbb6a4d] -> dovecot/imap [rrernboeck 127.0.0.1 APPEND]() [0x40be09] -> dovecot/imap [rrernboeck 127.0.0.1 APPEND](command_exec+0x3c) [0x416cfc] -> dovecot/imap [rrernboeck 127.0.0.1 APPEND]() [0x40b491] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7ff99d8de527] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7ff99d8df2b7] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7ff99d8de0c8] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7ff99d88e753] -> dovecot/imap [rrernboeck 127.0.0.1 APPEND](main+0x2af) [0x40b06f] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7ff99d4c0de5] -> dovecot/imap [rrernboeck 127.0.0.1 APPEND]() [0x40b1cc] May 5 14:53:10 vm-imap dovecot: imap(rrernboeck): Fatal: master: service(imap): child 47957 killed with signal 6 (core dumped) May 5 14:53:10 vm-imap dovecot: imap(rrernboeck): Error: Corrupted dbox file /home/vmail/virtualmailboxes/rrernboeck/storage/m.1 (around offset=1302): msg header has bad magic value

3 4

[Dovecot] crash while fts searching a virtual folder
by Matthias Rieber 07 May '14

07 May '14

Hi, searching a virtual folder crashes dovecot quite often. I'm using dovecot 2.2.12. Here's the backtrace: [New LWP 28245] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. #0 0x00007fc1d73f4425 in raise () from /lib/x86_64-linux-gnu/libc.so.6 #0 0x00007fc1d73f4425 in raise () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #1 0x00007fc1d73f7b8b in abort () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #2 0x00007fc1d77e6d45 in default_fatal_finish (type=<optimized out>, status=0) at failures.c:193 backtrace = 0x1cdc318 "/usr/local/lib/dovecot/libdovecot.so.0(+0x68d4f) [0x7fc1d77e6d4f] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x68dae) [0x7fc1d77e6dae] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fc1d77a0"... #3 0x00007fc1d77e6dae in i_internal_fatal_handler (ctx=0x7fff86d4b2d0, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007fc1d77a03b9 in i_panic (format=<optimized out>) at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fff86d4b3a0, reg_save_area = 0x7fff86d4b2e0}} #5 0x00007fc1d6774ed9 in level_scores_add_vuids (br=0x2413ab8, level=0x1c0c2e0, vbox=0x170c950) at fts-search.c:81 i = <optimized out> count = 234 backend_uids = {arr = {buffer = 0x1cdbe90, element_size = 8}, v = 0x1cdbe90, v_modifiable = 0x1cdbe90} vuids_arr = {arr = {buffer = 0x1cdba98, element_size = 4}, v = 0x1cdba98, v_modifiable = 0x1cdba98} vuids = 0xea scores = 0x23c8f50 score = 0xea #6 multi_add_lookup_result (args=0x1bbb220, level=0x1c0c2e0, fctx=0x18c2240, result=<optimized out>) at fts-search.c:146 br = 0x2413ab8 vbox = 0x170c950 vuids = {arr = {buffer = 0x16dbe70, element_size = 8}, v = 0x16dbe70, v_modifiable = 0x16dbe70} orig_size = <optimized out> i = <optimized out> #7 fts_search_lookup_level_multi (and_args=true, args=0x1bbb220, fctx=0x18c2240) at fts-search.c:194 mailboxes_arr = {arr = {buffer = 0x1e0a580, element_size = 8}, v = 0x1e0a580, v_modifiable = 0x1e0a580} backend = <optimized out> j = 60 vbox = <optimized out> mailboxes = 0x1e0a5b8 level = 0x1c0c2e0 result = {pool = 0x1e0a560, box_results = 0x2413838} i = <optimized out> mailbox_count = 60 #8 fts_search_lookup_level (fctx=0x18c2240, args=0x1bbb220, and_args=true) at fts-search.c:208 _data_stack_cur_id = 4 ret = <optimized out> #9 0x00007fc1d6774f86 in fts_search_lookup (fctx=<optimized out>) at fts-search.c:354 last_uid = 32653 seq1 = 0 seq2 = 0 __FUNCTION__ = "fts_search_lookup" #10 0x00007fc1d6776388 in fts_mailbox_search_init (t=<optimized out>, args=0x1bbb160, sort_program=<optimized out>, wanted_fields=0, wanted_headers=0x0) at fts-storage.c:207 ft = 0x1d4be20 fbox = <optimized out> flist = 0x1706610 ctx = 0x192f540 fctx = 0x18c2240 #11 0x000000000041caa0 in imap_search_start (ctx=0x170a238, sargs=0x1bbb160, sort_program=0x0) at imap-search.c:576 cmd = 0x170a130 __FUNCTION__ = "imap_search_start" #12 0x00000000004117b6 in cmd_search (cmd=0x170a130) at cmd-search.c:48 ctx = 0x170a238 sargs = 0x1bbb160 args = 0x16e2a38 charset = 0x424d0b "UTF-8" ret = <optimized out> #13 0x000000000041734d in command_exec (cmd=0x170a130) at imap-commands.c:158 hook = 0x16e00f0 ret = <optimized out> #14 0x00000000004163e0 in client_command_input (cmd=0x170a130) at imap-client.c:780 client = 0x17095e0 command = <optimized out> __FUNCTION__ = "client_command_input" #15 0x00000000004164c5 in client_command_input (cmd=0x170a130) at imap-client.c:841 client = 0x17095e0 command = <optimized out> __FUNCTION__ = "client_command_input" #16 0x000000000041676d in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x17095e0) at imap-client.c:879 No locals. #17 client_handle_input (client=0x17095e0) at imap-client.c:891 _data_stack_cur_id = 3 ret = 48 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #18 0x0000000000416ae2 in client_input (client=0x17095e0) at imap-client.c:933 cmd = <optimized out> output = 0x1709ff0 bytes = 26 __FUNCTION__ = "client_input" #19 0x00007fc1d77f7616 in io_loop_call_io (io=0x17071a0) at ioloop.c:388 ioloop = 0x16df730 t_id = 2 #20 0x00007fc1d77f84cf in io_loop_handler_run (ioloop=<optimized out>) at ioloop-epoll.c:220 ctx = 0x16e03d0 events = 0x0 event = 0x16e1230 list = 0x16e1e00 io = <optimized out> tv = {tv_sec = 2, tv_usec = 425339} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #21 0x00007fc1d77f7128 in io_loop_run (ioloop=0x16df730) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #22 0x00007fc1d77a57d3 in master_service_run (service=0x16df5c0, callback=<optimized out>) at master-service.c:566 No locals. #23 0x000000000040af58 in main (argc=1, argv=0x16df390) at main.c:400 set_roots = {0x427840, 0x0} login_set = {auth_socket_path = 0x16d7058 "", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x41fb00 <login_client_connected>, failure_callback = 0x41f810 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = <optimized out> c = <optimized out> Rebuilding the fts index and erasing all dovecot.index.* files didn't help. Regards, Matthias

2 3

[Dovecot] Can Auth dict proxy protocol be used to validate a password?
by Thomas Johnson 07 May '14

07 May '14

I'm interested in using authentication via a UNIX socket as documented at http://wiki2.dovecot.org/AuthDatabase/Dict. (We are currently using a checkpassword script to enable us to authenticate against a django app that stores passwords in pbkdf2 format, but I'm concerned about scalability as we grow - specifically the comment about performance on http://wiki2.dovecot.org/AuthDatabase/CheckPassword) The example clearly shows retrieving a password, but is there some way to validate a password that was provided the way a checkpassword script does? Otherwise, for performance reasons, perhaps we should implement a new password scheme directly for dovecot? Thanks- Tom

2 1

[Dovecot] Again: pop3: Panic: Trying to allocate 0 bytes
by Urban Loesch 07 May '14

07 May '14

Hi, in April I wrote an e-mail to the list, that with dovecot 2.2.12 on debian squeeze some pop3-sessions were killed sometimes. But I got no anwser from the list. At this was not a urgend problem and it happend very rarely it was not a big problem. But today it happend again more several times and I have no idea why. I have the following in my errorlog: ... May 6 13:26:52 mailstore dovecot: pop3(user(a)domain.com pid:48986 session:<bLxBhrn4ywBCNkO3>): Panic: Trying to allocate 0 bytes May 6 13:26:52 mailstore dovecot: pop3(user(a)domain.com pid:48986 session:<bLxBhrn4ywBCNkO3>): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x6c38a) [0x7f8ed4c7538a] -> /usr/lib/dovecot/libdovecot.so.0(+0x6c406) [0x7f8ed4c75406] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f8ed4c2e1af] -> /usr/lib/dovecot/libdovecot.so.0(+0x81e1b) [0x7f8ed4c8ae1b] -> dovecot/pop3() [0x4077f0] -> dovecot/pop3(client_command_execute+0x9d) [0x407d0d] -> dovecot/pop3(client_handle_input+0x80) [0x405810] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4e) [0x7f8ed4c856ae] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xaf) [0x7f8ed4c8682f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f8ed4c85739] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f8ed4c857c8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f8ed4c32f63] -> dovecot/pop3(main+0x257) [0x404a67] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f8ed48c5c8d] -> dovecot/pop3() [0x4045b9] May 6 13:26:52 mailstore dovecot: pop3(user(a)domain.com pid:48986 session:<bLxBhrn4ywBCNkO3>): Fatal: master: service(pop3): child 48986 killed with signal 6 (core dumped) ... I got a coredump. Here comes the backtrace: ... (gdb) bt full #0 0x00007f8ed48d91b5 in raise () from /lib/libc.so.6 No symbol table info available. #1 0x00007f8ed48dbfc0 in abort () from /lib/libc.so.6 No symbol table info available. #2 0x00007f8ed4c75380 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:193 backtrace = 0x1c180c8 "/usr/lib/dovecot/libdovecot.so.0(+0x6c38a) [0x7f8ed4c7538a] -> /usr/lib/dovecot/libdovecot.so.0(+0x6c406) [0x7f8ed4c75406] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f8ed4c2e1af] -> /usr/lib/d"... #3 0x00007f8ed4c75406 in i_internal_fatal_handler (ctx=0x7fff547b5940, format=<value optimized out>, args=<value optimized out>) at failures.c:657 status = 0 #4 0x00007f8ed4c2e1af in i_panic (format=0xbf5a <Address 0xbf5a out of bounds>) at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 16, fp_offset = 48, overflow_arg_area = 0x7fff547b5a10, reg_save_area = 0x7fff547b5950}} #5 0x00007f8ed4c8ae1b in pool_system_malloc (pool=<value optimized out>, size=0) at mempool-system.c:81 No locals. #6 0x00000000004077f0 in client_uidls_save (client=0x1c42990, seq=0) at pop3-commands.c:798 str = <value optimized out> permanent_uidl = <value optimized out> search_ctx = 0x1c230d0 mail = <value optimized out> prev_uidls = {_table = 0x1c23330, _key = 0x1c23330 "\300o\355Ԏ\177", _keyp = 0x1c23330, _const_key = 0x1c23330 "\300o\355Ԏ\177", _value = 0x1c23330, _valuep = 0x1c23330} search_args = 0x0 seq_uidls = 0x60a4d8 uidl = <value optimized out> wanted_fields = <value optimized out> #7 cmd_uidl_init (client=0x1c42990, seq=0) at pop3-commands.c:842 ctx = <value optimized out> search_args = <value optimized out> wanted_fields = <value optimized out> #8 0x0000000000407d0d in cmd_uidl (client=0x1c42990, name=<value optimized out>, args=0x408820 "") at pop3-commands.c:873 ctx = <value optimized out> seq = <value optimized out> #9 client_command_execute (client=0x1c42990, name=<value optimized out>, args=0x408820 "") at pop3-commands.c:938 No locals. #10 0x0000000000405810 in client_handle_input (client=0x1c42990) at pop3-client.c:739 _data_stack_cur_id = 3 line = <value optimized out> args = 0x408820 "" ret = <value optimized out> #11 0x00007f8ed4c856ae in io_loop_call_io (io=0x1c414a0) at ioloop.c:441 ioloop = 0x1c20740 t_id = 2 __FUNCTION__ = "io_loop_call_io" #12 0x00007f8ed4c8682f in io_loop_handler_run_internal (ioloop=<value optimized out>) at ioloop-epoll.c:220 ctx = 0x1c20aa0 event = 0x1c21910 list = 0x1c22500 io = 0xbf5a tv = {tv_sec = 9, tv_usec = 999120} msecs = <value optimized out> ret = 1 i = 0 call = false __FUNCTION__ = "io_loop_handler_run_internal" #13 0x00007f8ed4c85739 in io_loop_handler_run (ioloop=0xbf5a) at ioloop.c:488 No locals. #14 0x00007f8ed4c857c8 in io_loop_run (ioloop=0x1c20740) at ioloop.c:465 __FUNCTION__ = "io_loop_run" #15 0x00007f8ed4c32f63 in master_service_run (service=0x1c205d0, callback=0xbf5a) at master-service.c:566 No locals. #16 0x0000000000404a67 in main (argc=1, argv=0x1c20390) at main.c:277 set_roots = {0x409480, 0x0} login_set = {auth_socket_path = 0x1c18050 "/var/run/dovecot/auth-master", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x404c40 <login_client_connected>, failure_callback = 0x404bf0 <login_client_failed>, request_auth_token = 0} service_flags = <value optimized out> storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 ---Type <return> to continue, or q <return> to quit--- c = <value optimized out> ... Can you help to resolve this issue? many Thanks Urban Loesch --------------------- doveconf -n --------------------- # 2.2.12 (16212e6d4fd4): /etc/dovecot/dovecot.conf # OS: Linux 3.4.67-vs2.3.3.9-rol-em64t-efigpt x86_64 Debian 6.0.9 ext4 auth_cache_negative_ttl = 0 auth_cache_size = 40 M auth_cache_ttl = 1 weeks auth_mechanisms = plain login deliver_log_format = msgid=%m: %$ %p %w disable_plaintext_auth = no info_log_path = syslog login_trusted_networks = $INTERNAL_IPS mail_gid = mailstore mail_location = mdbox:/home/vmail/%d/%n mail_log_prefix = "%s(%u pid:%p session:<%{session}>): " mail_plugins = " quota mail_log notify acl zlib stats virtual" mail_uid = mailstore managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate imapflags notify mdbox_rotate_size = 10 M namespace { list = children location = mdbox:/home/vmail/%%d/%%n prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { hidden = no inbox = no list = children location = virtual:/home/virtual:INDEX=~/virtual prefix = [rolmail]/ separator = / subscriptions = yes type = private } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Items" { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox [mail]/All { auto = no special_use = \All } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql-account.conf driver = sql } plugin { acl = vfile acl_shared_dict = file:/home/vmail/%d/shared-mailboxes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size from mail_log_group_events = no quota = dict:Storage used::file:%h/dovecot-quota quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_max_redirects = 10 stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 16 M stats_refresh = 30 secs stats_session_min_time = 15 mins stats_track_cmds = no stats_user_min_time = 1 hours zlib_save = gz zlib_save_level = 9 } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = mailstore mode = 0660 user = root } } service imap-login { inet_listener imap { port = 143 } process_limit = 48 process_min_avail = 3 service_count = 1 } service imap { process_limit = 48 process_min_avail = 2 service_count = 1 } service lmtp { inet_listener lmtp { port = 24 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service pop3-login { inet_listener pop3 { port = 110 } process_limit = 16 process_min_avail = 2 service_count = 1 } service pop3 { process_limit = 16 process_min_avail = 2 service_count = 1 } service quota-warning { executable = script /usr/local/rol/dovecot/quota-warning.sh unix_listener quota-warning { user = mailstore } user = mailstore } service stats { fifo_listener stats-mail { mode = 0600 user = mailstore } } ssl = no ssl_cert = </etc/dovecot/certs/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql-account.conf driver = sql } protocol lmtp { mail_fsync = optimized mail_plugins = " quota mail_log notify acl zlib stats virtual sieve zlib" } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep imap_id_log = * imap_logout_format = bytes=%i/%o session=<%{session}> mail_max_userip_connections = 20 mail_plugins = " quota mail_log notify acl zlib stats virtual imap_quota imap_acl imap_zlib imap_stats" } protocol pop3 { mail_plugins = " quota mail_log notify acl zlib stats virtual" pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_lock_session = yes pop3_logout_format = bytes_sent=%o top=%t/%p, retr=%r/%b, del=%d/%m, size=%s uidl_hash=%u session=<%{session}> pop3_reuse_xuidl = yes }

2 3

[Dovecot] When you send an email with specific characters are included, dovecot.sieve is aborted.
by Atsuko Tanaka 07 May '14

07 May '14

Hello. I found a problem of dovecot.sieve. When you send an email with specific characters are included, dovecot.sieve is aborted. Are you sure I report details to this mailing list? Please reply. Thank you. -- ---------------------------------------- Atsuko Tanaka DesigNET Inc. e-mail：tanaka(a)designet.co.jp ----------------------------------------

2 2

[Dovecot] Some Information about compression rates to expect using zlib/xz compression
by Robert Nowotny 07 May '14

07 May '14

compression : xz, Level 6 here some compression rates I experienced : Diskspace usage : user1: uncompressed : 2.3GB --> compressed 1 GB user2: uncompressed : 6.2GB --> compressed 3.9 GB just for your reference Ing. Robert Nowotny Rotek GmbH Vienna/Austria

1 0

Re: [Dovecot] LMTP, TLS/SSL, authentication, proxy
by Stanislas SABATIER 06 May '14

06 May '14

Hello, unfortunatly, TLS doesn't seem to work on LMTP, anyway, not by simply put ssl=yet to the lmtp inet_listener. I've tried and when I *openssl s_client -connect* to the lmtp listener I've got the following response : CONNECTED(00000003) 34379118248:error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol:/usr/src/secure/lib/libssl/../../../crypto/openssl/ssl/s23_clnt.c:766: My postfix server can't neither establish a TLS connection on LMTP listener. On 22.10.2013, at 14.37, Jogi Hofmüller <jogi(a)mur.at> wrote: Can dovecot use TLS/SSL on LTMP inet socket? Oct 26, 2013 8:11:19 am , Timo Sirainen <tss(a)iki.fi> replied: Probably. Try adding ssl=yes to the inet_listener {}. --------------------------------------------------------------- Stanislas SABATIER s.sabatier(a)pobox.com ---------------------------------------------------------------

1 0

[Dovecot] Status of sieve-extdata?
by Jiri Bourek 06 May '14

06 May '14

Hi, I'd like to ask about status of extdata plugin for sieve. The wiki page (http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Extdata) mentions versions for PigeonHole 0.2 and 0.3, but there seems to be no version for 0.4 and Dovecot 2.2. Is the plugin dead or is it planned to make version for Dovecot 2.2 (when time allows I guess)? Regards J.

2 5

[Dovecot] on High Load using IMAPSYNC : Panic: file ostream-lzma.c: line 147: unreached. Dovecot 2.2.12 with zlib/XZ compression
by Robert Nowotny 06 May '14

06 May '14

when syncing Mailboxes with IMAPSYNC, using xz compression the dbox file gets corrupted. the same configuration was working ok on low load with xz compression. Dovecot Version 2.2.12 Linux Mint 16 EXT4 Filesystem another dovecot user already reported the same problem on the mailinglist, using dsync. That user switched to bz2 compression what worked for him. the answer was : > are you on latest patchlevel ? > there are some dsync fixes since 2.2.12 but it is not a problem of dsync. when looking at the code, we get here an unexpected returnvalue when flushing. I propose it would be good practice to write some logging in the default switch cases, to see the unexpected returnvalues in the errorlog. something like : ostream-lzma.c : -- Line 147 : i_unreached(); ++ Line 147 : i_fatal("unexpected lzma errorcode when flushing : %s", ret); I will try to change it and let You know. maybe You can also investigate and let me know when fixed. Here the log : May 5 14:53:10 vm-imap dovecot: imap(rrernboeck): Panic: file ostream-lzma.c: line 147: unreached May 5 14:53:10 vm-imap dovecot: imap(rrernboeck): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x67450) [0x7ff99d8ce450] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x6752e) [0x7ff99d8ce52e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7ff99d88955e] -> /usr/local/lib/dovecot/lib20_zlib_plugin.so(+0x4f0a) [0x7ff99ce87f0a] -> /usr/local/lib/dovecot/libdovecot.so.0(o_stream_flush+0x3e) [0x7ff99d8e6dbe] -> /usr/local/lib/dovecot/libdovecot.so.0(o_stream_nflush+0xf) [0x7ff99d8e71df] -> /usr/local/lib/dovecot/libdovecot.so.0(o_stream_nfinish+0x9) [0x7ff99d8e7229] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(dbox_save_end+0x29) [0x7ff99db7cfa9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mdbox_save_finish+0x39) [0x7ff99db76619] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_finish+0x4d) [0x7ff99dbb6a4d] -> dovecot/imap [rrernboeck 127.0.0.1 APPEND]() [0x40be09] -> dovecot/imap [rrernboeck 127.0.0.1 APPEND](command_exec+0x3c) [0x416cfc] -> dovecot/imap [rrernboeck 127.0.0.1 APPEND]() [0x40b491] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7ff99d8de527] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7ff99d8df2b7] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7ff99d8de0c8] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7ff99d88e753] -> dovecot/imap [rrernboeck 127.0.0.1 APPEND](main+0x2af) [0x40b06f] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7ff99d4c0de5] -> dovecot/imap [rrernboeck 127.0.0.1 APPEND]() [0x40b1cc] May 5 14:53:10 vm-imap dovecot: imap(rrernboeck): Fatal: master: service(imap): child 47957 killed with signal 6 (core dumped) May 5 14:53:10 vm-imap dovecot: imap(rrernboeck): Error: Corrupted dbox file /home/vmail/virtualmailboxes/rrernboeck/storage/m.1 (around offset=1302): msg header has bad magic value

1 0

[Dovecot] doveadm auth and the "nologin" extra field
by Axel Luttgens 05 May '14

05 May '14

Hello, Still busy with details... Considering, as in my previous example, a password_query returning '!' or NULL for the "nologin" column, depending on an account's status (suspended or not). Let's consider a suspended user "some.user". In the case of a successful authentication, one has: sh-3.2# doveadm auth test some.user goodpassword; echo $? passdb: some.user auth succeeded extra fields: user=some.user nologin 0 On the other hand, in the case of an authentication failure: sh-3.2# doveadm auth test some.user badpassword; echo $? passdb: some.user auth failed extra fields: user=some.user nologin=! 77 So, this is similar to what happens in a connection (pop3, imap...): when present, the nologin info is always taken into account, even in the case of an authentication failure. Again, this may raise some concerns about the consistency of such a behavior. Is this guaranteed to always behave that way, because of some rationale I'm currently missing, or does it go about some overlooked combination, liable to be inadvertently "corrected" in the future? I haven't been able to find a definitive answer in the wiki or in the code about such matters. This is particularly important in the case of doveadm, since its output requires parsing for extracting such informations (the exit code alone isn't sufficient); should above behavior be changed without notice, and a script could suddenly take the worst decisions... BTW, why: nologin in the first output, and: nologin=! in the second output? TIA, Axel

2 2

[Dovecot] Segfault in dovecot-lda when resolver is unavailable
by Marcin Mirosław 05 May '14

05 May '14

Hi list! Recently I noticed that dovecot-lda throws segfault when resolver is unavailable and with imapc configured. $ cat /etc/resolv.conf search . nameserver 127.0.0.1 backtrace: # gdb -q /usr/libexec/dovecot/dovecot-lda 'core-1398282784-8-11-!usr!libexec!dovecot!dovecot-lda-8805' [...] Core was generated by `/usr/libexec/dovecot/deliver -d marcin(a)mejor.pl'. Program terminated with signal 11, Segmentation fault. #0 0x000002b612afaf72 in _int_free (av=0x2b612e215c0 <main_arena>, p=0x1b23bfabe0, have_lock=0) at malloc.c:3903 3903 unlink(p, bck, fwd); (gdb) bt #0 0x000002b612afaf72 in _int_free (av=0x2b612e215c0 <main_arena>, p=0x1b23bfabe0, have_lock=0) at malloc.c:3903 #1 0x000002b612e96a4e in buffer_free (_buf=_buf@entry=0x1b23bfa948) at buffer.c:144 #2 0x000002b612ebeca8 in array_free_i (array=0x1b23bfa948) at array.h:108 #3 priorityq_deinit (_pq=_pq@entry=0x1b23bfabb0) at priorityq.c:38 #4 0x000002b612eafa57 in io_loop_destroy (_ioloop=_ioloop@entry=0x395a4da91d0) at ioloop.c:495 #5 0x000002b61306f225 in imapc_client_run_post (client=<optimized out>) at imapc-client.c:175 #6 imapc_client_run (client=0x1b23bda930) at imapc-client.c:181 #7 0x000002b613067158 in imapc_list_try_get_root_sep (list=0x1b23bd7b60, sep_r=sep_r@entry=0x395a4da9247 "") at imapc-list.c:297 #8 0x000002b6130671ae in imapc_list_get_hierarchy_sep (_list=<optimized out>) at imapc-list.c:310 #9 0x000002b613065d9f in imapc_list_get_fs_name (list=0x1b23bd7b60, name=0x0) at imapc-list.c:396 #10 0x000002b613066031 in imapc_list_get_path (_list=0x1b23bd7b60, name=0x0, type=MAILBOX_LIST_PATH_TYPE_MAILBOX, path_r=0x395a4da9338) at imapc-list.c:437 #11 0x000002b613089785 in mailbox_list_get_root_path (list=<optimized out>, type=type@entry=MAILBOX_LIST_PATH_TYPE_MAILBOX, path_r=path_r@entry=0x395a4da9338) at mailbox-list.c:1276 #12 0x000002b612ff8eb5 in quota_add_user_namespace (quota=0x1b23bcea80, ns=0x1b23bd7a10) at quota.c:745 #13 0x000002b61300073a in quota_mailbox_list_created (list=0x1b23bfd9c0) at quota-storage.c:590 #14 0x000002b613084581 in hook_mailbox_list_created (list=list@entry=0x1b23bfd9c0) at mail-storage-hooks.c:328 #15 0x000002b61308836f in mailbox_list_create (driver=driver@entry=0x2b6130e677b "maildir++", ns=0x1b23bd7a10, set=set@entry=0x395a4da94a0, flags=<optimized out>, list_r=list_r@entry=0x1b23bd7d60, error_r=error_r@entry=0x395a4da9498) at mailbox-list.c:210 #16 0x000002b613065cf6 in imapc_list_get_fs (list=list@entry=0x1b23bd7b60) at imapc-list.c:379 #17 0x000002b61306601e in imapc_list_get_path (_list=0x1b23bd7b60, name=0x0, type=MAILBOX_LIST_PATH_TYPE_MAILBOX, path_r=0x395a4da9588) at imapc-list.c:433 #18 0x000002b613089785 in mailbox_list_get_root_path (list=<optimized out>, type=type@entry=MAILBOX_LIST_PATH_TYPE_MAILBOX, path_r=path_r@entry=0x395a4da9588) at mailbox-list.c:1276 #19 0x000002b612ff8eb5 in quota_add_user_namespace (quota=0x1b23bcea80, ns=0x1b23bd7a10) at quota.c:745 #20 0x000002b61300073a in quota_mailbox_list_created (list=0x1b23bd7b60) at quota-storage.c:590 #21 0x000002b613084581 in hook_mailbox_list_created (list=list@entry=0x1b23bd7b60) at mail-storage-hooks.c:328 #22 0x000002b61308836f in mailbox_list_create (driver=driver@entry=0x2b6130e6d1b "imapc", ns=ns@entry=0x1b23bd7a10, set=set@entry=0x395a4da9720, flags=<optimized out>, list_r=list_r@entry=0x395a4da9708, error_r=error_r@entry=0x395a4da9810) at mailbox-list.c:210 #23 0x000002b61307f500 in mail_storage_create_full (ns=ns@entry=0x1b23bd7a10, driver=<optimized out>, driver@entry=0x0, data=<optimized out>, flags=flags@entry=(unknown: 0), storage_r=storage_r@entry=0x395a4da97c0, error_r=error_r@entry=0x395a4da9810) at mail-storage.c:356 #24 0x000002b61307f7cc in mail_storage_create (ns=ns@entry=0x1b23bd7a10, driver=driver@entry=0x0, flags=flags@entry=(unknown: 0), error_r=error_r@entry=0x395a4da9810) at mail-storage.c:407 #25 0x000002b613077a48 in namespace_add (user=user@entry=0x1b23bcf7e0, ns_set=0x1b23bd0db8, unexpanded_ns_set=0x1b23bcff30, mail_set=mail_set@entry=0x1b23bd07e8, ns_p=ns_p@entry=0x1b23bd3b00, error_r=error_r@entry=0x395a4da9950) at mail-namespace.c:170 #26 0x000002b613078aaf in mail_namespaces_init (user=0x1b23bcf7e0, error_r=error_r@entry=0x395a4da9950) at mail-namespace.c:344 #27 0x000002b6130901bf in mail_storage_service_init_post (error_r=0x395a4da9950, mail_user_r=0x395a4da9b18, priv=0x395a4da9960, user=0x1b23bbde50, ctx=<optimized out>) at mail-storage-service.c:685 #28 mail_storage_service_next (ctx=ctx@entry=0x1b23bbd4f0, user=0x1b23bbde50, mail_user_r=mail_user_r@entry=0x395a4da9b18) at mail-storage-service.c:1223 #29 0x000002b6130904b5 in mail_storage_service_lookup_next (ctx=0x1b23bbd4f0, input=input@entry=0x395a4da9b80, user_r=user_r@entry=0x395a4da9a70, mail_user_r=mail_user_r@entry=0x395a4da9b18, error_r=error_r@entry=0x395a4da9a60) at mail-storage-service.c:1258 #30 0x0000001b22341ccb in main (argc=3, argv=0x1b23bbb060) at main.c:412 # doveconf -n # 2.2.12: /etc/dovecot/dovecot.conf # OS: Linux 3.13.8-hardened x86_64 Gentoo Base System release 2.2 auth_cache_size = 1 k auth_master_user_separator = * auth_mechanisms = login digest-md5 cram-md5 plain deliver_log_format = msgid=%m: from=%f: phys=%p: virt=%w %$ dict { quota = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_uid = 8 last_valid_uid = 8 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_attachment_dir = /dane/domeny/zalaczniki mail_attachment_min_size = 10000 k mail_cache_min_mail_count = 20 mail_gid = mail mail_log_prefix = "%s(%u) <%{session}>: " mail_plugins = quota notify mail_log stats zlib mail_privileged_group = mail mail_uid = mail maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy inc$ ude variables body enotify environment mailbox date ihave mdbox_preallocate_space = yes mdbox_rotate_interval = 60 days mdbox_rotate_size = 50 M namespace inbox { inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . subscriptions = yes } passdb { args = /etc/dovecot/.master.user driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quota sieve = ~/.dovecot.sieve sieve_dir = ~/sieve stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 1M stats_refresh = 30 s stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours zlib_save = bz2 zlib_save_level = 2 } postmaster_address = postmaster(a)mejor.pl protocols = imap pop3 sieve service auth { unix_listener auth-userdb { group = mail mode = 0660 user = root } } service dict { unix_listener dict { user = mail } } service stats { fifo_listener stats-mail { mode = 0600 user = mail } } ssl_cert = </etc/ssl/gwiazdka.mejor.pl.pem ssl_key = </etc/ssl/gwiazdka.mejor.pl.pem userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lda { mail_plugins = quota notify mail_log stats zlib sieve } protocol imap { mail_max_userip_connections = 25 mail_plugins = quota notify mail_log stats zlib imap_quota imap_stats imap_zlib } Thanks, Marcin

2 2

[Dovecot] %{orig_user} missing in checkpassword-Script
by dovecot.pkoch＠dfgh.net 05 May '14

05 May '14

Dear dovecot maintainers: I'm using SSL client certificates together with a checkpassword scripts to authenticate our users. My problem is: In the checkpassword script the AUTH_USER environment variable will either contain the username that was configured in the mailclient (if auth_ssl_username_from_cert=false) or the username from the certificate (if auth_ssl_username_from_cert=true). I would like to compare both values, i.e. the %{user} Dovecot-variable and the %{orig_user} Dovecot-variable. But the environment of a checkpassword-script has only one of them. I tried myself and found the following: - the environment of a checkpassword script is setup by checkpassword_setup_env() in db-checkpassword.c - checkpassword_setup_env() calls env_put_auth_vars() - env_put_auth_vars() creates AUTH_xxx environment variables for all entries of the auth_request_get_var_expand_table() - the auth_request_get_var_expand_table_full() routine does not contain the original user, but the auth_request-struct does. So I changed the dovecot sourcecode (version 2.2.12) as follows In src/auth/auth-request.h line 152 I replaced #define AUTH_REQUEST_VAR_TAB_COUNT 27 by #define AUTH_REQUEST_VAR_TAB_COUNT 30 In src/auth/auth-request.c around line 2027 I replaced the following lines at the end of auth_request_var_expand_static_tab { '\0', NULL, "session_pid" }, /* be sure to update AUTH_REQUEST_VAR_TAB_COUNT */ { '\0', NULL, NULL } }; by { '\0', NULL, "session_pid" }, { '\0', NULL, "orig_user" }, { '\0', NULL, "orig_username" }, { '\0', NULL, "orig_domain" }, /* be sure to update AUTH_REQUEST_VAR_TAB_COUNT */ { '\0', NULL, NULL } }; In src/auth/auth-request.c around line 2116 I replaced the following lines at the end of function auth_request_get_var_expand_table_full() tab[26].value = auth_request->session_pid == (pid_t)-1 ? NULL : dec2str(auth_request->session_pid); return ret_tab; by tab[26].value = auth_request->session_pid == (pid_t)-1 ? NULL : dec2str(auth_request->session_pid); if (auth_request->original_username != NULL) { tab[27].value = escape_func(auth_request->original_username, auth_request); tab[28].value = escape_func(t_strcut(auth_request->original_username, '@'), auth_request); tab[29].value = strchr(auth_request->original_username, '@'); if (tab[29].value != NULL) { tab[29].value = escape_func(tab[29].value+1, auth_request); } } return ret_tab; This will add AUTH_ORIG_USER, AUTH_ORIG_USERNAME and AUTH_ORIG_DOMAIN environment variables to the environment of every checkpassword script. If this is the correct way to extend the environment of a chackpassword-script then you might consider adding these minor changes to the dovecot-source. Kind regards and thanks very much for this wonderful project Peter Koch

2 1

[Dovecot] CONTEXT=SORT
by Michael M Slusarz 05 May '14

05 May '14

Any reason this is not listed in the CAPABILITY string? I see it listed as a TODO here: http://wiki2.dovecot.org/Roadmap But it seems to work fine (as of 2.2.12): 1 UID SORT RETURN (CONTEXT COUNT) (SUBJECT) UTF-8 UNDELETED * ESEARCH (TAG "1") UID COUNT 12 1 OK Sort completed (0.000 secs). 2 UID SORT RETURN (UPDATE COUNT) (SUBJECT) UTF-8 UNDELETED * ESEARCH (TAG "2") UID COUNT 12 2 OK Sort completed (0.000 secs). [Add message to mailbox] 3 NOOP * 13 EXISTS * 1 RECENT * ESEARCH (TAG "2") UID ADDTO (0 62475) 3 OK NOOP completed. 4 CANCELUPDATE "2" 4 OK Updates cancelled. 5 UID SORT RETURN (PARTIAL 1:10) (SUBJECT) UTF-8 UNDELETED * ESEARCH (TAG "5") UID PARTIAL (1:10 NIL) 5 OK Sort completed (0.000 secs). michael

2 2

[Dovecot] Dovecot proxy
by Alex Ferrara 05 May '14

05 May '14

Hi everyone, I have a problem that hopefully has an easy solution. I am setting up an IMAP proxy in a DMZ network. It will connect to the real IMAP server and authenticate using "driver = imap", and this I have working really nicely. What I want to do is have it look up a list of users that are allowed to connect through the proxy before proxying the connection, as not all users with an account are permitted to access their email from the internet. I thought that using a post-login script would get me out of trouble, but it isn't possible in a relay configuration. dovecot.conf ## Dovecot configuration file mail_uid = dovecot mail_gid = dovecot protocols = imap listen = *, :: passdb { driver = imap # IMAP server to authenticate against args = host=192.168.1.1 # IMAP server to connect to for mailbox default_fields = proxy=yes host=192.168.1.1 } userdb { driver = prefetch } auth_mechanisms = plain login # This is the auth service used by Postfix to do dovecot auth. service auth { unix_listener auth-userdb { } inet_listener { port = 12345 } } ## ## SSL settings ## # These will need to ba adjusted to point to *your* certificates, not mine 8-) # The ssl_ca line refers to the intermediate certificate bundle which may or may not be required by your SSL provider ssl_cert = </etc/ssl/certs/mail.domain.com.au.pem ssl_key = </etc/ssl/private/mail.domain.com.au.key #ssl_ca = </etc/pki/tls/certs/ca.crt ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL

2 2

[Dovecot] Dsyncing mail in director setup
by Murray Trainer 05 May '14

05 May '14

Hi All, I have a pair of dovecot director proxies and six dovecot backend mailstores using NFS v4.1 to access five filesystems on EMC VNX NFS storage. This is all working fine until I try and dsync new email mailboxes via one of the mailstores onto the NFS storage. I get major NFS lockups at random on one or more of the mailstores with none of the NFS mounts accessible on one or more of the mailstores. I am getting our storage guy to look into it to see if it is just a performance issue. I can understand there may be locking issues but I wouldn't have thought it would have this effect. I also wonderif there is a better way to run dsync so it handle writing to NFS? Maybe passing it some of the nfs related dovecot options? Thanks Murray

1 0

[Dovecot] Dovecot/Postfix Auth, howto not working ?
by Matt . 05 May '14

05 May '14

Hi Guys, I'm trying to auth Dovecot agains FreeIPA using this tut: http://www.freeipa.org/page/Dovecot_IMAPS_Integration_with_FreeIPA_using_Si… (and also Postfix using this: https://www.dalemacartney.com/2013/03/14/deploying-postfix-with-ldap-freeip… it should be working with dovecot at the end I believe) I'm having some issues here and get the following errors no matter what I do: May 4 23:13:18 mail-01 dovecot: auth: Fatal: No passdbs specified in configuration file. LOGIN mechanism needs one May 4 23:13:18 mail-01 postfix/smtpd[2949]: error: open database /etc/aliases.db: No such file or directory May 4 23:13:18 mail-01 postfix/smtpd[2949]: warning: dict_nis_init: NIS domain name not set - NIS lookups disabled May 4 23:13:18 mail-01 dovecot: master: Error: service(auth): command startup failed, throttling May 4 23:13:18 mail-01 postfix/smtpd[2949]: connect from unknown[xxx.xxx.xxx.xxx] May 4 23:13:28 mail-01 dovecot: imap-login: Disconnected (no auth attempts): rip=xxx.xxx.xxx.xxx, lip=xxx.xxx.xxx.xxx May 4 23:13:28 mail-01 postfix/smtpd[2949]: fatal: no SASL authentication mechanisms May 4 23:13:29 mail-01 postfix/master[1627]: warning: process /usr/lib/postfix/smtpd pid 2949 exit status 1 May 4 23:13:29 mail-01 postfix/master[1627]: warning: /usr/lib/postfix/smtpd: bad command startup -- throttling May 4 23:14:18 mail-01 dovecot: auth: Fatal: No passdbs specified in configuration file. LOGIN mechanism needs one May 4 23:14:18 mail-01 dovecot: master: Error: service(auth): command startup failed, throttling May 4 23:15:09 mail-01 postfix/anvil[2952]: statistics: max connection rate 1/60s for (smtp:xxx.xxx.xxx.xxx) at May 4 23:13:18 May 4 23:15:09 mail-01 postfix/anvil[2952]: statistics: max connection count 1 for (smtp:xxx.xxx.xxx.xxx) at May 4 23:13:18 May 4 23:15:09 mail-01 postfix/anvil[2952]: statistics: max cache size 1 at May 4 23:13:18 Outside the issue that it cannot find the aliasses db, I'm kinda stuck here... the tut should be working "out of the box", but I have the feeling I'm missing something here. I hope someone can help me out! Thanks! Matt

1 0

[Dovecot] Unknown user when sending internal email
by SIW 04 May '14

04 May '14

I use MySQL to store my virtual users, domains and aliases. My database is setup as follows: |CREATE| |TABLE| |`dovecot_passwords` (| |||`username` ||varchar||(100) ||NOT| |NULL||,| |||`appname` ||varchar||(50) ||NOT| |NULL||,| |||`||password||` varbinary(256) ||NOT| |NULL||,| |||PRIMARY| |KEY| |(`username`,`appname`)| |) I then add a users: | |INSERT| |INTO| |dovecot_passwords (username, appname, ||password||) ||VALUES||( ||'test(a)domain.com'||, ||'desktop'||, MD5(||'password'||) ); My /usr/local/etc/dovecot/dovecot-sql.conf.ext has: | |driver = mysql | |connect = host=127.0.0.1 dbname=mailserver user=mailuser password=blahblah| |default_pass_scheme = PLAIN password_query = SELECT NULL AS password,'Y' as nopassword, username AS user||||FROM dovecot_passwords||||WHERE username = '%u' AND password=MD5(REPLACE('%w',' ','')) Logging in works great and I can use a desktop email client or webmail just fine to check email. The problem occurs when I try to email another user in MY domain. When I send an email from user1(a)domain.com to user2(a)domain.com I get the following error in the logs: to=<user1(a)domain.com>, relay=mail.domain.com[private/dovecot-lmtp], delay=0.08, delays=0.05/0.01/0/0.02, dsn=5.1.1, status=bounced (host mail.domain.com[private/dovecot-lmtp] said: 550 5.1.1 <user1(a)domain.com> User doesn't exist: user1(a)domain.com (in reply to RCPT TO command)) | I thought it may have something to do with this: http://wiki2.dovecot.org/DomainLost To quote: SQL password_query gets often misconfigured to drop the domain if username and domain are stored separately. For example: # BROKEN: password_query = SELECT username AS user, password FROM users WHERE username = '%n' AND domain = '%d' The "username AS user" changes the username permanently and the domain is dropped. You can instead use: # MySQL: password_query = SELECT concat(username, '@', domain) AS user, password FROM users WHERE username = '%n' AND domain = '%d' Despite the above I didn't have any luck. From what I can tell in the logs it is using the username AND domain for the user (and not dropping off the domain). Does anyone know how I can get local mail delivery to work again? I have changed the way my users are stored in MySQL so that I can make use of "Application Specific Passwords". If I revert back to using the previous user database internal mail works fine again. I can't seem to figure this out so appreciate any help! Any questions please ask. The details: Dovecot version: |2.2.12 # OS: FreeBSD 10.0-STABLE amd64 zfs auth_debug = yes auth_mechanisms = plain login auth_verbose = yes imap_id_log = * imap_id_send = * log_path = /var/log/dovecot.log login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_location = maildir:/var/mail/vhosts/%d/%n mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Junk { auto = subscribe special_use = \Junk } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = /var/mail/dovecotsieve/%d/%n/.dovecot.sieve sieve_default = /var/mail/sieve/default.sieve sieve_dir = /var/mail/dovecotsieve/%d/%n/sieve sieve_global_dir = /var/mail/sieve/ } protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl = required ssl_cert = </usr/local/openssl/certs/mail.domain.com.chained.dovecot.sha256.crt ssl_cipher_list = HIGH:EECDH+ECDSA+AESGCM:EECDH+aRSA+AESGCM:EECDH+ECDSA+SHA384:EECDH+ECDSA+SHA256:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH:EDH+aRSA:ECDHE-RSA-AES256-SHA:+DHE-RSA-AES256-SHA:!AES256-SHA256:!AES256-GCM-SHA384:!CAMELLIA256-SHA:!AES128:!CAMELLIA128:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS:!SSLv2:!RC4:!SEED:+AES256-SHA ssl_key = </usr/local/openssl/certs/mail.domain.com.sha256.key ssl_prefer_server_ciphers = yes userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n driver = static } protocol imap { mail_max_userip_connections = 2000 } protocol lmtp { mail_plugins = " sieve" } |

1 0

[Dovecot] IMAP clients can't connect while dovecot 2.0.9 is configured for LDAP
by Matthew Badeau 03 May '14

03 May '14

Good evening, Currently, it’s using mySQL for the passdb and userdb. This works fine but when I switch to LDAP it starts having problems. I’m trying to set up dovecot to use LDAP as its userdb and passdb. I’ve read the docs but I think I may be missing something obvious or I didn’t understand something right. The clients can’t connect through IMAP using MD5-Challenge Response. They also don’t work with plain auth.. When I run the command ` doveadm auth user(a)domain.com ` , it works! When I run ` doveadm auth -x service=imap user(a)domain.com ` that also works! What am I doing wrong??? I get the following error: Error: Apr 29 02:04:02 servername dovecot: auth: Fatal: CRAM-MD5 mechanism can't be supported with given passdbs Here is my config: # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.5.1.el6.x86_64 x86_64 CentOS release 6.5 (Final) ext4 auth_debug = yes auth_verbose = yes mail_location = maildir:/home/mailuser/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve_dir = ~/sieve sieve_global_dir = /var/lib/dovecot/sieve/ sieve_global_path = /var/lib/dovecot/sieve/default.sieve } protocols = pop3 imap sieve lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = mailuser mode = 0640 user = mailuser } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/ssl/certs/servernameredacted.crt ssl_key = </etc/ssl/certs/servernameredacted.key userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } Thank you for any help or links to docs!

1 0

[Dovecot] BINARY FETCH conversion issue
by Michael M Slusarz 03 May '14

03 May '14

Given this test message, with admittedly incorrect QP encoding: ---- From: Test <test(a)example.com> Subject: Test Mime-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain To: Test <test(a)example.com> Date: Tue, 29 Apr 2014 00:54:10 +0000 Message-Id: <1(a)example.com> https://example.com/?from=bsu&url=http%3A//www.example.com/ ---- Dovecot 2.2 returns this: C: 5 UID FETCH 4464 (BINARY.PEEK[1]) S: * 1 FETCH (UID 4464 BINARY[1] NIL) S: 5 OK Fetch completed. Contrast with, e.g., Cyrus 2.4: C: 6 UID FETCH 1 (BINARY.PEEK[1]) S: * 1 FETCH (UID 1 BINARY[1] {57} S: [LITERAL DATA: 57 bytes] S: ) S: 6 OK Completed (0.000 sec) (Cyrus FETCH output strips out the spurious non-encoding '=', IIRC). Not sure if this is an example of Cyrus' QP decoder being more robust (or lenient) than Dovecot's. Or whether this is intentional to return NIL for this kind of bad data. Although if intentional, output should probably be a NO response with UNKNOWN-CTE response code, since this appears to be an instance of "the server does not know how to decode the section's CTE". (RFC 3516 [4.3]). michael

2 2

[Dovecot] core dump in mail_cache_header_fields_read()
by Wesley Huang 02 May '14

02 May '14

We're seeing a core dump for a user connecting from IPHONE. The user mail are in NFS mount. # dovecot --version 2.2.12 # doveconf -n # 2.2.12: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 auth_cache_negative_ttl = 0 auth_cache_size = 20 M auth_verbose = yes default_client_limit = 4000 default_process_limit = 1000 default_vsz_limit = 2 G director_mail_servers = <server_ip_address> disable_plaintext_auth = no first_valid_uid = 100 imap_client_workarounds = tb-extra-mailbox-sep delay-newmail tb-lsub-flags log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = always mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " quota" mbox_dotlock_change_timeout = 1 mins mbox_lock_timeout = 1 mins mmap_disable = yes namespace inbox { hidden = no inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { quota = fs:Disk quota } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh protocols = " imap pop3" service auth-worker { user = root } service auth { user = $default_internal_user } service imap-login { client_limit = 2000 process_min_avail = 4 service_count = 1 } service imap-postlogin { executable = script-login /usr/local/dovecot-scripts/imap.sh user = root } service imap { executable = imap imap-postlogin process_limit = 4096 } service pop3-login { client_limit = 2000 service_count = 1 } service pop3-postlogin { executable = script-login /usr/local/dovecot-scripts/ipop3.sh user = root } service pop3 { executable = pop3 pop3-postlogin process_limit = 2048 } ssl_ca = </etc/dovecot/mailhost-ca.crt ssl_cert = </etc/dovecot/mailhost.crt ssl_key = </etc/dovecot/mailhost.key userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_ssl = yes protocol imap { mail_max_userip_connections = 1000 mail_plugins = " quota imap_quota" } protocol pop3 { mail_max_userip_connections = 1000 } -------------------------------------------------------------------------------------- # gdb /usr/lib/dovecot/imap ./5040 GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/lib/dovecot/imap...Reading symbols from /usr/lib/debug/usr/lib/dovecot/imap...done. done. [New LWP 5040] warning: Can't read pathname for load map: Input/output error. [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `dovecot/imap imap-postlogin'. Program terminated with signal 11, Segmentation fault. #0 0x00007fca22f0ca85 in mail_cache_header_fields_read (cache=cache@entry=0x7fca24a04f70) at mail-cache-fields.c:369 369 for (p = names; p != end && *p != '\0'; p++) ; (gdb) bt full #0 0x00007fca22f0ca85 in mail_cache_header_fields_read (cache=cache@entry=0x7fca24a04f70) at mail-cache-fields.c:369 field_hdr = 0x7fca21d37010 field = {name = 0x0, idx = 0, type = MAIL_CACHE_FIELD_FIXED_SIZE, field_size = 0, decision = MAIL_CACHE_DECISION_NO, last_used = 0} last_used = 0x7fca21d3701c sizes = 0x7fca79d3701c types = 0x7fcad1d3701c <Address 0x7fcad1d3701c out of bounds> decisions = 0x7fcae7d3701c <Address 0x7fcae7d3701c out of bounds> p = 0x7fcafdd3701c <Address 0x7fcafdd3701c out of bounds> names = 0x7fcafdd3701c <Address 0x7fcafdd3701c out of bounds> end = 0x7fcb1dd47010 <Address 0x7fcb1dd47010 out of bounds> orig_key = 0x48800 <Address 0x48800 out of bounds> orig_value = 0x8000 fidx = <optimized out> new_fields_count = <optimized out> dec = <optimized out> max_drop_time = 0 offset = 23204 i = <optimized out> #1 0x00007fca22f0a4d6 in mail_cache_open_and_verify (cache=0x7fca24a04f70) at mail-cache.c:497 ret = <optimized out> #2 0x00007fca22f0c905 in mail_cache_register_get_list (cache=0x7fca24a04f70, pool=0x7fca249d7480, count_r=count_r@entry=0x7fff0c4c7aec) at mail-cache-fields.c:194 list = <optimized out> i = <optimized out> #3 0x00007fca22ef93b3 in index_mail_parse_header_register_all_wanted (mail=0x7fca24a14ce0) at index-mail-headers.c:169 _mail = 0x7fca24a14ce0 all_cache_fields = <optimized out> i = <optimized out> count = <optimized out> #4 index_mail_parse_header_init (mail=mail@entry=0x7fca24a14ce0, headers=headers@entry=0x0) at index-mail-headers.c:230 _data_stack_cur_id = 4 data = 0x7fca24a14e50 match = 0x7fca24a05e00 "\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377\377a" i = <optimized out> field_idx = <optimized out> match_count = <optimized out> __FUNCTION__ = "index_mail_parse_header_init" #5 0x00007fca22ef9d08 in index_mail_cache_parse_init (_mail=0x7fca24a14ce0, input=0x7fca24a1b178, input@entry=0x7fca24a1b738) at index-mail-headers.c:376 mail = 0x7fca24a14ce0 input2 = 0x7fca24a24ef8 __FUNCTION__ = "index_mail_cache_parse_init" #6 0x00007fca22eb4202 in mbox_save_get_input_stream (input=0x7fca24a1ab88, ctx=0x7fca24a14930) at mbox-save.c:421 filter = 0x0 ---Type <return> to continue, or q <return> to quit---

2 3

[Dovecot] Segfault in auth (when talked to by postfix lda)
by Darac Marjal 02 May '14

02 May '14

Afternoon all. I'm seeing a segfault in dovecot 2.2.12 (debian package 1:2.2.12-2). I can log into dovecot fine with mutt, but the segfaults seem to occur when postfix (2.11.0, debian package 2.11.0-1+b1) tries to deliver a message. This was working fine under 2.2.9 (I can downgrade to that and delivery works). Can anyone help? Doveconf -n, and backtrace follow. ------------------------------ --8<-- doveconf -n ---------- # 2.2.12: /etc/dovecot/dovecot.conf # OS: Linux 3.12-1-686-pae i686 Debian jessie/sid xfs auth_debug = yes auth_mechanisms = digest-md5 cram-md5 plain info_log_path = /var/log/dovecot.info lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = service=%s user=<%u> session=%{session} method=%m rip=%r lip=%l mpid=%e %c %k mail_access_groups = mail users mail_location = mdbox:/var/mail/%u/Mail mail_max_userip_connections = 50 mail_plugins = " zlib stats" mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = /etc/dovecot/passwd driver = passwd-file } plugin { antispam_backend = dspam antispam_crm_binary = /bin/false antispam_debug_target = syslog antispam_dspam_args = --client;--mode=teft;--deliver;--user;%u antispam_dspam_binary = /usr/bin/dspam antispam_pipe_program = /usr/sbin/sendmail antispam_pipe_tmpdir = /tmp antispam_signature = X-DSPAM-Signature antispam_signature_missing = move antispam_spam_pattern_ignorecase = SPAM antispam_trash_pattern_ignorecase = trash;Deleted * sieve = ~/.dovecot.sieve sieve_dir = ~/sieve stats_refresh = 30 secs stats_track_cmds = yes } postmaster_address = postmaster(a)darac.org.uk protocols = " imap lmtp sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 } } service lmtp { inet_listener lmtp { address = 192.168.123.254 port = 20024 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_cert = </etc/dovecot/mail.www.ssl-bundle.crt ssl_key = </etc/dovecot/private/mail.www.ssl.key userdb { driver = passwd } userdb { args = uid=vmail gid=vmail home=/var/mail/%u driver = static } protocol lmtp { mail_fsync = optimized mail_plugins = " zlib sieve" } protocol lda { mail_fsync = optimized mail_plugins = " zlib sieve" } protocol imap { mail_plugins = " zlib zlib imap_zlib antispam stats imap_stats" } ----8<---- backtrace ------- Core was generated by `dovecot/auth'. Program terminated with signal 11, Segmentation fault. #0 auth_fields_find_idx (fields=fields@entry=0x0, key=key@entry=0xb84ae448 "uid", idx_r=idx_r@entry=0xbfc07d0c) at auth-fields.c:44 44 auth-fields.c: No such file or directory. (gdb) bt full #0 auth_fields_find_idx (fields=fields@entry=0x0, key=key@entry=0xb84ae448 "uid", idx_r=idx_r@entry=0xbfc07d0c) at auth-fields.c:44 i = <optimized out> count = <optimized out> #1 0xb77bed33 in auth_fields_add (fields=0x0, key=key@entry=0xb84ae448 "uid", value=value@entry=0xb84a6312 "1120", flags=flags@entry=(unknown: 0)) at auth-fields.c:68 field = <optimized out> idx = 3091882770 __FUNCTION__ = "auth_fields_add" #2 0xb77bb03b in auth_request_set_userdb_field (request=request@entry=0xb84b9218, name=0xb84ae448 "uid", value=0xb84a6312 "1120") at auth-request.c:1605 uid = <optimized out> gid = <optimized out> #3 0xb77d2fb5 in userdb_template_export (tmpl=0xb84ae410, auth_request=auth_request@entry=0xb84b9218) at userdb-template.c:83 table = 0xb84a6110 str = 0xb84a5ff0 value = <optimized out> i = 0 count = 6 __FUNCTION__ = "userdb_template_export" #4 0xb77d230a in static_lookup_real (auth_request=auth_request@entry=0xb84b9218, callback=0xb77ba9b0 <auth_request_userdb_callback>) at userdb-static.c:32 _module = <optimized out> module = <optimized out> #5 0xb77d23ae in static_credentials_callback (result=PASSDB_RESULT_OK, credentials=0xb84b5bb7 "Mananozu", size=8, auth_request=0xb84b9218) at userdb-static.c:52 ctx = 0xb84bb860 #6 0xb77bc039 in auth_request_lookup_credentials_finish (result=PASSDB_RESULT_OK, credentials=credentials@entry=0xb84b5bb7 "Mananozu", size=size@entry=8, request=request@entry=0xb84b9218) at auth-request.c:820 No locals. #7 0xb77bc136 in auth_request_lookup_credentials_callback (result=PASSDB_RESULT_OK, credentials=0xb84b5bb7 "Mananozu", size=8, request=0xb84b9218) at auth-request.c:858 passdb = 0xb84ae248 cache_cred = 0x0 cache_scheme = 0xb77f1abc "\234\211\004" __FUNCTION__ = "auth_request_lookup_credentials_callback" #8 0xb77cc66e in passdb_handle_credentials (result=result@entry=PASSDB_RESULT_OK, password=0xb84b5bb7 "Mananozu", scheme=0xb84a5cb8 "PLAIN", callback=callback@entry=0xb77bc0c0 <auth_request_lookup_credentials_callback>, auth_request=auth_request@entry=0xb84b9218) at passdb.c:165 credentials = 0xb84b5bb7 "Mananozu" size = 8 #9 0xb77ce62c in passwd_file_lookup_credentials (request=0xb84b9218, callback=0xb77bc0c0 <auth_request_lookup_credentials_callback>) at passdb-passwd-file.c:106 _module = <optimized out> module = <optimized out> pu = <optimized out> crypted_pass = 0xb84b5bb7 "Mananozu" scheme = 0xb84a5cb8 "PLAIN" #10 0xb77bc317 in auth_request_lookup_credentials (request=request@entry=0xb84b9218, scheme=0xb84b9450 "", callback=0xb77d2320 <static_credentials_callback>) at auth-request.c:907 passdb = 0xb84ae248 cache_key = <optimized out> cache_cred = 0x0 cache_scheme = 0xb77f1abc "\234\211\004" result = -1216406852 __FUNCTION__ = "auth_request_lookup_credentials" #11 0xb77bc0b4 in auth_request_lookup_credentials_finish ( result=PASSDB_RESULT_SCHEME_NOT_AVAILABLE, credentials=credentials@entry=0xb774f693 <uchar_nul> "", size=size@entry=0, request=request@entry=0xb84b9218) at auth-request.c:802 No locals. #12 0xb77bc136 in auth_request_lookup_credentials_callback ( result=result@entry=PASSDB_RESULT_SCHEME_NOT_AVAILABLE, credentials=0xb774f693 <uchar_nul> "", size=size@entry=0, request=request@entry=0xb84b9218) at auth-request.c:858 passdb = 0xb84ae180 cache_cred = 0xb84b93b8 "\001" cache_scheme = 0x0 __FUNCTION__ = "auth_request_lookup_credentials_callback" #13 0xb77bc396 in auth_request_lookup_credentials (request=request@entry=0xb84b9218, scheme=scheme@entry=0xb77dd7bd "", callback=callback@entry=0xb77d2320 <static_credentials_callback>) at auth-request.c:900 passdb = 0xb84ae180 cache_key = <optimized out> cache_cred = 0x1 <Address 0x1 out of bounds> cache_scheme = 0xb7780e78 "x\r\r" result = -1217270382 __FUNCTION__ = "auth_request_lookup_credentials" #14 0xb77d253c in static_lookup (auth_request=0xb84b9218, callback=0xb77ba9b0 <auth_request_userdb_callback>) at userdb-static.c:100 ctx = 0xb84bb860 callback = 0xb77ba9b0 <auth_request_userdb_callback> auth_request = 0xb84b9218 _module = <optimized out> module = <optimized out> #15 0xb77bae3b in auth_request_lookup_user (request=request@entry=0xb84b9218, callback=0xb77b5c80 <user_callback>) at auth-request.c:1141 userdb = 0xb84ae3e8 cache_key = <optimized out> #16 0xb77bac6d in auth_request_userdb_callback (result=<optimized out>, result@entry=USERDB_RESULT_USER_UNKNOWN, request=<optimized out>) at auth-request.c:1062 userdb = <optimized out> next_userdb = 0xb84ae3c8 result_rule = <optimized out> userdb_continue = <optimized out> #17 0xb77d091c in user_callback (reply=<optimized out>, context=0xb84b9218) at userdb-blocking.c:46 request = 0xb84b9218 result = USERDB_RESULT_USER_UNKNOWN args = 0xb84b9863 "" #18 0xb77c1caf in auth_worker_request_handle (request=0xb84b93b8, request=0xb84b93b8, line=0xb84b985a "NOTFOUND\t", conn=<optimized out>) at auth-worker-server.c:281 No locals. #19 worker_input (conn=0xb84b9600) at auth-worker-server.c:376 line = 0xb84b9859 "\tNOTFOUND\t" id_str = <optimized out> id = 1 #20 0xb7726928 in io_loop_call_io (io=0xb84b97f0) at ioloop.c:388 ioloop = 0xb84ad4d0 t_id = 2 #21 0xb77278be in io_loop_handler_run (ioloop=ioloop@entry=0xb84ad4d0) at ioloop-epoll.c:220 ctx = 0xb84b2538 list = 0xb84b9820 io = <optimized out> tv = {tv_sec = 0, tv_usec = 996120} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 j = 0 call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #22 0xb7726458 in io_loop_run (ioloop=0xb84ad4d0) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #23 0xb76ce8c8 in master_service_run (service=0xb84ad400, callback=0xb77c6010 <client_connected>) at master-service.c:566 No locals. #24 0xb77b2fae in main (argc=1, argv=0xb84ad1d8) at main.c:393 c = <optimized out>

2 2

[Dovecot] output of doveconf in conflict with order of settings in conf.d/*-*.conf files
by Steffen Kaiser 02 May '14

02 May '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I wanted to enable stats, so I added the settings from http://wiki2.dovecot.org/Statistics into conf.d/99-stats.conf: mail_plugins = $mail_plugins stats protocol imap { mail_plugins = $mail_plugins imap_stats } plugin { # how often to session statistics stats_refresh = 30 secs # track per-IMAP command statistics stats_track_cmds = yes } reloaded dovecot, see output of doveconf -n below, but I got the error: imap: Error: Can't load plugin imap_stats_plugin: Plugin stats must be loaded also (you must set: mail_plugins=$mail_plugins stats) If I move the line "mail_plugins = $mail_plugins stats" from 99-stats.conf into 15-stats.conf, the output of doveconf -n looks the same, but the stats is working. I tried finding information about the significance of the order of settings - I mean which number should a conf-file has - , but failed in the Wiki and mailing list. Is this a bug or should there be a documentation? ===== # 2.2.10 (5432b55a2b87): /usr/local/dovecot-2.2.10/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.8 auth_cache_size = 10 M auth_mechanisms = plain login base_dir = /var/run/dovecot2.2/ default_vsz_limit = 512 M deliver_log_format = msgid=%m: %$ %p/%w "%f" "%s" dict { acl = pgsql:/usr/local/dovecot-2.2.10/etc/dovecot/dovecot-dict-sql.conf.ext quota = pgsql:/usr/local/dovecot-2.2.10/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no instance_name = dovecot2.2 lda_mailbox_autocreate = yes lmtp_save_to_detail_mailbox = yes log_path = /var/log/dovecot/dovecot2.2.log log_timestamp = "%F %H:%M:%S " mail_gid = vmail mail_log_prefix = "%Us(%u) [%p]: " mail_max_userip_connections = 0 mail_plugins = " quota notify mail_log zlib acl stats" mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = users.%%u. separator = . type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = proxy::acl antispam_allow_append_to_spam = yes antispam_backend = spool2dir antispam_spam = SPAM+ReportAsSPAM antispam_spool2dir_notspam = /tmp/spamspool/%%020lu-%%05lu-%u-H antispam_spool2dir_spam = /tmp/spamspool/%%020lu-%%05lu-%u-S antispam_trash = trash;TRASH;Trash;spam;SPAM;Spam;junk;JUNK;Junk;Deleted Items;Deleted Messages;Gel&APY-schte Elemente;Gel&APY-schte Objekte;Junk E-mail;Junk-E-Mail;INBOX.Trash;INBOX.TRASH;INBOX.trash mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size vsize from subject quota = dict:User quota::proxy::quota quota_rule = *:storage=300MB quota_rule2 = Trash:storage=+30M recipient_delimiter = + sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_actions = 0 sieve_quota_max_storage = 3M stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 128 M stats_refresh = 30 secs stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours } postmaster_address = postmaster(a)inf.h-brs.de protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth { unix_listener auth-client { mode = 0766 } unix_listener auth-userdb { mode = 0766 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service doveadm { unix_listener doveadm-server { mode = 0666 } } service imap-login { process_min_avail = 4 service_count = 0 vsz_limit = 768 M } service imap { process_limit = 10000 vsz_limit = 768 M } service lmtp { vsz_limit = 768 M } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { process_min_avail = 5 service_count = 0 vsz_limit = 512 M } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_ca = </etc/ssl/certs/ca.crt ssl_cert = </etc/ssl/certs/imap.pem ssl_key = </etc/ssl/private/imap.key userdb { driver = prefetch } userdb { args = /usr/local/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf.ext default_fields = home=/home/%u uid=vmail gid=vmail driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = " quota notify mail_log zlib acl quota sieve" } protocol lda { mail_plugins = " quota notify mail_log zlib acl quota sieve" } protocol imap { mail_plugins = " quota notify mail_log zlib acl imap_quota imap_zlib imap_acl antispam imap_stats" } - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUwHPOnD1/YhP6VMHAQJ4Gwf/S+Vve0EOamXd0qok6Q8soRkmbXbU+lgm Fc2759gkZo05N9cNgHTe5T5ulSvZ+XcOt0DnResyHhz0/r6UlxCeR4pQyvxFHG9K eKsej2IlsG5ilT3xKCMHaB+wQg9f2lb4PQzD1flLANPESU3LSVZMpPCxy7O3LWN2 JQahrRNNjyK8mNOAw0M3F8SbT604co37acO47S90BEMcd2lfIZpHiAkH8NV22l9E /vM9yzvPwMADWXeFbMnvb8lSSb78zTe+P2tl/IOlxrBOODPF4+Whh790zpu5K8DO yLddMVFsGmC07aPGI70BldITvTkc0LzHurB2dTLH3mdoN5tgD1JhtA== =uqLL -----END PGP SIGNATURE-----

2 3

[Dovecot] maildir compressed message fix patch
by Richard Platel 02 May '14

02 May '14

When a compressed maildir message has a bad S= size in its filename it puts the user in an unrecoverable state, since maildir's do_fix_size function just does a stat() on the maildir file and saves the compressed size in the filename. This (quick, rough, barely tested) patch addresses this issue, it's inefficient, but we're already in a hopefully rare emergency situation. --- maildir-mail.c 2014-02-11 22:23:37.000000000 +0000 +++ maildir-mail.c.new 2014-04-24 20:41:25.000000000 +0000 @@ -8,6 +8,7 @@ #include "maildir-filename.h" #include "maildir-uidlist.h" #include "maildir-sync.h" +#include "compression.h" #include <stdio.h> #include <stdlib.h> @@ -640,6 +641,10 @@ { const char *fname, *newpath, *extra, *info, *dir; struct stat st; + const struct stat * stp; + const struct compression_handler * handler; + struct istream * fstream; + struct istream * cstream; fname = strrchr(path, '/'); i_assert(fname != NULL); @@ -650,13 +655,29 @@ info = strchr(fname, MAILDIR_INFO_SEP); if (info == NULL) info = ""; + fstream = i_stream_create_file(path, 1024); + handler = compression_detect_handler(fstream); + if (handler != NULL && handler->create_istream != NULL) + { + cstream = handler->create_istream(fstream, TRUE); + if (i_stream_stat(cstream, TRUE, &stp) < 0) + { + return -1; + } + st = *stp; /* dumb copy */ + i_stream_unref(&cstream); + } + else + { if (stat(path, &st) < 0) { if (errno == ENOENT) return 0; mail_storage_set_critical(&mbox->storage->storage, "stat(%s) failed: %m", path); return -1; - } + } + } + i_stream_unref(&fstream); newpath = t_strdup_printf("%s/%s,S=%"PRIuUOFF_T"%s", dir, t_strdup_until(fname, extra),

3 2

[Dovecot] ID command and dovecot
by Jernej Porenta 02 May '14

02 May '14

Heya, we are seeing some strange issues with IMAP ID command using latest Roundcube builds on dovecot 2.2.10 responding "Input buffer full, aborting". Roundcube webmail connects to IMAP server and issues ID command first with some long arguments to ID command, however shorter than 1024 octets, which are specified in RFC2971 for ID IMAP extension. The situation is easily reproducible (see http://pastebin.com/q4HX4wqb) # telnet hostname 143 * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Server ready. . ID ("name" "Roundcube" "version" "1.0-git" "php" "5.3.3" "os" "Linux" "command" "<$long_less_than_1024_octets_string>") * BYE Input buffer full, aborting However, this problem does not occur when user is already logged in. RFC2971 is saying "Field strings MUST NOT be longer than 30 octets. Value strings MUST NOT be longer than 1024 octets. Implementations MUST NOT send more than 30 field-value pairs." IMHO, dovecot is handling ID command before successful login successfully only if the length of the whole command is less than 1024 octets (exactly 861 octets is working fine, over that "Input buffer full" occurs). I tried finding the reference in the source code, however I am unable to find where this limit actually occurs (maybe IMAP_ARG_STRING imap_arg->type?) thank you in advance, regards, Jernej

2 1

[Dovecot] Finding memory leaks
by Philipp Brüll 02 May '14

02 May '14

Hello, I try to find a memory leak in a dovecot plugin that I develop. In order to find it, it would be helpful to print the total amount of memory that is currently allocated. This print could than spread over the source code and the memory consumption can be tracked. I've tried i_debug("pool size %u", (unsigned int)pool_alloconly_get_total_alloc_size(system_pool)); But that failed. Does someone has a good advice? I would like to avoid complex solutions like valgrind. Best regards, Philipp

2 1