- dovecot - dovecot.org

[Dovecot] imapc problem
by FUSTE Emmanuel 14 May '14

14 May '14

hello, I have some trouble when trying to migrate from another imap server to dovecot with imapc/dsync/doveadm. when running "doveadm -o imapc_user=foo -o imapc_password=bar backup -R -u localuser imapc:" all is ok. But when running "doveadm -o imapc_user=foo -o imapc_password=bar sync -R -u localuser imapc:", all local mods are overwritten. For example deleting a message or moving it to trash and it reappear in INBOX (and disappear from trash if moved there). If I try without the reverse flag "-R", local delete reappear two times after two or more sync. If I try without the reverse flag "-R", a message moved to trash is propagated to trash too, but reappear as many times as you "sync" on the two sides in the INBOX. With other users, first "backup -R" is ok but on next sync or backup try, I get : dsync(other_user): Error: Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted. Other IMAP server is CriticalPath 8.5.137. Any clue ?? Emmanuel. Dovecot conf : 2.2.12.12 (03196f188677+): /etc/dovecot/dovecot.conf # OS: Linux 3.11.0-19-generic x86_64 Ubuntu 12.04.4 LTS auth_master_user_separator = * auth_username_format = %u disable_plaintext_auth = no doveadm_password = **************** imapc_features = rfc822.size fetch-headers imapc_host = my_old_imap_server imapc_user = %u lda_mailbox_autocreate = yes listen = * mail_gid = vmail mail_location = maildir:~/Maildir mail_plugins = quota notify replication mail_prefetch_count = 20 mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { hidden = no inbox = no list = children location = maildir:%%h/Maildir:INDEXPVT=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-master-ldap.conf.ext driver = ldap master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_anyone = allow acl_shared_dict =file:/appli/vmail/shared-mailboxes quota = dict:userquota::file:/appli/vmail/local_userquota/%u/dovecot-quota quota_rule = *:storage=100M quota_rule2 = INBOX:storage=+20%% quota_rule3 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap sieve service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth { unix_listener auth-userdb { group = vmail mode = 0660 } } service doveadm { inet_listener { port = 12345 } user = vmail } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl = no userdb { args = /etc/dovecot/dovecot-users-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = quota sieve } protocol imap { mail_plugins = quota imap_quota }

1 1

[Dovecot] Error open(/var/lib/dovecot/db/shared-mailboxes) after update 2.2.10 -> 2.2.13
by Götz Reinicke - IT Koordinator 14 May '14

14 May '14

Hi, I did an update from dovecot 2.2.10 -> 2.2.13 and now I'm getting errors: May 14 10:40:00 imap(hansdampf): Error: open(/var/lib/dovecot/db/shared-mailboxes) failed: Permission denied Currently the permissions on shared-mailboxes rw-rw-rw but teh error still exists. Any hints? Thansk and Regards. Götz -- Götz Reinicke IT-Koordinator Tel. +49 7141 969 82 420 E-Mail goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Jürgen Walter MdL Staatssekretär im Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg Geschäftsführer: Prof. Thomas Schadt

3 4

[Dovecot] Dovecot repo for CentOS
by Eric Kom 14 May '14

14 May '14

Hi all, Please am looking for a repo for dovecot on CentOS where I can installed the latest never. Thanks

3 2

[Dovecot] Dovecot 2.2.13 core dumped with shared folder/acl
by Alessio Cecchi 14 May '14

14 May '14

Hi, after the upgrade to dovecot 2.2.13 (on Deb 6) for users that have enabled shared folder I found "core dumped" error in the log: imap(webmaster(a)pippo.com): Fatal: master: service(imap): child 26828 killed with signal 11 (core dumped) [...] imap[26828]: segfault at 160 ip 00007f76a18bca32 sp 00007fff5ecc13b0 error 4 in lib01_acl_plugin.so[7f76a18af000+13000] These error happens "random", when users configure subscription for shared folders or browse shared folders. Here "bt full": #0 0x00007f76a18bca32 in acl_mailbox_get_aclobj (box=<value optimized out>) at acl-mailbox.c:29 No locals. #1 0x00007f76a16ad1e3 in cmd_myrights (cmd=0x1211cd0) at imap-acl-plugin.c:331 ns = <value optimized out> box = 0x12051f0 mailbox = 0x11732a8 "shared" orig_mailbox = 0x1214690 "shared" rights = <value optimized out> str = <value optimized out> #2 0x000000000041813d in command_exec (cmd=0x1211cd0) at imap-commands.c:158 hook = 0x117c0e0 ret = <value optimized out> #3 0x0000000000417240 in client_command_input (cmd=0x1211cd0) at imap-client.c:778 client = 0x12110d0 command = <value optimized out> __FUNCTION__ = "client_command_input" #4 0x000000000041732d in client_command_input (cmd=0x1211cd0) at imap-client.c:839 client = 0x12110d0 command = 0x0 __FUNCTION__ = "client_command_input" #5 0x00000000004175ad in client_handle_next_command (client=0x12110d0) at imap-client.c:877 No locals. #6 client_handle_input (client=0x12110d0) at imap-client.c:889 _data_stack_cur_id = 3 ret = 96 remove_io = <value optimized out> handled_commands = false __FUNCTION__ = "client_handle_input" #7 0x000000000041792f in client_input (client=0x12110d0) at imap-client.c:931 cmd = <value optimized out> output = 0x1211b10 bytes = <value optimized out> __FUNCTION__ = "client_input" #8 0x00007f76a24c98ce in io_loop_call_io (io=0x1211be0) at ioloop.c:441 ioloop = 0x117b730 t_id = 2 __FUNCTION__ = "io_loop_call_io" #9 0x00007f76a24caa4f in io_loop_handler_run_internal (ioloop=<value optimized out>) at ioloop-epoll.c:220 ctx = 0x117c3c0 event = 0x117d230 list = 0x1197a60 io = 0x10 ---Type <return> to continue, or q <return> to quit--- tv = {tv_sec = 59, tv_usec = 999046} msecs = <value optimized out> ret = 1 i = 0 call = false __FUNCTION__ = "io_loop_handler_run_internal" #10 0x00007f76a24c9959 in io_loop_handler_run (ioloop=0x10) at ioloop.c:488 No locals. #11 0x00007f76a24c99e8 in io_loop_run (ioloop=0x117b730) at ioloop.c:465 __FUNCTION__ = "io_loop_run" #12 0x00007f76a2476ef3 in master_service_run (service=0x117b5c0, callback=0x28) at master-service.c:566 No locals. #13 0x0000000000420eb7 in main (argc=1, argv=0x117b390) at main.c:400 set_roots = {0x428e20, 0x0} login_set = {auth_socket_path = 0x1173050 "\210\060\027\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x4210b0 <login_client_connected>, failure_callback = 0x421050 <login_client_failed>, request_auth_token = 1} service_flags = <value optimized out> storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = <value optimized out> Here is my configuration: # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.9 auth_cache_negative_ttl = 10 mins auth_cache_size = 8 M auth_cache_ttl = 20 mins deliver_log_format = msgid=%m, from=%f, subject="%s": %$ dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 89 first_valid_uid = 89 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_idle_notify_interval = 29 mins imap_logout_format = in=%i out=%o session=<%{session}> last_valid_gid = 89 last_valid_uid = 89 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * mail_fsync = always mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota acl expire maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate vnd.dovecot.duplicate mmap_disable = yes namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = username_format=%Ld /etc/dovecot/extra/alias-domains-denylogin.txt deny = yes driver = passwd-file } passdb { args = cache_key=%s%u webmail=192.168.3.15 driver = vpopmail } plugin { acl = vfile acl_shared_dict = proxy::acl expire = Trash expire2 = Spam expire_dict = proxy::expire quota = maildir:UserQuota quota2 = dict:Quota Usage::noenforcing:proxy::sqlquota quota_grace = 10M quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/before.sieve sieve_dir = ~/sieve sieve_extensions = +vnd.dovecot.duplicate -vacation } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o, session=<%{session}> protocols = imap pop3 sieve service auth { client_limit = 5500 unix_listener auth-userdb { group = vchkpw mode = 0660 user = vpopmail } } service dict { process_limit = 500 unix_listener dict { group = vchkpw mode = 0660 user = vpopmail } } service imap-login { process_min_avail = 4 service_count = 0 } service imap { process_limit = 4000 service_count = 100 } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { service_count = 0 } service pop3 { process_limit = 1023 service_count = 100 } service quota-warning { executable = script /etc/dovecot/scripts/quota-warning.sh unix_listener quota-warning { user = vpopmail } user = vpopmail } ssl_cert = </etc/dovecot/ssl/wildcard.pem ssl_key = </etc/dovecot/ssl/wildcard.key submission_host = localhost userdb { args = quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol lda { mail_location = maildir:~/Maildir:INDEX=MEMORY mail_plugins = quota acl expire sieve } protocol imap { mail_max_userip_connections = 15 mail_plugins = quota acl expire imap_quota imap_acl } protocol sieve { mail_max_userip_connections = 2 } protocol pop3 { mail_max_userip_connections = 5 }

1 0

[Dovecot] dovecot shared folder
by Mihai Badici 13 May '14

13 May '14

I try to create a shared directory in dovecot. When accessing ( from roundcube) i can't subscribe or list the namespace. It looks like I don't have rights. This is an extract from debug log: When I try to create a new folder in "Public" (i don't have rights, but i can try) loooks like the process crash: May 12 23:10:07 imap: Debug: Module loaded: /usr/lib/dovecot/lib01_acl_plugin.so May 12 23:10:07 imap: Debug: Module loaded: /usr/lib/dovecot/lib02_imap_acl_plugin.so May 12 23:10:07 imap: Debug: Added userdb setting: plugin/ mail=Mihai.Badici May 12 23:10:07 imap(Mihai.Badici): Debug: Effective uid=10000, gid=10000, home=/home/dovecot/private/Mihai.Badici May 12 23:10:07 imap(Mihai.Badici): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/MAILDIR May 12 23:10:07 imap(Mihai.Badici): Debug: maildir++: root=/home/dovecot/private/Mihai.Badici/MAILDIR, index=, indexpvt=, control=, inbox=/home/dovecot/private/Mihai.Badici/MAILDIR, alt= May 12 23:10:07 imap(Mihai.Badici): Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot-acl May 12 23:10:07 imap(Mihai.Badici): Debug: acl: acl username = Mihai.Badici May 12 23:10:07 imap(Mihai.Badici): Debug: acl: owner = 1 May 12 23:10:07 imap(Mihai.Badici): Debug: acl vfile: Global ACL legacy directory: /etc/dovecot/dovecot-acl May 12 23:10:07 imap(Mihai.Badici): Debug: Namespace : type=shared, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:/home/dovecot/public May 12 23:10:07 imap(Mihai.Badici): Debug: maildir++: root=/home/dovecot/public, index=, indexpvt=, control=, inbox=, alt= May 12 23:10:07 imap(Mihai.Badici): Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot-acl May 12 23:10:07 imap(Mihai.Badici): Debug: acl: acl username = Mihai.Badici May 12 23:10:07 imap(Mihai.Badici): Debug: acl: owner = 0 May 12 23:10:07 imap(Mihai.Badici): Debug: acl vfile: Global ACL legacy directory: /etc/dovecot/dovecot-acl May 12 23:10:07 imap(Mihai.Badici): Debug: acl vfile: file /etc/dovecot/dovecot- acl//.DEFAULT not found May 12 23:10:07 imap(Mihai.Badici): Debug: acl vfile: file /etc/dovecot/dovecot- acl//.DEFAULT not found May 12 23:10:07 imap(Mihai.Badici): Debug: acl vfile: reading file /home/dovecot/public/dovecot-acl May 12 23:10:07 imap(Mihai.Badici): Fatal: master: service(imap): child 5013 killed with signal 11 (core dumps disabled) doveconf -n 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.10.17-smp i686 Slackware 14.1 auth_debug = yes default_login_user = dovecot disable_plaintext_auth = no imap_metadata = yes log_path = /var/log/dovecot mail_attribute_dict = file:~/shared_metadata mail_debug = yes mail_gid = 10000 mail_location = maildir:~/MAILDIR mail_plugins = acl mail_uid = 10000 namespace { location = maildir:/home/dovecot/public prefix = Public/ separator = / subscriptions = yes type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/dovecot-acl acl_anyone = allow acl_shared_dict = file:/home/dovecot/shared-mailboxes.db } postmaster_address = root(a)mail.olm.ro protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postdrop mode = 0666 user = postfix } unix_listener auth-userdb { group = mailbox mode = 0666 user = mailbox } user = dovecot } service dict { unix_listener dict { group = mailbox mode = 0600 user = mailbox } } service lmtp { unix_listener /var/spool/postfix/private/lmtp-dovecot { group = postfix mode = 0600 user = postfix } } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } imap_metadata = yes protocol lmtp { mail_plugins = acl } protocol lda { mail_plugins = acl } protocol imap { mail_plugins = acl acl imap_acl } -- Mihai Bădici http://mihai.badici.ro

2 1

[Dovecot] Quota dict with redis
by Davide 13 May '14

13 May '14

I have installed redis backend for quota and my dovecot.conf is as follow: quota = dict:User quota:ignoreunlimited:redis:host=127.0.0.1:prefix=%u/ but for all of my users doveadm quota get return always same quota (of the last user) Someone could help me in the right direction? -- *Davide Marchi* *T*eorema *F*errara *Srl* Via Spronello, 7 - Ferrara - 44121 Tel. *0532783161* Fax. *0532783368* E-m@il: *davide.marchi(a)mail.cgilfe.it* Skype: *davide.marchi73* Web: *http://www.cgilfe.it* *CONFIDENZIALITA'* *Ai sensi del D.Lgs. 196/2003 si precisa che le informazioni contenute in questo messaggio sono riservate ed a uso esclusivo del destinatario/dei destinatari. Qualora il messaggio in parola Le fosse pervenuto per errore, La invitiamo ad eliminarlo senza copiarlo e a non inoltrarlo a terzi, dandocene gentilmente comunicazione.* *Per favore, pensa all'ambiente. Stampa questa email solo se necessario.*

1 0

[Dovecot] Dovecot Special_Use and K9 (and other Clients)
by sumsumag＠gmx.de 13 May '14

13 May '14

4 4

[Dovecot] İnstall dovecot-piegonhone
by Selcuk Yazar 13 May '14

13 May '14

Hi, We have Postfix-Dovecot MTA at Redhat EL 5 system. Also we are using this system activelly. Now i wantto install pigeonhole managesive server on this sys. Do i have any risk or anything ? thanks in advance -- Selçuk YAZAR

2 2

[Dovecot] Error on doveadm director map
by mtrainer＠cloud-free.com 13 May '14

13 May '14

Hi All, I am running Dovecot 1:2.2.9-1~bpo70+1 on Debian Wheezy. I have just started getting the error below when I do a do a list of proxied users. The list of users appears OK afterwards. # doveadm director map doveadm(root): Error: User listing returned failure doveadm(root): Error: user listing failed user mail server ip expire time . . . My director config is below. Thanks Murray # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 auth_cache_size = 32 M auth_cache_ttl = 2 hours auth_debug = yes auth_mechanisms = plain login auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!#$-=?^_{}~./@+%" auth_username_translation = +@ auth_verbose = yes base_dir = /var/run/dovecot/ director_mail_servers = 27.54.95.41 27.54.95.42 27.54.95.43 27.54.95.44 27.54.95.45 27.54.95.46 director_servers = 27.54.95.37 27.54.95.38 disable_plaintext_auth = no doveadm_port = 24245 lmtp_proxy = yes mail_debug = yes namespace { inbox = yes location = prefix = INBOX. type = private } passdb { args = nopassword=y proxy=y driver = static } protocols = " imap lmtp pop3" service auth-worker { user = dovecot } service auth { client_limit = 4096 unix_listener auth-userdb { group = mail mode = 0666 user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = 27.54.95.37 port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap-login { chroot = login executable = imap-login director inet_listener imap { address = *, [::] port = 143 } inet_listener imaps { address = * port = 993 ssl = yes } process_limit = 2048 process_min_avail = 32 service_count = 1 user = dovecot vsz_limit = 256 M } service imap { process_limit = 4096 vsz_limit = 256 M } service ipc { unix_listener ipc { mode = 0666 user = dovecot } } service lmtp { inet_listener lmtp { address = 27.54.95.37 port = 24 } process_limit = 2048 process_min_avail = 32 } service pop3-login { chroot = login executable = pop3-login director inet_listener pop3 { address = *, [::] port = 110 } inet_listener pop3s { address = *, [::] port = 995 ssl = yes } process_limit = 2048 process_min_avail = 32 service_count = 1 user = dovecot vsz_limit = 256 M } service pop3 { process_limit = 4096 vsz_limit = 256 M } ssl_cert =

1 0

[Dovecot] dsync - Panic: file mail-index-transaction-update.c: line 19
by Götz Reinicke - IT Koordinator 12 May '14

12 May '14

Hi, we have started to switch our users mails from mbox to maildir and see for some users panics. May be someone has a hint on whats causing that and how to fix it? It's dovecot 2.2.10 on Redhat. dsync(s109487): Error: Corrupted index cache file /srv/vmail/s109487/mail/.imap/GS Drehbuch 1/dovecot.index.cache: Broken physical size for mail UID 42 dsync(s109487): Error: mail parser: read(/srv/vmail/s109487/mail/GS Drehbuch 1, box=GS Drehbuch 1) failed: Invalid argument dsync(s109487): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(s109487): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 [0x332ea6722a] -> /usr/lib64/dovecot/ Thanks and regards . Götz -- Götz Reinicke IT-Koordinator Tel. +49 7141 969 82 420 Fax +49 7141 969 55 420 E-Mail goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Jürgen Walter MdL Staatssekretär im Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg Geschäftsführer: Prof. Thomas Schadt

1 0

[Dovecot] Released Pigeonhole v0.4.3 for Dovecot v2.2.13.
by Stephan Bosch 12 May '14

12 May '14

Hello Dovecot users, Now that Dovecot v2.2.13 is released, I can release a new Pigeonhole. Due to changes in Dovecot, this Pigeonhole release will not compile cleanly against older Dovecot releases. This release is mainly about bugfixes. One notable addition is that I have updated the "vnd.dovecot.duplicate" extension to the new IETF draft "duplicate" extension. Changelog v0.4.3: * Editheader extension: Made control characters allowed for editheader, except NUL. Before, this would cause a runtime error. + Upgraded Dovecot-specific Sieve "vnd.dovecot.duplicate" extension to match the new draft "duplicate" extension. - Fixed sieve_result_global_log_error to log only as i_info in administrator log (syslog) if executed from multiscript context. - Sieve redirect extension: Adjusted loop detection to show leniency to resent messages. - Sieve include extension: Fixed problem with handling of duplicate includes with different parameters :once or :optional. - Sieve spamtest/virustest extensions: Tests were erroneously performed against the original message. When used together with extprograms filter to add the spam headers, the changes were not being used by the spamtest and virustest extensions. - Deprecated Sieve notify extension: Fixed segfault problems in message string substitution. - ManageSieve: Fixed active link verification to handle redundant path slashes correctly. - Sieve vacation extension: - Fixed interaction of sieve_vacation_dont_check_recipient with sieve_vacation_send_from_recipient setting. - Fixed log message for discarded response. - Sieve extprograms plugin: - Forgot to disable the alarm() timeouts set for script execution. - Fixed fd leak and handling of output shutdown. - Fixed 'Bad filedescriptor' error occurring when disconnecting script client. - Made sure that programs are never forked with root privileges. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.3.tar… http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.3.tar… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this new release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

[Dovecot] 2.2.12: Panic: file mail-index.c: line 380 (mail_index_keywords_unref): assertion failed: (keywords->refcount > 0)
by Leho Kraav 12 May '14

12 May '14

I upgraded 2.1 -> 2.2 something like a week ago because I needed INDEXPVT. Not sure if this crash started immediately or not, noticed it today looking at journalctl. Backtrace http://bpaste.net/raw/181944/ and pasted below. This seems to crash on every IMAP connection made, so any ideas for a possible client-level workaround are quite welcome until dovecot code improves here. root@server ~ $ dovecot -n # 2.2.12: /etc/dovecot/dovecot.conf # OS: Linux 3.4.54-vs2.3.3.5+pf64 x86_64 Gentoo Base System release 2.2 ext4 hostname = *hidden* listen = 192.168.1.2 log_path = /dev/stderr log_timestamp = mail_gid = mail mail_home = /secure/Maildir/%n mail_location = Maildir:/secure/Maildir/%n mail_plugins = acl mail_privileged_group = mail mail_uid = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { list = children location = maildir:/secure/Maildir/%%n:INDEXPVT=/secure/Maildir/%n/shared/%%n prefix = Shared.%%n. separator = . subscriptions = no type = shared } namespace { location = maildir:/secure/Maildir/projekt:INDEX=/secure/Maildir/%n/projekt prefix = Projekt. separator = . subscriptions = no type = public } namespace { location = maildir:/secure/Maildir/rss:INDEX=/secure/Maildir/%n/rss prefix = RSS. separator = . subscriptions = no type = public } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/secure/Maildir/shared-mailboxes.db mail_log_events = mailbox_delete sieve = /secure/Maildir/%n/dovecot-sieve sieve_dir = /secure/Maildir/%n/sieve sieve_global_path = /etc/dovecot/sieve/default.sieve } postmaster_address = postmaster protocols = imap lmtp sieve service auth { unix_listener auth-userdb { mode = 0600 user = mail } user = mail } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/ssl/server.crt ssl_key = </etc/ssl/server.key userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = acl sieve acl } protocol imap { mail_max_userip_connections = 20 mail_plugins = acl imap_acl } protocol sieve { managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date } #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out>

3 2

[Dovecot] IMAP disconnect before greeting / banner
by Benoit Panizzon 12 May '14

12 May '14

Hello We have a server on which we run multiple instances of dovecot. Each instance serving a domain and binding to a specific IP. The whole thing on three servers using the proxy ability and replication of dovecot. Now one domain has more users and we start seeing very strange behaviour. As soon as about 45 users have connected to the imap service ip of that instance, the server accepts the connections and then disconnects without showing the IMAP banner. This happens on all of our three servers and only for that specific domain (which has most connections). While this occurs, there is no problem with the other instances for other domains on the same physical machine. So the database backend etc. are not the issue. While this occurs, there is no hint of what goes wrong in the logfiles. I did even set mail_debug=yes but that still does not produce any output of why clients get disconnected prior to the server displaying the banner. Any hints on where I could start looking for the error, or get more debug output as with mail_debug=yes ? -Benoit-

1 0

[Dovecot] ManageSieve OOM with Huge Folders
by Fabian Peter 12 May '14

12 May '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi all, we're experiencing "Out of Memory" Problems caused by Sieve-Filters delivering mail to huge IMAP folders. From the logs, I'm beginning to think the problem is that the sieve/lmtp process loads the "dovecot.index.cache" file apparently twice into memory to do something with it. We've set our memory limit per process to 256MB - the cache file of the folders we're having issues with is exactly 128MB. Mails coming in that should be filtered to these folders are being denied, an error is being logged. Apparently, there would be two easy solutions to this: increasing memory OR decreasing folder size. Both are not possible. Increasing memory just means we will have this issue again in some weeks. Deacreasing mailbox size isn't possible since the folders contain archived system mails from our backend software which need to be kept for a while. Currently, we're creating a new folder each time we reach this limit, but that isn't exactly the best way to go for the future. In the end, the folders are for archiving purposes and therefore should not be managed at all since all this is automated. I hope there's some obvious switch I've just not seen in the config. I actually can't imagine that this is default or wanted behaviour since there must be people with large inboxes and sieve filters that either also have this problem or don't have it since they fixed it. The problem clearly is reproducable. Each time the cache file hits 128MB - which happens at around 200k mails in the folder - (with our current setting of 256MB memory limit per process), things go down and our mailqueues reach 10k undelivered mails within a few hours. I hope you can help me Sincerly Fabian OS - -- Linux 2.6.32-16-pve #1 SMP Mon Oct 22 08:38:13 CEST 2012 i686 GNU/Linux (The IMAP server is running within a debian squeeze openVZ container on the Proxmox Virtual Environment Kernel; filesystem for the containers is ext3) VERSION - ------- 2.1.14 (bf80034a547d) CONFIG - ------ # 2.1.14 (bf80034a547d): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-16-pve i686 Debian 6.0.7 simfs auth_cache_size = 10 M mail_debug = yes mail_location = maildir:/var/mail/%u:LAYOUT=fs mail_max_userip_connections = 10000 maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = /var/mail/%u/.dovecot.sieve sieve_dir = /var/mail/%u/sieve } protocols = imap lmtp sieve service imap-login { client_limit = 5 process_limit = 0 process_min_avail = 4 service_count = 0 } service imap { client_limit = 10 process_limit = 1024 process_min_avail = 4 } service lmtp { client_limit = 20 inet_listener lmtp { address = *, [::] port = 24 } process_limit = 0 process_min_avail = 10 vsz_limit = 256 M } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { client_limit = 10 process_limit = 0 process_min_avail = 4 } ssl = required ssl_ca = </etc/ssl/certs/wildcard.hexonet.net.ca ssl_cert = </etc/ssl/certs/wildcard.hexonet.net.crt ssl_key = </etc/ssl/certs/wildcard.hexonet.net.key userdb { args = uid=vmail gid=vmail home=/var/mail/%u driver = static } protocol lmtp { mail_plugins = sieve } LOG - --- May 12 06:36:36: Debug: none: root=, index=, control=, inbox=, alt= May 12 06:36:36: Debug: auth input: USERNAME(a)hexonet.net uid=5000 gid=5000 home=/var/mail/USERNAME(a)hexonet.net May 12 06:36:36: Debug: Effective uid=5000, gid=5000, home=/var/mail/USERNAME(a)hexonet.net May 12 06:36:36: Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/USERNAME@hexonet.net:LAYOUT=fs May 12 06:36:36: Debug: fs: root=/var/mail/USERNAME(a)hexonet.net, index=, control=, inbox=/var/mail/USERNAME(a)hexonet.net, alt= May 12 06:36:36: Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. May 12 06:36:36: Debug: PJyQMOZrcFN7awAA9jyUPQ: sieve: using the following location for user's Sieve script: /var/mail/USERNAME(a)hexonet.net/.dovecot.sieve May 12 06:36:36: Debug: PJyQMOZrcFN7awAA9jyUPQ: sieve: opening script /var/mail/USERNAME(a)hexonet.net/.dovecot.sieve May 12 06:36:36: Debug: PJyQMOZrcFN7awAA9jyUPQ: sieve: script binary /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin successfully loaded May 12 06:36:36: Debug: PJyQMOZrcFN7awAA9jyUPQ: sieve: binary save: not saving binary /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin, because it is already stored May 12 06:36:36: Debug: PJyQMOZrcFN7awAA9jyUPQ: sieve: executing script from /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin May 12 06:36:36: PJyQMOZrcFN7awAA9jyUPQ: sieve: msgid=unspecified: stored mail into mailbox 'IMAP-FOLDER' May 12 06:36:41 Debug: none: root=, index=, control=, inbox=, alt= May 12 06:36:41 Debug: auth input: USERNAME(a)hexonet.net uid=5000 gid=5000 home=/var/mail/USERNAME(a)hexonet.net May 12 06:36:41: Debug: Effective uid=5000, gid=5000, home=/var/mail/USERNAME(a)hexonet.net May 12 06:36:41: Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/USERNAME@hexonet.net:LAYOUT=fs May 12 06:36:41: Debug: fs: root=/var/mail/USERNAME(a)hexonet.net, index=, control=, inbox=/var/mail/USERNAME(a)hexonet.net, alt= May 12 06:36:41: Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. May 12 06:36:41: Debug: QJyQMOZrcFN7awAA9jyUPQ: sieve: using the following location for user's Sieve script: /var/mail/USERNAME(a)hexonet.net/.dovecot.sieve May 12 06:36:41: Debug: QJyQMOZrcFN7awAA9jyUPQ: sieve: opening script /var/mail/USERNAME(a)hexonet.net/.dovecot.sieve May 12 06:36:41: Debug: QJyQMOZrcFN7awAA9jyUPQ: sieve: script binary /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin successfully loaded May 12 06:36:41: Debug: QJyQMOZrcFN7awAA9jyUPQ: sieve: binary save: not saving binary /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin, because it is already stored May 12 06:36:41: Debug: QJyQMOZrcFN7awAA9jyUPQ: sieve: executing script from /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin May 12 06:36:41: Fatal: pool_system_realloc(268435456): Out of memory May 12 06:36:41: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x45951) [0x219951] -> /usr/lib/dovecot/libdovecot.so.0(+0x459bf) [0x2199bf] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x1e8dc5] -> /usr/lib/dovecot/libdovecot.so.0(+0x5806e) [0x22c06e] -> /usr/lib/dovecot/libdovecot.so.0(+0x40ec8) [0x214ec8] -> /usr/lib/dovecot/libdovecot.so.0(buffer_get_space_unsafe+0x85) [0x2153b5] -> /usr/lib/dovecot/libdovecot.so.0(buffer_append_space_unsafe+0x2b) [0x2154cb] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_map+0x219) [0x506cf9] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_open_and_verify+0x75) [0x507245] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_register_get_list+0x50) [0x5092a0] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_header_init+0x15f) [0x4f6def] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_cache_parse_init+0x7c) [0x4f73fc] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_save_add+0x1d7) [0x4a0a87] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_save_begin+0x1d3) [0x4a0dd3] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_begin+0x58) [0x4d7988] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xba) [0x4d163a] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_copy+0x4b) [0x49bacb] - -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x54) [0x4d78b4] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x35f5f) [0xc52f5f] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_result_execute+0x16b) [0xc49efb] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_execute+0x69) [0xc5b139] - -> /usr/lib/dovecot/modules/lib90_sieve_plugin.so(+0x2892) [0x75e892] - -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0x4f) [0x19641f] - -> dovecot/lmtp() [0x804c812] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x42) [0x227822] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd3) [0x2289e3] - -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x2277b0] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x2d) [0x21050d] May 12 06:36:41: Fatal: master: service(lmtp): child 27515 returned error 83 (Out of memory (service lmtp { vsz_limit=256 MB }, you may need to increase it)) - -- Fabian Peter Systemadministrator HEXONET GmbH T: +49 6841 69 84 308 F: +49 6841 69 84 199 E: fpeter(a)hexonet.net W: http://www.hexonet.net HEXONET GmbH, Talstrasse 27, 66424 Homburg, Germany. CEO & General Manager: Jens Wagner, HRB 2839 (HOM), Amtsgericht Saarbrücken, VAT-ID: DE-138316882 HEXONET Services Inc., 104 - 7455 132nd Street, Surrey, B.C., V3W 1J8, Canada. CSO & General Manager: Robert Birkner This email and any files transmitted are confidential and intended only or the person(s) directly addressed. If you are not the intended recipient, any use, copying, transmission, distribution, or other forms of dissemination is strictly prohibited. If you have received this email in error, please notify the sender immediately and permanently delete this email with any files that may be attached. -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.22 (Darwin) Comment: GPGTools - https://gpgtools.org Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBCgAGBQJTcHVYAAoJEPIZChNlZ+or5VQIAKegO6HwORlpEmP3YBkJnHXY sYsR1sP89Vm1Uzv4cVL30KF1P37NI9sZwHrO5H2aC5sqNSadaZ0lOUFncwlZwphh JsSS2Jye+56UW7XR92rUuwC8FPYRk6nOxTA0hHtAGW1IxCROz8P32V24cRlDE32k rcq2GT0V4laFlD5YNcqFWAClTqAholnHZCm/7VpBCevUTx0F+KVZxEth/xOf0ajY EmWoXat4Fihnly1YtdPqN5FqIyFdzBF8tyuWaUZN3BfO8QDso+tci/NRbe2yYkIK lhulr4PAvccsIqJ+u/9j+XN7SL9ZXDtU0w4xWQe+5SrGfFXJlXsuJoRgBdThn9I= =YP4k -----END PGP SIGNATURE-----

2 1

[Dovecot] v2.2.13.rc1 vs. Pigeonhole
by Tamsy 12 May '14

12 May '14

Server: Ubuntu 10.04 LTS 32bit There seems to be an incompatibility when compiling Pigeonhole against Dovecot v2.2.13.rc1. # make check with Pigeonhole throws up the following error message: <snip> Test case: ./tests/extensions/editheader/addheader.svtest: 1: Test 'Addheader - first' SUCCEEDED 2: Test 'Addheader - last' SUCCEEDED 3: Test 'Addheader - framed' SUCCEEDED 4: Test 'Addheader - folded' SUCCEEDED 5: Test 'Addheader - newlines' FAILED: wrong first header content in redirected mail 6: Test 'Addheader - implicit keep' SUCCEEDED 7: Test 'Addheader - UTF 8' SUCCEEDED 8: Test 'Addheader - devious characters' SUCCEEDED FAIL: 1 of 8 tests failed. I tried this with the latest Pigeonhole from Mercurial: - dovecot-2-2-pigeonhole-3b6917a4807c and also with the older: - dovecot-2-2-pigeonhole-e111a2393a92 Both versions are quitting during "make check" with the same error when compiling against dovecot-2.2.13.rc1. Compiling those versions against dovecot-2.2.12 is going without errors though. Cheers, Tamsy

3 4

[Dovecot] message-decoder bug for attachments with charset=binary attribute in content-type?
by Robert Wolf 12 May '14

12 May '14

Hello, I have configure dovecot with solr and I wanted to let solr index content of attachments. For testing I have used biabam command line tool to generate emails with attachments. I have found that dovecot with fts_decoder incorrectly decodes these attachments from biabam and therefore pdftotext has reported corrupted PDF. The problem is that biabam generates header with charset=binary and dovecot message decoder tries to process it as UTF8 or non-UTF8 data. ============================================================ --biabam.ZxWVLybiabam.ZxWVLy Content-Type: application/pdf; charset=binary Content-Disposition: attachment; filename="bacula-jobs.pdf" Content-Transfer-Encoding: base64 JVBERi0xLjQKJcfsj6IKNSAwIG9iago8PC9MZW5ndGggNiAwIFIvRmlsdGVy IC9GbGF0ZURlY29kZT4+CnN0cmVhbQp4nF2PT0+EMBDF7/0U7yYYWdqFXdbe 1vgnMXpQezMeClSoQNltweh+egvLyczhN3kz703mCLpioFMtLDoSv2aoHKGo ..... ============================================================ This PDF begins orginal with ============================================================ 0000000: 2550 4446 2d31 2e34 0a25 c7ec 8fa2 0a35 %PDF-1.4.%.....5 0000010: 2030 206f 626a 0a3c 3c2f 4c65 6e67 7468 0 obj.<</Length 0000020: 2036 2030 2052 2f46 696c 7465 7220 2f46 6 0 R/Filter /F 0000030: 6c61 7465 4465 636f 6465 3e3e 0a73 7472 lateDecode>>.str ============================================================ But the dovecot pass following data to fts_decoder script: ============================================================ 0000000: 2550 4446 2d31 2e34 0a25 c3a4 c3bc c3b6 %PDF-1.4.%...... 0000010: c39f 0a32 2030 206f 626a 0a3c 3c2f 4c65 ...2 0 obj.<</Le 0000020: 6e67 7468 2033 2030 2052 2f46 696c 7465 ngth 3 0 R/Filte 0000030: 722f 466c 6174 6544 6563 6f64 653e 3e0a r/FlateDecode>>. ============================================================ As you can see binary data are mangled. Alpine and Thunderbird do not write charset=binary to content-type header and searching works perfect. I have searched in source code and I have found one place. If I replace the following code in file dovecot-2.1.7/src/lib-mail/message-decoder.c on line 241 with new one, the dovecots message decoder decodes message correctly and pdftotext can convert attached PDF. Original code: ============================================================ 241: ctx->binary_input = ctx->content_charset == NULL && 242: (ctx->flags & MESSAGE_DECODER_FLAG_RETURN_BINARY) != 0 && 243: (part->flags & (MESSAGE_PART_FLAG_TEXT | 244: MESSAGE_PART_FLAG_MESSAGE_RFC822)) == 0; ============================================================ My update: ============================================================ 241 ctx->binary_input = ((ctx->content_charset != NULL) && (strcasecmp(ctx->content_charset, "binary") == 0)) || (ctx->content_charset == NULL && 242 (ctx->flags & MESSAGE_DECODER_FLAG_RETURN_BINARY) != 0 && 243 (part->flags & (MESSAGE_PART_FLAG_TEXT | 244 MESSAGE_PART_FLAG_MESSAGE_RFC822)) == 0); ============================================================ This will set ctx->binary_input for the attachment with charset set to "binary". I don't know if this is correct update, but the searching works with this update for biabam binary attachments too. Could you please verify this problem and maybe update the code? Thank you very much. # dovecot --version 2.1.7 Config: plugin { fts = solr fts_solr = url=http://localhost:8080/solr/ fts_decoder = decode2text } service decode2text { executable = script /etc/dovecot/scripts/decode2text.sh user = dovecot unix_listener decode2text { mode = 0666 } } Regards, Robert Wolf.

1 0

[Dovecot] questions about process_limit
by Andreas Meyer 12 May '14

12 May '14

Hello all! # dovecot --version 2.1.17 Sometimes I have this in the logfile: May 11 16:55:52 master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped May 11 17:35:03 master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped May 11 17:36:27 master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped I then put this in the dovecot.conf service imap-login { service_count = 1 process_min_avail = 50 #process_limit = $default_process_limit process_limit = 10000 vsz_limit = 64M } and get this: May 11 18:19:36 master: Info: Dovecot v2.1.17 starting up (core dumps disabled) May 11 18:19:36 config: Warning: service auth { client_limit=1000 } is lower than required under max. load (10300) May 11 18:19:36 config: Warning: service anvil { client_limit=1000 } is lower than required under max. load (10203) Puting this in: service auth { client_limit = 10300 unix_listener auth-userdb { mode = 0666 user = vmail group = vmail } } service anvil { client_limit = 10300 } I get this: May 11 18:27:37 delta.bitcorner.eu dovecot[3989]: Warning: fd limit (ulimit -n) is lower than required under max. load (1024 < 10300), because of service auth { client_limit } I have also seen this today: May 11 13:14:05 log: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) May 11 13:14:05 auth: Error: read(anvil-auth-penalty) failed: EOF May 11 13:14:05 auth: Error: net_connect_unix(anvil-auth-penalty) failed: Permission denied What is the best way to avoid this process_limit errors and configure dovecot the best way? Greetings Andreas

3 2

[Dovecot] Segfault with passwd as a second userdb at auth_fields_rollback
by Jan Kończak 11 May '14

11 May '14

Hello, I've been trying to set up dovecot to support passwd-file + passwd/PAM auth. I made an unusual config (passwd-file as userdb failed to work for me), which uses static as userdb: =============== passdb { driver = passwd-file args = username_format=%u scheme=CRYPT /etc/dovecot/users } userdb { driver = static default_fields = uid=vmail gid=vmail home=/var/spool/mail/%d/%n } passdb { driver = pam } userdb { driver = passwd } =============== While passwd-file+static worked well, passwd/PAM caused trouble: $ doveadm user xxx doveadm(root): Error: userdb lookup(xxx): Disconnected unexpectedly field value If passwd-file had the user, check went fine; otherwise it segfaulted. The crash has been accompanied by a syslog message: kernel: auth[9788]: segfault at 18 ip 0000000000416391 sp 00007fffd11a3d90 error 4 in auth[400000+44000] Translating address lead me to: 0000000000416390 <auth_fields_rollback>: 416390: 53 push %rbx 416391: 48 83 7f 18 00 cmpq $0x0,0x18(%rdi) I was using packages from http://packages.atrpms.net/dist/el6/dovecot/ To be precise, dovecot-2.2.10-1_14.el6.x86_64.rpm I tampered with the src.rpm, upgraded spec&sources to match 2.2.12. It didn't help, so I tries to "workaround" this. The bug has gone when in src/auth/auth-fields.c:210 I added check if the field ptr is not null. As it's a userdb query, it seems that for some reason (static?) in src/auth/auth-request.c:1058 the function auth_fields_rollback is called with null request->userdb_reply Now it works fine: $ doveadm user xxx field value uid 1000 gid 100 home /home/xxx mail maildir:~/.maildir system_groups_user xxx $ doveadm user jkonczak@ast... field value uid 103 gid 103 home /var/spool/mail/ast.../jkonczak mail maildir:~/.maildir So now virtual users get vmail uid/gid, system users get their uid/gid, home is fine etc. Below I attach the patch + full config. Regards, Jan Kończak =============================================== $ cat SOURCES/dovecot-2.2.12-auth_fields_rollback-nullptr_check.patch --- src/auth/auth-fields.c.orig 2014-05-11 16:17:49.755258666 +0200 +++ src/auth/auth-fields.c 2014-05-11 16:18:24.704946586 +0200 @@ -207,6 +207,7 @@ void auth_fields_rollback(struct auth_fields *fields) { + if (fields==NULL) return; if (array_is_created(&fields->snapshot_fields)) { array_clear(&fields->fields); array_append_array(&fields->fields, &fields->snapshot_fields); =============================================== $ dovecot --version 2.2.12 $ doveconf # passdb/userdb/auth related passdb { args = username_format=%u scheme=CRYPT /etc/dovecot/users default_fields = deny = no driver = passwd-file master = no override_fields = pass = no result_failure = continue result_internalfail = continue result_success = return-ok skip = never } passdb { args = default_fields = deny = no driver = pam master = no override_fields = pass = no result_failure = continue result_internalfail = continue result_success = return-ok skip = never } service auth { chroot = client_limit = 0 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-client { group = mode = 0600 user = $default_internal_user } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = mode = 0666 user = $default_internal_user } unix_listener login/login { group = mode = 0666 user = } unix_listener token-login/tokenlogin { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } userdb { args = default_fields = uid=vmail gid=vmail home=/var/spool/mail/%d/%n driver = static override_fields = result_failure = continue result_internalfail = continue result_success = return-ok skip = never } userdb { args = default_fields = driver = passwd override_fields = result_failure = continue result_internalfail = continue result_success = return-ok skip = never } ===============================================

2 1

[Dovecot] "doveadm penalty -a" doesn't work?
by Peer Heinlein 11 May '14

11 May '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 We're running multiple instances on the same server. While doveadm penalty works: root@host:/etc/dovecot# doveadm penalty IP penalty last_penalty last_update 93.180.xxx.xxx 4 2014-05-10 12:21:08 12:21:08 80.153.xxx.xxx 0 2014-05-10 12:21:12 12:21:12 a seperate anvil-Socket doesn't work at all: root@host:/etc/dovecot# doveadm penalty -a /var/run/dovecot-example/anvil doveadm penalty [-a <anvil socket path>] [<ip/bits>] It just shows up the help message. (Dovecot 2.2.12) Peer - -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBAgAGBQJTbf41AAoJEAOLLpq5E82H/h4H/2VpFfrqG+dcW73dS8CAWXVM thWcj5/GKUDaE/MYKsATDmNenlPuKIHsC8+hM7pyB3kfA0d7EDP/aNcaOWdw16XE fq7PSoLWiPJcsTG6ArzyuJMYiCwb2TuFIimFjjlZWVqnB+iAVv0y7ESJ9De/dmzM eE3ct/JmuY+0MrRAKSNdDX/Dbaakh03/JQ3/GvAwYeTFgviCfa3D5hsYCfhDZbPC 2vE3A9D46SqhmrediuWdtnj6rAhYwfjS+77jXaK6NyYru0WtYf9ozgtt5pbb89Hd EKzdNyKdKsZEnQ1ubv7cj5671OwL1ikp/d8tJr3/l4tgRHWf2+BmuGJIoo8AFwE= =2gZD -----END PGP SIGNATURE-----

2 1

[Dovecot] ECDSA certificate support
by SIW 11 May '14

11 May '14

Does the latest version of Dovecot support ECDSA certificates? I had a look in: http://wiki2.dovecot.org/SSL but it didn't answer my question. Can someone please help or point me in the right direction? I'd also like to know if I can run an RSA cert AND an ECDSA certificate at the same time in Dovecot (like you can in Postfix). Many thanks.

1 0

[Dovecot] LDA can't read dovecot.conf
by Hit4er 11 May '14

11 May '14

Hi, i have a problem with lda with this error what i doing wrong? -- View this message in context: http://dovecot.2317879.n4.nabble.com/LDA-can-t-read-dovecot-conf-tp47853.ht… Sent from the Dovecot mailing list archive at Nabble.com.

4 5

[Dovecot] dovecot 2.2.9 - ssl_cert and ssl_key ignored
by Alexandru Bostina 11 May '14

11 May '14

Hello, It seems that Dovecot ignores the new /ssl_cert and ssl_key /settings. Using them in the dovecot configuration results in the error: Fatal: Couldn't parse private ssl_key: error:0906D06C:PEM routines:PEM_read_bio:no start line: Expecting: ANY PRIVATE KEY] Using the old /ssl_//cert//_file/ and /ssl_key_file/ results in their being obsolete warning but no fatal error.

3 4

[Dovecot] Only part of sieve script works
by Sebastian Schlingmann 10 May '14

10 May '14

Hi, I am using Dovecot 2.2.11 with Pigeonhole on Arch Linux. I have a partly working sieve script (pasted to the end of this mail) which sorts mail into various imap folders. The first, third and fourth if blocks work just fine. The second and fifth block do not sort any mails. However, if I apply the script with sieve-test to mails the second and fifth block seem to work. How is the manual check with sieve-test different from the sieve filtering during mail delivery? I am thankful for any hints. Sebastian this is the sieve script I am talking about require "fileinto"; # Musik wegsortieren if anyof ( header :comparator "i;ascii-casemap" :contains "Subject" "Mixing.DJ", header :comparator "i;ascii-casemap" :contains "Subject" "John B", header :comparator "i;ascii-casemap" :contains "Subject" "FLOSS Weekly", header :comparator "i;ascii-casemap" :contains "Subject" "BrainStuff", header :comparator "i;ascii-casemap" :contains "Subject" "Nerdy Show", header :comparator "i;ascii-casemap" :contains "Subject" ["My Brother", " My Brother And Me"], header :comparator "i;ascii-casemap" :contains "Subject" "MoJoMenace", header :comparator "i;ascii-casemap" :contains "Subject" "GWJ Conference Call", header :comparator "i;ascii-casemap" :contains "Subject" "Welcome to Night Vale", header :comparator "i;ascii-casemap" :contains "Subject" "International Waters" ) { fileinto "Feeds.music"; stop; } # Youtube wegsortieren if address :all :comparator "i;ascii-casemap" :contains "From" "noreply(a)youtube.com" { fileinto "Feeds.Youtube"; stop; } # Awesomer wegsortieren if header :comparator "i;octet" :contains "Subject" "[The Awesomer]" { fileinto "Feeds.Awesomer"; stop; } # Feeds sortieren if address :all :comparator "i;octet" :contains "From" "sebi+feedmailer(a)mighty.selfhost.bz" { fileinto "Feeds"; stop; } # AIStA wegsortieren if header :comparator "i;ascii-casemap" :contains "Received" "webmail.awista.net" { fileinto "AIStA"; stop; }

2 1

[Dovecot] Denial of Service attacks against Dovecot v1.1+
by Timo Sirainen 10 May '14

10 May '14

There's an upper limit to how many IMAP/POP3 connections can exist that haven't logged in (and separate limits for post-login). Normally when this limit is reached, the oldest connection gets disconnected. There is of course some potential to try to DoS Dovecot by doing a lot of IMAP/POP3 connections, but because the oldest connection always gets destroyed this requires quite a lot of activity from the attacker. This "destroy oldest connection" however hasn't been working in v1.1+ releases for connections that have started SSL/TLS handshake, but haven't finished it. So an attacker could just do a bunch of TCP connections to port 993 and leave them hanging around and Dovecot would pretty quickly reach the upper limit without being able to disconnect any of the oldest connections. Here are patches to fix this: http://hg.dovecot.org/dovecot-2.2/rev/41622541a7a3 http://hg.dovecot.org/dovecot-2.1/rev/b7ac23b4d339 http://hg.dovecot.org/dovecot-2.0/rev/48f90e7e92dc http://hg.dovecot.org/dovecot-1.2/rev/8ba4253adc9b http://hg.dovecot.org/dovecot-1.1/rev/fe0e6550585c The fix will be in v2.2.13. Maybe also in v2.1.18 if I decide to release it. For older releases you need to patch it yourself. For people who are using dovecot-ee releases the fix is also in v2.2.12.12 and v2.1.7.7 releases.

3 2

[Dovecot] Strange behavior on with "listescape" and "lda_mailbox_autocreate" - double entries
by Patrick De Zordo 09 May '14

09 May '14

Hello Guys, we are using Dovecot since years; all working flawless but one strange behavior: Let me explain.. - we have enabled the "listescape" plugin in "15-lda.conf", "10-mail.conf" and "20-imap.conf". - we use the following default namespace in "10-mail.conf": --------------- 10-mail.conf ----------------------------------------- namespace { type = private prefix = separator = / inbox = yes subscriptions = yes } ---------------------------------------------------------------------------------------- - we use a sieve script that automatically generates folders in the following form (example): ---------------------------------------------------------------------------------------- ".INBOX.2014.05.patrick.incoming" for user "patrick(a)xx.com" ".INBOX.2014.05.patrick.outgoing" for user "patrick(a)xx.com" ".INBOX.2014.05.p\2edezordo.incoming" for user "p.dezordo(a)xx.com" ---------------------------------------------------------------------------------------- This is ok, but the automatically generated "subscriptions"-file of the user contains double lines (the second line is something strange?!); the second one should not be created, its totally wrong..! --------------- subscriptions ----------------------------------------- Trash Sent INBOX.2014.05.patrick.incoming INBOX.2014.05.patrick.outgoing INBOX.2014.05.p\2edezordo.incoming INBOX\2e2014\2e05\2ep\5c2edezordo\2eincoming <----- this line!?!?!? ---------------------------------------------------------------------------------------- Have you any ideas whats going on? Could this be a bug, or misconfiguration? Thanks in advance!! Greeting from Italy! Patrick.

2 6