- dovecot - dovecot.org

[Dovecot] Disconnected from database, retrying commit?
by Ralf Hildebrandt 15 May '14

15 May '14

In my log I have a lot of log entries like this one (covering one hour of logs here): May 15 09:00:49 dict: Info: maildatabase: Disconnected from database, retrying commit May 15 09:17:10 dict: Info: maildatabase: Disconnected from database, retrying commit May 15 09:22:30 dict: Info: maildatabase: Disconnected from database, retrying commit May 15 09:31:07 dict: Info: maildatabase: Disconnected from database, retrying commit May 15 09:37:15 dict: Info: maildatabase: Disconnected from database, retrying commit May 15 09:39:36 dict: Info: maildatabase: Disconnected from database, retrying commit May 15 09:50:49 dict: Info: maildatabase: Disconnected from database, retrying commit 7 times per hour, that's quite a bit. Dovecot 2.1.17 Related logs look like: ======================= May 15 00:16:44 imap(username): Info: save: box=Sent, uid=1196, msgid=<5373EB4A.90306(a)sys4.de>, size=11152 May 15 00:16:44 dict: Info: maildatabase: Disconnected from database, retrying commit or: May 14 16:10:34 lmtp(7225, username@domain): Info: NTuhEvF1c1M5HAAAcnFQ7Q: msgid=<20090714161800.121200(a)gmx.net>: saved mail to INBOX May 14 16:10:34 dict: Info: maildatabase: Disconnected from database, retrying commit May 14 16:10:34 dict: Info: mysql(sql.sys4.de): Connected to database maildatabase So it's reconnecting, but why is it disconnecting/being disconnected in the first place? Does it matter? should I worry? -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

1 0

[Dovecot] v2.2.13 released
by Timo Sirainen 15 May '14

15 May '14

http://dovecot.org/releases/2.2/dovecot-2.2.13.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.13.tar.gz.sig A few minor changes since v2.2.13.rc1, mainly making the Pigeonhole tests pass. * Fixed a DoS attack against imap/pop3-login processes. If SSL/TLS handshake was started but wasn't finished, the login process attempted to eventually forcibly disconnect the client, but failed to do it correctly. This could have left the connections hanging arond for a long time. (Affected Dovecot v1.1+) + mdbox: Added mdbox_purge_preserve_alt setting to keep the file within alt storage during purge. (Should become enforced in v2.3.0?) + fts: Added support for parsing attachments via Apache Tika. Enable with: plugin { fts_tika = http://tikahost:9998/tika/ } + virtual plugin: Delay opening backend mailboxes until it's necessary. This requires mailbox_list_index=yes to work. (Currently IMAP IDLE command still causes all backend mailboxes to be opened.) + mail_never_cache_fields=* means now to disable all caching. This may be a useful optimization as doveadm/dsync parameter for some admin tasks which shouldn't really update the cache file. + IMAP: Return SPECIAL-USE flags always for LSUB command. - pop3 server was still crashing in v2.2.12 with some settings - maildir: Various fixes and improvements to handling compressed mails, especially when they have broken/missing S=sizes in filenames. - fts-lucene, fts-solr: Fixed crash on search when the index contained duplicate entries. - Many fixes and performance improvements to dsync and replication - director was somewhat broken when there were exactly two directors in the ring. It caused errors about "weak users" getting stuck. - mail_attachment_dir: Attachments with the last base64-encoded line longer than the rest wasn't handled correctly. - IMAP: SEARCH/SORT PARTIAL was handled completely wrong in v2.2.11+ - acl: Global ACL file handling was broken when multiple entries matched the mailbox name. (Only the first entry was used.)

8 14

[Dovecot] v2.2.13.rc1 released
by Timo Sirainen 15 May '14

15 May '14

http://dovecot.org/releases/2.2/rc/dovecot-2.2.13.rc1.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.13.rc1.tar.gz.sig There have been a ton of smaller and some larger changes since v2.2.12, so I thought I'd first make a RC release and the final v2.2.13 tomorrow. Please try it out! BTW. I've read most of the mails again in Dovecot mailing list, but there are still a few reported bugs I decided to leave until later. Anyway feel free to re-send any bug reports for things that haven't been fixed in v2.2.13 yet. * Fixed a DoS attack against imap/pop3-login processes. If SSL/TLS handshake was started but wasn't finished, the login process attempted to eventually forcibly disconnect the client, but failed to do it correctly. This could have left the connections hanging arond for a long time. (Affected Dovecot v1.1+) + mdbox: Added mdbox_purge_preserve_alt setting to keep the file within alt storage during purge. (Should become enforced in v2.3.0?) + fts: Added support for parsing attachments via Apache Tika. Enable with: plugin { fts_tika = http://tikahost:9998/tika/ } + virtual plugin: Delay opening backend mailboxes until it's necessary. This requires mailbox_list_index=yes to work. (Currently IMAP IDLE command still causes all backend mailboxes to be opened.) + mail_never_cache_fields=* means now to disable all caching. This may be a useful optimization as doveadm/dsync parameter for some admin tasks which shouldn't really update the cache file. + IMAP: Return SPECIAL-USE flags always for LSUB command. - pop3 server was still crashing in v2.2.12 with some settings - maildir: Various fixes and improvements to handling compressed mails, especially when they have broken/missing S=sizes in filenames. - fts-lucene, fts-solr: Fixed crash on search when the index contained duplicate entries. - Many fixes and performance improvements to dsync and replication - director was somewhat broken when there were exactly two directors in the ring. It caused errors about "weak users" getting stuck. - mail_attachment_dir: Attachments with the last base64-encoded line longer than the rest wasn't handled correctly. - IMAP: SEARCH/SORT PARTIAL was handled completely wrong in v2.2.11+ - acl: Global ACL file handling was broken when multiple entries matched the mailbox name. (Only the first entry was used.)

4 8

[Dovecot] 2.2.12 RPM Needed
by Asai 15 May '14

15 May '14

Greetings, I'm not very experienced in building Source RPMs and we're in need of a Dovecot RPM for version 2.2.12 for CentOS 5. It seems that the ATRPMs repo maintained by Axel Thimm hasn't seen much activity lately and the task of updating a source RPM is more than I have time for as a busy developer who does systems admin on the side. Could anybody recommend another repo where there would be the latest Dovecot binaries? Or perhaps tell me of any gotchas and catches which might arise if I go ahead and build 2.2.12 from source over the RPM I currently have installed (2.2.10)? Thanks. -- --Asai

4 6

[Dovecot] LMTP SSL?
by Ralf Hildebrandt 15 May '14

15 May '14

Can I enable STARTTLS/SSL on the LMTP listener in Dovecot 2.1.x? service lmtp { unix_listener lmtp { } inet_listener lmtp { address = * port = 24 --> ssl=yes } } -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

4 4

[Dovecot] Enterprise repository for free now? ;-) (Bug?)
by Daniel Thielemann 14 May '14

14 May '14

Hi, I bought repo access for 0,00$ one minute ago. If its free now then I wanna say thank you very much, otherwise somebody should fix it :) Take a look here: http://shop.dovecot.fi/home/8-dovecot-ee-repository-access.html Screen: http://www.directupload.net/file/d/3622/oxyo89zm_png.htm Regards

3 3

[Dovecot] Pigeonhole Sieve: Vacation Extension answer to every E-Mail
by Götz Reinicke - IT Koordinator 14 May '14

14 May '14

Hi, dont ask :) but I have two accounts for which I have to configure an auto reply for any e-mail send to it. As far as I understand Sieve yet, I do have to set sieve_vacation_min_period = 0 in the dovecot config and set the days value in the sieve rule. But as there is a limit of 1 day, I think this is not working. Right? Is there any other way to accomplish that? regards . Götz -- Götz Reinicke IT-Koordinator Tel. +49 7141 969 82 420 E-Mail goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Jürgen Walter MdL Staatssekretär im Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg Geschäftsführer: Prof. Thomas Schadt

3 4

[Dovecot] Broken IMAPS Connects Create Lingering imap-login Processes
by Jochen Bern 14 May '14

14 May '14

Hello everyone, we are running a central server (CentOS 6.5, dovecot-2.0.9-7.el6 with a small patch to disable the IMAP CREATE command, and openssl-1.0.1e-16.el6_5.7) and distribute standard client software to customer( site)s. The clients do IMAPS connects in regular intervals (no IDLE, no lingering logins) and authenticate with certs issued by a dedicated PKI ("auth_ssl_username_from_cert = yes" and a static global password). One of the customers has a major networking problem that hasn't been fully analyzed yet. Sniffing his IMAPS connects on the server side, I see no (necessarily fragmented) TLSv1 Client Cert + Key Exchange happen; instead, after ~60s, we receive a single packet with "TLSv1 Certificate Verify, Change Cipher Spec, Encrypted Handshake Message" *and* the TCP FIN+PSH+ACK flags set. The problem I'ld like to ask for help with here is that dovecot's imap-login process doesn't terminate when the FIN is received, or when the IMAP protocol's inactivity timeout is reached, it takes *more than two hours* for it to go away. Because of that, this single client racks up 1100+ processes (counting against dovecot's configured limits), TCP connections, and the associated RAM usage. (Since the client cert is obviously never received, the default mail_max_userip_connections of 10 doesn't come into play, either.) Is there any way - short of hexing a negative feedback loop straight into the iptables - to prevent this kind of buildup? Kind regards, J. Bern > [root ~]# date ; ps auwwwx --forest | grep -A 12 '/dove[c]ot' > Mo 5. Mai 21:45:39 CEST 2014 > root 25297 0.8 0.0 19568 824 ? Ss Apr30 64:44 /usr/sbin/dovecot > dovecot 25299 0.1 0.1 17996 5828 ? S Apr30 11:52 \_ dovecot/anvil [1147 connections] > root 25300 0.1 0.0 13388 1220 ? S Apr30 8:07 \_ dovecot/log > root 25301 0.0 0.0 39596 1564 ? S Apr30 2:21 \_ dovecot/ssl-params > dovecot 25304 0.3 0.0 78384 3552 ? S Apr30 22:13 \_ dovecot/auth [0 wait, 0 passdb, 0 userdb] > root 13161 0.3 0.3 25236 13352 ? S May04 7:11 \_ dovecot/config > root 18384 0.2 0.2 20080 8200 ? S 08:20 1:37 \_ dovecot/config [... long-running IMAP login by the operators ...] > dovenull 12064 0.0 0.0 42440 3656 ? S 19:32 0:00 \_ dovecot/imap-login [1 connections (1 TLS)] > dovenull 12441 0.0 0.0 42440 3656 ? S 19:32 0:00 \_ dovecot/imap-login [1 connections (1 TLS)] > dovenull 12495 0.0 0.0 42440 3656 ? S 19:32 0:00 \_ dovecot/imap-login [1 connections (1 TLS)] > dovenull 12496 0.0 0.0 42440 3652 ? S 19:32 0:00 \_ dovecot/imap-login [1 connections (1 TLS)] > [root ~]# doveconf -n > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-431.3.1.el6.x86_64 x86_64 CentOS release 6.5 (Final) > auth_ssl_require_client_cert = yes > auth_ssl_username_from_cert = yes > listen = [...] > login_greeting = [...] > mail_location = maildir:~ > mail_log_prefix = "%s(%u)[%p]: " > mbox_write_locks = fcntl > passdb { > args = password=[...] > driver = static > } > plugin { > mail_log_events = delete undelete expunge > mail_log_fields = uid msgid size vsize flags > } > protocols = imap > service anvil { > client_limit = 3605 > } > service auth { > client_limit = 7000 > } > service imap-login { > process_limit = 3500 > } > service imap { > process_limit = 3500 > } > ssl = required > ssl_ca = </etc/pki/dovecot/certs/[...].pem > ssl_cert = </etc/pki/dovecot/certs/[...].pem > ssl_key = </etc/pki/dovecot/private/[...].pem > ssl_verify_client_cert = yes > userdb { > args = uid=mandanten gid=mandanten home=/[...]/%Ld_[...]/%Ln > driver = static > } > verbose_proctitle = yes > protocol imap { > mail_plugins = " mail_log notify" > } -- *NEU* - NEC IT-Infrastruktur-Produkte im <http://www.linworks-shop.de/>: Server--Storage--Virtualisierung--Management SW--Passion for Performance Jochen Bern, Systemingenieur --- LINworks GmbH <http://www.LINworks.de/> Postfach 100121, 64201 Darmstadt | Robert-Koch-Str. 9, 64331 Weiterstadt PGP (1024D/4096g) FP = D18B 41B1 16C0 11BA 7F8C DCF7 E1D5 FAF4 444E 1C27 Tel. +49 6151 9067-231, Zentr. -0, Fax -299 - Amtsg. Darmstadt HRB 85202 Unternehmenssitz Weiterstadt, Geschäftsführer Metin Dogan, Oliver Michel

3 5

[Dovecot] imapc problem
by FUSTE Emmanuel 14 May '14

14 May '14

hello, I have some trouble when trying to migrate from another imap server to dovecot with imapc/dsync/doveadm. when running "doveadm -o imapc_user=foo -o imapc_password=bar backup -R -u localuser imapc:" all is ok. But when running "doveadm -o imapc_user=foo -o imapc_password=bar sync -R -u localuser imapc:", all local mods are overwritten. For example deleting a message or moving it to trash and it reappear in INBOX (and disappear from trash if moved there). If I try without the reverse flag "-R", local delete reappear two times after two or more sync. If I try without the reverse flag "-R", a message moved to trash is propagated to trash too, but reappear as many times as you "sync" on the two sides in the INBOX. With other users, first "backup -R" is ok but on next sync or backup try, I get : dsync(other_user): Error: Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted. Other IMAP server is CriticalPath 8.5.137. Any clue ?? Emmanuel. Dovecot conf : 2.2.12.12 (03196f188677+): /etc/dovecot/dovecot.conf # OS: Linux 3.11.0-19-generic x86_64 Ubuntu 12.04.4 LTS auth_master_user_separator = * auth_username_format = %u disable_plaintext_auth = no doveadm_password = **************** imapc_features = rfc822.size fetch-headers imapc_host = my_old_imap_server imapc_user = %u lda_mailbox_autocreate = yes listen = * mail_gid = vmail mail_location = maildir:~/Maildir mail_plugins = quota notify replication mail_prefetch_count = 20 mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { hidden = no inbox = no list = children location = maildir:%%h/Maildir:INDEXPVT=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-master-ldap.conf.ext driver = ldap master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_anyone = allow acl_shared_dict =file:/appli/vmail/shared-mailboxes quota = dict:userquota::file:/appli/vmail/local_userquota/%u/dovecot-quota quota_rule = *:storage=100M quota_rule2 = INBOX:storage=+20%% quota_rule3 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap sieve service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth { unix_listener auth-userdb { group = vmail mode = 0660 } } service doveadm { inet_listener { port = 12345 } user = vmail } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl = no userdb { args = /etc/dovecot/dovecot-users-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = quota sieve } protocol imap { mail_plugins = quota imap_quota }

1 1

[Dovecot] Error open(/var/lib/dovecot/db/shared-mailboxes) after update 2.2.10 -> 2.2.13
by Götz Reinicke - IT Koordinator 14 May '14

14 May '14

Hi, I did an update from dovecot 2.2.10 -> 2.2.13 and now I'm getting errors: May 14 10:40:00 imap(hansdampf): Error: open(/var/lib/dovecot/db/shared-mailboxes) failed: Permission denied Currently the permissions on shared-mailboxes rw-rw-rw but teh error still exists. Any hints? Thansk and Regards. Götz -- Götz Reinicke IT-Koordinator Tel. +49 7141 969 82 420 E-Mail goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Jürgen Walter MdL Staatssekretär im Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg Geschäftsführer: Prof. Thomas Schadt

3 4

[Dovecot] Dovecot repo for CentOS
by Eric Kom 14 May '14

14 May '14

Hi all, Please am looking for a repo for dovecot on CentOS where I can installed the latest never. Thanks

3 2

[Dovecot] Dovecot 2.2.13 core dumped with shared folder/acl
by Alessio Cecchi 14 May '14

14 May '14

Hi, after the upgrade to dovecot 2.2.13 (on Deb 6) for users that have enabled shared folder I found "core dumped" error in the log: imap(webmaster(a)pippo.com): Fatal: master: service(imap): child 26828 killed with signal 11 (core dumped) [...] imap[26828]: segfault at 160 ip 00007f76a18bca32 sp 00007fff5ecc13b0 error 4 in lib01_acl_plugin.so[7f76a18af000+13000] These error happens "random", when users configure subscription for shared folders or browse shared folders. Here "bt full": #0 0x00007f76a18bca32 in acl_mailbox_get_aclobj (box=<value optimized out>) at acl-mailbox.c:29 No locals. #1 0x00007f76a16ad1e3 in cmd_myrights (cmd=0x1211cd0) at imap-acl-plugin.c:331 ns = <value optimized out> box = 0x12051f0 mailbox = 0x11732a8 "shared" orig_mailbox = 0x1214690 "shared" rights = <value optimized out> str = <value optimized out> #2 0x000000000041813d in command_exec (cmd=0x1211cd0) at imap-commands.c:158 hook = 0x117c0e0 ret = <value optimized out> #3 0x0000000000417240 in client_command_input (cmd=0x1211cd0) at imap-client.c:778 client = 0x12110d0 command = <value optimized out> __FUNCTION__ = "client_command_input" #4 0x000000000041732d in client_command_input (cmd=0x1211cd0) at imap-client.c:839 client = 0x12110d0 command = 0x0 __FUNCTION__ = "client_command_input" #5 0x00000000004175ad in client_handle_next_command (client=0x12110d0) at imap-client.c:877 No locals. #6 client_handle_input (client=0x12110d0) at imap-client.c:889 _data_stack_cur_id = 3 ret = 96 remove_io = <value optimized out> handled_commands = false __FUNCTION__ = "client_handle_input" #7 0x000000000041792f in client_input (client=0x12110d0) at imap-client.c:931 cmd = <value optimized out> output = 0x1211b10 bytes = <value optimized out> __FUNCTION__ = "client_input" #8 0x00007f76a24c98ce in io_loop_call_io (io=0x1211be0) at ioloop.c:441 ioloop = 0x117b730 t_id = 2 __FUNCTION__ = "io_loop_call_io" #9 0x00007f76a24caa4f in io_loop_handler_run_internal (ioloop=<value optimized out>) at ioloop-epoll.c:220 ctx = 0x117c3c0 event = 0x117d230 list = 0x1197a60 io = 0x10 ---Type <return> to continue, or q <return> to quit--- tv = {tv_sec = 59, tv_usec = 999046} msecs = <value optimized out> ret = 1 i = 0 call = false __FUNCTION__ = "io_loop_handler_run_internal" #10 0x00007f76a24c9959 in io_loop_handler_run (ioloop=0x10) at ioloop.c:488 No locals. #11 0x00007f76a24c99e8 in io_loop_run (ioloop=0x117b730) at ioloop.c:465 __FUNCTION__ = "io_loop_run" #12 0x00007f76a2476ef3 in master_service_run (service=0x117b5c0, callback=0x28) at master-service.c:566 No locals. #13 0x0000000000420eb7 in main (argc=1, argv=0x117b390) at main.c:400 set_roots = {0x428e20, 0x0} login_set = {auth_socket_path = 0x1173050 "\210\060\027\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x4210b0 <login_client_connected>, failure_callback = 0x421050 <login_client_failed>, request_auth_token = 1} service_flags = <value optimized out> storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = <value optimized out> Here is my configuration: # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.9 auth_cache_negative_ttl = 10 mins auth_cache_size = 8 M auth_cache_ttl = 20 mins deliver_log_format = msgid=%m, from=%f, subject="%s": %$ dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 89 first_valid_uid = 89 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_idle_notify_interval = 29 mins imap_logout_format = in=%i out=%o session=<%{session}> last_valid_gid = 89 last_valid_uid = 89 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * mail_fsync = always mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota acl expire maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate vnd.dovecot.duplicate mmap_disable = yes namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = username_format=%Ld /etc/dovecot/extra/alias-domains-denylogin.txt deny = yes driver = passwd-file } passdb { args = cache_key=%s%u webmail=192.168.3.15 driver = vpopmail } plugin { acl = vfile acl_shared_dict = proxy::acl expire = Trash expire2 = Spam expire_dict = proxy::expire quota = maildir:UserQuota quota2 = dict:Quota Usage::noenforcing:proxy::sqlquota quota_grace = 10M quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/before.sieve sieve_dir = ~/sieve sieve_extensions = +vnd.dovecot.duplicate -vacation } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o, session=<%{session}> protocols = imap pop3 sieve service auth { client_limit = 5500 unix_listener auth-userdb { group = vchkpw mode = 0660 user = vpopmail } } service dict { process_limit = 500 unix_listener dict { group = vchkpw mode = 0660 user = vpopmail } } service imap-login { process_min_avail = 4 service_count = 0 } service imap { process_limit = 4000 service_count = 100 } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { service_count = 0 } service pop3 { process_limit = 1023 service_count = 100 } service quota-warning { executable = script /etc/dovecot/scripts/quota-warning.sh unix_listener quota-warning { user = vpopmail } user = vpopmail } ssl_cert = </etc/dovecot/ssl/wildcard.pem ssl_key = </etc/dovecot/ssl/wildcard.key submission_host = localhost userdb { args = quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol lda { mail_location = maildir:~/Maildir:INDEX=MEMORY mail_plugins = quota acl expire sieve } protocol imap { mail_max_userip_connections = 15 mail_plugins = quota acl expire imap_quota imap_acl } protocol sieve { mail_max_userip_connections = 2 } protocol pop3 { mail_max_userip_connections = 5 }

1 0

[Dovecot] dovecot shared folder
by Mihai Badici 13 May '14

13 May '14

I try to create a shared directory in dovecot. When accessing ( from roundcube) i can't subscribe or list the namespace. It looks like I don't have rights. This is an extract from debug log: When I try to create a new folder in "Public" (i don't have rights, but i can try) loooks like the process crash: May 12 23:10:07 imap: Debug: Module loaded: /usr/lib/dovecot/lib01_acl_plugin.so May 12 23:10:07 imap: Debug: Module loaded: /usr/lib/dovecot/lib02_imap_acl_plugin.so May 12 23:10:07 imap: Debug: Added userdb setting: plugin/ mail=Mihai.Badici May 12 23:10:07 imap(Mihai.Badici): Debug: Effective uid=10000, gid=10000, home=/home/dovecot/private/Mihai.Badici May 12 23:10:07 imap(Mihai.Badici): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/MAILDIR May 12 23:10:07 imap(Mihai.Badici): Debug: maildir++: root=/home/dovecot/private/Mihai.Badici/MAILDIR, index=, indexpvt=, control=, inbox=/home/dovecot/private/Mihai.Badici/MAILDIR, alt= May 12 23:10:07 imap(Mihai.Badici): Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot-acl May 12 23:10:07 imap(Mihai.Badici): Debug: acl: acl username = Mihai.Badici May 12 23:10:07 imap(Mihai.Badici): Debug: acl: owner = 1 May 12 23:10:07 imap(Mihai.Badici): Debug: acl vfile: Global ACL legacy directory: /etc/dovecot/dovecot-acl May 12 23:10:07 imap(Mihai.Badici): Debug: Namespace : type=shared, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:/home/dovecot/public May 12 23:10:07 imap(Mihai.Badici): Debug: maildir++: root=/home/dovecot/public, index=, indexpvt=, control=, inbox=, alt= May 12 23:10:07 imap(Mihai.Badici): Debug: acl: initializing backend with data: vfile:/etc/dovecot/dovecot-acl May 12 23:10:07 imap(Mihai.Badici): Debug: acl: acl username = Mihai.Badici May 12 23:10:07 imap(Mihai.Badici): Debug: acl: owner = 0 May 12 23:10:07 imap(Mihai.Badici): Debug: acl vfile: Global ACL legacy directory: /etc/dovecot/dovecot-acl May 12 23:10:07 imap(Mihai.Badici): Debug: acl vfile: file /etc/dovecot/dovecot- acl//.DEFAULT not found May 12 23:10:07 imap(Mihai.Badici): Debug: acl vfile: file /etc/dovecot/dovecot- acl//.DEFAULT not found May 12 23:10:07 imap(Mihai.Badici): Debug: acl vfile: reading file /home/dovecot/public/dovecot-acl May 12 23:10:07 imap(Mihai.Badici): Fatal: master: service(imap): child 5013 killed with signal 11 (core dumps disabled) doveconf -n 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.10.17-smp i686 Slackware 14.1 auth_debug = yes default_login_user = dovecot disable_plaintext_auth = no imap_metadata = yes log_path = /var/log/dovecot mail_attribute_dict = file:~/shared_metadata mail_debug = yes mail_gid = 10000 mail_location = maildir:~/MAILDIR mail_plugins = acl mail_uid = 10000 namespace { location = maildir:/home/dovecot/public prefix = Public/ separator = / subscriptions = yes type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/dovecot-acl acl_anyone = allow acl_shared_dict = file:/home/dovecot/shared-mailboxes.db } postmaster_address = root(a)mail.olm.ro protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postdrop mode = 0666 user = postfix } unix_listener auth-userdb { group = mailbox mode = 0666 user = mailbox } user = dovecot } service dict { unix_listener dict { group = mailbox mode = 0600 user = mailbox } } service lmtp { unix_listener /var/spool/postfix/private/lmtp-dovecot { group = postfix mode = 0600 user = postfix } } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } imap_metadata = yes protocol lmtp { mail_plugins = acl } protocol lda { mail_plugins = acl } protocol imap { mail_plugins = acl acl imap_acl } -- Mihai Bădici http://mihai.badici.ro

2 1

[Dovecot] Quota dict with redis
by Davide 13 May '14

13 May '14

I have installed redis backend for quota and my dovecot.conf is as follow: quota = dict:User quota:ignoreunlimited:redis:host=127.0.0.1:prefix=%u/ but for all of my users doveadm quota get return always same quota (of the last user) Someone could help me in the right direction? -- *Davide Marchi* *T*eorema *F*errara *Srl* Via Spronello, 7 - Ferrara - 44121 Tel. *0532783161* Fax. *0532783368* E-m@il: *davide.marchi(a)mail.cgilfe.it* Skype: *davide.marchi73* Web: *http://www.cgilfe.it* *CONFIDENZIALITA'* *Ai sensi del D.Lgs. 196/2003 si precisa che le informazioni contenute in questo messaggio sono riservate ed a uso esclusivo del destinatario/dei destinatari. Qualora il messaggio in parola Le fosse pervenuto per errore, La invitiamo ad eliminarlo senza copiarlo e a non inoltrarlo a terzi, dandocene gentilmente comunicazione.* *Per favore, pensa all'ambiente. Stampa questa email solo se necessario.*

1 0

[Dovecot] Dovecot Special_Use and K9 (and other Clients)
by sumsumag＠gmx.de 13 May '14

13 May '14

4 4

[Dovecot] İnstall dovecot-piegonhone
by Selcuk Yazar 13 May '14

13 May '14

Hi, We have Postfix-Dovecot MTA at Redhat EL 5 system. Also we are using this system activelly. Now i wantto install pigeonhole managesive server on this sys. Do i have any risk or anything ? thanks in advance -- Selçuk YAZAR

2 2

[Dovecot] Error on doveadm director map
by mtrainer＠cloud-free.com 13 May '14

13 May '14

Hi All, I am running Dovecot 1:2.2.9-1~bpo70+1 on Debian Wheezy. I have just started getting the error below when I do a do a list of proxied users. The list of users appears OK afterwards. # doveadm director map doveadm(root): Error: User listing returned failure doveadm(root): Error: user listing failed user mail server ip expire time . . . My director config is below. Thanks Murray # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 auth_cache_size = 32 M auth_cache_ttl = 2 hours auth_debug = yes auth_mechanisms = plain login auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!#$-=?^_{}~./@+%" auth_username_translation = +@ auth_verbose = yes base_dir = /var/run/dovecot/ director_mail_servers = 27.54.95.41 27.54.95.42 27.54.95.43 27.54.95.44 27.54.95.45 27.54.95.46 director_servers = 27.54.95.37 27.54.95.38 disable_plaintext_auth = no doveadm_port = 24245 lmtp_proxy = yes mail_debug = yes namespace { inbox = yes location = prefix = INBOX. type = private } passdb { args = nopassword=y proxy=y driver = static } protocols = " imap lmtp pop3" service auth-worker { user = dovecot } service auth { client_limit = 4096 unix_listener auth-userdb { group = mail mode = 0666 user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = 27.54.95.37 port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap-login { chroot = login executable = imap-login director inet_listener imap { address = *, [::] port = 143 } inet_listener imaps { address = * port = 993 ssl = yes } process_limit = 2048 process_min_avail = 32 service_count = 1 user = dovecot vsz_limit = 256 M } service imap { process_limit = 4096 vsz_limit = 256 M } service ipc { unix_listener ipc { mode = 0666 user = dovecot } } service lmtp { inet_listener lmtp { address = 27.54.95.37 port = 24 } process_limit = 2048 process_min_avail = 32 } service pop3-login { chroot = login executable = pop3-login director inet_listener pop3 { address = *, [::] port = 110 } inet_listener pop3s { address = *, [::] port = 995 ssl = yes } process_limit = 2048 process_min_avail = 32 service_count = 1 user = dovecot vsz_limit = 256 M } service pop3 { process_limit = 4096 vsz_limit = 256 M } ssl_cert =

1 0

[Dovecot] dsync - Panic: file mail-index-transaction-update.c: line 19
by Götz Reinicke - IT Koordinator 12 May '14

12 May '14

Hi, we have started to switch our users mails from mbox to maildir and see for some users panics. May be someone has a hint on whats causing that and how to fix it? It's dovecot 2.2.10 on Redhat. dsync(s109487): Error: Corrupted index cache file /srv/vmail/s109487/mail/.imap/GS Drehbuch 1/dovecot.index.cache: Broken physical size for mail UID 42 dsync(s109487): Error: mail parser: read(/srv/vmail/s109487/mail/GS Drehbuch 1, box=GS Drehbuch 1) failed: Invalid argument dsync(s109487): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(s109487): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 [0x332ea6722a] -> /usr/lib64/dovecot/ Thanks and regards . Götz -- Götz Reinicke IT-Koordinator Tel. +49 7141 969 82 420 Fax +49 7141 969 55 420 E-Mail goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Jürgen Walter MdL Staatssekretär im Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg Geschäftsführer: Prof. Thomas Schadt

1 0

[Dovecot] Released Pigeonhole v0.4.3 for Dovecot v2.2.13.
by Stephan Bosch 12 May '14

12 May '14

Hello Dovecot users, Now that Dovecot v2.2.13 is released, I can release a new Pigeonhole. Due to changes in Dovecot, this Pigeonhole release will not compile cleanly against older Dovecot releases. This release is mainly about bugfixes. One notable addition is that I have updated the "vnd.dovecot.duplicate" extension to the new IETF draft "duplicate" extension. Changelog v0.4.3: * Editheader extension: Made control characters allowed for editheader, except NUL. Before, this would cause a runtime error. + Upgraded Dovecot-specific Sieve "vnd.dovecot.duplicate" extension to match the new draft "duplicate" extension. - Fixed sieve_result_global_log_error to log only as i_info in administrator log (syslog) if executed from multiscript context. - Sieve redirect extension: Adjusted loop detection to show leniency to resent messages. - Sieve include extension: Fixed problem with handling of duplicate includes with different parameters :once or :optional. - Sieve spamtest/virustest extensions: Tests were erroneously performed against the original message. When used together with extprograms filter to add the spam headers, the changes were not being used by the spamtest and virustest extensions. - Deprecated Sieve notify extension: Fixed segfault problems in message string substitution. - ManageSieve: Fixed active link verification to handle redundant path slashes correctly. - Sieve vacation extension: - Fixed interaction of sieve_vacation_dont_check_recipient with sieve_vacation_send_from_recipient setting. - Fixed log message for discarded response. - Sieve extprograms plugin: - Forgot to disable the alarm() timeouts set for script execution. - Fixed fd leak and handling of output shutdown. - Fixed 'Bad filedescriptor' error occurring when disconnecting script client. - Made sure that programs are never forked with root privileges. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.3.tar… http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.3.tar… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this new release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

[Dovecot] 2.2.12: Panic: file mail-index.c: line 380 (mail_index_keywords_unref): assertion failed: (keywords->refcount > 0)
by Leho Kraav 12 May '14

12 May '14

I upgraded 2.1 -> 2.2 something like a week ago because I needed INDEXPVT. Not sure if this crash started immediately or not, noticed it today looking at journalctl. Backtrace http://bpaste.net/raw/181944/ and pasted below. This seems to crash on every IMAP connection made, so any ideas for a possible client-level workaround are quite welcome until dovecot code improves here. root@server ~ $ dovecot -n # 2.2.12: /etc/dovecot/dovecot.conf # OS: Linux 3.4.54-vs2.3.3.5+pf64 x86_64 Gentoo Base System release 2.2 ext4 hostname = *hidden* listen = 192.168.1.2 log_path = /dev/stderr log_timestamp = mail_gid = mail mail_home = /secure/Maildir/%n mail_location = Maildir:/secure/Maildir/%n mail_plugins = acl mail_privileged_group = mail mail_uid = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { list = children location = maildir:/secure/Maildir/%%n:INDEXPVT=/secure/Maildir/%n/shared/%%n prefix = Shared.%%n. separator = . subscriptions = no type = shared } namespace { location = maildir:/secure/Maildir/projekt:INDEX=/secure/Maildir/%n/projekt prefix = Projekt. separator = . subscriptions = no type = public } namespace { location = maildir:/secure/Maildir/rss:INDEX=/secure/Maildir/%n/rss prefix = RSS. separator = . subscriptions = no type = public } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/secure/Maildir/shared-mailboxes.db mail_log_events = mailbox_delete sieve = /secure/Maildir/%n/dovecot-sieve sieve_dir = /secure/Maildir/%n/sieve sieve_global_path = /etc/dovecot/sieve/default.sieve } postmaster_address = postmaster protocols = imap lmtp sieve service auth { unix_listener auth-userdb { mode = 0600 user = mail } user = mail } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/ssl/server.crt ssl_key = </etc/ssl/server.key userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = acl sieve acl } protocol imap { mail_max_userip_connections = 20 mail_plugins = acl imap_acl } protocol sieve { managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date } #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> #0 0x00007f64da799535 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f64da79a9b8 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f64dab76dc5 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0xae54a8 "/usr/lib64/dovecot/libdovecot.so.0(+0x6adcf) [0x7f64dab76dcf] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6ae2e) [0x7f64dab76e2e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f64dab30d4e] -> /usr"... #3 0x00007f64dab76e2e in i_internal_fatal_handler (ctx=0x7fffb9d88d00, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 0 #4 0x00007f64dab30d4e in i_panic (format=format@entry=0x7f64dae79848 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb9d88df0, reg_save_area = 0x7fffb9d88d30}} #5 0x00007f64dae59fbc in mail_index_keywords_unref (_keywords=<optimized out>) at mail-index.c:380 keywords = <optimized out> __FUNCTION__ = "mail_index_keywords_unref" #6 0x00007f64dae22657 in mailbox_copy (_ctx=<optimized out>, mail=mail@entry=0xbcf260) at mail-storage.c:2140 ctx = 0xbd3a80 t = 0xbcd580 keywords = 0xbd4a50 pvt_flags = 0 real_mail = <optimized out> ret = -1 __FUNCTION__ = "mailbox_copy" #7 0x00007f64dae2270d in mailbox_move (_ctx=<optimized out>, mail=0xbcf260) at mail-storage.c:2153 ctx = 0xbd3a80 #8 0x000000000040e72d in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7fffb9d88e88, t=0xbcd580, move=true, client=0xb0de50) at cmd-copy.c:67 search_ctx = 0xbcefe0 src_trans = 0xbce2c0 srcset_ctx = {str = 0xae5320, first_uid = 0, last_uid = 4294967295} ret = 1 save_ctx = 0x0 mail = 0xbcf260 copy_count = 1 src_uidset = 0xae5320 #9 cmd_copy_full (cmd=0xb0ea30, move=true) at cmd-copy.c:123 client = 0xb0de50 dest_storage = <optimized out> destbox = 0xb87bf0 t = 0xbcd580 src_trans = <optimized out> search_args = 0xb86be0 messageset = 0xaf0b60 "2631" mailbox = 0xaf0b68 "Trash" src_uidset = <optimized out> sync_flags = (unknown: 0) imap_flags = (unknown: 0) changes = {pool = 0x7fffb9d88fb0, uid_validity = 3117977312, saved_uids = {arr = {buffer = 0xd, element_size = 140071145425344}, v = 0xd, v_modifiable = 0xd}, ignored_modseq_changes = 11471704, changed = false, no_read_perm = false} copy_count = <optimized out> msg = <optimized out> ret = <optimized out> __FUNCTION__ = "cmd_copy_full" #10 0x0000000000418e6c in command_exec (cmd=cmd@entry=0xb0ea30) at imap-commands.c:158 hook = 0xaee0f0 ret = <optimized out> #11 0x0000000000417ed0 in client_command_input (cmd=0xb0ea30) at imap-client.c:780 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000417f8a in client_command_input (cmd=0xb0ea30) at imap-client.c:841 client = 0xb0de50 command = <optimized out> __FUNCTION__ = "client_command_input" #13 0x0000000000418245 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0xb0de50) at imap-client.c:879 No locals. #14 client_handle_input (client=client@entry=0xb0de50) at imap-client.c:891 _data_stack_cur_id = 3 ret = 64 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #15 0x00000000004185f2 in client_input (client=0xb0de50) at imap-client.c:933 cmd = <optimized out> output = 0xb0e880 bytes = 26 __FUNCTION__ = "client_input" #16 0x00007f64dab873b6 in io_loop_call_io (io=0xb0e950) at ioloop.c:388 ioloop = 0xaed740 t_id = 2 #17 0x00007f64dab88237 in io_loop_handler_run (ioloop=ioloop@entry=0xaed740) at ioloop-epoll.c:220 ctx = 0xaee3d0 events = 0x0 event = 0xaef1f0 list = 0xaefdc0 io = <optimized out> tv = {tv_sec = 4, tv_usec = 995201} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #18 0x00007f64dab86ec8 in io_loop_run (ioloop=0xaed740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #19 0x00007f64dab36033 in master_service_run (service=0xaed5d0, callback=callback@entry=0x4216a0 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040cc87 in main (argc=1, argv=0xaed390) at main.c:400 set_roots = {0x429180 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0xae5048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x421550 <login_client_connected>, failure_callback = 0x421260 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out>

3 2

[Dovecot] IMAP disconnect before greeting / banner
by Benoit Panizzon 12 May '14

12 May '14

Hello We have a server on which we run multiple instances of dovecot. Each instance serving a domain and binding to a specific IP. The whole thing on three servers using the proxy ability and replication of dovecot. Now one domain has more users and we start seeing very strange behaviour. As soon as about 45 users have connected to the imap service ip of that instance, the server accepts the connections and then disconnects without showing the IMAP banner. This happens on all of our three servers and only for that specific domain (which has most connections). While this occurs, there is no problem with the other instances for other domains on the same physical machine. So the database backend etc. are not the issue. While this occurs, there is no hint of what goes wrong in the logfiles. I did even set mail_debug=yes but that still does not produce any output of why clients get disconnected prior to the server displaying the banner. Any hints on where I could start looking for the error, or get more debug output as with mail_debug=yes ? -Benoit-

1 0

[Dovecot] ManageSieve OOM with Huge Folders
by Fabian Peter 12 May '14

12 May '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi all, we're experiencing "Out of Memory" Problems caused by Sieve-Filters delivering mail to huge IMAP folders. From the logs, I'm beginning to think the problem is that the sieve/lmtp process loads the "dovecot.index.cache" file apparently twice into memory to do something with it. We've set our memory limit per process to 256MB - the cache file of the folders we're having issues with is exactly 128MB. Mails coming in that should be filtered to these folders are being denied, an error is being logged. Apparently, there would be two easy solutions to this: increasing memory OR decreasing folder size. Both are not possible. Increasing memory just means we will have this issue again in some weeks. Deacreasing mailbox size isn't possible since the folders contain archived system mails from our backend software which need to be kept for a while. Currently, we're creating a new folder each time we reach this limit, but that isn't exactly the best way to go for the future. In the end, the folders are for archiving purposes and therefore should not be managed at all since all this is automated. I hope there's some obvious switch I've just not seen in the config. I actually can't imagine that this is default or wanted behaviour since there must be people with large inboxes and sieve filters that either also have this problem or don't have it since they fixed it. The problem clearly is reproducable. Each time the cache file hits 128MB - which happens at around 200k mails in the folder - (with our current setting of 256MB memory limit per process), things go down and our mailqueues reach 10k undelivered mails within a few hours. I hope you can help me Sincerly Fabian OS - -- Linux 2.6.32-16-pve #1 SMP Mon Oct 22 08:38:13 CEST 2012 i686 GNU/Linux (The IMAP server is running within a debian squeeze openVZ container on the Proxmox Virtual Environment Kernel; filesystem for the containers is ext3) VERSION - ------- 2.1.14 (bf80034a547d) CONFIG - ------ # 2.1.14 (bf80034a547d): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-16-pve i686 Debian 6.0.7 simfs auth_cache_size = 10 M mail_debug = yes mail_location = maildir:/var/mail/%u:LAYOUT=fs mail_max_userip_connections = 10000 maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = /var/mail/%u/.dovecot.sieve sieve_dir = /var/mail/%u/sieve } protocols = imap lmtp sieve service imap-login { client_limit = 5 process_limit = 0 process_min_avail = 4 service_count = 0 } service imap { client_limit = 10 process_limit = 1024 process_min_avail = 4 } service lmtp { client_limit = 20 inet_listener lmtp { address = *, [::] port = 24 } process_limit = 0 process_min_avail = 10 vsz_limit = 256 M } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { client_limit = 10 process_limit = 0 process_min_avail = 4 } ssl = required ssl_ca = </etc/ssl/certs/wildcard.hexonet.net.ca ssl_cert = </etc/ssl/certs/wildcard.hexonet.net.crt ssl_key = </etc/ssl/certs/wildcard.hexonet.net.key userdb { args = uid=vmail gid=vmail home=/var/mail/%u driver = static } protocol lmtp { mail_plugins = sieve } LOG - --- May 12 06:36:36: Debug: none: root=, index=, control=, inbox=, alt= May 12 06:36:36: Debug: auth input: USERNAME(a)hexonet.net uid=5000 gid=5000 home=/var/mail/USERNAME(a)hexonet.net May 12 06:36:36: Debug: Effective uid=5000, gid=5000, home=/var/mail/USERNAME(a)hexonet.net May 12 06:36:36: Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/USERNAME@hexonet.net:LAYOUT=fs May 12 06:36:36: Debug: fs: root=/var/mail/USERNAME(a)hexonet.net, index=, control=, inbox=/var/mail/USERNAME(a)hexonet.net, alt= May 12 06:36:36: Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. May 12 06:36:36: Debug: PJyQMOZrcFN7awAA9jyUPQ: sieve: using the following location for user's Sieve script: /var/mail/USERNAME(a)hexonet.net/.dovecot.sieve May 12 06:36:36: Debug: PJyQMOZrcFN7awAA9jyUPQ: sieve: opening script /var/mail/USERNAME(a)hexonet.net/.dovecot.sieve May 12 06:36:36: Debug: PJyQMOZrcFN7awAA9jyUPQ: sieve: script binary /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin successfully loaded May 12 06:36:36: Debug: PJyQMOZrcFN7awAA9jyUPQ: sieve: binary save: not saving binary /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin, because it is already stored May 12 06:36:36: Debug: PJyQMOZrcFN7awAA9jyUPQ: sieve: executing script from /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin May 12 06:36:36: PJyQMOZrcFN7awAA9jyUPQ: sieve: msgid=unspecified: stored mail into mailbox 'IMAP-FOLDER' May 12 06:36:41 Debug: none: root=, index=, control=, inbox=, alt= May 12 06:36:41 Debug: auth input: USERNAME(a)hexonet.net uid=5000 gid=5000 home=/var/mail/USERNAME(a)hexonet.net May 12 06:36:41: Debug: Effective uid=5000, gid=5000, home=/var/mail/USERNAME(a)hexonet.net May 12 06:36:41: Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/mail/USERNAME@hexonet.net:LAYOUT=fs May 12 06:36:41: Debug: fs: root=/var/mail/USERNAME(a)hexonet.net, index=, control=, inbox=/var/mail/USERNAME(a)hexonet.net, alt= May 12 06:36:41: Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. May 12 06:36:41: Debug: QJyQMOZrcFN7awAA9jyUPQ: sieve: using the following location for user's Sieve script: /var/mail/USERNAME(a)hexonet.net/.dovecot.sieve May 12 06:36:41: Debug: QJyQMOZrcFN7awAA9jyUPQ: sieve: opening script /var/mail/USERNAME(a)hexonet.net/.dovecot.sieve May 12 06:36:41: Debug: QJyQMOZrcFN7awAA9jyUPQ: sieve: script binary /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin successfully loaded May 12 06:36:41: Debug: QJyQMOZrcFN7awAA9jyUPQ: sieve: binary save: not saving binary /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin, because it is already stored May 12 06:36:41: Debug: QJyQMOZrcFN7awAA9jyUPQ: sieve: executing script from /var/mail/USERNAME(a)hexonet.net/.dovecot.svbin May 12 06:36:41: Fatal: pool_system_realloc(268435456): Out of memory May 12 06:36:41: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x45951) [0x219951] -> /usr/lib/dovecot/libdovecot.so.0(+0x459bf) [0x2199bf] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x1e8dc5] -> /usr/lib/dovecot/libdovecot.so.0(+0x5806e) [0x22c06e] -> /usr/lib/dovecot/libdovecot.so.0(+0x40ec8) [0x214ec8] -> /usr/lib/dovecot/libdovecot.so.0(buffer_get_space_unsafe+0x85) [0x2153b5] -> /usr/lib/dovecot/libdovecot.so.0(buffer_append_space_unsafe+0x2b) [0x2154cb] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_map+0x219) [0x506cf9] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_open_and_verify+0x75) [0x507245] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_register_get_list+0x50) [0x5092a0] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_header_init+0x15f) [0x4f6def] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_cache_parse_init+0x7c) [0x4f73fc] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_save_add+0x1d7) [0x4a0a87] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_save_begin+0x1d3) [0x4a0dd3] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_begin+0x58) [0x4d7988] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xba) [0x4d163a] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_copy+0x4b) [0x49bacb] - -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x54) [0x4d78b4] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x35f5f) [0xc52f5f] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_result_execute+0x16b) [0xc49efb] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_execute+0x69) [0xc5b139] - -> /usr/lib/dovecot/modules/lib90_sieve_plugin.so(+0x2892) [0x75e892] - -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0x4f) [0x19641f] - -> dovecot/lmtp() [0x804c812] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x42) [0x227822] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd3) [0x2289e3] - -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x2277b0] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x2d) [0x21050d] May 12 06:36:41: Fatal: master: service(lmtp): child 27515 returned error 83 (Out of memory (service lmtp { vsz_limit=256 MB }, you may need to increase it)) - -- Fabian Peter Systemadministrator HEXONET GmbH T: +49 6841 69 84 308 F: +49 6841 69 84 199 E: fpeter(a)hexonet.net W: http://www.hexonet.net HEXONET GmbH, Talstrasse 27, 66424 Homburg, Germany. CEO & General Manager: Jens Wagner, HRB 2839 (HOM), Amtsgericht Saarbrücken, VAT-ID: DE-138316882 HEXONET Services Inc., 104 - 7455 132nd Street, Surrey, B.C., V3W 1J8, Canada. CSO & General Manager: Robert Birkner This email and any files transmitted are confidential and intended only or the person(s) directly addressed. If you are not the intended recipient, any use, copying, transmission, distribution, or other forms of dissemination is strictly prohibited. If you have received this email in error, please notify the sender immediately and permanently delete this email with any files that may be attached. -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.22 (Darwin) Comment: GPGTools - https://gpgtools.org Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBCgAGBQJTcHVYAAoJEPIZChNlZ+or5VQIAKegO6HwORlpEmP3YBkJnHXY sYsR1sP89Vm1Uzv4cVL30KF1P37NI9sZwHrO5H2aC5sqNSadaZ0lOUFncwlZwphh JsSS2Jye+56UW7XR92rUuwC8FPYRk6nOxTA0hHtAGW1IxCROz8P32V24cRlDE32k rcq2GT0V4laFlD5YNcqFWAClTqAholnHZCm/7VpBCevUTx0F+KVZxEth/xOf0ajY EmWoXat4Fihnly1YtdPqN5FqIyFdzBF8tyuWaUZN3BfO8QDso+tci/NRbe2yYkIK lhulr4PAvccsIqJ+u/9j+XN7SL9ZXDtU0w4xWQe+5SrGfFXJlXsuJoRgBdThn9I= =YP4k -----END PGP SIGNATURE-----

2 1

[Dovecot] v2.2.13.rc1 vs. Pigeonhole
by Tamsy 12 May '14

12 May '14

Server: Ubuntu 10.04 LTS 32bit There seems to be an incompatibility when compiling Pigeonhole against Dovecot v2.2.13.rc1. # make check with Pigeonhole throws up the following error message: <snip> Test case: ./tests/extensions/editheader/addheader.svtest: 1: Test 'Addheader - first' SUCCEEDED 2: Test 'Addheader - last' SUCCEEDED 3: Test 'Addheader - framed' SUCCEEDED 4: Test 'Addheader - folded' SUCCEEDED 5: Test 'Addheader - newlines' FAILED: wrong first header content in redirected mail 6: Test 'Addheader - implicit keep' SUCCEEDED 7: Test 'Addheader - UTF 8' SUCCEEDED 8: Test 'Addheader - devious characters' SUCCEEDED FAIL: 1 of 8 tests failed. I tried this with the latest Pigeonhole from Mercurial: - dovecot-2-2-pigeonhole-3b6917a4807c and also with the older: - dovecot-2-2-pigeonhole-e111a2393a92 Both versions are quitting during "make check" with the same error when compiling against dovecot-2.2.13.rc1. Compiling those versions against dovecot-2.2.12 is going without errors though. Cheers, Tamsy

3 4

[Dovecot] message-decoder bug for attachments with charset=binary attribute in content-type?
by Robert Wolf 12 May '14

12 May '14

Hello, I have configure dovecot with solr and I wanted to let solr index content of attachments. For testing I have used biabam command line tool to generate emails with attachments. I have found that dovecot with fts_decoder incorrectly decodes these attachments from biabam and therefore pdftotext has reported corrupted PDF. The problem is that biabam generates header with charset=binary and dovecot message decoder tries to process it as UTF8 or non-UTF8 data. ============================================================ --biabam.ZxWVLybiabam.ZxWVLy Content-Type: application/pdf; charset=binary Content-Disposition: attachment; filename="bacula-jobs.pdf" Content-Transfer-Encoding: base64 JVBERi0xLjQKJcfsj6IKNSAwIG9iago8PC9MZW5ndGggNiAwIFIvRmlsdGVy IC9GbGF0ZURlY29kZT4+CnN0cmVhbQp4nF2PT0+EMBDF7/0U7yYYWdqFXdbe 1vgnMXpQezMeClSoQNltweh+egvLyczhN3kz703mCLpioFMtLDoSv2aoHKGo ..... ============================================================ This PDF begins orginal with ============================================================ 0000000: 2550 4446 2d31 2e34 0a25 c7ec 8fa2 0a35 %PDF-1.4.%.....5 0000010: 2030 206f 626a 0a3c 3c2f 4c65 6e67 7468 0 obj.<</Length 0000020: 2036 2030 2052 2f46 696c 7465 7220 2f46 6 0 R/Filter /F 0000030: 6c61 7465 4465 636f 6465 3e3e 0a73 7472 lateDecode>>.str ============================================================ But the dovecot pass following data to fts_decoder script: ============================================================ 0000000: 2550 4446 2d31 2e34 0a25 c3a4 c3bc c3b6 %PDF-1.4.%...... 0000010: c39f 0a32 2030 206f 626a 0a3c 3c2f 4c65 ...2 0 obj.<</Le 0000020: 6e67 7468 2033 2030 2052 2f46 696c 7465 ngth 3 0 R/Filte 0000030: 722f 466c 6174 6544 6563 6f64 653e 3e0a r/FlateDecode>>. ============================================================ As you can see binary data are mangled. Alpine and Thunderbird do not write charset=binary to content-type header and searching works perfect. I have searched in source code and I have found one place. If I replace the following code in file dovecot-2.1.7/src/lib-mail/message-decoder.c on line 241 with new one, the dovecots message decoder decodes message correctly and pdftotext can convert attached PDF. Original code: ============================================================ 241: ctx->binary_input = ctx->content_charset == NULL && 242: (ctx->flags & MESSAGE_DECODER_FLAG_RETURN_BINARY) != 0 && 243: (part->flags & (MESSAGE_PART_FLAG_TEXT | 244: MESSAGE_PART_FLAG_MESSAGE_RFC822)) == 0; ============================================================ My update: ============================================================ 241 ctx->binary_input = ((ctx->content_charset != NULL) && (strcasecmp(ctx->content_charset, "binary") == 0)) || (ctx->content_charset == NULL && 242 (ctx->flags & MESSAGE_DECODER_FLAG_RETURN_BINARY) != 0 && 243 (part->flags & (MESSAGE_PART_FLAG_TEXT | 244 MESSAGE_PART_FLAG_MESSAGE_RFC822)) == 0); ============================================================ This will set ctx->binary_input for the attachment with charset set to "binary". I don't know if this is correct update, but the searching works with this update for biabam binary attachments too. Could you please verify this problem and maybe update the code? Thank you very much. # dovecot --version 2.1.7 Config: plugin { fts = solr fts_solr = url=http://localhost:8080/solr/ fts_decoder = decode2text } service decode2text { executable = script /etc/dovecot/scripts/decode2text.sh user = dovecot unix_listener decode2text { mode = 0666 } } Regards, Robert Wolf.

1 0

[Dovecot] questions about process_limit
by Andreas Meyer 12 May '14

12 May '14

Hello all! # dovecot --version 2.1.17 Sometimes I have this in the logfile: May 11 16:55:52 master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped May 11 17:35:03 master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped May 11 17:36:27 master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped I then put this in the dovecot.conf service imap-login { service_count = 1 process_min_avail = 50 #process_limit = $default_process_limit process_limit = 10000 vsz_limit = 64M } and get this: May 11 18:19:36 master: Info: Dovecot v2.1.17 starting up (core dumps disabled) May 11 18:19:36 config: Warning: service auth { client_limit=1000 } is lower than required under max. load (10300) May 11 18:19:36 config: Warning: service anvil { client_limit=1000 } is lower than required under max. load (10203) Puting this in: service auth { client_limit = 10300 unix_listener auth-userdb { mode = 0666 user = vmail group = vmail } } service anvil { client_limit = 10300 } I get this: May 11 18:27:37 delta.bitcorner.eu dovecot[3989]: Warning: fd limit (ulimit -n) is lower than required under max. load (1024 < 10300), because of service auth { client_limit } I have also seen this today: May 11 13:14:05 log: Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) May 11 13:14:05 auth: Error: read(anvil-auth-penalty) failed: EOF May 11 13:14:05 auth: Error: net_connect_unix(anvil-auth-penalty) failed: Permission denied What is the best way to avoid this process_limit errors and configure dovecot the best way? Greetings Andreas

3 2