October 2014 - dovecot

Panic: file istream-qp-decoder.c
by Urban Loesch 29 Oct '14

29 Oct '14

Hi, I'm running Dovecot EE Version with Debian Squeeze. Version info: ii dovecot-ee-core 1:2.2.13.31-1 secure mail server that supports mbox, maildir, dbox and mdbox mailboxes ii dovecot-ee-dbg 1:2.2.13.31-1 debug symbols for Dovecot ii dovecot-ee-imapd 1:2.2.13.31-1 secure IMAP server that supports mbox, maildir, dbox and mdbox mailboxes ii dovecot-ee-lmtpd 1:2.2.13.31-1 secure LMTP server for Dovecot ii dovecot-ee-managesieved 0.4.3-7 secure ManageSieve server for Dovecot ii dovecot-ee-mysql 1:2.2.13.31-1 MySQL support for Dovecot ii dovecot-ee-pop3d 1:2.2.13.31-1 secure POP3 server that supports mbox, maildir, dbox and mdbox mailboxes ii dovecot-ee-sieve 0.4.3-7 sieve filters support for Dovecot Yesterday I got the following errors in the error log: Oct 28 18:29:05 mailstore dovecot: imap(user(a)domain.com pid:37052 session:<0K7g+34GIwDD/vzI>): Panic: file istream-qp-decoder.c: line 102 (i_stream_qp_decoder_read): assertion failed: (ret < 0) Oct 28 18:29:05 mailstore dovecot: imap(user(a)domain.com pid:37052 session:<0K7g+34GIwDD/vzI>): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x6d75a) [0x7f9bcee0275a] -> /usr/lib/dovecot/libdovecot.so.0(+0x6d7d6) [0x7f9bcee027d6] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f9bcedba5bf] -> /usr/lib/dovecot/libdovecot.so.0(+0x5a86c) [0x7f9bcedef86c] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x63) [0x7f9bcee0b533] -> /usr/lib/dovecot/libdovecot.so.0(+0x7bc5c) [0x7f9bcee10c5c] -> /usr/lib/dovecot/libdovecot.so.0(+0x7c0c8) [0x7f9bcee110c8] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x63) [0x7f9bcee0b533] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x52) [0x7f9bcee0b8a2] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa44ea) [0x7f9bcf10c4ea] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_binary_stream+0x135) [0x7f9bcf10c9b5] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_binary_stream+0x61) [0x7f9bcf0e34f1] -> /usr/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0xb0) [0x7f9bcf142f20] -> dovecot/imap() [0x41ba26] -> dovecot/imap() [0x419b4a] -> dovecot/imap(imap_fetch_more+0x31) [0x419d81] -> dovecot/imap(cmd_fetch+0x49d) [0x40e88d] -> dovecot/imap(command_exec+0x3d) [0x41813d] -> dovecot/imap() [0x417230] -> dovecot/imap() [0x41731d] -> dovecot/imap(client_handle_input+0x11d) [0x41759d] -> dovecot/imap(client_input+0x6f) [0x41792f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4e) [0x7f9bcee12f1e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xaf) [0x7f9bcee1409f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f9bcee12fa9] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f9bcee13038] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f9bcedbf3e3] -> dovecot/imap(main+0x2a7) [0x420e97] Oct 28 18:29:05 mailstore dovecot: imap(user(a)domain.com pid:37052 session:<0K7g+34GIwDD/vzI>): Fatal: master: service(imap): child 37052 killed with signal 6 (core dumps disabled) Oct 28 18:29:58 mailstore dovecot: imap(user(a)domain.com pid:38868 session:<eAIJ/34GpADD/vzI>): Panic: file istream-qp-decoder.c: line 102 (i_stream_qp_decoder_read): assertion failed: (ret < 0) Oct 28 18:29:58 mailstore dovecot: imap(user(a)domain.com pid:38868 session:<eAIJ/34GpADD/vzI>): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x6d75a) [0x7f8f7cb9275a] -> /usr/lib/dovecot/libdovecot.so.0(+0x6d7d6) [0x7f8f7cb927d6] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f8f7cb4a5bf] -> /usr/lib/dovecot/libdovecot.so.0(+0x5a86c) [0x7f8f7cb7f86c] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x63) [0x7f8f7cb9b533] -> /usr/lib/dovecot/libdovecot.so.0(+0x7bc5c) [0x7f8f7cba0c5c] -> /usr/lib/dovecot/libdovecot.so.0(+0x7c0c8) [0x7f8f7cba10c8] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x63) [0x7f8f7cb9b533] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x52) [0x7f8f7cb9b8a2] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa44ea) [0x7f8f7ce9c4ea] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_binary_stream+0x135) [0x7f8f7ce9c9b5] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_binary_stream+0x61) [0x7f8f7ce734f1] -> /usr/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0xb0) [0x7f8f7ced2f20] -> dovecot/imap() [0x41ba26] -> dovecot/imap() [0x419b4a] -> dovecot/imap(imap_fetch_more+0x31) [0x419d81] -> dovecot/imap(cmd_fetch+0x49d) [0x40e88d] -> dovecot/imap(command_exec+0x3d) [0x41813d] -> dovecot/imap() [0x417230] -> dovecot/imap() [0x41731d] -> dovecot/imap(client_handle_input+0x11d) [0x41759d] -> dovecot/imap(client_input+0x6f) [0x41792f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4e) [0x7f8f7cba2f1e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xaf) [0x7f8f7cba409f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f8f7cba2fa9] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f8f7cba3038] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f8f7cb4f3e3] -> dovecot/imap(main+0x2a7) [0x420e97] Oct 28 18:29:58 mailstore dovecot: imap(user(a)domain.com pid:38868 session:<eAIJ/34GpADD/vzI>): Fatal: master: service(imap): child 38868 killed with signal 6 (core dumps disabled) The user uses Horde Webmail 5.2 to access his mailbox and there are about 1300 active session running curently on that server. Many thanks Urban Loesch

1 0

maildir++ quota support on dovecot
by Mirko ML 28 Oct '14

28 Oct '14

Some information about maildir++ that I have read: http://www.inter7.com/courierimap/README.maildirquota.html http://wiki2.dovecot.org/Quota/Maildir When I have to deliver a message with an MDA I can use dovecot-lda. If I have enabled "quota = maildir:User quota" I am pretty sure that in the mailbox on file system I find a file named "maildirsize" maildirsize on top contain something like this "xxxxxxxxxxS" that specifies the SIZE quota in bytes. LDA could delivery the message only when the SIZE written in mailbox is less than the SIZE defined by mail admin. "Each member of the list consists of an integer followed by a letter, specifying the nature of the quota. Currently defined quota types are 'S' - total size of all messages, and 'C' - the maximum count of messages in the maildir. For example, 10000000S,1000C specifies a quota of 10,000,000 bytes or 1,000 messages, whichever comes first." For this reason the value in bytes defined for the user must have S at the end. At the moment quota-maildir.c contains a control for S or C so I can find this in log: Quota rule: root=User quota mailbox=* bytes=20971520 messages=0 But quota-util.c do not contains a control for C and S, so probably the support of maildir++ format is not complete. Please let me know if I am wrong. -- Ciao Mirko

1 0

Namespaces (or another way) to put messages in a different drive
by Paulino Michelazzo 28 Oct '14

28 Oct '14

Hello people, I have a situation where I need to create a mailbox for clients where they put old messages (> 1year) but I would like to create this mailbox in a different disk. I have a server with the mailboxes and a storage mapped using NFS just to create those mailboxes for old messages. I was trying to namespaces but every time that I make the configurations, the authentication system stop and the clients can’t log in. I really don’t know if this is the best approach for my situation (mailbox with old emails in a storage) and, if namespaces can solve it. The infos that I have are: Dovecot version 2.1.7 mailboxes: Namespace configs: namespace { type = private separator = / prefix = #location defaults to mail_location. inbox = yes } namespace { type = private separator / prefix = storage/ location = /mnt/exibstor/%u inbox = no hidden = no list = yes } If someone knows how can I do that, I really appreciate it. Best regards, Paulino Michelazzo

1 0

dovecot ldap quota
by Mirko ML 28 Oct '14

28 Oct '14

First of all: doveconf -n # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.7 ext4 auth_mechanisms = plain login disable_plaintext_auth = no mail_debug = yes mail_gid = vmail mail_location = maildir:/home/vmail/domains/%d/%n mail_plugins = " quota" mail_temp_dir = /var/tmp mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave spamtest spamtestplus namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename quota = maildir:User quota sieve = ~/.dovecot.sieve sieve_default = /var/lib/dovecot/sieve/default.sieve sieve_dir = ~/sieve sieve_extensions = +spamtest +spamtestplus +relational +comparator-i;ascii-numeric sieve_global_dir = /var/lib/dovecot/sieve/global/ } protocols = " imap sieve pop3" service auth { unix_listener auth-userdb { user = vmail } } service imap-login { inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } service pop3-login { inet_listener pop3 { address = * port = 110 } inet_listener pop3s { address = * port = 995 ssl = yes } } ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh grep -v '^ *$#.*$\?$' dovecot-ldap.conf.ext uris = ldap://localhost dn = cn=phamm,o=hosting,dc=example,dc=com dnpass = ops auth_bind = yes ldap_version = 3 base = o=hosting,dc=example,dc=com deref = never user_attrs = quota=quota_rule=*:bytes=%$ user_filter = (&(objectClass=VirtualMailAccount)(accountActive=TRUE)(mail=%u)) pass_attrs = mail=user,userPassword=password pass_filter = (&(objectClass=VirtualMailAccount)(accountActive=TRUE)(mail=%u)) And at the end the problem that i see on log: Oct 27 20:42:36 mail dovecot: imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules Oct 27 20:42:36 mail dovecot: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Oct 27 20:42:36 mail dovecot: imap: Debug: Added userdb setting: plugin/quota_rule=*:bytes=20971520S Oct 27 20:42:36 mail dovecot: imap(ops(a)klez.it): Debug: Effective uid=1001, gid=1001, home= Oct 27 20:42:36 mail dovecot: imap(ops(a)klez.it): Debug: Quota root: name=User quota backend=maildir args= Oct 27 20:42:36 mail dovecot: imap(ops(a)klez.it): Debug: Quota rule: root=User quota mailbox=* bytes=20971520 messages=0 Oct 27 20:42:36 mail dovecot: imap(ops(a)klez.it): Error: user ops(a)klez.it: Initialization failed: Failed to initialize quota: Invalid quota root quota: Invalid rule *:bytes=20971520S: Invalid rule limit value 'bytes=20971520S': Unknown unit: S Oct 27 20:42:36 mail dovecot: imap(ops(a)klez.it): Error: Invalid user settings. Refer to server log for more information. I cant understand this 2 line: Oct 27 20:42:36 mail dovecot: imap(ops(a)klez.it): Debug: Quota rule: root=User quota mailbox=* bytes=20971520 messages=0 Oct 27 20:42:36 mail dovecot: imap(ops(a)klez.it): Error: user ops(a)klez.it: Initialization failed: Failed to initialize quota: Invalid quota root quota: Invalid rule *:bytes=20971520S: Invalid rule limit value 'bytes=20971520S': Unknown unit: S This is a situation that I want to migrate from courier to dovecot.. I see this post http://y6.gl/nnheTd that seems to have my problem. Could you help me to prepare a working conf? So I can write a simple doc for this? TIA -- Ciao Mirko

3 3

how to migration exchange'mail to dovecot?
by 576709166 28 Oct '14

28 Oct '14

hi : i want to migration all users's mails of exchange server to our dovecot:but i don't know how to do this ? i know that exchange server can put users's mails to file.pst , but i don't know hwo to convent file.pst to file.eml . please help thanks !

2 1

Error renaming folders with spaces
by mtrainer＠cloud-free.com 28 Oct '14

28 Oct '14

Hi All, I am getting frequent errors of the form below. In most cases the path has spaces in it. Oct 24 07:27:08 mailstore03 dovecot: imap(sam(a)userdomain.com.au): Error: rename(/home8/rs7-username/mail/xyzmortgages.com.au/sam/.Valuations - ABC, /home8/rs7-username/mail/xyzmortgages.com.au/sam/.Valuations - ABC/Subfolder) failed: Invalid argument The user home directories are on NFSv3 and are the user attributes are stored in ldap. My config is below. Any ideas what is causing these errors? Thanks Murray # doveconf -n # 2.2.9: /etc/dovecot/dovecot.conf doveconf: Warning: service auth { client_limit=40960 } is lower than required under max. load (41280) doveconf: Warning: service anvil { client_limit=40970 } is lower than required under max. load (41183) # OS: Linux 3.14-0.bpo.2-amd64 x86_64 Debian 7.5 auth_cache_size = 64 M auth_cache_ttl = 2 hours auth_failure_delay = 0 auth_mechanisms = plain login auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!#$-=?^_{}~./@+%" auth_username_translation = +@ auth_worker_max_count = 256 base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_gid = 1001 first_valid_uid = 1001 mail_fsync = always mail_location = maildir:~/ maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile quota = maildir quota_rule = INBOX.Trash:ignore } protocols = " imap lmtp sieve pop3" service anvil { client_limit = 40970 } service auth-worker { user = dovecot } service auth { client_limit = 40960 unix_listener auth-userdb { group = mail mode = 0666 user = dovecot } } service imap-login { chroot = login inet_listener imap { address = *, [::] port = 143 } inet_listener imaps { address = * port = 993 ssl = yes } process_limit = 20480 process_min_avail = 32 service_count = 0 user = dovecot vsz_limit = 256 M } service imap { process_limit = 40960 vsz_limit = 512 M } service lmtp { inet_listener lmtp { address = 27.54.95.43 port = 24 } process_min_avail = 32 } service managesieve-login { client_limit = 40960 process_limit = 120 process_min_avail = 5 service_count = 0 vsz_limit = 64 M } service managesieve { process_limit = 4096 vsz_limit = 256 M } service pop3-login { chroot = login inet_listener pop3 { address = *, [::] port = 110 } inet_listener pop3s { address = * port = 995 ssl = yes } process_limit = 20480 process_min_avail = 32 service_count = 0 user = dovecot vsz_limit = 256 M } service pop3 { process_limit = 40960 vsz_limit = 256 M } ssl_cert =

2 4

doveadm throws Panic: file dsync-mailbox-tree-fill.c: line 65
by Cassidy Larson 28 Oct '14

28 Oct '14

Running 2.2.15 on FreeBSD 10.0. Forcing replication with: doveadm replicator replicate -f user(a)host.com on one user that I've seen some syslogs show up to see what's going on. Other users are fine. When I run the above command on the one user it produces a core dump. See below for syslog output and full backtrace: syslog output: Oct 26 22:44:09 d3cstorage dovecot: dsync-server(user(a)host.com): Panic: file dsync-mailbox-tree-fill.c: line 65 (dsync_mailbox_tree_get_selectable): assertion failed: (status_r->uidvalidity != 0) Oct 26 22:44:09 d3cstorage dovecot: dsync-server(user(a)host.com): Fatal: master: service(doveadm): child 67571 killed with signal 6 (core dumped) Oct 26 22:44:09 d3cstorage kernel: pid 67571 (doveadm-server), uid 127: exited on signal 6 (core dumped) bt full: #0 0x0000000040f73e1a in kill () from /lib/libc.so.7 #1 0x0000000040f72ac9 in abort () from /lib/libc.so.7 #2 0x0000000040bd6fa4 in default_fatal_handler () from /usr/local/lib/dovecot/libdovecot.so.0 #3 0x0000000040bd7ca1 in i_set_failure_internal () from /usr/local/lib/dovecot/libdovecot.so.0 #4 0x0000000040bd7249 in i_panic () from /usr/local/lib/dovecot/libdovecot.so.0 #5 0x0000000000428014 in dsync_mailbox_tree_fill () #6 0x000000000041e0e6 in dsync_brain_mailbox_trees_init () #7 0x000000000041bb27 in dsync_brain_run () #8 0x000000000041b41f in dsync_brain_master_init () #9 0x000000000042ac54 in dsync_ibc_init_stream () #10 0x0000000040be9443 in io_loop_call_io () from /usr/local/lib/dovecot/libdovecot.so.0 #11 0x0000000040beaafd in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 #12 0x0000000040be9688 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 #13 0x000000000040ec49 in doveadm_dsync_main () #14 0x0000000000410fe9 in doveadm_mail_single_user () #15 0x000000000041a89c in client_connection_create () #16 0x0000000040be9443 in io_loop_call_io () from /usr/local/lib/dovecot/libdovecot.so.0 #17 0x0000000040beaafd in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 #18 0x0000000040be9688 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 #19 0x0000000040b90a58 in master_service_run () from /usr/local/lib/dovecot/libdovecot.so.0 #20 0x000000000041ae15 in main () Config snippets: service doveadm { drop_priv_before_exec = yes inet_listener { port = 12345 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = mailsys mode = 0666 user = mailsys } unix_listener replicator { group = mailsys mode = 0666 user = mailsys } } Anything else I can provide? Thanks! Cassidy

2 4

dsync-server throwing Resource temporarily available
by Cassidy Larson 28 Oct '14

28 Oct '14

Running 2.2.15 on FreeBSD 10.0 with two back end storage boxes using TCP to sync. Seeing a couple of users that always seem to be throwing these kind of errors in the logs: dovecot: dsync-server(user(a)host.com): Error: write(/var/run/dovecot/replicator-doveadm) failed: Resource temporarily unavailable Just wondering what's the proper course of action to fix it? Thanks.

2 1

An easy fix for "dovecot.map.index corrupted: map_uid=xxxx refcount too low"?
by Ralf Hildebrandt 28 Oct '14

28 Oct '14

Is there an easy way of "fixing" these? Oct 26 13:24:52 imap(account@domain): Error: mdbox map /var/mail/domain/account/mdbox/storage/dovecot.map.index corrupted: map_uid=2700 refcount too low (dovecot 2.1.17) -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

2 1

Sieve: carry global variables from sieve_before to user sieve scripts
by Alexander 'Leo' Bergolth 26 Oct '14

26 Oct '14

Hi! Is there a way to initialize global variables with default values in sieve_before scripts that can be used in the sieve_default script or in user scripts? I've tried the following code but this doesn't work.. before.d/10-set-defaults.sieve: -------------------- 8< -------------------- require ["variables", "include"]; require "vnd.dovecot.debug"; set "global.S_TESTVAR leo"; debug_log "LEO SIEVE: in before.d/10-set-defaults, S_TESTVAR: ${global.S_TESTVAR}"; -------------------- 8< -------------------- default.sieve: -------------------- 8< -------------------- require ["variables", "include"]; require "vnd.dovecot.debug"; global "S_TESTVAR"; debug_log "LEO SIEVE: in default.sieve: S_TESTVAR: ${global.S_TESTVAR}, ${S_TESTVAR}"; -------------------- 8< -------------------- Is there any other way to set up defaults in a global sieve script? Cheers, --leo -- e-mail ::: Leo.Bergolth (at) wu.ac.at fax ::: +43-1-31336-906050 location ::: IT-Services | Vienna University of Economics | Austria

2 2