- dovecot - dovecot.org

[Dovecot] Does quota-status respect quota_grace?
by Jiri Bourek 20 Dec '13

20 Dec '13

Hello, I have Dovecot 2.2.9 from Debian repository running on AMD64, ext4 filesystem for mail storage. Each mailbox has its own system user, quotas are enforced by file system. Quota settings in configuration are as follows (from doveconf -n): quota = fs:Domain quota:group:inode_per_mail quota2 = fs:Mailbox quota:user:inode_per_mail quota2_grace = 18%% quota_grace = 18%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO Quota rules are read from PostgreSQL (snippet) user_query = ... '*:bytes=' || domains.quota_size || 'M:messages=' || domains.quota_files as quota_rule, \ '*:bytes=' || mailboxes.quota_size || 'M:messages=' || mailboxes.quota_files as quota2_rule, \ ... As far as I can tell, quota enforcing in dovecot-lda works correctly. User is allowed one message which brings him over quota (provided the message fits into filesystem quota hard limit and quota_grace value), every other message after that is rejected. However policy service quota-status for Postfix seems to ignore the quota_grace value. When a message arrives which would make user go over quota (but which would not make him exceed the grace limit value), Postfix checks the policy service and is told to reject the message. I checked and dovecot itself is fine with the message - if I try to send it with the policy service check disabled, Postfix accepts it and so does dovecot-lda, the message is delivered into mailbox. My question is - is that intended behavior or bug in the quota-status? Appending some lines from debug log - as far as I can see there's not much in it though: dovecot: quota-status: Debug: Added userdb setting: mail=maildir:/home/mailboxes/t/e/test.info/test/:LAYOUT=fs:INDEX=/var/lib/dovecot-data/index/1010:CONTROL=/var/lib/dovecot-data/control/1010 dovecot: quota-status: Debug: Added userdb setting: plugin/quota2_rule=*:bytes=11M:messages=110 dovecot: quota-status: Debug: Added userdb setting: plugin/quota_rule=*:bytes=15M:messages=150 dovecot: quota-status(test(a)test.info): Debug: Effective uid=1010, gid=1007, home=/home/mailboxes/t/e/test.info/test/ dovecot: quota-status(test(a)test.info): Debug: Quota root: name=Domain quota backend=fs args=group:inode_per_mail dovecot: quota-status(test(a)test.info): Debug: Quota rule: root=Domain quota mailbox=* bytes=15728640 messages=150 dovecot: quota-status(test(a)test.info): Debug: Quota grace: root=Domain quota bytes=2831155 (18%) dovecot: quota-status(test(a)test.info): Debug: Quota root: name=Mailbox quota backend=fs args=user:inode_per_mail dovecot: quota-status(test(a)test.info): Debug: Quota rule: root=Mailbox quota mailbox=* bytes=11534336 messages=110 dovecot: quota-status(test(a)test.info): Debug: Quota grace: root=Mailbox quota bytes=2076180 (18%) dovecot: quota-status(test(a)test.info): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/mailboxes/t/e/test.info/test/:LAYOUT=fs:INDEX=/var/lib/dovecot-data/index/1010:CONTROL=/var/lib/dovecot-data/control/1010 dovecot: quota-status(test(a)test.info): Debug: fs: root=/home/mailboxes/t/e/test.info/test, index=/var/lib/dovecot-data/index/1010, indexpvt=, control=/var/lib/dovecot-data/control/1010, inbox=/home/mailboxes/t/e/test.info/test, alt= dovecot: quota-status(test(a)test.info): Debug: fs quota add mailbox dir = /home/mailboxes/t/e/test.info/test dovecot: quota-status(test(a)test.info): Debug: fs quota block device = /dev/sdc1 dovecot: quota-status(test(a)test.info): Debug: fs quota mount point = /home dovecot: quota-status(test(a)test.info): Debug: fs quota mount type = ext4

3 5

[Dovecot] mirror to download dovecot
by Edwardo Garcia 20 Dec '13

20 Dec '13

Halo, Is mirror to get 2.2.9? cannot get dovecot.org, this time out 4 xe-0-1-0-1-3664.r00.saplbr01.br.bb.gin.ntt.net (200.15.0.45) 6.946 ms 7.093 ms 6.899 ms 5 xe-4-1-3.r20.miamfl02.us.bb.gin.ntt.net (129.250.3.217) 118.130 ms 118.111 ms 118.117 ms 6 ae-1.r05.miamfl02.us.bb.gin.ntt.net (129.250.2.185) 118.592 ms 118.735 ms 118.628 ms 7 * * * 8 * * * 9 * * * I use to get from dovecot.ausics.org but fail connect too, seem has DNS 127.0.0.1 ????? is any others run mirror?

3 3

[Dovecot] reproducible dsync backup panic (dovecot 2.2.7)
by Peter Benko 20 Dec '13

20 Dec '13

Hi all, I'm receiving a reproducible dsync backup panic for some of my users. The error message is as follows: dsync-remote(user@<removed>): Panic: file dsync-brain-mailbox-tree-sync.c: line 111 (dsync_brain_mailbox_tree_sync_change): assertion failed: (brain->no_backup_overwrite) dsync-remote(user@<removed>): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x69b70) [0x7f922dad9b70] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f922dad9c4a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f922da94725] -> /usr/bin/dsync(dsync_brain_mailbox_tree_sync_change+0x382) [0x42f912] -> /usr/bin/dsync(dsync_brain_recv_mailbox_tree_deletes+0x10b) [0x42f4db] -> /usr/bin/dsync(dsync_brain_run+0x305) [0x42c6f5] -> /usr/bin/dsync() [0x42cbe8] -> /usr/bin/dsync() [0x43e040] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f922daea066] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7f922daeaf07] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f922dae9b78] -> /usr/bin/dsync() [0x4297f9] -> /usr/bin/dsync() [0x4133cd] -> /usr/bin/dsync(doveadm_mail_try_run+0x251) [0x414091] -> /usr/bin/dsync(main+0x3c8) [0x412f78] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f922d704ead] -> /usr/bin/dsync() [0x413191] dsync-local(user@<removed>): Error: read(<remote-mail-server>) failed: EOF dsync-local(user@<removed>): Error: Remote command returned error 134 The command I'm using to back up individual user's mail is something like: sudo -u vmail dsync -v -u user(a)server.com -R backup ssh -i sshid-file login(a)server.com sudo -u vmail dsync -v -u user(a)server.com I use the above command at the backup server. The error started to appear a few weeks after we started using the new mail system. First it appeared for a single user, now it appears for some more users as well. It is deterministic and reproducible. Any ideas? I included the relevant part of my config below. Best regards, Peter ------------------------------------------------------------------- # 2.2.7 (5c876ed0c3e0): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_master_user_separator = * auth_mechanisms = plain login hostname = <removed> listen = * login_greeting = $hostname IMAP server mail_attachment_dir = /mail/mailboxes/%d/_attachments_ mail_attachment_fs = sis-queue $mail_attachment_dir/queue:posix mail_attachment_min_size = 16 k mail_location = mdbox:~ mail_plugins = " zlib acl" mdbox_rotate_interval = 5 days mdbox_rotate_size = 5 M namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = mdbox:/mail/mailboxes/%%d/%%n:INDEX=/mail/mailboxes/%%d/%%n prefix = Accounts/%%n/ separator = / subscriptions = no type = shared } passdb { args = /mail/config/dovecot/passwd driver = passwd-file } passdb { args = /mail/config/dovecot/passwd-master driver = passwd-file master = yes pass = yes } plugin { acl = vfile acl_defaults_from_inbox = yes acl_shared_dict = file:/mail/mailboxes/%d/shared-mailboxes.db zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster@<removed> protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } syslog_facility = local6 userdb { args = uid=vmail gid=vmail master_user=%u home=/mail/mailboxes/%d/%n driver = static } protocol imap { mail_plugins = " zlib acl imap_acl" }

2 1

[Dovecot] auth failures
by Andreas Schulze 19 Dec '13

19 Dec '13

Hello, last week and today our dovecot pop3 server stopped responding. Without any other logentries dovecot start to log only this: Dec 12 09:14:12 mbox1 dovecot: auth: Error: ldap(testuser,192.0.2.110,<FBZH7lHtAQAK/FCj>): ldap_search(base=ou=accounts,dc=example,dc=de filter=(&(|(uid=testuser)(mail=testuser))(!(state=blocked)))) failed: Operations error For every pop3 Session, ~2000 per Minute ..., over 10 Minutes I send dovecot a SIGTERM. After dovecot was started again, all was fine again. # doveconf -n http://postmaster.datev.de/tmp/dovecot.conf The LDAP-Server itself did resond to queries in the same timeframe. I know this because the MTA on the same host was able to deliver messages into mailboxes. Any hints? Thanks Andreas -- Andreas Schulze Internetdienste | P252 DATEV eG 90329 Nürnberg | Telefon +49 911 319-0 | Telefax +49 911 319-3196 E-Mail info @datev.de | Internet www.datev.de Sitz: 90429 Nürnberg, Paumgartnerstr. 6-14 | Registergericht Nürnberg, GenReg Nr.70 Vorstand Prof. Dieter Kempf (Vorsitzender) Dipl.-Kfm. Wolfgang Stegmann (stellvertretender Vorsitzender) Dipl.-Kfm. Michael Leistenschneider Dipl.-Kfm. Dr. Robert Mayr Jörg Rabe v. Pappenheim Dipl.-Vw. Eckhard Schwarzer Vorsitzender des Aufsichtsrates: Reinhard Verholen

2 1

[Dovecot] External auth
by eechim enorniel 19 Dec '13

19 Dec '13

Hello, I saw a lot of tutorials about setting postfix with dovecot sasl but I would like more. I want to set a SSO system with roundcube on dovecot. I would like to know how to make dovecot work with sasl or saml, not as a provider but as a service plugging on an external provider. I saw there is an EXTERNAL auth mechanism but I didn't find any doc about it. Can you help me ? Thanks.

2 1

[Dovecot] Mailbox with .broken files
by Michael Smith (DF) 19 Dec '13

19 Dec '13

We're using Dovecot 2.2.4 and mdbox storage with compression. I noticed yesterday that at least one of the accounts has unusual files in it's mail/storage directory. This account has approximately 17.5G of compressed mail, across about 750 storage files (m.###) using 8G of storage. Starting on Dec 11, storage files m.409 through m.731 have not only their m.### file, but also a m.###.broken file. At the same time .temp.<unix time>.<unique id>.<hostname> files also started showing up... ... -rw--w---- 1 user123 mail 3225 Dec 12 04:38 m.708 -rw--w---- 1 user123 mail 167106 Dec 12 03:35 m.708.broken -rw--w---- 1 user123 mail 46155 Dec 12 04:38 m.709 -rw--w---- 1 user123 mail 177267 Dec 12 03:40 m.709.broken -rw--w---- 1 user123 mail 20965889 Nov 26 19:22 m.71 -rw--w---- 1 user123 mail 133248 Dec 12 04:38 m.710 -rw--w---- 1 user123 mail 264361 Dec 12 03:40 m.710.broken -rw--w---- 1 user123 mail 103407 Dec 12 04:38 m.711 -rw--w---- 1 user123 mail 627736 Dec 12 03:40 m.711.broken -rw--w---- 1 user123 mail 5132 Dec 12 04:38 m.712 -rw--w---- 1 user123 mail 136244 Dec 12 03:40 m.712.broken -rw--w---- 1 user123 mail 187224 Dec 12 04:38 m.713 -rw--w---- 1 user123 mail 351104 Dec 12 03:45 m.713.broken -rw--w---- 1 user123 mail 435793 Dec 12 04:38 m.714 -rw--w---- 1 user123 mail 566906 Dec 12 03:45 m.714.broken -rw--w---- 1 user123 mail 60916 Dec 12 04:38 m.715 -rw--w---- 1 user123 mail 192028 Dec 12 03:50 m.715.broken -rw--w---- 1 user123 mail 38051 Dec 12 04:38 m.716 -rw--w---- 1 user123 mail 169163 Dec 12 03:50 m.716.broken -rw--w---- 1 user123 mail 226067 Dec 12 04:38 m.717 -rw--w---- 1 user123 mail 389948 Dec 12 04:00 m.717.broken ... -rw--w---- 1 user123 mail 20967506 Dec 2 17:32 m.96 -rw--w---- 1 user123 mail 20967131 Dec 2 18:40 m.97 -rw--w---- 1 user123 mail 20969078 Dec 2 18:38 m.98 -rw--w---- 1 user123 mail 20963978 Dec 2 19:23 m.99 -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813944.P9142Q0M123686.myhost -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813967.P9213Q0M387733.myhost -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813970.P9231Q0M371190.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813972.P9173Q0M932070.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813972.P9239Q0M114754.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813983.P9261Q0M640646.myhost -rw--w---- 1 user123 mail 1048632 Dec 11 20:06 .temp.1386814038.P9515Q0M530600.myhost I'm not really seeing anything that stands out in the maillog during this time. What caused this problem? How concerned should I be about possible lost email? This is a production environment. Below is the dovecot -n output. -- Michael Smith # dovecot -n # 2.2.4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.19.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) auth_debug = yes auth_debug_passwords = yes auth_default_realm = mydomain.com auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no dotlock_use_excl = no lda_mailbox_autocreate = yes lock_method = dotlock mail_access_groups = mail mail_debug = yes mail_fsync = always mail_location = mdbox:~/mail:INDEX=~/index mail_plugins = quota zlib mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_read_locks = dotlock mbox_write_locks = dotlock mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 20 M mmap_disable = yes namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = type = private } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Drafts autosubscribe4 = Sent autosubscribe5 = INBOX mail_max_userip_connections = 10 managesieve_max_line_length = 65536 quota = dict:User quota::file:%h/dovecot.quota quota2_rule = Trash:storage=+10%% quota3_rule = Junk:storage=+20%% quota_rule = *:storage=100M:messages=100000 recipient_delimiter = + sieve_before = /var/opt/mail/global.sieve/ zlib_save = gz zlib_save_level = 9 } pop3_reuse_xuidl = yes protocols = imap pop3 sieve lmtp service auth { inet_listener auth { port = 113 } unix_listener auth-userdb { user = nobody } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 service_count = 1 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } ssl = no ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = quota zlib sieve } protocol imap { mail_plugins = quota zlib imap_quota } protocol sieve { mail_max_userip_connections = 10 mail_plugins = quota zlib managesieve_max_line_length = 65536 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date } protocol lmtp { mail_plugins = quota zlib sieve }

2 1

Re: [Dovecot] Mailbox with .broken files
by Michael Smith (DF) 19 Dec '13

19 Dec '13

Anyone have any feedback, guidance or suggestions on this? Timo? -----Original Message----- From: Michael Smith (DF) [mailto:msmith@datafoundry.com] Sent: Friday, December 13, 2013 9:49 AM To: 'dovecot(a)dovecot.org' Subject: [Dovecot] Mailbox with .broken files We're using Dovecot 2.2.4 and mdbox storage with compression. I noticed yesterday that at least one of the accounts has unusual files in it's mail/storage directory. This account has approximately 17.5G of compressed mail, across about 750 storage files (m.###) using 8G of storage. Starting on Dec 11, storage files m.409 through m.731 have not only their m.### file, but also a m.###.broken file. At the same time .temp.<unix time>.<unique id>.<hostname> files also started showing up... ... -rw--w---- 1 user123 mail 3225 Dec 12 04:38 m.708 -rw--w---- 1 user123 mail 167106 Dec 12 03:35 m.708.broken -rw--w---- 1 user123 mail 46155 Dec 12 04:38 m.709 -rw--w---- 1 user123 mail 177267 Dec 12 03:40 m.709.broken -rw--w---- 1 user123 mail 20965889 Nov 26 19:22 m.71 -rw--w---- 1 user123 mail 133248 Dec 12 04:38 m.710 -rw--w---- 1 user123 mail 264361 Dec 12 03:40 m.710.broken -rw--w---- 1 user123 mail 103407 Dec 12 04:38 m.711 -rw--w---- 1 user123 mail 627736 Dec 12 03:40 m.711.broken -rw--w---- 1 user123 mail 5132 Dec 12 04:38 m.712 -rw--w---- 1 user123 mail 136244 Dec 12 03:40 m.712.broken -rw--w---- 1 user123 mail 187224 Dec 12 04:38 m.713 -rw--w---- 1 user123 mail 351104 Dec 12 03:45 m.713.broken -rw--w---- 1 user123 mail 435793 Dec 12 04:38 m.714 -rw--w---- 1 user123 mail 566906 Dec 12 03:45 m.714.broken -rw--w---- 1 user123 mail 60916 Dec 12 04:38 m.715 -rw--w---- 1 user123 mail 192028 Dec 12 03:50 m.715.broken -rw--w---- 1 user123 mail 38051 Dec 12 04:38 m.716 -rw--w---- 1 user123 mail 169163 Dec 12 03:50 m.716.broken -rw--w---- 1 user123 mail 226067 Dec 12 04:38 m.717 -rw--w---- 1 user123 mail 389948 Dec 12 04:00 m.717.broken ... -rw--w---- 1 user123 mail 20967506 Dec 2 17:32 m.96 -rw--w---- 1 user123 mail 20967131 Dec 2 18:40 m.97 -rw--w---- 1 user123 mail 20969078 Dec 2 18:38 m.98 -rw--w---- 1 user123 mail 20963978 Dec 2 19:23 m.99 -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813944.P9142Q0M123686.myhost -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813967.P9213Q0M387733.myhost -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813970.P9231Q0M371190.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813972.P9173Q0M932070.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813972.P9239Q0M114754.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813983.P9261Q0M640646.myhost -rw--w---- 1 user123 mail 1048632 Dec 11 20:06 .temp.1386814038.P9515Q0M530600.myhost I'm not really seeing anything that stands out in the maillog during this time. What caused this problem? How concerned should I be about possible lost email? This is a production environment. Below is the dovecot -n output. -- Michael Smith # dovecot -n # 2.2.4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.19.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) auth_debug = yes auth_debug_passwords = yes auth_default_realm = mydomain.com auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no dotlock_use_excl = no lda_mailbox_autocreate = yes lock_method = dotlock mail_access_groups = mail mail_debug = yes mail_fsync = always mail_location = mdbox:~/mail:INDEX=~/index mail_plugins = quota zlib mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_read_locks = dotlock mbox_write_locks = dotlock mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 20 M mmap_disable = yes namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = type = private } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Drafts autosubscribe4 = Sent autosubscribe5 = INBOX mail_max_userip_connections = 10 managesieve_max_line_length = 65536 quota = dict:User quota::file:%h/dovecot.quota quota2_rule = Trash:storage=+10%% quota3_rule = Junk:storage=+20%% quota_rule = *:storage=100M:messages=100000 recipient_delimiter = + sieve_before = /var/opt/mail/global.sieve/ zlib_save = gz zlib_save_level = 9 } pop3_reuse_xuidl = yes protocols = imap pop3 sieve lmtp service auth { inet_listener auth { port = 113 } unix_listener auth-userdb { user = nobody } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 service_count = 1 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } ssl = no ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = quota zlib sieve } protocol imap { mail_plugins = quota zlib imap_quota } protocol sieve { mail_max_userip_connections = 10 mail_plugins = quota zlib managesieve_max_line_length = 65536 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date } protocol lmtp { mail_plugins = quota zlib sieve }

1 0

[Dovecot] v2.2.9 released
by Timo Sirainen 19 Dec '13

19 Dec '13

http://dovecot.org/releases/2.2/dovecot-2.2.9.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.9.tar.gz.sig + Full text search indexing can now be done automatically after saving/copying mails by setting plugin { fts_autoindex=yes } + replicator: Added replication_dsync_parameters setting to pass "doveadm sync" parameters (for controlling what to replicate). + Added mail-filter plugin + Added liblzma/xz support (zlib_save=xz) - v2.2.8's improved cache file handling exposed several old bugs related to fetching mail headers. - v2.2.7's iostream handling changes were causing some connections to be disconnected before flushing their output (e.g. POP3 logout message wasn't being sent)

7 9

[Dovecot] zlib plugin question
by Przemysław Orzechowski 19 Dec '13

19 Dec '13

Hi Is it possible to compress incoming mails delivered via dovecots LDA when using dovecot --version 1.2.9 or do i have to compress them via cron?

2 2

[Dovecot] problem with password in a changing scenario
by Angel Luis Mateo Martinez 19 Dec '13

19 Dec '13

Hello, I'm having a problem with with password changing. According to http://wiki2.dovecot.org/Authentication/Caching, I understand "normal scenario" and "Using old cached password scenario", but I'm having a problem with the "Early change scenario". I understand that in this case, if in step 4 user tries password Y, then this password is not tried again and login fails. But if the user tries another password Z, then is it test it? Or does it directly fail? I think that it is directly failing. And here is my problem... I am using dovecot with a ldap backend and another pam backend. The first one is users connecting with an email client. The other one applies when the ldap backend fails and it is use for connections from our webmail, which is integrated in our CAS SSO environment (it has running an imap proxy too). Sometimes (the only scenari we were able to reproduce is with users that for some reason has two SSO sessions opened) dovecot receives an invalid CAS ticket, then authentication fails, and no newer tickets are tried until cache is clean. That's why I think that in this scenario another Z password is even tried. Any idea? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

1 0

[Dovecot] letters local filter duplicated
by John Smith 18 Dec '13

18 Dec '13

two servers with replicated master/master. dovecot.conf = http://pastebin.com/jVnvyWZM with this setup letters processed local filter duplicated. ie when the mail client receives a letter begins processing using rules (filters) to move the letters in a different folder. summarized in this folder is two duplicate letters. if you disable the filter, the message is not duplicated. But does not move to another location. -- Best Regards, Evgeny Senior System Administrator OOO "Vaz Service Hurley"

3 4

[Dovecot] Size detection/replair does not work with zlib
by Roland Rosenfeld 18 Dec '13

18 Dec '13

Hi! Usually dovecot auto detects or repairs the size of a maildir message. So I can place a message named "foo" in the cur directory and dovecot uses it. Now I tried the same with a zlib compressed message but here dovecot doesn't recognize/repair the size of the message. When I access this folder via IMAP the connection is diconnected and in dovecot logs I see the following error messages: Error: Cached message size smaller than expected (805 < 2666) Error: Corrupted index cache file /somedir/dovecot.index.cache: Broken physical size for mail UID 23 Error: read() failed: Input/output error (FETCH for mailbox INBOX UID 23) Disconnected: Internal error occurred. Refer to server log for more information. [2013-12-12 10:54:18] in=321 out=1977 As you can see in the first line, dovecot does know the compressed size of the file (805) as well as the uncompressed size (2666), but it isn't able to repair its index for this. If I modify the setup a little with a standard file naming but with a wrong file size in S-flag (compressed size instead of uncompressed size), the log entries become stranger: Error: Cached message size smaller than expected (805 < 2666) Error: Maildir filename has wrong S value, renamed the file from /somedir/cur/1386772057.M152553P9709.host,S=805:2, to /somedir/cur/1386772057.M152553P9709.host,S=805:2, So here dovecot detects the wrong S value, but instead of fixing it by using the uncompressed size, it renames to the same file name as before... All the above was tested with dovecot 2.1.17. We did a short cross test with 2.2.9 which gives somewhat different error messages, but also isn't able to detect/repair the (uncompressed) file size: Error: Cached message size smaller than expected (805 < 2666) Error: Corrupted index cache file /somedir/dovecot.index.cache: Broken physical size for mail UID 23 Error: read(zlib(/somedir/cur/foo)) failed: Invalid argument We also noticed that on both dovecot versions after trying to access the above file, dovecot.index.cache is always deleted and not rebuild... Is all this intended behavior? It sounds different to the standard behavior of dovecot, that repairs broken folders if possible... Ciao Roland

4 3

[Dovecot] configure lmtp to deliver to email addresses case insensitively
by Adrian Zaugg 17 Dec '13

17 Dec '13

Dear List Using dovecot 2.1.7 with LMTP and exim4 I want to accept local parts regardless of their case. Exim does all virtual alias handling and delivers the messages to dovecot LMTP addressed to the right mailbox name. This works well except for addresses which do not need to be resolved by exim and which do have the "wrong" case in the local part. For example: There is a mailbox and a user on the mailsystem "example.org" called "user". Mails to "user(a)example.org" get delivered just as they should. If an incoming message is addressed to "USER(a)example.org" with upper case local part, exim passes the message to LMTP with the case unaltered (RFC 2821 conform), but LMTP fails with: LMTP error after RCPT TO:<USER(a)example.org>: 550 5.1.1 <USER(a)example.org> User doesn't exist: USER(a)example.org How can I tell dovecot to deliver "USER" to the mailbox "user" aswell? Thank you for your help. Best regards, Adrian. (I have tried to use %Ln and %Lu in mail_location setting with no success.)

5 9

[Dovecot] Dovecot proxy and Postfix SASL
by Andreas Kasenides 17 Dec '13

17 Dec '13

Can somebody please verify that currently (v 2.2.9) SMTP AUTH using SASL from Postfix with Dovecot proxy is still not supported as discussed in these threads (especially the first one)? http://www.dovecot.org/list/dovecot/2012-August/067977.html http://www.dovecot.org/list/dovecot/2011-May/059107.html As I understand it is possible to use saslauthd to do this by using the remote imap option (rimap). Such a facility is important since I am attempting to separate the outward facing servers (dovecot proxy, postfix relay) that have no knowledge of user databases from the backends. thanx Andreas

1 1

[Dovecot] Accessing plain text password from memory
by Stanislas SABATIER 17 Dec '13

17 Dec '13

Is there a way to retrieve the client's password in plain text from memory ? I don't store the password in plain text in my postgreSQL but I need it when the client is connected to make crypto computation. If I write a plugin to do the job, how could I retrieve the plain text password from master ? Thank you for your help, Regards, Stan. --------------------------------------------------------------- Stanislas SABATIER s.sabatier(a)pobox.com ---------------------------------------------------------------

6 9

[Dovecot] Postfix + Dovecot & mail-stack-delivery Outlook Problem
by Sami Mäntysaari 16 Dec '13

16 Dec '13

Hello all readers of the list, I wish to get Microsoft Outlook 2010 workin with mail-stack-delivery setup. Logs when trying to setup accaunt in Microsoft Outlook 2010: ec 14 22:38:31 ip-172-31-7-147 dovecot: imap-login: Disconnected: Too many invalid commands (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:38:31 ip-172-31-7-147 dovecot: pop3-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:38:31 ip-172-31-7-147 dovecot: pop3-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS Dec 14 22:38:31 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS Dec 14 22:38:32 ip-172-31-7-147 dovecot: pop3-login: Aborted login (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:38:33 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS Dec 14 22:38:33 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:39:17 ip-172-31-7-147 dovecot: pop3-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS handshaking: Disconnected Dec 14 22:39:18 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS handshaking: Disconnected Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after UNKNOWN from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after UNKNOWN from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8239]: connect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: lost connection after STARTTLS from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: disconnect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after STARTTLS from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: connect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: lost connection after EHLO from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: disconnect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after EHLO from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:40:13 ip-172-31-7-147 dovecot: imap-login: Login: user=<sm>, method=PLAIN, rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, mpid=8243, TLS Dec 14 22:40:57 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:40:57 ip-172-31-7-147 dovecot: pop3-login: Disconnected (tried to use disabled plaintext auth): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:40:58 ip-172-31-7-147 dovecot: pop3-login: Disconnected (tried to use disabled plaintext auth): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:42:44 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:42:45 ip-172-31-7-147 postfix/anvil[8238]: statistics: max connection rate 3/60s for (submission:2001:470:28:743:4923:c01c:c89a:567a) at Dec 14 22:39:24 Dec 14 22:42:45 ip-172-31-7-147 postfix/anvil[8238]: statistics: max connection count 1 for (submission:2001:470:28:743:4923:c01c:c89a:567a) at Dec 14 22:39:22 Dec 14 22:42:45 ip-172-31-7-147 postfix/anvil[8238]: statistics: max cache size 2 at Dec 14 22:39:22 Telnet log while connected over IPV6 to port 587 on mail server: Trying 2001:470:1f08:ddd::2... Connected to 2001:470:1f08:ddd::2. Escape character is '^]'. 220 mail.sami-mantysaari.biz ESMTP Postfix ehlo samip537.tk 250-mail.sami-mantysaari.biz 250-PIPELINING 250-SIZE 10240000 250-ETRN 250-STARTTLS 250-ENHANCEDSTATUSCODES 250-8BITMIME 250 DSN quit 221 2.0.0 Bye Connection closed by foreign host. Any seggestions what to try in order to get this to work?

5 11

[Dovecot] connection Dovecot to samba4
by Pascal den Bekker 16 Dec '13

16 Dec '13

Hello, I am trying to setup samba4/openchange and dovecot. Does anyone has experiences concering dovecot connecting to samba4 ?? I tried the following: /etc/dovecot.conf: protocols = imap sieve mail_location = maildir:/data/mail/%d/%n/Maildir mail_access_groups = vmail mail_privileged_group = vmail first_valid_uid = 110 last_valid_uid = 110 first_valid_gid = 115 last_valid_gid = 115 log_path = /var/log/dovecot log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = Welcome to domain.local. service imap { inet_listener { port=143 } } protocol lda { log_path = /var/log/mail/dovecot-deliver.log auth_socket_path = /var/run/dovecot/auth-master postmaster_address = postmaster(a)domain.local mail_plugins = sieve } service managesieve { inet_listener { port=12000 } } auth_verbose = yes auth_debug = yes service auth { unix_listener /var/spool/postfix/private/auth { group = vmail mode = 0660 user = postfix } } #service auth-userdb { # user = vmail # } #user = root #} passdb { args = /etc/dovecot/dovecot-ldap-passdb.conf driver = ldap } userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf driver = ldap } plugin { sieve = /data/mail/%d/%n/sieverc sieve_storage=/data/mail/%d/%n/sieve sieve_max_redirects = 20 } debug_log_path = /var/log/dovecot-debug.log dict { } /etc/dovecot/dovecot-ldap-passdb.conf hosts = localhost auth_bind = yes auth_bind_userdn = cn=%u,cn=Users,dc=domain,dc=local ldap_version = 3 base = cn=Users,dc=domain,dc=local pass_filter = (&(objectClass=person)(cn=%u)(mail=*)) /etc/dovecot/dovecot-ldap-userdb.conf: hosts = localhost dn = cn=ldap,cn=Users,DC=domain,DC=local dnpass = password ldap_version = 3 base = cn=Users,DC=domain,DC=local #user_attrs = user_attrs=uid=5000,=gid=5000,=home=/data/mail/%d/%n,mail=/data/mail/%d/%u/Maildir user_filter = (&(objectClass=person)(cn=%u)(mail=*)) iterate_attrs = cn=user iterate_filter = (objectClass=person) When I try to login with useraccountadministrator I get the following error messages: 2013-12-16 11:28:29 auth: Info: ldap(ldap,127.0.0.1,<N3HjRaTtdAB/AAAB>): unknown user 2013-12-16 11:28:29 auth: Error: userdb(ldap,127.0.0.1,<N3HjRaTtdAB/AAAB>): user not found from userdb ldap 2013-12-16 11:28:29 imap: Error: Authenticated user not found from userdb, auth lookup id=783810561 (client-pid=3809 client-id=1) 2013-12-16 11:28:29 imap-login: Info: Internal login failure (pid=3809 id=1) (internal failure, 1 succesful auths): user=<ldap>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3810, secured, session=<N3HjRaTtdAB/AAAB> Can someone tell me what I am doing wrong, or is there way to test to dovecot ldap connection string ?? Cheers, - Pascal -- Pascal den Bekker Linux System Administrator Affinitas GmbH | Kohlfurter Straße 41/43 | 10999 Berlin | Germany email: pascal_den.bekker(a)affinitas.de | tel: +49 30 868 000 140 www.edarling.de | www.shopaman.de Geschäftsführer: Lukas Brosseder, David Khalil, Michael Schrezenmaier Eingetragen beim Amtsgericht Berlin-Charlottenburg, HRB 115958

4 7

[Dovecot] Turn of mount point adding?
by Scott Galambos 16 Dec '13

16 Dec '13

I'm running dovecot 2.2.5 and would like to completely turn off all automatic adding of mount points. So var/lib/dovecot/mounts would be empty essentially. Is this possible? Somehow dovecot always adds a mount point that does not exist and was removed a long time ago. I've dove: doveadm mount add '/my custom path/*' ignore but it still will add mount points in the "mounts" file and flag them as online. for example: ignore /apps/proftp/servers/ftp.domain.ca/* ignore /mnt/* online / online /apps/proftp/servers/ftp.domain.ca/www.site1.com online /apps/proftp/servers/ftp.domain.ca/www.site2.com online /apps/proftp/servers/ftp.domain.ca/www.site3.com what does it list site1, 2 and 3 if its suppose to ignore the root path with the first line? I would to completely disable all mountpoints. Even "doveadm mount add '/*' ignore" should render a mounts file empty on reboot correct? It doesn't and keeps rebuilding it.

3 3

[Dovecot] Is mail deleted when mail-filter fails?
by martijn.list 15 Dec '13

15 Dec '13

Hi, While experimenting with the mail-filter, during some tests my filter failed with a non-zero exit code and did not write any data to the output. This seems to result in a lost email. Is this correct? Is there a way to gracefully handle error from a mail-filter out script? Kind regards, Martijn Brinkers

1 1

[Dovecot] Possible pigeonhole dealing with negative numerical values
by Sam Mulvey 14 Dec '13

14 Dec '13

Using dovecot 2.2.9 and pigeonhole 0.4.2 The system is a Xen VM running Arch Linux x86_64, presently up to date, on an XFS filesystem in an LVM2 partition. After recently updating my mail server, I found that a sieve rule I had which would check X-Spam-Score for a value over a certain number, in my case 2.5. In my most recent update, negative values would trip the rule. Here's the rule in question: # rule:[Spam Filter Subject] if anyof (header :contains "Subject" "[SPAM]", header :value "gt" :comparator "i;as cii-numeric" "X-Spam-Score" "2.5") { fileinto "Spam Box"; stop; } I have a successful work-around by checking the numerical value and also insuring that the header doesn't contain a '-', and things work as they should. Possible the bug could be in my Sieve interface, which is a RoundCube plugin. Otherwise things are working great. If there's anything I can add, please let me know. Thanks! -Sam dovecot -n output: # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.12.4-1-ARCH x86_64 xfs auth_cache_size = 512 k auth_cache_ttl = 10 mins auth_mechanisms = plain login auth_verbose = yes default_internal_user = mailstore first_valid_gid = 50 first_valid_uid = 50 hostname = tacomatelematics.com last_valid_gid = 50 last_valid_uid = 50 lda_mailbox_autocreate = yes mail_gid = 50 mail_location = maildir:/var/spool/mail/%d/%n/Maildir/ mail_privileged_group = postfix mail_uid = 50 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)tacomatelematics.com protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { group = mailstore mode = 01130 user = mailstore } unix_listener auth-userdb { group = mailstore mode = 0600 user = mailstore } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl_cert = </etc/certificate.pem ssl_key = </etc/certificate.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" }

2 1

[Dovecot] v2.2.8 released
by Timo Sirainen 13 Dec '13

13 Dec '13

http://dovecot.org/releases/2.2/dovecot-2.2.8.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.8.tar.gz.sig + Mail cache lookups work for the mail being saved. This improves performance by avoiding the need to parse the mail multiple times when using some plugins (e.g. mail_log). + Mail cache works for recently cached data also with in-memory indexes. + imapc: Many performance improvements, especially when working with dsync. Also added imapc_feature=fetch-headers which allows using FETCH BODY.PEEK[HEADER.FIELDS (..)] to avoid reading the entire header. + mail_location = ..:FULLDIRNAME=dbox-Mails is the same as :DIRNAME=dbox-Mails, but it will also be used for :INDEX and :CONTROL directories. (It should have worked this way from the beginning, but can't be changed anymore without breaking existing installations). - Fixed infinite loop in message parsing if message ends with "--boundary" and CR (without LF). Messages saved via SMTP/LMTP can't trigger this, because messages must end with an "LF.". A user could trigger this for him/herself though. - lmtp: Client was sometimes disconnected before all the output was sent to it. - imap_zlib plugin caused crashes during client disconnection in v2.2.7 - replicator: Database wasn't being exported to disk every 15 minutes as it should have. Instead it was being imported, causing "doveadm replicator remove" commands to not work very well.

5 9

Re: [Dovecot] Dsync error: Couldn't drop privileges: getgrnam
by Joseph Tam 13 Dec '13

13 Dec '13

Alan McGinlay wrote: > Can't believe I'm the only one with this error, googled it and there is > nothing. Sorry to whine but I am getting desperate here! I googled "safe_mkstemp permission denied" and first hit is this thread dovecot.org/list/dovecot/2010-August/052319.html which mentions this error coming about from chrooting users. Looking back on your post, I see http://www.dovecot.org/list/dovecot/2013-December/093900.html mail_chroot = /var/vmail As long as your desperate, maybe try leaving this setting empty? (This doesn't explain why it's not deterministic though.) Try process traces -- I do when I'm stumped. Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] dovecot-imapd eating 100% cpu every once in a while
by Nikolaus Rath 13 Dec '13

13 Dec '13

Hello, About once or twice a week, dovecot's imap-login process on my system seems gets out of control, eating 100% CPU for about 2 hours. Afterwards everything seems to go back to normal. I am using Dovecot 2.1.7 on a 64 bit Debian wheezy system. When running gdb on the process in this stage, I get the following traceback: #0 0x00007fcba50c5a90 in read () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007fcba4aa01aa in ?? () from /usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0 #2 0x00007fcba4a9df09 in BIO_read () from /usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0 #3 0x00007fcba4dbac8c in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 #4 0x00007fcba4dbbe75 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 #5 0x00007fcba4dbd8d0 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 #6 0x00007fcba4dad07a in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 #7 0x00007fcba4db143b in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 #8 0x00007fcba5622b61 in ssl_handshake (proxy=0x7fcba7870bb0) at ssl-proxy-openssl.c:465 #9 ssl_step (proxy=0x7fcba7870bb0) at ssl-proxy-openssl.c:528 #10 0x00007fcba53d2016 in io_loop_call_io (io=0x7fcba786fc80) at ioloop.c:379 #11 0x00007fcba53d2cc7 in io_loop_handler_run (ioloop=ioloop@entry=0x7fcba778c6e0) at ioloop-epoll.c:213 #12 0x00007fcba53d1a28 in io_loop_run (ioloop=0x7fcba778c6e0) at ioloop.c:398 #13 0x00007fcba53be483 in master_service_run (service=0x7fcba778c590, callback=callback@entry=0x7fcba5620100 <client_connected>) at master-service.c:544 #14 0x00007fcba562079e in login_binary_run (binary=<optimized out>, argc=1, argv=0x7fcba778c370) at main.c:406 #15 0x00007fcba5015ead in __libc_start_main () from /lib/x86_64-linux-gnu/libc.so.6 #16 0x00007fcba5a52b2d in _start () strace -tt says: 16:14:19.693378 gettimeofday({1381421659, 693415}, NULL) = 0 16:14:19.693490 time(NULL) = 1381421659 16:14:19.693588 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) 16:14:19.693688 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 16:14:19.693796 gettimeofday({1381421659, 693823}, NULL) = 0 16:14:19.693890 time(NULL) = 1381421659 16:14:19.693984 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) 16:14:19.694084 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 16:14:19.694177 gettimeofday({1381421659, 694203}, NULL) = 0 16:14:19.694269 time(NULL) = 1381421659 16:14:19.694399 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) 16:14:19.694563 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 16:14:19.694706 gettimeofday({1381421659, 694757}, NULL) = 0 16:14:19.694849 time(NULL) = 1381421659 16:14:19.694976 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) 16:14:19.695091 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 16:14:19.695201 gettimeofday({1381421659, 695230}, NULL) = 0 16:14:19.695300 time(NULL) = 1381421659 16:14:19.695420 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) 16:14:19.695555 epoll_wait(14, <unfinished ...> dovecot -n output is: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 ext3 first_valid_uid = 8 last_valid_uid = 8 mail_access_groups = spamd-clients mail_gid = mail mail_location = mdbox:/var/spool/mail/%n/mdbox mail_plugins = fts quota fts_lucene mail_uid = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=SHA512-CRYPT username_format=%n /etc/dovecot/users driver = passwd-file } plugin { antispam_backend = pipe antispam_pipe_program = /usr/local/bin/spamc_wrapper antispam_pipe_program_notspam_args = -L;ham antispam_pipe_program_spam_args = -L;spam antispam_spam = Spam antispam_trash = Trash;Papierkorb fts = lucene fts_lucene = whitespace_chars=@. quota = dict:User quota::file:%h/quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve" service auth { unix_listener auth-client { mode = 0600 user = Debian-exim } } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 2003 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 } ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { args = username_format=%n /etc/dovecot/users driver = passwd-file override_fields = home=/var/spool/mail/%n } protocol lmtp { mail_plugins = fts quota fts_lucene sieve } protocol lda { mail_plugins = fts quota fts_lucene sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = fts quota fts_lucene imap_quota antispam } Is this a bug in dovecot, or am I doing something wrong? Is there something I can do to debug this further? Best, Nikolaus -- Encrypted emails preferred. PGP fingerprint: 5B93 61F8 4EA2 E279 ABF6 02CF A9AD B7F8 AE4E 425C »Time flies like an arrow, fruit flies like a Banana.«

3 6

[Dovecot] Locking down master user to certain domains through passwd-file auth
by Andrew Obertas 12 Dec '13

12 Dec '13

Hello, I know it is possible to lock down a master user to only have access to certain domains through SQL login but I was wondering if the same was possible with a passwd-based system. I currently have a master-passwd file residing in the /etc/virtual/domain.com/ directories I want the master user to be able to log in to. Is there a way to tell passdb to only allow the master user login to proceed if they can auth to the master-passwd file in the same folder as the user? Alternatively, is there a better way to go about this? What I assumed would be the easy approach, where the domain from the user's e-mail is fetched, doesn't seem to work as %d fetches the master user's domain and, unless I'm doing something wrong, the login_domain variable cannot be used as this is outside Dovecot-auth. Any assistance with this would be appreciated. -- Best regards, Andrew Obertas Technical Support Representative Infinet Communications Group

2 2

[Dovecot] error with xz compression
by Michael Cramer 12 Dec '13

12 Dec '13

i have enabled the zlib plugin with xz compression but on some new mails i got now a segfault and the following lines in dovecot error.log Dec 12 08:51:23 imap(tester(a)domain.com): Error: lzma.read(/srv/vmail/mail/domain.com/root/storage/m.3): unexpected EOF at 136004 Dec 12 08:51:23 imap(tester(a)domain.com): Error: read(zlib(/srv/vmail/mail/domain.com/root/storage/m.3)) failed: Invalid argument (uid=2985) Dec 12 08:51:23 imap(tester(a)domain.com): Error: mail parser: read(zlib(/srv/vmail/mail/domain.com/root/storage/m.3), box=Shared/root(a)domain.com) failed: Invalid argument Dec 12 08:52:33 indexer-worker(tester(a)domain.com): Error: lzma.read(/srv/vmail/mail/domain.com/tester/storage/m.41): unexpected EOF at 4913758 the problem is that the mails can't be shown. this happens not with every mail i also got new mails that can be shown without any problem. i was not able to produce a coredump

2 1