- dovecot - dovecot.org

[Dovecot] Ignoring mount points for secondary dovecot instance does not seem to work
by Jouko Nikula 21 Dec '13

21 Dec '13

Hello, I tried to ignore all mountpoints in Dovecot. I have two dovecot instances running: root@fileserver# doveadm instance list path name last used running /usr/local/var/run/dovecot dovecot 2013-12-21 08:09:34 yes /var/run/dovecot.smtp smtp-auth 2013-12-21 08:09:34 yes I give commands: root@fileserver# doveadm mount add '/*' ignore root@fileserver# doveadm -i smtp-auth mount add '/*' ignore And then restart dovecot. In the log I can see that the main instance is now ignoring my mountpoints, but the smtp-auth instance is still warning about my mountpoints. Is this a bug or am I missing something? My configurations are as follows: root@fileserver# doveconf -ni smtp-auth # 2.2.9: /usr/local/etc/dovecot/dovecot.conf.smtp # OS: Linux 3.2.0-4-686-pae i686 Debian 7.1 auth_mechanisms = plain login base_dir = /var/run/dovecot.smtp/ first_valid_uid = 123 instance_name = smtp-auth log_timestamp = "%Y-%m-%d %H:%M:%S " mail_gid = mail mail_location = maildir:~/mail mail_uid = vmail passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = dovecot driver = pam } protocols = service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/certs/imapd.pem ssl_key = </etc/ssl/private/imapd.pem userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } root@fileserver# doveconf -n # 2.2.9: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-686-pae i686 Debian 7.1 auth_mechanisms = plain login first_valid_uid = 123 log_timestamp = "%Y-%m-%d %H:%M:%S " mail_gid = mail mail_location = maildir:~/mail mail_uid = vmail passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = session=yes dovecot driver = pam } protocols = imap service auth-worker { user = vmail } ssl_cert = </etc/ssl/certs/imapd.pem ssl_key = </etc/ssl/private/imapd.pem userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } regards, - Jouko

1 0

[Dovecot] Thank you!
by Steve Litt 20 Dec '13

20 Dec '13

Hi all, I've been on this list for 18 months but almost completely as a lurker. You know why? Because Dovecot never, ever, ever screws up on me or displays unexpected behavior, so I never have technical questions. Thank you for producing such a rock solid piece of software! SteveT Steve Litt * http://www.troubleshooters.com/ Troubleshooting Training * Human Performance

1 0

Re: [Dovecot] configure lmtp to deliver to email addresses case insensitively
by Adrian Zaugg 20 Dec '13

20 Dec '13

Hi David > I believe RFC822 email addresses are case-insensitive, and (in some RFC 2821, Page 13, 1st paragraph: "The local-part of a mailbox MUST BE treated as case sensitive. Therefore, SMTP implementations MUST take care to preserve the case of mailbox local-parts. Mailbox domains are not case sensitive. In particular, for some hosts the user "smith" is different from the user "Smith". However, exploiting the case sensitivity of mailbox local-parts impedes interoperability and is discouraged." (http://tools.ietf.org/html/rfc2821#section-2.4) > cases, especially ones where there's just a mail server) it's entirely > possible that people remember their account names with some capital > letters that aren't in user db. (System knows you as > "mrsmithy(a)mail.domain", while the user may remember the account as > "MrSmithy(a)mail.domain" or "MrsMithy(a)mail.domain"...). Also, people with I just want login names to be case sensitive but not email addresses, and in spite of being treated as case insensitive email addresses should retain their case, just like defined and suggested in the RFC. This reduces support calls because it's con-formant and we have a clear policy: Usernames are always lower case, non-email addresses, the same simple and short name for all our services. There is nothing easier than this. We use this since 17 years and it works without confusion. If a user now spots that suddendly any capitalization of usernames is working when logging in to the webmail, how can I explain that this doesn't work with other services like FTP? > smartphones may not notice that the phone "helpfully" uppercased the > first letter of a lowercase user name. Forcing case reduces support > calls, which is always a good thing. That's why email addresses should be allowed containing capitalizations. On smartphone people tend to use MUAs and there the username is saved and not entered each and every time, so for the username this is less true, I think. Back to dovecot: Using LDA as a transport for the dovecot store, it used to work perfectly (with dovecot 1.x). It's just LMTP that spits, because it looks up the local part in the userdb, which is PAM in our case. I won't change PAM to act case insensitive: I'm not in the position to change a common sense in the computing world as it always was. It's enough Microsoft did that and probably just because of that we're having this discussion here... However, it's maybe best to lowercase the local part in the exim lmtp-transport and leave dovecot's LMTP in peace. Best regards, Adrian.

3 8

[Dovecot] Does quota-status respect quota_grace?
by Jiri Bourek 20 Dec '13

20 Dec '13

Hello, I have Dovecot 2.2.9 from Debian repository running on AMD64, ext4 filesystem for mail storage. Each mailbox has its own system user, quotas are enforced by file system. Quota settings in configuration are as follows (from doveconf -n): quota = fs:Domain quota:group:inode_per_mail quota2 = fs:Mailbox quota:user:inode_per_mail quota2_grace = 18%% quota_grace = 18%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO Quota rules are read from PostgreSQL (snippet) user_query = ... '*:bytes=' || domains.quota_size || 'M:messages=' || domains.quota_files as quota_rule, \ '*:bytes=' || mailboxes.quota_size || 'M:messages=' || mailboxes.quota_files as quota2_rule, \ ... As far as I can tell, quota enforcing in dovecot-lda works correctly. User is allowed one message which brings him over quota (provided the message fits into filesystem quota hard limit and quota_grace value), every other message after that is rejected. However policy service quota-status for Postfix seems to ignore the quota_grace value. When a message arrives which would make user go over quota (but which would not make him exceed the grace limit value), Postfix checks the policy service and is told to reject the message. I checked and dovecot itself is fine with the message - if I try to send it with the policy service check disabled, Postfix accepts it and so does dovecot-lda, the message is delivered into mailbox. My question is - is that intended behavior or bug in the quota-status? Appending some lines from debug log - as far as I can see there's not much in it though: dovecot: quota-status: Debug: Added userdb setting: mail=maildir:/home/mailboxes/t/e/test.info/test/:LAYOUT=fs:INDEX=/var/lib/dovecot-data/index/1010:CONTROL=/var/lib/dovecot-data/control/1010 dovecot: quota-status: Debug: Added userdb setting: plugin/quota2_rule=*:bytes=11M:messages=110 dovecot: quota-status: Debug: Added userdb setting: plugin/quota_rule=*:bytes=15M:messages=150 dovecot: quota-status(test(a)test.info): Debug: Effective uid=1010, gid=1007, home=/home/mailboxes/t/e/test.info/test/ dovecot: quota-status(test(a)test.info): Debug: Quota root: name=Domain quota backend=fs args=group:inode_per_mail dovecot: quota-status(test(a)test.info): Debug: Quota rule: root=Domain quota mailbox=* bytes=15728640 messages=150 dovecot: quota-status(test(a)test.info): Debug: Quota grace: root=Domain quota bytes=2831155 (18%) dovecot: quota-status(test(a)test.info): Debug: Quota root: name=Mailbox quota backend=fs args=user:inode_per_mail dovecot: quota-status(test(a)test.info): Debug: Quota rule: root=Mailbox quota mailbox=* bytes=11534336 messages=110 dovecot: quota-status(test(a)test.info): Debug: Quota grace: root=Mailbox quota bytes=2076180 (18%) dovecot: quota-status(test(a)test.info): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/mailboxes/t/e/test.info/test/:LAYOUT=fs:INDEX=/var/lib/dovecot-data/index/1010:CONTROL=/var/lib/dovecot-data/control/1010 dovecot: quota-status(test(a)test.info): Debug: fs: root=/home/mailboxes/t/e/test.info/test, index=/var/lib/dovecot-data/index/1010, indexpvt=, control=/var/lib/dovecot-data/control/1010, inbox=/home/mailboxes/t/e/test.info/test, alt= dovecot: quota-status(test(a)test.info): Debug: fs quota add mailbox dir = /home/mailboxes/t/e/test.info/test dovecot: quota-status(test(a)test.info): Debug: fs quota block device = /dev/sdc1 dovecot: quota-status(test(a)test.info): Debug: fs quota mount point = /home dovecot: quota-status(test(a)test.info): Debug: fs quota mount type = ext4

3 5

[Dovecot] mirror to download dovecot
by Edwardo Garcia 20 Dec '13

20 Dec '13

Halo, Is mirror to get 2.2.9? cannot get dovecot.org, this time out 4 xe-0-1-0-1-3664.r00.saplbr01.br.bb.gin.ntt.net (200.15.0.45) 6.946 ms 7.093 ms 6.899 ms 5 xe-4-1-3.r20.miamfl02.us.bb.gin.ntt.net (129.250.3.217) 118.130 ms 118.111 ms 118.117 ms 6 ae-1.r05.miamfl02.us.bb.gin.ntt.net (129.250.2.185) 118.592 ms 118.735 ms 118.628 ms 7 * * * 8 * * * 9 * * * I use to get from dovecot.ausics.org but fail connect too, seem has DNS 127.0.0.1 ????? is any others run mirror?

3 3

[Dovecot] reproducible dsync backup panic (dovecot 2.2.7)
by Peter Benko 20 Dec '13

20 Dec '13

Hi all, I'm receiving a reproducible dsync backup panic for some of my users. The error message is as follows: dsync-remote(user@<removed>): Panic: file dsync-brain-mailbox-tree-sync.c: line 111 (dsync_brain_mailbox_tree_sync_change): assertion failed: (brain->no_backup_overwrite) dsync-remote(user@<removed>): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x69b70) [0x7f922dad9b70] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f922dad9c4a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f922da94725] -> /usr/bin/dsync(dsync_brain_mailbox_tree_sync_change+0x382) [0x42f912] -> /usr/bin/dsync(dsync_brain_recv_mailbox_tree_deletes+0x10b) [0x42f4db] -> /usr/bin/dsync(dsync_brain_run+0x305) [0x42c6f5] -> /usr/bin/dsync() [0x42cbe8] -> /usr/bin/dsync() [0x43e040] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f922daea066] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7f922daeaf07] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f922dae9b78] -> /usr/bin/dsync() [0x4297f9] -> /usr/bin/dsync() [0x4133cd] -> /usr/bin/dsync(doveadm_mail_try_run+0x251) [0x414091] -> /usr/bin/dsync(main+0x3c8) [0x412f78] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f922d704ead] -> /usr/bin/dsync() [0x413191] dsync-local(user@<removed>): Error: read(<remote-mail-server>) failed: EOF dsync-local(user@<removed>): Error: Remote command returned error 134 The command I'm using to back up individual user's mail is something like: sudo -u vmail dsync -v -u user(a)server.com -R backup ssh -i sshid-file login(a)server.com sudo -u vmail dsync -v -u user(a)server.com I use the above command at the backup server. The error started to appear a few weeks after we started using the new mail system. First it appeared for a single user, now it appears for some more users as well. It is deterministic and reproducible. Any ideas? I included the relevant part of my config below. Best regards, Peter ------------------------------------------------------------------- # 2.2.7 (5c876ed0c3e0): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_master_user_separator = * auth_mechanisms = plain login hostname = <removed> listen = * login_greeting = $hostname IMAP server mail_attachment_dir = /mail/mailboxes/%d/_attachments_ mail_attachment_fs = sis-queue $mail_attachment_dir/queue:posix mail_attachment_min_size = 16 k mail_location = mdbox:~ mail_plugins = " zlib acl" mdbox_rotate_interval = 5 days mdbox_rotate_size = 5 M namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = mdbox:/mail/mailboxes/%%d/%%n:INDEX=/mail/mailboxes/%%d/%%n prefix = Accounts/%%n/ separator = / subscriptions = no type = shared } passdb { args = /mail/config/dovecot/passwd driver = passwd-file } passdb { args = /mail/config/dovecot/passwd-master driver = passwd-file master = yes pass = yes } plugin { acl = vfile acl_defaults_from_inbox = yes acl_shared_dict = file:/mail/mailboxes/%d/shared-mailboxes.db zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster@<removed> protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } syslog_facility = local6 userdb { args = uid=vmail gid=vmail master_user=%u home=/mail/mailboxes/%d/%n driver = static } protocol imap { mail_plugins = " zlib acl imap_acl" }

2 1

[Dovecot] auth failures
by Andreas Schulze 19 Dec '13

19 Dec '13

Hello, last week and today our dovecot pop3 server stopped responding. Without any other logentries dovecot start to log only this: Dec 12 09:14:12 mbox1 dovecot: auth: Error: ldap(testuser,192.0.2.110,<FBZH7lHtAQAK/FCj>): ldap_search(base=ou=accounts,dc=example,dc=de filter=(&(|(uid=testuser)(mail=testuser))(!(state=blocked)))) failed: Operations error For every pop3 Session, ~2000 per Minute ..., over 10 Minutes I send dovecot a SIGTERM. After dovecot was started again, all was fine again. # doveconf -n http://postmaster.datev.de/tmp/dovecot.conf The LDAP-Server itself did resond to queries in the same timeframe. I know this because the MTA on the same host was able to deliver messages into mailboxes. Any hints? Thanks Andreas -- Andreas Schulze Internetdienste | P252 DATEV eG 90329 Nürnberg | Telefon +49 911 319-0 | Telefax +49 911 319-3196 E-Mail info @datev.de | Internet www.datev.de Sitz: 90429 Nürnberg, Paumgartnerstr. 6-14 | Registergericht Nürnberg, GenReg Nr.70 Vorstand Prof. Dieter Kempf (Vorsitzender) Dipl.-Kfm. Wolfgang Stegmann (stellvertretender Vorsitzender) Dipl.-Kfm. Michael Leistenschneider Dipl.-Kfm. Dr. Robert Mayr Jörg Rabe v. Pappenheim Dipl.-Vw. Eckhard Schwarzer Vorsitzender des Aufsichtsrates: Reinhard Verholen

2 1

[Dovecot] External auth
by eechim enorniel 19 Dec '13

19 Dec '13

Hello, I saw a lot of tutorials about setting postfix with dovecot sasl but I would like more. I want to set a SSO system with roundcube on dovecot. I would like to know how to make dovecot work with sasl or saml, not as a provider but as a service plugging on an external provider. I saw there is an EXTERNAL auth mechanism but I didn't find any doc about it. Can you help me ? Thanks.

2 1

[Dovecot] Mailbox with .broken files
by Michael Smith (DF) 19 Dec '13

19 Dec '13

We're using Dovecot 2.2.4 and mdbox storage with compression. I noticed yesterday that at least one of the accounts has unusual files in it's mail/storage directory. This account has approximately 17.5G of compressed mail, across about 750 storage files (m.###) using 8G of storage. Starting on Dec 11, storage files m.409 through m.731 have not only their m.### file, but also a m.###.broken file. At the same time .temp.<unix time>.<unique id>.<hostname> files also started showing up... ... -rw--w---- 1 user123 mail 3225 Dec 12 04:38 m.708 -rw--w---- 1 user123 mail 167106 Dec 12 03:35 m.708.broken -rw--w---- 1 user123 mail 46155 Dec 12 04:38 m.709 -rw--w---- 1 user123 mail 177267 Dec 12 03:40 m.709.broken -rw--w---- 1 user123 mail 20965889 Nov 26 19:22 m.71 -rw--w---- 1 user123 mail 133248 Dec 12 04:38 m.710 -rw--w---- 1 user123 mail 264361 Dec 12 03:40 m.710.broken -rw--w---- 1 user123 mail 103407 Dec 12 04:38 m.711 -rw--w---- 1 user123 mail 627736 Dec 12 03:40 m.711.broken -rw--w---- 1 user123 mail 5132 Dec 12 04:38 m.712 -rw--w---- 1 user123 mail 136244 Dec 12 03:40 m.712.broken -rw--w---- 1 user123 mail 187224 Dec 12 04:38 m.713 -rw--w---- 1 user123 mail 351104 Dec 12 03:45 m.713.broken -rw--w---- 1 user123 mail 435793 Dec 12 04:38 m.714 -rw--w---- 1 user123 mail 566906 Dec 12 03:45 m.714.broken -rw--w---- 1 user123 mail 60916 Dec 12 04:38 m.715 -rw--w---- 1 user123 mail 192028 Dec 12 03:50 m.715.broken -rw--w---- 1 user123 mail 38051 Dec 12 04:38 m.716 -rw--w---- 1 user123 mail 169163 Dec 12 03:50 m.716.broken -rw--w---- 1 user123 mail 226067 Dec 12 04:38 m.717 -rw--w---- 1 user123 mail 389948 Dec 12 04:00 m.717.broken ... -rw--w---- 1 user123 mail 20967506 Dec 2 17:32 m.96 -rw--w---- 1 user123 mail 20967131 Dec 2 18:40 m.97 -rw--w---- 1 user123 mail 20969078 Dec 2 18:38 m.98 -rw--w---- 1 user123 mail 20963978 Dec 2 19:23 m.99 -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813944.P9142Q0M123686.myhost -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813967.P9213Q0M387733.myhost -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813970.P9231Q0M371190.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813972.P9173Q0M932070.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813972.P9239Q0M114754.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813983.P9261Q0M640646.myhost -rw--w---- 1 user123 mail 1048632 Dec 11 20:06 .temp.1386814038.P9515Q0M530600.myhost I'm not really seeing anything that stands out in the maillog during this time. What caused this problem? How concerned should I be about possible lost email? This is a production environment. Below is the dovecot -n output. -- Michael Smith # dovecot -n # 2.2.4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.19.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) auth_debug = yes auth_debug_passwords = yes auth_default_realm = mydomain.com auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no dotlock_use_excl = no lda_mailbox_autocreate = yes lock_method = dotlock mail_access_groups = mail mail_debug = yes mail_fsync = always mail_location = mdbox:~/mail:INDEX=~/index mail_plugins = quota zlib mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_read_locks = dotlock mbox_write_locks = dotlock mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 20 M mmap_disable = yes namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = type = private } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Drafts autosubscribe4 = Sent autosubscribe5 = INBOX mail_max_userip_connections = 10 managesieve_max_line_length = 65536 quota = dict:User quota::file:%h/dovecot.quota quota2_rule = Trash:storage=+10%% quota3_rule = Junk:storage=+20%% quota_rule = *:storage=100M:messages=100000 recipient_delimiter = + sieve_before = /var/opt/mail/global.sieve/ zlib_save = gz zlib_save_level = 9 } pop3_reuse_xuidl = yes protocols = imap pop3 sieve lmtp service auth { inet_listener auth { port = 113 } unix_listener auth-userdb { user = nobody } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 service_count = 1 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } ssl = no ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = quota zlib sieve } protocol imap { mail_plugins = quota zlib imap_quota } protocol sieve { mail_max_userip_connections = 10 mail_plugins = quota zlib managesieve_max_line_length = 65536 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date } protocol lmtp { mail_plugins = quota zlib sieve }

2 1

Re: [Dovecot] Mailbox with .broken files
by Michael Smith (DF) 19 Dec '13

19 Dec '13

Anyone have any feedback, guidance or suggestions on this? Timo? -----Original Message----- From: Michael Smith (DF) [mailto:msmith@datafoundry.com] Sent: Friday, December 13, 2013 9:49 AM To: 'dovecot(a)dovecot.org' Subject: [Dovecot] Mailbox with .broken files We're using Dovecot 2.2.4 and mdbox storage with compression. I noticed yesterday that at least one of the accounts has unusual files in it's mail/storage directory. This account has approximately 17.5G of compressed mail, across about 750 storage files (m.###) using 8G of storage. Starting on Dec 11, storage files m.409 through m.731 have not only their m.### file, but also a m.###.broken file. At the same time .temp.<unix time>.<unique id>.<hostname> files also started showing up... ... -rw--w---- 1 user123 mail 3225 Dec 12 04:38 m.708 -rw--w---- 1 user123 mail 167106 Dec 12 03:35 m.708.broken -rw--w---- 1 user123 mail 46155 Dec 12 04:38 m.709 -rw--w---- 1 user123 mail 177267 Dec 12 03:40 m.709.broken -rw--w---- 1 user123 mail 20965889 Nov 26 19:22 m.71 -rw--w---- 1 user123 mail 133248 Dec 12 04:38 m.710 -rw--w---- 1 user123 mail 264361 Dec 12 03:40 m.710.broken -rw--w---- 1 user123 mail 103407 Dec 12 04:38 m.711 -rw--w---- 1 user123 mail 627736 Dec 12 03:40 m.711.broken -rw--w---- 1 user123 mail 5132 Dec 12 04:38 m.712 -rw--w---- 1 user123 mail 136244 Dec 12 03:40 m.712.broken -rw--w---- 1 user123 mail 187224 Dec 12 04:38 m.713 -rw--w---- 1 user123 mail 351104 Dec 12 03:45 m.713.broken -rw--w---- 1 user123 mail 435793 Dec 12 04:38 m.714 -rw--w---- 1 user123 mail 566906 Dec 12 03:45 m.714.broken -rw--w---- 1 user123 mail 60916 Dec 12 04:38 m.715 -rw--w---- 1 user123 mail 192028 Dec 12 03:50 m.715.broken -rw--w---- 1 user123 mail 38051 Dec 12 04:38 m.716 -rw--w---- 1 user123 mail 169163 Dec 12 03:50 m.716.broken -rw--w---- 1 user123 mail 226067 Dec 12 04:38 m.717 -rw--w---- 1 user123 mail 389948 Dec 12 04:00 m.717.broken ... -rw--w---- 1 user123 mail 20967506 Dec 2 17:32 m.96 -rw--w---- 1 user123 mail 20967131 Dec 2 18:40 m.97 -rw--w---- 1 user123 mail 20969078 Dec 2 18:38 m.98 -rw--w---- 1 user123 mail 20963978 Dec 2 19:23 m.99 -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813944.P9142Q0M123686.myhost -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813967.P9213Q0M387733.myhost -rw--w---- 1 user123 mail 294968 Dec 11 20:05 .temp.1386813970.P9231Q0M371190.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813972.P9173Q0M932070.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813972.P9239Q0M114754.myhost -rw--w---- 1 user123 mail 327736 Dec 11 20:05 .temp.1386813983.P9261Q0M640646.myhost -rw--w---- 1 user123 mail 1048632 Dec 11 20:06 .temp.1386814038.P9515Q0M530600.myhost I'm not really seeing anything that stands out in the maillog during this time. What caused this problem? How concerned should I be about possible lost email? This is a production environment. Below is the dovecot -n output. -- Michael Smith # dovecot -n # 2.2.4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.19.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) auth_debug = yes auth_debug_passwords = yes auth_default_realm = mydomain.com auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no dotlock_use_excl = no lda_mailbox_autocreate = yes lock_method = dotlock mail_access_groups = mail mail_debug = yes mail_fsync = always mail_location = mdbox:~/mail:INDEX=~/index mail_plugins = quota zlib mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_read_locks = dotlock mbox_write_locks = dotlock mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 20 M mmap_disable = yes namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = type = private } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Drafts autosubscribe4 = Sent autosubscribe5 = INBOX mail_max_userip_connections = 10 managesieve_max_line_length = 65536 quota = dict:User quota::file:%h/dovecot.quota quota2_rule = Trash:storage=+10%% quota3_rule = Junk:storage=+20%% quota_rule = *:storage=100M:messages=100000 recipient_delimiter = + sieve_before = /var/opt/mail/global.sieve/ zlib_save = gz zlib_save_level = 9 } pop3_reuse_xuidl = yes protocols = imap pop3 sieve lmtp service auth { inet_listener auth { port = 113 } unix_listener auth-userdb { user = nobody } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 service_count = 1 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } ssl = no ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = quota zlib sieve } protocol imap { mail_plugins = quota zlib imap_quota } protocol sieve { mail_max_userip_connections = 10 mail_plugins = quota zlib managesieve_max_line_length = 65536 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date } protocol lmtp { mail_plugins = quota zlib sieve }

1 0

[Dovecot] v2.2.9 released
by Timo Sirainen 19 Dec '13

19 Dec '13

http://dovecot.org/releases/2.2/dovecot-2.2.9.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.9.tar.gz.sig + Full text search indexing can now be done automatically after saving/copying mails by setting plugin { fts_autoindex=yes } + replicator: Added replication_dsync_parameters setting to pass "doveadm sync" parameters (for controlling what to replicate). + Added mail-filter plugin + Added liblzma/xz support (zlib_save=xz) - v2.2.8's improved cache file handling exposed several old bugs related to fetching mail headers. - v2.2.7's iostream handling changes were causing some connections to be disconnected before flushing their output (e.g. POP3 logout message wasn't being sent)

7 9

[Dovecot] zlib plugin question
by Przemysław Orzechowski 19 Dec '13

19 Dec '13

Hi Is it possible to compress incoming mails delivered via dovecots LDA when using dovecot --version 1.2.9 or do i have to compress them via cron?

2 2

[Dovecot] problem with password in a changing scenario
by Angel Luis Mateo Martinez 19 Dec '13

19 Dec '13

Hello, I'm having a problem with with password changing. According to http://wiki2.dovecot.org/Authentication/Caching, I understand "normal scenario" and "Using old cached password scenario", but I'm having a problem with the "Early change scenario". I understand that in this case, if in step 4 user tries password Y, then this password is not tried again and login fails. But if the user tries another password Z, then is it test it? Or does it directly fail? I think that it is directly failing. And here is my problem... I am using dovecot with a ldap backend and another pam backend. The first one is users connecting with an email client. The other one applies when the ldap backend fails and it is use for connections from our webmail, which is integrated in our CAS SSO environment (it has running an imap proxy too). Sometimes (the only scenari we were able to reproduce is with users that for some reason has two SSO sessions opened) dovecot receives an invalid CAS ticket, then authentication fails, and no newer tickets are tried until cache is clean. That's why I think that in this scenario another Z password is even tried. Any idea? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

1 0

[Dovecot] letters local filter duplicated
by John Smith 18 Dec '13

18 Dec '13

two servers with replicated master/master. dovecot.conf = http://pastebin.com/jVnvyWZM with this setup letters processed local filter duplicated. ie when the mail client receives a letter begins processing using rules (filters) to move the letters in a different folder. summarized in this folder is two duplicate letters. if you disable the filter, the message is not duplicated. But does not move to another location. -- Best Regards, Evgeny Senior System Administrator OOO "Vaz Service Hurley"

3 4

[Dovecot] Size detection/replair does not work with zlib
by Roland Rosenfeld 18 Dec '13

18 Dec '13

Hi! Usually dovecot auto detects or repairs the size of a maildir message. So I can place a message named "foo" in the cur directory and dovecot uses it. Now I tried the same with a zlib compressed message but here dovecot doesn't recognize/repair the size of the message. When I access this folder via IMAP the connection is diconnected and in dovecot logs I see the following error messages: Error: Cached message size smaller than expected (805 < 2666) Error: Corrupted index cache file /somedir/dovecot.index.cache: Broken physical size for mail UID 23 Error: read() failed: Input/output error (FETCH for mailbox INBOX UID 23) Disconnected: Internal error occurred. Refer to server log for more information. [2013-12-12 10:54:18] in=321 out=1977 As you can see in the first line, dovecot does know the compressed size of the file (805) as well as the uncompressed size (2666), but it isn't able to repair its index for this. If I modify the setup a little with a standard file naming but with a wrong file size in S-flag (compressed size instead of uncompressed size), the log entries become stranger: Error: Cached message size smaller than expected (805 < 2666) Error: Maildir filename has wrong S value, renamed the file from /somedir/cur/1386772057.M152553P9709.host,S=805:2, to /somedir/cur/1386772057.M152553P9709.host,S=805:2, So here dovecot detects the wrong S value, but instead of fixing it by using the uncompressed size, it renames to the same file name as before... All the above was tested with dovecot 2.1.17. We did a short cross test with 2.2.9 which gives somewhat different error messages, but also isn't able to detect/repair the (uncompressed) file size: Error: Cached message size smaller than expected (805 < 2666) Error: Corrupted index cache file /somedir/dovecot.index.cache: Broken physical size for mail UID 23 Error: read(zlib(/somedir/cur/foo)) failed: Invalid argument We also noticed that on both dovecot versions after trying to access the above file, dovecot.index.cache is always deleted and not rebuild... Is all this intended behavior? It sounds different to the standard behavior of dovecot, that repairs broken folders if possible... Ciao Roland

4 3

[Dovecot] configure lmtp to deliver to email addresses case insensitively
by Adrian Zaugg 17 Dec '13

17 Dec '13

Dear List Using dovecot 2.1.7 with LMTP and exim4 I want to accept local parts regardless of their case. Exim does all virtual alias handling and delivers the messages to dovecot LMTP addressed to the right mailbox name. This works well except for addresses which do not need to be resolved by exim and which do have the "wrong" case in the local part. For example: There is a mailbox and a user on the mailsystem "example.org" called "user". Mails to "user(a)example.org" get delivered just as they should. If an incoming message is addressed to "USER(a)example.org" with upper case local part, exim passes the message to LMTP with the case unaltered (RFC 2821 conform), but LMTP fails with: LMTP error after RCPT TO:<USER(a)example.org>: 550 5.1.1 <USER(a)example.org> User doesn't exist: USER(a)example.org How can I tell dovecot to deliver "USER" to the mailbox "user" aswell? Thank you for your help. Best regards, Adrian. (I have tried to use %Ln and %Lu in mail_location setting with no success.)

5 9

[Dovecot] Dovecot proxy and Postfix SASL
by Andreas Kasenides 17 Dec '13

17 Dec '13

Can somebody please verify that currently (v 2.2.9) SMTP AUTH using SASL from Postfix with Dovecot proxy is still not supported as discussed in these threads (especially the first one)? http://www.dovecot.org/list/dovecot/2012-August/067977.html http://www.dovecot.org/list/dovecot/2011-May/059107.html As I understand it is possible to use saslauthd to do this by using the remote imap option (rimap). Such a facility is important since I am attempting to separate the outward facing servers (dovecot proxy, postfix relay) that have no knowledge of user databases from the backends. thanx Andreas

1 1

[Dovecot] Accessing plain text password from memory
by Stanislas SABATIER 17 Dec '13

17 Dec '13

Is there a way to retrieve the client's password in plain text from memory ? I don't store the password in plain text in my postgreSQL but I need it when the client is connected to make crypto computation. If I write a plugin to do the job, how could I retrieve the plain text password from master ? Thank you for your help, Regards, Stan. --------------------------------------------------------------- Stanislas SABATIER s.sabatier(a)pobox.com ---------------------------------------------------------------

6 9

[Dovecot] Postfix + Dovecot & mail-stack-delivery Outlook Problem
by Sami Mäntysaari 16 Dec '13

16 Dec '13

Hello all readers of the list, I wish to get Microsoft Outlook 2010 workin with mail-stack-delivery setup. Logs when trying to setup accaunt in Microsoft Outlook 2010: ec 14 22:38:31 ip-172-31-7-147 dovecot: imap-login: Disconnected: Too many invalid commands (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:38:31 ip-172-31-7-147 dovecot: pop3-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:38:31 ip-172-31-7-147 dovecot: pop3-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS Dec 14 22:38:31 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS Dec 14 22:38:32 ip-172-31-7-147 dovecot: pop3-login: Aborted login (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:38:33 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS Dec 14 22:38:33 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:39:17 ip-172-31-7-147 dovecot: pop3-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS handshaking: Disconnected Dec 14 22:39:18 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, TLS handshaking: Disconnected Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after UNKNOWN from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:22 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after UNKNOWN from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8239]: connect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:23 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: lost connection after STARTTLS from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: disconnect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after STARTTLS from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: connect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: connect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: lost connection after EHLO from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8239]: disconnect from unknown[2001:470:28:743:4923:c01c:c89a:567a] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: lost connection after EHLO from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:39:24 ip-172-31-7-147 postfix/submission/smtpd[8237]: disconnect from cable-tku-58c3cc-203.dhcp.inet.fi[88.195.204.203] Dec 14 22:40:13 ip-172-31-7-147 dovecot: imap-login: Login: user=<sm>, method=PLAIN, rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2, mpid=8243, TLS Dec 14 22:40:57 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:40:57 ip-172-31-7-147 dovecot: pop3-login: Disconnected (tried to use disabled plaintext auth): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:40:58 ip-172-31-7-147 dovecot: pop3-login: Disconnected (tried to use disabled plaintext auth): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:42:44 ip-172-31-7-147 dovecot: imap-login: Disconnected (no auth attempts): rip=2001:470:28:743:4923:c01c:c89a:567a, lip=2001:470:1f08:ddd::2 Dec 14 22:42:45 ip-172-31-7-147 postfix/anvil[8238]: statistics: max connection rate 3/60s for (submission:2001:470:28:743:4923:c01c:c89a:567a) at Dec 14 22:39:24 Dec 14 22:42:45 ip-172-31-7-147 postfix/anvil[8238]: statistics: max connection count 1 for (submission:2001:470:28:743:4923:c01c:c89a:567a) at Dec 14 22:39:22 Dec 14 22:42:45 ip-172-31-7-147 postfix/anvil[8238]: statistics: max cache size 2 at Dec 14 22:39:22 Telnet log while connected over IPV6 to port 587 on mail server: Trying 2001:470:1f08:ddd::2... Connected to 2001:470:1f08:ddd::2. Escape character is '^]'. 220 mail.sami-mantysaari.biz ESMTP Postfix ehlo samip537.tk 250-mail.sami-mantysaari.biz 250-PIPELINING 250-SIZE 10240000 250-ETRN 250-STARTTLS 250-ENHANCEDSTATUSCODES 250-8BITMIME 250 DSN quit 221 2.0.0 Bye Connection closed by foreign host. Any seggestions what to try in order to get this to work?

5 11

[Dovecot] connection Dovecot to samba4
by Pascal den Bekker 16 Dec '13

16 Dec '13

Hello, I am trying to setup samba4/openchange and dovecot. Does anyone has experiences concering dovecot connecting to samba4 ?? I tried the following: /etc/dovecot.conf: protocols = imap sieve mail_location = maildir:/data/mail/%d/%n/Maildir mail_access_groups = vmail mail_privileged_group = vmail first_valid_uid = 110 last_valid_uid = 110 first_valid_gid = 115 last_valid_gid = 115 log_path = /var/log/dovecot log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = Welcome to domain.local. service imap { inet_listener { port=143 } } protocol lda { log_path = /var/log/mail/dovecot-deliver.log auth_socket_path = /var/run/dovecot/auth-master postmaster_address = postmaster(a)domain.local mail_plugins = sieve } service managesieve { inet_listener { port=12000 } } auth_verbose = yes auth_debug = yes service auth { unix_listener /var/spool/postfix/private/auth { group = vmail mode = 0660 user = postfix } } #service auth-userdb { # user = vmail # } #user = root #} passdb { args = /etc/dovecot/dovecot-ldap-passdb.conf driver = ldap } userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf driver = ldap } plugin { sieve = /data/mail/%d/%n/sieverc sieve_storage=/data/mail/%d/%n/sieve sieve_max_redirects = 20 } debug_log_path = /var/log/dovecot-debug.log dict { } /etc/dovecot/dovecot-ldap-passdb.conf hosts = localhost auth_bind = yes auth_bind_userdn = cn=%u,cn=Users,dc=domain,dc=local ldap_version = 3 base = cn=Users,dc=domain,dc=local pass_filter = (&(objectClass=person)(cn=%u)(mail=*)) /etc/dovecot/dovecot-ldap-userdb.conf: hosts = localhost dn = cn=ldap,cn=Users,DC=domain,DC=local dnpass = password ldap_version = 3 base = cn=Users,DC=domain,DC=local #user_attrs = user_attrs=uid=5000,=gid=5000,=home=/data/mail/%d/%n,mail=/data/mail/%d/%u/Maildir user_filter = (&(objectClass=person)(cn=%u)(mail=*)) iterate_attrs = cn=user iterate_filter = (objectClass=person) When I try to login with useraccountadministrator I get the following error messages: 2013-12-16 11:28:29 auth: Info: ldap(ldap,127.0.0.1,<N3HjRaTtdAB/AAAB>): unknown user 2013-12-16 11:28:29 auth: Error: userdb(ldap,127.0.0.1,<N3HjRaTtdAB/AAAB>): user not found from userdb ldap 2013-12-16 11:28:29 imap: Error: Authenticated user not found from userdb, auth lookup id=783810561 (client-pid=3809 client-id=1) 2013-12-16 11:28:29 imap-login: Info: Internal login failure (pid=3809 id=1) (internal failure, 1 succesful auths): user=<ldap>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3810, secured, session=<N3HjRaTtdAB/AAAB> Can someone tell me what I am doing wrong, or is there way to test to dovecot ldap connection string ?? Cheers, - Pascal -- Pascal den Bekker Linux System Administrator Affinitas GmbH | Kohlfurter Straße 41/43 | 10999 Berlin | Germany email: pascal_den.bekker(a)affinitas.de | tel: +49 30 868 000 140 www.edarling.de | www.shopaman.de Geschäftsführer: Lukas Brosseder, David Khalil, Michael Schrezenmaier Eingetragen beim Amtsgericht Berlin-Charlottenburg, HRB 115958

4 7

[Dovecot] Turn of mount point adding?
by Scott Galambos 16 Dec '13

16 Dec '13

I'm running dovecot 2.2.5 and would like to completely turn off all automatic adding of mount points. So var/lib/dovecot/mounts would be empty essentially. Is this possible? Somehow dovecot always adds a mount point that does not exist and was removed a long time ago. I've dove: doveadm mount add '/my custom path/*' ignore but it still will add mount points in the "mounts" file and flag them as online. for example: ignore /apps/proftp/servers/ftp.domain.ca/* ignore /mnt/* online / online /apps/proftp/servers/ftp.domain.ca/www.site1.com online /apps/proftp/servers/ftp.domain.ca/www.site2.com online /apps/proftp/servers/ftp.domain.ca/www.site3.com what does it list site1, 2 and 3 if its suppose to ignore the root path with the first line? I would to completely disable all mountpoints. Even "doveadm mount add '/*' ignore" should render a mounts file empty on reboot correct? It doesn't and keeps rebuilding it.

3 3

[Dovecot] Is mail deleted when mail-filter fails?
by martijn.list 15 Dec '13

15 Dec '13

Hi, While experimenting with the mail-filter, during some tests my filter failed with a non-zero exit code and did not write any data to the output. This seems to result in a lost email. Is this correct? Is there a way to gracefully handle error from a mail-filter out script? Kind regards, Martijn Brinkers

1 1

[Dovecot] Possible pigeonhole dealing with negative numerical values
by Sam Mulvey 14 Dec '13

14 Dec '13

Using dovecot 2.2.9 and pigeonhole 0.4.2 The system is a Xen VM running Arch Linux x86_64, presently up to date, on an XFS filesystem in an LVM2 partition. After recently updating my mail server, I found that a sieve rule I had which would check X-Spam-Score for a value over a certain number, in my case 2.5. In my most recent update, negative values would trip the rule. Here's the rule in question: # rule:[Spam Filter Subject] if anyof (header :contains "Subject" "[SPAM]", header :value "gt" :comparator "i;as cii-numeric" "X-Spam-Score" "2.5") { fileinto "Spam Box"; stop; } I have a successful work-around by checking the numerical value and also insuring that the header doesn't contain a '-', and things work as they should. Possible the bug could be in my Sieve interface, which is a RoundCube plugin. Otherwise things are working great. If there's anything I can add, please let me know. Thanks! -Sam dovecot -n output: # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.12.4-1-ARCH x86_64 xfs auth_cache_size = 512 k auth_cache_ttl = 10 mins auth_mechanisms = plain login auth_verbose = yes default_internal_user = mailstore first_valid_gid = 50 first_valid_uid = 50 hostname = tacomatelematics.com last_valid_gid = 50 last_valid_uid = 50 lda_mailbox_autocreate = yes mail_gid = 50 mail_location = maildir:/var/spool/mail/%d/%n/Maildir/ mail_privileged_group = postfix mail_uid = 50 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)tacomatelematics.com protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { group = mailstore mode = 01130 user = mailstore } unix_listener auth-userdb { group = mailstore mode = 0600 user = mailstore } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl_cert = </etc/certificate.pem ssl_key = </etc/certificate.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" }

2 1

[Dovecot] v2.2.8 released
by Timo Sirainen 13 Dec '13

13 Dec '13

http://dovecot.org/releases/2.2/dovecot-2.2.8.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.8.tar.gz.sig + Mail cache lookups work for the mail being saved. This improves performance by avoiding the need to parse the mail multiple times when using some plugins (e.g. mail_log). + Mail cache works for recently cached data also with in-memory indexes. + imapc: Many performance improvements, especially when working with dsync. Also added imapc_feature=fetch-headers which allows using FETCH BODY.PEEK[HEADER.FIELDS (..)] to avoid reading the entire header. + mail_location = ..:FULLDIRNAME=dbox-Mails is the same as :DIRNAME=dbox-Mails, but it will also be used for :INDEX and :CONTROL directories. (It should have worked this way from the beginning, but can't be changed anymore without breaking existing installations). - Fixed infinite loop in message parsing if message ends with "--boundary" and CR (without LF). Messages saved via SMTP/LMTP can't trigger this, because messages must end with an "LF.". A user could trigger this for him/herself though. - lmtp: Client was sometimes disconnected before all the output was sent to it. - imap_zlib plugin caused crashes during client disconnection in v2.2.7 - replicator: Database wasn't being exported to disk every 15 minutes as it should have. Instead it was being imported, causing "doveadm replicator remove" commands to not work very well.

5 9

Re: [Dovecot] Dsync error: Couldn't drop privileges: getgrnam
by Joseph Tam 13 Dec '13

13 Dec '13

Alan McGinlay wrote: > Can't believe I'm the only one with this error, googled it and there is > nothing. Sorry to whine but I am getting desperate here! I googled "safe_mkstemp permission denied" and first hit is this thread dovecot.org/list/dovecot/2010-August/052319.html which mentions this error coming about from chrooting users. Looking back on your post, I see http://www.dovecot.org/list/dovecot/2013-December/093900.html mail_chroot = /var/vmail As long as your desperate, maybe try leaving this setting empty? (This doesn't explain why it's not deterministic though.) Try process traces -- I do when I'm stumped. Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] dovecot-imapd eating 100% cpu every once in a while
by Nikolaus Rath 13 Dec '13

13 Dec '13

Hello, About once or twice a week, dovecot's imap-login process on my system seems gets out of control, eating 100% CPU for about 2 hours. Afterwards everything seems to go back to normal. I am using Dovecot 2.1.7 on a 64 bit Debian wheezy system. When running gdb on the process in this stage, I get the following traceback: #0 0x00007fcba50c5a90 in read () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007fcba4aa01aa in ?? () from /usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0 #2 0x00007fcba4a9df09 in BIO_read () from /usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0 #3 0x00007fcba4dbac8c in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 #4 0x00007fcba4dbbe75 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 #5 0x00007fcba4dbd8d0 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 #6 0x00007fcba4dad07a in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 #7 0x00007fcba4db143b in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 #8 0x00007fcba5622b61 in ssl_handshake (proxy=0x7fcba7870bb0) at ssl-proxy-openssl.c:465 #9 ssl_step (proxy=0x7fcba7870bb0) at ssl-proxy-openssl.c:528 #10 0x00007fcba53d2016 in io_loop_call_io (io=0x7fcba786fc80) at ioloop.c:379 #11 0x00007fcba53d2cc7 in io_loop_handler_run (ioloop=ioloop@entry=0x7fcba778c6e0) at ioloop-epoll.c:213 #12 0x00007fcba53d1a28 in io_loop_run (ioloop=0x7fcba778c6e0) at ioloop.c:398 #13 0x00007fcba53be483 in master_service_run (service=0x7fcba778c590, callback=callback@entry=0x7fcba5620100 <client_connected>) at master-service.c:544 #14 0x00007fcba562079e in login_binary_run (binary=<optimized out>, argc=1, argv=0x7fcba778c370) at main.c:406 #15 0x00007fcba5015ead in __libc_start_main () from /lib/x86_64-linux-gnu/libc.so.6 #16 0x00007fcba5a52b2d in _start () strace -tt says: 16:14:19.693378 gettimeofday({1381421659, 693415}, NULL) = 0 16:14:19.693490 time(NULL) = 1381421659 16:14:19.693588 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) 16:14:19.693688 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 16:14:19.693796 gettimeofday({1381421659, 693823}, NULL) = 0 16:14:19.693890 time(NULL) = 1381421659 16:14:19.693984 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) 16:14:19.694084 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 16:14:19.694177 gettimeofday({1381421659, 694203}, NULL) = 0 16:14:19.694269 time(NULL) = 1381421659 16:14:19.694399 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) 16:14:19.694563 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 16:14:19.694706 gettimeofday({1381421659, 694757}, NULL) = 0 16:14:19.694849 time(NULL) = 1381421659 16:14:19.694976 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) 16:14:19.695091 epoll_wait(14, {{EPOLLOUT, {u32=2810463600, u64=140512665552240}}}, 10, 4294967295) = 1 16:14:19.695201 gettimeofday({1381421659, 695230}, NULL) = 0 16:14:19.695300 time(NULL) = 1381421659 16:14:19.695420 read(18, 0x7fcba7876a43, 5) = -1 EAGAIN (Resource temporarily unavailable) 16:14:19.695555 epoll_wait(14, <unfinished ...> dovecot -n output is: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 ext3 first_valid_uid = 8 last_valid_uid = 8 mail_access_groups = spamd-clients mail_gid = mail mail_location = mdbox:/var/spool/mail/%n/mdbox mail_plugins = fts quota fts_lucene mail_uid = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=SHA512-CRYPT username_format=%n /etc/dovecot/users driver = passwd-file } plugin { antispam_backend = pipe antispam_pipe_program = /usr/local/bin/spamc_wrapper antispam_pipe_program_notspam_args = -L;ham antispam_pipe_program_spam_args = -L;spam antispam_spam = Spam antispam_trash = Trash;Papierkorb fts = lucene fts_lucene = whitespace_chars=@. quota = dict:User quota::file:%h/quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve" service auth { unix_listener auth-client { mode = 0600 user = Debian-exim } } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 2003 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 } ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { args = username_format=%n /etc/dovecot/users driver = passwd-file override_fields = home=/var/spool/mail/%n } protocol lmtp { mail_plugins = fts quota fts_lucene sieve } protocol lda { mail_plugins = fts quota fts_lucene sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = fts quota fts_lucene imap_quota antispam } Is this a bug in dovecot, or am I doing something wrong? Is there something I can do to debug this further? Best, Nikolaus -- Encrypted emails preferred. PGP fingerprint: 5B93 61F8 4EA2 E279 ABF6 02CF A9AD B7F8 AE4E 425C »Time flies like an arrow, fruit flies like a Banana.«

3 6

[Dovecot] Locking down master user to certain domains through passwd-file auth
by Andrew Obertas 12 Dec '13

12 Dec '13

Hello, I know it is possible to lock down a master user to only have access to certain domains through SQL login but I was wondering if the same was possible with a passwd-based system. I currently have a master-passwd file residing in the /etc/virtual/domain.com/ directories I want the master user to be able to log in to. Is there a way to tell passdb to only allow the master user login to proceed if they can auth to the master-passwd file in the same folder as the user? Alternatively, is there a better way to go about this? What I assumed would be the easy approach, where the domain from the user's e-mail is fetched, doesn't seem to work as %d fetches the master user's domain and, unless I'm doing something wrong, the login_domain variable cannot be used as this is outside Dovecot-auth. Any assistance with this would be appreciated. -- Best regards, Andrew Obertas Technical Support Representative Infinet Communications Group

2 2

[Dovecot] error with xz compression
by Michael Cramer 12 Dec '13

12 Dec '13

i have enabled the zlib plugin with xz compression but on some new mails i got now a segfault and the following lines in dovecot error.log Dec 12 08:51:23 imap(tester(a)domain.com): Error: lzma.read(/srv/vmail/mail/domain.com/root/storage/m.3): unexpected EOF at 136004 Dec 12 08:51:23 imap(tester(a)domain.com): Error: read(zlib(/srv/vmail/mail/domain.com/root/storage/m.3)) failed: Invalid argument (uid=2985) Dec 12 08:51:23 imap(tester(a)domain.com): Error: mail parser: read(zlib(/srv/vmail/mail/domain.com/root/storage/m.3), box=Shared/root(a)domain.com) failed: Invalid argument Dec 12 08:52:33 indexer-worker(tester(a)domain.com): Error: lzma.read(/srv/vmail/mail/domain.com/tester/storage/m.41): unexpected EOF at 4913758 the problem is that the mails can't be shown. this happens not with every mail i also got new mails that can be shown without any problem. i was not able to produce a coredump

2 1

[Dovecot] Dsync error: Couldn't drop privileges: getgrnam
by Alan McGinlay - SICS 12 Dec '13

12 Dec '13

Hi, I upgraded (in place upgrade, preserving my dovecot configs) to a newer release of ubuntu in order to gain access to slightly newer Dovecot release and be able to use Dsync for migration from Cyrus, here is my doveconf -n output: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.5.0-44-generic x86_64 Ubuntu 12.10 auth_debug = yes auth_default_realm = whatever.com auth_master_user_separator = * auth_socket_path = /var/run/dovecot/auth-master imapc_features = rfc822.size imapc_host = oldmail.whatever.com imapc_master_user = cyradmin imapc_password = <password hidden> mail_chroot = /var/vmail mail_debug = yes mail_gid = 5000 mail_location = maildir:~/Maildir mail_prefetch_count = 20 mail_privileged_group = vmail mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve pop3" service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = dovecot mode = 0600 user = dovecot } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = <cert ssl_key = <cert userdb { args = uid=vmail gid=vmail home=/domain/%1d/%d/%1n/%n allow_all_users=yes driver = static } protocol lmtp { postmaster_address = post(a)whatever.com } protocol imap { mail_max_userip_connections = 10 } protocol pop3 { pop3_uidl_format = %v.%u } And the command I am using to (attempt) a mailbox sync: doveadm -o mail_fsync=never backup -R -u alantestuser(a)whatever.com imapc: Produces this output: dsync(alantestuser(a)whatever.com): Error: user alantestuser(a)whatever.com: Couldn't drop privileges: getgrnam(vmail) failed: No such file or directory (in mail_privileged_group setting) dsync(alantestuser(a)whatever.com): Fatal: User init failed mail.log shows this: Dec 5 21:10:54 newmailserver dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Dec 5 21:10:54 newmailserver dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Dec 5 21:10:54 newmailserver dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so Dec 5 21:10:54 newmailserver dovecot: auth: Debug: passwd-file /etc/dovecot/master-users: Read 1 users in 0 secs Dec 5 21:10:54 newmailserver dovecot: auth: Debug: master in: USER#0111#011alantestuser(a)whatever.com#011service=doveadm Dec 5 21:10:54 newmailserver dovecot: auth: Debug: master out: USER#0111#011alantestuser@whatever.com#011uid=5000#011gid=5000#011home=/domain/w/whatever.com/a/alantestuser I followed this doc (which could use a little fleshing out, I will be happy to do it once I get a grasp on this!): http://wiki2.dovecot.org/Migration/Dsync Thanks in advance! /Alan

3 9

[Dovecot] managesieve error with dovecot
by saurabh 12 Dec '13

12 Dec '13

Hi All, I am using Dovecot version 2.0.9 on Centos 6.4. I have installed dovecot-pegionhole version 2.0.9 and Roundcube version 0.9.5 . After doing all the configurations. I am able to see the filters icon in roundcube setting. But whem I click it I get the error "could not connect to server" please help. Below are the error logs. ########### log from /var/log/maillog ########## Dec 11 21:41:06 eximtest dovecot: managesieve: Debug: Unknown userdb setting: plugin//mail/%d/%n/=/home/test Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Debug: Effective uid=6006, gid=6000, home= Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Debug: quota: No quota setting - plugin disabled Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/mail/ayurve.co.uk/test/Maildir Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Debug: maildir++: root=/mail/ayurve.co.uk/test/Maildir, index=, control=, inbox=/mail/ayurve.co.uk/test/Maildir Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Debug: sieve-storage: using active sieve script path: (null) Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Debug: sieve-storage: using sieve script storage directory: (null) Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Error: sieve-storage: stat((null)) failed: Bad address Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Error: sieve-storage: stat((null)) failed: Bad address Dec 11 21:41:06 eximtest dovecot: managesieve(test(a)ayurve.co.uk): Fatal: Failed to open Sieve storage. ############## log from /var/www/html/roundcube/logs/errors ############## [11-Dec-2013 16:11:06 +0000]: PHP Error: Unable to connect to managesieve on eximtest.techblue.co.uk:4190 in /var/www/html/roundcube/plugins/managesieve/managesieve.php on line 308 (GET /roundcube/?_task=settings&_action=plugin.managesieve) [11-Dec-2013 16:11:06] Not currently in AUTHORISATION state (1): [11-Dec-2013 16:11:06] Failed to write to socket: connection lost (): ################### log from /var/www/html/roundcube/logs/sieve ################### [11-Dec-2013 16:11:06 +0000]: S: "IMPLEMENTATION" "dovecot" [11-Dec-2013 16:11:06 +0000]: S: "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date" [11-Dec-2013 16:11:06 +0000]: S: "NOTIFY" "mailto" [11-Dec-2013 16:11:06 +0000]: S: "SASL" "PLAIN" [11-Dec-2013 16:11:06 +0000]: S: "VERSION" "1.0" [11-Dec-2013 16:11:06 +0000]: S: OK "Capability completed." [11-Dec-2013 16:11:06 +0000]: C: AUTHENTICATE "PLAIN" "AHRlc3RAYXl1cnZlLmNvLnVrADRRUG9vZFdvMGQ=" [11-Dec-2013 16:11:06 +0000]: S: Thanks, Saurabh -- Saurabh Kumar (RHCSA,RHCE,RHCVA)

2 6

[Dovecot] what's wrong with this config file?
by Jim Reid 12 Dec '13

12 Dec '13

Hi. I'm setting up a new IMAPS server. Mail users don't have login access to the box but will each have unique UNIX-style UIDs: no back-end database or LDAP thing. So far. Their mail will get delivered to UNIX-style mailboxes in /var/mail/%u (where %u is the UNIX username obviously). Their IMAP folders will go in /var/imap/%u. These will contain subfolders once everyone migrates to the new set-up and some folders will contain messages and subfolders. I think this is what I configured in dovecot. However when I try to set up a test account, dovecot reports the following error: Dec 12 02:22:00 shaun dovecot: imap-login: Login: user=<jim>, method=CRAM-MD5, rip=10.0.0.1, lip=10.1.1.1, mpid=14874, TLS, session=<8Hy1Ak3t+gDDNulD> Dec 12 02:22:00 shaun dovecot: imap(jim): Error: user jim: Initialization failed: namespace configuration error: Duplicate namespace prefix: "" Dec 12 02:22:00 shaun dovecot: imap(jim): Error: Invalid user settings. Refer to server log for more information. I've checked and re-checked the wiki. google was unable to suggest any explanation either. Any ideas what's wrong? There is no duplicate namespace (and/or prefix) that I can see below. # 2.2.9: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 9.2-RELEASE amd64 auth_mechanisms = cram-md5 auth_verbose = yes base_dir = /var/run/dovecot/ default_client_limit = 120 director_username_hash = %Lu import_environment = TZ listen = *, [::] mail_debug = yes mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail mbox_write_locks = fcntl namespace { disabled = no hidden = yes ignore_on_failure = no inbox = yes list = yes location = mbox:~/mail:INBOX=/var/mail/%u prefix = "#mbox/" separator = / subscriptions = yes type = private } namespace imapstuff { disabled = no hidden = no ignore_on_failure = no inbox = no list = yes location = maildir:/var/imap/%u:LAYOUT=fs prefix = separator = / subscriptions = yes type = private } namespace inbox { disabled = no hidden = no ignore_on_failure = no inbox = yes list = yes location = mailbox Drafts { auto = no driver = special_use = \Drafts } mailbox Junk { auto = no driver = special_use = \Junk } mailbox Sent { auto = no driver = special_use = \Sent } mailbox "Sent Messages" { auto = no driver = special_use = \Sent } mailbox Trash { auto = no driver = special_use = \Trash } prefix = separator = subscriptions = yes type = private } passdb { driver = pam } passdb { driver = pam } passdb { args = /usr/local/etc/dovecot-md5 driver = passwd-file } protocols = imap service aggregator { chroot = . client_limit = 0 drop_priv_before_exec = no executable = aggregator extra_groups = fifo_listener replication-notify-fifo { group = mode = 0600 user = } group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replication-notify { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service anvil { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = anvil extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = anvil unix_listener anvil-auth-penalty { group = mode = 0600 user = } unix_listener anvil { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service auth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = auth -w extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener auth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service auth { chroot = client_limit = 0 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-client { group = mode = 0600 user = } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = mode = 0666 user = $default_internal_user } unix_listener login/login { group = mode = 0666 user = } unix_listener token-login/tokenlogin { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service config { chroot = client_limit = 0 drop_priv_before_exec = no executable = config extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = config unix_listener config { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service dict { chroot = client_limit = 1 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service director { chroot = . client_limit = 0 drop_priv_before_exec = no executable = director extra_groups = fifo_listener login/proxy-notify { group = mode = 00 user = } group = idle_kill = 4294967295 secs inet_listener { address = port = 0 ssl = no } privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener director-admin { group = mode = 0600 user = } unix_listener director-userdb { group = mode = 0600 user = } unix_listener login/director { group = mode = 00 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dns_client { chroot = client_limit = 1 drop_priv_before_exec = no executable = dns-client extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dns-client { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener doveadm-server { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service imap-login { chroot = login client_limit = 32 drop_priv_before_exec = no executable = /usr/local/libexec/dovecot/imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = port = 0 ssl = no } inet_listener imaps { address = port = 993 ssl = yes } privileged_group = process_limit = 8 process_min_avail = 3 protocol = imap service_count = 1 type = login user = $default_login_user vsz_limit = 64 M } service imap-urlauth-login { chroot = token-login client_limit = 0 drop_priv_before_exec = no executable = imap-urlauth-login extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login unix_listener imap-urlauth { group = mode = 0666 user = } user = $default_login_user vsz_limit = 18446744073709551615 B } service imap-urlauth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth-worker extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener imap-urlauth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service imap-urlauth { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap-urlauth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener token-login/imap-urlauth { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service imap { chroot = client_limit = 1 drop_priv_before_exec = no executable = /usr/local/libexec/dovecot/imap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 32 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener login/imap { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service indexer-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = indexer-worker extra_groups = group = idle_kill = 0 privileged_group = process_limit = 10 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service indexer { chroot = client_limit = 0 drop_priv_before_exec = no executable = indexer extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service ipc { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = ipc extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener ipc { group = mode = 0600 user = } unix_listener login/ipc-proxy { group = mode = 0600 user = $default_login_user } user = $default_internal_user vsz_limit = 18446744073709551615 B } service lmtp { chroot = client_limit = 1 drop_priv_before_exec = no executable = lmtp extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service log { chroot = client_limit = 0 drop_priv_before_exec = no executable = log extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = log unix_listener log-errors { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service pop3-login { chroot = login client_limit = 32 drop_priv_before_exec = no executable = pop3-login extra_groups = group = idle_kill = 0 inet_listener pop3 { address = port = 110 ssl = no } inet_listener pop3s { address = port = 995 ssl = yes } privileged_group = process_limit = 8 process_min_avail = 3 protocol = pop3 service_count = 1 type = login user = $default_login_user vsz_limit = 64 M } service pop3 { chroot = client_limit = 1 drop_priv_before_exec = no executable = pop3 extra_groups = group = idle_kill = 0 privileged_group = process_limit = 32 process_min_avail = 0 protocol = pop3 service_count = 1 type = unix_listener login/pop3 { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service replicator { chroot = client_limit = 0 drop_priv_before_exec = no executable = replicator extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replicator-doveadm { group = mode = 00 user = $default_internal_user } unix_listener replicator { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service ssl-params { chroot = client_limit = 0 drop_priv_before_exec = no executable = ssl-params extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = startup unix_listener login/ssl-params { group = mode = 0666 user = } unix_listener ssl-params { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service stats { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = stats extra_groups = fifo_listener stats-mail { group = mode = 0600 user = } group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener stats { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } ssl_cert = </usr/local/etc/ssl/certs/dovecot.pem ssl_cipher_list = ALL:!LOW:!SSLv2 ssl_key = </usr/local/etc/ssl/private/dovecot.pem ssl_parameters_regenerate = 1 weeks state_dir = /var/lib/dovecot syslog_facility = local4 userdb { driver = passwd } userdb { driver = passwd } protocol lda { postmaster_address = postmaster(a)example.com } protocol imap { mail_max_userip_connections = 10 mail_plugin_dir = /usr/local/lib/dovecot/imap }

3 2

[Dovecot] warning from managesieve
by Michael Cramer 12 Dec '13

12 Dec '13

when .dovecot.sieve is a symlink (which it is in my case) a warning is written to the error log file, but it still works. Dec 12 10:02:33 managesieve(tester(a)domain.com): Warning: sieve-storage: Active sieve script symlink /srv/vmail/sieve/domain.com/tester/.dovecot.sieve is broken: invalid/unknown path to storage (points to ingo.sieve). root@i920:/srv/vmail/sieve/domain.com/tester# ll insgesamt 20 drwx------ 3 mail mail 4096 Dez 12 10:03 ./ drwx------ 15 mail mail 4096 Dez 12 10:02 ../ lrwxrwxrwx 1 mail mail 10 Dez 12 10:02 .dovecot.sieve -> ingo.sieve -rw------- 1 mail mail 1575 Dez 12 10:03 .dovecot.svbin -rw------- 1 mail mail 2457 Dez 12 10:02 ingo.sieve drwx------ 2 mail mail 4096 Dez 12 10:02 tmp/

4 7

[Dovecot] Panic: file buffer.c: assertion failed: (used_size <= buf->alloc)
by giom87＠libero.it 12 Dec '13

12 Dec '13

Hi, We have a crash in dovecot 2.2.7 2013-12-11 10:38:44 imap(xxx(a)example.com): Panic: file buffer.c: line 307 (buffer_set_used_size): assertion failed: (used_size <= buf->alloc) 2013-12-11 10:38:44 imap(xxx(a)example.com): Error: Raw backtrace: /opt/dovecot- 2.2.7/lib/dovecot/libdovecot.so.0(+0x672a2) [0x7f576b9742a2] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot.so.0(+0x67306) [0x7f576b974306] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f576b92eb4f] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot.so.0(+0x62d89) [0x7f576b96fd89] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_file_open+0x228) [0x7f576bc85488] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0 (mail_transaction_log_open+0xba) [0x7f576bc8229a] -> /opt/dovecot-2.2.7 /lib/dovecot/libdovecot-storage.so.0(+0x8dc94) [0x7f576bc69c94] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot-storage.so.0(mail_index_open+0xf0) [0x7f576bc69ee0] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0 (index_storage_mailbox_open+0xad) [0x7f576bc5d0dd] -> /opt/dovecot-2.2.7 /lib/dovecot/libdovecot-storage.so.0(+0x4432a) [0x7f576bc2032a] -> /opt/dovecot- 2.2.7/lib/dovecot/libdovecot-storage.so.0(+0x443ff) [0x7f576bc203ff] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0(+0x564e4) [0x7f576bc324e4] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot-storage.so.0 (mailbox_open+0xf) [0x7f576bc3269f] -> /opt/dovecot-2.2.7 /lib/dovecot/libdovecot-storage.so.0(mailbox_delete+0x1d) [0x7f576bc3287d] -> dovecot/imap(cmd_delete+0xb4) [0x40cc24] -> dovecot/imap(command_exec+0x3d) [0x416d0d] -> dovecot/imap() [0x415e30] -> dovecot/imap() [0x415f1d] -> dovecot/imap(client_handle_input+0x11d) [0x41619d] -> dovecot/imap (client_input+0x6f) [0x41650f] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot.so.0 (io_loop_call_io+0x36) [0x7f576b983b96] -> /opt/dovecot-2.2.7 /lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f576b984bf7] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f576b983b08] -> /opt/dovecot-2.2.7/lib/dovecot/libdovecot.so.0 (master_service_run+0x13) [0x7f576b9338f3] -> dovecot/imap(main+0x2a7) [0x41fa27] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f576b598cdd] -> dovecot/imap() [0x40ab79] 2013-12-11 10:38:44 imap(xx(a)example.com): Fatal: master: service(imap): child 6214 killed with signal 6 (core dumped) We use CentOS 6.4: # cat /etc/issue CentOS release 6.4 (Final) The output of dovecot -n: # 2.2.7: /opt/dovecot-2.2.7/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 CentOS release 6.4 (Final) auth_debug = yes auth_master_user_separator = * auth_username_format = disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 101 first_valid_uid = 102 imap_id_send = import_environment = TZ info_log_path = /var/log/dovecot.log log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = always mail_gid = 101 mail_location = maildir:%h/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota expire fts fts_lucene mail_uid = 102 maildir_broken_filename_sizes = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . subscriptions = yes type = private } passdb { args = /opt/dovecot-2.2.7/etc/dovecot/passwd.masterusers driver = passwd-file master = yes } passdb { args = /opt/dovecot-2.2.7/etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /opt/dovecot-2.2.7/etc/dovecot/dovecot-ldap-multiuser.conf driver = ldap master = yes } plugin { fts = lucene fts_lucene = quota = maildir quota_rule2 = INBOX.Trash:storage=+100M } protocols = imap pop3 service anvil { client_limit = 3000 } service auth { client_limit = 4096 unix_listener auth-userdb { mode = 0600 } } service imap-login { inet_listener imap { address = xxx.xxx.xxx.xxx port = 143 } inet_listener imaps { address = xxx.xxx.xxx.xxx port = 993 ssl = yes } process_limit = 2500 process_min_avail = 5 } service imap { drop_priv_before_exec = yes process_limit = 2500 process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { drop_priv_before_exec = yes process_limit = 1024 } service pop3-login { inet_listener pop3 { address = xxx.xxx.xxx.xxx port = 110 } inet_listener pop3s { address = xxx.xxx.xxx.xxx port = 995 ssl = yes } process_limit = 300 process_min_avail = 5 } service pop3 { drop_priv_before_exec = yes process_limit = 300 process_min_avail = 5 } ssl_cert = </opt/dovecot-2.2.7/certs/imapd.pem ssl_key = </opt/dovecot-2.2.7/certs/imapd.pem userdb { args = /opt/dovecot-2.2.7/etc/dovecot/dovecot-ldap.conf driver = ldap } protocol lmtp { mail_plugins = quota expire fts fts_lucene sieve } protocol lda { mail_plugins = quota expire fts fts_lucene sieve } protocol imap { mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota pop3_uidl_format = UID%u-%v } Thanks

2 1

[Dovecot] ot: tracking messages- luser troubleshooting
by voytek＠sbt.net.au 12 Dec '13

12 Dec '13

I had a user complaining of 'not getting emails' I've searched for sender in maillog, got two messages, both showed up as; Dec 12 15:51:29 emu postfix/pipe[9607]: 3F21C5E750: to=<xxx>, relay=dovecot, delay=6.4, delays=6.3/0.01/0/0.12, dsn=2.0.0, status=sent (delivered via dovecot service) Dec 12 15:51:29 emu postfix/qmgr[20178]: 3F21C5E750: removed yes the user claimed the message was not received, eventually, after traversing through severl directories, I found the message in '../Maildir/.Deleted Messages' it turns out it was inadvertenltly deleted on iphone. there has to be a better way to try to find / resolve such issues ? what's an optimal way of trying to trace such? I greped for the 3F21C5E750 string through several Maildirs tia,

2 1

[Dovecot] Dovecot as caching proxy
by Anton Lundin 12 Dec '13

12 Dec '13

Hi. I'm bin playing around with dovecot to try to setup it as a caching imap proxy. I manged to get dovecot to use both proxy=y and imapc: connections to the master server, but i haven't manged to get dovecot to cache any mails. The remote imap server is a quite hostile one, that i don't have any super/master user access to, and it only exposes imap. I've used tried both with the static passdb, nopassword=y, and imap authdb and with static and prefetch userdbs. I manage to produce the same results, eg. dovecot grabbing the password from the client and uses it to establish a imapc connection to the server and re-exposing it, and starts to write indexes. ( The later plan is probably to use pam as passdb to grab a and store a hashed copy of the password to allow offline access to the cached emails, but thats a later problem to solve.) What i haven't managed to get working is to trigger some replication of the remote emails to dovecot and using that as a cache to serve the emails to the client. I found some presentations and some emails that point in the direction that this should be possible to achieve, probably with the replication plugin, but never managed to get this to work. I'm using dovecot 2.2.9 Does anyone have manged to produce a working setup like this? //Anton -- Anton Lundin +46702-161604

1 0

[Dovecot] Dovecot 2.1.7 crash (with core dumped)
by Alessio Cecchi 12 Dec '13

12 Dec '13

Hi, I'm running dovecot 2.1.7 with vpopmail auth and Maildir on NFS (I have only one POP/IMAP server). All works fine but sometimes dovecot "imap" process crush and I would like to understand why: Error in log files: Dec 12 06:32:56 pop01eeh dovecot: imap-login: Login: user=<info(a)mydomain.com>, method=PLAIN, rip=1.2.3.4, lip=192.168.1.3, mpid=4086, session=<UbiBrU/tvACXCCva> Dec 12 06:50:25 pop01eeh dovecot: imap(info(a)mydomain.com), session=<UbiBrU/tvACXCCva>: Disconnected: Disconnected in IDLE in=654 out=704677 Dec 12 06:50:25 pop01eeh dovecot: imap(info(a)mydomain.com), session=<UbiBrU/tvACXCCva>: Panic: Message count decreased Dec 12 06:50:25 pop01eeh dovecot: imap(info(a)mydomain.com), session=<UbiBrU/tvACXCCva>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4892a) [0x7f68af1ae92a] -> /usr/lib/dovecot/libdovecot.so.0(+0x48976) [0x7f68af1ae976] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f68af181faf] -> dovecot/imap() [0x4191e9] -> dovecot/imap() [0x40b366] -> dovecot/imap() [0x40b69c] -> dovecot/imap(command_exec+0x3d) [0x411ffd] -> dovecot/imap(client_command_cancel+0x3a) [0x4108da] -> dovecot/imap(client_destroy+0xdd) [0x41178d] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f68af1bab56] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f68af1bbb8f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f68af1baaf8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f68af1a6413] -> dovecot/imap(main+0x2a4) [0x419dd4] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f68aee22c8d] -> dovecot/imap() [0x4090b9] Dec 12 06:50:25 pop01eeh dovecot: imap(info(a)mydomain.com), session=<UbiBrU/tvACXCCva>: Fatal: master: service(imap): child 4086 killed with signal 6 (core dumped) Backtrace: # gdb /usr/libexec/dovecot/imap /home/dovecot/core GNU gdb (GDB) 7.0.1-debian Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/libexec/dovecot/imap...done. warning: Can't read pathname for load map: Input/output error. Reading symbols from /usr/lib/dovecot/libdovecot-storage.so.0...done. Loaded symbols for /usr/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /usr/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /usr/lib/dovecot/libdovecot.so.0 Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /usr/lib/libssl.so.0.9.8...(no debugging symbols found)...done. Loaded symbols for /usr/lib/libssl.so.0.9.8 Reading symbols from /usr/lib/libcrypto.so.0.9.8...(no debugging symbols found)...done. Loaded symbols for /usr/lib/libcrypto.so.0.9.8 Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done. Loaded symbols for /lib/libdl.so.2 Reading symbols from /lib/librt.so.1...(no debugging symbols found)...done. Loaded symbols for /lib/librt.so.1 Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /usr/lib/libz.so.1...(no debugging symbols found)...done. Loaded symbols for /usr/lib/libz.so.1 Reading symbols from /lib/libpthread.so.0...(no debugging symbols found)...done. Loaded symbols for /lib/libpthread.so.0 Reading symbols from /usr/lib/dovecot/lib01_acl_plugin.so...done. Loaded symbols for /usr/lib/dovecot/lib01_acl_plugin.so Reading symbols from /usr/lib/dovecot/lib02_imap_acl_plugin.so...done. Loaded symbols for /usr/lib/dovecot/lib02_imap_acl_plugin.so Reading symbols from /usr/lib/dovecot/lib10_quota_plugin.so...done. Loaded symbols for /usr/lib/dovecot/lib10_quota_plugin.so Reading symbols from /usr/lib/dovecot/lib11_imap_quota_plugin.so...done. Loaded symbols for /usr/lib/dovecot/lib11_imap_quota_plugin.so Reading symbols from /usr/lib/dovecot/lib20_expire_plugin.so...done. Loaded symbols for /usr/lib/dovecot/lib20_expire_plugin.so Reading symbols from /usr/lib/dovecot/lib20_zlib_plugin.so...done. Loaded symbols for /usr/lib/dovecot/lib20_zlib_plugin.so Reading symbols from /lib/libbz2.so.1.0...(no debugging symbols found)...done. Loaded symbols for /lib/libbz2.so.1.0 Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols found)...done. Loaded symbols for /lib/libgcc_s.so.1 Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. #0 0x00007f68aee361b5 in raise () from /lib/libc.so.6 (gdb) bt full #0 0x00007f68aee361b5 in raise () from /lib/libc.so.6 No symbol table info available. #1 0x00007f68aee38fc0 in abort () from /lib/libc.so.6 No symbol table info available. #2 0x00007f68af1ae93d in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:191 backtrace = 0x1980248 "/usr/lib/dovecot/libdovecot.so.0(+0x4892a) [0x7f68af1ae92a] -> /usr/lib/dovecot/libdovecot.so.0(+0x48976) [0x7f68af1ae976] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f68af181faf] -> dovecot/im"... #3 0x00007f68af1ae976 in i_internal_fatal_handler (ctx=0x7fffb9588e70, format=<value optimized out>, args=<value optimized out>) at failures.c:649 status = 0 #4 0x00007f68af181faf in i_panic (format=0xff6 <Address 0xff6 out of bounds>) at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = 0x7fffb9588f40, reg_save_area = 0x7fffb9588e80}} #5 0x00000000004191e9 in imap_sync_deinit (ctx=0x1a36ae0, sync_cmd=0x19a54c0) at imap-sync.c:242 client = 0x19a48e0 status = {messages = 1983, recent = 0, unseen = 0, uidvalidity = 1290163110, uidnext = 84072, first_unseen_seq = 0, first_recent_uid = 84072, last_cached_seq = 0, highest_modseq = 1, keywords = 0x0, permanent_flags = 0, nonpermanent_modseqs = 1, permanent_keywords = 0, allow_new_keywords = 0} sync_status = {sync_delayed_expunges = 0} ret = 0 #6 0x000000000040b366 in idle_finish (ctx=0x19a55b0, done_ok=false, free_cmd=false) at cmd-idle.c:38 client = 0x19a48e0 #7 0x000000000040b69c in cmd_idle_continue (cmd=0x19a54c0) at cmd-idle.c:234 client = 0x19a48e0 ctx = 0x19a55b0 orig_offset = 704677 #8 0x0000000000411ffd in command_exec (cmd=0x19a54c0) at imap-commands.c:148 hook = 0x1989cd0 ret = <value optimized out> #9 0x00000000004108da in client_command_cancel (_cmd=0x7fffb9589088) at imap-client.c:136 cmd = 0x19a54c0 cmd_ret = <value optimized out> #10 0x000000000041178d in client_destroy (client=0x19a48e0, reason=<value optimized out>) at imap-client.c:202 cmd = 0x0 __FUNCTION__ = "client_destroy" #11 0x00007f68af1bab56 in io_loop_call_io (io=0x1a35ad0) at ioloop.c:379 ioloop = 0x1988670 t_id = 2 #12 0x00007f68af1bbb8f in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:213 ctx = 0x19889e0 event = 0x1988a50 list = 0x19a5410 io = 0xff6 tv = {tv_sec = 29, tv_usec = 999250} msecs = <value optimized out> ret = <value optimized out> i = 0 call = false #13 0x00007f68af1baaf8 in io_loop_run (ioloop=0x1988670) at ioloop.c:398 No locals. #14 0x00007f68af1a6413 in master_service_run (service=0x1988520, callback=0xff6) at master-service.c:544 No locals. ---Type <return> to continue, or q <return> to quit--- #15 0x0000000000419dd4 in main (argc=1, argv=0x1988370) at main.c:389 set_roots = {0x41cf20, 0x0} login_set = {auth_socket_path = 0x1980078 "/var/run/dovecot/auth-master", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x41a0b0 <login_client_connected>, failure_callback = 0x41a050 <login_client_failed>} service_flags = <value optimized out> storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = <value optimized out> (gdb) And my configuration: dovecot -n # 2.1.17: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.8 auth_cache_size = 8 M deliver_log_format = msgid=%m, from=%f, subject="%s": %$ dict { acl = mysql:/etc/dovecot/dovecot-share-folder.conf expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 89 first_valid_uid = 89 last_valid_gid = 89 last_valid_uid = 89 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_fsync = always mail_location = maildir:~/Maildir mail_log_prefix = "%s(%u), session=<%{session}>: " mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota acl zlib expire maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vnd.dovecot.duplicate mmap_disable = yes namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = username_format=%Ld /etc/dovecot/extra/alias-domains-denylogin.txt deny = yes driver = passwd-file } passdb { args = cache_key=%s%u webmail=192.168.1.5 driver = vpopmail } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = proxy::acl expire = Trash expire2 = Spam expire_dict = proxy::expire quota = maildir:UserQuota quota2 = dict:Quota Usage::noenforcing:proxy::sqlquota quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/before.sieve sieve_dir = ~/sieve sieve_extensions = +vnd.dovecot.duplicate -vacation } pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o protocols = imap pop3 sieve service auth { unix_listener auth-userdb { group = vchkpw mode = 0660 user = vpopmail } } service dict { process_limit = 300 unix_listener dict { group = vchkpw mode = 0660 user = vpopmail } } service imap-login { process_min_avail = 4 service_count = 0 } service imap { process_limit = 2400 } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { service_count = 0 } service quota-warning { executable = script /etc/dovecot/scripts/quota-warning.sh unix_listener quota-warning { user = vpopmail } user = vpopmail } ssl_cert = </etc/dovecot/ssl/wildcard-myserver.net.pem ssl_key = </etc/dovecot/ssl/wildcard-myserver.net.key submission_host = localhost userdb { args = quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol lda { mail_plugins = quota acl zlib expire sieve } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_idle_notify_interval = 29 mins mail_max_userip_connections = 15 mail_plugins = quota acl zlib expire imap_quota imap_acl } protocol sieve { mail_max_userip_connections = 2 } protocol pop3 { mail_max_userip_connections = 5 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz Cloud Email Hosting -> http://www.qboxmail.com @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it

2 7

[Dovecot] Dovecot connection problem - Too many invalid commands (no auth attempts) - v2.0.19
by Thomas Standaert 12 Dec '13

12 Dec '13

Hello. This might be a silly problem, but I'm a bit a newbie at this, and the internet didn't give me a solution to this yet. I installed a mail server with postfix, dovecot, postfixadmin and a mysql DB for authentification, using this tutorial : <http://www.exratione.com/2012/05/a-mailserver-on-ubuntu-1204-postfix-doveco t-mysql/> http://www.exratione.com/2012/05/a-mailserver-on-ubuntu-1204-postfix-dovecot -mysql/. Except step 4. The complete tutorial worked on a virtual machine, but doesn't work here on a vps from ovh.net. Connecting via telnet localhost 143 works, I can connect. When I try to connect via thunderbird, the domain name is picked up, but gives me a bad login/password combination. Mail.log, mail.err and error don't show anything. Via MS Outlook, I seem to get stuck on the connection page, and I get the following errors in mail.log: dovecot: imap-login: Disconnected: Too many invalid commands (no auth attempts): rip=x, lip=y dovecot: pop3-login: Disconnected (no auth attempts): rip=x, lip=y dovecot: imap-login: Disconnected (no auth attempts): rip=x, lip=y, TLS: Disconnected dovecot: pop3-login: Disconnected (no auth attempts): rip=x, lip=y, TLS: Disconnected dovecot: pop3-login: Aborted login (no auth attempts): rip=x, lip=y dovecot: imap-login: Disconnected (no auth attempts): rip=x, lip=y, TLS: Disconnected dovecot: imap-login: Disconnected (no auth attempts rip=x, lip=y dovecot: imap-login: Disconnected (no auth attempts): rip=x, lip=y, TLS handshaking: Disconnected dovecot: pop3-login: Disconnected (no auth attempts): rip=x, lip=y, TLS handshaking: Disconnected And after a while asks to try to connect via plain method. Doveconf -n gives me this # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab068.8 x86_64 Ubuntu 12.04.2 LTS simfs auth_mechanisms = plain login first_valid_uid = 150 last_valid_uid = 150 mail_gid = mail mail_location = maildir:/var/vmail/%d/%n mail_uid = vmail passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = " imap pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = mail mode = 0600 user = vmail } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } Hope you guys can help me, and thanks in advance for it. Greetings, Thomas Standaert

4 4

[Dovecot] multiple passdbs and auth sockets
by Jouko Nikula 12 Dec '13

12 Dec '13

Hello, I want to use different authentication arguments for smtp and imap/pop3. In the dovecot list I found this: http://www.dovecot.org/list/dovecot/2013-August/091960.html I tried to follow these instructions but dovecot refuses to find the auth executable: Dec 12 10:36:18 jlaptop postfix/smtpd[7302]: connect from localhost[127.0.0.1] Dec 12 10:36:18 jlaptop dovecot: auth-10: Error: doveconf: Fatal: execvp(/usr/local/var/run/dovecot/dovecot/auth) failed: No such file or directory Dec 12 10:36:18 jlaptop dovecot: master: Error: service(auth-10): command startup failed, throttling for 2 secs Dec 12 10:36:18 jlaptop dovecot: auth-10: Fatal: master: service(auth-10): child 7304 returned error 89 (Fatal failure) Dec 12 10:36:18 jlaptop postfix/smtpd[7302]: fatal: no SASL authentication mechanisms Dec 12 10:36:19 jlaptop postfix/master[7046]: warning: process /usr/lib/postfix/smtpd pid 7302 exit status 1 Dec 12 10:36:19 jlaptop postfix/master[7046]: warning: /usr/lib/postfix/smtpd: bad command startup -- throttling My settings for postfix and dovecot are as follows: root@jlaptop:/usr/local/etc/dovecot/conf.d# postconf -n alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases append_dot_mydomain = no biff = no config_directory = /etc/postfix default_transport = error home_mailbox = Maildir/ inet_interfaces = loopback-only mailbox_command = mailbox_size_limit = 0 myhostname = jlaptop mynetworks = 127.0.0.0/8 [::ffff:127.0.0.0]/104 [::1]/128 queue_directory = /var/spool/postfix readme_directory = no recipient_delimiter = + relay_transport = error relayhost = smtp_tls_session_cache_database = btree:${data_directory}/smtp_scache smtpd_banner = $myhostname ESMTP $mail_name (Ubuntu) smtpd_relay_restrictions = permit_mynetworks permit_sasl_authenticated defer_unauth_destination smtpd_sasl_auth_enable = yes smtpd_sasl_path = private/auth-10 smtpd_sasl_type = dovecot smtpd_tls_cert_file = /etc/ssl/certs/ssl-cert-snakeoil.pem smtpd_tls_key_file = /etc/ssl/private/ssl-cert-snakeoil.key smtpd_tls_session_cache_database = btree:${data_directory}/smtpd_scache smtpd_use_tls = yes virtual_gid_maps = static:8 virtual_mailbox_base = /var/mail/smtp virtual_mailbox_domains = jlaptop.com virtual_mailbox_maps = hash:/etc/postfix/vmaps virtual_minimum_uid = 100 virtual_uid_maps = static:124 root@jlaptop:/usr/local/etc/dovecot/conf.d# doveconf -n # 2.2.9: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.11.0-13-generic x86_64 Ubuntu 13.10 auth_debug = yes auth_debug_passwords = yes auth_verbose = yes first_valid_uid = 124 mail_gid = mail mail_home = /var/mail/imap/%n mail_location = maildir:~/mail mail_plugin_dir = /usr/local/lib/dovecot/ mail_plugins = gpgfuse_umount mail_uid = vmail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = session=yes dovecot driver = pam } protocols = imap pop3 lmtp imap pop3 service auth-10 { executable = auth -c /usr/local/etc/dovecot-auth-smtp.conf process_limit = 1 unix_listener /var/spool/postfix/private/auth-10 { group = postfix mode = 0666 user = postfix } } ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { args = uid=vmail gid=mail home=/var/mail/imap/%n driver = static } The file /usr/local/etc/dovecot-auth-smtp.conf is as follows: auth_mechanisms = plain login disable_plaintext_auth = no #auth_username_format = %Lu auth_debug = yes auth_debug_passwords = yes auth_verbose = yes first_valid_uid = 124 mail_gid = mail mail_uid = vmail protocols = imap pop3 lmtp imap pop3 ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem passdb { driver = pam args = dovecot } userdb { driver = static args = uid=vmail gid=mail home=/var/mail/imap/%n } The result is exactly the same also if I don't give the path to auth. I.e.: executable = auth -c /usr/local/etc/dovecot-auth-smtp.conf In order to get past this problem I provided the auth executable in /usr/local/var/run/dovecot/dovecot/auth, but then I get a new problem: Dec 12 12:31:53 jlaptop postfix/smtpd[9220]: connect from localhost[127.0.0.1] Dec 12 12:31:53 jlaptop dovecot: auth-10: Error: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Dec 12 12:31:53 jlaptop dovecot: auth-10: Error: Debug: Read auth token secret from /usr/local/var/run/dovecot/auth-token-secret.dat Dec 12 12:32:03 jlaptop postfix/smtpd[9220]: fatal: no SASL authentication mechanisms Dec 12 12:32:04 jlaptop postfix/master[8842]: warning: process /usr/lib/postfix/smtpd pid 9220 exit status 1 Dec 12 12:32:04 jlaptop postfix/master[8842]: warning: /usr/lib/postfix/smtpd: bad command startup -- throttling My test client is thunderbird with smtp connection security "None" and Authentication method "Password, transmitted insecurely". Any ideas what is going wrong? Is there a better way to provide different passdb settings for smtp and imap/pop3? regards, - Jouko

1 0

[Dovecot] Selectively allow non-SSL connections based on userdb
by Trent Lloyd 12 Dec '13

12 Dec '13

Howdy Folks, I am considering transitioning our mail service over to SSL-only. As a transition mechanism, it would make sense to force all new accounts to use SSL, but still allow old accounts to go unencrypted until some transition date passes. I have done some extensive searching but could not figure a mechanism through which I could specify a setting for this in userdb or similar. Does anyone have any ideas that doesn’t involve a post-login script? Thanks, Trent

1 0

[Dovecot] base_dir= problems
by Philippe Lelédy 12 Dec '13

12 Dec '13

Hi I first let base_dir = with it's default value of /var/dovecot. I changed my mind and now I have doveconf -n # 2.1.17: /etc/dovecot/dovecot.conf # OS: OpenBSD 5.4 amd64 ffs base_dir = /var/run/dovecot/ After a few days, imap clients couldn't login. Here the problem Dec 04 17:03:16 imap-login: Fatal: Corrupted SSL parameters file: /var/dovecot/ssl-parameters.dat Dec 04 17:03:16 imap-login: Fatal: Corrupted SSL parameters file: /var/dovecot/ssl-parameters.dat Dec 04 17:03:16 master: Error: mkdir(/var/dovecot) failed: Read-only file system Dec 04 17:03:16 master: Error: safe_mkstemp(/var/dovecot/mounts.tmp.) failed: No such file or directory Dec 04 17:03:16 master: Error: file_dotlock_open(/var/dovecot/instances) failed: No such file or directory Dec 04 17:03:16 ssl-params: Fatal: creat(/var/dovecot/ssl-parameters.dat.tmp) failed: No such file or directory By-pass ln -s /var/run/dovecot /var/dovecot Strange ? Ph. Le.

2 3

[Dovecot] Plugin development - ostream and index cache size
by Philipp Brüll 11 Dec '13

11 Dec '13

Hi, I'm new to this list, so first thanks for the dovecot tool! So far, it has been great to work with. Currently, I'm developing a scrambler plugin for dovecot, that should stores the mails encrypted. To do that, I've created the scrambler_ostream and scrambler_istream that does the encryption and that I hook in the mail storage process. The scrambler_ostream is stacked on top of the output stream of the mail_save_context (mail_save_context->data.output) and the scrambler_istream is attached to the input stream when the virtual function istream_opened in the mail_private struct is called. Basically, the encrypt/decrypt works, but during the process the data size changes slightly. And when I'm doing a FETCH BINARY[] via imap, it results in the error... Cached message size smaller than expected (204 < 208) Error: Corrupted index cache file /home/.../mail/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 1 My guess is, that the FETCH function tries to deliver the unencrypted cache version of the mail (204 bytes) and not the stored version (208 bytes). How can I make dovecot cache the output of my scrambler_ostream or at least disable this caching for testing? I've read already a lot of code, but I've found a hint yet. How does - for example - the zlib plugin handle this issue? I have read the code a couple of times, but still have no clue. Best regards, Philipp

2 1

Re: [Dovecot] pigeonhole openssl s_client
by LEVAI Daniel 11 Dec '13

11 Dec '13

> http://wiki2.dovecot.org/Pigeonhole/ManageSieve/Troubleshooting > > Try the gnutls command line interface: > > gnutls-cli --starttls --print-cert -p 4190 example.com > STARTTLS > Ctrl-D > LOGOUT > > Regards > Daniel Ah, thanks! Pretty dumb of openssl not to be able to connect arbitrary servers... in a useful way, that is. Daniel -- LÉVAI Dániel PGP key ID = 0x83B63A8F Key fingerprint = DBEC C66B A47A DFA2 792D 650C C69B BE4C 83B6 3A8F

1 0

[Dovecot] [Dovecot 2.2.9] mail-filter plugin don't load
by Stanislas SABATIER 11 Dec '13

11 Dec '13

Hello, I'm trying to load the mail-filter plugin (dovecot-2.2.9) with the following option in 10-mail.conf : mail_plugins = $mail_plugins mail_filter But I've got the following error when restarting dovecot : dovecot: imap: Fatal: Plugin 'mail_filter' not found from directory /usr/local/lib/dovecot I reinstalled dovecot-2.2.9 from sources (freeBSD ports) but it did not install the mail-filter library in /usr/local/lib/dovecot Thank you for your help. --------------------------------- Stanislas SABATIER s.sabatier(a)pobox.com ---------------------------------------------------------------

1 0

[Dovecot] OT: Large corporate email systems - Exchange vs open source *nix based
by Charles Marcus 11 Dec '13

11 Dec '13

Hello, There has been some whispers about considering migrating our mail systems to Exchange Server. I want to try to nip this in the bud. I would like to ask for some help with providing some kind of comparison of large(r) commercial companies use of email systems... specifically, those using Microsoft Exchange Server, vs those using open source Linux/Unix based systems, including even commercial *nix groupware based systems like Zimbra, as well as plain mail systems like dovecot, or cyrus or courier. I know that many (if they are smart) Admins that do use Exchange internally will use postfix (or something else linux/unix based) in front of it as their relayhost (for both inbound and outbound), so just counting the number of publicly accessible smtp servers won't be a good gauge. Does anyone know of any decent non-biased studies that have been done, hopefully relatively recently (last few years) that provide such a comparison? Thanks, -- Best regards, */Charles/*

9 10

[Dovecot] restricted dovecot conf
by Goran 11 Dec '13

11 Dec '13

Hi all, I have a simple but well running dovecot configuration attached below. Now I want to change some things. What I need is an IMAP-Server which restricts the user to the following: - no folder createable - no messages deleteable How to get what I want? My Version: Debian x86 Squeeze, Dovecot 1:1.2.15-7. Many thanks in advance! Goran --- protocols = imaps disable_plaintext_auth = yes shutdown_clients = yes log_timestamp = "%Y-%m-%d %H:%M:%S " ssl = yes ssl_cert_file = /etc/ssl/certs/dovecot.pem ssl_key_file = /etc/ssl/private/dovecot.pem mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail mbox_write_locks = fcntl dotlock auth default { mechanisms = plain passdb shadow { } userdb passwd { } }

2 1

Re: [Dovecot] Ubuntu packages and broken link in docs
by Michael Cramer 11 Dec '13

11 Dec '13

these are build from the sources that are automatically build for the debian system mentioned in the wiki http://wiki2.dovecot.org/PrebuiltBinaries#Automatically_Built_Packages (only difference to these are some changes to the build file for version numbers and the changelog file). only building official releases named ...~auto0 packages Zitat von Alan McGinlay - SICS <alanm(a)sics.se>: > On 2013-12-11 13:00, Michael Cramer wrote: >> i uploaded 2.2.9 for ubuntu 12.04 LTS, 12.10, 13.04 and 13.10 to the >> ppa >> >> Zitat von michael(a)bigmichi1.de: >> >> Zitat von Alan McGinlay - SICS <alanm(a)sics.se> >> >> Hi, >> >> Two things: >> >> 1. Does anyone know of a good PPA with updated packages of Dovecot for >> Ubuntu? "For the latest Dovecot for latest Ubuntu LTS see Xiaoka APT >> Repository. (Outdated. Could someone provide a ppa for latest stable >> Dovecot, please?)" >> >> 2. On the http://wiki2.dovecot.org/PrebuiltBinaries#Ubuntu page there >> is a link to a supposedly outdated PPA, the ppa page now redirects to >> an ad for the guys services so should probably be removed. >> >> /Alan >> >> Hi, >> >> In my ppa https://launchpad.net/~bigmichi1 i provide the latest version >> of dovecot for the latest version of Ubuntu. It is build after a >> official release. > > Thanks! I will give it a try on a dev server. Does it follow the debian > split config files layout? Also, which sources are the debs built from? > I would like to try building it my self for comparison.

1 0

Re: [Dovecot] Ubuntu packages and broken link in docs
by michael＠bigmichi1.de 11 Dec '13

11 Dec '13

Zitat von Alan McGinlay - SICS <alanm(a)sics.se> > Hi, > > Two things: > > 1. Does anyone know of a good PPA with updated packages of Dovecot > for Ubuntu? "For the latest Dovecot for latest Ubuntu LTS see Xiaoka > APT Repository. (Outdated. Could someone provide a ppa for latest > stable Dovecot, please?)" > > 2. On the http://wiki2.dovecot.org/PrebuiltBinaries#Ubuntu page > there is a link to a supposedly outdated PPA, the ppa page now > redirects to an ad for the guys services so should probably be > removed. > > /Alan > Hi, In my ppa https://launchpad.net/~bigmichi1 i provide the latest version of dovecot for the latest version of Ubuntu. It is build after a official release. Von meinem Sony Xperia™-Smartphone gesendet Alan McGinlay - SICS <alanm(a)sics.se> schrieb:

3 3

[Dovecot] "Select Inbox" drops connection. IMAP troubleshooting help available?
by Thor Legvold 11 Dec '13

11 Dec '13

Newbie to the list here. I don’t know if this is Dovecot specific, but I can see that my IMAP server is running Dovecot. So far (as a client) I haven’t been able to figure out how to get it to tell me the version number. What I’m trying to get is more detailed info in order to debug an IMAP problem. I’ve been unable to retrieve email since the 27th of November on this specific account. Another user on the same domain/email receives and sends email just fine. Having tried both Apple Mail, Thunderbird, as well as a Telnet terminal connection, I see two problems, but am unaware of what to do from here to verify or fix the problem. First is that the SSL certificate is a self signed one from some local hosting service. Fair enough, I told OS X to trust it (for now), both in Mail and Thunderbird (and Safari). Second is that when logging in via the terminal, I can log in fine, navigate to any folder and read any email on the server - with the exception of the Inbox. Anytime I issue a “Select” or “Examine” command with the “Inbox” as argument, the connection is dropped. E.g.: after logging in, listing folders, navigating around, I do this: a select inbox closed Sonovo:~ Thunder$ and am back at the terminal prompt. If I do an “Email Trace” in CPanel on my server (hosting both my website and IMAP email accounts), I see a long list of emails accepted to my address and in the system, but I cannot seem to access them from any client. There may well be a better list/forum for discussing this kind of thing. I was actually on a mailing list years ago with Mark Crispin himself, but haven’t spoken with him in 10 years or more. I’m not sure where to go for more help/info. I’m not a complete (l)user, but nor am I a guru (tm). Any tips or help is greatly appreciated! Sonovo

2 2

[Dovecot] post-logout scripting
by Jouko Nikula 11 Dec '13

11 Dec '13

Hi all, I found this (http://www.dovecot.org/list/dovecot/2010-January/045717.html) describing how to do a post-logout script. But is this valid anymore? It seems I'm getting error when trying to execute imap process in post-logout script and post logout documentation does not talk about executing imap. I'm trying to umount (virtual) user home directory when user logs out. Thanks, - Jouko

2 2

[Dovecot] undoing a zlib test
by Terry Barnum 10 Dec '13

10 Dec '13

I'm trying to undo a dovecot zlib test and uncompress 6 emails in my Junk mailbox. There are about 25 total in different mailboxes but I thought I'd first start with those in my Junk. I ran: # dsync -v -u terry(a)dop.com -m Junk -o plugin/zlib_save= backup maildir:/path/to/temp/folder which returned without error and backed up my Junk mailbox but didn't uncompress the 6 emails. Am I calling dsync incorrectly to uncompress? zlib is currently not loaded as a plugin. Once I get them uncompressed is doveadm import the correct way to get them back into my Junk mailbox? Something like this? # doveadm -v import -u terry(a)dop.com maildir:/path/to/temp/folder "" mailbox Junk SENTON 2013-12-06 Thanks, -Terry # 2.2.9: /opt/local/etc/dovecot/dovecot.conf # OS: Darwin 11.4.2 x86_64 hfs auth_verbose = yes base_dir = /opt/local/var/run/dovecot/ default_internal_user = _dovecot default_login_user = _dovenull first_valid_uid = 102 last_valid_uid = 105 listen = * mail_gid = 102 mail_location = maildir:/Volumes/mail/vmail/%d/%u mail_uid = 102 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /opt/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { antispam_backend = dspam antispam_debug_target = syslog antispam_dspam_args = --user;%u;--deliver=;--source=error;--signature=%%s antispam_dspam_binary = /opt/local/bin/dspamc antispam_dspam_notspam = --class=innocent antispam_dspam_result_header = X-DSPAM-Result antispam_dspam_spam = --class=spam antispam_signature = X-DSPAM-Signature antispam_signature_missing = move antispam_spam_pattern_ignorecase = junk;spam;junk * antispam_trash_pattern_ignorecase = trash;deleted * mail_log_events = flag_change append delete undelete expunge copy sieve = ~/dovecot.sieve sieve_before = /Volumes/mail/vmail/%d/global/global.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve sendmail_path = /opt/local/sbin/sendmail service auth-worker { user = $default_internal_user } service auth { unix_listener /opt/local/var/spool/postfix/private/auth { group = _postfix mode = 0660 user = _postfix } unix_listener auth-userdb { mode = 0660 user = _vmail } } ssl_cert = </opt/local/etc/ssl/certs/dovecot.cert ssl_key = </opt/local/etc/ssl/private/dovecot.key userdb { args = /opt/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" postmaster_address = postmaster(a)dop.com } protocol imap { mail_max_userip_connections = 50 mail_plugins = " antispam" } Terry Barnum digital OutPost http://www.dop.com

2 2

Re: [Dovecot] Index issue? - SOLVED
by IT geek 31 10 Dec '13

10 Dec '13

They were subscribed in Outlook, but there's no option to set that on the iPad. The solution was to edit the mail account settings on the iPad and specify a root folder "INBOX" (minus quotes). -Mark On 10 December 2013 13:15, Daniel Parthey <d.parthey(a)metaways.de> wrote: > Are all the subfolders subscribed? > > For example Thunderbird doesn't show unsubscribed folders by default. > > Regards > Daniel

1 0

[Dovecot] dsync verbosity, summary of transfer
by Alan McGinlay - SICS 10 Dec '13

10 Dec '13

Hi! I am playing with dsync and trying to fix an issue I have mentioned in another thread (subject: "Re: [Dovecot] Dsync error: Couldn't drop privileges: getgrnam") and feel that dsync could use some additional informational output. It would be particularly helpful while experimenting with a migration if it could output a transfer summary and / or log separately. A summary could be similar to that which imapsync outputs after completion, for example: ++++ Statistics Transfer started on : Thu Dec 5 20:30:05 2013 Transfer ended on : Thu Dec 5 20:32:00 2013 Transfer time : 114.3 sec Messages transferred : 7 Messages skipped : 766 Messages found duplicate on host1 : 0 Messages found duplicate on host2 : 0 Messages void (noheader) on host1 : 0 Messages void (noheader) on host2 : 0 Messages deleted on host1 : 0 Messages deleted on host2 : 9 Total bytes transferred : 71820 (70.137 KiB) Total bytes duplicate host1 : 0 (0.000 KiB) Total bytes duplicate host2 : 0 (0.000 KiB) Total bytes skipped : 10070561 (9.604 MiB) Total bytes error : 0 (0.000 KiB) Message rate : 0.1 messages/s Average bandwidth rate : 0.6 KiB/s Reconnections to host1 : 0 Reconnections to host2 : 0 Memory consumption : 90.5 MiB Biggest message : 39274 bytes Detected 0 errors

1 0

[Dovecot] Dovecot+LDAP lda problem
by Zeljko Culek 10 Dec '13

10 Dec '13

Hello everyone, I need some help with Dovecot+LDAP config and local delivery. We're using Dovecot 2.0.9 on Centos 6.4. Before, we used Qmail with the same LDAP. Our LDAP accounts have the attribute deliveryMode which we used for mailing lists (OK, they are in fact mailing groups rather than lists). When the attribute is set to deliveryMode = nolocal Qmail did not deliver mail to the list mailbox, only to the accounts on the list/group. Now with Dovecot(+postfix) I can't achieve the same behaviour. Can Dovecot be set up not to deliver the mail to the list mailbox if the list has the attribute deliveryMode = nolocal? This is my /etc/dovecot/conf.d/dovecot-ldap.conf.ext hosts = xxx.xxx.xxx.xxx auth_bind = yes dn = cn=admin,dc=nth,dc=ch dnpass = xxxxxxxxxx ldap_version = 3 base = dc=nth,dc=ch #deref = always scope = subtree user_attrs = mail=user user_filter = (|(&(objectclass=inetOrgPerson)(mail=%u))(|(mailAlternateAddress=%u))) pass_attrs = uid=user pass_filter = (&(objectclass=inetOrgPerson)(|(mail=%u)(mailAlternateAddress=%u))) default_pass_scheme = CRYPT Basicaly, I want to make check: if deliveryMode=nolocal > do not deliver to mail=some.mail(a)tld.com (only to mailForwardingAddress) else deliver normally :) Thnx, -- Zeljko Culek IT Department Samurai Digital d.o.o. NTH Group Office Osijek Ivana Gundulica 5 31000 Osijek, Croatia Mobile company: 00385 99 262 2661 [VPN 214] Skype: nthuser128 Email: zeljko.culek(a)nth.ch www.nth.ch

3 5

[Dovecot] Dovecot+LDAP lda problem
by Zeljko Culek 10 Dec '13

10 Dec '13

Hello everyone, I need some help with Dovecot+LDAP config and local delivery. We're using Dovecot 2.0.9 on Centos 6.4. Before, we used Qmail with the same LDAP. Our LDAP accounts have the attribute deliveryMode which we used for mailing lists (OK, they are in fact mailing groups rather than lists). When the attribute is set to deliveryMode = nolocal Qmail did not deliver mail to the list mailbox, only to the accounts on the list/group. Now with Dovecot(+postfix) I can't achieve the same behaviour. Can Dovecot be set up not to deliver the mail to the list mailbox if the list has the attribute deliveryMode = nolocal? This is my /etc/dovecot/conf.d/dovecot-ldap.conf.ext hosts = xxx.xxx.xxx.xxx auth_bind = yes dn = cn=admin,dc=nth,dc=ch dnpass = xxxxxxxxxx ldap_version = 3 base = dc=nth,dc=ch #deref = always scope = subtree user_attrs = mail=user user_filter = (|(&(objectclass=inetOrgPerson)(mail=%u))(|(mailAlternateAddress=%u))) pass_attrs = uid=user pass_filter = (&(objectclass=inetOrgPerson)(|(mail=%u)(mailAlternateAddress=%u))) default_pass_scheme = CRYPT Basicaly, I want to make check: if deliveryMode=nolocal > do not deliver to mail=some.mail(a)tld.com (only to mailForwardingAddress) else deliver normally :) Thnx, Zeljko

1 0

[Dovecot] Index issue?
by IT geek 31 10 Dec '13

10 Dec '13

I've just hastily migrated from Dovecot 1.2.9 to 2.2.9 due to a disk crash. When I say hastily, I literally copied the user's mail data files to the new server and then started the Dovecot service. The trouble is, I now have a user who can see all the subfolders of her inbox in Outlook, but not on her iPad. Do I need to re-index her mail folders? The data is there (as seen by Outlook 2013) and is good, but the iPad mail client only sees the top-level folder. Any thoughts? -Mark

3 2

[Dovecot] Problem with INDEXes and deleting shared folders
by Achim Gottinger 10 Dec '13

10 Dec '13

Hi, I use dovecot 2.1.7 on debian wheezy. I have a bunch of shared folders whom i configured to store the indexe's under the users mail_location/shared/%%u. I configured acl's for those shared folders in an way that all users should be able to add and delete folders (for example "group=buchhaltung keilrwtsx"). Creating folders works fine but if i try to delete such an folder i get the following error. Dec 10 12:03:41 logon-zor dovecot: imap(ag): Debug: Can't rename 'shared/buchhaltung/Test' to 'Trash/Test': one namespace has index dir and another doesn't Of course there is no dovecot.index file in /home/vmail/buchhaltung/mai/.Test but there is one in /home/ag/vmail/mail/shared/buchhaltung/.Test and in /home/ag/vmail/mail/.Trash. Seems dovecot does not honour the shared namespaces index settings when trying to rename that folder. Is there an fix for this issue in 2.1.7 or would upgrade to 2.2.5 (from debian unstable) help? Thanks in advance Achim Gottinger Here are my namespace mail_location etc. settings: mail_home = /home/vmail/%u mail_location = maildir:/home/vmail/%u/mail:INDEX=/home/vmail/%u/mail:INBOX=/home/vmail/%u/mail/.INBOX mail_uid = 998 mail_gid = 998 first_valid_uid = 998 first_valid_gid = 998 mail_shared_explicit_inbox = yes maildir_very_dirty_syncs = yes namespace { list = children location = maildir:/home/vmail/%%u/mail:INDEX=/home/vmail/%u/mail/shared/%%u:INBOX=/home/vmail/%%u/mail/.INBOX prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { inbox = yes location = maildir:/home/vmail/%u/mail:INDEX=/home/vmail/%u/mail:INBOX=/home/vmail/%u/mail/.INBOX prefix = separator = / type = private }

1 1

[Dovecot] Panic: file acl-cache.c
by Helga.Mayer＠uni-hohenheim.de 10 Dec '13

10 Dec '13

Hello, our dovecot mailservice was running smoothly for a long time. Since last week we get the following error message when connecting from the horde/imp webmailer to the public namespace: Panic: file acl-cache.c: line 294 (acl_cache_update): assertion failed: (obj_cache->my_current_rights != &negative_cache_entry) Dovecot and horde/imp are running on seperate hosts. There are no known recent configuration changes, neither on the webmailer nor on the dovecot host. Helga dovecot -n # 1.2.17: /etc/dovecot.conf # OS: Linux 2.6.18-238.9.1.el5 x86_64 Scientific Linux SL release 5.5 (Boron) listen(default): 192.168.0.104:143 127.0.0.1:143 144.41.4.87:143 listen(imap): 192.168.0.104:143 127.0.0.1:143 144.41.4.87:143 listen(pop3): *:110 ssl_listen(default): 144.41.4.28:993 ssl_listen(imap): 144.41.4.28:993 ssl_listen(pop3): 144.41.4.28:995 ssl_cert_file: /etc/ssl/certs/imapd.pem ssl_key_file: /etc/ssl/certs/imapd.pem disable_plaintext_auth(default): no disable_plaintext_auth(imap): no disable_plaintext_auth(pop3): yes login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_max_processes_count: 2048 max_mail_processes: 2048 first_valid_uid: 200 mail_drop_priv_before_exec(default): yes mail_drop_priv_before_exec(imap): yes mail_drop_priv_before_exec(pop3): no mail_executable(default): /afs/hoh/common/etc/mail/bin/acl-groups mail_executable(imap): /afs/hoh/common/etc/mail/bin/acl-groups mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_process_size: 1024 mail_plugins(default): acl imap_acl lazy_expunge metadata imap_annotatemore mail_log mail_plugins(imap): acl imap_acl lazy_expunge metadata imap_annotatemore mail_log mail_plugins(pop3): lazy_expunge mail_log mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 mail_log_max_lines_per_sec: 0 imap_client_workarounds(default): tb-extra-mailbox-sep imap_client_workarounds(imap): tb-extra-mailbox-sep imap_client_workarounds(pop3): namespace: type: private separator: / location: maildir:/maildir/%1n/%u:LAYOUT=fs inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: .EXPUNGED/ location: maildir:/maildir/expunged/%1n/%u:LAYOUT=fs hidden: yes list: no subscriptions: yes namespace: type: shared separator: / prefix: Shared/%%u/ location: maildir:/maildir/%%1n/%%u:LAYOUT=fs list: children namespace: type: public separator: / prefix: Groups/ location: maildir:/maildir/public:LAYOUT=fs list: children namespace: type: public separator: / prefix: .G-EXPUNGED/ location: maildir:/maildir/expunged/public:LAYOUT=fs hidden: yes list: no subscriptions: yes lda: postmaster_address: postmaster(a)uni-hohenheim.de mail_plugins: acl auth default: mechanisms: plain login verbose: yes debug: yes passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/spool/postfix/private/auth-master mode: 384 user: postfix group: postfix plugin: mail_log_events: delete undelete expunge copy mailbox_delete mailbox_rename mail_log_group_events: mail_log_fields: uid box msgid size acl: vfile acl_shared_dict: proxy::acl_dict lazy_expunge: .EXPUNGED/ metadata_dict: proxy:/var/run/dovecot/dict-server:metadata dict: acl_dict: mysql:/etc/dovecot-dict-sql.conf metadata: sqlite:/etc/metadata-dict.conf -- This smoke signal communication (and any attachment/s) is confidential and intended only for the individual(s) or entity named above and to others who have been specifically authorized to receive it. If you are not the intended recipient, please do not read, copy, use or disclose the contents of this communication to others. Please notify the sender that you have received this smoke signal in error, by calling the phone number indicated or by smoke signals, and stamp out the fire (including any attachment/s) subsequently. Thank you.

1 0

[Dovecot] Dovecot - solr - user unknown
by dvm＠rdyn.net 09 Dec '13

09 Dec '13

Hi all, I am running dovecot with solr on centos 6.5. In my dovecotlog i am getting the following error for any user : Dec 09 16:03:22 indexer-worker: Error: User me(a)mydomain.net lookup failed: Unknown user everything else works ok and no mail-issues. I have been searching and searching and really cant figure it out. Probably i overlooked something dumb, I hope someone can help me out here ? would be very appreciated. (if i posted anything wrong sorry this is my first time) Kind regards, Johan. my configs : (dovecot 2.2.9 - solr 4.6 standard install - centos 4.6) --------------- 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.el6.x86_64 x86_64 CentOS release 6.5 (Final) auth_master_user_separator = * auth_mechanisms = PLAIN LOGIN dict { acl = mysql:/etc/dovecot/dovecot-share-folder.conf quotadict = mysql:/etc/dovecot/dovecot-used-quota.conf } first_valid_uid = 2000 last_valid_uid = 2000 listen = * log_path = /var/log/dovecot.log mail_gid = 2000 mail_location = maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/ mail_plugins = quota fts fts_solr mail_uid = 2000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:/%%Lh/Maildir/:INDEX=/%%Lh/Maildir/Shared/%%u prefix = Shared/%%u/ separator = / subscriptions = yes type = shared } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-master-users-password driver = passwd-file master = yes } plugin { acl = vfile acl_shared_dict = proxy::acl auth_socket_path = /var/run/dovecot/auth-master autocreate = INBOX autocreate2 = Sent autocreate3 = Trash autocreate4 = Drafts autocreate5 = Junk autosubscribe = INBOX autosubscribe2 = Sent autosubscribe3 = Trash autosubscribe4 = Drafts autosubscribe5 = Junk fts = solr fts_autoindex = yes fts_solr = break-imap-search url=http://localhost:8983/solr/ quota = dict:user::proxy::quotadict quota_rule = *:storage=1G quota_warning = storage=85%% quota-warning 85 %u quota_warning2 = storage=90%% quota-warning 90 %u quota_warning3 = storage=95%% quota-warning 95 %u sieve = /%Lh/sieve/dovecot.sieve sieve_dir = /%Lh/sieve sieve_global_dir = /var/vmail/sieve sieve_global_path = /var/vmail/sieve/dovecot.sieve } protocols = pop3 imap sieve service auth { unix_listener /var/spool/postfix/dovecot-auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { group = vmail mode = 0666 user = vmail } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { process_limit = 500 service_count = 1 } service pop3-login { service_count = 1 } service quota-warning { executable = script /usr/local/bin/dovecot-quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } } ssl = required ssl_cert = </etc/pki/tls/certs/rmac.pem ssl_key = </etc/pki/tls/private/rmac.key userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } protocol lda { auth_socket_path = /var/run/dovecot/auth-master lda_mailbox_autocreate = yes log_path = /var/log/sieve.log mail_plugins = quota fts fts_solr sieve autocreate postmaster_address = root } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = quota fts fts_solr imap_quota } protocol pop3 { mail_plugins = quota fts fts_solr pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } ----- dovecot-ldap.conf hosts = 127.0.0.1:389 ldap_version = 3 auth_bind = yes dn = cn=vmail,dc=mydomain,dc=net dnpass = mypassword base = o=domains,dc=mydomain,dc=net scope = subtree deref = never # Below two are required by command 'doveadm mailbox ...' iterate_attrs = mail=user iterate_filter = (&(objectClass=mailUser)(accountStatus=active)(enabledService=mail)) user_filter = (&(objectClass=mailUser)(accountStatus=active)(enabledService=mail)(enabledService=%Ls%Lc)(|(mail=%u)(&(enabledService=shadowaddress)(shadowAddress=%u)))) user_attrs = mail=user,homeDirectory=home,=mail=maildir:~/Maildir/,mailQuota=quota_rule=*:bytes=%$ pass_filter = (&(objectClass=mailUser)(accountStatus=active)(enabledService=mail)(enabledService=%Ls%Lc)(|(mail=%u)(&(enabledService=shadowaddress)(shadowAddress=%u)))) pass_attrs = mail=user,userPassword=password default_pass_scheme = CRYPT ------------------- -- This email was Virus checked by UTM 9. http://www.astaro.com

1 0

[Dovecot] Question regarding quotas (is this a bug or intended behavior) ?
by Gilles Chauvin 09 Dec '13

09 Dec '13

Hi, I was wondering if this is a normal behavior (test was made using Dovecot v2.2.9). In my config, quotas are configured as follows: plugin { quota = dict:Userquota::file:%h/dovecot-quota quota_rule = *:storage=1G quota_rule2 = Trash:ignore } # doveadm mailbox status -u my_user "messages vsize" '*' Trash messages=4997 vsize=229535631 Drafts messages=0 vsize=0 Sent messages=0 vsize=0 Junk messages=0 vsize=0 INBOX messages=0 vsize=0 # doveadm -f flow quota get -u my_user Quota name=Userquota Type=STORAGE Value=0 Limit=1048576 %=0 Quota name=Userquota Type=MESSAGE Value=0 Limit=- %=0 The 4997 mails in the Trash mailbox are ignored as desired, but now, if I have the following case: # doveadm mailbox status -u my_user "messages vsize" '*' Trash messages=0 vsize=0 Trash/TEST messages=4997 vsize=229535631 Drafts messages=0 vsize=0 Sent messages=0 vsize=0 Junk messages=0 vsize=0 INBOX messages=0 vsize=0 (As you can see mails were moved to a Trash/TEST mailbox) # doveadm -f flow quota get -u my_user Quota name=Userquota Type=STORAGE Value=220918 Limit=1048576 %=21 Quota name=Userquota Type=MESSAGE Value=4997 Limit=- %=0 I tried to add the following quota_rule: quota_rule3 = Trash/*:ignore But this doesn't fix anything. Do you have any idea about why this is not working ? Thanks, Regards, Gilles.

2 5

[Dovecot] Use Replication plugin to do a backup (one-direction sync)
by Francesco Barresi 09 Dec '13

09 Dec '13

Hello, I have a setup where I need to have Server A (dovecot 2.1.7) replicated on a Server B (dovecot 2.1.7). I know that I can do a per user backup with: doveadm -D backup -u %u remote:mailmirror@serverB I would like to use Notify/Replication to backup only when there's something new. I don't understad if the Replication plugin can be used to do a backup server, or it's only of for two-way sync? My question is: It's possible to use Replication to do a backup (one-direction sync)? Thanks Francesco

1 0

[Dovecot] backup mdbox best strategy
by Claus 09 Dec '13

09 Dec '13

Hello, i have to backup (tape library) a mailsystem with about 300.000 Mailboxes on 2 backends. Summary of all mailboxes are 2 TByte. The mailstore is mdbox. Is it save to do a simple filesystem backup (full and incremental) with backupsoftware? What is the prefered strategy to do a backup for desaster recovery (mailsystem crash) and restoring single usermailboxes? Regards, Claus

5 9

[Dovecot] Expire plugin - empty expires table
by Peter Šori 09 Dec '13

09 Dec '13

Hello, Dovecot does not fill expires table when moving messages to Trash or Junk folder. I looked all over mailing list and googled around and cannot find what could be wrong - pleas help :) Dict works for quota, so I presume connection to mysql is not a problem - mailuser has Select,Insert,Update,Delete privileges over quota and expires table (log below for deleting message) dovecot log does not show any problems, not even with mail_debug. doveadm -A works ____________________________________________________________________________ ________________________ dovecot -n # 2.2.6: /etc/dovecot/dovecot.conf # OS: Linux 3.10.17-gentoo x86_64 Gentoo Base System release 2.2 xfs auth_mechanisms = plain login dict { expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } hostname = ****(a)****.**** listen = ************* login_greeting = ***** ready. mail_access_groups = vmail mail_attachment_dir = /data/vmail/attachments mail_attachment_fs = sis-queue /data/vmail/attachments/queue:posix mail_attachment_hash = %{sha256} mail_location = mdbox:/data/vmail/storage/%d/%n/:ALT=/data/vmail/altstorage/%d/%n/:INDEX=/da ta/vmail/indexes/%d/%n/ mail_plugins = " expire quota zlib mail_log notify" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_preallocate_space = yes mdbox_rotate_interval = 1 days namespace Unwanted { hidden = no inbox = no list = yes location = maildir:/data/vmail/unwanted/%d/%n/ mailbox Ham { auto = subscribe } mailbox Spam { auto = subscribe } prefix = Unwanted. separator = . subscriptions = yes type = private } namespace inbox { hidden = no inbox = yes list = yes location = mdbox:/data/vmail/storage/%d/%n/:ALT=/data/vmail/altstorage/%d/%n/:INDEX=/da ta/vmail/indexes/%d/%n/ mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Folders { auto = subscribe } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { expire = Trash 1 Trash.* 1 Junk 2 expire_dict = proxy::expire mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid from subject, size, vsize, flags quota = dict:User quota::proxy::quota quota_exceeded_message = Quota exceeded (mailbox is full) quota_grace = 10%% quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_rule3 = Junk:ignore quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=85%% quota-warning 85 %u quota_warning3 = storage=70%% quota-warning 70 %u sieve = /data/vmail/sieve/%d/%n/.dovecot.sieve sieve_before = /data/vmail/sieve/before.sieve sieve_default = /data/vmail/sieve/default.sieve sieve_dir = /data/vmail/sieve/%d/%n/sieve sieve_global_dir = /data/vmail/sieve/ zlib_save = bz2 zlib_save_level = 9 } postmaster_address = postmaster(a)fingerprints.si protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service dict { unix_listener dict { group = vmail mode = 0660 } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/bin/dovecot-quota-warning.sh unix_listener quota-warning { mode = 0666 user = vmail } user = vmail } ssl_cert = </etc/ssl/certs/san_*****.****-2048.crt ssl_key = </etc/ssl/private/san_*****.****-2048.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = expire sieve zlib } protocol imap { mail_plugins = " expire quota zlib mail_log notify expire imap_quota quota" } protocol sieve { managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date } ____________________________________________________________________________ ________________________ dovecot-dict-sql.conf.ext connect = host=127.0.0.1 dbname=mailserver user=mailuser password=************************* map { pattern = priv/quota/storage table = quota username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota username_field = username value_field = messages } map { pattern = shared/expire/$user/$mailbox table = expires value_field = expire_stamp fields { username = $user mailbox = $mailbox } } ____________________________________________________________________________ ________________________ dovecot-sql.conf.ext driver = mysql connect = host=127.0.0.1 dbname=mailserver user=mailuser password=************************* default_pass_scheme = PLAIN-MD5 iterate_query = SELECT email AS user FROM virtual_users password_query = SELECT email AS user, password, \ uid AS userdb_uid, gid AS userdb_gid, \ concat('*:bytes=', quota_bytes) AS userdb_quota_rule \ FROM virtual_users WHERE email = '%u' user_query = SELECT uid, gid, \ CONCAT('/data/vmail/storage/',CONCAT(SUBSTRING_INDEX(email,'@',-1),'/',SUBST RING_INDEX(email,'@',1))) AS home, \ CONCAT('*:bytes=', quota_bytes) AS quota_rule \ FROM virtual_users WHERE email = '%u' ____________________________________________________________________________ ________________________ MYSQL: +-----------+------------+-------------+------------+----------------+------ ---------------+------------------------------------------------------------ ----------------------------------+-------------+ | Host | Db | User | Table_name | Grantor | Timestamp | Table_priv | Column_priv | +-----------+------------+-------------+------------+----------------+------ ---------------+------------------------------------------------------------ ----------------------------------+-------------+ | 127.0.0.1 | mailserver | mailuser | quota | root@localhost | 2013-12-06 02:14:57 | Select,Insert,Update,Delete | | | 127.0.0.1 | mailserver | mailuser | expires | root@localhost | 2013-12-08 05:49:42 | Select,Insert,Update,Delete | | +-----------+------------+-------------+------------+----------------+------ ---------------+------------------------------------------------------------ ----------------------------------+-------------+ mysql> describe expires; +--------------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +--------------+--------------+------+-----+---------+-------+ | username | varchar(75) | NO | PRI | NULL | | | mailbox | varchar(255) | NO | PRI | NULL | | | expire_stamp | int(11) | NO | | NULL | | +--------------+--------------+------+-----+---------+-------+ mysql> select * from expires; Empty set (0.00 sec) MYSQL LOG: 1 Query SELECT email AS user, password, uid AS userdb_uid, gid AS userdb_gid, concat('*:bytes=', quota_bytes) AS userdb_quota_rule FROM virtual_users WHERE email = '*********************' 2 Connect mailuser@************* on mailserver 2 Query BEGIN 1 Query SELECT uid, gid, CONCAT('/data/vmail/storage/',CONCAT(SUBSTRING_INDEX(email,'@',-1),'/',SUBST RING_INDEX(email,'@',1))) AS home, CONCAT('*:bytes=', quota_bytes) AS quota_rule FROM virtual_users WHERE email = '*********************' 2 Query UPDATE quota SET bytes=bytes-15989,messages=messages-1 WHERE username = '*********************' 2 Query COMMIT 2 Query SELECT bytes FROM quota WHERE username = '*********************' 2 Query SELECT messages FROM quota WHERE username = '*********************' 2 Query SELECT bytes FROM quota WHERE username = '*********************' 2 Query BEGIN 2 Query UPDATE quota SET bytes=bytes+16025,messages=messages+1 WHERE username = '*********************' 2 Query COMMIT 2 Query SELECT bytes FROM quota WHERE username = '*********************' 2 Query SELECT messages FROM quota WHERE username = '*********************'

2 2

[Dovecot] [PATCH] lib-sql/driver-mysql.c - Add support for enabling MYSQL_OPT_SSL_VERIFY_SERVER_CERT
by Gareth Palmer 09 Dec '13

09 Dec '13

Hello, The following patch adds support for enabling MYSQL_OPT_SSL_VERIFY_SERVER_CERT. It makes the mysql client library check that the commonName in the server's SSL certificate matches the host name provided to mysql_real_connect() and aborts the connection if the name doesn't match. An example connect string would look something like: connect = ... ssl-ca=/path/to/ca.cert ssl-verify-server-cert=yes By default the mysql client library does not perform this check.

3 7

[Dovecot] dovecot.index-Errors with multiple IMAP client access in Dovecot 2.2
by Martin Rabl 08 Dec '13

08 Dec '13

Hello list, I hope you can help me! My self-compiled dovecot 2.2.6 (and the two minor versions before, too) throws that errors: Nov 28 18:29:00 mailserv dovecot: imap(martin(a)example.com): Error: Transaction log /srv/vmail/example.com/martin/Maildir/dovecot.index.log: duplicate transaction log sequence (25) Nov 28 18:29:00 mailserv dovecot: imap(martin(a)example.com): Error: /srv/vmail/example.com/martin/Maildir/dovecot.index log position went backwards (24,40 < 25,10028) ... and so on ... duplicate transaction log sequences and backwards gone log positions, and this always, when I use at least two IMAP clients at the same time (better: the two clients are online and logged in at the same time). That happens only with one user (me ;-) ), the other about 15 users on this server are having no problems. What I see: the clients are bothering each other, but I don't know, why. I thought about the used reiserfs filesystem on the server, but there were no problems with 1.2 on the same server. Some words about my client setup: I use Thunderbird and iPhone at the same time, and as a third client on the same Server there is a Thunderbird instance at my company, which runs parallel to the other two. Seems to be weired, but isn't really (IMHO ;-) ). Sometimes there are two TBs at the same mailbox, sometimes only the iPhone and a TB, sometimes all three. This runs quite good for long time with dovecot 1.2 and 2.1.x (the last one at my company in a similary setup with more users and several clients at the same time). Maybe there is an error by using "my" build configurations (I think, not)? ---- configures ------------------- ./configure \ --prefix=/usr/local \ --with-sql \ --with-ssl \ --with-mysql ----------------------------------- Here are my dovecot.conf (only the changes of defaults) - maybe there is a misconfiguration? ---- dovecot.conf ----------------- # 2.2.6: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-028stab101.1 x86_64 Ubuntu 10.04.4 LTS reiserfs auth_master_user_separator = * auth_mechanisms = plain login auth_socket_path = /usr/local/var/run/dovecot/auth-master default_internal_user = vmail default_login_user = vmail dict { acl = mysql:/etc/dovecot/dovecot-dict-acl-sql.conf.ext } disable_plaintext_auth = no imap_capability = +NAMESPACE imap_client_workarounds = delay-newmail tb-lsub-flags tb-lsub-flags tb-extra-mailbox-sep listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c mail_access_groups = vmail mail_location = maildir:/srv/vmail/%d/%n/Maildir mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify namespace { list = yes location = maildir:%%Lh/Maildir/:INDEX=%%Lh/shared-idx/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { hidden = no list = yes location = maildir:/srv/vmail/public prefix = public/ separator = / subscriptions = no type = public } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl autocreate = Trash autocreate2 = Spam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Spam autosubscribe3 = Sent autosubscribe4 = Drafts sieve = ~/.dovecot.sieve sieve_after = /srv/vmail/sieve/after.sieve sieve_before = /srv/vmail/sieve/before.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_dir = /srv/vmail/sieve sieve_global_path = /srv/vmail/sieve/globalsieverc } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh postmaster_address = postmaster@%d protocols = imap pop3 quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service imap { process_limit = 2048 vsz_limit = 256 M } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = " sieve" } protocol imap { mail_plugins = acl imap_acl } protocol sieve { managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags } local 1.2.3.4 { ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem } ----------------------------------- Thank you very much for your time and help! Greetings, Martin

2 1

[Dovecot] shared folder - ACL
by Héctor Moreno Blanco 08 Dec '13

08 Dec '13

Hello everyone, I've trying to configure shared folders in dovecot 2.1.6 without success. My configuration is: mail_plugins = quota autocreate mail_log notify acl ... plugin { ... acl_shared_dict = file:/etc/dovecot/shared-mailboxes.db ... } Protocol imap { ... mail_plugins = imap_quota imap_acl ... } When I try to set acl to a folder: a02 setacl inbox.test1 user1 lr a02 BAD Error in IMAP command SETACL: ACLs disabled. In the logs, I can see: dovecot: imap(testing_ddfr): Debug: acl: No acl setting - ACLs are disabled What am I missing? Thank you very much in advanced. Kind regards. Héctor Moreno Blanco. P Please consider the environment before printing this e-mail. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________

3 3

[Dovecot] imap list response has an extra field on some mailboxes.
by Kui Zhang 08 Dec '13

08 Dec '13

Hello, per rfc3501 7.2.2. LIST Response Contents: name attributes hierarchy delimiter name Dovecot: 2.1.16 /usr/lib/dovecot/imap -u user(a)domain.tld list "" "*" Most responses are correct. But some appears to not be. """ * LIST (\HasNoChildren) "/" {117} path/to/"part_mailbox_name" other_parts * LIST (\HasNoChildren) "/" {10} "test" box """ char after {117} appears to be \n. All affected mailboxes appears to have ' " ' in mailbox name. And the number between '{' '}' appears to be the length of the path. Anyone ran into this issues before? If so, how to fix it? Is it a bug? Other rfc I should read? Thanks Kui.Z

2 1

[Dovecot] Panic in indexer-worker
by Michael Kliewe 08 Dec '13

08 Dec '13

Hi, I did a fresh installation of 2.2.9 in my test environment and enabled fts_autoindex=yes. I'm using a solr-server for FTS. I got this error, just once until now: _=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_= ==> dovecot-lmtp-errors.log <== Dec 03 16:15:06 lmtp(30601, username(a)domain.de) Error: Timeout (29s) while waiting for lock for transaction log file /maildata/domain.de/username/maildir/dovecot.list.index.log ==> dovecot-lmtp.log <== Dec 03 16:15:06 lmtp(30601, username(a)domain.de) Info: h2jGC1j1nVKJdwAAwaC1kQ: sieve: msgid=<20131203151436.962C06B6E9(a)monitoring01.domain.de>: stored mail into mailbox 'Trash' Dec 03 16:15:06 lmtp(30601): Info: Disconnect from 10.0.0.3: Successful quit ==> dovecot.log <== Dec 03 16:15:06 indexer-worker(username(a)domain.de): Panic: file http-client-request.c: line 521 (http_client_request_send_more): assertion failed: (req->payload_input != NULL) Dec 03 16:15:06 indexer-worker(username(a)domain.de): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x66ab1) [0x7fc60fe2eab1] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x66b8e) [0x7fc60fe2eb8e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fc60fdea3ce] -> /usr/local/lib/dovecot/libdovecot.so.0(http_client_request_send_more+0x2ed) [0x7fc60fe0406d] -> /usr/local/lib/dovecot/libdovecot.so.0(http_client_request_send+0x1e1) [0x7fc60fe042a1] -> /usr/local/lib/dovecot/libdovecot.so.0(http_client_connection_next_request+0x120) [0x7fc60fe06720] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3f6b7) [0x7fc60fe076b7] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xbf) [0x7fc60fe3e9af] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x94) [0x7fc60fe3f7d4] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fc60fe3e628] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3bb3f) [0x7fc60fe03b3f] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_end+0x61) [0x7fc60f1d5421] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x4388) [0x7fc60f1d2388] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_deinit+0x29) [0x7fc60f3dfd29] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xbb7c) [0x7fc60f3e4b7c] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc982) [0x7fc60f3e5982] -> /usr/local/lib/dovecot/lib10_quota_plugin.so(+0xb584) [0x7fc60f5f6584] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x90927) [0x7fc61012a927] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x3f) [0x7fc6101162cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit+0xe) [0x7fc61011636e] -> dovecot/indexer-worker [username(a)domain.de Trash]() [0x4024f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7fc60fe3ea87] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7fc60fe3f817] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fc60fe3e628] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fc60fdef5c3] -> dovecot/indexer-worker [username(a)domain.de Trash](main+0xe3) [0x401f03] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7fc60fa21de5] -> dovecot/indexer-worker [username(a)domain.de Trash]() [0x401fc2] Dec 03 16:15:13 indexer: Error: Indexer worker disconnected, discarding 1 requests for username(a)domain.de Dec 03 16:15:13 indexer-worker(username(a)domain.de): Fatal: master: service(indexer-worker): child 30611 killed with signal 6 (core dumped) _=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_= This happend when LMTP received a mail, and because of fts_autoindex=yes it should be sent to the solr server. Is this normal when waiting for lock on transaction log file times out, or should there be something more graceful, maybe just skip it or so? I already tried to reproduce, but I cannot. I will check the logfiles if it happens again. Regards Michael

2 1

[Dovecot] Multi-master Replication?
by Pizza Napoletana 08 Dec '13

08 Dec '13

Will the replication method described at http://wiki2.dovecot.org/Replication support a master/master/master configuration to keep three replicas in sync? Thanks

2 1

[Dovecot] file descriptor errors
by Christian Rößner 08 Dec '13

08 Dec '13

Hi, I use dovecot 2.2.9 on Gentoo Linux and I get lots of these erors in my log file: Dec 4 08:53:37 mx dovecot: auth: Error: close failed in file object destructor: Dec 4 08:53:37 mx dovecot: auth: Error: IOError: [Errno 9] Bad file descriptor What could cause these error messages? My mailboxes are stored on an ext4 filesystem: /dev/vdb1 on /srv/mail type ext4 (rw,noatime) doveconf -n: # OS: Linux 3.11.2-hardened x86_64 Gentoo Base System release 2.2 ext4 auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_access_groups = mail mail_attachment_dir = /srv/mail/copymail/attachments mail_gid = mail mail_location = maildir:/srv/mail/virtual/%d/%n mail_plugins = quota acl zlib mail_log notify mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk-E-Mail { auto = subscribe special_use = \Junk } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. } passdb { args = /usr/local/sbin/ispcp-decrypt.py driver = checkpassword } plugin { acl = vfile acl_shared_dict = file:/srv/mail/virtual/shared-mailboxes.db quota = dict:User quota::file:/srv/mail/virtual/%d/%n/dovecot-quota quota_rule = *:storage=300M:messages=20000 quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster(a)deltaweb.de protocols = imap pop3 lmtp sieve service auth-worker { extra_groups = ssl-cert unix_listener auth-worker { mode = 0600 user = vmail } user = vmail } service auth { extra_groups = ssl-cert unix_listener /var/spool/postfix.relay/private/auth { group = postfix mode = 0660 user = postfix } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0660 user = vmail } user = vmail } service config { unix_listener config { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = ::1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl_cert = </etc/ssl/certs/mx_deltaweb_de.crt ssl_key = </etc/ssl/private/mx_deltaweb_de.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = quota acl zlib mail_log notify sieve } protocol lda { mail_plugins = quota acl zlib mail_log notify sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = quota acl zlib mail_log notify imap_quota imap_acl imap_zlib } Thanks in advance -Christian Rößner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

3 4

[Dovecot] Dovecot readable compressed mail archive
by Dave Hall 08 Dec '13

08 Dec '13

Hello. Is Dovecot able to create and/or read any sort of compressed mail archive? We have a large installation with a few users who need to keep a large amount of email available. With maildir this means a large number of individual files, leading to additional load on our backup process. Even using a compressed mbox file as an archive would help, but only if Dovecot is able to interact with this file seamlessly while keeping current email in the maildir format. Please pardon if this is old business, but I haven't been able to find any reference to it by searching. Thanks. -Dave -- Dave Hall System Administrator Computer Science Binghamton University davehall(a)cs.binghamton.edu 607-760-2328 (Cell) 607-777-4641 (Office)

3 2

[Dovecot] imap crash 2.2.9 hg
by Oli Schacher 08 Dec '13

08 Dec '13

Hi Timo With dovecot built from the latest 2.2.9 hg (342f6962390e) we get imap crashes. This only affects one account which is used by multiple clients. The first few logins seem to work ok, but after a few seconds the log is flooded with Dec 5 13:43:10 team dovecot: imap-login: Login: user=<sales(a)example.com>, method=PLAIN, rip=1.2.3.4, lip=5.6.7.8, mpid=27923, TLS, session=<GeNN38jsHgBNbZEi> Dec 5 13:43:10 team dovecot: imap(sales(a)example.com): Fatal: master: service(imap): child 27923 killed with signal 11 (core dumped) Dec 5 13:43:11 team dovecot: imap-login: Login: user=<sales(a)example.com>, method=PLAIN, rip=1.2.3.4, lip=5.6.7.8, mpid=27925, TLS, session=<NNVS38jsnwBNbZEi> Dec 5 13:43:11 team dovecot: imap(sales(a)example.com): Fatal: master: service(imap): child 27925 killed with signal 11 (core dumped) Dec 5 13:43:11 team dovecot: imap-login: Login: user=<sales(a)example.com>, method=PLAIN, rip=1.2.3.4, lip=5.6.7.8, mpid=27927, TLS, session=<8LxX38jsAgBNbZEi> Dec 5 13:43:11 team dovecot: imap(sales(a)example.com): Fatal: master: service(imap): child 27927 killed with signal 11 (core dumped) [...] messagelog meanwile gets floods of: imap[29173]: segfault at 60 ip 00007f104c160f40 sp 00007fff935a0f58 error 4 in libdovecot-storage.so.0.0.0[7f104c095000+10d000] imap[29175]: segfault at 60 ip 00007fb7247eff40 sp 00007fff8a949578 error 4 in libdovecot-storage.so.0.0.0[7fb724724000+10d000] imap[29177]: segfault at 60 ip 00007f59e4f5df40 sp 00007fff70e884b8 error 4 in libdovecot-storage.so.0.0.0[7f59e4e92000+10d000] imap[29179]: segfault at 60 ip 00007fdda0e68f40 sp 00007fffd3576498 error 4 in libdovecot-storage.so.0.0.0[7fdda0d9d000+10d000] imap[29181]: segfault at 60 ip 00007f60d774af40 sp 00007fffc249aee8 error 4 in libdovecot-storage.so.0.0.0[7f60d767f000+10d000] imap[29183]: segfault at 60 ip 00007fce0da4ff40 sp 00007fff33ff92f8 error 4 in libdovecot-storage.so.0.0.0[7fce0d984000+10d000] imap[29185]: segfault at 60 ip 00007f2e4414ef40 sp 00007fff5888ab28 error 4 in libdovecot-storage.so.0.0.0[7f2e44083000+10d000] imap[29187]: segfault at 60 ip 00007fb0e6d3ef40 sp 00007fff0ed60c58 error 4 in libdovecot-storage.so.0.0.0[7fb0e6c73000+10d000] imap[29189]: segfault at 60 ip 00007f77c8292f40 sp 00007fff4d14bc08 error 4 in libdovecot-storage.so.0.0.0[7f77c81c7000+10d000] imap[29197]: segfault at 60 ip 00007f8366108f40 sp 00007fffd2e060a8 error 4 in libdovecot-storage.so.0.0.0[7f836603d000+10d000] [...] The user with the client on ip 1.2.3.4 tells me he doesn't see any errors in his outlook client, so maybe this crash only affects additional background connections. OS: Centos 6.5, 64 bit (gdb) bt full #0 0x00007f6fdcb9ef40 in mail_index_view_is_inconsistent () from /usr/lib64/dovecot/libdovecot-storage.so.0 No symbol table info available. #1 0x00007f6fdcb4f73b in mailbox_is_inconsistent () from /usr/lib64/dovecot/libdovecot-storage.so.0 No symbol table info available. #2 0x00000000004176dc in client_send_box_error () No symbol table info available. #3 0x0000000000411c46 in cmd_select_full () No symbol table info available. #4 0x0000000000416d6d in command_exec () No symbol table info available. #5 0x0000000000415e90 in ?? () No symbol table info available. #6 0x0000000000415f7d in ?? () No symbol table info available. #7 0x00000000004161fd in client_handle_input () No symbol table info available. #8 0x000000000041656f in client_input () No symbol table info available. #9 0x00007f6fdc87a0c6 in io_loop_call_io () from /usr/lib64/dovecot/libdovecot.so.0 No symbol table info available. #10 0x00007f6fdc87b187 in io_loop_handler_run () from /usr/lib64/dovecot/libdovecot.so.0 No symbol table info available. #11 0x00007f6fdc87a038 in io_loop_run () from /usr/lib64/dovecot/libdovecot.so.0 No symbol table info available. #12 0x00007f6fdc828e43 in master_service_run () from /usr/lib64/dovecot/libdovecot.so.0 No symbol table info available. #13 0x000000000041fd58 in main () No symbol table info available. Possibly related to recent change 9946079253c4/"imap: If SELECT fails with "mailbox is inconsistent", disconnect client. (Plus related cleanups.)" ? Is this "mailbox_is_inconsistent" call something I need to worry about? Reverting back to 2.2.7 doesn't show any errors for the affected account. Thanks Oli -- message transmitted on 100% recycled electrons

2 1

Re: [Dovecot] zlib config questions
by Richard Platel 08 Dec '13

08 Dec '13

You only need to add the zlib plugin to mail_plugins once. As far as I know, there's no indication in the logs that mail is being compressed, and the filename isn't modified to indicate that it's compressed, but, of course, the files are zlib data on disk. One gotcha if you're using maildir is, if you're planning to compress old mail, make sure that the S= and W= sizes in the filenames are correct, otherwise dovecot errors and closes the client session, and it can't repair the filename on it's own. On Dec 6, 2013, at 12:51 AM, dovecot-request(a)dovecot.org wrote: > Message: 6 > Date: Thu, 5 Dec 2013 13:55:40 -0800 > From: Terry Barnum <terry(a)dop.com> > To: Dovecot Mailing List <dovecot(a)dovecot.org> > Subject: [Dovecot] zlib config questions > Message-ID: <EF7F46D0-DE03-4B11-85ED-D669DE78D931(a)dop.com> > Content-Type: text/plain; charset=us-ascii > > After nearly running out of space I swapped in larger disks and then saw the recent threads about zlib compression. Unfortunately I'm still confused after reading <http://wiki2.dovecot.org/Plugins/Zlib>. > > In order to compress new email being stored do I only need to change > > 10-mail.conf to this: > mail_plugins = $mail_plugins zlib > > and 90-plugin.conf to this: > plugin { > zlib_save_level = 6 > zlib_save = gz > ... > > Or do I need to instead (or also?) add it to the list of plugins in 20-imap.conf? > > A simple 'sudo doveadm reload' to enable? > > Once enabled, is there an indication in the logs that compression is taking place? > > Do new mail files have a suffix like .Z to indicate they've been compressed? > > Any gotchas to be aware of? > > I'm running macports dovecot 2.2.5. > > Thanks for any help. > > -Terry > > Terry Barnum > digital OutPost > http://www.dop.com

6 7

[Dovecot] No Dovecot 2.2.9 on OpenBSD 5.4 amd64
by Philippe Lelédy 08 Dec '13

08 Dec '13

Hi, First I have this warning when configuring: configure: WARNING: sys/ucred.h: present but cannot be compiled configure: WARNING: sys/ucred.h: check for missing prerequisite headers? configure: WARNING: sys/ucred.h: see the Autoconf documentation configure: WARNING: sys/ucred.h: section "Present But Cannot Be Compiled" configure: WARNING: sys/ucred.h: proceeding with the compiler's result configure: WARNING: ## ---------------------------------- ## configure: WARNING: ## Report this to dovecot(a)dovecot.org ## configure: WARNING: ## ---------------------------------- ## So I do ! Second, make builds fine, but doveconf not: doveconf -n # 2.2.9: /etc/dovecot/dovecot.conf doveconf: Fatal: pool_system_realloc(536870912): Out of memory Because I can't run doveconf, I give the only information I can get dovecot --version 2.2.9 and dovecot --build-options Build options: ioloop=kqueue notify=kqueue ipv6 openssl io_block_size=8192 Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail SQL drivers: Passdb: bsdauth checkpassword passwd passwd-file Userdb: checkpassword passwd prefetch passwd-file Install prefix . : /usr/local File offsets ... : 64bit I/O polling .... : kqueue I/O notifys .... : kqueue SSL ............ : yes (OpenSSL) GSSAPI ......... : no passdbs ........ : static passwd passwd-file checkpassword bsdauth : -shadow -pam -sia -ldap -sql -vpopmail userdbs ........ : static prefetch passwd passwd-file checkpassword : -ldap -sql -vpopmail -nss SQL drivers .... : : -pgsql -mysql -sqlite Full text search : squat : -lucene -solr Ph. Le.

2 1

[Dovecot] bug report: doveadm assertion failure "mail_index_map_lookup_seq_range"
by email-from-bobby 08 Dec '13

08 Dec '13

A negated subject search on an empty folder causes an assertion failure in doveadm. To reproduce: bash-3.2# doveadm mailbox create -u ephraim "Freshly Empty" bash-3.2# doveadm search -u ephraim mailbox "Freshly Empty" NOT subject '***JUNK MAIL***' doveadm(ephraim): Panic: file mail-index-map.c: line 548 (mail_index_map_lookup_seq_range): assertion failed: (first_uid <= last_uid\ ) doveadm(ephraim): Error: Raw backtrace: 2 libdovecot.0.dylib 0x0000000100347463 default_fatal_handler + 486 -> 3 \ libdovecot.0.dylib 0x00000001003472c0 default_fatal_handler + 67 -> 4 libdovecot.0.dylib 0x000\ 0000100347705 i_fatal + 0 -> 5 libdovecot-storage.0.dylib 0x00000001002a799f mail_index_map_lookup_seq_range + 309 -> 6 \ libdovecot-storage.0.dylib 0x00000001002b6d4f mail_index_lookup_seq_range + 12 -> 7 lib20_fts_plugin.so \ 0x00000001003fe325 fts_search_lookup + 3307 -> 8 lib20_fts_plugin.so 0x00000001003fddfb fts_search_lookup + 1985 -\ > 9 lib20_fts_plugin.so 0x00000001003fd6e2 fts_search_lookup + 168 -> 10 lib20_fts_plugin.so 0x00\ 000001003ff148 fts_mailbox_allocated + 1139 -> 11 doveadm 0x00000001001dd3d2 doveadm_mail_iter_init + 1\ 99 -> 12 doveadm 0x00000001001df3ce cmd_search_run + 138 -> 13 doveadm 0x0\ 0000001001d94f9 doveadm_mail_next_user + 196 -> 14 doveadm 0x00000001001d9ad1 doveadm_mail_try_run + 77\ 6 -> 15 doveadm 0x00000001001e1a09 main + 1150 -> 16 libdyld.dylib 0x00007fff915\ ba5fd start + 1 -> 17 ??? 0x0000000000000009 0x0 + 9 Abort trap: 6 bash-3.2# A positive search is no problem: bash-3.2# doveadm search -u ephraim mailbox "Freshly Empty" subject '***JUNK MAIL***' bash-3.2# Version and configuration info: bash-3.2# /Applications/Server.app/Contents/ServerRoot/usr/sbin/dovecotd --version 2.2.5 bash-3.2# /Applications/Server.app/Contents/ServerRoot/usr/sbin/dovecotd -n # 2.2.5: /Library/Server/Mail/Config/dovecot/dovecot.conf # OS: Darwin 13.0.0 x86_64 hfs auth_mechanisms = cram-md5 login apop plain digest-md5 auth_realms = mail.vishniac.com auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %n debug_log_path = /Library/Logs/Mail/mail-debug.log default_internal_user = _dovecot default_login_user = _dovenull disable_plaintext_auth = no first_valid_gid = 6 first_valid_uid = 6 hostname = mail.vishniac.com imap_id_log = * imap_id_send = "name" * "version" * imap_urlauth_submit_user = submit info_log_path = /Library/Logs/Mail/mail-info.log log_path = /Library/Logs/Mail/mail-err.log login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_access_groups = mail mail_attribute_dict = file:/Library/Server/Mail/Data/attributes/attributes.dict mail_location = maildir:/Library/Server/Mail/Data/mail/users/%u mail_log_prefix = "%s(pid %p user %u): " mail_plugins = quota zlib acl fts fts_sk managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational \ regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_size = 200 M namespace acl-mailboxes { list = children location = maildir:/Library/Server/Mail/Data/mail/users/%%u:INDEX=/Library/Server/Mail/Data/mail/shared/%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } namespace list-archives { list = children location = maildir:/Library/Server/Mail/Data/listserver/messages/archive/lists/%%u:INDEX=/Library/Server/Mail/Data/listserver/mess\ ages/archive/shared/%%u prefix = archives.%%u. separator = . subscriptions = no type = shared } passdb { driver = od } passdb { args = /Library/Server/Mail/Config/dovecot/submit.passdb driver = passwd-file } plugin { acl = vfile:/Library/Server/Mail/Config/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/Library/Server/Mail/Data/shared/shared-mailboxes fts = sk quota = maildir:User quota quota_warning = storage=100%% quota-exceeded %u sieve = /Library/Server/Mail/Data/rules/%u/dovecot.sieve sieve_dir = /Library/Server/Mail/Data/rules/%u stats_refresh = 30 secs stats_track_cmds = yes } postmaster_address = postmaster(a)vishniac.com protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth { extra_groups = _keytabusers idle_kill = 15 mins unix_listener auth-userdb { user = _dovecot } } service dict { unix_listener dict { user = _dovecot } } service dns_client { unix_listener dns-client { mode = 0600 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } service_count = 0 } service imap { client_limit = 5 process_limit = 20 service_count = 0 } service indexer-worker { user = _dovecot } service lmtp { unix_listener lmtp { mode = 0600 } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { client_limit = 5 process_limit = 200 service_count = 0 } service quota-exceeded { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-exceeded.sh unix_listener quota-exceeded { group = mail mode = 0660 user = _dovecot } user = _dovecot } service quota-warning { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-warning.sh unix_listener quota-warning { group = mail mode = 0660 user = _dovecot } user = _dovecot } service stats { fifo_listener stats-mail { mode = 0600 user = _dovecot } } ssl_ca = </etc/certificates/mail.vishniac.com.6BC35F87D55C160F0933F54763846F6CC1EB5A81.chain.pem ssl_cert = </etc/certificates/mail.vishniac.com.6BC35F87D55C160F0933F54763846F6CC1EB5A81.cert.pem ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!ADH:!eNULL ssl_key = </etc/certificates/mail.vishniac.com.6BC35F87D55C160F0933F54763846F6CC1EB5A81.key.pem ssl_key_path = /etc/certificates/mail.vishniac.com.6BC35F87D55C160F0933F54763846F6CC1EB5A81.key.pem userdb { args = partition=/Library/Server/Mail/Config/dovecot/partition_map.conf enforce_quotas=no driver = od } userdb { args = /Library/Server/Mail/Config/dovecot/submit.passdb driver = passwd-file } verbose_proctitle = yes protocol lmtp { mail_plugins = quota zlib acl fts fts_sk sieve } protocol lda { mail_plugins = quota zlib acl fts fts_sk sieve } protocol imap { mail_max_userip_connections = 20 mail_plugins = quota zlib acl fts fts_sk imap_acl imap_quota imap_zlib } protocol pop3 { mail_max_userip_connections = 6 } bash-3.2#

3 2

[Dovecot] delete message with specified id
by Костырев Александр Алексеевич 08 Dec '13

08 Dec '13

Good day, everyone! Could someone help me to find a way to delete message with certain id from all users's mailboxes? What seems to be a problem: I have configured exim + dovecot lmtp I got a long list of aliases in BD in form of: +----------+-------------------------------------+ |alias_name recipients | (for example) -----------|-------------------------------------+ | list_a | user1@example.org,user2@example.org | +----------|-------------------------------------+ When I send a message to that list_a, user1 and user2 get the mail and I see this in log: Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, user1(a)example.org) copy from INBOX: box=INBOX, uid=1, msgid=<E1VojxY-0004Gl-Gu@beta-mail>, size=570 Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, user1(a)example.org) oCOXKmAkoVIjQAAA635u4w: msgid=<E1VojxY-0004Gl-Gu@beta-mail>: from=root@beta-mail: subj=: saved mail to INBOX Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, user2(a)example.org) copy from INBOX: box=INBOX, uid=1, msgid=<E1VojxY-0004Gl-Gu@beta-mail>, size=570 Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, user2(a)example.org) oCOXKmAkoVIjQAAA635u4w: msgid=<E1VojxY-0004Gl-Gu@beta-mail>: from=root@beta-mail: subj=: saved mail to INBOX Is it possible to delete these letters with known msgid=<E1VojxY-0004Gl-Gu@beta-mail> from all users mailboxes with couple of simple commands ? How do I do it currently: in exim's log I get mailaddress of a user, get into his mailbox (wich cd), find the letter I need, with ls -i I get inode, search (with find) through all users mails and delete all files with that inode, then I have to rebuild dovecot indexes with doveadm mailbox status -A -t all INBOX -- С уважением, Костырев Александр администратор Linux-систем

2 2

[Dovecot] pigeonhole openssl s_client
by LEVAI Daniel 08 Dec '13

08 Dec '13

Hi! I'm trying to get information about a server certificate from a pigeonhole sieve server. Various connection attempts show only "wrong version number" or "unknown protocol" errors from openssl: $ openssl s_client -connect example.com:4190 { -tls1, -tls1_1, -tls1_2 } [ -starttls { imap, pop3 } ] None of these work. I'm trying to see who signed the server cert. How could I do this? Thanks, Daniel -- LÉVAI Dániel PGP key ID = 0x83B63A8F Key fingerprint = DBEC C66B A47A DFA2 792D 650C C69B BE4C 83B6 3A8F

2 1

[Dovecot] Replication via sneakernet
by David Bishop 07 Dec '13

07 Dec '13

Is there a way to get a running transaction log from a Dovecot instance to synchronize (and I use that word very, very loosely) multiple instances that don't share a network? Why I would want to do such a thing: I have a couple way stations along a long, winding road through very hilly country, and at each of these stations, I have a few people (and many, many more at one end of the road). Which people are where varies from hour to hour (but they're all members of a known, larger, group of people with accounts). It would be helpful to get communication (however limited) along this road (and establishing direct communication, either through radio or landline, is not feasible within the budget constraints I have), and it is possible to store a complete copy of the mail spool to a small box at each station (the total mail spool over the period I care about is in the tens of megs). There are trams shuttling back and forth along this road (stopping at each station), and adding a small box (such as a weatherproofed Raspberry Pi with a wifi dongle) to transport files up and down the road is pretty simple. Doing incremental copies of the mail spool is also simple, keeping track of files that get moved or deleted is a bit harder (but still not that bad), but I have no idea how hard it is to track what messages have been seen, especially for the shared folders (which we use instead of mailing lists). I realize this is not a "normal" use of Dovecot, but given this, does anyone who knows the software (and how it keeps track of messages) better have suggestions on how to approach the problem?

4 6

[Dovecot] Easy migration from Dovecot 1.2.16 ppc maildir to 2.1.17 amd64 mdbox
by Philippe Lelédy 07 Dec '13

07 Dec '13

Hi After http://retrospekt.dk/2011/08/migrating-maildir-to-dovecot-2-0-dbox/ I used a two phases process. The first, transfering over the network, is done by this shell function, on the *new* server. The argument is the <user> fetchOldServer () { rsync -poazuHK --exclude="**/dovecot.index*" \ -e ssh root@oldServer:/var/mail/Maildirs/$1 /var/mail/oldServer/ } I had to add --exclude="**/dovecot.index*" because of a change of endianness (ppc -> amd64). the second, having dovecot import the folder, is done by this second fonction dsync () { doveadm backup -R -u $1(a)mondomaine.fr maildir:/var/mail/oldServer/$1 } this one is really fast. Both in one function doveImport() { fetchOldServer $1 && dsync $1 } I tried for initial load to empty mailbox. I am not sure it will works on a non empty mailbox. But would be nice, as it would allow a fast last minute sync before switch, minimizing downtime. Ph. Le

2 1

Re: [Dovecot] Dovecot readable compressed mail archive
by Dave Hall 06 Dec '13

06 Dec '13

Alan, My goal is to reduce the file count in my backups. Based on the information at the link you sent it looks like for a Maildir setup the file count remains the same. Do you know if it's possible to have a mixed config with Dovecot where for a given user the Inbox is a maildir, but the archives are compressed mbox files? Thanks. -Dave On 12/04/2013 02:06 PM, Alan McGinlay wrote: > http://wiki2.dovecot.org/Plugins/Zlib try this.. Excuse the lack of quoted text, im on my phone

1 0

[Dovecot] Authentification Dovecot + Samba4
by dago＠quantentunnel.de 06 Dec '13

06 Dec '13

Hello list, I am struggling with setting up dovecot 2.1.7 with samba 4.1.2 on debian wheezy. Dovecot should authenticate via LDAP, but I cannot get it to work reliably. Sometimes auth works, sometimes not. Referals are already activated in ldap.conf … LDAP-authentication works fine with other clients (Apache Directory Studio, …) Has somebody got a similar setup running? I would love some hints on how to debug this issue … Thank you! Regards dovecot-ldap.conf hosts = 192.168.188.156:389 dn = CN=Administrator,CN=Users,DC=DOMAIN,DC=LOCAL dnpass = Test123 auth_bind = yes ldap_version = 3 base = DC=DOMAIN,DC=LOCAL tls = no debug_level = -1 ldap_version = 3 scope = subtree user_attrs = uidNumber=uid,gidNumber=gid user_filter = (&(&(objectClass=Person)(sAMAccountName=%u))) pass_attrs = sAMAccountName=user,userPassword=password pass_filter = (&(&(objectClass=Person)(sAMAccountName=%u))) logs: srv1 dovecot: auth: Debug: auth client connected (pid=0) srv1 dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=doveadm#011resp=<hidden> srv1 dovecot: auth: Debug: ldap(john): bind search: base=DC=DOMAIN,DC=LOCAL filter=(&(&(objectClass=Person)(sAMAccountName=john))) srv1 dovecot: auth: Error: ldap_search srv1 dovecot: auth: Error: put_filter: "(&(&(objectClass=Person)(sAMAccountName=john)))" srv1 dovecot: auth: Error: put_filter: AND srv1 dovecot: auth: Error: put_filter_list "(&(objectClass=Person)(sAMAccountName=john))" srv1 dovecot: auth: Error: put_filter: "(&(objectClass=Person)(sAMAccountName=john))" srv1 dovecot: auth: Error: put_filter: AND srv1 dovecot: auth: Error: put_filter_list "(objectClass=Person)(sAMAccountName=john)" srv1 dovecot: auth: Error: put_filter: "(objectClass=Person)" srv1 dovecot: auth: Error: put_filter: simple srv1 dovecot: auth: Error: put_simple_filter: "objectClass=Person" srv1 dovecot: auth: Error: put_filter: "(sAMAccountName=john)" srv1 dovecot: auth: Error: put_filter: simple srv1 dovecot: auth: Error: put_simple_filter: "sAMAccountName=john" srv1 dovecot: auth: Error: ldap_build_search_req ATTRS: sAMAccountName srv1 dovecot: auth: Error: ldap_send_initial_request srv1 dovecot: auth: Error: ldap_send_server_request srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid -1 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid -1 (timeout 0 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: DOMAIN.local port: 0 srv1 dovecot: auth: Error: refcnt: 1 status: Connected srv1 dovecot: auth: Error: last used: Fri Dec 6 19:08:49 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: * msgid 35, origid 33, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 1 srv1 dovecot: auth: Error: * msgid 33, origid 33, status RequestCompleted srv1 dovecot: auth: Error: outstanding referrals 1, parent count 1 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 3 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 35 message type search-result srv1 dovecot: auth: Error: ldap_chase_referrals srv1 dovecot: auth: Error: read1msg: V2 referral chased, mark request completed, id = 35 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 0 new referrals srv1 dovecot: auth: Error: read1msg: mark request completed, ld 0x7fef48794580 msgid 35 srv1 dovecot: auth: Error: merged parent (id 33) error info: result errno 1, error <00002020: Operation unavailable without authentication>, matched <> srv1 dovecot: auth: Error: request done: ld 0x7fef48794580 msgid 33 srv1 dovecot: auth: Error: res_errno: 1, res_error: <00002020: Operation unavailable without authentication>, res_matched: <> srv1 dovecot: auth: Error: ldap_free_request (origid 33, msgid 33) srv1 dovecot: auth: Error: ldap_free_request (origid 33, msgid 35) srv1 dovecot: auth: Error: ldap_free_connection 0 1 srv1 dovecot: auth: Error: ldap_send_unbind srv1 dovecot: auth: Error: ldap_free_connection: actually freed srv1 dovecot: auth: Error: ldap_parse_result srv1 dovecot: auth: Error: ldap_err2string srv1 dovecot: auth: Error: ldap(john): ldap_search(base=DC=DOMAIN,DC=LOCAL filter=(&(&(objectClass=Person)(sAMAccountName=john)))) failed: Operations error srv1 dovecot: auth: Error: ldap_msgfree srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid -1 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid -1 (timeout 0 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 1 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 37 message type search-entry srv1 dovecot: auth: Error: ldap_first_attribute srv1 dovecot: auth: Error: ldap_get_values srv1 dovecot: auth: Error: ldap_next_attribute srv1 dovecot: auth: Debug: auth(john): username changed john -> john srv1 dovecot: auth: Debug: ldap(john): result: sAMAccountName=john srv1 dovecot: auth: Error: ldap_get_dn srv1 dovecot: auth: Error: ldap_msgfree srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid -1 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid -1 (timeout 0 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 1 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 37 message type search-reference srv1 dovecot: auth: Error: ldap_chase_v3referrals srv1 dovecot: auth: Error: ldap_url_parse_ext(ldap://DOMAIN.local/CN=Configuration,DC=DOMAIN,DC=local) srv1 dovecot: auth: Error: re_encode_request: new msgid 39, new dn <CN=Configuration,DC=DOMAIN,DC=local> srv1 dovecot: auth: Error: re_encode_request new request is: srv1 dovecot: auth: Error: ber_dump: buf=0x7fef4879d8d0 ptr=0x7fef4879d956 end=0x7fef4879e8ac len=134 srv1 dovecot: auth: Error: 0000: 61 6d 65 4e 61 6d 65 00 00 00 00 00 00 00 00 00 ameName......... srv1 dovecot: auth: Error: 0010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0080: 00 00 00 00 00 00 ...... srv1 dovecot: auth: Error: ldap_chase_v3referral: msgid 37, url "ldap://DOMAIN.local/CN=Configuration,DC=DOMAIN,DC=local" srv1 dovecot: auth: Error: ldap_send_server_request srv1 dovecot: auth: Error: ldap_new_connection 0 1 1 srv1 dovecot: auth: Error: ldap_int_open_connection srv1 dovecot: auth: Error: ldap_connect_to_host: TCP DOMAIN.local:389 srv1 dovecot: auth: Error: ldap_new_socket: 19 srv1 dovecot: auth: Error: ldap_prepare_socket: 19 srv1 dovecot: auth: Error: ldap_connect_to_host: Trying 192.168.188.156:389 srv1 dovecot: auth: Error: ldap_pvt_connect: fd: 19 tm: -1 async: 0 srv1 dovecot: auth: Error: anonymous rebind via ldap_sasl_bind("") srv1 dovecot: auth: Error: ldap_sasl_bind srv1 dovecot: auth: Error: ldap_send_initial_request srv1 dovecot: auth: Error: ldap_send_server_request srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid 40 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid 40 (timeout 100000 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: DOMAIN.local port: 0 srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: rebind in progress srv1 dovecot: auth: Error: queue is empty srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 3 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 40, origid 40, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 1, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 2 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 37 message type search-result srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 0 new referrals srv1 dovecot: auth: Error: read1msg: mark request completed, ld 0x7fef48794580 msgid 37 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 0 s 99976 us to go srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: DOMAIN.local port: 0 srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: rebind in progress srv1 dovecot: auth: Error: queue is empty srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 40, origid 40, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: * msgid 37, origid 37, status RequestCompleted srv1 dovecot: auth: Error: outstanding referrals 1, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 2 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL dovecot -n: # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_debug = yes auth_verbose = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } protocols = " imap lmtp sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = vmail mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } } ssl = no userdb { driver = passwd }

2 1

[Dovecot] SQL as a storage backend
by Zachary Sturgeon 06 Dec '13

06 Dec '13

Hello, I am researching using dovecot with an SQL database as the storage backend. From what I've read, dovecot only supports mbox style file storage, but I'd like to investigate the possibility of using a database instead. According to http://dovecot.org/pipermail/dovecot/2006-June/013818.html, this possibility has been explored before and has generally been accepted that Dovecot is not optimized to handle this. Any suggestions? - Zachary Sturgeon

4 3

[Dovecot] UIDL and namespaces after qmail-pop3d and BincIMAP
by Adrian C. 06 Dec '13

06 Dec '13

Hello, I migrated qmail-pop3d and BincIMAP to Dovecot in the past, and I could always tweak the settings a little to match what old services used to provide, namely namespaces (separator /, prefix INBOX/) and pop3_uidl_format (%f). This time I'm migrating to a large mail system which has its configuration set differently and there's no changing it. pop3_uidl_format = %08Xu%08Xv namespace private {prefix = INBOX. separator = . inbox = yes} Am I corrent in thinking dsync plugin is the only chance I have of getting this mail migrated right? Unfortunately Debian's Dovecot is much much older than required v2.1.4... so I could use some advice from Dovecot experts. Thanks. -- Adrian C. (anrxc) | anrxc..sysphere.org | PGP ID: D20A0618 PGP FP: 02A5 628A D8EE 2A93 996E 929F D5CB 31B7 D20A 0618

1 0

[Dovecot] Design details of high performance dovecot cluster
by JEHERUL 06 Dec '13

06 Dec '13

Dear All, Currently we are running a mail system for 10000 users each 2GB mailbox. At present we have 5 mail servers where users mailboxes are distributed almost uniformly. We have a HP SAN Storage (HP EVA 6400) where mailboxes are stored. We partition the storage into five vg and each is mounted on the 5 servers. We are using postfix and dovecot. The system was running fine but currently we notices high IO load due to IMAP connection. So we are planning to build a dovecot cluster. Please suggest some design for the dovecot cluster keeping in mind to our scenario. (If needed we can buy additional hardware like load balancer). With Thanks and Regards -- Jeherul Islam India

2 3

[Dovecot] SOLR quick and dirty how to - needs review/testing
by Christian Rößner 06 Dec '13

06 Dec '13

Hi, I just wrote a quick and dirty how to. But not sure, if that is done the way it should. So any kind of feedback is welcome. http://www.roessner-network-solutions.com/?p=1127 At least the stuff does not break things here :-) Kind regards -Christian Rößner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

1 0

[Dovecot] Active Directory LDAP userdb and dovecot
by Simone Ferretti 06 Dec '13

06 Dec '13

Hello everybody, I have a problem with LDAP userdb and dovecot. Let me first explain my LDAP configuration: I got three Active Directory LDAP servers (a.galliera.it, b.galliera.it, c.galliera.it) responding round robin to the name galliera.it. I want to use LDAP for the userdb lookup, so I configured dovecot-ldap-userdb.conf.ext as follow: hosts = galliera.it # round robin base = dc=galliera,dc=it ldap_version = 3 auth_bind=yes auth_bind_userdn = %n(a)galliera.it dn=CN=stampa,CN=Users,DC=galliera,DC=it dnpass=stampa base = DC=galliera,DC=it scope = subtree deref = always user_attrs = sAMAccountName=home=/home/dovecot.galliera.it/%$,=uid=8,=gid=8 user_filter = (&(objectClass=person)(sAMAccountName=%n)) default_pass_scheme=CRYPT With this configuration everything go fine, I can authenticate and lookup my users in the expected way. What follows is the conversation between (one of) the LDAP server(s) and dovecot after a issue of the command $ doveadm user -u <user>@galliera.it : 62.785686 10.0.31.235 -> 10.0.5.0 TCP 74 43053 > ldap [SYN] Seq=0 Win=14600 Len=0 MSS=1460 SACK_PERM=1 TSval=536265719 TSecr=0 WS=32 62.786216 10.0.5.0 -> 10.0.31.235 TCP 78 ldap > 43053 [SYN, ACK] Seq=0 Ack=1 Win=16384 Len=0 MSS=1460 WS=1 TSval=0 TSecr=0 SACK_PERM=1 62.786279 10.0.31.235 -> 10.0.5.0 TCP 66 43053 > ldap [ACK] Seq=1 Ack=1 Win=14624 Len=0 TSval=536265719 TSecr=0 62.786394 10.0.31.235 -> 10.0.5.0 LDAP 122 bindRequest(1) "CN=stampa,CN=Users,DC=galliera,DC=it" simple 62.786583 10.0.31.235 -> 10.0.5.0 TCP 74 43054 > ldap [SYN] Seq=0 Win=14600 Len=0 MSS=1460 SACK_PERM=1 TSval=536265719 TSecr=0 WS=32 62.786953 10.0.5.0 -> 10.0.31.235 TCP 78 ldap > 43054 [SYN, ACK] Seq=0 Ack=1 Win=16384 Len=0 MSS=1460 WS=1 TSval=0 TSecr=0 SACK_PERM=1 62.787008 10.0.31.235 -> 10.0.5.0 TCP 66 43054 > ldap [ACK] Seq=1 Ack=1 Win=14624 Len=0 TSval=536265719 TSecr=0 62.787039 10.0.31.235 -> 10.0.5.0 LDAP 122 bindRequest(1) "CN=stampa,CN=Users,DC=galliera,DC=it" simple 62.788484 10.0.5.0 -> 10.0.31.235 LDAP 88 bindResponse(1) success 62.788528 10.0.31.235 -> 10.0.5.0 TCP 66 43053 > ldap [ACK] Seq=57 Ack=23 Win=14624 Len=0 TSval=536265719 TSecr=36040952 62.789334 10.0.5.0 -> 10.0.31.235 LDAP 88 bindResponse(1) success 62.789365 10.0.31.235 -> 10.0.5.0 TCP 66 43054 > ldap [ACK] Seq=57 Ack=23 Win=14624 Len=0 TSval=536265720 TSecr=36040952 62.789462 10.0.31.235 -> 10.0.5.0 LDAP 174 searchRequest(2) "DC=galliera,DC=it" wholeSubtree 62.790396 10.0.5.0 -> 10.0.31.235 LDAP 392 searchResEntry(2) "CN=Marco De benedetto,OU=S.S.C. Area sistemistica,OU=S.C. S.I.e.T. - Servizi informatici e telecomunicazioni,OU=Dipartimento di Staff,OU=Direzione generale,DC=galliera,DC=it" | searchResRef(2) | searchResDone(2) success 62.790508 10.0.31.235 -> 10.0.5.0 LDAP 191 searchRequest(3) "CN=Configuration,DC=galliera,DC=it" wholeSubtree 62.791077 10.0.5.0 -> 10.0.31.235 LDAP 168 searchResRef(3) | searchResDone(3) success 62.791172 10.0.31.235 -> 10.0.5.0 LDAP 203 searchRequest(4) "CN=Schema,CN=Configuration,DC=galliera,DC=it" wholeSubtree 62.791838 10.0.5.0 -> 10.0.31.235 LDAP 88 searchResDone(4) success 62.828752 10.0.31.235 -> 10.0.5.0 TCP 66 43054 > ldap [ACK] Seq=427 Ack=473 Win=15680 Len=0 TSval=536265730 TSecr=36040952 Strange things happen instead if I change the 'hosts' configuration variable to one (no matter what) of the domain controllers e.g.: hosts = a.galliera.it base = dc=galliera,dc=it ldap_version = 3 auth_bind=yes auth_bind_userdn = %n(a)galliera.it dn=CN=stampa,CN=Users,DC=galliera,DC=it dnpass=stampa base = DC=galliera,DC=it scope = subtree deref = always user_attrs = sAMAccountName=home=/home/dovecot.galliera.it/%$,=uid=8,=gid=8 user_filter = (&(objectClass=person)(sAMAccountName=%n)) default_pass_scheme=CRYPT Changing this variable to only one of the domain controllers make the doveadm request (issued as above) hang for some seconds and then exit with a Request time out message. This is the conversation record, you can note that there is *more the one* LDAP server involved in the conversation despite the fact that in the conf file only one is specified: 3427.019635 10.0.31.235 -> 10.0.10.0 TCP 74 33963 > ldap [SYN] Seq=0 Win=14600 Len=0 MSS=1460 SACK_PERM=1 TSval=537106777 TSecr=0 WS=32 3427.020428 10.0.10.0 -> 10.0.31.235 TCP 78 ldap > 33963 [SYN, ACK] Seq=0 Ack=1 Win=16384 Len=0 MSS=1460 WS=1 TSval=0 TSecr=0 SACK_PERM=1 3427.020489 10.0.31.235 -> 10.0.10.0 TCP 66 33963 > ldap [ACK] Seq=1 Ack=1 Win=14624 Len=0 TSval=537106777 TSecr=0 3427.020562 10.0.31.235 -> 10.0.10.0 LDAP 122 bindRequest(1) "CN=stampa,CN=Users,DC=galliera,DC=it" simple 3427.021894 10.0.31.235 -> 10.0.10.0 TCP 74 33964 > ldap [SYN] Seq=0 Win=14600 Len=0 MSS=1460 SACK_PERM=1 TSval=537106778 TSecr=0 WS=32 3427.022474 10.0.10.0 -> 10.0.31.235 LDAP 88 bindResponse(1) success 3427.022498 10.0.31.235 -> 10.0.10.0 TCP 66 33963 > ldap [ACK] Seq=57 Ack=23 Win=14624 Len=0 TSval=537106778 TSecr=33551087 3427.022805 10.0.10.0 -> 10.0.31.235 TCP 78 ldap > 33964 [SYN, ACK] Seq=0 Ack=1 Win=16384 Len=0 MSS=1460 WS=1 TSval=0 TSecr=0 SACK_PERM=1 3427.022868 10.0.31.235 -> 10.0.10.0 TCP 66 33964 > ldap [ACK] Seq=1 Ack=1 Win=14624 Len=0 TSval=537106778 TSecr=0 3427.022996 10.0.31.235 -> 10.0.10.0 LDAP 122 bindRequest(1) "CN=stampa,CN=Users,DC=galliera,DC=it" simple 3427.024537 10.0.10.0 -> 10.0.31.235 LDAP 88 bindResponse(1) success 3427.024574 10.0.31.235 -> 10.0.10.0 TCP 66 33964 > ldap [ACK] Seq=57 Ack=23 Win=14624 Len=0 TSval=537106778 TSecr=33551087 3427.024884 10.0.31.235 -> 10.0.10.0 LDAP 176 searchRequest(2) "DC=galliera,DC=it" wholeSubtree 3427.028078 10.0.10.0 -> 10.0.31.235 LDAP 391 searchResEntry(2) "CN=Simone Ferretti,OU=S.S.C. Area sistemistica,OU=S.C. S.I.e.T. - Servizi informatici e telecomunicazioni,OU=Dipartimento di Staff,OU=Direzione generale,DC=galliera,DC=it" | searchResRef(2) | searchResDone(2) success 3427.028426 10.0.31.235 -> 10.0.5.0 TCP 74 43077 > ldap [SYN] Seq=0 Win=14600 Len=0 MSS=1460 SACK_PERM=1 TSval=537106779 TSecr=0 WS=32 3427.028882 10.0.5.0 -> 10.0.31.235 TCP 78 ldap > 43077 [SYN, ACK] Seq=0 Ack=1 Win=16384 Len=0 MSS=1460 WS=1 TSval=0 TSecr=0 SACK_PERM=1 3427.028932 10.0.31.235 -> 10.0.5.0 TCP 66 43077 > ldap [ACK] Seq=1 Ack=1 Win=14624 Len=0 TSval=537106780 TSecr=0 3427.029091 10.0.31.235 -> 10.0.5.0 LDAP 80 bindRequest(4) "<ROOT>" simple 3427.029816 10.0.5.0 -> 10.0.31.235 LDAP 88 bindResponse(4) success 3427.029832 10.0.31.235 -> 10.0.5.0 TCP 66 43077 > ldap [ACK] Seq=15 Ack=23 Win=14624 Len=0 TSval=537106780 TSecr=36074586 3427.030001 10.0.31.235 -> 10.0.5.0 LDAP 193 searchRequest(3) "CN=Configuration,DC=galliera,DC=it" wholeSubtree 3427.030980 10.0.5.0 -> 10.0.31.235 LDAP 168 searchResRef(3) | searchResDone(3) success 3427.064639 10.0.31.235 -> 10.0.10.0 TCP 66 33964 > ldap [ACK] Seq=167 Ack=348 Win=15680 Len=0 TSval=537106789 TSecr=33551087 3427.068791 10.0.31.235 -> 10.0.5.0 TCP 66 43077 > ldap [ACK] Seq=142 Ack=125 Win=14624 Len=0 TSval=537106790 TSecr=36074586 Is there anyone that have some ideas of what is going on? My dovecot version is 2.2.9 (5c170e0786f3) running on a debian wheezy 3.2.0-4-amd64. My Active Directory server is a windows server 2003 R2. Follows my doveconf -n: # 2.2.9 (5c170e0786f3): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 ext4 auth_cache_size = 8 k auth_debug = yes auth_master_user_separator = * auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@+ auth_verbose = yes disable_plaintext_auth = no first_valid_uid = 5 hostname = dovecot.galliera.it last_valid_uid = 100000 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_access_groups = mail mail_debug = yes mail_gid = mail mail_location = maildir:/home/%d/%n/Maildir mail_privileged_group = mail mail_uid = mail maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { list = children location = maildir:/var/mail/shared/istituzionali:INDEX=/var/mail/shared/istituzionali/INDEX/%n prefix = Avvisi al personale. subscriptions = yes type = public } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile fts = squat fts_squat = partial=4 full=10 mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = from subject uid box msgid size sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)galliera.it protocols = " imap lmtp sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { mode = 0600 user = mail } unix_listener auth-userdb { mode = 0777 user = mail } user = root } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl = no ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem syslog_facility = local5 userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap } protocol imap { mail_max_userip_connections = 30 mail_plugins = fts fts_squat mail_log zlib acl imap_acl notify } protocol pop3 { pop3_uidl_format = %v.%u } Thanks in advance and ciao! Simone

1 0

[Dovecot] Expire plugin and databases
by Mauricio Tavares 06 Dec '13

06 Dec '13

Dumb question: do I need to have a database to run the expire plugin?

2 1

[Dovecot] zlib config questions
by Terry Barnum 05 Dec '13

05 Dec '13

After nearly running out of space I swapped in larger disks and then saw the recent threads about zlib compression. Unfortunately I'm still confused after reading <http://wiki2.dovecot.org/Plugins/Zlib>. In order to compress new email being stored do I only need to change 10-mail.conf to this: mail_plugins = $mail_plugins zlib and 90-plugin.conf to this: plugin { zlib_save_level = 6 zlib_save = gz ... Or do I need to instead (or also?) add it to the list of plugins in 20-imap.conf? A simple 'sudo doveadm reload' to enable? Once enabled, is there an indication in the logs that compression is taking place? Do new mail files have a suffix like .Z to indicate they've been compressed? Any gotchas to be aware of? I'm running macports dovecot 2.2.5. Thanks for any help. -Terry Terry Barnum digital OutPost http://www.dop.com

1 0

[Dovecot] Syslog debug messages
by Bruno Galindro da Costa 05 Dec '13

05 Dec '13

Is there a way to configure dovecot to register in syslog the debug messages enabled by mail_debug=yes as a debug not as information? I need this because I want to send this kind of information only to a remote server. I've configured rsyslog to do this, but dovecot is registering those debug messages as information not as debug (as I expected). This is my rsyslog config: mail.info;\ mail.warning;\ mail.err;\ mail.crit -/var/log/mail.log mail.* :omrelp:192.168.2.162:2514 root@imap:~# dovecot -n # 1.2.9: /etc/dovecot/dovecot.conf Warning: fd limit 1024 is lower than what Dovecot can use under full load (more than 4748). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: Linux 2.6.32-44-server x86_64 Ubuntu 10.04.4 LTS xfs log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve pop3s listen(default): *:143,[::]:143 listen(imap): *:143,[::]:143 listen(pop3): * listen(managesieve): * ssl_listen(default): *:993,[::]:993 ssl_listen(imap): *:993,[::]:993 ssl_listen(pop3): *:2221,[::]:2221 ssl_listen(managesieve): ssl_ca_file(default): /etc/dovecot/ca.crt ssl_ca_file(imap): /etc/dovecot/ca.crt ssl_ca_file(pop3): /etc/dovecot/ca.crt ssl_ca_file(managesieve): ssl_cert_file(default): /etc/dovecot/ufsc.br.crt ssl_cert_file(imap): /etc/dovecot/ufsc.br.crt ssl_cert_file(pop3): /etc/dovecot/ufsc.br.crt ssl_cert_file(managesieve): /etc/ssl/certs/dovecot.pem ssl_key_file(default): /etc/dovecot/ufsc.br.key ssl_key_file(imap): /etc/dovecot/ufsc.br.key ssl_key_file(pop3): /etc/dovecot/ufsc.br.key ssl_key_file(managesieve): /etc/ssl/private/dovecot.pem disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_process_per_connection: no login_process_size: 256 login_max_processes_count: 900 login_max_connections: 1024 max_mail_processes: 2048 mail_max_userip_connections(default): 2048 mail_max_userip_connections(imap): 2048 mail_max_userip_connections(pop3): 10 mail_max_userip_connections(managesieve): 10 mail_privileged_group: mail mail_uid: vmail mail_gid: mail mail_location: maildir:/var/mail/mailboxes/%d/%n:INDEX=/var/mail/indexes/%d/%n mail_debug: yes fsync_disable(default): yes fsync_disable(imap): yes fsync_disable(pop3): yes fsync_disable(managesieve): no mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): quota imap_quota autocreate trash zlib mail_plugins(imap): quota imap_quota autocreate trash zlib mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve managesieve_implementation_string(default): dovecot managesieve_implementation_string(imap): dovecot managesieve_implementation_string(pop3): dovecot managesieve_implementation_string(managesieve): Cyrus timsieved v2.2.13 lda: fsync_disable: no postmaster_address: xxx(a)xxx.xxx.xx mail_plugins: quota sieve auth_socket_path: /var/run/dovecot/auth-master auth default: cache_size: 1024 cache_ttl: 600 cache_negative_ttl: 60 username_chars: abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@~ username_format: %Lu passdb: driver: checkpassword args: /etc/dovecot/passdb.v3.1.sh userdb: driver: prefetch userdb: driver: ldap args: /etc/dovecot/dovecot-ldap-userdb.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: mail plugin: quota_exceeded_message: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx. quota: maildir:DefaultQuota quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 %u quota_warning2: storage=90%% /usr/local/bin/quota-warning.sh 90 %u trash: /etc/dovecot/dovecot-trash.conf sieve: /var/mail/sieve_scripts/%d/%n/.dovecot.sieve sieve_dir: /var/mail/sieve_scripts/%d/%n/sieve mail_log_events: delete expunge copy mailbox_delete mail_log_fields: uid box msgid from subject size vsize autocreate: Spam autosubscribe: Spam -- Att. Bruno Galindro da Costa

2 1

[Dovecot] FTS solr issue with second private namespace
by Andreas Oster 05 Dec '13

05 Dec '13

Hi all, I have just stumbled over an issue with the FTS plugin of dovecot. For our primary namespace, INBOX and its subfolders, searching works without any problems but in a second namespace, which I have created for old/archived mails, searching of the mail text/body does not work. I can see the search request in the tomcat log but no result is created and the mail client (Thunderbird) keeps displaying the serach message without returning any results. Tomcat6 catalina.out: Dez 02, 2013 11:58:00 AM org.apache.solr.core.SolrCore execute INFO: [] webapp=/solr path=/select params={fl=uid,score&sort=uid+asc&q=body:"schiller"&fq=%2Bbox:1b4de60d0a6287522d0c00004424cda4+%2Buser:"testuser"&rows=2} hits=0 status=0 QTime=1 I am currently using Dovecot 2.2.9 and do not have any special FTS config: mail_plugins = quota mailbox_alias fts fts_solr plugin { fts = solr fts_solr = break-imap-search url=http://localhost:8080/solr/ fts_autoindex = yes } Thank you for your kind help best regards Andreas

1 2

[Dovecot] Full text search improvements
by Timo Sirainen 05 Dec '13

05 Dec '13

FTS indexing is something I hear quite often nowadays. I’ve added some hacks to make it work better for some installations, but it’s about time to think about the whole design and how it could be improved for everyone in future. Here are some of my initial thoughts. Currently Dovecot supports 3 full text search engines: Solr, CLucene and Dovecot Squat. CLucene plugin has various features built in, which should have been built in a generic way to work with all the engines (although Solr has most of those already built-in). Squat was abandoned a few years ago in favor of Solr/CLucene, but perhaps it could be brought back to life, since it looks like its index sizes could be smaller than Lucene's. Here's a list of things that should be added to generic Dovecot FTS code to improve all the backends: 1. Support for multiple languages. Use textcat while indexing to guess the language of the indexed data. (Perhaps run it separately for each paragraph to handle multi-language mails? Or at least many emails begin/end with different language than the text in the middle, e.g. "Foo Bar wrote:" is often in various languages.) Index the data using the detected language's stemming and other features. Keep track of which languages have been used in the index, and when searching stem the search words to all the used languages. Since each added language requires additional searches and there's the possibility of wrong detection, the list of allowed languages could be configurable. See also http://ntextcat.codeplex.com/ or at least change textcat to use UTF8. 2. Word stemming. This can be done for many languages with Snowball library. Solr has also implemented several other languages, perhaps its code can be somehow automatically translated to C(++) for use with Dovecot? 3. Don't index language-specific stopwords. We can get the word lists from e.g. Solr. 4. Try to detect compound words and index each part separately for languages that use them. http://wiki.apache.org/solr/LanguageAnalysis#Decompounding suggests two possible ways to do it. 5. Normalize words (e.g. drop diacritics). libicu can be used for this. 6. Drop (Unicode) characters that don't belong to the language? Or especially don't index most of the weird Unicode characters. This would avoid filling the index with unnecessary garbage. 7. Don't index non-text data? For example if there is large block of base64 data or something else that definitely doesn't look like text, it's pretty useless to index it. Then again, we do want to index all kinds of IDs that someone might want to search. This could be a bit difficult to implement well. 8. Index attachments separately, so it would be possible to search only attachments. (Should "SEARCH BODY word1 BODY word2" return matches if word1 and word2 are in different attachments?) 9. Attachments can be translated to indexable UTF-8 text already with fts_decoder setting by doing it via a conversion script. This could also support Apache Tika server directly. 10. It should be configurable which fields are indexed. Body and header would always be separately indexed. Optionally there could be also at least: attachments, From, To, Cc, Bcc and Subject. The From/To/Cc/Bcc could also be indexed together in one "addresses" field. The more fields there are, the larger the index, but better/faster search results. 11. Each indexed mail should have metadata: Mailbox GUID, mail UID and the language the mail was indexed with. For attachments there should also be the MIME part number. When matching results, drop results if returned language doesn't match the query language. Squat ----- Currently Squat index consists of a trie containing all the words and pointer to a file listing all the message UIDs that contain them. Each node in the trie has a pointer to the UIDs, so e.g. with "abc" the "a" node will contain UIDs of all mails that contain the "a" letter (e.g. 1,3-5,10). "ab" node will contain mails that have the "ab" substring. Since the "ab" is a subset of "a", the "ab" won't contain UIDs directly but instead it contains indexes to the "a" list to get a better compression (e.g. UID 3-5,10 -> 2-4 indexes in the "1,3-5,10" list). The "abc" node then similarly refers to the "ab" node's indexes. It's configurable how long words Squat will index. Also substring matching is configurable. By default both are 4 letters, so words longer than 4 letters will be split to 4 letter pieces which are indexed (e.g. "dovecot" -> "dove", "ovec", "veco", "ecot"). When searching these pieces are looked up and the results are merged. It's pretty pointless to do a search for 1-2 letter substrings. Most likely the user wants to find 1-2 letter word instead. Perhaps this is true also for 3 letters? The Squat index could be changed to only add results for the first 1-2 (or 1-3?) letters only for full words, not to word prefixes. This of course would mean that the "ab" referring to "a" UID list would no longer work for the first nodes. Substring searching likely wouldn't work very nicely for stemmed words. So Squat should probably index the full stemmed word and then also index the unstemmed word in the small 4 letter pieces. It should be possible to also disable substring searching entirely. Squat already attempts to reduce disk space by encoding the common characters with less bits than other characters. This is hardcoded for English language though. Each index compression could analyze the most common letters and dynamically use those. Perhaps different languages could even use separate Squat index files to get the most advantage of this? Although if there are a lot of languages it's a bit annoying to have many different index files. Squat currently indexes each Unicode character as one letter, so there can be quite a huge number of different 4 letter words. This substring indexing should probably be disabled for words that contain letters not used by the current language. The UID lists are not compressed very efficiently. See http://www2009.eprints.org/41/1/p401.pdf for alternatives. There is currently one Squat index per mailbox. There should be one per user. This requires adding a separate ID -> { mailbox GUID, UID, language, mime part } mapping file. Squat indexes should be updated in two parts. For old mails there are the large trie+uidlist base files in optimized format. For new mails there are small trie+uidlist files in a format where they are just appended to. When the trie or uidlist becomes large enough, it's first internally sorted/optimized, and then merged with the base files by recreating new optimized base files. This fixes the scalability problem with current large Squat indexes where with large unsorted indexes the sorting could have taken forever. Since substring searches in Squat produce only "maybe matches" UID lists, the mails still need to be opened and searched through. This step could probably also do the same language detection + stemming as is done during indexing to improve the search results. (And this feature could be enabled even if no FTS index is enabled.)

6 9

[Dovecot] Postfix & Dovecot Sieve Advice
by craig.dovecot＠noboost.org 05 Dec '13

05 Dec '13

Hi, I've configured up Dovecot Pigeonhole with Postfix for delivery (all working perfectly). Seeing as I'm about to use this in production, I'm just after any advice or tips people might have to safeguard email delivery from Postfix to Dovecot via LMTP? Spec: postfix-2.6.6-2.2.el6_1.x86_64 dovecot-2.0.9-5.el6.x86_64 dovecot-pigeonhole-2.0.9-5.el6.x86_64 Postfix: virtual_transport = lmtp:unix:private/dovecot-lmtp Dovecot (key settings): vim /etc/dovecot/conf.d/10-auth.conf auth_username_format = %Ln vim /etc/dovecot/conf.d/10-master.conf service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } vim /etc/dovecot/conf.d/20-lmtp.conf protocol lmtp { mail_plugins = $mail_plugins sieve } vim /etc/dovecot/conf.d/90-sieve.conf plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_vacation_min_period = 1h sieve_vacation_default_period = 10d sieve_vacation_max_period = 30d } Regards, Craig

1 0

[Dovecot] BUG: Authentication client sent unknown handshake command
by Emmanuel Dreyfus 04 Dec '13

04 Dec '13

Hi After upgrading the kernel, everything is fine, except dovecot authentication. I get this trange thing (data after REQUEST? changed just in case it contains anything sensitive): Nov 29 16:56:01 volanges dovecot: auth: Error: BUG: Authentication client sent unknown handshake command: REQUEST?6970356762?616?6?235264ef69dbd1665538af54d12fdaea?session_pid=453?req... Nov 29 16:56:01 volanges dovecot: imap: Error: Authentication server didn't send valid SPID as expected: MECH PLAIN plaintext Nov 29 16:56:01 volanges dovecot: imap: Error: Disconnected from auth server, aborting (client-pid=161 client-id=1) Nov 29 16:56:01 volanges dovecot: imap-login: Internal login failure (pid=161 id=1) (internal failure, 1 successful auths): user=<jdoe>, method=PLAIN, rip=192.0.2.251, lip=192.0.2.10, mpid=453, TLS, TLSv1 with cipher AES128-SHA (128/128 bits) Reverting to the previous kernel fixed the problem, but I have not been able to spot what the problem was. Any idea? -- Emmanuel Dreyfus manu(a)netbsd.org

3 5

[Dovecot] Ubuntu packages and broken link in docs
by Alan McGinlay - SICS 04 Dec '13

04 Dec '13

Hi, Two things: 1. Does anyone know of a good PPA with updated packages of Dovecot for Ubuntu? "For the latest Dovecot for latest Ubuntu LTS see Xiaoka APT Repository. (Outdated. Could someone provide a ppa for latest stable Dovecot, please?)" 2. On the http://wiki2.dovecot.org/PrebuiltBinaries#Ubuntu page there is a link to a supposedly outdated PPA, the ppa page now redirects to an ad for the guys services so should probably be removed. /Alan

2 1

[Dovecot] Different settings for SSL/non-SSL protocols
by Алексей Прокопчук 04 Dec '13

04 Dec '13

Good time of the day! It is possible to setup dovecot with different requirements for SSL and non-SSL protocols? What would I like to do: pop3/imap non-SSL = allowed plain text authentication. pop3/imap with SSL = allowed plain text authentication with required valid SSL certificates. I need to allow access from any IP address for first group of users, which have valid SSL certificates. And allow access from only local IP addresses for second group of users which doesn't have SSL certificates at all. I tried to setup dovecot for such task. SSL and non-SSL pop3/imap works together fine, but without require valid SSL certificates. If I set auth_ssl_require_client_cert = yes, non-SSL pop3/imap refuses authentication without valid SSL certificate. I tried to use different sections for protocol pop3 {} and protocol pop3s {} (and imap/imaps) but this seems doesn't work. Is there any way to solve this? Thanks for attention, with best regards, Alexey Prokopchuk (AP8686-RIPE)

1 2

[Dovecot] Complete migration from Cyrus on remote server
by Alan McGinlay - SICS 04 Dec '13

04 Dec '13

Hi All! I am working on a complete migration from an old solaris machine running Cyrus IMAP v2.3.14 and wish to migrate all users to a new ubuntu vm running Dovecot 2.0.19. What I have so far is a fully functional dovecot installation with LDAP / Dovecot SASL auth using Maildir++. My plan is to use Perdition IMAP proxy on a third host and migrate users a few at a time (see attached picture of my whiteboard). The proxy is in place and already used by webmail clients to connect to the old server, shortly I will change the dns to point smtp.domain.com and imap.domain.com etc to the proxy instead of the old server but I haven't finished testing yet. Once that is done it is a simple matter of changing the proxy configuration per user to make them hit the new server instead. The problem I am having with this is that I am using Imapsync (http://imapsync.lamiral.info) to perform the initial synchronization (i have scripted it to maintain sync every 10 minutes with the addtion of "--maxage 1" option) using the following command line options: /usr/local/bin/imapsync --noreleasecheck --useheader ALL --delete2 --expunge2 --tmpdir /var/vmail/cache --subscribe --subscribed --tls1 --tls2 --usecache --nofoldersizes --nocheckmessageexists --host1 oldserver.domain.com --authuser1 adminuser --user1 testuser(a)domain.com --authmech1 PLAIN --password1 <HIDDEN> --host2 newserver.domain.com --authuser2 adminuser --user2 testuser(a)domain.com --authmech2 PLAIN --password2 <HIDDEN> All email is copied over and stored in dovecot as you would expect. Then I switch the user to the new server on the imapproxy and restart the client (thunderbird or whatever). This is where all email headers are downloaded again as if they were new! There are *Many* users here who would complain intensely if this happened and I was really wanting the migration to be as invisible as possible. Is there a way to do what I have described without the clients redownloading headers / full messages? I have been working on this for some time now but have hit a roadblock and don't know where to turn, any help would be really appreciated! Notes: * The proxy is not used during imapsync. * Some users have 20 years worth of mail running into 10's of GB * I have looked at dsync but the docs state that the mailbox should not be accessed during sync, this is not possible for me (it doesn't say why this is the case however)

4 7

[Dovecot] file descriptor errors
by Christian Rößner 04 Dec '13

04 Dec '13

Hi, I use dovecot 2.2.9 on Gentoo Linux and I get lots of these erors in my log file: Dec 4 08:53:37 mx dovecot: auth: Error: close failed in file object destructor: Dec 4 08:53:37 mx dovecot: auth: Error: IOError: [Errno 9] Bad file descriptor What could cause these error messages? My mailboxes are stored on an ext4 filesystem: /dev/vdb1 on /srv/mail type ext4 (rw,noatime) doveconf -n: # OS: Linux 3.11.2-hardened x86_64 Gentoo Base System release 2.2 ext4 auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_access_groups = mail mail_attachment_dir = /srv/mail/copymail/attachments mail_gid = mail mail_location = maildir:/srv/mail/virtual/%d/%n mail_plugins = quota acl zlib mail_log notify mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk-E-Mail { auto = subscribe special_use = \Junk } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. } passdb { args = /usr/local/sbin/ispcp-decrypt.py driver = checkpassword } plugin { acl = vfile acl_shared_dict = file:/srv/mail/virtual/shared-mailboxes.db quota = dict:User quota::file:/srv/mail/virtual/%d/%n/dovecot-quota quota_rule = *:storage=300M:messages=20000 quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster(a)deltaweb.de protocols = imap pop3 lmtp sieve service auth-worker { extra_groups = ssl-cert unix_listener auth-worker { mode = 0600 user = vmail } user = vmail } service auth { extra_groups = ssl-cert unix_listener /var/spool/postfix.relay/private/auth { group = postfix mode = 0660 user = postfix } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0660 user = vmail } user = vmail } service config { unix_listener config { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = ::1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl_cert = </etc/ssl/certs/mx_deltaweb_de.crt ssl_key = </etc/ssl/private/mx_deltaweb_de.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = quota acl zlib mail_log notify sieve } protocol lda { mail_plugins = quota acl zlib mail_log notify sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = quota acl zlib mail_log notify imap_quota imap_acl imap_zlib } Thanks in advance -Christian Rößner -- Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 78823400, F: +49 6631 78823409, M: +49 176 93118939 USt-IdNr.: DE225643613, http://www.roessner-network-solutions.com

1 0

[Dovecot] Possible managesieve bug.
by Pedro R. Benito da Rocha 04 Dec '13

04 Dec '13

Hi, I'm migrating from from 1.1 to 2.2. Currently I am doing test to ensure I'm doing it right. On the old server the managesieve config says: sieve = /correo/%d/%u/dovecot.sieve sieve_dir = /correo/%d/%u/Sieve and is working fine. But the same config on the new server is not working. I have activated verbose logging and this is the result: Dec 3 09:59:41 imap-01 dovecot: managesieve-login: Login: user=<xxxx(a)ubu.es>, method=LOGIN, rip=10.145.4.65, lip=10.145.4.45, mpid=29855, session=<T7hfhJ3s+QAKkQRB> Dec 3 09:59:41 imap-01 dovecot: managesieve(xxxx(a)ubu.es): Error: sieve-storage: Performing readlink() on active sieve symlink '/correo/ubu.es/xxxx(a)ubu.es/dovecot.sieve' failed: Permission denied Dec 3 09:59:41 imap-01 dovecot: managesieve(xxxx(a)ubu.es): Error: sieve-storage: Failed to stat active sieve script symlink (/correo/ubu.es/xxxx(a)ubu.es/dovecot.sieve) Permission denied. Dec 3 09:59:41 imap-01 dovecot: managesieve(xxxx(a)ubu.es): Disconnected: Logged out bytes=120/331 Dec 3 09:59:51 imap-01 dovecot: managesieve-login: Login: user=<pedro(a)ubu.es>, method=LOGIN, rip=10.145.4.65, lip=10.145.4.45, mpid=29858, session=<6bDthJ3s+wAKkQRB> Dec 3 09:59:51 imap-01 dovecot: managesieve(xxxx(a)ubu.es): Error: sieve-storage: Performing readlink() on active sieve symlink '/correo/ubu.es/xxxx(a)ubu.es/dovecot.sieve' failed: Permission denied Dec 3 09:59:51 imap-01 dovecot: managesieve(xxxx(a)ubu.es): Disconnected: Logged out bytes=44/199 Permissions are ok. I modified the permissions using 0777 but the error message is the same. I have made other tests to see if I can find the problem, and I made it work if I delete "%d" from config, this way: sieve = /correo/%u/dovecot.sieve sieve_dir = /correo/%u/Sieve I have copied all filters preserving permissions, and with the same file permissions is working. If I add the '%d' to the path error comes again. Can anyone tell me if this is the normal behavior or is a bug? Thanks, Pedro -- ------------------------------------------------------------------------ Pedro R. Benito da Rocha - Servicio de Informatica - Area de Sistemas Universidad de Burgos (España) E-mail: pedro(a)ubu.es Tel: +34 947258845 ------------------------------------------------------------------------

2 2

[Dovecot] disconnecting (disconnected by server)
by Patrick Westenberg 03 Dec '13

03 Dec '13

Hi all, I just recognized a lot of log entries like this on my proxy: Dec 03 13:50:54 imap-login: Info: proxy(mail(a)example.com): disconnecting 1.2.3.4 (Disconnected by server): user=<mail(a)example.com>, method=PLAIN, rip=1.2.3.4, lip=2.4.6.8, TLS, session=<qk02v6DsJwBTlUQX> There are no similar entries on the backends. What does this mean? Something I have to worry about? Regards Patrick # 2.2.7: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_mechanisms = plain login default_process_limit = 150 director_mail_servers = 172.17.1.2 172.17.1.1 director_servers = 172.17.1.3 172.17.1.4 director_user_expire = 5 mins lmtp_proxy = yes log_path = /var/log/dovecot.log managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = 172.17.1.3 port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director } service lmtp { inet_listener lmtp { address = 172.17.1.3 port = 24 } } service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 4190 } } service pop3-login { executable = pop3-login director } ssl_cert = </etc/ssl/certs/wildcard.example.com.crt ssl_key = </etc/ssl/private/wildcard.example.com.key protocol !smtp { passdb { args = proxy=y nopassword=y starttls=any-cert driver = static } } protocol smtp { passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } } protocol lmtp { auth_socket_path = director-userdb } # 2.2.2: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.1 auth_mechanisms = plain login disable_plaintext_auth = no dotlock_use_excl = no hostname = mb01.example.com listen = 172.17.1.1 log_path = /var/log/dovecot.log login_trusted_networks = 172.17.1.3 172.17.1.4 mail_fsync = always mail_gid = vmail mail_home = /var/mail/%d/%n mail_location = maildir:~/Maildir mail_plugins = quota mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spamverdacht { auto = subscribe } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. separator = . type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::file:%h/Maildir/dovecot-quota quota_rule2 = INBOX.Trash:ignore quota_warning = storage=90%% quota-warning 90 %u quota_warning2 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_after = /usr/local/etc/dovecot/sieve/sieve_after.sieve sieve_default = /usr/local/etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)example.com protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { mode = 0666 user = vmail } } service lmtp { inet_listener lmtp { address = 172.17.1.1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/etc/dovecot/quota_warning.sh unix_listener quota-warning { user = vmail } user = root } ssl_cert = </etc/ssl/certs/mb01.example.com.crt ssl_key = </etc/ssl/private/mb01.example.com.key submission_host = mf01.wk-serv.net userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = quota sieve } protocol imap { mail_max_userip_connections = 30 mail_plugins = quota imap_quota }

2 5

[Dovecot] Error in imap_address_arg_append
by Potapov Sergey 03 Dec '13

03 Dec '13

Hi Function imap_envelope_parse return incorrect result for addresses with groups due to error in imap_address_arg_append because of with ", " is added after group name and before first mailbox. Patch for dovecot v2.1 in attach.

2 1

[Dovecot] Gettings mails recently moved to a folder
by Florian Lindner 03 Dec '13

03 Dec '13

Hello, some spam training tools learn the same message over and over again. Since I want to use a daily cronjob to train messages and I do not want to have the same messages trained multiple times, I need to way to get new messages in a folder. Is there a (consolish) way to get a list of messages that were recently moved to a folder? dovecot does not modify mtime, according to RFC 3501. Thanks, Florian

5 9