August 2015 - dovecot

Merging maildirs
by Petter Gunnerud 28 Aug '15

28 Aug '15

Hi List How do I merge files from one maildir into another maildir? Long version: I've been using dovecot/postfix for a 12 user environment for several years, and today was the first time I ran into an issue I could not solve from reading the documentation. The server is gentoo running on esxi. A few times a year I've made a snapshot of the server and copied the files to my home esxi server as a full system backup. 5 days ago the internet connection at the office broke, and I decided to power on the last copy of the server at my home and change public dns so that users could access their new mails via webmail from this spare server. (I didn't allow imap through firewall.) Now the network at the office is back. DNS is updated so that mails are delivered to the office server again. But all the mails sent / received during those 5 days is only at my house. How can I merge those into the office server?I'd like to do this as a server administrator. I do not want to have each user forward the mails to them self from the temporarily webmail. I tried to just copy the mail files on my own account - like I did once when I used courier-imap, but that did not work with dovecot. I hope someone has an idea of how to solve this.

3 2

Panic in service(log)
by Eugene Paskevich 27 Aug '15

27 Aug '15

Hello, I'm using the Debian builds of dovecot-2.2 by S[r]us. Today I started getting the following panic: log: Panic: file priorityq.c: line 122 (priorityq_remove_idx): assertion failed: (idx < count) log: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x7f1ae) [0x7fd368dc31ae] -> /usr/lib/dovecot/libdovecot.so.0(+0x7f269) [0x7fd368dc3269] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fd368d6c81e] -> /usr/lib/dovecot/libdovecot.so.0(+0xa0de8) [0x7fd368de4de8] -> /usr/lib/dovecot/libdovecot.so.0(priorityq_remove+0xb) [0x7fd368de4eeb] -> /usr/lib/dovecot/libdovecot.so.0(+0x9179c) [0x7fd368dd579c] -> /usr/lib/dovecot/libdovecot.so.0(master_status_update+0x93) [0x7fd368d71263] -> /usr/lib/dovecot/libdovecot.so.0(+0x2ecf3) [0x7fd368d72cf3] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7fd368dd6b2c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xc5) [0x7fd368dd7e35] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7fd368dd6bb5] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fd368dd6d58] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fd368d72213] -> dovecot/log(main+0x11c) [0x555e9f81771c] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7fd3689bcb45] -> dovecot/log(+0x277d) [0x555e9f81777d] master: Error: service(log): child 28845 killed with signal 6 (core dumps disabled) Could anyone please advise? -- Eugene Paskevich | *==)----------- | Plug me into eugene(a)raptor.kiev.ua | -----------(==* | The Matrix

2 2

mailbox deletion is not replicated correctly
by Dennis Kuhn 27 Aug '15

27 Aug '15

i can't delete several folders at once. I have a folder structure like folder1/folder2/folder3 (we use slash as hierarchy separator). When i delete folder1 server1 executes the command correctly Apr 16 13:44:28 server1 dovecot: imap(d.kuhn(a)heinlein-support.de): Mailbox deleted: INBOX/Trash/folder1/folder2/folder3 Apr 16 13:44:28 server1 dovecot: imap(d.kuhn(a)heinlein-support.de): Mailbox deleted: INBOX/Trash/folder1/folder2 Apr 16 13:44:28 server1 dovecot: imap(d.kuhn(a)heinlein-support.de): Mailbox deleted: INBOX/Trash/folder1 but the replica server2 reverses the order: Apr 16 13:44:29 server2 dovecot: dsync-server(d.kuhn(a)heinlein-support.de): Mailbox deleted: INBOX/Trash/folder1 Apr 16 13:44:29 server2 dovecot: dsync-server(d.kuhn(a)heinlein-support.de): Mailbox deleted: INBOX/Trash/folder1/folder2 Apr 16 13:44:29 server2 dovecot: dsync-server(d.kuhn(a)heinlein-support.de): Mailbox deleted: INBOX/Trash/folder1/folder2/folder3 This creates the folder INBOX/Trash/folder1/folder2 on server2 again which replicates back to server1. Regards, Dennis Kuhn -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-57 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

3 4

mail_log proposal: recipient
by Peter Chiochetti 26 Aug '15

26 Aug '15

As Timo seems to be on a committing spree; I'd like to propose that in the mail_log_fields the recipient would be available. Like probably many dovecot users, my MUAs save to Sent; so when grepping the log to learn etc. that would just be useful Kind regards -- peter

2 2

Duplicate folder names
by Paulo Matos 26 Aug '15

26 Aug '15

Hi, I have setup message filtering and for example, I might move a message which a given sender to folder special/. This folder is created and shows up twice in INBOX/special/ and special/. They are however exactly the same folder. If I subscribe to one I am automatically subscribed to the other and viceversa. Not too happy with this configuration. I have a feeling this is related to namespaces but I am not sure in which way to configure things in order to have only INBOX/special but not special/. How can I set this up. My current configuration is: $ dovecot -n # 2.2.18: /etc/dovecot/dovecot.conf # OS: Linux 4.1.0-x86_64-linode59 x86_64 Fedora release 22 (Twenty Two) ext4 auth_debug = yes auth_mechanisms = plain login digest-md5 cram-md5 auth_verbose = yes auth_verbose_passwords = yes default_internal_user = root imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_debug = yes mail_location = maildir:/home/vmail/%d/%n/Maildir maildir_very_dirty_syncs = yes mbox_write_locks = fcntl namespace { inbox = yes location = prefix = INBOX. separator = . type = private } namespace inbox { location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } postmaster_address = pmatos protocols = imap quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { mode = 0600 user = vmail } user = $default_internal_user } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = uid=5000 gid=5000 home=/home/vmail/%d/%n allow_all_users=yes driver = static } protocol lda { auth_socket_path = /var/run/dovecot/auth-master deliver_log_format = msgid=%m: %$ log_path = /home/vmail/dovecot-deliver.log } protocol imap { mail_max_userip_connections = 100 } Regards, Paulo Matos

2 2

PROXY protocol
by Hoggins! 26 Aug '15

26 Aug '15

Hello folks, Any plans on implementing the PROXY protocol to allow Dovecot being behind a TCP proxy, and still logging the real IP address of the users ? See : http://blog.haproxy.com/haproxy/proxy-protocol/ Thanks !

6 15

Shared Mailboxes Not Visible
by Mark Usrey 25 Aug '15

25 Aug '15

OK, gurus, I've spent the last 2 days crawling through all of the posts and web postings regarding shared folders, and I simply cannot get it to work. I'm sure that there is something simple that I've overlooked, but cannot for the life of me see it :) Here's my current config: # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-46-generic x86_64 Ubuntu 14.04.3 LTS xfs auth_mechanisms = plain login debug_log_path = /var/log/debug.log listen = * mail_gid = mail mail_location = mdbox:/mail/data/private/%n:INDEX=/mail/index/private/%n mail_plugins = acl notify mail_log stats mail_privileged_group = mail namespace { list = children location = mdbox:/mail/data/shared/%%n:INDEXPVT=/mail/index/private/%n/shared_indices/%%n prefix = Shared/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/mail/dict/shared-mailboxes autocreate = Trash autocreate2 = Spam autocreate3 = Drafts autocreate4 = Junk autosubscribe = Trash autosubscribe2 = Spam autosubscribe3 = Drafts autosubscribe4 = Junk mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid size subject stats_refresh = 30 secs stats_track_cmds = yes } protocols = " imap lmtp" service auth { unix_listener /var/spool/postfix/private/auth { user = postfix } } service dict { unix_listener dict { group = mail mode = 0600 user = root } } service imap-login { process_min_avail = 5 service_count = 0 } service imap { process_limit = 4096 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service stats { fifo_listener stats-mail { group = mail mode = 0660 user = root } } ssl_ca = </etc/dovecot/thawte2.crt ssl_cert = </etc/dovecot/dovecot2.pem ssl_key = </etc/dovecot/private/solaray-sunglasses.com.key userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { postmaster_address = postmaster(a)solaray-sunglasses.com } protocol imap { mail_plugins = acl notify mail_log stats imap_acl imap_stats } All of our users are "real" (no virtual users or domains) and only a single domain supported. We have a user, rself, that is attempting to share his inbox with a few others that also need access to it. So the corresponding ACL files: root@srv56:/mail/data/shared/rself# ls -la /mail/data/shared/rself/ total 20 drwx------ 4 rself mail 79 Aug 24 15:22 . drwxrwx--- 7 mail mail 71 Aug 24 16:01 .. -rw------- 1 rself mail 17 Aug 24 15:22 dovecot-acl-list drwx------ 10 rself mail 130 Aug 24 12:28 mailboxes drwx------ 2 rself mail 12288 Aug 25 16:25 storage -rw------- 1 rself mail 70 Aug 24 12:28 subscriptions And the contents of dovecot-acl-list: root@srv56:/mail/data/shared/rself# cat dovecot-acl-list 1440447778 INBOX root@srv56:/mail/data/shared/rself# And the mailbox-specific files: root@srv56:/mail/data/shared/rself/mailboxes/INBOX/dbox-Mails# ls -la total 4 drwx------ 2 rself mail 24 Aug 25 08:16 . drwx------ 3 rself mail 23 Aug 24 12:28 .. -rw------- 1 rself mail 24 Aug 24 15:22 dovecot-acl root@srv56:/mail/data/shared/rself/mailboxes/INBOX/dbox-Mails# Content: root@srv56:/mail/data/shared/rself/mailboxes/INBOX/dbox-Mails# cat dovecot-acl user=musrey akxeilprwts root@srv56:/mail/data/shared/rself/mailboxes/INBOX/dbox-Mails# Now, the global ACL dictionary (just a flat file, not enough users to justify SQL :) root@srv56:~# ls -la /mail/dict/ total 12 drwxrwxr-x 2 root mail 4096 Aug 24 18:05 . drwxr-xr-x 5 root root 4096 Aug 23 08:51 .. -rw-r--r-- 1 rself mail 40 Aug 24 18:05 shared-mailboxes And contents: root@srv56:~# cat /mail/dict/shared-mailboxes shared/shared-boxes/user/musrey/rself 1 root@srv56:~# So, as far as I can tell from my RTFM activities, I think the configuration is correct. Now, I go to attempt to check the ACL using doveadm, and I get this: root@srv56:~# doveadm acl debug -u musrey Shared/rself/INBOX doveadm(musrey): Error: Can't open mailbox Shared/rself/INBOX: Mailbox doesn't exist: Shared/rself/INBOX root@srv56:~# WTH, over? So, not thinking this is an ACL issue, but simply a namespace issue - either I have the shared namespace configured incorrectly, or I'm using it incorrectly in attempting to identify rself's INBOX when trying to verify that the ACL is working. So, I thought to myself, let's try a mailbox list, so I executed root@srv56:~# doveadm mailbox list -u musrey ACT! ACT!/General AES Outdoors AES Outdoors/Christy AES Outdoors/Gwen .... (many, many mailboxes in here - I should probably eliminate some of them :) VMWare Watchguard Xata Corporation Xata Corporation/Mike Brossman Xata Corporation/Mike Uremovich INBOX root@srv56:~# But no "Shared" or "rself" to be found. Help, please. I'm quickly going bald over this one. -- *Mark Usrey* Director of Information Technologies *Solaray LLC Solaray LLC* 620 S. Linden Sapulpa, Ok 74066 (918) 227-0722 Ext. 527

1 0

sieve_after seems to ignored ?
by Per Jessen 25 Aug '15

25 Aug '15

sieve and managesieve are both working fine, have been for years. Now I want to add a sieve_after script: /etc/dovecot/conf.d/90-sieve.conf : plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_before = sieve_after = ~/sieve/personal.sieve sieve_subaddress_sep = + } I have compiled ~/sieve/personal.sieve to ~/sieve/personal.svbin, but it doesn't seem to be read. Any hints? thanks Per Jessen -- Per Jessen, Zürich (17.2°C) http://www.hostsuisse.com/ - dedicated server rental in Switzerland.

3 6

ldap attribute modifiers. how to lowercase non ASCII
by matthias lay 24 Aug '15

24 Aug '15

hi all, I encountered some problem with lowercasing chars like an "Ä" with user_attrs like this: user_attrs = uid=home=/mail/%Lu, =myvar=%L{ldap:uid} the Ä doesnt get lower cased in both cases # doveadm user BLÄTULA field value user blÄtula uid vmail gid vmail home /mail/blÄtula mail maildir:~/Maildir:LAYOUT=fs:INBOX=~/Maildir/INBOX myvar blÄtula somebody knows if there a fix for that? Greetz Matze

2 2

Store ACL files within shared mailbox / rename shared folder problem
by Chris Laif 24 Aug '15

24 Aug '15

Hi. If $otheruser shares a mailbox to $myuser, my private index is stored in *my* Maildir, according to this template (from the dovecot docs): mail_location = maildir:%%h/Maildir:INDEXPVT=%h/Maildir/shared/%%u If $otheruser renames the shared mailbox, all my private mail flags (Seen) are lost because my mailclient couldn't find the private index anymore. Is there any way to store the private index within the shared mailbox? If $otheruser renames the mailbox, the index will be 'migrated' as well. Something like this: /data/mails/$otheruser/Maildir/.MagicSharedFolder/shared/$myuser.dovecot.index.pvt.log I see no way on how to do craft a INDEXPVT for this. Kind regards, Chris

2 1