- dovecot - dovecot.org

Migration from mbox/maildir++ to mdbox
by Nima Saed-Samii 28 Jul '14

28 Jul '14

Dear list, dovecot version: 2.1.7 I have an old mail server that uses mboxes for the INBOX and maildirs for subfolders. I want to migrate our mail handling to a new setup using mdboxes for everything. The current config looks like this: # 2.1.7: /etc/dovecot/dovecot.conf doveconf: Warning: service anvil { client_limit=1000 } is lower than required under max. load (1127) # OS: Linux 3.2.0-0.bpo.4-686-pae i686 Debian 6.0.10 auth_mechanisms = plain login disable_plaintext_auth = no first_valid_uid = 114 log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = mbox:~/Mail/MBox:INBOX=/var/mail/%u mail_max_userip_connections = 30 mail_privileged_group = mail namespace { hidden = yes inbox = yes list = no location = prefix = "#mbox/" separator = / } namespace { location = maildir:~/Mail/Maildir prefix = separator = / } passdb { args = dovecot driver = pam } protocols = imap service auth { client_limit = 1024 user = root } service imap-login { inet_listener imap { port = 0 } process_limit = 1024 } ssl_cert = </etc/ssl/certs/cert-imap.ikp.pem ssl_key = </etc/ssl/private/key-imap.ikp.pem ssl_key_password = ********* userdb { driver = passwd } I would like to use dsync to migrate all to mdboxes and transfer them to the new system. Unfortunately I can't get dsync to do that. Using a config that specifies only one namespace allows me to convert either mboxes or Maildirs to mdboxes but not both. Using the above config dsync somehow thinks the source and destination are the same: Syncing mailbox for user nima (136 MB) Setup done. doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_zlib_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so doveadm(nima): Debug: Effective uid=5224, gid=1162, home=/home/nima doveadm(nima): Debug: Namespace mboxes: type=private, prefix=#mbox/, sep=/, inbox=yes, hidden=no, \ list=yes, subscriptions=yes location=mbox:~/Mail/MBox:INBOX=/var/mail/nima doveadm(nima): Debug: fs: root=/home/nima/Mail/MBox, index=, control=, inbox=/var/mail/nima, alt= doveadm(nima): Debug: Namespace maildirs: type=private, prefix=, sep=/, inbox=no, hidden=no, list=yes, \ subscriptions=yes location=maildir:~/Mail/Maildir doveadm(nima): Debug: maildir++: root=/home/nima/Mail/Maildir, index=, control=, inbox=, alt= dsync(nima): Debug: Effective uid=5224, gid=1162, home=/home/nima dsync(nima): Debug: Namespace mboxes: type=private, prefix=#mbox/, sep=/, inbox=yes, hidden=no, list=yes, \ subscriptions=yes location=mdbox:/scratch/mail-convert/nima dsync(nima): Debug: fs: root=/scratch/mail-convert/nima, index=, control=, inbox=, alt= dsync(nima): Debug: Namespace #mbox/: Using permissions from /scratch/mail-convert/nima: mode=0700 gid=-1 dsync(nima): Debug: Namespace maildirs: type=private, prefix=, sep=/, inbox=no, hidden=no, list=yes, \ subscriptions=yes location=maildir:~/Mail/Maildir dsync(nima): Debug: maildir++: root=/home/nima/Mail/Maildir, index=, control=, inbox=, alt= dsync(nima): Fatal: Both source and destination mail_location points to same directory: /home/nima/Mail/Maildir What am I doing wrong? Best regards, Nima Saed-Samii -- Institute for Nuclear Physics, University of Cologne Zuelpicher Str. 77 50937 Cologne Germany Tel.: +49-221-470-3617 Fax.: +49-221-470-5168 -- Institute for Nuclear Physics, University of Cologne Zuelpicher Str. 77 50937 Cologne Germany Tel.: +49-221-470-3617 Fax.: +49-221-470-5168

1 0

ACLs on Top level mailboxes.
by Dan Carroll 28 Jul '14

28 Jul '14

Hello, I’m in the process of migrating a mail server to new hardware. At the same time, I’ve made the decision to switch from courier to dovecot (v2.2.13) and from what I have seen so far I’m pretty happy. I have two questions for the list. I’d like my users mailboxes (Maildir format) to look like this: Inbox UserCreatedSubFolder1 UserCreatedSubFolder2 … Sent UserCreatedSubFolder3 Drafts Trash Junk Archives The Top level folders (Sent, Drafts etc) are all “Special” and I do not wish the users to be able to delete them. I also don’t want them to create new Top level folders. This will force all custom folders to be under a Top Level folder. The Maildir format currently looks like this: ~/Maildir/cur ~/Maildir/new ~/Maildir/tmp ~/Maildir/.INBOX/.UserCreatedSubFolder1/cur ~/Maildir/.INBOX/.UserCreatedSubFolder1/new ~/Maildir/.INBOX/.UserCreatedSubFolder1/tmp ~/Maildir/.Sent/cur ~/Maildir/.Sent/new ~/Maildir/.Sent/tmp etc…. I can get ACLs working with dovecot-acl files, and the permission I need (I think is) “owner lrwstipe”. But if I put it into the ~/Maildir directory, then it applies to Inbox. I’ve tried creating an .INBOX dir and putting it in there but that did not work. I also tried some global-acl file settings but I could not make that work either. Basically, I’m wondering how to apply ACLs to the Top level and have different ACLs for the actual inbox when using this scheme. I’m not opposed to changing the Maildir format, but that would mean a lot of work re-doing proemial scripts. My second question relates to migration. Is it enough that I copy the Maildir structure and simply delete the courier files or is it a lot better to use a courier->dovecot migration tool? I realise folder subscriptions would be lost but that’s OK, I’ll recreate them manually anyway. Thanks for your time. -Dan

2 1

After upgrade from 2.1 to 2.2.13 clients can create folders with names containing slash character on a Linux system
by David Davidov 28 Jul '14

28 Jul '14

We have following issue: After upgrade from 2.1 to 2.2.13 clients can create folders with names containing slash character. This was not possible with our previous version 2.1. Tested. Our Dovecot runs on Debian Wheezy system. According http://wiki2.dovecot.org/Plugins/Listescape this should be disabled on a Posix system. We use the usual separator '.' as you can see in the config file later. Issue can be reproduced using outlook 2013. On the file system this is the representation of the "Family/Friends" folder /home/vpopmail/domains/0/example.org/steve/Maildir/.Family/Friends /home/vpopmail/domains/0/example.org/steve/Maildir/.Family/Friends/new /home/vpopmail/domains/0/example.org/steve/Maildir/.Family/Friends/tmp /home/vpopmail/domains/0/example.org/steve/Maildir/.Family/Friends/cur Doveadm does not lists properly the folder doveadm mailbox list -usteve(a)alltimes.com |grep -i Family INBOX.Family This is the server configuration: ----------------------- dovecot -n # 2.2.13: /dovecot/etc/dovecot/dovecot.conf # OS: Linux 3.2.59-grsec x86_64 Debian 7.6 auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890@!#$&\'*+=?^_`{|}~.-" base_dir = /var/run/dovecot/ disable_plaintext_auth = no listen = * login_log_format_elements = user=<%u> method=%m rip=%r lip=%l pid=%p %c mail_access_groups = vchkpw mail_fsync = never mail_plugins = quota stats namespace { inbox = yes location = maildir:~/Maildir:INDEX=/home/vpopmail/dovecot-indexes/%d/%n prefix = INBOX. separator = . type = private } passdb { args = /home/vpopmail/bin/chkpw driver = checkpassword } plugin { acl = vfile:/dovecot/acls quota = maildir quota_rule = INBOX.Trash:ignore stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 64 M stats_refresh = 30 secs stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours } protocols = imap pop3 service imap-login { executable = /dovecot/libexec/dovecot/imap-login inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } process_min_avail = 16 service_count = 0 } service imap { executable = /dovecot/libexec/dovecot/imap-ld-hack process_limit = 1500 vsz_limit = 256 M } service pop3-login { process_min_avail = 16 service_count = 0 } service pop3 { executable = /dovecot/libexec/dovecot/pop3-ld-hack process_limit = 1500 vsz_limit = 256 M } service stats { fifo_listener stats-mail { mode = 0600 user = vpopmail } } ssl_ca = </apache/conf/ssl.crt/server-ca.crt ssl_cert = </apache/conf/ssl.crt/server.crt ssl_cipher_list = ALL:-ADH:+HIGH:+MEDIUM:-LOW:-SSLv2:-EXP ssl_key = </apache/conf/ssl.key/server.key userdb { driver = vpopmail } userdb { driver = prefetch } protocol imap { imap_client_workarounds = mail_max_userip_connections = 100 mail_plugins = quota stats acl imap_quota imap_stats } protocol pop3 { mail_max_userip_connections = 100 mail_plugins = quota stats acl pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_enable_last = yes pop3_no_flag_updates = yes pop3_uidl_format = %f } ----------------------- We need a way to prevent creation of those folders, because our users create several of them a day. Any suggestions? regards, David Davidov

2 1

[pigeonhole] disregards --with-ldap=no during compilation
by Michael Grimm 28 Jul '14

28 Jul '14

Hi -- I can't get current dovecot and pigeonhole compiled; compilation stops with: | sieve-ldap-db.h:19:10: fatal error: 'ldap.h' file not found Ok, because my dovecot isn't compiled with ldap (--without-ldap), I tried to apply "--with-ldap=no" with configure as advertised in the INSTALL file of pigeonhole, but without success: [...] | ./sieve-ldap-db.h:19:10: fatal error: 'ldap.h' file not found | #include <ldap.h> | ^ | 1 error generated. | gmake[5]: *** [sieve-ldap-db.lo] Error 1 | gmake[5]: Leaving directory `/usr/local/etc/dovecot/SOURCE/dovecot-2.2-pigeonhole/src/lib-sieve/storage/ldap' [...] | gmake: *** [all] Error 2 My configure run logfile shows: [...] | config.status: creating src/lib-sieve/storage/ldap/Makefile [...] | script drivers . : file dict | : -ldap This happens at FreeBSD-STABLE (clang 3.4.1, gmake 3.82) with dovecot at 2d2d75ac6715 and pigeonhole at 1475892e8cff. Any ideas what went wrong? (I'm back to pigeonhole 0.4.3 (1c6130ff5dd6) for the time being.) Thanks and regards, Michael

4 6

Fwd: Disconnected (no auth attempts)
by Michael Pierce 28 Jul '14

28 Jul '14

Hi, Firstly, I'd like to apologise if this is really simple or the answers available easily. I have searched and tried to solve this alone but with no success. I'm having an issue with dovecot to which its reporting "Disconnected (no auth attempts)" in the info log file. From what I understand this is usually due to SSL not being enabled (however, ssl = required is in the config). I hope someone can help. I have included config file, and log file information below. Please and Thanks, Michael Pierce ps, apologies if I was supposed to pastebin these, I was not sure. *dovecot -n* # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 3.10.9-xxxx-grs-ipv6-64 x86_64 CentOS release 6.5 (Final) auth_debug_passwords = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_uid = 200 info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log mail_gid = 12 mail_uid = 200 passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocols = imap ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } *dovecot-sql.conf* driver = mysql connect = host=/var/run/mysqld/mysqld.sock dbname=mailreader_mail user=[removed] password=[removed] default_pass_scheme = SHA512 password_query = SELECT email as user, password, 'maildir:/home/mail'||maildir as userdb_mail FROM users WHERE email = '%u' dovecot-info.conf Jul 28 10:58:50 master: Info: Dovecot v2.0.9 starting up (core dumps disabled) Jul 28 10:58:59 auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Jul 28 10:58:59 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Jul 28 10:58:59 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Jul 28 10:58:59 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Jul 28 10:58:59 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Jul 28 10:58:59 auth: Debug: auth client connected (pid=22493) Jul 28 10:59:00 imap-login: Info: Disconnected (no auth attempts): rip=[removed], lip=[removed]

2 1

"Corrupted dbox file [...] purging found mismatched offsets"
by Jesus Cea 28 Jul '14

28 Jul '14

Doing a "doveadm purge" today I got this: """ doveadm(jcea): Error: Corrupted dbox file /home/jcea/.thunderbird/dovecot/storage/m.686 (around offset=1385772): purging found mismatched offsets (1385742 vs 1380664, 185/275) doveadm(jcea): Warning: fscking index file /home/jcea/.thunderbird/dovecot/storage/dovecot.map.index doveadm(jcea): Warning: mdbox /home/jcea/.thunderbird/dovecot/storage: rebuilding indexes doveadm(jcea): Error: Purging namespace '' failed: Internal error occurred. Refer to server log for more information. [2014-07-28 01:17:10] """ Checking the log I get this: """ Jul 28 01:17:18 ubuntu dovecot: imap(jcea): Error: /home/jcea//.thunderbird/dovecot/mailboxes/proveedores/dovecot/DbOx-mAiLs/dovecot.index reset, view is now inconsistent Jul 28 01:17:19 ubuntu dovecot: imap(jcea): Error: /home/jcea//.thunderbird/dovecot/mailboxes/varios/OpenStreetMap/osm-newbies/DbOx-mAiLs/dovecot.index reset, view is now inconsistent Jul 28 01:17:20 ubuntu dovecot: imap(jcea): Error: /home/jcea//.thunderbird/dovecot/mailboxes/varios/esc&AOk-pticos/DbOx-mAiLs/dovecot.index reset, view is now inconsistent """ Subsequent "doveadm purge" don't show anything. What happened and why?. Consequences?. Did I lose email? -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

1 1

mdbox "doveadm purge" strategy
by Jesus Cea 28 Jul '14

28 Jul '14

Hi there. I am using mdbox storage with great success but I am seeing something I find strange and I would like to compare notes with you. When doing "doveadm purge", "m.*" files with non deleted messages are left alone, but "m.*" files with deleted messages copy the "non deleted" messages to a newly created "m.*" file and delete the original. Good so far. What surprises me is that the newly created "m.*" files are not fullsize. they can be "small" files, not using the 2MB max size I have configured for mdbox storage. Moreover, those files stay in that size forever, no new messages are appended ever. I guess each old "m.*" file with deleted messages generates a new independent "m.*" containing only the non deleted messages. I wonder if that is the case and if that is a fundamental issue that can't be changed. I would like my "m.*" files to use the full configured mdbox size, instead of having quite a few of new SMALL "m.*" files. Thanks for your time and attention!. -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

1 0

struggling with pigeonhole date extensions
by Laeeth Isharc 27 Jul '14

27 Jul '14

I am struggling with how to use the date extension for Dovecot/Pigenhole implementation of Sieve email filtering language. I have read RFC 5260 several times and tried different things with no luck. I would like to place all messages this year up till the end of March into the specified mail folder. What the snippet below actually seems to do is take any messages this year (whether before or after March). Any thoughts? if allof(date :value "eq" :originalzone "date" "year" "2014", date :value "le" :originalzone "date" "month" "3") { fileinto "INBOX/2014 up to Mar"; stop; } Incidentally, it's puzzling how sparse the ecosystem seems to be for managing sieve scripts given the importance of email and the unmanageability of volumes these days without rules. What would be nice to have is something like the Outlook rule manager as a front end and server side sieve scripts on the back. I looked at Modoboa (which seems to be the only standalone option), but it's a bit heavy for my taste and I struggled to configure it in the time I had available. Thanks in advance.

2 1

IMAP forward boxes
by Andre Dietrich 26 Jul '14

26 Jul '14

Hi all, since a few weeks I'm experimenting with some "IMAP forward boxes", but I didn't find a satisfactory solution yet. Target function is a directory structure like following in a shared mailbox: /intern/users/fred /intern/users/ted /intern/users/alice The idea is, that a mail, moved to the directory "/intern/users/fred" via IMAP-client will be forwarded to "fred(a)test.domain" without modifying the mail (except the header line "delivered to:"). So if you get a mail in your inbox and want fred to answer it, you drag'n'drop it to /intern/users/fred. Fred gets the mail in his inbox and can answer it. To share all inboxes, to drop mails directly to them, is not an option, because I don't want everybody to see all other inboxes mails. Only to apply "-w-" ACL rights isn't an option either, because it seems to irritate the mail clients. Some month ago I had a partially working solution using a cron bash script. The script read the mails in the cur and new folders, processed the folders path and passed it to sendmail. It's ok, but it has to run quite often to get an adequate forwarding time and on sendmail errors mails got lost without any notification. It would be nice to have a dot-forward file in this subfolder (like in the qmail mailbox root), which is processed by dovecot when a mail is dropped in. Is it possible to solve this with a sieve script, a dot-forward file, or something similar ? I'm grateful for all solutions / ideas ! thx! Andre

1 1

Pigeonhole Sieve LDAP support
by Stephan Bosch 25 Jul '14

25 Jul '14

Hi, Yesterday, I committed two important and rather big changes to the Pigeonhole repository. The first creates a generic interface for implementing Sieve script storages. It was already possible to some extent to read Sieve scripts from other sources than the local filesystem, such as Dovecot dict, but that was still pretty limited, as it was not possible to do this with sieve_before/sieve_after. This is now supported. But, more importantly, ManageSieve did not support storing Sieve scripts on locations other than the local filesystem. Now, alternatives can be implemented. Still, I haven't actually implemented write access to a storage other than the local filesystem yet, but now this would be much easier to achieve. The second creates an LDAP script storage implementation. Much like the dict storage, it is still read-only. It can be compiled directly into the Sieve interpreter, and, alternatively, it can also be compiled as a plugin called sieve_storage_ldap. I've updated the documentation in the sources. For all Xi repository users: I added compilation of LDAP storage as a plugin. Read the INSTALL files and other files referenced therein for more information about how to use the plugin. The plugin is installed as part of the dovecot-ldap package. This is a rather big change, but it should all be backwards compatible in terms of configuration. If you have problems (I heard about one so far), please don't hesitate to notify me. Regards, Stephan.

2 2