June 2012 - dovecot - dovecot.org

[Dovecot] Sieve: Mailbox doesn't exist
by Stefan Fricke 12 Jun '12

12 Jun '12

I have just set up a mail server on Ubuntu, using Postfix and Dovecot 2.0.19. It works well but I can't get Sieve working. I always get the error that the target mailbox doesn't exist. In fact it doesn't but isn'r Dovecot supposed to create it? Here is my doveconf -n: # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-24-generic x86_64 Ubuntu 12.04 LTS mail_debug = yes mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH: +MEDIUM ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve postmaster_address = postmaster quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r }

3 2

[Dovecot] commercial support -- feedback
by Костырев Александр Алексеевич 12 Jun '12

12 Jun '12

good day! Did anybody in here decide to go for commercial support from Dovecot Solutions Oy ? I'd like to know if you are satisfied with what they provide? if time of support reaction is really as what is stated at their site and stuff like that.

1 0

[Dovecot] Authentication issue
by Emiliano Rago 12 Jun '12

12 Jun '12

Hi, I need to set up a weird dovecot configuration: 1) outside a ssl tunnel I'd like to authenticate only with cram-md5 scheme 2) inside a ssl tunnel I'd like to authenticate only with plain auth The first is easily satisfied with auth_mechanisms = plain cram-md5 disable_plaintext_auth = yes but I don't know how to satisfy the second condition, if it's possible. Thanks for help, Emiliano Rago

2 2

[Dovecot] Getting duplicates despite trying hard to match lock styles
by Richard Walker 12 Jun '12

12 Jun '12

I'm attempting to replace (a) a very old setup that has POP (qpopper) access to inboxes and a separate UW IMAP server that provides folders, with (b) a shiny new mail setup with dovecot providing both inboxes and IMAP support. For the new mail server I created a virtual machine running a minimal Fedora 16 installation and installed sendmail, MIMEDefang, SpamAssassin, ClamAV, procmail, and dovecot. I have kept installing updates as they become available. For now I'm running the old and new mail setups in parallel; I have configured the original sendmail server to forward copies of incoming messages to the new sendmail running on the virtual machine. I then compare the results (e.g., how spam filtering is working). I've kept as much as possible of the original _style_ of setup as possible, which in particular means using sendmail, and message delivery through procmail to mbox files in /var/spool/mail. The key difference is the use of dovecot to provide IMAP access to the inbox and IMAP folders. Because of the legacy setup, my desktop access to email is via Thunderbird 2.0.0.22 on a very old Mac PowerBook G4 to work with both old and new setups and I have two windows open to make comparison possible. (Yes, both mail servers are on separate computers, not on this notebook.) Mostly this is working fine (after a fair bit of tweaking, including adding custom SELinux rules to get rid of all AVCs). I put the notebook to sleep overnight, and in the morning I open it up and see what happens. After a few minutes, the window with the old setup does its POP fetch; the window with the new setup almost straightaway shows the new messages in its version of the inbox. Not quite: again, for legacy reasons I have some Thunderbird filters, and I have duplicated those (still within Thunderbird) for the new setup. The filters are: 1. Move messages tagged as spam by SpamAssassin to the Junk folder. 2. Move messages from GeoNetwork-related senders to a "GeoNetwork" folder. 3. Move all remaining messages to the "In" folder. Most mornings this works just fine. But not always. Sometimes I get duplicates in the "In" and "GeoNetwork" folders of the new dovecot-based setup. I used to get _garbled_ duplicates (with extra random bits of other messages at the end of the duplicates) in the new setup, which I presumed must be due to a locking configuration mismatch. Having fixed that (see below) I no longer get garbled duplicates, but I do still sometimes (including today) get identical duplicates. This seems to happen when one of the incoming messages has a very large attachment - but you may wish to treat that as hearsay. I attach below: 0. The line from /etc/mtab on the new server that covers the filesystem (i.e., including /var/spool and /home). 1. Output of "doveconf -n" and a note about how I modified locking from the Fedora default. 2. Output of "procmail -v". 3. Sendmail procmail mailer config (for good measure; I don't think you need this). 4. An excerpt from /var/log/maillog on the new server showing the beginning of dovecot processing this morning when I opened my notebook. 5. A link to the dovecot raw log files of my "INBOX" and "In" folder processing from this morning. You'll see from the dovecot log files that Thunderbird sends expunge commands, but the expunged messages hang around -- indeed, the same messages get expunged several times! And eventually they get fetched again -- hence the duplicates I see in Thunderbird. Given that INBOX.out contains: 08:56:53.765423 * 537 EXISTS 08:56:53.765423 * 533 RECENT and then, after many expunges: 08:56:58.441341 * 16 EXPUNGE 08:56:58.441341 * 11 EXPUNGE 08:56:58.441341 * 3 EXPUNGE 08:56:58.441341 * 539 EXISTS 08:56:58.441341 * 536 RECENT 08:56:58.441341 9 OK Expunge completed. it looks like I still have a locking problem. I have tried very hard to understand the locking options in dovecot.conf and to match dovecot with procmail -- apparently, there is more to do. 0. The line from /etc/mtab for the filesystem: ---------- /dev/mapper/vg_f16i386serverbasic-lv_root / ext4 rw,seclabel,relatime,user_xattr,acl,barrier=1,data=ordered 0 0 ---------- 1. doveconf -n says: ---------- # 2.0.20: /etc/dovecot/dovecot.conf # OS: Linux 3.3.6-3.fc16.i686.PAE i686 Fedora release 16 (Verne) mail_debug = yes mail_privileged_group = mail namespace { hidden = yes inbox = yes list = no location = mbox:~/mail:INBOX=/var/spool/mail/%u prefix = "#mbox/" separator = / type = private } namespace { inbox = no location = maildir:~/Maildir prefix = separator = / type = private } passdb { driver = pam } service imap-login { inet_listener imap { address = localhost } } service imap { executable = imap postlogin } service pop3-login { inet_listener pop3 { address = localhost } } service postlogin { executable = script-login -d rawlog -t } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } ---------- Note that the default Fedora installation specifies: mbox_write_locks = fcntl and I commented that out. This seems to restore the default setting of: mbox_write_locks = dotlock fcntl to match procmail. 2. procmail -v (run as me) says: ---------- procmail v3.22 2001/09/10 Copyright (c) 1990-2001, Stephen R. van den Berg <srb(a)cuci.nl> Copyright (c) 1997-2001, Philip A. Guenther <guenther(a)sendmail.com> Submit questions/answers to the procmail-related mailinglist by sending to: <procmail-users(a)procmail.org> And of course, subscription and information requests for this list to: <procmail-users-request(a)procmail.org> Locking strategies: dotlocking, fcntl() Default rcfile: $HOME/.procmailrc It may be writable by your primary group Your system mailbox: /var/spool/mail/rw ---------- (There is no $HOME/.procmailrc or other system-wide procmailrc.) 3. The mailer as defined in sendmail.cf says: ---------- Mlocal, P=/usr/bin/procmail, F=lsDFMAw5:/|@qSPfhn9, S=EnvFromL/HdrFromL, R=EnvToL/HdrToL, T=DNS/RFC822/X-Unix, A=procmail -t -Y -a $h -d $u ---------- 4. The relevant lines from /var/log/maillog: ---------- Jun 12 08:56:53 localhost dovecot: imap-login: Login: user=<rw>, method=PLAIN, rip=192.168.2.200, lip=192.168.2.188, mpid=21618, TLS Jun 12 08:56:53 localhost dovecot: imap(rw): Debug: Effective uid=1000, gid=100, home=/home/rw Jun 12 08:56:53 localhost dovecot: imap(rw): Debug: Namespace : type=private, prefix=#mbox/, sep=/, inbox=yes, hidden=yes, list=no, subscriptions=yes location=mbox:~/mail:INBOX=/var/spool/mail/rw Jun 12 08:56:53 localhost dovecot: imap(rw): Debug: fs: root=/home/rw/mail, index=, control=, inbox=/var/spool/mail/rw, alt= Jun 12 08:56:53 localhost dovecot: imap(rw): Debug: Namespace : type=private, prefix=, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir Jun 12 08:56:53 localhost dovecot: imap(rw): Debug: maildir++: root=/home/rw/Maildir, index=, control=, inbox=, alt= Jun 12 08:56:58 localhost dovecot: imap-login: Login: user=<rw>, method=PLAIN, rip=192.168.2.200, lip=192.168.2.188, mpid=21625, TLS Jun 12 08:56:58 localhost dovecot: imap(rw): Debug: Effective uid=1000, gid=100, home=/home/rw Jun 12 08:56:58 localhost dovecot: imap(rw): Debug: Namespace : type=private, prefix=#mbox/, sep=/, inbox=yes, hidden=yes, list=no, subscriptions=yes location=mbox:~/mail:INBOX=/var/spool/mail/rw Jun 12 08:56:58 localhost dovecot: imap(rw): Debug: fs: root=/home/rw/mail, index=, control=, inbox=/var/spool/mail/rw, alt= Jun 12 08:56:58 localhost dovecot: imap(rw): Debug: Namespace : type=private, prefix=, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir Jun 12 08:56:58 localhost dovecot: imap(rw): Debug: maildir++: root=/home/rw/Maildir, index=, control=, inbox=, alt= Jun 12 08:57:03 localhost dovecot: imap-login: Login: user=<rw>, method=PLAIN, rip=192.168.2.200, lip=192.168.2.188, mpid=21632, TLS Jun 12 08:57:03 localhost dovecot: imap(rw): Debug: Effective uid=1000, gid=100, home=/home/rw Jun 12 08:57:03 localhost dovecot: imap(rw): Debug: Namespace : type=private, prefix=#mbox/, sep=/, inbox=yes, hidden=yes, list=no, subscriptions=yes location=mbox:~/mail:INBOX=/var/spool/mail/rw Jun 12 08:57:03 localhost dovecot: imap(rw): Debug: fs: root=/home/rw/mail, index=, control=, inbox=/var/spool/mail/rw, alt= Jun 12 08:57:03 localhost dovecot: imap(rw): Debug: Namespace : type=private, prefix=, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir Jun 12 08:57:03 localhost dovecot: imap(rw): Debug: maildir++: root=/home/rw/Maildir, index=, control=, inbox=, alt= ---------- 5. dovecot raw logs for "INBOX" and "In". Because I have trouble comparing times in epoch format, I've run the logs through a little filter that replaces the timestamps at the beginning of each line with a timestamp in HH:MM:SS.nanosecond format in local time. I've carefully deleted lots of (what I hope are) lines you don't need from the logs. E.g., I deleted the middle section of a block of FETCH statements, leaving the first few and the last few. Please let me know if I deleted too much -- I was trying to be helpful. And of course I replaced e-mail address/subject lines/etc with XXXXXXXXXX. Although the Thunderbird filters are "supposed" to be run in the order I listed above, it seems that Thunderbird fetches all headers, works out what messages should be filtered to which folders, and then sends corresponding IMAP commands that copy the messages to the other folders in a _different_ order of the filters. (I.e., the INBOX log shows copy/store/expunge operations in the order "In", "Junk", then "GeoNetwork", rather than "Junk", "GeoNetwork", "In".) I have renamed the in/out log files as INBOX.in, INBOX.out, In.in, In.out and uploaded them to: https://sites.google.com/site/rwdownloadssite/dovecot-logs Thanks in advance to anyone who is willing to take a look and advise what I need to do.

1 1

[Dovecot] Dovecot auth process delays exiting if LDAPS passdb used
by SATOH Fumiyasu 11 Jun '12

11 Jun '12

Hi, I'm using Dovecot 2.1.6 and LDAP server as a backend for Postfix SMTP-Auth (SASL) on Debian GNU/Linux (wheezy), Solaris 10 and AIX 6.1/7.1. If Dovecot passdb is configured with LDAP (no TLS/SSL), it is no problem. But if Dovecot passdb is configured with LDAPS (or LDAP+TLS), Dovecot auth process has a problem that Dovecot auth delays exiting about between 20 and 60 seconds when Dovecot dovecot (master) process is already terminated by an administrator. Is this known problem? On AIX, this problem prevents restart Dovecot service by the following error: May 24 00:42:03 build-aix6 mail:warn|warning dovecot: master: Warning: Killed with signal 15 (by pid=11337890 uid=0 code=kill) May 24 00:42:10 build-aix6 mail:err|error dovecot: master: Error: service(auth): Socket already exists: /opt/osstech/var/run/dovecot/auth-login May 24 00:42:11 build-aix6 mail:crit dovecot: master: Fatal: Failed to start listeners My Dovecot 2.1.6 platforms are: * Debian GNU/Linux wheezy + OpenLDAP 2.4.28 (linked with GNU TLS 2.12.18) * Solaris 10 + OpenLDAP 2.4.26 (linked with OpenSSL 0.9.7) * AIX 6.1 + OpenLDAP 2.4.31 (linked with OpenSSL 1.0.0) * AIX 7.1 + OpenLDAP 2.4.28 (linked with OpenSSL 1.0.0) Because I see the problem on the all of above, there is a bug in Dovecot 2.1.6, I think. Thanks. -- -- Name: SATOH Fumiyasu (fumiyas @ osstech co jp) -- Business Home: http://www.OSSTech.co.jp/ -- Personal Home: http://www.SFO.jp/blog/

2 9

[Dovecot] fts_lucene crashing
by Joe Beaubien 11 Jun '12

11 Jun '12

I found this in mail.err. Anyone ever experience this? May 22 14:51:51 mba dovecot: imap(formulaire): Panic: file lucene-wrapper.cc: line 196: unreached May 22 14:51:51 mba dovecot: imap(formulaire): Error: Raw backtrace: /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot.so.0(+0x4200a) [0x7f7e0edfd00a] -> /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot.so.0(+0x4204e) [0x7f7e0edfd04e] -> /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f7e0edd43c0] -> /opt/dovecot/lib/dovecot/lib21_fts_lucene_plugin.so(+0x850e) [0x7f7e0d57a50e] -> /opt/dovecot/lib/dovecot/lib21_fts_lucene_plugin.so(+0xa7be) [0x7f7e0d57c7be] -> /opt/dovecot/lib/dovecot/lib21_fts_lucene_plugin.so(+0xa952) [0x7f7e0d57c952] -> /opt/dovecot/lib/dovecot/lib21_fts_lucene_plugin.so(lucene_index_lookup+0x7b) [0x7f7e0d57ce0b] -> /opt/dovecot/lib/dovecot/lib21_fts_lucene_plugin.so(+0x73a7) [0x7f7e0d5793a7] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(fts_backend_lookup+0x63) [0x7f7e0d98ece3] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xa32d) [0x7f7e0d99232d] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(fts_search_lookup+0xa6) [0x7f7e0d992a26] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xba25) [0x7f7e0d993a25] -> /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x27) [0x7f7e0f0c1957] -> dovecot/imap() [0x4158a7] -> dovecot/imap() [0x415c62] -> /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xc4) [0x7f7e0ee09cd4] -> /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x5b) [0x7f7e0ee0ac2b] -> /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f7e0ee09998] -> /opt/dovecot-2.1.6-lucene/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f7e0edf6233] -> dovecot/imap(main+0x285) [0x4086e5] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xed) [0x7f7e0ea1f76d] -> dovecot/imap() [0x40885d] May 22 14:51:51 mba dovecot: imap(formulaire): Fatal: master: service(imap): child 32761 killed with signal 6 (core dumped) I get these errors very very often. When I look at lucene-wrapper.cc source code I see the following 196: if (uni_utf8_to_ucs4(str, &dest_arr) < 0) i_unreached(); Any ideas? -Joe

2 6

[Dovecot] Director problems
by Joseba Torre 11 Jun '12

11 Jun '12

Hi, I've just setup a testing enviroment for director, and it's not working as expected. I have just 1 director (called director) and 2 dovecot servers (dovecot1 and dovecot2); these are exact copies. First problem: when both dovecot servers are up, every imap connection is redirected to the same server as you can see here: $ sudo doveadm director map user mail server ip expire time <unknown> 158.227.4.186 2012-06-06 13:34:12 <unknown> 158.227.4.186 2012-06-06 13:34:27 <unknown> 158.227.4.186 2012-06-06 13:34:34 (I don't know if that <unknown> is good or not) I've tried with 3 different users and ips to no change, users are always directed to the same host. Second problem: if I try to add/remove/modify one of the dovecot servers, the output of doveadm director map/status seems to be ok, but any new user connection fails with this log: Jun 6 14:51:59 director dovecot: director: Warning: Delaying new user requests until ring is synced Jun 6 14:52:27 director dovecot: director: Error: director: User test1 host lookup failed: Timeout - queued for 30 secs (Ring not synced for 73 secs) Jun 6 14:52:31 director dovecot: imap-login: Aborted login (auth failed, 1 attempts in 34 secs): user=<>, method=PLAIN, rip=158.227.4.186, lip=158.227.4.185, TLS, session=<Oyx9O83B/wCe4wS6> Any clue? This is the dovecot config -n output: # 2.1.7: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-220.17.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.2 (Santiago) director_mail_servers = dovecot1.example dovecot2.example director_servers = director.example lmtp_proxy = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = proxy=y nopassword=y starttls=any-cert driver = static } service auth { unix_listener auth-userdb { group = mail mode = 0660 user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director service_count = 0 } service lmtp { client_limit = 1 inet_listener lmtp { port = 24 } unix_listener /var/lib/dovecot/lmtp-socket { group = root mode = 0600 user = root } } service pop3-login { executable = pop3-login director service_count = 0 } service pop3 { process_limit = 5000 } shutdown_clients = no ssl_cert = </etc/ssl/private/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } verbose_proctitle = yes version_ignore = yes protocol lmtp { auth_socket_path = director-userdb } protocol imap { mail_max_userip_connections = 100 }

2 4

[Dovecot] multi-instance doveadm user -m woes
by David Warden 11 Jun '12

11 Jun '12

I'm having difficulty with the doveadm who command on a multi-instance setup of dovecot. When I run the who command on the non-standard instance with the -m flag (to see their mail location), this happens: [root@wardentest3 dovecot]# doveadm -i mailtest user -m warden doveadm(root): Error: user warden: Initialization failed: Namespace 'INBOX.': Ambiguous mail location setting, don't know what to do with it: /var/spool/mail/root (try prefixing it with mbox: or maildir:) I tried adding my mail_location setting as location to both of my legacy and default namespaces, but got the same error. I also tried adding the -a flag like so: doveadm user -a /var/run/dovecot/mailtest/auth-userdb -m warden doveadm(root): Error: userdb lookup: connect(/var/run/dovecot/auth-userdb) failed: Connection refused (the default instance is currently stopped) and combining -a and -i out of curiosity: [root@wardentest3 conf.d]# doveadm -i mailtest user -a /var/run/dovecot/mailtest/auth-userdb -m warden doveadm(root): Error: user warden: Initialization failed: Namespace 'INBOX.': Ambiguous mail location setting, don't know what to do with it: /var/spool/mail/root (try prefixing it with mbox: or maildir:) I have 2 instances, default and mailtest: [root@wardentest3 conf.d]# doveadm instance list path name last used running /var/run/dovecot/mailtest mailtest 2012-05-11 10:57:16 yes /var/run/dovecot default 2012-05-11 10:54:09 no my doveconf -n for the mailtest instance: # 2.1.6: mailtest/dovecot.conf doveconf: Warning: service auth { client_limit=4096 } is lower than required under max. load (12288) doveconf: Warning: service anvil { client_limit=4096 } is lower than required under max. load (12291) # OS: Linux 2.6.32-220.13.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.2 (Santiago) nfs auth_cache_negative_ttl = 0 auth_cache_size = 16 M auth_gssapi_hostname = $ALL auth_krb5_keytab = /etc/dovecot/mailtest/mail.combined.keytab auth_master_user_separator = * auth_mechanisms = plain login gssapi auth_username_format = %Ln base_dir = /var/run/dovecot/mailtest/ default_client_limit = 4096 default_process_limit = 4096 deliver_log_format = msgid="%m" subject="%s" from="%f" size=%p result="%$" first_valid_uid = 0 hostname = mailtest.geneseo.edu instance_name = mailtest lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_log_format_elements = user=%u method=%m rip=%r lip=%l lport=%a mpid=%e encryption=%c mail_fsync = always mail_location = maildir:/Mail/mailhome/%Ln/mailtest/Maildir:CONTROL=/Mail/mailhome/%Ln/mailtest/.dovecot-control:INDEX=/Mail/mailhome/%Ln/mailtest/.dovecot-index mail_log_prefix = "service=%s user=%u rip=%r " mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = zlib quota mail_log notify fts fts_squat stats maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl mmap_disable = yes namespace default { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = no special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . subscriptions = yes type = private } namespace legacy { alias_for = hidden = yes inbox = no list = no location = mailbox INBOX.Drafts { auto = no special_use = \Drafts } mailbox INBOX.Junk { auto = no special_use = \Junk } mailbox INBOX.Sent { auto = no special_use = \Sent } mailbox INBOX.Trash { auto = no special_use = \Trash } prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes } passdb { args = cache_key=%u dovecot driver = pam } plugin { fts = squat mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid size from subject flags mail_log_group_events = yes quota = maildir:User quota quota_exceeded_message = Quota exceeded (mailbox for user is full). Please see http://go.geneseo.edu/emailoverquota for help deleting messages while over quota. quota_rule = *:storage=200M quota_rule2 = Trash:storage=+50M sieve = /Mail/mailhome/%Ln/mailtest/.filter.sieve sieve_dir = /Mail/mailhome/%Ln/mailtest/.sievedir sieve_max_redirects = 25 stats_memory_limit = 32 M stats_refresh = 30 secs stats_track_cmds = yes } postmaster_address = postmaster(a)geneseo.edu protocols = imap sieve lmtp quota_full_tempfail = yes service auth { unix_listener auth-exim { group = exim mode = 0660 } } service doveadm { inet_listener { port = 12345 } } service imap-login { inet_listener imap { port = 1143 } inet_listener imaps { port = 1993 } service_count = 0 vsz_limit = 256 M } service imap { process_limit = 4096 } service lmtp { inet_listener lmtp { port = 124 } } service managesieve-login { inet_listener sieve { port = 14190 } inet_listener sieve_deprecated { port = 12000 } inet_listener sieves { port = 14191 ssl = yes } } service pop3 { process_limit = 4096 } service stats { fifo_listener stats-mail { mode = 0666 } } ssl_ca = </etc/pki/tls/certs/geotrust-intermediate.pem ssl_cert = </etc/pki/tls/certs/wildcard-geotrust.geneseo.edu.pem ssl_key = </etc/pki/tls/private/wildcard-geotrust.geneseo.edu.key userdb { driver = passwd } verbose_proctitle = yes protocol lmtp { mail_plugins = zlib quota mail_log notify fts fts_squat stats sieve } protocol lda { mail_location = maildir:/Mail/mailhome/%Ln/mailtest/Maildir:CONTROL=/Mail/mailhome/%Ln/mailtest/.dovecot-control:INDEX=/Mail/mailhome/%Ln/mailtest/.dovecot-index mail_plugins = zlib quota mail_log notify fts fts_squat stats sieve plugin { quota = maildir:User quota quota_rule = *:storage=200M quota_rule2 = Trash:storage=+50M zlib_save = gz zlib_save_level = 6 } } protocol imap { imap_logout_format = bytes(in/out)=%i/%o mail_max_userip_connections = 50 mail_plugins = zlib quota mail_log notify fts fts_squat stats imap_quota imap_zlib imap_stats } protocol sieve { managesieve_logout_format = bytes(in/out)=%i/%o } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_logout_format = bytes(in/out)=%i/%o, top=%t/%p, retr=%r/%b, del=%d/%m, mailbox-size=%s pop3_uidl_format = UID%u-%v } remote 137.238.0.0/16/16 { disable_plaintext_auth = no } local 137.238.2.0/24/24 { doveadm_password = *scrub* } …and for the default instance: # 2.1.6: /etc/dovecot/dovecot.conf doveconf: Warning: service auth { client_limit=4096 } is lower than required under max. load (12288) doveconf: Warning: service anvil { client_limit=4096 } is lower than required under max. load (12291) # OS: Linux 2.6.32-220.13.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.2 (Santiago) nfs auth_cache_negative_ttl = 0 auth_cache_size = 16 M auth_gssapi_hostname = $ALL auth_krb5_keytab = /etc/dovecot/mailtest.combined.keytab auth_master_user_separator = * auth_mechanisms = plain login auth_username_format = %Ln default_client_limit = 4096 default_process_limit = 4096 deliver_log_format = msgid="%m" subject="%s" from="%f" size=%p result="%$" first_valid_uid = 0 hostname = mail.geneseo.edu instance_name = default lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_log_format_elements = user=%u method=%m rip=%r lip=%l lport=%a mpid=%e encryption=%c mail_location = maildir:/Mail/mailhome/%Ln/Maildir:CONTROL=/Mail/mailhome/%Ln/.dovecot:INDEX=/var/cache/dovecot/mailtestindexes/%Ln/.dovecot-index mail_log_prefix = "service=%s user=%u rip=%r " mail_nfs_storage = yes mail_plugins = zlib quota mail_log notify fts fts_squat stats maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace default { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = no special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . subscriptions = yes type = private } namespace legacy { alias_for = hidden = yes inbox = no list = no location = mailbox INBOX.Drafts { auto = no special_use = \Drafts } mailbox INBOX.Junk { auto = no special_use = \Junk } mailbox INBOX.Sent { auto = no special_use = \Sent } mailbox INBOX.Trash { auto = no special_use = \Trash } prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes } passdb { args = cache_key=%u dovecot driver = pam } plugin { fts = squat mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid size from subject flags mail_log_group_events = yes quota = fs:User quota quota_exceeded_message = Quota exceeded (mailbox for user is full). Please see http://go.geneseo.edu/emailoverquota for help deleting messages while over quota. sieve = /Mail/mailhome/%Ln/.filter.sieve sieve_dir = /Mail/mailhome/%Ln/.sievedir sieve_max_redirects = 25 stats_memory_limit = 32 M stats_refresh = 5 secs stats_track_cmds = yes } postmaster_address = postmaster(a)geneseo.edu protocols = imap sieve lmtp quota_full_tempfail = yes service auth { unix_listener auth-exim { group = exim mode = 0660 } } service imap-login { inet_listener imap_mygeneseo { port = 144 } service_count = 0 vsz_limit = 256 M } service imap { process_limit = 4096 } service lmtp { inet_listener lmtp { port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } inet_listener sieves { port = 4191 ssl = yes } } service pop3 { process_limit = 4096 } service stats { fifo_listener stats-mail { mode = 0666 } } ssl_ca = </etc/pki/tls/certs/geotrust-intermediate.pem ssl_cert = </etc/pki/tls/certs/wildcard-geotrust.geneseo.edu.pem ssl_key = </etc/pki/tls/private/wildcard-geotrust.geneseo.edu.key userdb { driver = passwd } verbose_proctitle = yes protocol lmtp { mail_plugins = zlib quota mail_log notify fts fts_squat stats sieve } protocol lda { mail_location = maildir:/Mail/mailhome/%Ln/Maildir:CONTROL=/Mail/mailhome/%Ln/.dovecot:INDEX=/var/cache/dovecot/mailtestindexes/%Ln/.dovecot-index mail_plugins = zlib quota mail_log notify fts fts_squat stats sieve plugin { quota = fs:User quota } } protocol imap { imap_logout_format = bytes(in/out)=%i/%o mail_max_userip_connections = 50 mail_plugins = zlib quota mail_log notify fts fts_squat stats quota imap_quota imap_zlib fts imap_stats } protocol sieve { managesieve_logout_format = bytes(in/out)=%i/%o } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_logout_format = bytes(in/out)=%i/%o, top=%t/%p, retr=%r/%b, del=%d/%m, mailbox-size=%s pop3_uidl_format = UID%u-%v } remote 137.238.0.0/16/16 { disable_plaintext_auth = no }

2 2

[Dovecot] dsync migration with preserving pop3 uidl
by Tomáš Herceg 11 Jun '12

11 Jun '12

Hi all, I'm trying to migrate messages from icewarp (merak) mailserver to dovecot via dsync, IMAP migration is looking fine, but I'm unable to migrate pop3 uidls from originating server, probably is something wrong with configuration, but I don't know what. The only documentation i found is on the wiki: http://wiki2.dovecot.org/Migration/Dsync where is bad writen mail_plugins = pop3-migration, i corrected it to mail_plugins = pop3_migration, but it still didn't work, here is my configuration: dovecot --version 2.1.5 dovecot -n # 2.1.5: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-220.13.1.el6.centos.plus.x86_64 x86_64 CentOS release 6.2 (Final) auth_mechanisms = PLAIN LOGIN dict { acl = mysql:/etc/dovecot/dovecot-share-folder.conf expire = db:/var/lib/dovecot/expire/expire.db quotadict = mysql:/etc/dovecot/dovecot-used-quota.conf } disable_plaintext_auth = no imapc_features = rfc822.size imapc_host = **originating_server** last_valid_uid = 500 listen = * log_path = /var/log/dovecot.log mail_fsync = never mail_gid = 500 mail_location = maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/ mail_uid = 500 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment ma ilbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:/%%Lh/Maildir/:INDEX=/%%Lh/Maildir/Shared/%%u prefix = Shared/%%u/ separator = / subscriptions = yes type = shared } namespace { hidden = yes list = yes location = pop3c: prefix = POP3/ } passdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl auth_socket_path = /var/run/dovecot/auth-master autocreate = INBOX autocreate2 = Sent autocreate3 = Trash autocreate4 = Drafts autocreate5 = Spam autosubscribe = INBOX autosubscribe2 = Sent autosubscribe3 = Trash autosubscribe4 = Drafts autosubscribe5 = Spam expire = Trash 7 Trash/* 7 Spam 30 expire_dict = proxy::expire pop3_migration_mailbox = POP3/INBOX quota = dict:user::proxy::quotadict quota_rule = *:storage=1G quota_warning = storage=85%% quota-warning 85 %u quota_warning2 = storage=90%% quota-warning 90 %u quota_warning3 = storage=95%% quota-warning 95 %u sieve = /%Lh/sieve/dovecot.sieve sieve_dir = /%Lh/sieve sieve_global_dir = /home/mail/sieve sieve_global_path = /home/mail/sieve/dovecot.sieve zlib_save = bz2 zlib_save_level = 9 } pop3c_host = **originating_server** protocols = pop3 imap sieve service auth { unix_listener /var/spool/postfix/dovecot-auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { group = vmail mode = 0666 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service quota-warning { executable = script /usr/local/bin/dovecot-quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } } ssl_cert = </etc/pki/tls/certs/iRedMail_CA.pem ssl_key = </etc/pki/tls/private/iRedMail.key userdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } protocol lda { auth_socket_path = /var/run/dovecot/auth-master lda_mailbox_autocreate = yes log_path = /var/log/sieve.log mail_plugins = quota sieve autocreate zlib postmaster_address = root } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = quota imap_quota autocreate zlib } protocol pop3 { mail_plugins = quota zlib pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol doveadm { mail_plugins = pop3_migration } I'm runnig dsync this way: /usr/bin/time -f "%E" doveadm -vD -o imapc_user=test1(a)irock.cz -o imapc_password=***** backup -u test1(a)irock.cz -f -R imapc:/tmp-ram/imapc-test1 doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intention al, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_lookup (this is usually i ntentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually int entional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(test1(a)irock.cz): Debug: Added userdb setting: plugin/quota_rule=*:bytes=20971520000 doveadm(test1(a)irock.cz): Debug: Effective uid=500, gid=500, home=/home/mail/i/irock.cz/test1/ doveadm(test1(a)irock.cz): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir://home/mail/i/irock.cz/test1//Maildir/:INDEX=//home/mail/i/irock.cz/test1//Maildir/ doveadm(test1(a)irock.cz): Debug: maildir++: root=//home/mail/i/irock.cz/test1//Maildir, index=, control=, inbox=//home/mail/i/irock.cz/test1//Maildir, alt= doveadm(test1(a)irock.cz): Debug: Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/Shared/%u doveadm(test1(a)irock.cz): Debug: shared: root=/var/run/dovecot, index=, control=, inbox=, alt= doveadm(test1(a)irock.cz): Debug: Namespace : type=private, prefix=POP3/, sep=, inbox=no, hidden=yes, list=yes, subscriptions=yes location=pop3c: doveadm(test1(a)irock.cz): Debug: fs: root=, index=, control=, inbox=, alt= dsync(test1(a)irock.cz): Debug: Effective uid=500, gid=500, home=/home/mail/i/irock.cz/test1/ dsync(test1(a)irock.cz): Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=imapc:/tmp-ram/imapc-test1 dsync(test1(a)irock.cz): Debug: imapc: root=/tmp-ram/imapc-test1, index=, control=, inbox=, alt= dsync(test1(a)irock.cz): Debug: maildir++: root=/tmp-ram/imapc-test1, index=, control=, inbox=, alt= dsync(test1(a)irock.cz): Debug: imapc(**originating_server**:143): Looking up IP address dsync(test1(a)irock.cz): Debug: imapc(**originating_server**:143): Connecting to 95.168.205.4:143 dsync(test1(a)irock.cz): Debug: imapc(**originating_server**:143): Server capabilities: IMAP4rev1 AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5 AUTH=NTLM AUTH=GSSAPI SORT THREAD=ORDEREDSUBJECT UIDPLUS QUOTA ACL NAMESPACE CHILDREN IDLE ID UNSELECT METADATA X-ICEWARP-SERVER X-MOVE MSEARCH XLIST CREATE-SPECIAL-USE STARTTLS dsync(test1(a)irock.cz): Debug: imapc(**originating_server**:143): Authenticating as test1(a)irock.cz dsync(test1(a)irock.cz): Debug: imapc(**originating_server**:143): Authenticated successfully dsync(test1(a)irock.cz): Debug: Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/Shared/%u dsync(test1(a)irock.cz): Debug: shared: root=/var/run/dovecot, index=, control=, inbox=, alt= dsync(test1(a)irock.cz): Debug: Namespace : type=private, prefix=POP3/, sep=, inbox=no, hidden=yes, list=yes, subscriptions=yes location=pop3c: dsync(test1(a)irock.cz): Debug: fs: root=, index=, control=, inbox=, alt= dsync(test1(a)irock.cz): Debug: Namespace : Using permissions from /tmp-ram/imapc-test1: mode=0700 gid=-1 dsync(test1(a)irock.cz): Debug: Namespace : Using permissions from //home/mail/i/irock.cz/test1//Maildir: mode=0700 gid=-1 dsync(test1(a)irock.cz): Error: stat((null)) failed: Bad address dsync(test1(a)irock.cz): Error: stat((null)) failed: Bad address dsync(test1(a)irock.cz): Debug: imapc(**originating_server**:143): Looking up IP address dsync(test1(a)irock.cz): Debug: imapc(**originating_server**:143): Connecting to 95.168.205.4:143 dsync(test1(a)irock.cz): Debug: imapc(**originating_server**:143): Server capabilities: IMAP4rev1 AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5 AUTH=NTLM AUTH=GSSAPI SORT THREAD=ORDEREDSUBJECT UIDPLUS QUOTA ACL NAMESPACE CHILDREN IDLE ID UNSELECT METADATA X-ICEWARP-SERVER X-MOVE MSEARCH XLIST CREATE-SPECIAL-USE STARTTLS dsync(test1(a)irock.cz): Debug: imapc(**originating_server**:143): Authenticating as test1(a)irock.cz dsync(test1(a)irock.cz): Debug: imapc(**originating_server**:143): Authenticated successfully dsync(test1(a)irock.cz): Debug: imapc(**originating_server**:143): Disconnected dsync(test1(a)irock.cz): Debug: imapc(**originating_server**:143): Disconnected 0:00.52 can somebody give me a hint how to use the pop3 migration plugin please? -- Best regards Tomas Herceg Linux System Administrator Red Hat Certified Engineer 111-070-975 tomas.herceg(a)stable.cz Stable.cz, s.r.o. | www.stable.cz www.stable.cz | www.kvapem.cz | www.multak.cz | www.otoman.cz

2 1

Re: [Dovecot] Different but probably related issue
by Johannes Berg 11 Jun '12

11 Jun '12

Hi Marc, [+list since I'm unlikely to be able to solve this problem myself] > I am trying to setup a debian testing (wheeze) mail server using > postfix, dovecot and amavisd-new with spamassassin. I have everything > working fine, using mdbox mailboxes and system users. As a final touch > for this setup, I wanted to be able to train the (global) bayes > database directly through IMAP. > > Hence, I installed your plugin (directly from the official debian > repositories) and set it up to report mails to spamassassin. I am > using the "pipe" backend to call a wrapper script, that stores the > mail into a temporary file and launches sa-learn to learn it. My tests > indicate that this is working properly. Ok, nice. > However, when the dovecot-antispam plugin is enabled, I have a weird > problem sending emails. This is, whenever my MUA tries to save the > just sent message to the "Sent" folder, dovecot shows the following > error: Hmm, ok, let's see > > --------------------------------------------------- > > Dovecot's error log: > > --------------------------------------------------- > > Jun 4 22:35:14 aiur dovecot: imap(user): Error: mdbox /home/user/.mdbox/mailboxes/Sent/dbox-Mails: map uid lost for uid 0 > > Jun 4 22:36:06 aiur dovecot: imap(user): Error: /home/user/.mdbox/mailboxes/Spam/dbox-Mails/dovecot.index reset, view is now inconsistent > > Jun 4 22:36:09 aiur dovecot: imap(user): Error: Log synchronization error at seq=8,offset=27592 for /home/user/.mdbox/storage/dovecot.map.index: Append with UID 56056, but next_uid = 56057 > > Jun 4 22:36:09 aiur dovecot: lda(user): Error: Log synchronization error at seq=8,offset=27592 for /home/user/.mdbox/storage/dovecot.map.index: Append with UID 56056, but next_uid = 56057 > > Jun 4 22:36:10 aiur dovecot: imap(user): Error: /home/user/.mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent > > > As a result, the MUA hangs for a while (some minute and a half). After > that it closes the IMAP session properly, but I am left with two > copies of the sent email in the "Sent" folder: one that is marked as > unread and one that is not. Curious. I think the problem is likely the mdbox storage... There have always been some issues with it and the antispam plugin when combined. The first issue was that we couldn't access the raw text or something ... not sure what's up now. > > IMAP Conversation (as logged by roundcube webmail) > > [04-Jun-2012 22:35:14 +0200]: [4A68] C: A0005 APPEND INBOX.Sent (\Seen) {519+} > > [04-Jun-2012 22:35:14 +0200]: [4A68] C: Received: from cpe-76-169-183-245.socal.res.rr.com ([76.169.183.245]) > > by server.domain.tld > > with HTTP (HTTP/1.1 POST); Mon, 04 Jun 2012 22:35:14 +0200 > > MIME-Version: 1.0 ... > > [04-Jun-2012 22:36:10 +0200]: [4A68] S: A0005 OK [APPENDUID > 1338488996 4274] Append completed. That looks ... pretty normal. > At this point, I do not know what else to try or how to fix this > problem. Thus, I have had to disable your plugin for now. Do you have > any ideas on how to proceed? I can give you access to this machine if > need be (it's a personal server). Unfortunately, I don't. I can only suggest, as a test, trying with some other storage format -- I only use Maildir -- to see if the problem is really in the interaction with mdbox. I'm fairly sure that's likely the problem, maybe the plugin doesn't pass something through append that is needed by mdbox, but I've never even attempted to understand mdbox. Maybe Timo can comment. Timo, you can find the latest code here: http://git.sipsolutions.net/?p=dovecot-antispam.git;a=summary johannes

2 1