February 2011 - dovecot

[Dovecot] converting from maildir to mdbox ?
by Jan-Frode Myklebust 08 Feb '11

08 Feb '11

I´m considering moving from maildir to mdbox, but don´t quite see how I should do the conversion with minimal downtime. Our userdb is ldap, and the we use this setting to point to the users maildirectory: user_attrs = mailMessageStore=mail=maildir:%$:INDEX=/indexes/%1u/%1.1u/%u,mailQuota=quota_rule=*:storage=%$ i.e. every user has a "mailMessageStore" attribute in LDAP that points to his INBOX. Any ideas for how we can migrate user by user to mdbox? Can we add a mailboxFormat attribute to LDAP, and somehow get that used in the user_attrs lookup ? Ideally have it default to maildir if not set, so that the current setup isn´t changed and only migrated users are affected. Or should we be keeping the mailboxFormat as a prefix in all mailMessageStore strings ? -jf

2 1

[Dovecot] How to recover a mail box from an assertion failure
by Michael Durket 08 Feb '11

08 Feb '11

I'm running Dovecot version 1.2.11 and getting this assertion error on a user's mail: Panic: file /home/durket/dovecot-1.2.11/src/lib-index/mail-transaction-log-view.c: line 290 (mail_transaction_log_view_set): assertion failed: (min_file_seq != max_file_seq || max_file_seq != view->head->hdr.file_seq || max_file_offset != (uoff_t)-1 || min_file_offset <= view->head->sync_offset) I realize that there are newer releases of Dovecot (that even may fix this bug) but what I need to know is if there's anything I can do (like having Dovecot recreate indexes or whatnot) that will recover the user's mail (short of having to reconstruct it from backups).

2 1

[Dovecot] Auto rebuild indexes?
by Willie Gillespie 08 Feb '11

08 Feb '11

Here's an easy question for you. I'm restoring some emails from a backup. Do I need to delete or otherwise manually rebuild the indexes? dovecot.index.cache dovecot.index.log dovecot-uidlist Or will Dovecot itself detect that something is amiss and handle it on first folder access? Using Maildir with Dovecot 1.2.9

3 3

[Dovecot] lmtp error at domains containing "-" sign
by ckubu 08 Feb '11

08 Feb '11

hallo, I have running dovecot 2.0.9. I want to deliver mail with rcipient prameter "-", we spoked about that at thread "LMTP with address extension" and after your patch and version 2.0.8 that works. But now, there's an another much greater problem. No mails to adresses, which domain-part contains an "-" sign wil be delivered (i.e. test(a)aku-punkt-berlin.de) lmtp is looking about the user "test@aku" instead of "test(a)aku-punkt-berlin.de" and the following logentries appears: Feb 3 10:46:36 vserver08 dovecot: auth: Debug: sql(test@aku): SELECT '/var/vmail/' || maildir as home, '5000' AS uid, '5000' AS gid, '*:bytes=' || quota as quota_rule FROM mailbox WHERE username = 'test@aku' and active = true Feb 3 10:46:36 vserver08 dovecot: auth: sql(test@aku): Unknown user Greatings Christoph

4 9

[Dovecot] best fine tune for 2.0.9
by fakessh ＠ 08 Feb '11

08 Feb '11

Hi Timo and the other directors of the following pigeonhole dovecot sieve I wonder what are the strengths and weaknesses of my config, and what do I need to change to stick more to a best configuration r13151 ~]# /usr/sbin/dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32.2-xxxx-grs-ipv6-32 i686 CentOS release 5.5 (Final) auth_mechanisms = plain login base_dir = /var/run/dovecot/ imap_capability = +IDLE listen = [::] log_path = /var/log/maillog log_timestamp = %Y-%m-%d %H:%M:%S login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c mail_location = maildir:~/Maildir mail_max_userip_connections = 20 managesieve_notify_capability = mailto managesieve_sieve_capability = comparator-i;octet comparator-i;ascii-casemap fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date spamtest spamtestplus virustest namespace { inbox = yes location = prefix = separator = . } passdb { driver = pam } plugin { plugin = autocreate managesieve sieve sieve = ~/.dovecot.sieve sieve_before = /var/sieve-scripts/roundcube.sieve sieve_dir = ~/sieve sieve_global_path = whatever } protocols = sieve imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { mode = 0666 } vsz_limit = 64 M } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { address = * , [::] port = 993 } process_limit = 128 vsz_limit = 64 M } service imap { client_limit = 5 service_count = 0 } service managesieve-login { inet_listener managesieve-login { address = * port = 2000 } process_limit = 128 vsz_limit = 64 M } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { address = * , [::] port = 995 } process_limit = 128 vsz_limit = 64 M } ssl_ca = </etc/pki/tls/certs/root.crt ssl_cert = </etc/pki/tls/certs/r13151.ovh.net.crt ssl_key = </etc/pki/tls/private/r13151.ovh.net.key ssl_verify_client_cert = yes userdb { driver = passwd } version_ignore = yes protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep imap_max_line_length = 64 k mail_plugins = autocreate } protocol pop3 { mail_plugins = autocreate pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s } protocol lda { hostname = r13151.ovh.net mail_plugins = autocreate sieve postmaster_address = postmaster(a)fakessh.eu sendmail_path = /usr/lib/sendmail } protocol sieve { managesieve_implementation_string = dovecot managesieve_logout_format = bytes ( in=%i : out=%o ) managesieve_max_line_length = 65536 } -- gpg --keyserver pgp.mit.edu --recv-key 092164A7 http://pgp.mit.edu:11371/pks/lookup?op=get&search=0x092164A7

2 2

[Dovecot] dovecot: imap-login: Error: net_connect_unix(imap) failed: Resource temporarily unavailable
by Kurt Hockenbury 08 Feb '11

08 Feb '11

We recently switched over mail servers to one running dovecot and postfix on RedHat Enterprise 6. The mail store is NFS on a NetApp filer, the index files are on local disk. We have about 6000 total active users, though not all of them access the system at the same time. All goes well for a while, then we start seeing errors like this in the log: dovecot: imap-login: Error: net_connect_unix(imap) failed: Resource temporarily unavailable imap-login: Internal login failure (auth failed, 1 attempts) And at this point, users can't log in. I don't know what Resource dovecot is running out of. The machine is a 12-core Xeon 2.27Ghz, with 24GB RAM. I have removed the 1024 nproc limit in /etc/security/limits.d/90-nproc.conf, and upped the nproc and nofile limits to 16384 and 65535 respectively, both in limits.conf, as well as adding ulimit statements in /etc/init.d/dovecot (belt and suspenders). I have tried adjusting dovecot.conf, but I'm obviously missing something. dovecot -n follows: # 2.0.beta6 (3156315704ef): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-71.14.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.0 (Santiago) auth_master_user_separator = * auth_mechanisms = plain login default_client_limit = 5000 default_process_limit = 5000 disable_plaintext_auth = no mail_fsync = always mail_gid = 501 mail_location = maildir:~/Maildir:INDEX=/var/indexes/%n mail_nfs_storage = yes mail_plugins = quota mail_uid = 501 passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { quota = maildir:User quota quota_rule = *:storage=200M } service auth { client_limit = 32768 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service imap-login { process_min_avail = 12 service_count = 0 } service pop3-login { service_count = 0 } shutdown_clients = no ssl_cert = </etc/pki/postfix/certs/nexus.pem ssl_key = </etc/pki/postfix/private/nexus_key.pem userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } protocol imap { mail_plugins = $mail_plugins imap_quota } Thanks, -Kurt Hockenbury

5 17

[Dovecot] Outlook 2010 IMAP disconnected
by Luigi Rosa 08 Feb '11

08 Feb '11

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 A customer moved from a previous version of Outlook to 2010. When he forces the synchronization of the IMAP folders he gets this error: Disconnected for inactivity. Protocollo: IMAP Server: mail.xxxxxxxxxxxxxxxxxxx Porta: 143 Codice errore: 0x800CCCDD Dovecot simply logs this: Feb 3 09:20:34 server dovecot: imap(xxxx): Disconnected: Logged out bytes=2488/534485 Feb 3 09:20:34 server dovecot: imap(xxxx): Disconnected: Logged out bytes=63/815 Where can I search to solve this issue? Ciao, luigi - -- / +--[Luigi Rosa]-- \ I'd be a vegetarian if bacon grew on trees. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk1KZj8ACgkQ3kWu7Tfl6ZQtHwCfTZPpFC5iHvL1+5EuxKAFlqWD DjcAn3rYU0Uwc13arHirb/5G3NuYcWX/ =LkGi -----END PGP SIGNATURE-----

5 9

[Dovecot] vpopmail passdb deadlock if tcprules binary is missing
by Teodor Milkov 07 Feb '11

07 Feb '11

Hello, I've just found that if vpopmail is compiled with --enable-roaming-users=y, but tcprules binary is missing there is kind of denial of service situation, which is not very obvious for debugging. I know this is result of misconfiguration and I suppose this is more of a vpopmail() bug, but it is somewhat hard to debug and causes greater harm to dovecot long running auth process than vpopmail's short living vchkpw process. Symptoms -------- Login to dovecot imap takes very long time. There are auth processes in D state: USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND root 9873 0.0 0.0 2884 1396 ? D 14:04 0:00 dovecot/auth -w root 11292 0.0 0.0 2884 1396 ? S 14:25 0:00 \_ dovecot/auth -w Cause ----- When new user has to be authenticated from vpopmail, the sequence of events goes something like this: * libexec/dovecot/auth -w process is doing the authentication (passdb-vpopmail.c) * passdb-vpopmail.c: at some point user is authenticated and open_smtp_relay() is called * vpopmail.c: open_smtp_relay() gets a write lock on ~vpopmail/etc/open-smtp.lock adds new IP to ~vpopmail/etc/open-smtp and calls update_rules() etc. to rebuild the tcp.cdb file * vpopmailc: tcprules_open() is called and it fork()s and tries to execv() tcprules * if tcprules is not found, execv() fails silently, and we are left with a forked libexec/dovecot/auth instance, which runs all over again up to the open_smtp_relay() point where it tries to obtain write lock on ~vpopmail/etc/open-smtp.lock again (it is already locked by parent) Hope this helps someone.

1 0

[Dovecot] maildrop and multi-dbox
by Manfred Lotz 07 Feb '11

07 Feb '11

Hi there, I'm using Dovecot 2.0.9-1 under Arch Linux. Currently, I have Maildir configured, and I move all my emails into dovecot by using this sequence: 1) cron starts fetchmail periodically under user manfred to collect my mails from various email accounts. 2) In ~/.fetchmailrc I have configured /usr/bin/maildrop as MDA. 3) In ~/.mailfilter (used by maildrop) I have extensive filtering in place and call bogofilter (by using xfilter) to classify spam mails. This works fine so far. Now I'd like to migrate to dovecot's new format multi-dbox. My question now: Is it correct that then I cannot longer use maildrop and would need to switch do dovecot-lda? -- Thanks, Manfred

3 4

[Dovecot] DoveCot 2.0.19: Problem compiling Solaris 10u9 x86 with dbox storage enabled
by Denny Schierz 07 Feb '11

07 Feb '11

hi, I can't compile DoveCot 2.0.19 with dbox enabled on our Solaris 10/U9: LDFLAGS="-L/opt/csw/lib -L/usr/lib -R/opt/csw/lib/" ./configure --prefix=/usr/local/dovecot/2.0.19 --with-ssl=openssl --with-rundir=/var/run/dovecot --with-storages=maildir,mbox,dbox --with-ldap=yes gmake -> ========================== [... ../../src/lib-storage/mailbox-list.h:250: warning: parameter has incomplete type mv -f .deps/mail-storage-callbacks.Tpo .deps/mail-storage-callbacks.Po gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-settings -I../../src/lib-dict -I../../src/lib-master -I../../src/lib-mail -I../../src/lib-imap -I../../src/lib-index -I../../src/lib-storage -I/opt/csw/include -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c In file included from ../../src/lib-storage/mail-storage.h:10, from imap-commands.h:6, from imap-client.h:4, from imap-common.h:17, from main.c:3: ../../src/lib-storage/mailbox-list.h:250: warning: parameter has incomplete type mv -f .deps/main.Tpo .deps/main.Po /bin/bash ../../libtool --tag=CC --mode=link gcc -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -export-dynamic -L/opt/csw/lib -L/usr/lib -R/opt/csw/lib/ -o imap cmd-append.o cmd-capability.o cmd-cancelupdate.o cmd-check.o cmd-close.o cmd-copy.o cmd-create.o cmd-delete.o cmd-enable.o cmd-examine.o cmd-expunge.o cmd-fetch.o cmd-id.o cmd-idle.o cmd-list.o cmd-logout.o cmd-lsub.o cmd-namespace.o cmd-noop.o cmd-rename.o cmd-search.o cmd-select.o cmd-sort.o cmd-status.o cmd-store.o cmd-subscribe.o cmd-thread.o cmd-uid.o cmd-unselect.o cmd-unsubscribe.o cmd-x-cancel.o imap-client.o imap-commands.o imap-commands-util.o imap-expunge.o imap-fetch.o imap-fetch-body.o imap-search.o imap-search-args.o imap-settings.o imap-status.o imap-sync.o mail-storage-callbacks.o main.o ../../src/lib-storage/libdovecot-storage.la ../../src/lib-dovecot/libdovecot.la -export-dynamic -lrt -lnsl -lsocket -lrt -lsendfile libtool: link: gcc -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -o .libs/imap cmd-append.o cmd-capability.o cmd-cancelupdate.o cmd-check.o cmd-close.o cmd-copy.o cmd-create.o cmd-delete.o cmd-enable.o cmd-examine.o cmd-expunge.o cmd-fetch.o cmd-id.o cmd-idle.o cmd-list.o cmd-logout.o cmd-lsub.o cmd-namespace.o cmd-noop.o cmd-rename.o cmd-search.o cmd-select.o cmd-sort.o cmd-status.o cmd-store.o cmd-subscribe.o cmd-thread.o cmd-uid.o cmd-unselect.o cmd-unsubscribe.o cmd-x-cancel.o imap-client.o imap-commands.o imap-commands-util.o imap-expunge.o imap-fetch.o imap-fetch-body.o imap-search.o imap-search-args.o imap-settings.o imap-status.o imap-sync.o mail-storage-callbacks.o main.o -L/opt/csw/lib -L/usr/lib ../../src/lib-storage/.libs/libdovecot-storage.so /usr/local/dovecot/v2/dovecot-2.0.9/src/lib-dovecot/.libs/libdovecot.so ../../src/lib-dovecot/.libs/libdovecot.so -liconv -lnsl -lsocket -lrt -lsendfile -R/usr/local/dovecot/2.0.19/lib/dovecot -R/opt/csw/lib/ ld: warning: file ../../src/lib-dovecot/.libs/libdovecot.so: linked to /usr/local/dovecot/v2/dovecot-2.0.9/src/lib-dovecot/.libs/libdovecot.so: attempted multiple inclusion of file Undefined first referenced symbol in file dbox_storage ../../src/lib-storage/.libs/libdovecot-storage.so ld: fatal: Symbol referencing errors. No output written to .libs/imap collect2: ld returned 1 exit status gmake[3]: *** [imap] Error 1 gmake[3]: Leaving directory `/usr/local/dovecot/v2/dovecot-2.0.9/src/imap' gmake[2]: *** [all-recursive] Error 1 gmake[2]: Leaving directory `/usr/local/dovecot/v2/dovecot-2.0.9/src' gmake[1]: *** [all-recursive] Error 1 gmake[1]: Leaving directory `/usr/local/dovecot/v2/dovecot-2.0.9' gmake: *** [all] Error 2 ============================ compiling without dbox works. # pkgutil -a | grep iconv libiconv CSWiconv 1.9.2 1.3 MB cu denny

2 2