- dovecot - dovecot.org

[Dovecot] problems when using dsync between servers
by Yann Dupont 08 Dec '11

08 Dec '11

Hello, I'm trying to migrate from maildir++ to mdbox. The maildir++ is a leftover of our previous setup (was using courier) We have 3 virtuals servers for our +70000 accounts. Now, I'd like to use mdbox, so I'm trying using dsync for that. I setup a new virtual server, configured for mdbox. 1st, I tried a basic setup: I established a file with all my accounts (taken from LDAP) and then I use this script : FILENAME=$1 while read LINE do dsync -u $LINE backup $LINE@my_new_server done < $FILENAME But it's quite slow and dsync hangs. So I tried another approach using multi threaded python. Much faster (using all the cores), but dsync still hangs on some accounts. After a certain time dsync exit with an error like that : Panic: file dsync-worker-local.c: line 1688 (local_worker_save_msg_continue): assertion failed: (ret == -1) dsync-remote(E072184L): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x3fd8a) [0x7f34fc577d8a] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f34fc577e72] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f34fc55119f] -> dsync() [0x40ff0b] -> dsync() [0x410142] -> dsync(dsync_worker_msg_save+0x99) [0x40f639] -> dsync() [0x40e24a] -> dsync() [0x40d8ef] -> dsync() [0x40dbfc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x48) [0x7f34fc5830d8] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f34fc58403f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f34fc583068] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f34fc5713a3] -> dsync(main+0x9e1) [0x4078b1] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f34fbde9c4d] -> dsync() [0x406cf9] This is on a RUNNNING server. My aim was to make some pass on the running server, then stop it and make a last pass to finish the process. Is dsync supposed to run only on a stopped server ? Is my approach totally wrong ? -- Yann Dupont - Service IRTS, DSI Université de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont(a)univ-nantes.fr

2 2

[Dovecot] sql dict: commit failed: MySQL server has gone away
by Mark Zealey 08 Dec '11

08 Dec '11

Following on from this thread: http://www.dovecot.org/list/dovecot/2010-September/052704.html <https://owa2010.webfusion.com/owa/redir.aspx?C=a447887e3d204944a8c766142df4…> in 2.0.16 I am seeing the same issues. I believe this would be related to some timeouts set on our mysql servers which are pretty low (30 or 60 seconds or so to drop idle connections). This is happening for imap, pop and lmtp processes when they try to update quotas stored in a mysql database; presumably it is the dict process that actually has these issues - the lmtp delivery isn't lasting longer than 1 second so shouldn't be seeing any timeouts there. This is always followed by the "Error: dict quota: Quota update failed, it's now desynced" line; presumably it is telling the truth but I'm not sure how I could tell. We are also seeing this "MySQL server has gone away" issue in login processes but it isn't causing an issue there as presumably dovecot transparently retries rather than just giving up as it seems to in the quota updates. Any thoughts or advice would be appreciated. Mark

3 2

[Dovecot] Assertion failure in 2.0.16 - SEARCH ()
by Daniel Colascione 08 Dec '11

08 Dec '11

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Nov 25 22:25:39 dancol dovecot: master: Error: service(imap): child 25115 killed with signal 6 (core dumps disabled) Nov 25 22:25:59 dancol dovecot: imap(dancol): Panic: file mail-search-build.c: line 59 (mail_search_build_key_int): assertion failed: (sarg->value.subargs != NULL) Nov 25 22:25:59 dancol dovecot: imap(dancol): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x3d291) [0xb7636291] -> /usr/lib/dovecot/libdovecot.so.0(+0x3d2ff) [0xb76362ff] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0xb760bb7a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x24109) [0xb7692109] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x24177) [0xb7692177] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_search_build+0x82) [0xb7692242] - -> dovecot/imap [dancol 127.0.0.1 SEARCH](imap_search_args_build+0x4a) [0x805db5a] -> dovecot/imap [dancol 127.0.0.1 SEARCH](cmd_search+0xbf) [0x80537ef] -> dovecot/imap [dancol 127.0.0.1 SEARCH]() [0x80568cc] -> dovecot/imap [dancol 127.0.0.1 SEARCH]() [0x80569a2] -> dovecot/imap [dancol 127.0.0.1 SEARCH](client_handle_input+0x175) [0x8056c25] -> dovecot/imap [dancol 127.0.0.1 SEARCH](client_input+0x5f) [0x80574cf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x51) [0xb76430d1] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd3) [0xb7644193] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0xb7643050] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x2a) [0xb762ec1a] -> dovecot/imap [dancol 127.0.0.1 SEARCH](main+0x315) [0x805fef5] -> /lib/i686/cmov/libc.so.6(__libc_start_main+0xe6) [0xb74b6c76] -> dovecot/imap [dancol 127.0.0.1 SEARCH]() [0x804eb81] $ telnet localhost imap Trying 127.0.0.1... Connected to localhost.localdomain. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. . LOGIN dancol XXXXXXXX . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in . SELECT rss * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 8 EXISTS * 0 RECENT * OK [UIDVALIDITY 1322264663] UIDs valid * OK [UIDNEXT 11] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest . OK [READ-WRITE] Select completed. . SEARCH () Connection closed by foreign host. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (Darwin) Comment: GPGTools - http://gpgtools.org iEYEARECAAYFAk7QiNcACgkQ17c2LVA10VvhHACgihmbmTjVNl/PbKcreIDRTKpC 5wkAoJd9FHXM4GhPfnVUjwrpdsqnVQ6E =RlpQ -----END PGP SIGNATURE-----

2 1

[Dovecot] POP3/IMAP crash signal 10
by Patrick Wood 08 Dec '11

08 Dec '11

Hi, I'm building a Postfix/Dovecot mail server and while I am able to send/receive emails using telnet, after establishing a connection to Dovecot via a client (Mail Live, Thunderbird etc) the following appears in the logs: Nov 28 14:11:02 mailserver dovecot: [ID 583609 mail.info] pop3-login: Login: user=<user(a)domain.com>, method=PLAIN, rip=xxx.xxx.xxx.xxx, lip=xxx.xxx.xxx.xxx, mpid=282 78 Nov 28 14:11:02 mailserver dovecot: [ID 583609 mail.error] master: Error: service(pop3-login): child 28277 killed with signal 10 (core not dumped - set service pop3-log in { drop_priv_before_exec=yes }) Nov 28 14:11:02 mailserver dovecot: [ID 583609 mail.info] pop3(user(a)domain.com): Disconnected: Logged out top=0/0, retr=0/0, del=0/5, size=3250 I also experience very poor connectivity to the server, with Microsoft Mail and Thunderbird regularly failing to connect (connection errors in the client and no login attempt in the dovecot logs). I assume this is related to the issue above. I am running dovecot 2.0.16 on Solaris 10 SPARC using a ZFS filesystem for mailbox storage. Here is my configuration: # 2.0.16: /usr/local/etc/dovecot/dovecot.conf # OS: SunOS 5.10 sun4u zfs auth_mechanisms = plain login disable_plaintext_auth = no mail_location = maildir:/storage0/home/vmail/%d/%n/Maildir mail_plugins = quota passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = maildir:User quota quota_rule = *:storage=1G } postmaster_address = root(a)domain.com sendmail_path = /usr/lib/sendmail ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { mail_plugins = quota quota imap_quota } protocol lda { mail_plugins = quota quota } protocol pop3 { mail_plugins = quota quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } I'm tearing my hair out! Hopefully someone can see something I'm missing

2 1

[Dovecot] Questions about Proxy/Director (was: Re: Indexes to MLC-SSD)
by Patrick Westenberg 08 Dec '11

08 Dec '11

Jan-Frode Myklebust schrieb: > Yes, and in ascii-art this becomes :-) > > MTA -(lmtp)--> dovecot-director ---(lmtp)---> backend-server1 > \---(lmtp)---> backend-server2 > > > IMAP-user -(imap)--> dovecot-director --(imap) --> backend-server1 > \--(imap) --> backend-server2 I failed creating a nice ascii view ;-) However, I have some more questions: - What happens if the MTA accepted a message but the backend-server fails and is unable to store it? - What about load-balancing and/or failover? Maybe all users on backend-server1 are fetching their mails causing high load while backend-server2 is idle. Is it possible to specify more than one backend-server IPs as I can do for the database hosts for userdb queries?

3 6

[Dovecot] v2.1.rc1 missing SnowballAnalyzer.h
by Eray Aslan 08 Dec '11

08 Dec '11

While trying to test v.2.1.rc1 with configure \ --with-lucene \ --without-stemmer \ [...] I get the following error: [...] /bin/sh ../../../libtool --tag=CXX --mode=compile i686-pc-linux-gnu-g++ -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-index -I../../../src/lib-storage -I../../../src/plugins/fts -I../../../src/doveadm -O2 -march=i686 -pipe -c -o lucene-wrapper.lo lucene-wrapper.cc libtool: compile: i686-pc-linux-gnu-g++ -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-index -I../../../src/lib-storage -I../../../src/plugins/fts -I../../../src/doveadm -O2 -march=i686 -pipe -c lucene-wrapper.cc -fPIC -DPIC -o .libs/lucene-wrapper.o lucene-wrapper.cc:26:30: fatal error: SnowballAnalyzer.h: No such file or directory compilation terminated. make[4]: *** [lucene-wrapper.lo] Error 1 The offending line in lucene-wrapper.cc is: #include "SnowballAnalyzer.h" Sure enough, there is no SnowballAnalyzer.h in the tarball. Looks like a missing a backslash in src/plugins/fts-lucene/Makefile.am: [...] noinst_HEADERS = \ fts-lucene-plugin.h \ lucene-wrapper.h SnowballAnalyzer.h \ SnowballFilter.h -- Eray Aslan

2 1

[Dovecot] lazy_expunge plugin and folder subscription trouble
by Jürgen Obermann 08 Dec '11

08 Dec '11

Hello, I wanted to test the lazy expunge plugin together with mdbox. It seems to me that the folder subscriptions file in the mdbox directory was overwritten with only a few folder names every time I added or removed something in the list of subscribed folders, or even if I turned the imap folder subscription feature off and on. Here is my setup: # 2.0.16: /opt/local/etc/dovecot/dovecot.conf # OS: SunOS 5.10 sun4v mail_location = mdbox:~/mdbox mail_plugins = mail_log notify quota lazy_expunge zlib mdbox_rotate_interval = 1 days mdbox_rotate_size = 16 M namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes list = no location = prefix = Mail/ separator = / subscriptions = yes type = private } namespace { location = maildir:/var/mail/public:CONTROL=~/Maildir/public:INDEX=~/Maildir/public prefix = Public/ separator = / subscriptions = no type = public } namespace { location = mdbox:~/mdbox:MAILBOXDIR=expunged prefix = .EXPUNGED/ separator = / } plugin { autocreate = Trash autocreate2 = caughtspam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = caughtspam autosubscribe3 = Sent autosubscribe4 = Drafts fts = squat lazy_expunge = .EXPUNGED/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = fs:Home-Verzeichnis:noenforcing sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 3 } protocols = imap pop3 lmtp sieve quota_full_tempfail = yes sendmail_path = /usr/lib/sendmail service auth { client_limit = 11120 } service imap-login { process_min_avail = 16 service_count = 0 vsz_limit = 640 M } service imap { process_limit = 4096 vsz_limit = 1 G } ssl_cert = </etc/ssl/horus.crt ssl_key = </etc/ssl/horus.key syslog_facility = local0 userdb { driver = passwd } version_ignore = yes protocol lda { info_log_path = log_path = mail_plugins = mail_log notify quota lazy_expunge zlib sieve } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags mail_max_userip_connections = 20 mail_plugins = mail_log notify quota lazy_expunge zlib autocreate fts fts_squat imap_quota imap_zlib } protocol lmtp { mail_plugins = mail_log notify quota lazy_expunge zlib sieve } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xv%08Xu } -- Hochschulrechenzentrum der | Mail: Juergen.Obermann(a)hrz.uni-giessen.de Justus-Liebig-Universitaet | WWW: http://www.uni-giessen.de/obermann/ Heinrich-Buff-Ring 44 | Tel: 0641-99-13054 (0641-99-13001) D-35392 Giessen, Germany | Fax: 0641-99-13009

2 1

[Dovecot] doveadm fetch vs search+fetch
by Joseph Tam 08 Dec '11

08 Dec '11

What's the pactical difference between using "doveadm fetch" rather than using "doveadm search" in conjunction with "doveadm fetch", as the man pages suggest? It seems "doveadm fetch" functionally supercedes "doveadm search" making the latter obsolete. It can even be closely simulated with "doveadm -f tab fetch ... 'mailbox-guid uid' search-query ...". Joseph Tam <jtam.home(a)gmail.com>

2 3

[Dovecot] dovecot 2.0 sieve if working, managesieve not.
by Sacha xxxx 07 Dec '11

07 Dec '11

Hi, this is my configuration # OS: Linux 2.6.32-131.0.15.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.1 (Santiago) ext4 auth_debug = yes auth_master_user_separator = * auth_username_format = %Lu auth_verbose = yes disable_plaintext_auth = no info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = Dovecot ready mail_debug = yes mail_gid = 999 mail_home = /MAIL/%d/%n/ mail_location = maildir:/MAIL/%d/%n/ mail_log_prefix = "%Us(%u): " mail_plugins = " quota" mail_privileged_group = mail mail_uid = 999 passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes pass = yes } plugin { quota = maildir:User quota quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/sieve/dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve service auth { unix_listener auth-userdb { group = mail mode = 0660 user = postfix } } service managesieve-login { executable = /usr/libexec/dovecot/managesieve-login inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { group = mail mode = 0666 user = mail } user = mail } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.user driver = ldap } doveconf: Error: protocols: Unknown protocol: sieve doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: protocols: Unknown protocol: sieve I get the error Unknown protocol: sieve The installed rpm package is this: dovecot-2.0.9-2.el6.x86_64 The sieve filtering is working: 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: opening script /MAIL/***/user//sieve/dovecot.sieve 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: script /MAIL/***/user//sieve/dovecot.sieve successfully compiled 2011-12-07 12:12:29 LDA(utente01@***): Debug: sieve: executing script from /MAIL/***/utente01//sieve/dovecot.sieve 2011-12-07 12:12:29 LDA(utente01@***): Info: sieve: msgid=<4EDF4A1C.9010509@***>: stored mail into mailbox 'INBOX' But the manage sieve won't work. It seems that pigeonhole is installed because /usr/libexec/dovecot/managesieve-login exist and is not empty. Can you help me? Thank You Sushi.

1 1

[Dovecot] IMAP SPECIAL-USE extension
by Timo Sirainen 07 Dec '11

07 Dec '11

It's implemented now in dovecot-2.1 hg. It also deprecates autocreate plugin (but it still works the old way). The idea is that you can now do e.g.: mailbox Trash { auto = no special_use = \Trash } mailbox Drafts { auto = no special_use = \Drafts } mailbox Sent { auto = subscribe # autocreate, autosubscribe special_use = \Sent } mailbox Spam { auto = create # autocreate, but don't autosubscribe special_use = \Junk } mailbox virtual/All { # if you have a virtual "All messages" mailbox auto = no special_use = \All } The mailbox names require a namespace prefix, so if you use e.g. "INBOX." prefix you'll need to use: mailbox INBOX.Trash { ..etc..

11 21