January 2014 - dovecot

[Dovecot] tests with metadata module
by Mihai Badici 25 Feb '14

25 Feb '14

--Repost after subscription as list member --- I made some tests with metadata support in dovecot 2.2.10. Previously I had dovecot 2.2.4 with external metadata plugin who work well. I use dovecot with roundcube and roundcube plugins from kolab project . First, the feature activation was tricky and rather undocumented. I spent about half hour googling, after that I set: imap_metadata = yes and mail_attribute_dict = file:%h/shared_metadata I think you cold put those lines in the 20-imap.conf example file commented; that way will be easy for us to activate. Because I changed the location of shared_metadata, all folders was unannotated . I went in folder manager in roundcube and set folder "calendar" as calendar type and so on. That worked and i have: cat shared_metadata: shared/c4268a04da44bb527c5b0000193e0904/vendor/kolab/folder-type event shared/cd5792367fc9cd5196170000193e0904/vendor/kolab/folder-type event shared/33f55d2e8912195209290000193e0904/vendor/kolab/folder-type event shared/32f55d2e8912195209290000193e0904/vendor/kolab/folder-type contact However, it looks like the metadata is not properly read after. Calendar and Contacts folders don't appear in roundcube. I have this crash in dovecot's log: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x67d81) [0xb7625d81] -> /usr/lib/dovecot/libdovecot.so.0(+0x67e11) [0xb7625e11] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb75d6af9] -> dovecot/imap() [0x805d3b2] -> dovecot/imap() [0x805d5bc] -> dovecot/imap() [0x805d6c9] -> dovecot/imap(client_handle_input+0x56) [0x805d836] -> dovecot/imap(client_input+0x72) [0x805dcc2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x38) [0xb7638d98] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x10e) [0xb7639d6e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x48) [0xb7638818] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x28) [0xb75dcb68] -> dovecot/imap(main+0x284) [0x8050f34] -> /lib/libc.so.6(__libc_start_main+0xf5) [0xb743f5a5] -> dovecot/imap() [0x80510a5] Dec 26 09:28:49 imap(mihai.badici): Fatal: master: service(imap): child 4919 killed with signal 6 (core dumps disabled) I logged imap sessions in roundcube and I have: A0003 GETMETADATA "*" (/private/vendor/kolab/folder-type /shared/vendor/kolab/folder-type) On a similar server with the "old" metadata plugin, I have here listed all folders with coresponding annotations. How I can debug further? This is a test server so I can stress it. -- Mihai Bădici http://mihai.badici.ro -----------------------------------------

3 6

[Dovecot] failed: Message has been copied too many times
by Angel L. Mateo 19 Feb '14

19 Feb '14

Hello, I'm running dovecot 2.1.16 in a ubuntu 12.04 server, with lazy_expunge, SiS and mdbox format. The problem I'm having is that the index for one the mailboxes of one of my users is growing too much. This is not the first time of this problem. In previous cases, is because a message is duplicated thousand of times (I haven't found any reason for this). In these cases, moving messages to other folder and moving again to this same folder fixes the problem. So I have tried this, and I have moved all messages from this folder to another one. But this time, after this, indexes directory is still using a lot of space. And the folder seems to have more serious problems: amateo_adm@myotis51:~$ sudo doveadm search -u vlo mailbox BORRADOS.INBOX.MNCS doveadm(vlo): Error: Syncing mailbox BORRADOS.INBOX.MNCS failed: Message has been copied too many times (59306 + -1) I have tried to delete the folder, with the same result: amateo_adm@myotis51:~$ sudo doveadm mailbox delete -u vlo BORRADOS.INBOX.MNCS doveadm(vlo): Error: Can't delete mailbox BORRADOS.INBOX.MNCS: Message has been copied too many times (59306 + -1) And to purge user's mailbox, but it didn't fix the problem. PS: If this could help, BORRADOS. is the namespace used by lazy_expunge plugin. -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337

4 9

[Dovecot] Problems with dovecot 2.1.7, spamassassin 3.3.2 and antispam plugin
by Dean Carpenter 18 Feb '14

18 Feb '14

This might be a fairly long message, but I wanted to be sure to include as much information as possible. I'm having an issue with the dovecot-antispam plugin in that it seems to be unable to successfully run anything from the pipe backend. To qualify that, they run, but they fail ... Running /usr/bin/sa-learn directly always returns with an error code of 1, and the bayes DB isn't actually updated. Running the /usr/local/bin/sa-learn-pipe.sh script from the example will run sa-learn successfully, but sa-learn fails partway through, right on a sql DB access. I have both bayes and FuzzyOcr data stored in mysql, and the error occurs on accessing either one. That is, I've tested with FuzzyOcr enabled, and it fails on the db access to the FuzzyOcr DB, and I've tried it with FuzzyOcr disabled. In that case, it fails on the access to the bayes DB. The error line right there is : libgcc_s.so.1 must be installed for pthread_cancel to work Since sa-learn terminated prematurely, the bayes DB isn't updated at all. Running /usr/bin/sa-learn or the script /usr/local/bin/sa-learn-pipe.sh directly from cmdline works fine though - sa-learn completes correctly and updates the bayes DB properly, I can see the new tokens. $ sa-learn-pipe.sh --spam < /usr/share/doc/spamassassin/examples/sample-spam.txt $ sa-learn --spam /usr/share/doc/spamassassin/examples/sample-spam.txt I think it would be great to have a dedicated logfile for antispam, one that would capture both stdout as well as stderr. These tests are being done on a clean Ubuntu 13.04 system. I'm rebuilding the VM repeatedly as I configure the various pieces, and can test any changes or whatever you might suggest very easily. I've fully scripted the install and configuration of Exim4, Dovecot, Spamassassin, Clamav, Percona/Mysql, Roundcube, and can build a full VM under Virtualbox or any VPS in less than 10 minutes. Ubuntu 13.04 Dovecot 2.1.7 dovecot-antispam 2.0+20120225-3 Anyone else using the antispam plugin with spamassassin 3.3.2 ? Anything I can check to see what's causing this problem ? -------------------------------------------------------- $ cat /usr/local/bin/sa-learn-pipe.sh #!/bin/bash echo /usr/bin/sa-learn $* /tmp/sendmail-msg-$$.txt echo "$$-start ($*)" >> /var/log/sa-learn-pipe.log cat<&0 >> /tmp/sendmail-msg-$$.txt /usr/bin/sa-learn -D $* /tmp/sendmail-msg-$$.txt >> /tmp/sa-learn-pipe.$$.log 2>&1 echo $$ sa-learn rc=$? id=$(id) HOME=$HOME >> /var/log/sa-learn-pipe.log while read line; do echo $$-sa-learn "$line" >> /var/log/sa-learn-pipe.log done < /tmp/sa-learn-pipe.$$.log rm -f /tmp/sendmail-msg-$$.txt echo "$$-end" >> /var/log/sa-learn-pipe.log exit 0 -------------------------------------------------------- With FuzzyOcr DISabled, fails right after Bayes DB access $ cat /var/log/sa-learn-pipe.log 4505-start (--spam) 4505 sa-learn rc=134 id=uid=108(Debian-exim) gid=113(Debian-exim) groups=113(Debian-exim) HOME= 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: logger: adding facilities: all 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: logger: logging level is DBG 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: generic: SpamAssassin version 3.3.2 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: generic: Perl 5.014002, PREFIX=/usr, DEF_RULES_DIR=/usr/share/spamassassin, LOCAL_RULES_DIR=/etc/spamassassin, LOCAL_STATE_DIR=/var/lib/spamassassin : : 4505-sa-learn Nov 8 09:05:27.131 [4507] dbg: replacetags: done replacing tags 4505-sa-learn Nov 8 09:05:27.131 [4507] dbg: FreeMail: loaded freemail_domains entries: 2470 normal, 29 wildcard 4505-sa-learn Nov 8 09:05:27.132 [4507] dbg: plugin: Mail::SpamAssassin::Plugin::Bayes=HASH(0x3879e88) implements 'learner_new', priority 0 4505-sa-learn Nov 8 09:05:27.132 [4507] dbg: bayes: learner_new self=Mail::SpamAssassin::Plugin::Bayes=HASH(0x3879e88), bayes_store_module=Mail::SpamAssassin::BayesStore::MySQL 4505-sa-learn Nov 8 09:05:27.151 [4507] dbg: bayes: using username: debian-spamd 4505-sa-learn Nov 8 09:05:27.151 [4507] dbg: bayes: learner_new: got store=Mail::SpamAssassin::BayesStore::MySQL=HASH(0x3ec0388) 4505-sa-learn Nov 8 09:05:27.152 [4507] dbg: plugin: Mail::SpamAssassin::Plugin::Bayes=HASH(0x3879e88) implements 'learner_is_scan_available', priority 0 4505-sa-learn libgcc_s.so.1 must be installed for pthread_cancel to work 4505-end 7235-start () -------------------------------------------------------- With FuzzyOcr ENabled, fails right after FuzzyOcr DB access $ cat /var/log/sa-learn-pipe.log : : 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan ocrad-invert: /usr/bin/ocrad -s5 -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan ocrad-decolorize-invert: /usr/bin/ocrad -s5 -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan ocrad-decolorize: /usr/bin/ocrad -s5 $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan gocr: /usr/bin/gocr -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan gocr-180: /usr/bin/gocr -l 180 -d 2 -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan tesseract: /usr/bin/tesseract $input $output 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Importing for MLDBM databases not available (dependencies missing) 7804-sa-learn Nov 8 09:37:09.612 [7806] dbg: FuzzyOcr: Connecting to: dbi:mysql:database=FuzzyOcr;mysql_socket=/var/run/mysqld/mysqld.sock 7804-sa-learn libgcc_s.so.1 must be installed for pthread_cancel to work 7804-end -------------------------------------------------------- syslog entries from running with sa-learn-pipe.sh script antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh Nov 8 09:36:41 newgalah1 imap: antispam: plugin initialising (2.0-notgit) Nov 8 09:36:41 newgalah1 imap: antispam: verbose debug enabled Nov 8 09:36:41 newgalah1 imap: antispam: "Junk" is exact match spam folder Nov 8 09:36:41 newgalah1 imap: antispam: "Spam" is exact match spam folder Nov 8 09:36:41 newgalah1 imap: antispam: no unsure folders Nov 8 09:36:41 newgalah1 imap: antispam: "Trash" is wildcard match trash folder Nov 8 09:36:41 newgalah1 imap: antispam: "Deleted *" is wildcard match trash folder Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend spam argument = --spam Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend not-spam argument = --ham Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend program = /usr/local/bin/sa-learn-pipe.sh Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend tmpdir /tmpNov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_unsure(Junk): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_trash(INBOX): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_trash(Junk): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mail copy: from trash: 0, to trash: 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_spam(INBOX): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_spam(Junk): 1 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_unsure(INBOX): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 Nov 8 09:37:08 newgalah1 imap: antispam: running mailtrain backend program /usr/local/bin/sa-learn-pipe.sh Nov 8 09:37:08 newgalah1 imap: antispam: running mailtrain backend program /usr/local/bin/sa-learn-pipe.sh Nov 8 09:37:08 newgalah1 imap: antispam: running mailtrain backend program parameter 1 --spam -------------------------------------------------------- syslog entries from running with sa-learn directly antispam_pipe_program = /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: plugin initialising (2.0-notgit) Nov 8 09:44:57 newgalah1 imap: antispam: verbose debug enabled Nov 8 09:44:57 newgalah1 imap: antispam: "Junk" is exact match spam folder Nov 8 09:44:57 newgalah1 imap: antispam: "Spam" is exact match spam folder Nov 8 09:44:57 newgalah1 imap: antispam: no unsure folders Nov 8 09:44:57 newgalah1 imap: antispam: "Trash" is wildcard match trash folder Nov 8 09:44:57 newgalah1 imap: antispam: "Deleted *" is wildcard match trash folder Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend spam argument = --spam Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend not-spam argument = --ham Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend program = /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend tmpdir /tmp Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_unsure(Junk): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_trash(INBOX): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_trash(Junk): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mail copy: from trash: 0, to trash: 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_spam(INBOX): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_spam(Junk): 1 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_unsure(INBOX): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 Nov 8 09:44:57 newgalah1 imap: antispam: running mailtrain backend program /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: running mailtrain backend program /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: running mailtrain backend program parameter 1 --spam Nov 8 09:44:58 newgalah1 imap: antispam: run program failed with exit code -1 -------------------------------------------------------- $ cat 90-plugin.conf plugin { antispam_debug_target = syslog antispam_verbose_debug = 1 antispam_backend = pipe antispam_trash_pattern = Trash;Deleted * antispam_spam = Junk;Spam antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh # antispam_pipe_program_args = --progress antispam_pipe_program_spam_arg = --spam antispam_pipe_program_notspam_arg = --ham antispam_pipe_tmpdir = /tmp } -------------------------------------------------------- $ dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.8.0-32-generic x86_64 Ubuntu 13.04 auth_mechanisms = cram-md5 login plain first_valid_uid = 108 mail_location = maildir:~/Maildir:LAYOUT=fs:INBOX=~/Maildir/INBOX managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;as cii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = scheme=plain username_format=%u /var/mail/%d/PASSWD driver = passwd-file } plugin { antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh antispam_pipe_program_notspam_arg = --ham antispam_pipe_program_spam_arg = --spam antispam_pipe_tmpdir = /tmp antispam_spam = Junk;Spam antispam_trash_pattern = Trash;Deleted * antispam_verbose_debug = 1 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve" service auth { unix_listener auth-client { mode = 0666 } } ssl = required ssl_cert = </etc/ssl/certs/dovecot1.crt ssl_key = </etc/ssl/private/dovecot1.pkcs8.key userdb { args = username_format=%u /var/mail/%d/PASSWD default_fields = uid=Debian-exim gid=Debian-exim home=/var/mail/%d/%n driver = static } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol imap { mail_plugins = " antispam" }

6 10

[Dovecot] Dsync Panic
by Gilles Chauvin 14 Feb '14

14 Feb '14

Hi, Using dsync to backup my users' mailboxes (dovecot 2.2.10 on both sides), I sometimes encounter the following issue. Below is the output of: dsync -Dvf -u "user" -R backup ssh root(a)server.domain.tld dsync -u "user" doveadm(root): Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_lookup (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(user): Debug: Effective uid=495, gid=495, home=/srv/mail/u/user doveadm(user): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:/srv/mail/u/user doveadm(user): Debug: fs: root=/srv/mail/u/user, index=, indexpvt=, control=, inbox=, alt= doveadm(user): Debug: Namespace : Using permissions from /srv/mail/u/user: mode=0700 gid=default dsync-local(user): Debug: brain M: in state=master_recv_handshake dsync-local(user): Debug: brain M: out state=send_mailbox_tree changed=1 dsync-local(user): Debug: brain M: in state=send_mailbox_tree dsync-local(user): Debug: brain M: out state=send_mailbox_tree_deletes changed=1 dsync-local(user): Debug: brain M: in state=send_mailbox_tree_deletes dsync-local(user): Debug: brain M: out state=recv_mailbox_tree changed=1 dsync-local(user): Debug: brain M: in state=recv_mailbox_tree dsync-local(user): Debug: brain M: out state=recv_mailbox_tree changed=0 dsync-local(user): Debug: brain M: in state=recv_mailbox_tree dsync-local(user): Debug: brain M: out state=recv_mailbox_tree_deletes changed=1 dsync-local(user): Debug: brain M: in state=recv_mailbox_tree_deletes dsync-local(user): Debug: brain M: out state=recv_mailbox_tree_deletes changed=0 dsync-remote(user): Panic: file dsync-brain-mailbox-tree-sync.c: line 111 (dsync_brain_mailbox_tree_sync_change): assertion failed: (brain->no_backup_overwrite) dsync-remote(user): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f1e89ee889a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f1e89ee89a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f1e89ea21cf] -> dsyn(dsync_brain_mailbox_tree_sync_change+0x3c6) [0x42e046] -> dsyn(dsync_brain_recv_mailbox_tree_deletes+0x12a) [0x42d30a] -> dsyn(dsync_brain_run+0x2e6) [0x42ac96] -> dsyn() [0x42b5f0] -> dsyn() [0x43d740] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f1e89ef8336] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f1e89ef93a7] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f1e89ef82a8] -> dsyn() [0x427fd1] -> dsyn() [0x411c97] -> dsyn(doveadm_mail_try_run+0x238) [0x4120a8] -> dsyn(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f1e89b0ad1d] -> dsyn() [0x411419] dsync-local(user): Debug: brain M: in state=recv_mailbox_tree_deletes dsync-local(user): Error: read(server.domain.tld) failed: EOF dsync-local(user): Debug: brain M: out state=recv_mailbox_tree_deletes changed=0 dsync-local(user): Error: Remote command returned error 255 Regards, Gilles

1 1

[Dovecot] Problem to setup replication
by Daniel Thielemann 14 Feb '14

14 Feb '14

Hi, i tried to setup replication since some days but I'am stuck now. My conf: # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.3.1.el6.x86_64 x86_64 CentOS release 6.5 (Final) dsync_remote_cmd = ssh -l%{login} %{host} /usr/bin/doveadm dsync-server -u%u -l%{lock_timeout} -n%{namespace} log_path = /var/log/dovecot mail_gid = 5000 mail_home = /var/vmail/%d/%n mail_location = maildir:~/Maildir mail_plugins = " notify replication" mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { mail_replica = remote:vmail@server1.domain.dom replication_full_sync_interval = 1 hours sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap sieve service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 user = postfix } unix_listener auth-master { mode = 0600 user = vmail } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service managesieve-login { inet_listener sieve_deprecated { port = 2000 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = vmail } } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lda { auth_socket_path = /var/run/dovecot/auth-master log_path = /var/log/protocol-lda.log mail_plugins = sieve postmaster_address = postmaster(a)domain.dom } ----------------- sql-conf: driver = mysql connect = host=127.0.0.1 dbname=xxx user=mailuser password=xxx default_pass_scheme = SSHA512 password_query = SELECT email as user, password FROM virtual_users WHERE email='%u'; user_query = SELECT email as user FROM virtual_users WHERE email ='%u'; iterate_query = SELECT email as user FROM virtual_users WHERE email='%u'; ------------------ The config on the other node is similar, except the mail_replica settings. The weird thing is, that my logs are completly empty. I see only the dovecot startup messages and nothing else. I don't understand why the replication never starts by itself or why there are no errors or anything else in the log. I already read the dovecot replication howto in the official documentation, but IMO I've setup everything already like in the docs. ----------------- I've already tried to replicate my mailboxes using dsync, but if I run the dsync command I get only this output: bash-4.1$ ssh vmail(a)server1.domain.dom /usr/bin/doveadm dsync-server -u john(a)domain.dom VERSION dsync 3 2 Hhostname sync_ns_prefix sync_box sync_box_guid sync_type debug sync_visible_namespaces exclude_mailboxes send_mail_requests backup_send backup_recv lock_timeout no_mail_sync no_backup_overwrite purge_remote Smailbox_guid last_uidvalidity last_common_uid last_common_modseq last_common_pvt_modseq changes_during_sync Nname existence mailbox_guid uid_validity uid_next last_renamed_or_created subscribed last_subscription_change Dhierarchy_sep mailboxes dirs unsubscribes Bmailbox_guid uid_validity uid_next messages_count first_recent_uid highest_modseq highest_pvt_modseq mailbox_lost cache_fields have_guids have_save_guids have_only_guid128 Atype key value stream deleted last_change modseq Ctype uid guid hdr_hash modseq pvt_modseq save_timestamp add_flags remove_flags final_flags keywords_reset keyword_changes Rguid uid Mguid uid pop3_uidl pop3_order received_date stream cname decision last_used . Hserver1.domain.dom dsync-remote(john(a)domain.dom): Error: dsync(local): I/O has stalled, no activity for 600 seconds dsync-remote(john(a)domain.dom): Error: Timeout during state=slave_recv_handshake Any help would be appreciated, because I've really no other ideas anymore. Thanks in advance PS: Excuse my english, I'am german :D

1 1

[Dovecot] Sieve is not getting the propper RCPT from the LMTP daemon
by klondike 14 Feb '14

14 Feb '14

Hi! Since the setup I use is a bit strange let's go for it first: * The system uses postfix as MTA and dovecot as LDA after alias translation by local via LMTP * The dovecot version is 2.2.5 and the pigeonhole version is 0.4.1 * The SMTP server at gentoo.org is configured to send me a backup of my emails to klondike+gentoo (at) xiscosoft.es using sendmail * The email is received by the server and then (hopefully filtered). * The email comes with two Delivered-To: headers, the first one has the correct address, the second one has the gentoo address. The interesting part of the filter is this: if envelope :detail "to" "gentoo" { addflag "\\Seen"; fileinto "gentoo"; stop; } But this doesn't seem to work, I enable debugging with the following lines: require "vnd.dovecot.debug"; require "envelope"; require "variables"; if envelope :matches "to" "*" { debug_log "envelope to `${1}'"; } if envelope :matches "from" "*" { debug_log "envelope from `${1}'"; } The relevant lines for the test e-mail I sent are these: sieve: info: started log at Dec 24 13:37:23. main script: line 9: info: DEBUG: envelope to `klondike (at) gentoo.org'. main script: line 10: info: DEBUG: envelope from `klondike (at) gentoo.org'. info: msgid=<52B97FF7.6050109(a)gentoo.org>: stored mail into mailbox 'INBOX'. The thing is that the to envelope should be instead klondike+gentoo (at) xiscosoft.es as show by the lmtp logs: Dec 24 13:37:23 localhost dovecot: lmtp(26249): Connect from local Dec 24 13:37:23 localhost dovecot: lmtp(26249, klondike): Cd6YHwOAuVKJZgAA0J78UA: sieve: msgid=<52B97FF7.6050109(a)gentoo.org>: stored mail into mailbox 'INBOX' Dec 24 13:37:23 localhost dovecot: lmtp(26249): Disconnect from local: Successful quit Dec 24 13:37:23 localhost postfix/lmtp[26248]: 657D9101E5E: to=<klondike+gentoo (at) xiscosoft.es>, relay=xiscosoft.net[private/dovecot-lmtp], delay=0.29, delays=0.05/0.03/0.03/0.18, dsn=2.0.0, status=sent (250 2.0.0 <klondike+gentoo (at) xiscosoft.es> Cd6YHwOAuVKJZgAA0J78UA Saved) I really have no idea of why sieve is behaving like this as the evelope address is sent properly by postfix's lmtp according to the logs. Any ideas? klondike PS: please do CC me when answering this e-mail as I'm not subscribed to the list yet

4 4

[Dovecot] RFC 5267 Contexts for IMAP4 PARTIAL results
by Anders Thøgersen 11 Feb '14

11 Feb '14

Hello, I am looking at PARTIAL responses using a dovecot version 2.2.5 and am running into an inconsistency with the RFC which I would like to ask about. The following section http://tools.ietf.org/html/rfc5267#section-4.4 lists client requests and server responses which I have tried running against a folder, specifying the ranges that fit the contents of the folder I have selected. The Last of the listed client requests returns a response that is not as I would expect: C: A04 UID SEARCH RETURN (PARTIAL 24000:24500) UNDELETED UNKEYWORD $Junk should return S: * ESEARCH (TAG "A04") UID PARTIAL (24000:24500 NIL) // No results are present, this is beyond the end of the results. S: A04 OK Completed. according to the RFC, but instead of NIL in the PARTIAL result I see the full range of UIDs that are in the folder, as in: C: A02 UID SEARCH RETURN (PARTIAL 23500:24000) UNDELETED S: * ESEARCH (TAG "A02") UID PARTIAL (23500:24000 1:9) S: A02 OK Search completed (0.000 secs). The folder that is selected contains 9 emails with the UIDs 1-9. Should the server return NIL Instead of returning 1:9? Thanks! Anders

2 2

[Dovecot] Dsync Errors
by Asai 08 Feb '14

08 Feb '14

Greetings, I've seen something like this in another thread, about a month ago, but we're running into this error pretty frequently when we run dsync backup. Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 [0x39ccc5f1c0] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x35) [0x39ccc5f2a5] -> /usr/lib64/dovecot/libdovecot.so.0 [0x39ccc5ebb3] -> dsync(dsync_brain_mailbox_tree_sync_change+0x41c) [0x42cc0c] -> dsync(dsync_brain_recv_mailbox_tree_deletes+0x10a) [0x42be7a] -> dsync(dsync_brain_run+0x4fc) [0x429cdc] -> dsync [0x42885b] -> dsync [0x4119ff] -> dsync(doveadm_mail_try_run+0x269) [0x411e09] -> dsync(main+0x358) [0x41a2c8] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x3f4281d994] -> dsync [0x4111c9] We're running Dovecot 2.2.4 and the dsync command is this: dsync -u <username> backup maildir:/mnt/backups/<period>/<domain>/<username> When this happens to a particular users account I delete the backup and let it rebuild, which works for awhile, but then it happens again, and it seems to happen to particular users. Can you point me in the right direction to start troubleshooting this? Thanks. -- --Asai

3 6

[Dovecot] Auth socket can't listen using ssl
by Anthony Bourguignon 07 Feb '14

07 Feb '14

Hi, I'm using Dovecot 2.2.9 (debian package on testing). It seems that it's not possible to open an auth socket using ssl. I'm using this configuration : service auth { [...] inet_listener authxmpp-client { address = [ips] port = 5220 } inet_listener genericauth-client { ssl = yes address = [ips] port = 5221 } [...] } Both ports are running fine. But the 5221, which should listen in ssl (because of the "ssl = yes" as written in the documentation here : http://wiki2.dovecot.org/Services ) is using plaintext. If I telnet directly to it, the content is delivered on an unsecured socket. Is there a way to make ssl works on this kind of socket ? Thanks a lot

4 7

[Dovecot] mime support for pigeonhole
by Tim Dickson 06 Feb '14

06 Feb '14

is there any chance of rfc5703 (mime support/extension) being added to pigeonhole? I am trying to filter mail with .exe and .zip attachments, to no success. I have tried *header :contains "x-attached" [".zip", ".exe"] *but emails i'm getting don't have x-attached. a sample snippet is below. Subject: testa1 Content-Type: multipart/mixed; boundary="------------020304040002050407030900" This is a multi-part message in MIME format. --------------020304040002050407030900 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit this has a compressed file added a1 --------------020304040002050407030900 Content-Type: application/x-zip-compressed; name="pinglog.zip" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="pinglog.zip" I have tried *header :contains ["Content-Type","name","filename"] ["application/x-zip-compressed",".zip",".exe"]* but that doesn't work either. I can't use body because that doesn't include the mime headers, so the only way I can see is to use mime (aka rfc5703) I am using dovecot 2.1.8 with pigeonhole 0.3.3 (and am about to use dovecot 2.2.9 with pigeonhole 0.4.2 on another server) If I'm just missing the point, or there is already support, please point me in the right direction.

6 7