- dovecot - dovecot.org

[Dovecot] Problems with dovecot 2.1.7, spamassassin 3.3.2 and antispam plugin
by Dean Carpenter 18 Feb '14

18 Feb '14

This might be a fairly long message, but I wanted to be sure to include as much information as possible. I'm having an issue with the dovecot-antispam plugin in that it seems to be unable to successfully run anything from the pipe backend. To qualify that, they run, but they fail ... Running /usr/bin/sa-learn directly always returns with an error code of 1, and the bayes DB isn't actually updated. Running the /usr/local/bin/sa-learn-pipe.sh script from the example will run sa-learn successfully, but sa-learn fails partway through, right on a sql DB access. I have both bayes and FuzzyOcr data stored in mysql, and the error occurs on accessing either one. That is, I've tested with FuzzyOcr enabled, and it fails on the db access to the FuzzyOcr DB, and I've tried it with FuzzyOcr disabled. In that case, it fails on the access to the bayes DB. The error line right there is : libgcc_s.so.1 must be installed for pthread_cancel to work Since sa-learn terminated prematurely, the bayes DB isn't updated at all. Running /usr/bin/sa-learn or the script /usr/local/bin/sa-learn-pipe.sh directly from cmdline works fine though - sa-learn completes correctly and updates the bayes DB properly, I can see the new tokens. $ sa-learn-pipe.sh --spam < /usr/share/doc/spamassassin/examples/sample-spam.txt $ sa-learn --spam /usr/share/doc/spamassassin/examples/sample-spam.txt I think it would be great to have a dedicated logfile for antispam, one that would capture both stdout as well as stderr. These tests are being done on a clean Ubuntu 13.04 system. I'm rebuilding the VM repeatedly as I configure the various pieces, and can test any changes or whatever you might suggest very easily. I've fully scripted the install and configuration of Exim4, Dovecot, Spamassassin, Clamav, Percona/Mysql, Roundcube, and can build a full VM under Virtualbox or any VPS in less than 10 minutes. Ubuntu 13.04 Dovecot 2.1.7 dovecot-antispam 2.0+20120225-3 Anyone else using the antispam plugin with spamassassin 3.3.2 ? Anything I can check to see what's causing this problem ? -------------------------------------------------------- $ cat /usr/local/bin/sa-learn-pipe.sh #!/bin/bash echo /usr/bin/sa-learn $* /tmp/sendmail-msg-$$.txt echo "$$-start ($*)" >> /var/log/sa-learn-pipe.log cat<&0 >> /tmp/sendmail-msg-$$.txt /usr/bin/sa-learn -D $* /tmp/sendmail-msg-$$.txt >> /tmp/sa-learn-pipe.$$.log 2>&1 echo $$ sa-learn rc=$? id=$(id) HOME=$HOME >> /var/log/sa-learn-pipe.log while read line; do echo $$-sa-learn "$line" >> /var/log/sa-learn-pipe.log done < /tmp/sa-learn-pipe.$$.log rm -f /tmp/sendmail-msg-$$.txt echo "$$-end" >> /var/log/sa-learn-pipe.log exit 0 -------------------------------------------------------- With FuzzyOcr DISabled, fails right after Bayes DB access $ cat /var/log/sa-learn-pipe.log 4505-start (--spam) 4505 sa-learn rc=134 id=uid=108(Debian-exim) gid=113(Debian-exim) groups=113(Debian-exim) HOME= 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: logger: adding facilities: all 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: logger: logging level is DBG 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: generic: SpamAssassin version 3.3.2 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: generic: Perl 5.014002, PREFIX=/usr, DEF_RULES_DIR=/usr/share/spamassassin, LOCAL_RULES_DIR=/etc/spamassassin, LOCAL_STATE_DIR=/var/lib/spamassassin : : 4505-sa-learn Nov 8 09:05:27.131 [4507] dbg: replacetags: done replacing tags 4505-sa-learn Nov 8 09:05:27.131 [4507] dbg: FreeMail: loaded freemail_domains entries: 2470 normal, 29 wildcard 4505-sa-learn Nov 8 09:05:27.132 [4507] dbg: plugin: Mail::SpamAssassin::Plugin::Bayes=HASH(0x3879e88) implements 'learner_new', priority 0 4505-sa-learn Nov 8 09:05:27.132 [4507] dbg: bayes: learner_new self=Mail::SpamAssassin::Plugin::Bayes=HASH(0x3879e88), bayes_store_module=Mail::SpamAssassin::BayesStore::MySQL 4505-sa-learn Nov 8 09:05:27.151 [4507] dbg: bayes: using username: debian-spamd 4505-sa-learn Nov 8 09:05:27.151 [4507] dbg: bayes: learner_new: got store=Mail::SpamAssassin::BayesStore::MySQL=HASH(0x3ec0388) 4505-sa-learn Nov 8 09:05:27.152 [4507] dbg: plugin: Mail::SpamAssassin::Plugin::Bayes=HASH(0x3879e88) implements 'learner_is_scan_available', priority 0 4505-sa-learn libgcc_s.so.1 must be installed for pthread_cancel to work 4505-end 7235-start () -------------------------------------------------------- With FuzzyOcr ENabled, fails right after FuzzyOcr DB access $ cat /var/log/sa-learn-pipe.log : : 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan ocrad-invert: /usr/bin/ocrad -s5 -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan ocrad-decolorize-invert: /usr/bin/ocrad -s5 -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan ocrad-decolorize: /usr/bin/ocrad -s5 $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan gocr: /usr/bin/gocr -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan gocr-180: /usr/bin/gocr -l 180 -d 2 -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan tesseract: /usr/bin/tesseract $input $output 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Importing for MLDBM databases not available (dependencies missing) 7804-sa-learn Nov 8 09:37:09.612 [7806] dbg: FuzzyOcr: Connecting to: dbi:mysql:database=FuzzyOcr;mysql_socket=/var/run/mysqld/mysqld.sock 7804-sa-learn libgcc_s.so.1 must be installed for pthread_cancel to work 7804-end -------------------------------------------------------- syslog entries from running with sa-learn-pipe.sh script antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh Nov 8 09:36:41 newgalah1 imap: antispam: plugin initialising (2.0-notgit) Nov 8 09:36:41 newgalah1 imap: antispam: verbose debug enabled Nov 8 09:36:41 newgalah1 imap: antispam: "Junk" is exact match spam folder Nov 8 09:36:41 newgalah1 imap: antispam: "Spam" is exact match spam folder Nov 8 09:36:41 newgalah1 imap: antispam: no unsure folders Nov 8 09:36:41 newgalah1 imap: antispam: "Trash" is wildcard match trash folder Nov 8 09:36:41 newgalah1 imap: antispam: "Deleted *" is wildcard match trash folder Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend spam argument = --spam Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend not-spam argument = --ham Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend program = /usr/local/bin/sa-learn-pipe.sh Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend tmpdir /tmpNov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_unsure(Junk): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_trash(INBOX): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_trash(Junk): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mail copy: from trash: 0, to trash: 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_spam(INBOX): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_spam(Junk): 1 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_unsure(INBOX): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 Nov 8 09:37:08 newgalah1 imap: antispam: running mailtrain backend program /usr/local/bin/sa-learn-pipe.sh Nov 8 09:37:08 newgalah1 imap: antispam: running mailtrain backend program /usr/local/bin/sa-learn-pipe.sh Nov 8 09:37:08 newgalah1 imap: antispam: running mailtrain backend program parameter 1 --spam -------------------------------------------------------- syslog entries from running with sa-learn directly antispam_pipe_program = /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: plugin initialising (2.0-notgit) Nov 8 09:44:57 newgalah1 imap: antispam: verbose debug enabled Nov 8 09:44:57 newgalah1 imap: antispam: "Junk" is exact match spam folder Nov 8 09:44:57 newgalah1 imap: antispam: "Spam" is exact match spam folder Nov 8 09:44:57 newgalah1 imap: antispam: no unsure folders Nov 8 09:44:57 newgalah1 imap: antispam: "Trash" is wildcard match trash folder Nov 8 09:44:57 newgalah1 imap: antispam: "Deleted *" is wildcard match trash folder Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend spam argument = --spam Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend not-spam argument = --ham Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend program = /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend tmpdir /tmp Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_unsure(Junk): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_trash(INBOX): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_trash(Junk): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mail copy: from trash: 0, to trash: 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_spam(INBOX): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_spam(Junk): 1 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_unsure(INBOX): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 Nov 8 09:44:57 newgalah1 imap: antispam: running mailtrain backend program /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: running mailtrain backend program /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: running mailtrain backend program parameter 1 --spam Nov 8 09:44:58 newgalah1 imap: antispam: run program failed with exit code -1 -------------------------------------------------------- $ cat 90-plugin.conf plugin { antispam_debug_target = syslog antispam_verbose_debug = 1 antispam_backend = pipe antispam_trash_pattern = Trash;Deleted * antispam_spam = Junk;Spam antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh # antispam_pipe_program_args = --progress antispam_pipe_program_spam_arg = --spam antispam_pipe_program_notspam_arg = --ham antispam_pipe_tmpdir = /tmp } -------------------------------------------------------- $ dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.8.0-32-generic x86_64 Ubuntu 13.04 auth_mechanisms = cram-md5 login plain first_valid_uid = 108 mail_location = maildir:~/Maildir:LAYOUT=fs:INBOX=~/Maildir/INBOX managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;as cii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = scheme=plain username_format=%u /var/mail/%d/PASSWD driver = passwd-file } plugin { antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh antispam_pipe_program_notspam_arg = --ham antispam_pipe_program_spam_arg = --spam antispam_pipe_tmpdir = /tmp antispam_spam = Junk;Spam antispam_trash_pattern = Trash;Deleted * antispam_verbose_debug = 1 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve" service auth { unix_listener auth-client { mode = 0666 } } ssl = required ssl_cert = </etc/ssl/certs/dovecot1.crt ssl_key = </etc/ssl/private/dovecot1.pkcs8.key userdb { args = username_format=%u /var/mail/%d/PASSWD default_fields = uid=Debian-exim gid=Debian-exim home=/var/mail/%d/%n driver = static } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol imap { mail_plugins = " antispam" }

6 10

[Dovecot] SMTP configuration for director mail cluster
by Murray Trainer 18 Feb '14

18 Feb '14

HI All, I have setup my Dovecot director proxies and Dovecot backend mail stores. I intend setting up several incoming and outgoing Exim MTA's. I am a bit confused about what I need to run on the backend Dovecot MTA's to get the incoming mail delivered to them. Do I need to install Exim on them or use LMTP to receive mail from the MTA's? Also, can I directly deliver mail to the mailstores or do I have to go through the director proxies using lmtp? Note that I am using Director with the mailboxes on NFS backed storage. Thanks Murray

2 1

[Dovecot] Bug report
by Ramon 18 Feb '14

18 Feb '14

I'm using release 2.2.12, during a copy operation i get segfault on imap process. I have full bt of the issue: (gdb) bt #0 0x00007fcc521029cd in mail_cache_header_fields_read (cache=0x15c7210) at mail-cache-fields.c:369 #1 0x00007fcc52100664 in mail_cache_open_and_verify (cache=0x15c7210) at mail-cache.c:497 #2 0x00007fcc5210244d in mail_cache_register_get_list (cache=0x15c7210, pool=0x1573608, count_r=0x7fff7b3b2418) at mail-cache-fields.c:194 #3 0x00007fcc520ef845 in index_mail_parse_header_register_all_wanted (mail=0x15d4b60, headers=<value optimized out>) at index-mail-headers.c:170 #4 index_mail_parse_header_init (mail=0x15d4b60, headers=<value optimized out>) at index-mail-headers.c:230 #5 0x00007fcc520efdb8 in index_mail_cache_parse_init (_mail=0x15d4b60, input=0x15ddb38) at index-mail-headers.c:376 #6 0x00007fcc520bb163 in maildir_save_add (_ctx=0x15d3b20, tmp_fname=0x15735e8 "1392731650.M182940P5176.pecpop5", src_mail=0x0) at maildir-save.c:225 #7 0x00007fcc520bb4b8 in maildir_save_begin (_ctx=0x15d3b20, input=0x15debb8) at maildir-save.c:415 #8 0x00007fcc511e7360 in quota_save_begin (ctx=0x15d3b20, input=0x15debb8) at quota-storage.c:274 #9 0x00007fcc520cc182 in mailbox_save_begin (ctx=0x7fff7b3b25a8, input=0x15debb8) at mail-storage.c:2025 #10 0x00007fcc520c6242 in mail_storage_try_copy (ctx=0x15d3b20, mail=<value optimized out>) at mail-copy.c:76 #11 mail_storage_copy (ctx=0x15d3b20, mail=<value optimized out>) at mail-copy.c:101 #12 0x00007fcc520b6916 in maildir_copy (ctx=0x15d3b20, mail=0x15cf300) at maildir-copy.c:148 #13 0x00007fcc50dd7461 in notify_copy (ctx=0x15d3b20, mail=0x15cf300) at notify-storage.c:107 #14 0x00007fcc511e7183 in quota_copy (ctx=0x15d3b20, mail=0x15cf300) at quota-storage.c:220 #15 0x00007fcc520cc01f in mailbox_copy (_ctx=<value optimized out>, mail=0x15cf300) at mail-storage.c:2133 #16 0x000000000040c63b in fetch_and_copy (cmd=0x1593810, move=false) at cmd-copy.c:70 #17 cmd_copy_full (cmd=0x1593810, move=false) at cmd-copy.c:123 #18 0x0000000000416fbd in command_exec (cmd=0x1593810) at imap-commands.c:158 #19 0x00000000004160e0 in client_command_input (cmd=0x1593810) at imap-client.c:780 #20 0x00000000004161cd in client_command_input (cmd=0x1593810) at imap-client.c:841 #21 0x000000000041644d in client_handle_next_command (client=0x1592fb0) at imap-client.c:879 #22 client_handle_input (client=0x1592fb0) at imap-client.c:891 #23 0x00000000004167bf in client_input (client=0x1592fb0) at imap-client.c:933 #24 0x00007fcc51e1f336 in io_loop_call_io (io=0x158c1d0) at ioloop.c:388 #25 0x00007fcc51e203a7 in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:220 #26 0x00007fcc51e1f2a8 in io_loop_run (ioloop=0x157b720) at ioloop.c:412 #27 0x00007fcc51dcdf73 in master_service_run (service=0x157b5b0, callback=<value optimized out>) at master-service.c:566 #28 0x000000000041fd07 in main (argc=1, argv=0x157b390) at main.c:400 Here's config: auth_debug = yes auth_master_user_separator = * auth_username_format = default_vsz_limit = 512 M disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 101 first_valid_uid = 102 imap_id_send = import_environment = TZ info_log_path = /var/log/dovecot.log log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = always mail_gid = 101 mail_location = maildir:%h/Maildir mail_max_userip_connections = 50 mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota expire fts fts_lucene mail_log notify mail_uid = 102 maildir_broken_filename_sizes = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . subscriptions = yes type = private } passdb { args = /opt/dovecot-2.2.10/etc/dovecot/passwd.masterusers driver = passwd-file master = yes } passdb { args = /opt/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /opt/dovecot-2.2.10/etc/dovecot/dovecot-ldap-multiuser.conf driver = ldap master = yes } plugin { fts = lucene fts_lucene = mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = maildir quota_rule2 = INBOX.Trash:storage=+100M } protocols = imap pop3 service anvil { client_limit = 3000 } service auth { client_limit = 4096 unix_listener auth-userdb { mode = 0600 } } service imap-login { inet_listener imap { address = 10.11.47.49 port = 143 } inet_listener imaps { address = 10.11.47.49 port = 993 ssl = yes } process_limit = 2500 process_min_avail = 5 } service imap { drop_priv_before_exec = yes process_limit = 2500 process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { drop_priv_before_exec = yes process_limit = 1024 } service pop3-login { inet_listener pop3 { address = 10.11.47.49 port = 110 } inet_listener pop3s { address = 10.11.47.49 port = 995 ssl = yes } process_limit = 300 process_min_avail = 5 } service pop3 { drop_priv_before_exec = yes process_limit = 300 process_min_avail = 5 } ssl_cert = </opt/dovecot-2.2.10/certs/imapd.pem ssl_key = </opt/dovecot-2.2.10/certs/imapd.pem userdb { args = /opt/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf driver = ldap } protocol lmtp { mail_plugins = quota expire fts fts_lucene mail_log notify sieve } protocol lda { mail_plugins = quota expire fts fts_lucene mail_log notify sieve } protocol imap { mail_plugins = quota imap_quota mail_log notify } protocol pop3 { mail_plugins = quota mail_log notify pop3_uidl_format = UID%u-%v } Regards, Ramon

1 0

[Dovecot] PARTIAL results and UIDs
by Anders Thøgersen 18 Feb '14

18 Feb '14

Hi, I have had a look at dovecot 2.2.12 and think that I may have run into an issue with PARTIAL results. I have a mailbox with 9 emails having UIDs from 1 - 9. One of these emails contains the STRING "RFC" in the Subject header. The following SORT command with this mailbox selected does not return any emails: A4 UID SORT RETURN (COUNT PARTIAL 1:3) (FROM) UTF-8 (SUBJECT "RFC") * ESEARCH (TAG "A4") UID PARTIAL (1:3 NIL) COUNT 1 A4 OK Sort completed (0.000 secs). Here COUNT is 1, but the result is NIL. Changing the partial range to 1:5 returns the expected result: A4 UID SORT RETURN (COUNT PARTIAL 1:5) (FROM) UTF-8 (SUBJECT "RFC") * ESEARCH (TAG "A4") UID PARTIAL (1:5 5) COUNT 1 A4 OK Sort completed (0.000 secs). It may be that UIDs are used instead of sequence numbers. Regards Anders

1 0

[Dovecot] Possible error in function mailbox_autocreate
by Potapov Sergey 18 Feb '14

18 Feb '14

Hi! in mailbox_autocreate: if (mailbox_create(box, NULL, FALSE) < 0) { errstr = mailbox_get_last_error(box, &error); if (error != MAIL_ERROR_NOTFOUND) { <<< May be MAIL_ERROR_EXISTS should be here? mail_storage_set_critical(box->storage, "Failed to autocreate mailbox %s: %s", box->vname, errstr); return -1; } Some time I got this error when two connections tries to create INBOX at same time. ______ С уважением, Сергей Потапов

1 0

[Dovecot] Dsync crash (v2.2.10, sdbox+sis → mbox)
by Gilles Chauvin 18 Feb '14

18 Feb '14

Hi, I'm trying to use dsync to convert sdbox + sis mailboxes to mbox (mbox is chosen here to "re-attach" the attachments to their original place) # dsync -Dv -u $LOGIN -o "mail_location=sdbox:/zfspool/clone_srv_mail/$LOGIN" -o "mail_attachment_dir=/zfspool/clone_srv_attachments" backup "mbox:/zfspool/restore/$LOGIN/mbox:DIRNAME=mBoX-MeSsAgEs:INDEX=/zfspool/restore/$LOGIN/indexes:CONTROL=/zfspool/restore/$LOGIN/control" For 5 users out of a sample of 24, here is what's happening: dsync(user1): Error: read(/zfspool/clone_srv_attachments/cb/0a/cb0aad465a4ff95bf6fa6ece0fba94b43e8892cf-19dc51309fc2f3527e31000044c1c7e7-b55eb9176ca1b350e565000094b229f9-30810[base64:19 b/l]) failed: Stream is larger than expected (163244 > 163243, eof=1) dsync(user1): Error: copy: i_stream_read() failed: Invalid argument dsync(user1): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(user1): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f58a95a189a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f58a95a19a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f58a955b1cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc0287) [0x7f58a98ca287] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc3145) [0x7f58a98cd145] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xb6) [0x7f58a98bcb06] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x91) [0x7f58a98be5e1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa0ac3) [0x7f58a98aaac3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4a) [0x7f58a98ab04a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c021) [0x7f58a98a6021] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c151) [0x7f58a98a6151] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0xf5) [0x7f58a98a6295] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x48) [0x7f58a98867c8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x92) [0x7f58a9880e32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5f) [0x7f58a9886c2f] -> dsync() [0x42f750] -> dsync(dsync_brain_sync_mails+0x459) [0x42e9c9] -> dsync(dsync_brain_run+0x2a1) [0x42ac51] -> dsync() [0x42876f] -> dsync() [0x411c97] -> dsync(doveadm_mail_try_run+0x238) [0x4120a8] -> dsync(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f58a91c3d1d] -> dsync() [0x411419] dsync(user2): Error: read(/zfspool/clone_srv_attachments/ad/0c/ad0cef35cc6f0b2dae2197c4ff2b61a2bd58070d-9e8345192ccbf352c210000044c1c7e7-6efa5f2e522db350ed3d000094b229f9-15470[base64:18 b/l]) failed: Stream is larger than expected (194476 > 194475, eof=1) dsync(user2): Error: copy: i_stream_read() failed: Invalid argument dsync(user2): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(user2): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f2e2248d89a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f2e2248d9a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f2e224471cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc0287) [0x7f2e227b6287] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc3145) [0x7f2e227b9145] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xb6) [0x7f2e227a8b06] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x91) [0x7f2e227aa5e1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa0ac3) [0x7f2e22796ac3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4a) [0x7f2e2279704a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c021) [0x7f2e22792021] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c151) [0x7f2e22792151] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0xf5) [0x7f2e22792295] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x48) [0x7f2e227727c8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x92) [0x7f2e2276ce32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5f) [0x7f2e22772c2f] -> dsync() [0x42f750] -> dsync(dsync_brain_sync_mails+0x459) [0x42e9c9] -> dsync(dsync_brain_run+0x2a1) [0x42ac51] -> dsync() [0x42876f] -> dsync() [0x411c97] -> dsync(doveadm_mail_try_run+0x238) [0x4120a8] -> dsync(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f2e220afd1d] -> dsync() [0x411419] dsync(user3): Error: read(/zfspool/clone_srv_attachments/23/8a/238a781b53bb4d1b1bee989a5ff38636b616d5c5-41ba47152912f4522c6f000044c1c7e7-f3b06c2f5aa1b350d565000094b229f9-38650[base64:19 b/l]) failed: Stream is larger than expected (33191 > 33190, eof=1) dsync(user3): Error: copy: i_stream_read() failed: Invalid argument dsync(user3): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(user3): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f88d4bde89a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f88d4bde9a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f88d4b981cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc0287) [0x7f88d4f07287] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc3145) [0x7f88d4f0a145] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xb6) [0x7f88d4ef9b06] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x91) [0x7f88d4efb5e1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa0ac3) [0x7f88d4ee7ac3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4a) [0x7f88d4ee804a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c021) [0x7f88d4ee3021] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c151) [0x7f88d4ee3151] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0xf5) [0x7f88d4ee3295] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x48) [0x7f88d4ec37c8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x92) [0x7f88d4ebde32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5f) [0x7f88d4ec3c2f] -> dsync() [0x42f750] -> dsync(dsync_brain_sync_mails+0x459) [0x42e9c9] -> dsync(dsync_brain_run+0x2a1) [0x42ac51] -> dsync() [0x42876f] -> dsync() [0x411c97] -> dsync(doveadm_mail_try_run+0x238) [0x4120a8] -> dsync(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f88d4800d1d] -> dsync() [0x411419] dsync(user4): Error: read(/zfspool/clone_srv_attachments/11/fa/11fa090f48879e8514a07040a837b5544364e091-d5dd321af54ff452790f000044c1c7e7-98da7910e38db350b75a000094b229f9-50167[base64:19 b/l]) failed: Stream is larger than expected (56522 > 56521, eof=1) dsync(user4): Error: copy: i_stream_read() failed: Invalid argument dsync(user4): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(user4): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f416564a89a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f416564a9a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f41656041cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc0287) [0x7f4165973287] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc3145) [0x7f4165976145] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xb6) [0x7f4165965b06] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x91) [0x7f41659675e1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa0ac3) [0x7f4165953ac3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4a) [0x7f416595404a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c021) [0x7f416594f021] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c151) [0x7f416594f151] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0xf5) [0x7f416594f295] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x48) [0x7f416592f7c8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x92) [0x7f4165929e32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5f) [0x7f416592fc2f] -> dsync() [0x42f750] -> dsync(dsync_brain_sync_mails+0x459) [0x42e9c9] -> dsync(dsync_brain_run+0x2a1) [0x42ac51] -> dsync() [0x42876f] -> dsync() [0x411c97] -> dsync(doveadm_mail_try_run+0x238) [0x4120a8] -> dsync(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f416526cd1d] -> dsync() [0x411419] dsync(user5): Error: read(/zfspool/clone_srv_attachments/77/aa/77aa90d73107cc35fd0305c22a84eb00e793c935-a0d2ef302a20f552de5a000044c1c7e7-2accb7218264b350a423000094b229f9-11713[base64:19 b/l]) failed: Stream is larger than expected (43663 > 43662, eof=1) dsync(user5): Error: copy: i_stream_read() failed: Invalid argument dsync(user5): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(user5): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f2ab375489a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f2ab37549a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f2ab370e1cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc0287) [0x7f2ab3a7d287] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc3145) [0x7f2ab3a80145] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xb6) [0x7f2ab3a6fb06] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x91) [0x7f2ab3a715e1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa0ac3) [0x7f2ab3a5dac3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4a) [0x7f2ab3a5e04a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c021) [0x7f2ab3a59021] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c151) [0x7f2ab3a59151] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0xf5) [0x7f2ab3a59295] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x48) [0x7f2ab3a397c8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x92) [0x7f2ab3a33e32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5f) [0x7f2ab3a39c2f] -> dsync() [0x42f750] -> dsync(dsync_brain_sync_mails+0x459) [0x42e9c9] -> dsync(dsync_brain_run+0x2a1) [0x42ac51] -> dsync() [0x42876f] -> dsync() [0x411c97] -> dsync(doveadm_mail_try_run+0x238) [0x4120a8] -> dsync(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f2ab3376d1d] -> dsync() [0x411419] Regards, Gilles.

1 1

[Dovecot] The submission server
by Peter Mogensen 18 Feb '14

18 Feb '14

Hi, As many others I'm looking forward to the submission server. But I have a question: A use-case with authenticated SMTP is to have the server restrict From/Sender headers based on the authenticated user. (and adding the actual authenticated user to the headers) Postfix supports this (AFAICS) and I can't imagine Exims doesn't either with it's elaborate config possibilities. But will that be possible with the Dovecot submission server? /Peter

2 3

[Dovecot] Master user ldap config
by Roman Gelfand 17 Feb '14

17 Feb '14

I am using outlook 2010 to login to pop3 mailbox as master user. The user name I provide is john@domain.tld*test@domain.tld. The password is that of test(a)domain.tld. I am not quite sure as to how to specify ACL. I guessed the ACL specs as per ldap config, below. But it is not working. The master password is stored in master-users file. The ldap config is # debug_level = 9 hosts = 192.168.0.22:389 ldap_version = 3 auth_bind = yes dn = dlookup(a)domain.local dnpass = password base = OU=Test Users,DC=domain,DC=local scope = subtree deref = never user_filter = (&(Mail=%u)(objectClass=person)(!(userAccountControl=514))) pass_filter = (&(Mail=%u)(objectClass=person)(!(userAccountControl=514))) pass_attrs = uid=user, userPassword=password, =proxy=y, =destuser=%u*masteruser, =pass=mastpass default_pass_scheme = CRYPT user_attrs = =uid=999,=gid=8,=home=/vmail/%Ld/%Ln/home/,=mail=maildir:/vmail/%Ld/%Ln/Maildir/ The dovecot.conf is auth_mechanisms = plain login disable_plaintext_auth = no base_dir = /var/run/dovecot/ log_path = /var/log/dovecot.log info_log_path = /var/log/dovecot.info.log mail_debug = no auth_debug = no auth_verbose = no auth_debug_passwords = no first_valid_gid = 8 instance_name = test last_valid_gid = 8 log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:~/Maildir mail_privileged_group = mail passdb { args = /etc/dovecot/conf.d/users.conf driver = passwd-file } passdb { args = /etc/dovecot/dovecot-ldap-test.conf driver = ldap } auth_master_user_separator = * passdb { driver = passwd-file args = /etc/dovecot/master-users master = yes pass = yes } service auth { inet_listener { port = 10305 } unix_listener auth-master { group = mail mode = 0600 user = mail } } userdb { args = /etc/dovecot/conf.d/users.conf driver = passwd-file } userdb { args = /etc/dovecot/master-users driver = passwd-file } userdb { args = /etc/dovecot/dovecot-ldap-test.conf driver = ldap } protocol lmtp { postmaster_address = postmaster(a)domain.tld mail_plugins = sieve } protocol lda { postmaster_address = postmaster(a)domain.tld hostname = server.domain.tld # Sieve plugin for local delivery agent mail_plugins = cmusieve log_path = /var/log/dovecot-local-deliver.log }

2 1

[Dovecot] lda+ldap multiple users
by matthias lay 17 Feb '14

17 Feb '14

Hi list and timo, I use dovecot lda with ldap to do a email => user lookup. I experienced that if a Mailaddress matches several users the delivery is aborted. ---------------- dovecot: auth: Error: ldap(christian.test(a)securepoint.de): LDAP search returned multiple entries dovecot: auth: ldap(christian.test(a)securepoint.de): unknown user dovecot: lda: Error: user christian.test(a)securepoint.de: Auth USER lookup failed ----------------- now my question, is there a way to have a mail like that delivered to all users that matches the lookup? havent found anything in the docs. thx in advance Matze

3 6

[Dovecot] Using DSYNC between dovecot 1.2.15 and 2.1.7 servers.
by Raphael GARCIA CTI 17 Feb '14

17 Feb '14

Hello everyone, Is it possible to use DSYNC between dovecot 1.2.15 and 2.1.7 servers ? Precisely replicate a dovecot 1.2.15 server to a 2.1.7 server ? Best regards. -- Raphaël Garcia

2 1

[Dovecot] Segmentation fault in libdovecot-storage.so
by Francesco Fiore 17 Feb '14

17 Feb '14

Hi, I obtain continuosly segmentation fault of processes pop3 and imap, with version 2.2.10. This is the error for the pop3 process (but for imap is is the same): 2014-02-10 11:06:22 pop3(xxxxxxx(a)yyyyyyyy.zz): Fatal: master: service(pop3): child 23804 killed with signal 11 (core dumped) This is the kernel log: Feb 10 11:06:22 pecpop5 kernel: pop3[23804]: segfault at 7fa42a3f4070 ip 00007fa41ff849cd sp 00007fff78dedfa0 error 4 in libdovecot-storage.so.0.0.0[7fa41fefa000+d9000] ------------------------------------------------------- # /opt/dovecot-2.2.10/sbin/dovecot --version 2.2.10 ------------------------------------------------------- # cat /etc/redhat-release CentOS release 6.4 (Final) ------------------------------------------------------- # uname -r 2.6.32-358.23.2.el6.x86_64 ------------------------------------------------------- Filesystem: NFS ------------------------------------------------------- # /opt/dovecot-2.2.10/sbin/dovecot -n # 2.2.10: /opt/dovecot-2.2.10/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 CentOS release 6.4 (Final) auth_debug = yes auth_master_user_separator = * auth_username_format = default_vsz_limit = 512 M disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 101 first_valid_uid = 102 imap_id_send = import_environment = TZ info_log_path = /var/log/dovecot.log log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = always mail_gid = 101 mail_location = maildir:%h/Maildir mail_max_userip_connections = 50 mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota expire fts fts_lucene mail_log notify mail_uid = 102 maildir_broken_filename_sizes = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . subscriptions = yes type = private } passdb { args = /opt/dovecot-2.2.10/etc/dovecot/passwd.masterusers driver = passwd-file master = yes } passdb { args = /opt/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /opt/dovecot-2.2.10/etc/dovecot/dovecot-ldap-multiuser.conf driver = ldap master = yes } plugin { fts = lucene fts_lucene = mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = maildir quota_rule2 = INBOX.Trash:storage=+100M } protocols = imap pop3 service anvil { client_limit = 3000 } service auth { client_limit = 4096 unix_listener auth-userdb { mode = 0600 } } service imap-login { inet_listener imap { address = 10.11.47.49 port = 143 } inet_listener imaps { address = 10.11.47.49 port = 993 ssl = yes } process_limit = 2500 process_min_avail = 5 } service imap { drop_priv_before_exec = yes process_limit = 2500 process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { drop_priv_before_exec = yes process_limit = 1024 } service pop3-login { inet_listener pop3 { address = 10.11.47.49 port = 110 } inet_listener pop3s { address = 10.11.47.49 port = 995 ssl = yes } process_limit = 300 process_min_avail = 5 } service pop3 { drop_priv_before_exec = yes process_limit = 300 process_min_avail = 5 } ssl_cert = </opt/dovecot-2.2.10/certs/imapd.pem ssl_key = </opt/dovecot-2.2.10/certs/imapd.pem userdb { args = /opt/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf driver = ldap } protocol lmtp { mail_plugins = quota expire fts fts_lucene mail_log notify sieve } protocol lda { mail_plugins = quota expire fts fts_lucene mail_log notify sieve } protocol imap { mail_plugins = quota imap_quota mail_log notify } protocol pop3 { mail_plugins = quota mail_log notify pop3_uidl_format = UID%u-%v } ------------------------------------------------------- (gdb) bt full #0 0x00007f351537e9cd in mail_cache_header_fields_read (cache=0xf16740) at mail-cache-fields.c:369 field_hdr = 0x7f35157ed040 field = {name = 0x0, idx = 0, type = MAIL_CACHE_FIELD_FIXED_SIZE, field_size = 0, decision = MAIL_CACHE_DECISION_NO, last_used = 0} last_used = 0x7f35157ed04c sizes = 0x7f35217ed04c types = 0x7f352d7ed04c <Address 0x7f352d7ed04c out of bounds> decisions = 0x7f35307ed04c <Address 0x7f35307ed04c out of bounds> p = 0x7f35337ed04c <Address 0x7f35337ed04c out of bounds> names = <value optimized out> end = 0x7f355e7ed040 <Address 0x7f355e7ed040 out of bounds> orig_key = 0x7f35155e8715 "I\211\303L\213L$0L\213D$(H\213|$ H\213t$\030H\213T$\020H\213L$\bH\213\004$H\203\304HA\377\343ffffff.\017\037\204" fidx = <value optimized out> new_fields_count = <value optimized out> dec = <value optimized out> max_drop_time = 1388530800 offset = 64 i = <value optimized out> #1 0x00007f351537c664 in mail_cache_open_and_verify (cache=0xf16740) at mail-cache.c:497 ret = 1 #2 0x00007f351537fe4c in mail_cache_field_exists (view=0xf16110, seq=<value optimized out>, field=<value optimized out>) at mail-cache-lookup.c:345 data = <value optimized out> __FUNCTION__ = "mail_cache_field_exists" #3 0x00007f351537ff64 in mail_cache_lookup_field (view=0xf16110, dest_buf=0x7fff96c80030, seq=52, field_idx=0) at mail-cache-lookup.c:413 field_def = <value optimized out> iter = {view = 0x7f3500000001, remap_counter = 0, seq = 0, rec = 0x1, pos = 355448944, rec_size = 32565, offset = 2048, trans_next_idx = 0, stop = 0, failed = 0, memory_appends_checked = 0, disk_appends_checked = 0} field = {field_idx = 15818688, size = 0, data = 0x0, offset = 52} ret = <value optimized out> #4 0x00007f3515367999 in index_mail_cache_lookup_field (mail=0xf21910, buf=<value optimized out>, field_idx=<value optimized out>) at index-mail.c:68 ret = -1765278176 #5 0x00007f35153685c5 in index_mail_get_fixed_field (mail=0xf21910, field=<value optimized out>, data=<value optimized out>, data_size=4) at index-mail.c:130 field_idx = 0 buf = {data = 0xf21b14, used = 0, priv = {0xf21b14, 0x0, 0x4, 0x0, 0x0}} __FUNCTION__ = "index_mail_get_fixed_field" #6 0x00007f3515368843 in index_mail_update_access_parts (mail=0xf21910) at index-mail.c:1385 _mail = 0xf21910 data = 0xf21a80 cache_fields = 0xf164a0 cache_view = 0xf16110 hdr = <value optimized out> input = 0x7f35150a0227 #7 0x00007f3515368a56 in index_mail_set_seq (_mail=0xf21910, seq=52, saving=<value optimized out>) at index-mail.c:1521 mail = 0xf21910 #8 0x00007f351536e72b in search_more_with_mail (ctx=0xf1f620, mail_r=0x7fff96c80190) at index-search.c:1507 _ctx = 0xf1f620 box = 0xf12030 cost2 = <value optimized out> match = <value optimized out> ret = -1 imail = 0xf21910 cost1 = 0 #9 search_more_with_prefetching (ctx=0xf1f620, mail_r=0x7fff96c80190) at index-search.c:1579 _data_stack_cur_id = 4 ret = <value optimized out> mail = 0xf21910 mails = <value optimized out> ---Type <return> to continue, or q <return> to quit--- #10 search_more (ctx=0xf1f620, mail_r=0x7fff96c80190) at index-search.c:1650 imail = <value optimized out> ret = -1765278176 #11 0x00007f351536ee28 in index_storage_search_next_nonblock (_ctx=0xf1f620, mail_r=0xf0f9a8, tryagain_r=0x7fff96c801ff) at index-search.c:1674 ctx = 0xf1f620 mail = <value optimized out> mailp = <value optimized out> seq = <value optimized out> ret = <value optimized out> #12 0x00007f3515348507 in mailbox_search_next_nonblock (ctx=0xf1f620, mail_r=0xf0f9a8, tryagain_r=<value optimized out>) at mail-storage.c:1787 box = <value optimized out> #13 0x00007f3515348566 in mailbox_search_next (ctx=0xf1f620, mail_r=0xf0f9a8) at mail-storage.c:1773 tryagain = false #14 0x0000000000418a0e in imap_fetch_more_int (ctx=0xf0f948, cancel=false) at imap-fetch.c:479 state = 0xf0f998 client = 0xf0efb0 handlers = 0xf0fc78 count = 5 ret = <value optimized out> __FUNCTION__ = "imap_fetch_more_int" #15 0x0000000000418b61 in imap_fetch_more (ctx=0xf0f948, cmd=0xf0f810) at imap-fetch.c:556 ret = <value optimized out> __FUNCTION__ = "imap_fetch_more" #16 0x000000000040d75d in cmd_fetch (cmd=0xf0f810) at cmd-fetch.c:284 client = 0xf0efb0 ctx = 0xf0f948 args = 0xefaa38 next_arg = <value optimized out> list_arg = 0x0 search_args = 0x0 qresync_args = {qresync_sample_seqset = 0xf0f7f0, qresync_sample_uidset = 0x7f35150ae158} messageset = 0xefaba0 "52:84" send_vanished = <value optimized out> ret = <value optimized out> #17 0x0000000000416fbd in command_exec (cmd=0xf0f810) at imap-commands.c:158 hook = 0xef80f0 ret = <value optimized out> #18 0x00000000004160e0 in client_command_input (cmd=0xf0f810) at imap-client.c:780 client = 0xf0efb0 command = <value optimized out> __FUNCTION__ = "client_command_input" #19 0x00000000004161cd in client_command_input (cmd=0xf0f810) at imap-client.c:841 client = 0xf0efb0 command = <value optimized out> __FUNCTION__ = "client_command_input" #20 0x000000000041644d in client_handle_next_command (client=0xf0efb0) at imap-client.c:879 No locals. #21 client_handle_input (client=0xf0efb0) at imap-client.c:891 _data_stack_cur_id = 3 ret = false remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #22 0x00000000004167bf in client_input (client=0xf0efb0) at imap-client.c:933 cmd = <value optimized out> output = 0xf08100 ---Type <return> to continue, or q <return> to quit--- bytes = 77 __FUNCTION__ = "client_input" #23 0x00007f351509b336 in io_loop_call_io (io=0xf081d0) at ioloop.c:388 ioloop = 0xef7720 t_id = 2 #24 0x00007f351509c3a7 in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:220 ctx = 0xef83d0 events = <value optimized out> event = 0xef9230 list = 0xef9e00 io = <value optimized out> tv = {tv_sec = 1799, tv_usec = 999407} msecs = <value optimized out> ret = 1 i = <value optimized out> call = <value optimized out> __FUNCTION__ = "io_loop_handler_run" #25 0x00007f351509b2a8 in io_loop_run (ioloop=0xef7720) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #26 0x00007f3515049f73 in master_service_run (service=0xef75b0, callback=<value optimized out>) at master-service.c:566 No locals. #27 0x000000000041fd07 in main (argc=1, argv=0xef7390) at main.c:400 set_roots = {0x427c60, 0x0} login_set = {auth_socket_path = 0xeef060 "\210\360", <incomplete sequence \356>, postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x41ff00 <login_client_connected>, failure_callback = 0x41fea0 <login_client_failed>, request_auth_token = 1} service_flags = <value optimized out> storage_service_flags = <value optimized out> username = <value optimized out> c = <value optimized out> Thanks Francesco

3 4

Re: [Dovecot] Crash in pop3 with recent dovecot, backtrace
by Leo 17 Feb '14

17 Feb '14

Hi, I have the same crashes in pop3 with the recent dovecot release 2.2.11 on Fedora 16 x86_64. The log file shows: dovecot: pop3(username(a)example.com): Fatal: master: service(pop3): child 26735 killed with signal 11 (core dumped) New mails will be successfully fetched by the client but all the dovecot files in the users maildir (dovecot.index.log, dovecot.index.cache, ...) are not being updated anymore. Here is my backtrace: -----> start backtrace <----- Reading symbols from /usr/local/libexec/dovecot/pop3...done. [New LWP 26735] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/pop3'. Program terminated with signal 11, Segmentation fault. #0 client_update_mails (client=0x2388560) at pop3-commands.c:256 256 seq_range_array_add(&deleted_msgs, client->msgnum_to_seq_map[msgnum]); (gdb) bt full #0 client_update_mails (client=0x2388560) at pop3-commands.c:256 search_args = <optimized out> ctx = <optimized out> mail = 0x7fb36483ac5d deleted_msgs = {arr = {buffer = 0x236c088, element_size = 8}, v = 0x236c088, v_modifiable = 0x236c088} seen_msgs = {arr = {buffer = 0x237765a, element_size = 140408462221679}, v = 0x237765a, v_modifiable = 0x237765a} msgnum = <optimized out> bit = 1 #1 0x0000000000407800 in cmd_quit (args=<optimized out>, client=0x2388560) at pop3-commands.c:289 No locals. #2 client_command_execute (client=0x2388560, name=<optimized out>, args=0x408200 "") at pop3-commands.c:920 No locals. #3 0x0000000000405fb8 in client_handle_input (client=0x2388560) at pop3-client.c:739 _data_stack_cur_id = 3 line = 0x237765a "QUIT" args = <optimized out> ret = <optimized out> #4 0x00007fb364828e06 in io_loop_call_io (io=0x2388d10) at ioloop.c:388 ioloop = 0x2374730 t_id = 2 #5 0x00007fb364829c9f in io_loop_handler_run (ioloop=<optimized out>) at ioloop-epoll.c:220 ctx = 0x2374a90 events = 0x0 event = 0x23758f0 list = 0x23764c0 io = <optimized out> tv = {tv_sec = 9, tv_usec = 999836} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #6 0x00007fb364828918 in io_loop_run (ioloop=0x2374730) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #7 0x00007fb3647d7533 in master_service_run (service=0x23745c0, callback=<optimized out>) at master-service.c:566 No locals. #8 0x00000000004041f7 in main (argc=1, argv=0x2374390) at main.c:277 set_roots = {0x408e60, 0x0} login_set = {auth_socket_path = 0x236c048 "/run/dovecot/auth-master", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x4045e0 <login_client_connected>, failure_callback = 0x404590 <login_client_failed>, request_auth_token = 0} service_flags = <optimized out> storage_service_flags = <optimized out> username = <optimized out> c = <optimized out> (gdb) -----> end backtrace <----- Kind regards, Leo

3 3

[Dovecot] FTS question
by Peter Chiochetti 14 Feb '14

14 Feb '14

Please advise: Can I override the user parameter in solr indexing and searching? To understand, why I wish for that, please consider my setup: # Mail is fetched from a remote imap server # dovecot LDA stores into Maildir as system user # Several virtual users exist in a static userdb # They all share the system users Maildir # everybody can see, move, delete etc. all the mails # dovecot mail_log plugin is used for audit So it is like all/only shared folders, isn't it? A cheap groupware, maybe… This works exceptionally well (2.0 and 2.2.11 as of now). The problem: When e-mails are indexed by solr, the uid of the virtual user is passed on, and only this user will later find that mail in a server side body search. I tried and made "user" an ignored field in solr schema, but then nothing will ever be found, because it is dropped when indexing, but will be asked for in searching. So far, what I learned in a day. Maybe someone can help? Thank You in advance -- peter

2 4

[Dovecot] Isolated crash in dovecot/imap (with backtrace)
by Ralf Hildebrandt 14 Feb '14

14 Feb '14

Log: Feb 14 20:31:56 postamt dovecot: imap(lumo) m0Yg1mLyKABXuzxs: Panic: file imap-fetch.c: line 554 (imap_fetch_more): assertion failed: (ctx->client->output_cmd_lock == NULL || ctx->client->output_cmd_lock == cmd) Feb 14 20:31:56 postamt dovecot: imap(lumo) m0Yg1mLyKABXuzxs: Error: Raw backtrace: /usr/local/dovecot-2.2/lib/dovecot/libdovecot.so.0(+0x68fee) [0xb75ccfee] -> /usr/local/dovecot-2.2/lib/dovecot/libdovecot.so.0(+0x69071) [0xb75cd071] -> /usr/local/dovecot-2.2/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb75cda9c] -> dovecot/imap [lumo 87.187.60.108 UID FETCH UID FETCH UID FETCH UID FETCH]() [0x8060ad4] -> dovecot/imap [lumo 87.187.60.108 UID FETCH UID FETCH UID FETCH UID FETCH](cmd_fetch+0x318) [0x8054078] -> dovecot/imap [lumo 87.187.60.108 UID FETCH UID FETCH UID FETCH UID FETCH](command_exec+0x32) [0x805e2e2] -> dovecot/imap [lumo 87.187.60.108 UID FETCH UID FETCH UID FETCH UID FETCH]() [0x805d2c7] -> dovecot/imap [lumo 87.187.60.108 UID FETCH UID FETCH UID FETCH UID FETCH]() [0x805d409] -> dovecot/imap [lumo 87.187.60.108 UID FETCH UID FETCH UID FETCH UID FETCH](client_handle_input+0x115) [0x805d645] -> dovecot/imap [lumo 87.187.60.108 UID FETCH UID FETCH UID FETCH UID FETCH](client_input+0x72) [0x805d9f2] -> Feb 14 20:31:56 postamt dovecot: imap(lumo) m0Yg1mLyKABXuzxs: Fatal: master: service(imap): child 23971 killed with signal 6 (core dumped) Backtrace: Reading symbols from /usr/local/dovecot-2.2/libexec/dovecot/imap...done. [New LWP 23971] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/i386-linux-gnu/i686/cmov/libthread_db.so.1". Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. #0 0xb775e424 in __kernel_vsyscall () #0 0xb775e424 in __kernel_vsyscall () No symbol table info available. #1 0xb741b941 in *__GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 resultvar = <optimized out> pid = -1219162124 selftid = 23971 #2 0xb741ed72 in *__GI_abort () at abort.c:92 act = {__sigaction_handler = {sa_handler = 0xbfe67364, sa_sigaction = 0xbfe67364}, sa_mask = {__val = {3077998178, 3219551060, 3075884392, 3219551048, 3078081124, 0, 3075825056, 1, 0, 1, 3077954592, 142179296, 1594, 3076296067, 3, 142209064, 1, 128, 0, 3219551120, 3219551048, 3219551060, 3219551068, 3077954592, 0, 3076305535, 142179264, 3075920260, 3076310429, 3076751908, 1594, 3076751908}}, sa_flags = 0, sa_restorer = 0xb75cca17 <internal_handler+519>} sigs = {__val = {32, 0 <repeats 31 times>}} #3 0xb75ccfde in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:193 backtrace = 0x87973b0 "/usr/local/dovecot-2.2/lib/dovecot/libdovecot.so.0(+0x68fee) [0xb75ccfee] -> /usr/local/dovecot-2.2/lib/dovecot/libdovecot.so.0(+0x69071) [0xb75cd071] -> /usr/local/dovecot-2.2/lib/dovecot/libdovecot."... #4 0xb75cd071 in i_internal_fatal_handler (ctx=0xbfe67434, format=0x806f714 "file %s: line %d (%s): assertion failed: (%s)", args=0xbfe67454 "\207\320\006\b*\002") at failures.c:657 status = 0 #5 0xb75cda9c in i_panic ( format=format@entry=0x806f714 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = 0xbfe67454 "\207\320\006\b*\002" #6 0x08060ad4 in imap_fetch_more (ctx=0x87fdd20, cmd=cmd@entry=0x87fdc28) at imap-fetch.c:553 ret = <optimized out> __FUNCTION__ = "imap_fetch_more" #7 0x08054078 in cmd_fetch (cmd=0x87fdc28) at cmd-fetch.c:284 client = <optimized out> ctx = 0x87fdd20 args = 0x87ba650 next_arg = <optimized out> list_arg = 0xb7638224 search_args = 0x0 qresync_args = {qresync_sample_seqset = 0x0, qresync_sample_uidset = 0xb7638224} messageset = 0x87ba710 "38703" send_vanished = <optimized out> ret = <optimized out> #8 0x0805e2e2 in command_exec (cmd=cmd@entry=0x87fdc28) at imap-commands.c:158 hook = 0x879f9a8 ret = <optimized out> #9 0x0805d2c7 in client_command_input (cmd=0x87fdc28) at imap-client.c:780 client = 0x87b7408 command = <optimized out> __FUNCTION__ = "client_command_input" #10 0x0805d409 in client_command_input (cmd=0x87fdc28) at imap-client.c:841 client = 0x87b7408 command = <optimized out> __FUNCTION__ = "client_command_input" #11 0x0805d645 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x87b7408) at imap-client.c:879 No locals. #12 client_handle_input (client=client@entry=0x87b7408) at imap-client.c:891 _data_stack_cur_id = 3 ret = 2 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #13 0x0805d9f2 in client_input (client=0x87b7408) at imap-client.c:933 cmd = <optimized out> output = 0x87b7d40 bytes = 198 __FUNCTION__ = "client_input" #14 0xb75dfd44 in io_loop_call_io (io=0x87db478) at ioloop.c:388 ioloop = 0x879f498 t_id = 2 #15 0xb75e0e0e in io_loop_handler_run (ioloop=ioloop@entry=0x879f498) at ioloop-epoll.c:220 ctx = 0x87a0618 events = 0x0 event = 0x87a0658 list = 0x87a0f40 io = <optimized out> tv = {tv_sec = 299, tv_usec = 976127} events_count = 0 msecs = <optimized out> ret = 1 i = <optimized out> j = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #16 0xb75df7d8 in io_loop_run (ioloop=0x879f498) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #17 0xb7584d7e in master_service_run (service=0x879f3c0, callback=callback@entry=0x80674f0 <client_connected>) at master-service.c:566 No locals. #18 0x08067a00 in main (argc=1, argv=0x879f1e0) at main.c:400 set_roots = {0x8070080, 0x0} login_set = {auth_socket_path = 0x8797048 "\003", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x8067310 <login_client_connected>, failure_callback = 0x8067490 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = <optimized out> c = <optimized out> -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

1 0

Re: [Dovecot] LDAP Integration
by Roman Gelfand 14 Feb '14

14 Feb '14

Would there be any adverse side effects if I change, just this config item, now as I have 20 users created and receiving already? On Fri, Feb 14, 2014 at 11:32 AM, Steffen Kaiser <skdovecot(a)smail.inf.fh-brs.de> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Fri, 14 Feb 2014, Roman Gelfand wrote: > >> user_attrs = >> >> =uid=999,=gid=8,=home=/vmail/%Ld/%Ln/Maildir/,=mail=maildir:/vmail/%Ld/%Ln/Maildir/ > > > Never use the Maildir directory as home, use =home=/vmail/%Ld/%Ln/ or > =home=/vmail/%Ld/%Ln/home/ > > or something like that > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBUv5FEHD1/YhP6VMHAQJNLQf/SrxflCu+82HjyqSo17CiKNxdahFSIq1V > BZ0AUqs3x9FZEAU/9hRj/090q82jxNkdPRiAUmj0i4UZR7wznBmeNEjxDbYeKGrs > UtOd8AhmlBAWoaTnpcIJd7Bnn5v/mJd+JN8AldidUnOJK4nqMxT22whOcYC6mFQY > IfLUp16hrg3LjqOmq/Yo7rtLZYkQkBLEbRkiNHjMWO99C/5kXQyvb599e6Fxl8nQ > htOIa5Jj9uS+CX2fk4ojrm84K6y14cifdfyxM6AtTqBUSHSyb5tLLeKLkw48ED9f > ksebXbT6sO7qBM78sHsKbGFHVeK7gUQf0T+e4apz9TmwbH1mMJvniw== > =Q3KB > -----END PGP SIGNATURE-----

2 1

[Dovecot] LDAP Integration
by Roman Gelfand 14 Feb '14

14 Feb '14

My ldap config. Would this store incoming email in maildir format? If so, can it be overriden? If so, where (possible place)? hosts = 192.168.0.12:389 ldap_version = 3 auth_bind = yes dn = llookup(a)domain.local dnpass = password base = OU=People,DC=domain,DC=local scope = subtree deref = never user_filter = (&(Mail=%u)(objectClass=person)(!(userAccountControl=514))) pass_filter = (&(Mail=%u)(objectClass=person)(!(userAccountControl=514))) pass_attrs = userPassword=password default_pass_scheme = CRYPT user_attrs = =uid=999,=gid=8,=home=/vmail/%Ld/%Ln/Maildir/,=mail=maildir:/vmail/%Ld/%Ln/Maildir/

2 2

Re: [Dovecot] Maildir format
by Roman Gelfand 14 Feb '14

14 Feb '14

I am not sure where I went wrong here. The wiki says... By default Dovecot uses Maildir++ directory layout for organizing mailbox directories. This means that all the folders are directly inside ~/Maildir directory: ~/Maildir/new, ~/Maildir/cur and ~/Maildir/tmp directories contain the messages for INBOX. The tmp directory is used during delivery, new messages arrive in new and read shall be moved to cur by the clients. ~/Maildir/.folder/ is a mailbox folder ~/Maildir/.folder.subfolder/ is a subfolder of a folder (ie. "folder/subfolder") You can also optionally use the "fs" layout by appending :LAYOUT=fs to mail_location. This makes the folder structure look like: ~/Maildir/new, ~/Maildir/cur and ~/Maildir/tmp directories contain the messages for INBOX, just like with Maildir++. ~/Maildir/folder/ is a mailbox folder ~/Maildir/folder/subfolder/ is a subfolder of a folder Here is my folders. Though there are emails in the inbox, I am not seeing anything in new/ or cur/ folders. root@mbx:/etc/dovecot# ls -la /vmail/domain.tld/j.doe/Maildir/ drwx------ 5 999 mail 4096 Feb 14 10:06 . drwx------ 3 999 mail 4096 Feb 12 19:53 .. drwx------ 2 999 mail 4096 Feb 14 10:02 cur -rw------- 1 999 mail 17408 Feb 14 10:02 dovecot.index.cache -rw------- 1 999 mail 2896 Feb 14 10:06 dovecot.index.log -rw------- 1 999 mail 51 Feb 14 10:06 dovecot-uidlist -rw------- 1 999 mail 8 Feb 12 19:53 dovecot-uidvalidity -r--r--r-- 1 999 mail 0 Feb 12 19:53 dovecot-uidvalidity.52fc176c drwx------ 2 999 mail 4096 Feb 14 10:02 new drwx------ 2 999 mail 4096 Feb 14 09:59 tmp root@mbx:/etc/dovecot# ls -la /vmail/domain.tld/j.joe/Maildir/new total 8 drwx------ 2 999 mail 4096 Feb 14 10:02 . drwx------ 5 999 mail 4096 Feb 14 10:06 .. root@mbx:/etc/dovecot# ls -la /vmail/domain.tld/j.joe/Maildir/cur total 8 drwx------ 2 999 mail 4096 Feb 14 10:02 . drwx------ 5 999 mail 4096 Feb 14 10:06 .. On Fri, Feb 14, 2014 at 9:41 AM, Steffen Kaiser <skdovecot(a)smail.inf.fh-brs.de> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Fri, 14 Feb 2014, Roman Gelfand wrote: > >> I see where the mail box meta data is kept. But don't the actual >> emails. I was under the impression the impression the email was kept, >> on the server, as .eml. > > > http://wiki2.dovecot.org/MailboxFormat/Maildir > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBUv4rNnD1/YhP6VMHAQJzRAgA0yz7cZ0tFAgzluubKN7jK0ha3bOXcd5A > ue2aOVWfVz52eHUjgBDY5E4/s37WWe022WKNS1LAEcwbTC/xo7VdGYA472oQdxMm > QWfOvEPdxF8nSY4GIeAe5YiYyszXhQE4i6bC/ouBh0v0OKu6T6VIdd9YYowMW43r > fmpg23xHV/MY7Tk36ac41fZhDYvg0u0uMr7mJyKkf17kuRIBZ0G34AVBodbWml0/ > MN9oLSfIsriOq5zqZw5gkSg1GMsCHneNreKnRcnW5iVGXyYWWu9FoEUwTxUcrf9I > vJI7JA+ut38YN8iO7pFzOvoJ0z4UPeIckp9/7zs8lkjjh5orhQAVcA== > =9fx8 > -----END PGP SIGNATURE-----

2 1

[Dovecot] Mailbox Viewer
by Roman Gelfand 14 Feb '14

14 Feb '14

Is web or windows client which allows for viewing contents of all mailboxes without having to login with their id? Thanks in advance

2 1

[Dovecot] Maildir format
by Roman Gelfand 14 Feb '14

14 Feb '14

I see where the mail box meta data is kept. But don't the actual emails. I was under the impression the impression the email was kept, on the server, as .eml. Thanks in advance

2 1

[Dovecot] Dsync Panic
by Gilles Chauvin 14 Feb '14

14 Feb '14

Hi, Using dsync to backup my users' mailboxes (dovecot 2.2.10 on both sides), I sometimes encounter the following issue. Below is the output of: dsync -Dvf -u "user" -R backup ssh root(a)server.domain.tld dsync -u "user" doveadm(root): Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_lookup (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(user): Debug: Effective uid=495, gid=495, home=/srv/mail/u/user doveadm(user): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:/srv/mail/u/user doveadm(user): Debug: fs: root=/srv/mail/u/user, index=, indexpvt=, control=, inbox=, alt= doveadm(user): Debug: Namespace : Using permissions from /srv/mail/u/user: mode=0700 gid=default dsync-local(user): Debug: brain M: in state=master_recv_handshake dsync-local(user): Debug: brain M: out state=send_mailbox_tree changed=1 dsync-local(user): Debug: brain M: in state=send_mailbox_tree dsync-local(user): Debug: brain M: out state=send_mailbox_tree_deletes changed=1 dsync-local(user): Debug: brain M: in state=send_mailbox_tree_deletes dsync-local(user): Debug: brain M: out state=recv_mailbox_tree changed=1 dsync-local(user): Debug: brain M: in state=recv_mailbox_tree dsync-local(user): Debug: brain M: out state=recv_mailbox_tree changed=0 dsync-local(user): Debug: brain M: in state=recv_mailbox_tree dsync-local(user): Debug: brain M: out state=recv_mailbox_tree_deletes changed=1 dsync-local(user): Debug: brain M: in state=recv_mailbox_tree_deletes dsync-local(user): Debug: brain M: out state=recv_mailbox_tree_deletes changed=0 dsync-remote(user): Panic: file dsync-brain-mailbox-tree-sync.c: line 111 (dsync_brain_mailbox_tree_sync_change): assertion failed: (brain->no_backup_overwrite) dsync-remote(user): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f1e89ee889a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f1e89ee89a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f1e89ea21cf] -> dsyn(dsync_brain_mailbox_tree_sync_change+0x3c6) [0x42e046] -> dsyn(dsync_brain_recv_mailbox_tree_deletes+0x12a) [0x42d30a] -> dsyn(dsync_brain_run+0x2e6) [0x42ac96] -> dsyn() [0x42b5f0] -> dsyn() [0x43d740] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f1e89ef8336] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f1e89ef93a7] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f1e89ef82a8] -> dsyn() [0x427fd1] -> dsyn() [0x411c97] -> dsyn(doveadm_mail_try_run+0x238) [0x4120a8] -> dsyn(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f1e89b0ad1d] -> dsyn() [0x411419] dsync-local(user): Debug: brain M: in state=recv_mailbox_tree_deletes dsync-local(user): Error: read(server.domain.tld) failed: EOF dsync-local(user): Debug: brain M: out state=recv_mailbox_tree_deletes changed=0 dsync-local(user): Error: Remote command returned error 255 Regards, Gilles

1 1

[Dovecot] Problem to setup replication
by Daniel Thielemann 14 Feb '14

14 Feb '14

Hi, i tried to setup replication since some days but I'am stuck now. My conf: # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.3.1.el6.x86_64 x86_64 CentOS release 6.5 (Final) dsync_remote_cmd = ssh -l%{login} %{host} /usr/bin/doveadm dsync-server -u%u -l%{lock_timeout} -n%{namespace} log_path = /var/log/dovecot mail_gid = 5000 mail_home = /var/vmail/%d/%n mail_location = maildir:~/Maildir mail_plugins = " notify replication" mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { mail_replica = remote:vmail@server1.domain.dom replication_full_sync_interval = 1 hours sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap sieve service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 user = postfix } unix_listener auth-master { mode = 0600 user = vmail } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service managesieve-login { inet_listener sieve_deprecated { port = 2000 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = vmail } } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lda { auth_socket_path = /var/run/dovecot/auth-master log_path = /var/log/protocol-lda.log mail_plugins = sieve postmaster_address = postmaster(a)domain.dom } ----------------- sql-conf: driver = mysql connect = host=127.0.0.1 dbname=xxx user=mailuser password=xxx default_pass_scheme = SSHA512 password_query = SELECT email as user, password FROM virtual_users WHERE email='%u'; user_query = SELECT email as user FROM virtual_users WHERE email ='%u'; iterate_query = SELECT email as user FROM virtual_users WHERE email='%u'; ------------------ The config on the other node is similar, except the mail_replica settings. The weird thing is, that my logs are completly empty. I see only the dovecot startup messages and nothing else. I don't understand why the replication never starts by itself or why there are no errors or anything else in the log. I already read the dovecot replication howto in the official documentation, but IMO I've setup everything already like in the docs. ----------------- I've already tried to replicate my mailboxes using dsync, but if I run the dsync command I get only this output: bash-4.1$ ssh vmail(a)server1.domain.dom /usr/bin/doveadm dsync-server -u john(a)domain.dom VERSION dsync 3 2 Hhostname sync_ns_prefix sync_box sync_box_guid sync_type debug sync_visible_namespaces exclude_mailboxes send_mail_requests backup_send backup_recv lock_timeout no_mail_sync no_backup_overwrite purge_remote Smailbox_guid last_uidvalidity last_common_uid last_common_modseq last_common_pvt_modseq changes_during_sync Nname existence mailbox_guid uid_validity uid_next last_renamed_or_created subscribed last_subscription_change Dhierarchy_sep mailboxes dirs unsubscribes Bmailbox_guid uid_validity uid_next messages_count first_recent_uid highest_modseq highest_pvt_modseq mailbox_lost cache_fields have_guids have_save_guids have_only_guid128 Atype key value stream deleted last_change modseq Ctype uid guid hdr_hash modseq pvt_modseq save_timestamp add_flags remove_flags final_flags keywords_reset keyword_changes Rguid uid Mguid uid pop3_uidl pop3_order received_date stream cname decision last_used . Hserver1.domain.dom dsync-remote(john(a)domain.dom): Error: dsync(local): I/O has stalled, no activity for 600 seconds dsync-remote(john(a)domain.dom): Error: Timeout during state=slave_recv_handshake Any help would be appreciated, because I've really no other ideas anymore. Thanks in advance PS: Excuse my english, I'am german :D

1 1

[Dovecot] Hybrid of linux user accounts and virtual user accounts configuration
by Derek Winterstien 14 Feb '14

14 Feb '14

So some system users have their email forward to Maildir in their /home/user directory (virtual_alias_maps) for their domain . This I have working! And the rest are non-system users, ie virtual users listed in a plain text file and their MailDir will be in /home/vmial/domain.com/user/ The virtual user part is working 100% with postfix and dovecot accepting mail for each virtual alias and system account holders popping in to retrieve their mail. The second part is working 50%. I have email for virtual users going into /home/vmail/domain.com where they are supposed to go. Now, I am very confused on how to configure dovecot to allow folks without system accounts to login and retrieve their email. I have been going through one guide after another. When I start changing things I break the first working part, the system accounts being able to get their mail. Changes to dovecot.conf to get the second working negatively impact the first. Also, a lot of documentation is out of date, which further complicates matters. Postfix/Dovecot: Postfix version: 2.6.6 Dovecot version: 2.0.9

3 5

[Dovecot] Feature request about Info: Internal login failure (pid=2296 id=17278) (internal failure, 1 successful auths)
by Steffen Kaiser 14 Feb '14

14 Feb '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, since some time I'm plagued by internal login failures. With v2.2.10 I got the some additional error, that I should raise the process_limit for the imap service, then I got the hint to raise vsz_limit for the lmtp and imap serverices. These hints are very helpful and are some sort of unique feature of Dovecot - descriptive error messages. Now I have upgraded a Webfrontend behind imapproxy -> Dovecot and get this during a phase in the day, several of messages go to large internal mailing lists and lots of users are connecting/disconnecting via IMAP, POP,& Web: <login success> imap: Error: Disconnected from auth server, aborting (client-pid=2296 client-id=17278) imap-login: Info: Internal login failure (pid=2296 id=17278) (internal failure, 1 successful auths) .... . doveadm and to query the userdb [I have some processes that use Dovecot UserDB to query user data, which do not cache its information], & login into IMAP fail as well. Even connecting to the auth-userdb socket reveals no reaction - usually the VERSION prompts immediately. I now suppose that the deault auth_worker_max_count=30 is the culprit, because I query LDAP for passdb and userdb and client_count, but client_limit=0. Would it be possible to add a warning to all limits "that max out"? Or, if such "generic error" occurs, could Dovecot be enabled to dump a list of which limit is used up to which level? Or something like that. Also, I'm surprised to find that the "Internal login failure" is at "Info" level only. Also note: It is very possible that the problem is caused by a client that goes havoc. ====== Just to no trigger the "post your config" reply I give now and then myself: # 2.2.10 (5432b55a2b87): /usr/local/dovecot-2.2.10/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.8 auth_cache_size = 10 M auth_debug = yes auth_mechanisms = plain login auth_verbose = yes base_dir = /var/run/dovecot2.2/ default_vsz_limit = 512 M deliver_log_format = msgid=%m: %$ %p/%w "%f" "%s" dict { acl = pgsql:/usr/local/dovecot-2.2.10/etc/dovecot/dovecot-dict-sql.conf.ext quota = pgsql:/usr/local/dovecot-2.2.10/etc/dovecot/dovecot-dict-sql.conf.ext } instance_name = dovecot2.2 lda_mailbox_autocreate = yes lmtp_save_to_detail_mailbox = yes log_path = /var/log/dovecot/dovecot2.2.log log_timestamp = "%F %H:%M:%S " mail_debug = yes mail_gid = vmail mail_log_prefix = "%Us(%u) [%p]: " mail_max_userip_connections = 0 mail_plugins = " quota notify mail_log zlib acl" mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = users.%%u. separator = . type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = proxy::acl antispam_allow_append_to_spam = yes antispam_backend = spool2dir antispam_spam = SPAM+ReportAsSPAM antispam_spool2dir_notspam = /tmp/spamspool/%%020lu-%%05lu-%u-H antispam_spool2dir_spam = /tmp/spamspool/%%020lu-%%05lu-%u-S antispam_trash = trash;TRASH;Trash;spam;SPAM;Spam;junk;JUNK;Junk;Deleted Items;Deleted Messages;Gel&APY-schte Elemente;Gel&APY-schte Objekte;Junk E-mail;Junk-E-Mail;INBOX.Trash;INBOX.TRASH;INBOX.trash mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size vsize from subject quota = dict:User quota::proxy::quota quota_rule = *:storage=300MB quota_rule2 = Trash:storage=+30M recipient_delimiter = + sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_actions = 0 sieve_quota_max_storage = 3M } protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth { unix_listener auth-client { mode = 0766 } unix_listener auth-userdb { mode = 0766 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service doveadm { unix_listener doveadm-server { mode = 0666 } } service imap-login { process_min_avail = 4 service_count = 0 vsz_limit = 768 M } service imap { process_limit = 10000 vsz_limit = 768 M } service lmtp { vsz_limit = 768 M } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { process_min_avail = 5 service_count = 0 vsz_limit = 512 M } ssl_ca = </etc/ssl/certs/ca.crt ssl_cert = </etc/ssl/certs/imap.pem ssl_key = </etc/ssl/private/imap.key userdb { driver = prefetch } userdb { args = /usr/local/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf.ext default_fields = home=/home/%u uid=vmail gid=vmail driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = " quota notify mail_log zlib acl quota sieve" } protocol lda { mail_plugins = " quota notify mail_log zlib acl quota sieve" } protocol imap { mail_plugins = " quota notify mail_log zlib acl imap_quota imap_zlib imap_acl antispam" } - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUvjzZnD1/YhP6VMHAQKElQgAoBU3v5JD9kFNzan06UFG88sucvf6HZru gLF6l7IZSWiY/IwouTBoseJcrXmgVG9sCk12gxvonO3iT0KVu1PyJZeTMaKtY3hS I37J4iS88pmY3cGQNguYMSidrIvNOt6SW+Jv/9QxuYTJKYCqoEZRdP8yJ+dvrmQw zpZEzKqcV+x4ofDLcpRxLZtXwb+Bl5AA9hoe/Md/UqzUEa9CYyvANoX63/zY7WS5 1VpK+a80/L6ukJUt9tPQTWSe0ALYmL6Cd4tAdC2Bsq7rN+6SQIcjxxr/9v8Byj8Q BdtwUhpTazVm7CLOjnFiWxfXmHCL9BNrQUBBAd5docSydNDEUMmQng== =r9QR -----END PGP SIGNATURE-----

2 3

[Dovecot] No Access to public folder
by vupibi 14 Feb '14

14 Feb '14

Hello, I have some Issues with Dovecots public folder. I only see the folder in users Mailbox but I cannot subscribe it or copy mails in it. My public file structure (folder: "/var/vmail/public/") looks like this: -rw-rw-rw- 1 ebox ebox 0 Feb 12 01:21 dovecot-acl-list drwxrwsrwx 2 ebox ebox 4096 Feb 12 00:31 test (Wierd thing is that "dovecot-acl-list" is empty, why?) content of "test" public folder is: -rw-r--r-- 1 root ebox 10 Feb 12 01:21 dovecot-acl I can see the folder in my mail accounts but I dont have access to it. I activated ACL and the log sais the plugin is loaded successfully Feb 12 12:54:19 mailand dovecot: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib02_imap_acl_plugin.so Feb 12 12:54:19 mailand dovecot: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so And the dovecot-acl file is loaded too Feb 12 12:54:19 mailand dovecot: imap(test(a)sxps.eu): Debug: acl vfile: reading file /var/vmail/public/test/dovecot-acl content of "/var/vmail/public/test/dovecot-acl" file is: anyone lr So i think everything is set up the right way but i'm still not able to access the public mal folder. Any suggestions? My Dovecot -n output # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-58-generic x86_64 Ubuntu 12.04.4 LTS auth_gssapi_hostname = mailand.sxps.int auth_krb5_keytab = /etc/dovecot/dovecot.keytab auth_mechanisms = gssapi plain first_valid_gid = 116 first_valid_uid = 108 log_timestamp = "%Y-%m-%d %H:%M:%S " mail_debug = yes mail_gid = 116 mail_home = /var/vmail/sieve/%d/%u mail_location = maildir:~/Maildir:LAYOUT=fs mail_uid = 108 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = no inbox = no list = yes location = maildir:/var/vmail/public:LAYOUT=fs prefix = public/ separator = / subscriptions = no type = public } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl = vfile autocreate = Trash autocreate2 = Spam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Spam autosubscribe3 = Sent autosubscribe4 = Drafts listescape_char = \ quota = maildir:User quota quota_rule = *:storage=0 sieve = /var/vmail/sieve/%d/%u/sieve-script sieve_dir = /var/vmail/sieve/%d/%u sieve_global_path = /var/vmail/sieve/default.sieve sieve_storage = /var/vmail/sieve/%d/%u } protocols = imap sieve service auth { executable = /usr/lib/dovecot/auth unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = ebox mode = 0600 user = ebox } user = dovecot } service imap-login { inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/dovecot/ssl/dovecot.pem ssl_key = </etc/dovecot/ssl/dovecot.pem userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } protocol imap { mail_plugins = listescape acl imap_acl } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = sieve quota postmaster_address = admin(a)XX.eu } -- View this message in context: http://dovecot.2317879.n4.nabble.com/No-Access-to-public-folder-tp46696.html Sent from the Dovecot mailing list archive at Nabble.com.

2 1

[Dovecot] Status
by Timo Sirainen 14 Feb '14

14 Feb '14

So, just some quick notes: - dovecot.org server was down a couple of days again, need to find time to move it to a VM.. - my tss(a)iki.fi emails were also broken for some hours at least and it was bouncing back all mails to it during the time - I fixed some bugs reported by people, but I did it in airplane so couldn't reply back with links to the fixes in hg repo. I'll probably do that tomorrow. But you can already check if your reported bug has been fixed in http://hg.dovecot.org/dovecot-2.2 - I'm planning on going through Dovecot list's mails this week and make v2.2.11 release - although it looks like I've a flu, so lets see how far I can get.. - hopefully by the beginning of March I'll have more time again

5 7