- dovecot - dovecot.org

[Dovecot] failed: Message has been copied too many times
by Angel L. Mateo 19 Feb '14

19 Feb '14

Hello, I'm running dovecot 2.1.16 in a ubuntu 12.04 server, with lazy_expunge, SiS and mdbox format. The problem I'm having is that the index for one the mailboxes of one of my users is growing too much. This is not the first time of this problem. In previous cases, is because a message is duplicated thousand of times (I haven't found any reason for this). In these cases, moving messages to other folder and moving again to this same folder fixes the problem. So I have tried this, and I have moved all messages from this folder to another one. But this time, after this, indexes directory is still using a lot of space. And the folder seems to have more serious problems: amateo_adm@myotis51:~$ sudo doveadm search -u vlo mailbox BORRADOS.INBOX.MNCS doveadm(vlo): Error: Syncing mailbox BORRADOS.INBOX.MNCS failed: Message has been copied too many times (59306 + -1) I have tried to delete the folder, with the same result: amateo_adm@myotis51:~$ sudo doveadm mailbox delete -u vlo BORRADOS.INBOX.MNCS doveadm(vlo): Error: Can't delete mailbox BORRADOS.INBOX.MNCS: Message has been copied too many times (59306 + -1) And to purge user's mailbox, but it didn't fix the problem. PS: If this could help, BORRADOS. is the namespace used by lazy_expunge plugin. -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337

4 9

Re: [Dovecot] Virtual folder for selected users only? (1.2.15)
by Sebastian Schäfer 19 Feb '14

19 Feb '14

> thats very outdated, you should upgrade 2.1.x / 2.2.x latest I would like to avoid this, because the 1.2.15 is running extremely stable for a long time. (also it's the most recent version on this old squeeze-machine if not using backports) As far as I see, the virtual folders are fully supported since 1.2.x - am I wrong? What are the advantages of upgrading to 2.x? Are there security issues? Thanks! best, sebastian

2 1

[Dovecot] Dovecot, mysql, and quota
by David Mehler 19 Feb '14

19 Feb '14

Hello, I'm running dovecot 2.2 and wanting to get quotas going. I've got the plugins loaded appropriately and am wanting to configure a dictionary backend to talk to my mysql database. I've got a single database called mail which has all the mail-related items in it. One table is for virtual users which postfix uses. It looks like this: CREATE TABLE `virtual_users` ( `id` int(11) NOT NULL auto_increment, `domain_id` int(11) NOT NULL, `password` varchar(128) NOT NULL, `email` varchar(100) NOT NULL, PRIMARY KEY (`id`), UNIQUE KEY `email` (`email`), FOREIGN KEY (domain_id) REFERENCES virtual_domains(id) ON DELETE CASCADE ) ENGINE=InnoDB DEFAULT CHARSET=utf8; and a user looks like: INSERT INTO `mail`.`virtual_users` ( `id` , `domain_id` , `password` , `email` ) VALUES ( '1', '1', SHA2( 'PasswordGoesHere', 512) , 'username(a)domain.com' ); plugin { # SQL backend: quota = dict:User quota::proxy::sqlquota } dict { sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } Now when creating the quota table i'd like to have the username field linked to my virtual_users table username field, so I don't have to set up two tables both with the same username information in it. Can someone check me on this design so that if I delete a virtual user out of the virtual_users table the coresponding row in the quota table is also eliminated? My second question has to do with global and per user quotas. If I have something like this: CREATE TABLE quota ( username varchar(100) not null, bytes bigint not null default 262144, messages integer not null default 0, primary key (username) ); 256MB for all users by default, but then if I give a user a 100MB value in the bytes field of their quota entry would that be a per-user quota? Thanks. Dave.

2 1

[Dovecot] Index corruption with 2.2.12 when moving a message
by Bojan Smojver 19 Feb '14

19 Feb '14

Just bumped into this today, when I upgraded to a testing package in Fedora: https://admin.fedoraproject.org/updates/FEDORA-2014-2672/dovecot-2.2.12-1.f… For details, see this bug: https://bugzilla.redhat.com/show_bug.cgi?id=1066709 Haven't seen this kind of thing before. Sure, it worked the second time I tried to move the message to another folder (I'm guessing index got rebuilt or something), but still, looks suspicious. Anyway, I'm using mbox format mailboxes, if it matters. Client was Gnome Evolution 3.10.4. -- Bojan

1 0

[Dovecot] Problems with dovecot 2.1.7, spamassassin 3.3.2 and antispam plugin
by Dean Carpenter 18 Feb '14

18 Feb '14

This might be a fairly long message, but I wanted to be sure to include as much information as possible. I'm having an issue with the dovecot-antispam plugin in that it seems to be unable to successfully run anything from the pipe backend. To qualify that, they run, but they fail ... Running /usr/bin/sa-learn directly always returns with an error code of 1, and the bayes DB isn't actually updated. Running the /usr/local/bin/sa-learn-pipe.sh script from the example will run sa-learn successfully, but sa-learn fails partway through, right on a sql DB access. I have both bayes and FuzzyOcr data stored in mysql, and the error occurs on accessing either one. That is, I've tested with FuzzyOcr enabled, and it fails on the db access to the FuzzyOcr DB, and I've tried it with FuzzyOcr disabled. In that case, it fails on the access to the bayes DB. The error line right there is : libgcc_s.so.1 must be installed for pthread_cancel to work Since sa-learn terminated prematurely, the bayes DB isn't updated at all. Running /usr/bin/sa-learn or the script /usr/local/bin/sa-learn-pipe.sh directly from cmdline works fine though - sa-learn completes correctly and updates the bayes DB properly, I can see the new tokens. $ sa-learn-pipe.sh --spam < /usr/share/doc/spamassassin/examples/sample-spam.txt $ sa-learn --spam /usr/share/doc/spamassassin/examples/sample-spam.txt I think it would be great to have a dedicated logfile for antispam, one that would capture both stdout as well as stderr. These tests are being done on a clean Ubuntu 13.04 system. I'm rebuilding the VM repeatedly as I configure the various pieces, and can test any changes or whatever you might suggest very easily. I've fully scripted the install and configuration of Exim4, Dovecot, Spamassassin, Clamav, Percona/Mysql, Roundcube, and can build a full VM under Virtualbox or any VPS in less than 10 minutes. Ubuntu 13.04 Dovecot 2.1.7 dovecot-antispam 2.0+20120225-3 Anyone else using the antispam plugin with spamassassin 3.3.2 ? Anything I can check to see what's causing this problem ? -------------------------------------------------------- $ cat /usr/local/bin/sa-learn-pipe.sh #!/bin/bash echo /usr/bin/sa-learn $* /tmp/sendmail-msg-$$.txt echo "$$-start ($*)" >> /var/log/sa-learn-pipe.log cat<&0 >> /tmp/sendmail-msg-$$.txt /usr/bin/sa-learn -D $* /tmp/sendmail-msg-$$.txt >> /tmp/sa-learn-pipe.$$.log 2>&1 echo $$ sa-learn rc=$? id=$(id) HOME=$HOME >> /var/log/sa-learn-pipe.log while read line; do echo $$-sa-learn "$line" >> /var/log/sa-learn-pipe.log done < /tmp/sa-learn-pipe.$$.log rm -f /tmp/sendmail-msg-$$.txt echo "$$-end" >> /var/log/sa-learn-pipe.log exit 0 -------------------------------------------------------- With FuzzyOcr DISabled, fails right after Bayes DB access $ cat /var/log/sa-learn-pipe.log 4505-start (--spam) 4505 sa-learn rc=134 id=uid=108(Debian-exim) gid=113(Debian-exim) groups=113(Debian-exim) HOME= 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: logger: adding facilities: all 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: logger: logging level is DBG 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: generic: SpamAssassin version 3.3.2 4505-sa-learn Nov 8 09:05:26.134 [4507] dbg: generic: Perl 5.014002, PREFIX=/usr, DEF_RULES_DIR=/usr/share/spamassassin, LOCAL_RULES_DIR=/etc/spamassassin, LOCAL_STATE_DIR=/var/lib/spamassassin : : 4505-sa-learn Nov 8 09:05:27.131 [4507] dbg: replacetags: done replacing tags 4505-sa-learn Nov 8 09:05:27.131 [4507] dbg: FreeMail: loaded freemail_domains entries: 2470 normal, 29 wildcard 4505-sa-learn Nov 8 09:05:27.132 [4507] dbg: plugin: Mail::SpamAssassin::Plugin::Bayes=HASH(0x3879e88) implements 'learner_new', priority 0 4505-sa-learn Nov 8 09:05:27.132 [4507] dbg: bayes: learner_new self=Mail::SpamAssassin::Plugin::Bayes=HASH(0x3879e88), bayes_store_module=Mail::SpamAssassin::BayesStore::MySQL 4505-sa-learn Nov 8 09:05:27.151 [4507] dbg: bayes: using username: debian-spamd 4505-sa-learn Nov 8 09:05:27.151 [4507] dbg: bayes: learner_new: got store=Mail::SpamAssassin::BayesStore::MySQL=HASH(0x3ec0388) 4505-sa-learn Nov 8 09:05:27.152 [4507] dbg: plugin: Mail::SpamAssassin::Plugin::Bayes=HASH(0x3879e88) implements 'learner_is_scan_available', priority 0 4505-sa-learn libgcc_s.so.1 must be installed for pthread_cancel to work 4505-end 7235-start () -------------------------------------------------------- With FuzzyOcr ENabled, fails right after FuzzyOcr DB access $ cat /var/log/sa-learn-pipe.log : : 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan ocrad-invert: /usr/bin/ocrad -s5 -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan ocrad-decolorize-invert: /usr/bin/ocrad -s5 -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan ocrad-decolorize: /usr/bin/ocrad -s5 $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan gocr: /usr/bin/gocr -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan gocr-180: /usr/bin/gocr -l 180 -d 2 -i $input 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Using scan tesseract: /usr/bin/tesseract $input $output 7804-sa-learn Nov 8 09:37:09.612 [7806] info: FuzzyOcr: Importing for MLDBM databases not available (dependencies missing) 7804-sa-learn Nov 8 09:37:09.612 [7806] dbg: FuzzyOcr: Connecting to: dbi:mysql:database=FuzzyOcr;mysql_socket=/var/run/mysqld/mysqld.sock 7804-sa-learn libgcc_s.so.1 must be installed for pthread_cancel to work 7804-end -------------------------------------------------------- syslog entries from running with sa-learn-pipe.sh script antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh Nov 8 09:36:41 newgalah1 imap: antispam: plugin initialising (2.0-notgit) Nov 8 09:36:41 newgalah1 imap: antispam: verbose debug enabled Nov 8 09:36:41 newgalah1 imap: antispam: "Junk" is exact match spam folder Nov 8 09:36:41 newgalah1 imap: antispam: "Spam" is exact match spam folder Nov 8 09:36:41 newgalah1 imap: antispam: no unsure folders Nov 8 09:36:41 newgalah1 imap: antispam: "Trash" is wildcard match trash folder Nov 8 09:36:41 newgalah1 imap: antispam: "Deleted *" is wildcard match trash folder Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend spam argument = --spam Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend not-spam argument = --ham Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend program = /usr/local/bin/sa-learn-pipe.sh Nov 8 09:36:41 newgalah1 imap: antispam: pipe backend tmpdir /tmpNov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_unsure(Junk): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_trash(INBOX): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_trash(Junk): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mail copy: from trash: 0, to trash: 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_spam(INBOX): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_spam(Junk): 1 Nov 8 09:37:08 newgalah1 imap: antispam: mailbox_is_unsure(INBOX): 0 Nov 8 09:37:08 newgalah1 imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 Nov 8 09:37:08 newgalah1 imap: antispam: running mailtrain backend program /usr/local/bin/sa-learn-pipe.sh Nov 8 09:37:08 newgalah1 imap: antispam: running mailtrain backend program /usr/local/bin/sa-learn-pipe.sh Nov 8 09:37:08 newgalah1 imap: antispam: running mailtrain backend program parameter 1 --spam -------------------------------------------------------- syslog entries from running with sa-learn directly antispam_pipe_program = /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: plugin initialising (2.0-notgit) Nov 8 09:44:57 newgalah1 imap: antispam: verbose debug enabled Nov 8 09:44:57 newgalah1 imap: antispam: "Junk" is exact match spam folder Nov 8 09:44:57 newgalah1 imap: antispam: "Spam" is exact match spam folder Nov 8 09:44:57 newgalah1 imap: antispam: no unsure folders Nov 8 09:44:57 newgalah1 imap: antispam: "Trash" is wildcard match trash folder Nov 8 09:44:57 newgalah1 imap: antispam: "Deleted *" is wildcard match trash folder Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend spam argument = --spam Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend not-spam argument = --ham Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend program = /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: pipe backend tmpdir /tmp Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_unsure(Junk): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_trash(INBOX): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_trash(Junk): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mail copy: from trash: 0, to trash: 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_spam(INBOX): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_spam(Junk): 1 Nov 8 09:44:57 newgalah1 imap: antispam: mailbox_is_unsure(INBOX): 0 Nov 8 09:44:57 newgalah1 imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 Nov 8 09:44:57 newgalah1 imap: antispam: running mailtrain backend program /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: running mailtrain backend program /usr/bin/sa-learn Nov 8 09:44:57 newgalah1 imap: antispam: running mailtrain backend program parameter 1 --spam Nov 8 09:44:58 newgalah1 imap: antispam: run program failed with exit code -1 -------------------------------------------------------- $ cat 90-plugin.conf plugin { antispam_debug_target = syslog antispam_verbose_debug = 1 antispam_backend = pipe antispam_trash_pattern = Trash;Deleted * antispam_spam = Junk;Spam antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh # antispam_pipe_program_args = --progress antispam_pipe_program_spam_arg = --spam antispam_pipe_program_notspam_arg = --ham antispam_pipe_tmpdir = /tmp } -------------------------------------------------------- $ dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.8.0-32-generic x86_64 Ubuntu 13.04 auth_mechanisms = cram-md5 login plain first_valid_uid = 108 mail_location = maildir:~/Maildir:LAYOUT=fs:INBOX=~/Maildir/INBOX managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;as cii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = scheme=plain username_format=%u /var/mail/%d/PASSWD driver = passwd-file } plugin { antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh antispam_pipe_program_notspam_arg = --ham antispam_pipe_program_spam_arg = --spam antispam_pipe_tmpdir = /tmp antispam_spam = Junk;Spam antispam_trash_pattern = Trash;Deleted * antispam_verbose_debug = 1 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve" service auth { unix_listener auth-client { mode = 0666 } } ssl = required ssl_cert = </etc/ssl/certs/dovecot1.crt ssl_key = </etc/ssl/private/dovecot1.pkcs8.key userdb { args = username_format=%u /var/mail/%d/PASSWD default_fields = uid=Debian-exim gid=Debian-exim home=/var/mail/%d/%n driver = static } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol imap { mail_plugins = " antispam" }

6 10

[Dovecot] SMTP configuration for director mail cluster
by Murray Trainer 18 Feb '14

18 Feb '14

HI All, I have setup my Dovecot director proxies and Dovecot backend mail stores. I intend setting up several incoming and outgoing Exim MTA's. I am a bit confused about what I need to run on the backend Dovecot MTA's to get the incoming mail delivered to them. Do I need to install Exim on them or use LMTP to receive mail from the MTA's? Also, can I directly deliver mail to the mailstores or do I have to go through the director proxies using lmtp? Note that I am using Director with the mailboxes on NFS backed storage. Thanks Murray

2 1

[Dovecot] Bug report
by Ramon 18 Feb '14

18 Feb '14

I'm using release 2.2.12, during a copy operation i get segfault on imap process. I have full bt of the issue: (gdb) bt #0 0x00007fcc521029cd in mail_cache_header_fields_read (cache=0x15c7210) at mail-cache-fields.c:369 #1 0x00007fcc52100664 in mail_cache_open_and_verify (cache=0x15c7210) at mail-cache.c:497 #2 0x00007fcc5210244d in mail_cache_register_get_list (cache=0x15c7210, pool=0x1573608, count_r=0x7fff7b3b2418) at mail-cache-fields.c:194 #3 0x00007fcc520ef845 in index_mail_parse_header_register_all_wanted (mail=0x15d4b60, headers=<value optimized out>) at index-mail-headers.c:170 #4 index_mail_parse_header_init (mail=0x15d4b60, headers=<value optimized out>) at index-mail-headers.c:230 #5 0x00007fcc520efdb8 in index_mail_cache_parse_init (_mail=0x15d4b60, input=0x15ddb38) at index-mail-headers.c:376 #6 0x00007fcc520bb163 in maildir_save_add (_ctx=0x15d3b20, tmp_fname=0x15735e8 "1392731650.M182940P5176.pecpop5", src_mail=0x0) at maildir-save.c:225 #7 0x00007fcc520bb4b8 in maildir_save_begin (_ctx=0x15d3b20, input=0x15debb8) at maildir-save.c:415 #8 0x00007fcc511e7360 in quota_save_begin (ctx=0x15d3b20, input=0x15debb8) at quota-storage.c:274 #9 0x00007fcc520cc182 in mailbox_save_begin (ctx=0x7fff7b3b25a8, input=0x15debb8) at mail-storage.c:2025 #10 0x00007fcc520c6242 in mail_storage_try_copy (ctx=0x15d3b20, mail=<value optimized out>) at mail-copy.c:76 #11 mail_storage_copy (ctx=0x15d3b20, mail=<value optimized out>) at mail-copy.c:101 #12 0x00007fcc520b6916 in maildir_copy (ctx=0x15d3b20, mail=0x15cf300) at maildir-copy.c:148 #13 0x00007fcc50dd7461 in notify_copy (ctx=0x15d3b20, mail=0x15cf300) at notify-storage.c:107 #14 0x00007fcc511e7183 in quota_copy (ctx=0x15d3b20, mail=0x15cf300) at quota-storage.c:220 #15 0x00007fcc520cc01f in mailbox_copy (_ctx=<value optimized out>, mail=0x15cf300) at mail-storage.c:2133 #16 0x000000000040c63b in fetch_and_copy (cmd=0x1593810, move=false) at cmd-copy.c:70 #17 cmd_copy_full (cmd=0x1593810, move=false) at cmd-copy.c:123 #18 0x0000000000416fbd in command_exec (cmd=0x1593810) at imap-commands.c:158 #19 0x00000000004160e0 in client_command_input (cmd=0x1593810) at imap-client.c:780 #20 0x00000000004161cd in client_command_input (cmd=0x1593810) at imap-client.c:841 #21 0x000000000041644d in client_handle_next_command (client=0x1592fb0) at imap-client.c:879 #22 client_handle_input (client=0x1592fb0) at imap-client.c:891 #23 0x00000000004167bf in client_input (client=0x1592fb0) at imap-client.c:933 #24 0x00007fcc51e1f336 in io_loop_call_io (io=0x158c1d0) at ioloop.c:388 #25 0x00007fcc51e203a7 in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:220 #26 0x00007fcc51e1f2a8 in io_loop_run (ioloop=0x157b720) at ioloop.c:412 #27 0x00007fcc51dcdf73 in master_service_run (service=0x157b5b0, callback=<value optimized out>) at master-service.c:566 #28 0x000000000041fd07 in main (argc=1, argv=0x157b390) at main.c:400 Here's config: auth_debug = yes auth_master_user_separator = * auth_username_format = default_vsz_limit = 512 M disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 101 first_valid_uid = 102 imap_id_send = import_environment = TZ info_log_path = /var/log/dovecot.log log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = always mail_gid = 101 mail_location = maildir:%h/Maildir mail_max_userip_connections = 50 mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota expire fts fts_lucene mail_log notify mail_uid = 102 maildir_broken_filename_sizes = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . subscriptions = yes type = private } passdb { args = /opt/dovecot-2.2.10/etc/dovecot/passwd.masterusers driver = passwd-file master = yes } passdb { args = /opt/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /opt/dovecot-2.2.10/etc/dovecot/dovecot-ldap-multiuser.conf driver = ldap master = yes } plugin { fts = lucene fts_lucene = mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = maildir quota_rule2 = INBOX.Trash:storage=+100M } protocols = imap pop3 service anvil { client_limit = 3000 } service auth { client_limit = 4096 unix_listener auth-userdb { mode = 0600 } } service imap-login { inet_listener imap { address = 10.11.47.49 port = 143 } inet_listener imaps { address = 10.11.47.49 port = 993 ssl = yes } process_limit = 2500 process_min_avail = 5 } service imap { drop_priv_before_exec = yes process_limit = 2500 process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { drop_priv_before_exec = yes process_limit = 1024 } service pop3-login { inet_listener pop3 { address = 10.11.47.49 port = 110 } inet_listener pop3s { address = 10.11.47.49 port = 995 ssl = yes } process_limit = 300 process_min_avail = 5 } service pop3 { drop_priv_before_exec = yes process_limit = 300 process_min_avail = 5 } ssl_cert = </opt/dovecot-2.2.10/certs/imapd.pem ssl_key = </opt/dovecot-2.2.10/certs/imapd.pem userdb { args = /opt/dovecot-2.2.10/etc/dovecot/dovecot-ldap.conf driver = ldap } protocol lmtp { mail_plugins = quota expire fts fts_lucene mail_log notify sieve } protocol lda { mail_plugins = quota expire fts fts_lucene mail_log notify sieve } protocol imap { mail_plugins = quota imap_quota mail_log notify } protocol pop3 { mail_plugins = quota mail_log notify pop3_uidl_format = UID%u-%v } Regards, Ramon

1 0

[Dovecot] PARTIAL results and UIDs
by Anders Thøgersen 18 Feb '14

18 Feb '14

Hi, I have had a look at dovecot 2.2.12 and think that I may have run into an issue with PARTIAL results. I have a mailbox with 9 emails having UIDs from 1 - 9. One of these emails contains the STRING "RFC" in the Subject header. The following SORT command with this mailbox selected does not return any emails: A4 UID SORT RETURN (COUNT PARTIAL 1:3) (FROM) UTF-8 (SUBJECT "RFC") * ESEARCH (TAG "A4") UID PARTIAL (1:3 NIL) COUNT 1 A4 OK Sort completed (0.000 secs). Here COUNT is 1, but the result is NIL. Changing the partial range to 1:5 returns the expected result: A4 UID SORT RETURN (COUNT PARTIAL 1:5) (FROM) UTF-8 (SUBJECT "RFC") * ESEARCH (TAG "A4") UID PARTIAL (1:5 5) COUNT 1 A4 OK Sort completed (0.000 secs). It may be that UIDs are used instead of sequence numbers. Regards Anders

1 0

[Dovecot] Possible error in function mailbox_autocreate
by Potapov Sergey 18 Feb '14

18 Feb '14

Hi! in mailbox_autocreate: if (mailbox_create(box, NULL, FALSE) < 0) { errstr = mailbox_get_last_error(box, &error); if (error != MAIL_ERROR_NOTFOUND) { <<< May be MAIL_ERROR_EXISTS should be here? mail_storage_set_critical(box->storage, "Failed to autocreate mailbox %s: %s", box->vname, errstr); return -1; } Some time I got this error when two connections tries to create INBOX at same time. ______ С уважением, Сергей Потапов

1 0

[Dovecot] Dsync crash (v2.2.10, sdbox+sis → mbox)
by Gilles Chauvin 18 Feb '14

18 Feb '14

Hi, I'm trying to use dsync to convert sdbox + sis mailboxes to mbox (mbox is chosen here to "re-attach" the attachments to their original place) # dsync -Dv -u $LOGIN -o "mail_location=sdbox:/zfspool/clone_srv_mail/$LOGIN" -o "mail_attachment_dir=/zfspool/clone_srv_attachments" backup "mbox:/zfspool/restore/$LOGIN/mbox:DIRNAME=mBoX-MeSsAgEs:INDEX=/zfspool/restore/$LOGIN/indexes:CONTROL=/zfspool/restore/$LOGIN/control" For 5 users out of a sample of 24, here is what's happening: dsync(user1): Error: read(/zfspool/clone_srv_attachments/cb/0a/cb0aad465a4ff95bf6fa6ece0fba94b43e8892cf-19dc51309fc2f3527e31000044c1c7e7-b55eb9176ca1b350e565000094b229f9-30810[base64:19 b/l]) failed: Stream is larger than expected (163244 > 163243, eof=1) dsync(user1): Error: copy: i_stream_read() failed: Invalid argument dsync(user1): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(user1): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f58a95a189a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f58a95a19a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f58a955b1cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc0287) [0x7f58a98ca287] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc3145) [0x7f58a98cd145] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xb6) [0x7f58a98bcb06] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x91) [0x7f58a98be5e1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa0ac3) [0x7f58a98aaac3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4a) [0x7f58a98ab04a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c021) [0x7f58a98a6021] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c151) [0x7f58a98a6151] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0xf5) [0x7f58a98a6295] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x48) [0x7f58a98867c8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x92) [0x7f58a9880e32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5f) [0x7f58a9886c2f] -> dsync() [0x42f750] -> dsync(dsync_brain_sync_mails+0x459) [0x42e9c9] -> dsync(dsync_brain_run+0x2a1) [0x42ac51] -> dsync() [0x42876f] -> dsync() [0x411c97] -> dsync(doveadm_mail_try_run+0x238) [0x4120a8] -> dsync(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f58a91c3d1d] -> dsync() [0x411419] dsync(user2): Error: read(/zfspool/clone_srv_attachments/ad/0c/ad0cef35cc6f0b2dae2197c4ff2b61a2bd58070d-9e8345192ccbf352c210000044c1c7e7-6efa5f2e522db350ed3d000094b229f9-15470[base64:18 b/l]) failed: Stream is larger than expected (194476 > 194475, eof=1) dsync(user2): Error: copy: i_stream_read() failed: Invalid argument dsync(user2): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(user2): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f2e2248d89a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f2e2248d9a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f2e224471cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc0287) [0x7f2e227b6287] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc3145) [0x7f2e227b9145] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xb6) [0x7f2e227a8b06] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x91) [0x7f2e227aa5e1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa0ac3) [0x7f2e22796ac3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4a) [0x7f2e2279704a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c021) [0x7f2e22792021] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c151) [0x7f2e22792151] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0xf5) [0x7f2e22792295] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x48) [0x7f2e227727c8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x92) [0x7f2e2276ce32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5f) [0x7f2e22772c2f] -> dsync() [0x42f750] -> dsync(dsync_brain_sync_mails+0x459) [0x42e9c9] -> dsync(dsync_brain_run+0x2a1) [0x42ac51] -> dsync() [0x42876f] -> dsync() [0x411c97] -> dsync(doveadm_mail_try_run+0x238) [0x4120a8] -> dsync(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f2e220afd1d] -> dsync() [0x411419] dsync(user3): Error: read(/zfspool/clone_srv_attachments/23/8a/238a781b53bb4d1b1bee989a5ff38636b616d5c5-41ba47152912f4522c6f000044c1c7e7-f3b06c2f5aa1b350d565000094b229f9-38650[base64:19 b/l]) failed: Stream is larger than expected (33191 > 33190, eof=1) dsync(user3): Error: copy: i_stream_read() failed: Invalid argument dsync(user3): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(user3): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f88d4bde89a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f88d4bde9a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f88d4b981cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc0287) [0x7f88d4f07287] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc3145) [0x7f88d4f0a145] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xb6) [0x7f88d4ef9b06] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x91) [0x7f88d4efb5e1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa0ac3) [0x7f88d4ee7ac3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4a) [0x7f88d4ee804a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c021) [0x7f88d4ee3021] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c151) [0x7f88d4ee3151] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0xf5) [0x7f88d4ee3295] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x48) [0x7f88d4ec37c8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x92) [0x7f88d4ebde32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5f) [0x7f88d4ec3c2f] -> dsync() [0x42f750] -> dsync(dsync_brain_sync_mails+0x459) [0x42e9c9] -> dsync(dsync_brain_run+0x2a1) [0x42ac51] -> dsync() [0x42876f] -> dsync() [0x411c97] -> dsync(doveadm_mail_try_run+0x238) [0x4120a8] -> dsync(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f88d4800d1d] -> dsync() [0x411419] dsync(user4): Error: read(/zfspool/clone_srv_attachments/11/fa/11fa090f48879e8514a07040a837b5544364e091-d5dd321af54ff452790f000044c1c7e7-98da7910e38db350b75a000094b229f9-50167[base64:19 b/l]) failed: Stream is larger than expected (56522 > 56521, eof=1) dsync(user4): Error: copy: i_stream_read() failed: Invalid argument dsync(user4): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(user4): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f416564a89a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f416564a9a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f41656041cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc0287) [0x7f4165973287] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc3145) [0x7f4165976145] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xb6) [0x7f4165965b06] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x91) [0x7f41659675e1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa0ac3) [0x7f4165953ac3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4a) [0x7f416595404a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c021) [0x7f416594f021] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c151) [0x7f416594f151] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0xf5) [0x7f416594f295] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x48) [0x7f416592f7c8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x92) [0x7f4165929e32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5f) [0x7f416592fc2f] -> dsync() [0x42f750] -> dsync(dsync_brain_sync_mails+0x459) [0x42e9c9] -> dsync(dsync_brain_run+0x2a1) [0x42ac51] -> dsync() [0x42876f] -> dsync() [0x411c97] -> dsync(doveadm_mail_try_run+0x238) [0x4120a8] -> dsync(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f416526cd1d] -> dsync() [0x411419] dsync(user5): Error: read(/zfspool/clone_srv_attachments/77/aa/77aa90d73107cc35fd0305c22a84eb00e793c935-a0d2ef302a20f552de5a000044c1c7e7-2accb7218264b350a423000094b229f9-11713[base64:19 b/l]) failed: Stream is larger than expected (43663 > 43662, eof=1) dsync(user5): Error: copy: i_stream_read() failed: Invalid argument dsync(user5): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) dsync(user5): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f2ab375489a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f2ab37549a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f2ab370e1cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc0287) [0x7f2ab3a7d287] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc3145) [0x7f2ab3a80145] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xb6) [0x7f2ab3a6fb06] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x91) [0x7f2ab3a715e1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xa0ac3) [0x7f2ab3a5dac3] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4a) [0x7f2ab3a5e04a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c021) [0x7f2ab3a59021] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x9c151) [0x7f2ab3a59151] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0xf5) [0x7f2ab3a59295] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x48) [0x7f2ab3a397c8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x92) [0x7f2ab3a33e32] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5f) [0x7f2ab3a39c2f] -> dsync() [0x42f750] -> dsync(dsync_brain_sync_mails+0x459) [0x42e9c9] -> dsync(dsync_brain_run+0x2a1) [0x42ac51] -> dsync() [0x42876f] -> dsync() [0x411c97] -> dsync(doveadm_mail_try_run+0x238) [0x4120a8] -> dsync(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f2ab3376d1d] -> dsync() [0x411419] Regards, Gilles.

1 1