June 2015 - dovecot - dovecot.org

dsync replication issues with shared mailboxes
by Sergey Schwartz 15 Jun '15

15 Jun '15

Gentlemen, I've setup 2 servers with dsync replication and hit a serious issue - some messages got duplicated thousands times in some shared mailboxes(~5). There is actually no reason to replicate anything from shared name space and I've tried to limit replication scope with just 'inbox' name space but it didn't help. dovecot version ||2.2.18 (2de3c7248922) errors in the logs May 26 13:23:38 mx10 dovecot: doveadm: Error: dsync-remote(korobova@mydomain): Error: Mailbox turkey: Save commit failed: Message has been copied too many times (24498 + 8270) May 26 13:25:16 mx10 dovecot: doveadm: Error: dsync-remote(korobova@mydomain): Error: Mailbox turkey: Save commit failed: Message has been copied too many times (24498 + 8270) May 26 13:26:40 mx10 dovecot: dsync-local(zhelonkina@mydomain): Error: Mailbox booking: Save commit failed: Message has been copied too many times (0 + 32768) May 26 13:30:01 mx10 dovecot: dsync-local(kashchits@mydomain): Error: Mailbox shared/davydjanc@mydomain/russia: Save commit failed: Message has been copied too many times (17139 + 15629) May 26 13:30:01 mx10 dovecot: dsync-local(davydjanc@mydomain): Error: Mailbox russia: Save commit failed: Message has been copied too many times (17139 + 15629) May 26 13:30:01 mx10 dovecot: dsync-local(kapitanova@mydomain): Error: Mailbox shared/davydjanc@mydomain/russia: Save commit failed: Message has been copied too many times (17139 + 15629) May 26 13:30:03 mx10 dovecot: dsync-local(grinenko@mydomain): Error: Mailbox shared/davydjanc@mydomain/russia: Save commit failed: Message has been copied too many times (17139 + 15629) May 26 13:30:03 mx10 dovecot: dsync-local(maslova@mydomain): Error: Mailbox shared/davydjanc@mydomain/russia: Save commit failed: Message has been copied too many times (17139 + 15629) Data was not lost and I've been able to run deduplicate for most of mailboxes, but one mailbox got broken and I had to manually move message to another mailbox force-resync failed fot that mailbox doveadm(l.davydjanc@mydomain): Error: mdbox map /srv/vmail/current/mydomain/davydjanc/storage/dovecot.map.index corrupted: map_uid=361735 refcount too low Hope you guys have an idea how to work it around :) replication.conf dsync_remote_cmd = /usr/bin/ssh -i /home/vmail/.ssh/id_rsa -l %{login} %{host} doveadm dsync-server -u %u service aggregator { fifo_listener replication-notify-fifo { user = vmail mode = 0600 } unix_listener replication-notify { user = vmail mode = 0600 } process_min_avail = 1 } service replicator { unix_listener replicator-doveadm { user = vmail mode = 0600 } process_min_avail = 1 } service doveadm { user = vmail process_min_avail = 1 } service config { unix_listener config { user = vmail } process_min_avail = 1 } replication_max_conns = 50 replication_dsync_parameters = -d -n inbox -l 30 -U plugin { mail_replica = remote:vmail@mx20 } doveconf -n # 2.2.18 (2de3c7248922): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 # OS: Linux 3.13.0-34-generic x86_64 Ubuntu 14.04.2 LTS xfs auth_cache_negative_ttl = 0 auth_cache_size = 512 M auth_default_realm = mydomain auth_failure_delay = 5 secs auth_worker_max_count = 4096 default_client_limit = 40960 default_process_limit = 8192 default_vsz_limit = 2 G disable_plaintext_auth = no first_valid_gid = 500 mail_location = mdbox:/srv/vmail/current/%d/%n mail_plugins = acl zlib notify replication mail_shared_explicit_inbox = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mdbox_rotate_size = 32 M namespace { list = yes location = mdbox:/srv/vmail/current/%%d/%%n prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/virtual/base.conf.ext driver = sql } passdb { args = /etc/dovecot/virtual/master.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = file:/srv/vmail/current/shared.db/000-shared-mailboxes.db sieve = file:/srv/vmail/current/%d/%n/sieve;active=/srv/vmail/current/%d/%n/active.sieve sieve_max_redirects = 0 zlib_save = xz zlib_save_level = 6 } protocols = " imap lmtp sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { process_min_avail = 24 } service imap { process_limit = 4096 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl_cert = </etc/ssl/mxbgcom/2015/mydomain.com.crt.chained ssl_key = </etc/ssl/mxbgcom/2015/mydomain.com.key syslog_facility = local0 userdb { args = /etc/dovecot/virtual/base.conf.ext driver = sql } protocol lmtp { mail_plugins = acl zlib notify replication sieve } protocol imap { mail_max_userip_connections = 15 mail_plugins = acl zlib notify replication imap_acl } -- Best regards, Sergey Schwartz Senior System Administrator Biblio Globus Tour Operator www.bgoperator.ru T: +7 495 5042500 ext 1532 E: sergey.schwartz(a)bgoperator.com

1 0

Sorry, another faq
by Martin S 14 Jun '15

14 Jun '15

I've installed a mailserver according to these instructions: http://www.server-world.info/en/note?os=CentOS_7&p=httpd&f=13 When I try to login to the server through Roundcube webmail I get Connection to storage server failed. So checking on this [12-Jun-2015 11:28:53 +0000]: <6jap13r2> IMAP Error: Login failed for martin from 83.251.209.249. Could not connect to ssl://myserver:993: Permission denied in /usr/share/roundcubemail/program/lib/Roundcube/rcube_imap.php on line 198 (POST /roundcubemail/?.... /etc/roundcubemail/config.inc.php Has the following: $config['default_host'] = 'ssl://mail.myserver.tld'; [address obfuscated] $config['default_port'] = 993; as I understand should be correct. I've been looking at various posts on the net that says the problem is a permission on dovecot, but I fail to find anything to how to fix this as it looks right to me. Any suggestions? /Martin S -- Regards, Martin S

5 5

dovecot only partially indexing ... fts
by Infoomatic 14 Jun '15

14 Jun '15

hi, I have a setup using solr as fts, however it seems that when I move messages it does not automatically index the stuff. Also, when using sieve scripts to store messages in different folders I get: dovecot: indexer-worker(user): Indexed 0 messages in testfolder If I get a mail to normal INBOX I get dovecot: indexer-worker(user): Indexed 1 messages in INBOX doveadm index -u user '*' does the trick, however, I have set "fts_autoindex = yes" ... the relevant part of doveconf -n: mail_plugins = fts fts_solr zlib acl quota zlib fts fts_solr acl plugin { fts = solr fts_autoindex = yes fts_solr = url=http://localhost:8983/solr/ break-imap-search sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags } protocol lda { mail_plugins = fts fts_solr zlib sieve acl } protocol imap { mail_plugins = fts fts_solr zlib acl quota imap_acl imap_quota } is this normal behaviour or did I screw something up? TIA, infoomatic

1 0

fts_solr Bad Request / BUG: Unknown internal error
by Nick Rosier 14 Jun '15

14 Jun '15

Hi, yesterday I created a new mailbox; ever since (and only for the new mailbox) I am getting these errors: 2015-06-12T00:00:29.808526+02:00 mail dovecot: indexer-worker(xxx(a)example.com): Error: fts_solr: Lookup failed: Bad Request 2015-06-12T00:00:29.808560+02:00 mail dovecot: indexer-worker(xxx(a)example.com): Error: Mailbox INBOX: Status lookup failed: BUG: Unknown internal error Is this a known issue? Rgds, N.

2 2

RE: Testin new installation
by edgar 13 Jun '15

13 Jun '15

Look at /etc/hosts ::1 is the ipv6 version of localhost. Sent from Samsung tablet -------- Original message -------- From Steve Matzura <number6(a)noisynotes.com> Date: 06/13/2015 6:00 AM (GMT-06:00) To dovecot <dovecot(a)dovecot.org> Subject Testin new installation The first place I went to for test advice and planning recommendations was http://wiki2.dovecot.org/TestInstallation - The very first test failed. Doc says: Next check that Dovecot is listening for connections: # telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN] Dovecot ready. If you got "connection refused", make sure that Dovecot is configured to serve the imap protocol and listening on the expected interfaces/addresses. The simplest way to do that would be using doveconf(1): # doveconf protocols listen protocols = imap pop3 lmtp sieve listen = *, :: If the protocols setting shouldn't contain imap so add it. Also make sure, that relevant !include or !try_include configuration lines are not commented. *** End doc extract *** All of the above specified settings are correct. Yet, when I telnet localhost 143, I get: Trying ::1... # this is certainly suspect Escape character is '^['. Connection closed by foreign host.

3 3

postfix/dovecot on debian jessie (url config at OVH)
by klrumpf 13 Jun '15

13 Jun '15

Hi list, could use some help with a pasword issue or ovh dns zone problem, dovecot newbie I have gone thru setting up a mailserver using the below http://www.binarytides.com/install-postfix-dovecot-debian/ when I try to set up an account from my laptop (iceweasel/t-bird) I get password problems. mail.log says Jun 13 18:36:04 www postfix/smtpd[701]: connect from unknown[xx.xx.214.75] Jun 13 18:36:04 www postfix/smtpd[688]: disconnect from unknown[xx.xx.214.75] Jun 13 18:36:04 www postfix/submission/smtpd[687]: disconnect from unknown[xx.xx.214.75] Jun 13 18:36:04 www postfix/submission/smtpd[694]: disconnect from unknown[xx.xx.214.75] Jun 13 18:36:04 www postfix/smtpd[693]: disconnect from unknown[xx.xx.214.75] Jun 13 18:36:04 www postfix/submission/smtpd[698]: disconnect from unknown[.... nstat also looks ok BWE1# netstat -lntp Active Internet connections (only servers) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 127.0.0.1:12301 0.0.0.0:* LISTEN 492/opendkim tcp 0 0 0.0.0.0:110 0.0.0.0:* LISTEN 504/dovecot tcp 0 0 0.0.0.0:143 0.0.0.0:* LISTEN 504/dovecot tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 486/nginx -g daemon tcp 0 0 0.0.0.0:465 0.0.0.0:* LISTEN 617/master tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 449/sshd tcp 0 0 0.0.0.0:25 0.0.0.0:* LISTEN 617/master tcp 0 0 127.0.0.1:4000 0.0.0.0:* LISTEN 653/ssh tcp 0 0 0.0.0.0:993 0.0.0.0:* LISTEN 504/dovecot tcp 0 0 0.0.0.0:995 0.0.0.0:* LISTEN 504/dovecot tcp 0 0 0.0.0.0:587 0.0.0.0:* LISTEN 617/master tcp 0 0 127.0.0.1:6379 0.0.0.0:* LISTEN 455/redis-server 12 tcp6 0 0 :::110 :::* LISTEN 504/dovecot tcp6 0 0 :::143 :::* LISTEN 504/dovecot tcp6 0 0 :::80 :::* LISTEN 486/nginx -g daemon tcp6 0 0 :::465 :::* LISTEN 617/master tcp6 0 0 :::21 :::* LISTEN 485/vsftpd tcp6 0 0 :::22 :::* LISTEN 449/sshd tcp6 0 0 :::25 :::* LISTEN 617/master tcp6 0 0 ::1:4000 :::* LISTEN 653/ssh tcp6 0 0 :::993 :::* LISTEN 504/dovecot tcp6 0 0 :::995 :::* LISTEN 504/dovecot tcp6 0 0 :::587 :::* LISTEN 617/master maybe someone has done it before, thanks <http://de.linkedin.com/in/klrumpf>

1 0

LDA versus LMTP
by Steve Matzura 13 Jun '15

13 Jun '15

My system has a great big four users. The Dovecot wiki says LMTP is more efficient, and someone on IRC told me I'd need it if I were ever to use sieve, which at this time I have no intention of doing. Should I stick with LDA, or just implement LMTP so I'm ready if ever I need it in the future? The bottom line is, it's unclear from the wiki how to explicitly specify use of one or the other, so that's my question.

5 7

Non-Existent Log File
by Steve Matzura 13 Jun '15

13 Jun '15

My /var/log/maillog was getting pretty big because of lots of testing and re-configuring I've been doing lately with both Dovecot and Postfix. I figured just remove /var/log/maillog and it would be re-created. It wasn't--not by Dovecot, not by Postfix. I had to manually create a new one, put one character in it, save it, properly secure it with chmod, and then Dovecot (and postfix) messages got written to it. This can't possibly be the proper procedure to clear maillog messages ... can it?

3 3

Error when starting Dovecot
by Steve Matzura 13 Jun '15

13 Jun '15

After applying some changes to 10-master.conf as detailed at http://wiki2.dovecot.org/HowTo/PostfixDovecotLMTP I receive the following when trying to start: doveconf: Fatal: Error in configuration file /etc/dovecot/conf.d/10-master.conf line 49: Expecting '{' I'm trying to enable LMTP. The instructions say: Socket configuration The actual socket is configured in /etc/dovecot/conf.d/10-master.conf. The LMTP service can be bound to both INET or Unix sockets. In this example a Unix socket is placed inside the Postfix spool with appropriate permissions set: service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } I copied this block and placed it in my copy of 10-master.conf. Line 49 is the first line of this block, and there's clearly a left-brace there. The braces match, too. Thoughts?

2 3

Orphaned email boxes...
by SH Development 13 Jun '15

13 Jun '15

What is the correct way to delete mailboxes that no longer have a database entry? Jeff

2 3