- dovecot - dovecot.org

[Dovecot] Deduplicate not processing all messages - bug?
by Jiri Bourek 01 Apr '14

01 Apr '14

Hello, I'm trying to create automated backup recovery using "doveadm import" and "doveadm deduplicate". During testing I noticed that deduplicate only deletes some duplicates and has to be called multiple times to find them all. Here's what I've been trying (in shell commands): First, expunge inbox (the end result is the same even if you delete only some messages): # doveadm expunge -u test mailbox inbox all # ls /home/mailboxes/test/cur | wc -l 0 Then import data from backup - twice, so duplicates are created (again, if you don't delete all messages and call import only once, resulting behaviour is the same.) # doveadm import -u test maildir:/home/test "" mailbox INBOX # doveadm import -u test maildir:/home/test "" mailbox INBOX # ls /home/mailboxes/test/cur | wc -l 1046 Then try to deduplicate # doveadm deduplicate -u test mailbox INBOX # ls /home/mailboxes/test/cur | wc -l 1040 And again # doveadm deduplicate -u test mailbox INBOX # ls /home/mailboxes/test/cur | wc -l 1029 And so on until the message count holds on 523 Each repetition removes 10 - 30 duplicates so eventually all duplicates are removed if "doveadm deduplicate" is called enough times in a row. I also noticed that when I repeat the test, import the backup again and call deduplicate, the steps - how many messages are removed at one time - are the same. That is I start with 1046 messages in the mailbox, after first run there's 1040, then 1029 and so on. My guess would be the behaviour depends on what is stored in the mailbox, but that's pretty much all I can figure out on my own at this time. My question is - is this intended behaviour, ie. are you supposed to run doveadm deduplicate as long as the number of messages in the mailbox keeps changing? Or is it a bug? Tried to Google for the answer but no luck, so thanks for any answers. Tested on Dovecot version 2.2.9 and 2.2.12 (both from Debian repositories.)

2 1

[Dovecot] [Bug] doveadm pw Fatal: open(/etc/dovecot/dovecot.conf) failed: Permission denied
by Dwain Blazej 01 Apr '14

01 Apr '14

dovecot --version => 2.1.7 When I as a normal user the command: doveadm pw -s sha512-crypt -p example_password the command exit with return code 89 and the message doveconf: Fatal: open(/etc/dovecot/dovecot.conf) failed: Permission denied If I make Dovecot's configuration files world readable the error goes away. Please remove configuration file dependencies from "doveadm pw".

4 4

[Dovecot] Specifying passwd-file with virtual domains?
by Jeffrey Walton 01 Apr '14

01 Apr '14

I'm trying to use virtual domains and I'm suffering a disconnect. I have two domains - foo.com and bar.com. On the filesystem, they are located at /var/mail/foo.com/ and /var/mail/bar.com/. Users are located at /var/mail/foo.com/john/, /var/mail/bar.com/jane/, etc. There are two password files with <user>:<scheme><password> entries. The scheme is {PLAIN}. They are located at /var/mail/foo.com/users and /var/mail/bar.com/users. According to the wiki, these are passwd-file databases (http://wiki2.dovecot.org/AuthDatabase/PasswdFile) I specified the following in my dovecot.conf. passdb { args = /var/mail/%d/users driver = passwd-file } Attempts to use the configuration result in an authentication failure. Here's an entry from dovecot.log when the failure happens: Mar 31 16:04:12 imap-login: Info: Disconnected (auth failed, 1 attempts in 5 secs): user=<jeff(a)foo.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.1.1, secured, session=<n5/ajez1FgB/AAAB> What exactly goes where to have Dovecot use the 'users' files to authenticate users? Thanks in advance and my apologies for the question. Two days of blog posts, mini-HowTo's and mailing lists has only help me discover ways to do things incorrectly. ********** # dovecot --version 2.1.7 # doveconf -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-686-pae i686 Debian 7.4 disable_plaintext_auth = no log_path = /var/log/dovecot.log login_trusted_networks = 127.0.0.1 mail_location = mbox:~/mail:INBOX=/var/mail/%u namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } ... prefix = } passdb { args = /var/mail/%d/users driver = passwd-file } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap pop3" ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = passwd }

2 1

Re: [Dovecot] Dovecot not honoring configuration settings (auth failure)
by Joseph Tam 01 Apr '14

01 Apr '14

Jeffrey Walton <noloader(a)gmail.com> writes: > I specified the following in my dovecot.conf. > > passdb { > args = /var/mail/%d/users > driver = passwd-file > } > > Attempts to use the configuration result in an authentication failure. > Here's an entry from dovecot.log when the failure happens: > > Mar 31 16:04:12 imap-login: Info: Disconnected (auth failed, 1 > attempts in 5 secs): user=<jeff(a)foo.com>, method=PLAIN, rip=127.0.0.1, > lip=127.0.1.1, secured, session=<n5/ajez1FgB/AAAB> Just to confirm, your <user> specified in the passdb corresponds to what is being authenticated (i.e. client is authenticating as "jeff(a)foo.com", not "jeff")? Otherwise, you'll need to add domains to your passdb, or configure "username_format=%n" Joseph Tam <jtam.home(a)gmail.com>

2 2

[Dovecot] Fwd: Dovecot not honoring configuration settings (auth failure)
by Reindl Harald 01 Apr '14

01 Apr '14

boah how i hate that "reply all" attitude leading to break "reply to list" and leads in off-list replies -------- Original-Nachricht -------- Betreff: Re: [Dovecot] Dovecot not honoring configuration settings (auth failure) Datum: Tue, 01 Apr 2014 00:02:42 +0200 Von: Reindl Harald <h.reindl(a)thelounge.net> Organisation: the lounge interactive design An: noloader(a)gmail.com Am 31.03.2014 23:47, schrieb Jeffrey Walton: > On Mon, Mar 31, 2014 at 5:39 PM, Reindl Harald <h.reindl(a)thelounge.net> wrote: >> >> Am 31.03.2014 23:37, schrieb Jeffrey Walton: >>> My dovecot.conf has the following: >>> >>> # No results when searching the wiki >>> disable_plaintext_auth = no >>> >>> # http://wiki2.dovecot.org/Authentication/Mechanisms >>> auth_mechanisms = plain login digest-md5 cram-md5 >>> >>> When I attempt to run imapsync, I receive an error: >>> >>> Host2: <host> says it has NO CAPABILITY for AUTHENTICATE LOGIN >>> >>> imapsync also dumps the helo string, and it is missing: >>> >>> Host2: * OK [CAPABILITY IMAP4rev1 LITERAL+ ... STARTTLS >>> AUTH=PLAIN] Dovecot ready. >>> >>> I've restarted the dovecot service with 'service dovecot restart' and >>> even rebooted the machine. >>> >>> There is nothing reported in any on the log files >>> (/var/mail/dovecot.log and /var/log/mail.<level>). >>> >>> Any ideas why dovecot is not honoring the setting in its config file? >> >> and the settings are *really* in /etc/dovecot/dovecot.conf >> or in some ".d"-folder which may or may not be included? > I believe they are in /etc/dovecot/dovecot.conf: > > # cat /etc/dovecot/dovecot.conf | grep -i auth_ > auth_mechanisms = plain login digest-md5 cram-md5 my local machine is configured like below for years and it works well, post the whole config-file and strip only what is really needed to keep secret # provided services protocols = imap # configure ssl ssl = yes ssl_cert = </etc/postfix/certs/localhost.pem ssl_key = </etc/postfix/certs/localhost.pem ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES2$ ssl_prefer_server_ciphers = yes ssl_parameters_regenerate = 0 # configure imap-proxy service imap-login { inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } vsz_limit = 128M service_count = 0 process_min_avail = 1 process_limit = 1 client_limit = 200 } # default settings imap_capability = IMAP4 IMAP4rev1 ACL RIGHTS=texk NAMESPACE CHILDREN SORT QUOTA THREAD=ORDEREDSUBJECT UNSELECT I$ login_greeting = login_log_format_elements = %u %r %m %c login_log_format = %{login_status}: %s pop3_client_workarounds = outlook-no-nuls oe-ns-eoh mail_max_userip_connections = 100 auth_mechanisms = CRAM-MD5 DIGEST-MD5 APOP LOGIN PLAIN SCRAM-SHA-1 disable_plaintext_auth = no shutdown_clients = no version_ignore = yes

2 2

[Dovecot] maildir backup
by Ramon Orrù 31 Mar '14

31 Mar '14

Hi everybody, I'm trying to backup a dovecot instance, and i'm looking for a method to "snapshot" dovecot maildir in a properly way, and backup whole snapshot in a second step (tar). I read about dsync, end, if i'm not going wrong, it dumps correctly also dovecot indexes; is it the tool i need? Thank you for any hint. Ramon

3 2

[Dovecot] sieve mailbox in IMAP mailboxes
by Luigi Rosa 31 Mar '14

31 Mar '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I have installed latest pigeonhole-sieve Everything works as expected but in IMAP folders I have a "dovecot" folder with a "sieve" subfolder Mail storage is maildir. I remember a setting that tells dovecot to ignore directories and do not display them as IMAP folders, but I acannot find it. Any hints? # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.5.1.el6.centos.plus.i686 i686 CentOS release 6.5 (Final) ext4 auth_cache_negative_ttl = 0 auth_cache_size = 1 M auth_cache_ttl = 5 hours auth_failure_delay = 3 secs auth_mechanisms = plain login digest-md5 cram-md5 base_dir = /var/run/dovecot/ disable_plaintext_auth = no lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_greeting = Ready. mail_location = maildir:/var/spool/mail/%u/ mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Bozze { special_use = \Drafts } mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox "Posta eliminata" { special_use = \Trash } mailbox "Posta inviata" { special_use = \Sent } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = logwatch(a)meti.it protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = </etc/dovecot/certs/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem syslog_facility = local5 userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = sieve } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep delay-newmail imap_idle_notify_interval = 2 mins imap_logout_format = bytes=%i/%o mail_max_userip_connections = 20 } protocol pop3 { mail_max_userip_connections = 3 pop3_client_workarounds = oe-ns-eoh outlook-no-nuls pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_uidl_format = %08Xu%08Xv } Ciao, luigi - -- / +--[Luigi Rosa]-- \ Everyone lies, Michael. The innocent lie because they don't want to be blamed for something they didn't do. The guilty lie because they have no other choice. --Jeffrey Sinclair, "And the Sky Full of Stars" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.14 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJTMwRTAAoJEO5WT/qgw4yKqmEP/AwHAF5MvG9nXbK7s6G4q4xf 0XG8fVef6CcWLnL+VWdFXxpL8aINmYlMJxlKp7wq1jVRGhnhdVJWM/zp5V/aZ3ql J/QR5LRuBJaJDdzHFP+Mlmf8mnl1iczc0bWRQpbJ+uiQJbd4RiPH4TM+RtJor5E3 3Wa2JOXpbJUEHtVaCpu5dSv26YaLtj3seRXQ3jgMruePOpab6qJSDt7BAaBSwTS/ IMlMXe0oRULTVIYX+Rf+n2sp/8a3XlBO3MU325JOaW3zLEsEQ89EE0/QUnMb6Rnf 5bu+Dn8Y1KeA8UJBKb+0CjVLrNLI0MeukzylLO43UL8iFfdHhgLo7hzh9L4HNVIs qk5fot9c0Q2/DDWUTO/lxMXaE1uZxxdPaAHQiTz/A7FbWQqtM5QtuP5z+NQprFqo f8cyCUETlGdde9CoBCmLZLSs3GlV7sjimJwL3xd4SP21S2fJvpkZcHWNKXl7btm9 UnQJCTXli1WdwrsY+vSiLUIPZJG8jg3F5NkCV55rWH21OnkmvUG0MKQW5Icggb9V W8K5EI66S3soMFSIyiGWf5iPDU8KyYd1GA6/pDESksJhbDKktPn5Dq4LgWNuIwp0 ZgvCHNcO1ZPH2T7VpDPBOEYeYHICrUfKLX7I9/v8RM9pbIRsjYXd0FgqwNDIXRyq daB394iwfQUmGbjjvcSZ =D9b8 -----END PGP SIGNATURE-----

2 3

[Dovecot] check the user number
by ihab 31 Mar '14

31 Mar '14

There is a way to check the number of user using the system at anytime -- View this message in context: http://dovecot.2317879.n4.nabble.com/check-the-user-number-tp47327.html Sent from the Dovecot mailing list archive at Nabble.com.

3 2

[Dovecot] possible quota bug ?
by fernando.figaro＠uol.com.br 31 Mar '14

31 Mar '14

Hi, I'm using dovecot 2.2.5 with quota (maildir backend), zlib and expunge plugins. When I list maildirsize file, I get: 1073741824S 17952 16 If I receive a new message (example: 1204 bytes compressed and 2524 bytes plain text), the quota file is write correctly (2524 1 entry). When I move the message to trash folder (or between user custom folders) the file have wrong entries: 1073741824S 17952 16 2524 1 1204 1 (this is the size of the compressed message) -2524 -1 I coudn't find any relation with the config settings causing this problem and checked the changelog since 2.2.5. Had someone had this same problem? Thanks, Fernando

4 6

Re: [Dovecot] Connection refused userdb lookup ..dovecot/auth-userdb
by Simon 31 Mar '14

31 Mar '14

On Thursday, March 13, 2014, Steffen Kaiser <skdovecot(a)smail.inf.fh-brs.de> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 13 Mar 2014, Simon wrote: > > Ive taken a look at this and cant quite figure out what is going on here. >> I have tested all the SQL permissions, and also changed the unix_listener >> auth-userdb mode to 0666 (as instructed elsewhere to try and solve this >> issue), but cannot seem to work out what the issue is. >> > > what happens if you connect to that socket manually, e.g.: > > # sudo -u <lda-user> socat - UNIX:/usr/local/dovecot/var/ > run/dovecot/auth-userdb > VERSION 1 1 > SPID 1746 > > Maybe first try as root, then with the partucular users. > Thanks for the reply! I tried this as root and got the following: [root@vmail1 ~]# socat - UNIX:/usr/local/dovecot/var/run/dovecot/auth-userdb 2014/03/16 20:57:05 socat[24404] E connect(3, AF=1 "/usr/local/dovecot/var/run/dovecot/auth-userdb", 48): Connection refused Seems a bit wierd that I can't connect as root? Simon

4 12