- dovecot - dovecot.org

Sieve dict and bindir question
by Alessio Cecchi 03 May '17

03 May '17

Hi, I have setup the latest Dovecot and Sieve with dict in order to read rules from MySQL and works fine: sieve_before = dict:proxy::sieve;name=activesql;bindir=~/.sieve-bin dict { sieve = mysql:/etc/dovecot/dovecot-dict-sieve-sql.conf.ext } # cat /etc/dovecot/dovecot-dict-sieve-sql.conf.ext connect = host=10.1.1.1 dbname=dovecot user=dovecot password=Ciao map { pattern = priv/sieve/name/$script_name table = user_sieve_scripts username_field = username value_field = id fields { script_name = $script_name } } map { pattern = priv/sieve/data/$id table = user_sieve_scripts username_field = username value_field = script_data fields { id = $id } } But when I update the rules in mysql sieve continue to apply only the "old" rules stored in the binary. The only way to apply the new rules is to delete the .sieve-bin/activesql.svbin. If I remove ";bindir=~/.sieve-bin" works fine. This is a cache issue and can be fixed via setting, is an issue or is a "feature" :-) ? Thanks -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice

3 4

dovecot log shows: service=imap ... Error: Temp file creation to /tmp/dovecot.imap. failed: No such directory
by Peter Kielbasiewicz 03 May '17

03 May '17

I am using dovecot 2.2 with plesk 12 and I have made no modifications to the dovecot config. Logwatch reports the messages below. The errors don't seem to appear for every imap connect as can be seen from the number of deliveries and successful logins. So what makes dovecot fail sometimes to create the /tmp/dovecot.imap? Dovecot Deliveries: 19 Dovecot IMAP and POP3 Successful Logins: 106 Dovecot disconnects: 72 **Unmatched Entries** dovecot: message repeated 4 times: [ service=imap, user=tester(a)example.com, ip=[::1]. Error: Temp file creation to /tmp/dovecot.imap. failed: No such file or directory]: 1 Time(s) dovecot: message repeated 5 times: [ service=imap, user=tester(a)example.com, ip=[::1]. Error: Temp file creation to /tmp/dovecot.imap. failed: No such file or directory]: 1 Time(s) dovecot: service=imap, user=tester(a)example.com, ip=[::1]. Error: Temp file creation to /tmp/dovecot.imap. failed: No such file or directory: 10 Time(s) dovecot: service=imap, user=tester(a)example.com, ip=[::1]. Error: Temp file creation to /tmp/dovecot.imap. failed: No such file or directory: 1 Time(s)

2 1

Problem with Pigeonhole/Sieve
by Kamil Kapturkiewicz 03 May '17

03 May '17

Hi, I am trying to configure Pigeonhole to get filters in RoundCube working. Unfortunately I am getting following error in DoveCot log instead: May 01 14:35:41 managesieve-login: Error: auth: connect(login) in directory / failed: Permission denied (euid=248(<getpwuid() error>) egid=248(<getgrgid() error>) missing +x perm: /, we're not in group 202, dir owned by 0:202 mode=0750) May 01 14:35:41 managesieve-login: Error: auth: connect(login) in directory / failed: Permission denied (euid=248(<unknown>) egid=248(<unknown>) missing +x perm: /, we're not in group 202, dir owned by 0:202 mode=0750) May 01 14:36:00 master: Warning: Killed with signal 15 (by pid=37695 uid=0 code=kill) May 01 14:36:36 managesieve-login: Error: auth: connect(login) in directory / failed: Permission denied (euid=248(<getpwuid() error>) egid=248(<getgrgid() error>) missing +x perm: /, we're not in group 202, dir owned by 0:202 mode=0750) May 01 14:36:36 managesieve-login: Error: auth: connect(login) in directory / failed: Permission denied (euid=248(<unknown>) egid=248(<unknown>) missing +x perm: /, we're not in group 202, dir owned by 0:202 mode=0750) May 01 15:17:08 managesieve-login: Error: auth: connect(login) in directory / failed: Permission denied (euid=248(<getpwuid() error>) egid=248(<getgrgid() error>) missing +x perm: /, we're not in group 202, dir owned by 0:202 mode=0750) May 01 15:17:08 managesieve-login: Error: auth: connect(login) in directory / failed: Permission denied (euid=248(<unknown>) egid=248(<unknown>) missing +x perm: /, we're not in group 202, dir owned by 0:202 mode=0750) Above appears in log, when I am trying to access filters configuration in RC or manually connecting to sieve using telnet. My DoveCot configuration: # 2.2.27 (c0f36b0): /usr/local/dovecot/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.15 (97b3da0) # OS: Linux 4.4.38 x86_64 Slackware 14.2 ext4 debug_log_path = /var/log/dovecot/dovecot-debug.log first_valid_gid = 12 first_valid_uid = 8 info_log_path = /var/log/dovecot/dovecot-info.log last_valid_gid = 12 last_valid_uid = 8 listen = *, [::] log_path = /var/log/dovecot/dovecot.log mail_location = maildir:/var/mail/%d/%n managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocols = imap pop3 sieve service auth { user = dovecot } service imap-login { user = dovecot } service pop3-login { user = dovecot } ssl_cert = </etc/letsencrypt/live/domain/fullchain.pem ssl_cipher_list = ALL:!ADH:!LOW:!SSLv2:!SSLv3:!EXP:!aNULL:+HIGH:+MEDIUM ssl_key = # hidden, use -P to show it userdb { driver = prefetch } verbose_proctitle = yes protocol pop3 { pop3_uidl_format = %08Xu%08Xv } What could be a reason of that? -- skype. kamil.kapturkiewicz tel/whatsapp. +44 758 306 8467

2 3

Re: Re: migrate Maildir to mdbox
by Joseph Tam 02 May '17

02 May '17

Michael Segel <dovecot_mjs(a)hotmail.com> writes: > Which is preferred? MailDir or Mbox? (directory vs flat file) Mailbox; I wish I converted when I had the chance. The only benefits I can see with mbox is that it's slightly less complicated, and if you're doing pattern searching or some global mailbox operation, less I/O intensive, but that's a niche case and usually ameliorated by indices. However, backing up mbox is a pain since changes results in the entire file being backed up for snapshotting filesystems, and atomicity of I/O operations is much harder. It just doesn't scale well for large mailboxes. As Aki recommends, use something other than mbox unless you got some legacy issue. > How would you do this when migrating from an old server to a new one? Lots of third party scripts out there that will convert for you. I think you can do dovecot->dovecot dsync to convert. Joseph Tam <jtam.home(a)gmail.com>

1 0

migrate Maildir to mdbox
by Tamas Papp 02 May '17

02 May '17

Hi, I replaced HDDs in my home server and reinstalled the OS (Ubuntu 17.04). Since I had some time I reviewed my Dovecot configuration and changed a couple of things, including mailbox format. Now I would like to migrate e-mail (about 20G -- I use this server as an e-mail archive). The Maildir is available on the (old) hard disk. The new dovecot is running. What should I use? Would mbsync work? I would prefer a solution that does not mess up the UUIDs, but I can live with that too. $ dovecot --version 2.2.27 (c0f36b0) Incidentally, would you recommend sdbox or mdbox? Lots of e-mails, many of them have large attachments. best, Tamas

4 4

Issue with parsing of forwarded messages with attachments and quotes in the subject
by Giovanni Salvatore Fois 02 May '17

02 May '17

Hi all, at work we use Roundcube acting as a mail client for the Dovecot Imap server. In Roundube the messages are parsed through the Imap BODYSTRUCTURE command If a message contains forwarded messages and attachments and some of the messages contains a quote (") in the subject, then the resulting BODYSTRUCTURE appears to be malformed. --- After some digging through the code of Dovecot, it seems to me that the problem is related to the function: imap_append_string_for_humans defined at the line 120 of the file src/lib-imap/imap-quote.c (dovecot sources v. 2.2.29) Said function is supposed to return a quoted version of the input string while removing unwanted characters from the input data. But, if I call it with a string containing quotes as argument (eg: I am a lazy " programmer) in the resulting output the quotes aren't escaped and the output string is not quoted. ---- This is related to the stated issue through the function calls in: part_write_body [ defined at line 142 of imap-bodystructure.c ] which calls imap_envelope_write [defined at line 46 of imap-envelope.c] which finally calls imap_append_string_for_humans ---- Thank you for your time. Best regards, Giovanni S. Fois

2 2

Dovecot 2.2 maildir replication issue
by Joelly Alexander 01 May '17

01 May '17

Hello, I'm just trying to setup two mailservers with dovecot 2.2, postfix, mysql, postfixadmin where i would like to sync the maildirs between them; I'm at the point where sending/receiving and qouta is working and try the maildir replication but it only creates the maildir directories (as example: /srv/vmail/test.domain/screenie/) on the second server but nothing inside the maildir is copied over; Both servers are setup identical except the things which have to be different (ssl certs and mail_replica node entries); This is what i'm getting in the log but stuck at: dsync-server(screenie(a)test.domain): Error: User has no home directory I assume it's the user_query in dovecot-sql.conf.ext but not 100% sure nor an idea to fix it; May 1 18:09:48 mx1 dovecot: doveadm(192.168.1.10,screenie(a)test.domain): Debug: auth input: user=screenie(a)test.domain May 1 18:09:48 mx1 dovecot: doveadm(192.168.1.10,screenie(a)test.domain): Debug: auth input: screenie(a)test.domain mail=maildir:/srv/vmail/test.domain/screenie/ quota_rule=*:bytes=102400000 uid=5000 gid=5000 May 1 18:09:48 mx1 dovecot: doveadm(192.168.1.10,screenie(a)test.domain): Debug: Added userdb setting: mail=maildir:/srv/vmail/test.domain/screenie/ May 1 18:09:48 mx1 dovecot: doveadm(192.168.1.10,screenie(a)test.domain): Debug: Added userdb setting: plugin/quota_rule=*:bytes=102400000 May 1 18:09:48 mx1 dovecot: doveadm(192.168.1.10,screenie(a)test.domain): Debug: Effective uid=5000, gid=5000, home= May 1 18:09:48 mx1 dovecot: doveadm(192.168.1.10,screenie(a)test.domain): Debug: Quota root: name=User Quota backend=dict args=:proxy::sqluserquota May 1 18:09:48 mx1 dovecot: doveadm(192.168.1.10,screenie(a)test.domain): Debug: Quota rule: root=User Quota mailbox=* bytes=102400000 messages=0 May 1 18:09:48 mx1 dovecot: doveadm(192.168.1.10,screenie(a)test.domain): Debug: Quota rule: root=User Quota mailbox=Trash bytes=+10240000 (10%) messages=0 May 1 18:09:48 mx1 dovecot: doveadm(192.168.1.10,screenie(a)test.domain): Debug: Quota grace: root=User Quota bytes=10240000 (10%) May 1 18:09:48 mx1 dovecot: doveadm(192.168.1.10,screenie(a)test.domain): Debug: dict quota: user=screenie(a)test.domain, uri=proxy::sqluserquota, noenforcing=0 May 1 18:09:48 mx1 dovecot: doveadm(192.168.1.10,screenie(a)test.domain): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/srv/vmail/test.domain/screenie/ May 1 18:09:48 mx1 dovecot: doveadm(192.168.1.10,screenie(a)test.domain): Debug: maildir++: root=/srv/vmail/test.domain/screenie, index=, indexpvt=, control=, inbox=/srv/vmail/test.domain/screenie, alt= May 1 18:09:48 mx1 dovecot: dsync-server(screenie(a)test.domain): Error: User has no home directory May 1 18:09:53 mx1 dovecot: doveadm(screenie(a)test.domain): Debug: auth input: user=screenie(a)test.domain May 1 18:09:53 mx1 dovecot: doveadm(screenie(a)test.domain): Debug: auth input: screenie(a)test.domain mail=maildir:/srv/vmail/test.domain/screenie/ quota_rule=*:bytes=102400000 uid=5000 gid=5000 May 1 18:09:53 mx1 dovecot: doveadm(screenie(a)test.domain): Debug: Added userdb setting: mail=maildir:/srv/vmail/test.domain/screenie/ May 1 18:09:53 mx1 dovecot: doveadm(screenie(a)test.domain): Debug: Added userdb setting: plugin/quota_rule=*:bytes=102400000 May 1 18:09:53 mx1 dovecot: doveadm(screenie(a)test.domain): Debug: Effective uid=5000, gid=5000, home= May 1 18:09:53 mx1 dovecot: doveadm(screenie(a)test.domain): Debug: Quota root: name=User Quota backend=dict args=:proxy::sqluserquota May 1 18:09:53 mx1 dovecot: doveadm(screenie(a)test.domain): Debug: Quota rule: root=User Quota mailbox=* bytes=102400000 messages=0 May 1 18:09:53 mx1 dovecot: doveadm(screenie(a)test.domain): Debug: Quota rule: root=User Quota mailbox=Trash bytes=+10240000 (10%) messages=0 May 1 18:09:53 mx1 dovecot: doveadm(screenie(a)test.domain): Debug: Quota grace: root=User Quota bytes=10240000 (10%) May 1 18:09:53 mx1 dovecot: doveadm(screenie(a)test.domain): Debug: dict quota: user=screenie(a)test.domain, uri=proxy::sqluserquota, noenforcing=0 May 1 18:09:53 mx1 dovecot: doveadm(screenie(a)test.domain): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/srv/vmail/test.domain/screenie/ May 1 18:09:53 mx1 dovecot: doveadm(screenie(a)test.domain): Debug: maildir++: root=/srv/vmail/test.domain/screenie, index=, indexpvt=, control=, inbox=/srv/vmail/test.domain/screenie, alt= May 1 18:09:53 mx1 dovecot: doveadm(screenie(a)test.domain): Debug: Namespace : Using permissions from /srv/vmail/test.domain/screenie: mode=0700 gid=default May 1 18:09:53 mx1 dovecot: dsync-local(screenie(a)test.domain): Error: User has no home directory root@mx1:/# dovecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-48-pve x86_64 Debian 8.7 simfs auth_mechanisms = plain login dict { sqluserquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } doveadm_password = password doveadm_port = 64500 mail_debug = yes mail_location = maildir:/srv/vmail/%d/%n/maildir mail_plugins = " notify quota replication zlib" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_replica = tcp:mx2:64500 quota = dict:User Quota::proxy::sqluserquota quota_rule2 = Trash:storage=+10%% sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve pop3" service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service config { unix_listener config { user = vmail } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service doveadm { inet_listener { port = 64500 ssl = no } user = vmail } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl_cert = </etc/ssl/certs/mx1.pem ssl_key = </etc/ssl/private/mx1.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " notify quota replication zlib quota" } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = " notify quota replication zlib quota" } protocol imap { mail_plugins = " notify quota replication zlib imap_quota" } protocol pop3 { mail_plugins = " notify quota replication zlib" } root@mx1:/# root@mx1:/etc/dovecot# grep -v '^ *$#.*$\?$' dovecot-sql.conf.ext driver = mysql connect = host=127.0.0.1 dbname=mailserver user=vmail password=password default_pass_scheme = SHA512-CRYPT password_query = SELECT CONCAT('*:bytes=', quota) AS userdb_quota_rule, password FROM mailbox WHERE username = '%u' user_query = SELECT CONCAT('maildir:/srv/vmail/',maildir) AS mail, CONCAT('*:bytes=', quota) AS quota_rule, 5000 AS uid, 5000 AS gid FROM mailbox WHERE username = '%u' iterate_query = SELECT username AS user FROM mailbox WHERE active = '1'; root@mx1:/etc/dovecot# thx, screenie

1 0

most secure password scheme
by David Mehler 30 Apr '17

30 Apr '17

Hello, I have a few questions on password schemes. Is SHA512 the most secure? Is there a difference between SHA512 and SHA512-CRYPT? What about SSHA512 and SSH512-CRYPT? Is there a problem with this sql statement: UPDATE virtual_users SET password=CONCAT(‘{SHA256-CRYPT}’, ENCRYPT (‘Password Goes Here’, CONCAT(‘$5$’, SUBSTRING(SHA(RAND()), -16)))) WHERE user=’user(a)example.xn--com-to0a; I'm getting an error 1064 at the ending email address. Thanks. Dave.

3 4

IMAP hibernate and scalability in general
by Christian Balzer 30 Apr '17

30 Apr '17

Hello, as some may remember, we're running very dense IMAP cluster here, in excess of 50k IMAP sessions per node (current record holder is 68k, design is for 200k+). The first issue we ran into was that the dovecot master process (which is single thread and thus a bottleneck) was approaching 100% CPU usage (aka using a full core) when trying to spawn off new IMAP processes. This was rectified by giving IMAP a service count of 200 to create a pool of "idling" processes eventually, reducing the strain for the master process dramatically. That of course required generous cranking up ulimits, FDs in particular. The next issues of course is (as mentioned before) the memory usage of all those IMAP processes and the fact that quite a few things outside of dovecote (ps, etc) tend to get quite sedate when dealing with tens of thousands of processes. We just started to deploy a new mailbox cluster pair with 2.2.27 and having IMAP hibernate configured. Getting this work is a PITA though with regards to ownership and access rights to the various sockets, this part could definitely do with some better (I know, difficult) defaults or at least more documentation (none besides the source and this ML). Initial results are very promising, depending on what your clients are doing (are they well behaved, are your users constantly looking at other folders, etc) the vast majority of IDLE processes will be in hibernated at any given time and thus not only using a fraction of the RAM otherwise needed but also freeing up process space. Real life example: 240 users, 86 imap processes (80% of those not IDLE) and: dovecot 119157 0.0 0.0 10452 3236 ? S Apr01 0:21 dovecot/imap-hibernate [237 connections] That's 237 hibernated connections and thus less processes than otherwise. I assume that given the silence on the ML what we are going to be the first hibernate users where the term "large scale" does apply. Despite that I have some questions, clarifications/confirmations: Our current default_client_limit is 16k, which can be seen by having 5 config processes on our 65k+ session node. ^_- This would also apply to imap-hibernate, one wonders if that's fine (config certainly has no issues) or if something smaller would be appropriate here? Since we have idling IMAP processes around most of the time, the strain of re-spawning proper processes from imap-hibernate should be just as reduced as for the dovecot master, correct? I'll keep reporting our experiences here, that is if something blows up spectacularly. ^o^ Christian -- Christian Balzer Network/Systems Engineer chibi(a)gol.com Global OnLine Japan/Rakuten Communications http://www.gol.com/

4 16

Re: Dovecot last_login plugin and Mysql
by David Mehler 29 Apr '17

29 Apr '17

Hi, Thanks for the pointing out of the oops! I missed that. Don't worry that has been changed. Any suggestions on my issue? Thanks. Dave. On 4/28/17, David Mehler <dave.mehler(a)gmail.com> wrote: > Hi, > > OOPS! I missed that one and it was big. > > Changing now. > > Thanks. > Dave. > > > On 4/28/17, Noel Butler <noel.butler(a)ausics.net> wrote: >> ummmmmm >> >> It's usually a good idea to redact user and passwords for databases, >> even if only local socket ;) >> >> I suggest you change it ASAP. >> >> On 29/04/2017 10:53, David Mehler wrote: >> >>> Hello, >>> >>> Here is the requested file: >>> >>> driver = mysql >>> connect = host=/tmp/mysql.sock dbname=mail user=mail_admin >>> password=MainBoard55 >>> >>> # Last Login >>> map { >>> pattern = shared/last-login/$user >>> table = virtual_users >>> username_field = user >>> value_field = lastlogin >>> fields { >>> user = $user >>> } >>> } >>> >>> Thanks. >>> Dave. >>> >>> On 4/28/17, Aki Tuomi <aki.tuomi(a)dovecot.fi> wrote: >>> On April 29, 2017 at 12:29 AM David Mehler <dave.mehler(a)gmail.com> >>> wrote: >>> >>> Hello, >>> >>> Trying to implement lastlogin via mysql. I'm getting an unknown column >>> username which I don't get. Here's the log: >>> >>> Apr 28 17:18:15 ohio dovecot: imap-login: Login: >>> user=<user(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, >>> mpid=16257, secured, session=<KxiSnEBOwUx/AAAB> >>> >>> Apr 28 17:18:15 ohio dovecot: dict(17099): Error: sql dict: commit >>> failed: Unknown column 'username' in 'field list' >>> >>> Apr 28 17:18:15 ohio dovecot: imap(user(a)example.com): Error: >>> dict-client: server returned failure: 1493414295 (reply took 0.026 >>> secs) >>> >>> Apr 28 17:18:15 ohio dovecot: imap(user(a)example.com): Error: >>> last_login_dict: Failed to write value for user user(a)example.com >>> >>> You can configure all this in dovecot-dict-sql.conf, which you have not >>> provided. The actual column names are defined there. >>> >>> Aki >> >> -- >> Kind Regards, >> >> Noel Butler >> >> This Email, including any attachments, may contain legally privileged >> information, therefore remains confidential and subject to copyright >> protected under international law. You may not disseminate, discuss, or >> reveal, any part, to anyone, without the authors express written >> authority to do so. If you are not the intended recipient, please notify >> the sender then delete all copies of this message including attachments, >> immediately. Confidentiality, copyright, and legal privilege are not >> waived or lost by reason of the mistaken delivery of this message. Only >> PDF [1] and ODF [2] documents accepted, please do not send proprietary >> formatted documents >> >> >> >> Links: >> ------ >> [1] http://www.adobe.com/ >> [2] http://en.wikipedia.org/wiki/OpenDocument >

2 1