- dovecot - dovecot.org

Sql user and maildirs
by ＠lbutlr 10 Jun '19

10 Jun '19

For many years I had the following in my dovecot.conf: userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext default_fields = uid=vpopmail gid=vchkpw mail_location=/usr/local/virtual/%u/Maildir mail=maildir:/usr/local/virtual/%u/Maildir driver = sql } Recently, I started having quite a lot of errors on one MySQL account (used as a bcc backup account) along the lines of Fatal: Namespace '': Ambiguous mail location setting, don't know what to do with it: /usr/local/virtual/backup@domain/Maildir (try prefixing it with mbox: or maildir: Messages were sitting in the mail and were also getting dumped into /usr/local/virtual/backup@domain/new and I ended up running a fun little awk to move them into the right folders: grep -r "<backup+" . |awk -F: '{t=tolower($2); f=tolower($1); gsub(/@.*/, "/", t); sub(/<backup\+/, "../Maildir/", t); sub(/\.\//, "",f); cmd="mv " f" “t; system(cmd); }’ So I changed my doevecot.conf to: userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext default_fields = uid=vpopmail gid=vchkpw mail_location=maildir:/usr/local/virtual/%u/Maildir mail=maildir:/usr/local/virtual/%u/Maildir driver = sql } And the errors went away. So, no problem here to solve, but I am curious why I haven’t been having issues until quite recently? Was there a change or have I stumbled into something where it only looks like I’ve fixed the issue? In case it matters? # cat dovecot-sql.conf.ex [7:57] [/etc/dovecot] driver = mysql connect = host=localhost dbname=postfixusers user=dovecot password=x default_pass_scheme = SHA256-CRYPT password_query = select password FROM mailbox where username ='%u' user_query = select 89 as uid, 89 as gid, concat('/usr/local/virtual/', maildir, 'Maildir') as home FROM mailbox where username = '%u' The only ‘recent’ change I’ve made to my configuration was creating the Maildir/ subfolder for all the virtual users instead of using the ‘mailder’ from the sql table (that is, I added “, ‘Maildir’” to the concat, but that was quite awhile ago. I’m pretty sure I’d have noticed this before. Is that user_query as it should be or should I set concat('/usr/local/virtual/', maildir) as home and also set concat(‘maildir:/usr/local/virtual/', maildir, 'Maildir') as mail here rather than in the userdb block? -- K is for KATE who was struck by an axe L is for Leo who swallowed some tacks

1 1

Re: doveconf complains No matches on !include conf.d/* line but still writes out contents in conf.d
by Ben Ma 10 Jun '19

10 Jun '19

Further investigation shows that `doveconf` called `/usr/lib/dovecot/managesieve` which in return calls `doveconf` again, but with another uid (possible? I'm not sure) and a few extra arguments, which causes a call to `glob` in `src/config/config-parser.c:settings_include` to fail with `GLOB_NOMATCH`. I'd be appreciate if anyone can provide information on suspicious permission-relating operation that `managesieve` does before calling `doveconf`. I just can't find a way to post reply on previous mails, so I decided to post a new one. The original text follows. On 2019/6/6 3:15, Ben Ma wrote: > I'm on dovecot 2.3.3 (dcead646b). Output of `dovecot -n`: > > # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # Pigeonhole version > 0.5.3 (f018bbab) doveconf: Fatal: Error in configuration file > /etc/dovecot/dovecot.conf line 98: No matches doveconf: Error: > managesieve-login: dump-capability process returned 89 doveconf: > Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 98: > No matches > > While line 98 of dovecot.conf is just "!include conf.d/*.conf". > > Output of `doveconf -n`: > > # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # Pigeonhole version > 0.5.3 (f018bbab) doveconf: Fatal: Error in configuration file > /etc/dovecot/dovecot.conf line 98: No matches doveconf: Error: > managesieve-login: dump-capability process returned 89 # OS: Linux > 4.12.14-lp151.28.4-default x86_64 # Hostname: XXX doveconf: Error: > t_readlink(/var/run/dovecot/dovecot.conf) failed: readlink() failed: > No such file or directory namespace inbox { ............. (Removed for > simplicity) } ssl = required ssl_cert = > </etc/postfix/ssl/certs/phys.cer ssl_options = no_compression > ssl_prefer_server_ciphers = yes userdb { driver = passwd } > > It's strange that all the extra content (especially ssl conf) only > occurs in conf.d/10-ssl.conf. > > To dig on what's happening underneath I ran `strace doveconf -n 2>&1 > |egrep "\.conf|conf\.d"` and got: > > write(1, "# 2.3.3 (dcead646b): /etc/doveco"..., 47# 2.3.3 (dcead646b): > /etc/dovecot/dovecot.conf openat(AT_FDCWD, > "/etc/dovecot/dovecot.conf", O_RDONLY) = 7 wait4(-1, doveconf: Fatal: > Error in configuration file /etc/dovecot/dovecot.conf line 98: No > matches open("/etc/dovecot/conf.d", > O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 8 openat(AT_FDCWD, > "/etc/dovecot/conf.d/90-sieve.conf", O_RDONLY) = 8 ............. > (Removed for simplicity) openat(AT_FDCWD, > "/etc/dovecot/conf.d/10-ssl.conf", O_RDONLY) = 20 openat(AT_FDCWD, > "/etc/dovecot/conf.d/10-auth.conf", O_RDONLY) = 25 > stat("/etc/dovecot/conf.d/auth-system.conf.ext", > {st_mode=S_IFREG|0644, st_size=2182, ...}) = 0 openat(AT_FDCWD, > "/etc/dovecot/conf.d/auth-system.conf.ext", O_RDONLY) = 26 > stat("/etc/dovecot/local.conf", 0x7ffd94664760) = -1 ENOENT (No such > file or directory) stat("/etc/resolv.conf", {st_mode=S_IFREG|0644, > st_size=709, ...}) = 0 open("/etc/host.conf", O_RDONLY|O_CLOEXEC) = 7 > read(7, "#\n# /etc/host.conf - resolver co"..., 4096) = 370 > open("/etc/resolv.conf", O_RDONLY|O_CLOEXEC) = 7 read(7, "### > /etc/resolv.conf is a symlin"..., 4096) = 709 > readlink("/var/run/dovecot/dovecot.conf", 0x5555db302598, 128) = -1 > ENOENT (No such file or directory) write(2, "doveconf: Error: > t_readlink(/var"..., 112doveconf: Error: > t_readlink(/var/run/dovecot/dovecot.conf) failed: readlink() failed: > No such file or directory > > It seems that files in conf.d is never read before doveconf's > complaint! I have totally no idea why this happens. Any help?

1 0

sieve setup. no svbin ?
by Voytek Eymont 09 Jun '19

09 Jun '19

since moving/upgrading system I've noticed I no longer get sieve script compiled, there is no dovecot.svbin created in /var/vmail/vmail1/sbt.net.au/voytek(a)tld.au/sieve what am I missing, how to check ? also, looking at sieve.log, I see a lot of May 31 06:32:50 lda(voytek(a)sbt.net.au)<1234><c4aVBfI98FzSBAAAyLbbsQ>: Error: sieve: Failed to initialize script execution: Invalid postmaster_address: invalid address `root' specified for the postmaster_address setting # grep root dovecot.conf postmaster_address = root what should I have ? # dovecot --version 2.3.6 (7eab80676)

2 5

FTS Xapian
by Daniel Miller 09 Jun '19

09 Jun '19

For my primary namespace this is working fine - thanks to the developers! It also appears to work great for shared folders as well. But my virtual folders aren't returning results - at least not to the client. The logs show FTS Xapian opening several DB files and getting results - but nothing is being returned to client. Is this a config issue on my side or is this a current limitation of the plugin? -- Daniel

2 5

Last Login Plugin Help
by Júlio Covolato 07 Jun '19

07 Jun '19

Hi, I'm configuring Last_Login plugin whith Mysql back end and all works fine. I just wonder to track besides time_stamp, user and domain, the remote IP and proto (imap or pop3) I tried in dovecot.conf: plugin { ... ... # Track last login time on imap and pop3 last_login_dict = proxy::lastlogin last_login_key = last-login/%u/%d/%r } dict { ... lastlogin = mysql:/etc/dovecot/dovecot-last-login.conf ... } protocol imap { mail_plugins = $mail_plugins ... last_login ... } protocol pop3 { mail_plugins = $mail_plugins last_login ... } And dovecot-last-login.conf: connect = host=127.0.0.1 port=3306 dbname=vmail user=vmailadmin password=xxxxxxxxxxxxxxxxxx map { pattern = shared/last-login/$user/$domain table = last_login value_field = last_login value_type = uint fields { username = $user domain = $domain rip = $rip } } And the table criated in mysql: CREATE TABLE IF NOT EXISTS `last_login` ( `username` VARCHAR(255) NOT NULL DEFAULT '', `domain` VARCHAR(255) NOT NULL DEFAULT '', `last_login` INT(11) DEFAULT NULL, `rip` VARCHAR(16) NOT NULL DEFAULT '', PRIMARY KEY (`username`), INDEX (`domain`), INDEX (`last_login`), INDEX (`rip`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8; And got de error in dovecot log: Jun 06 13:56:59 dict(21157): Error: Failed to initialize dictionary 'lastlogin': dict mysql: Error in configuration file /etc/dovecot/dovecot-last-login.conf line 13: Unused variable: rip Thanks in any help. -- ---------------------------------- _ Engº Julio Cesar Covolato 0v0 <julio(a)psi.com.br> /(_)\ F: +55 11 99175-9260 ^ ^ PSI INTERNET ---------------------------------- --- Este email foi escaneado pelo Avast antivírus. https://www.avast.com/antivirus

2 3

doveconf complains No matches on !include conf.d/* line but still writes out contents in conf.d
by runappz 05 Jun '19

05 Jun '19

I'm on dovecot 2.3.3 (dcead646b). Output of `dovecot -n`: # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.3 (f018bbab) doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 98: No matches doveconf: Error: managesieve-login: dump-capability process returned 89 doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 98: No matches While line 98 of dovecot.conf is just "!include conf.d/*.conf". Output of `doveconf -n`: # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.3 (f018bbab) doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 98: No matches doveconf: Error: managesieve-login: dump-capability process returned 89 # OS: Linux 4.12.14-lp151.28.4-default x86_64 # Hostname: XXX doveconf: Error: t_readlink(/var/run/dovecot/dovecot.conf) failed: readlink() failed: No such file or directory namespace inbox { ............. (Removed for simplicity) } ssl = required ssl_cert = </etc/postfix/ssl/certs/phys.cer ssl_options = no_compression ssl_prefer_server_ciphers = yes userdb { driver = passwd } It's strange that all the extra content (especially ssl conf) only occurs in conf.d/10-ssl.conf. To dig on what's happening underneath I ran `strace doveconf -n 2>&1 |egrep "\.conf|conf\.d"` and got: write(1, "# 2.3.3 (dcead646b): /etc/doveco"..., 47# 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf openat(AT_FDCWD, "/etc/dovecot/dovecot.conf", O_RDONLY) = 7 wait4(-1, doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 98: No matches open("/etc/dovecot/conf.d", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 8 openat(AT_FDCWD, "/etc/dovecot/conf.d/90-sieve.conf", O_RDONLY) = 8 ............. (Removed for simplicity) openat(AT_FDCWD, "/etc/dovecot/conf.d/10-ssl.conf", O_RDONLY) = 20 openat(AT_FDCWD, "/etc/dovecot/conf.d/10-auth.conf", O_RDONLY) = 25 stat("/etc/dovecot/conf.d/auth-system.conf.ext", {st_mode=S_IFREG|0644, st_size=2182, ...}) = 0 openat(AT_FDCWD, "/etc/dovecot/conf.d/auth-system.conf.ext", O_RDONLY) = 26 stat("/etc/dovecot/local.conf", 0x7ffd94664760) = -1 ENOENT (No such file or directory) stat("/etc/resolv.conf", {st_mode=S_IFREG|0644, st_size=709, ...}) = 0 open("/etc/host.conf", O_RDONLY|O_CLOEXEC) = 7 read(7, "#\n# /etc/host.conf - resolver co"..., 4096) = 370 open("/etc/resolv.conf", O_RDONLY|O_CLOEXEC) = 7 read(7, "### /etc/resolv.conf is a symlin"..., 4096) = 709 readlink("/var/run/dovecot/dovecot.conf", 0x5555db302598, 128) = -1 ENOENT (No such file or directory) write(2, "doveconf: Error: t_readlink(/var"..., 112doveconf: Error: t_readlink(/var/run/dovecot/dovecot.conf) failed: readlink() failed: No such file or directory It seems that files in conf.d is never read before doveconf's complaint! I have totally no idea why this happens. Any help?

1 0

Re: Potfix+Dovecot with dsync replication problem
by Zeljko Dokman 05 Jun '19

05 Jun '19

Hi all, I am still struggling with this issue. I scraped my previous configuration and started from beginning. Thanks to Aki Tuomi and his suggestion I changed the users in my configurations from vmail --> root and that helped. Now I have a working replication but with some problems and strange behavior. Replication works only when I manually execute a command: "doveadm sync -A tcp:secundary:server:12345" Automatic fast and full sync do not work: doveadm replicator status "*" username priority fast sync full sync success sync failed zdokman none 01:46:14 01:46:14 01:46:14 - doveadm replicator status Queued 'sync' requests 0 Queued 'high' requests 0 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 0 Waiting 'failed' requests 0 Total number of known users 1 doveadm replicator dsync-status username type status - Not connected maillog has no error entries. my conf files are attached. I don't understand why is this happening and how to fix it, any help is much appreciated. Best regards, On Mon, 13 May 2019 at 15:23, Zeljko Dokman <zdokman(a)gmail.com> wrote: > Hi, > Thank you for your reply Aki. > I changed my configuration and substituted vmail user with root user. > > Now I have no error massages in maillog but replication is not working, > mails are not visible on second server. > > BR > > > > > > On Mon, 13 May 2019 at 10:50, Aki Tuomi <aki.tuomi(a)open-xchange.com> > wrote: > >> Your problem is that you are running service doveadm as vmail, but you >> are using real uids. You need to start doveadm server as root to be able to >> switch into the correct target user. >> >> Aki >> >> >> On 13.5.2019 11.26, Zeljko Dokman via dovecot wrote: >> >> Hi all, >> >> Any suggestion? >> >> BR >> >> On Mon, 6 May 2019 at 14:22, Zeljko Dokman <zdokman(a)gmail.com> wrote: >> >>> Hi all, >>> >>> I am in need of some help. >>> >>> Straggling to make something work, trying to configure postfix and >>> dovecote imap server with dovecote replication. >>> >>> Can’t figure out what is wrong with my configuration. >>> >>> >>> >>> Replication is working only for vmail user account, I am getting this >>> error on my secondary server for all other users… >>> >>> >>> >>> dovecot: doveadm: Fatal: setgid(4015(zdokman) from userdb lookup) failed >>> with euid=5000(vmail), gid=5000(vmail), egid=5000(vmail): Operation not >>> permitted (This binary should probably be called with process group set to >>> 4015(zdokman) instead of 5000(vmail)) >>> >>> >>> >>> primary server reports this error: >>> >>> >>> >>> dovecot: doveadm(zdokman): Error: doveadm server disconnected before >>> handshake: EOF >>> >>> dovecot: doveadm(zdokman): Error: sync: Disconnected from remote: EOF >>> >>> >>> >>> >>> >>> doveadm replicator status '*' >>> >>> username >>> priority fast sync full sync success sync failed >>> >>> vmail >>> none 01:58:13 02:05:25 01:58:13 - >>> >>> zdokman >>> none 00:00:25 02:55:26 - y >>> >>> test >>> none 00:01:00 21:48:13 - y >>> >>> >>> >>> doveadm sync * >>> >>> doveadm(root): Fatal: execvp(Maildir) failed: Permission denied >>> >>> dsync-local(root): Error: read(remote) failed: EOF (version not received) >>> >>> >>> >>> I am attaching my dovecot.conf main.cf and master.cf. >>> >>> >>> >>> I think my problem is with permissions but I can figure out how to >>> workaround it. >>> >>> >>> >>> Best regards >>> >> >> >> -- >> >> >> >> >> >> > > -- > > > > > --

1 1

Stats/Metrics in 2.3
by Nikolai Lusan 03 Jun '19

03 Jun '19

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Greetings, So the changes to the stats modules between v2.2 and v2.3 have broken some of my monitoring. I am attempting to use the new method of gathering "metrics" from "events" - but the details in the documentation are a bit thin. I started with the examples provided at https://wiki2.dovecot.org/Statistics and tried to build from there with only moderate success. What I am trying to achieve is the monitoring of login attempts (with successes and failures as separate modules - as well as aborted attempts), user sessions an bytes transferred. All this for multiple virtual domains and users. I have attached my current /etc/dovecot/conf.d/10-stats.conf so people can see what I have attempted so far. Based on that file the output I get is: # doveadm stats dump metric_name field count sum min max avg median stddev %95 imap_login_attempt_lusan.id.au duration 0 0 0 0 0.00 0 0.00 0 imap_login_lusan.id.au_failed duration 0 0 0 0 0.00 0 0.00 0 imap_login_lusan.id.au_success duration 0 0 0 0 0.00 0 0.00 0 imap_select_no duration 702 197998 89 13942 282.05 133 1247.14 278 imap_select_no_notfound duration 702 197998 89 13942 282.05 133 1330.67 285 imap_command_list duration 14 287397 17595 25823 20528.36 20060 2194.36 25823 imap_command_select duration 1593 2354698 355 81662 1478.15 743 4583.03 4460 imap_command_search duration 0 0 0 0 0.00 0 0.00 0 imap_command_fetch_ok duration 0 0 0 0 0.00 0 0.00 0 storage_http_gets duration 0 0 0 0 0.00 0 0.00 0 Based on the metrics I have set I would expect to see entries in the first 2 lines at least, given that there are multiple users logged into the server from the monitored domain (or at least the domain I am trying to monitor to begin with). I am also not sure how to get the session and data transfer information out of the metrics/stats system. If anyone can help me I would appreciate it. Thanks - -- Nikolai Lusan <nikolai(a)lusan.id.au> -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEVfd4GW6z4nsBxdLo4ZaDRV2VL6QFAlzz29EACgkQ4ZaDRV2V L6QnIg/8CcB4V/69QSn+zqNhGNX2sHApoaGK0zCt7ITthOlDDVsdVKNT48hxJ3AR uEtoDQL9g3jcDJOQplsobDXmcs/Z6Po275T++8+CY0Bl5iqWO0/6g5LSvNDi6VlS VZzdLyDvAT0+oemaeTHgT/zPwx2waCrs84ZVwMCnuNVQKlE8l05gV2r6aLpgkRFf /Pc6zBwNEXGdthTcnowV2yPiYZkp87jaEl6+4RcHQcYQO1/Q/JEl38/iYlPWdVFZ NVOHpmzZdY9tGRhN0lqiUgivPLZu7gYyfzBeO6JHDOajLUNFW1NR7aKKhyALEOgM GZmjgSODzLjLw8CYx8iGnyMGRsEBDk+NLrJ1zjDqN+xIZkoUcnjkqwpNzurMIW4c kAkFDaPjquXu9eFy4T6V+r23p9E0z0IcWqTFfUyHkdctQApvkjLBFxoc35Abp1Yy I6LzGlGRmiV2Z2HNQYNM3n0w2O+tl4lDpLDN1UCialzfFO81fbHfopk/f9+RHt7b LHy1gTNrUwnLS+3Lobt5p179zNw3C9gtDMdgq355WC/B8jYYJGrw4Y0Jwh7WoyMF w1lPPEByeGTEl/P4zxegKz7oHL+DDBw9BdRdREJ3praUYAVtnMrZgJCJTS0qGh3Z 3m2wCF6yRSwGG8QkwsmoeIF2A6HwjnXcDWHWbOwkkDwh705BUXo= =QfOl -----END PGP SIGNATURE-----

4 6

Mailman option "Set Reply-To header to list" unavailable
by Ralph Seichter 01 Jun '19

01 Jun '19

Looking at https://dovecot.org/mailman/options/dovecot I see that the option "Set Reply-To header to list?" does not accept any changes from me. I assume this might be related to DMARC related header mangling that was discussed at length before. While I do not want to open that particular can of worms again, I would like to force Reply-To: dovecot(a)dovecot.org for my own (!) postings to this mailing list. I actually set this header in my MUA when I post to the Dovecot ML, but it gets overwritten to include my own sender address in Reply-To, which is not what I want. Is there something I can do on my end to ensure that replies get sent to the list only? If not, Is this something the list owners can set for me? Thanks, Ralph

2 1

[mail-crypt-plugin] Private key location in Folder Key Mode
by emordin 01 Jun '19

01 Jun '19

Nice. It worked but I think there is a little output error (probably not a big issue): When I type the following command I get this output: user'@'host:~$ doveadm -o plugin/mail_crypt_private_private_password=1234 mailbox cryptokey export -u username -U /var/vmail/domain/username/Maildir/dovecot-attributes Folder: Public ID: <Public key ID> Error: -----BEGIN PRIVATE KEY----- <private_key> -----END PRIVATE KEY----- And when I type the following command I get this output: user'@'host:~$ doveadm mailbox cryptokey export -u username -U /var/vmail/domain/username/Maildir/dovecot-attributes Folder: Public ID: <Public key ID> Error: ERROR: error:03070068:bignum routines:BN_mpi2bn:encoding error Key: So in the first command the private key shows but it's under Error, and I believe it should be under Key. Thanks again. Sent with [ProtonMail](https://protonmail.com) Secure Email.

1 0