July 2017 - dovecot - dovecot.org

Dovecot user lookup from sendmail
by Garry Glendown 06 Jul '17

06 Jul '17

Hi * after trying everything I could think of and find on the web, I'm totally stumped ... maybe someone give me some hints on what I'm doing wrong, or where to look ... I have an ancient customer box with sendmail & cyrus imap, with imap using an LDAP database of users (no locally configured users), all of which is working fine. This machine needs to be replaced by a new installation, which - regrettably - is supposed to use SLES 12. Which does not have any Cyrus IMAP packages available anymore, so I had to use the Dovecot imap instead. I've already got the LDAP auth working, as well as the imap storage of mails (used imapsync to copy all of the old mailboxes to the new machine), everything fine so far. Anyway, I'm running into problems getting sendmail to check whether a recipient actually exists. Any local user is correctly identified, but all virtual users are constantly rejected. I tried finding anything on how sendmail actually does the user check ... on the cyrus install, all I had to do is define(`confLOCAL_MAILER',`cyrusv2')dnl define(`CYRUSV2_MAILER_ARGS',`FILE /var/lib/imap/socket/lmtp')dnl MAILER(cyrusv2)dnl and both user checks and local delivery worked. What's the appropriate config entry in the .mc for dovecot? I tried settings like: FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp')dnl and used the dovecot.m4 file together with MAILER(`dovecot')dnl but couldn't see anything happening - or improve. Hints and help greatly appreciated! -garry -- PGP Fingerprint: A79F A33F 5B13 BEB7 A51D 274F F99C 3AE2 4BCB 7015

4 4

Re: Dovecot user lookup from sendmail
by Joseph Tam 06 Jul '17

06 Jul '17

Garry Glendown <garry(a)glendown.de> writes: > Anyway, I'm running into problems getting sendmail to check whether a > recipient actually exists. Any local user is correctly identified, but > all virtual users are constantly rejected. I tried finding anything on > how sendmail actually does the user check ... on the cyrus install, all > I had to do is > > define(`confLOCAL_MAILER',`cyrusv2')dnl > define(`CYRUSV2_MAILER_ARGS',`FILE /var/lib/imap/socket/lmtp')dnl > MAILER(cyrusv2)dnl It's unclear what you mean when you say "problems getting sendmail to check whether a recipient actually exists". Are you saying 1) During SMTP delivery, sendmail complains a user is unknown? RCPT TO:<user@domain> 550 5.1.1 <user@domain>... User unknown In this case, it has nothing to do with dovecot. You'll have to check your sendmail configs on user map lookups. 2) The LMTP can't deliver to a user's INBOX? If this is what you're complaining about, you ought to supply i) log entries demonstrating the problem ii) a hint of your configuration i.e. doveconf -n Joseph Tam <jtam.home(a)gmail.com>

1 0

gzip compressed mbox: Panic: file istream-zlib.c: line 421 (i_stream_zlib_seek): assertion failed: (ret == -1)
by Anton Yuzhaninov 05 Jul '17

05 Jul '17

Hello, I use mbox compressed by gzip as read-only folder (using zlib plugin). I have errors in logs: Panic: file istream-zlib.c: line 416 (i_stream_zlib_seek): assertion failed: (ret == -1) and can't read messages in MUA. IMAP commands to reproduce a bug: 1 SELECT "compressed.gz" 2 UID fetch 2 BODY.PEEK[] # sleep 5 3 UID fetch 2 BODY.PEEK[] # repeat sleep/fetch until assert (a few fetches need to trigger bug, probably because of caching) The bug appeared in 2.2.26 and still can be reproduced (in 2.2.31) Using 'git bisect' was not productive (a lot of build errors), but I've found that reverting this commit: https://github.com/dovecot/core/commit/6a1110d8757bb72fd90f4fe0857fd3aeaf89… "fixes" problem for me, so I suppose the bug was introduced in this commit. -- Best Regards, Anton Yuzhaninov

2 4

how to make user iteration work (ldap)
by mj 04 Jul '17

04 Jul '17

Hi, User iteration doesn't work, we're getting: > auth: Error: Trying to iterate users, but userdbs don't support it The way I understand it, I need to set iterate_attrs and iterate_filter for iteration to work. I have set it, and yet it does't work with the above failure. Our config is against ldap (active directory) and generdoveadm user -u "*" oalally works fine. Can anyone here take a quick look, and tell me how to make > doveadm user -u "*" work? Below are the required configs. Any tips would be appreciated...! MJ > root@dovetest:/etc/dovecot# doveconf -n > # 2.2.26.0 (23d1de6): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.16 (fed8554) > # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.7 xfs > auth_debug = yes > auth_debug_passwords = yes > auth_failure_delay = 400 secs > auth_master_user_separator = * > auth_mechanisms = plain login > auth_username_format = %Ln > auth_verbose = yes > auth_verbose_passwords = plain > debug_log_path = /var/log/dovecot/dovecot.debug > deliver_log_format = %f | %s | msgid=%m: %$ > disable_plaintext_auth = no > info_log_path = /var/log/dovecot/dovecot.info > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > log_path = /var/log/dovecot/dovecot.err > login_greeting = Dovecot ready. > mail_gid = vmail > mail_location = maildir:/var/vmail/%Ln/Maildir:LAYOUT=fs:DIRNAME=mAildir > mail_plugins = acl lazy_expunge zlib quota mail_log notify > mail_uid = vmail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave > namespace { > list = children > location = maildir:/var/vmail/%%u/Maildir:LAYOUT=fs:DIRNAME=mAildir:INDEX=/var/vmail/%u/shared/%%u > prefix = shared/%%n/ > separator = / > subscriptions = no > type = shared > } > namespace inbox { > inbox = yes > location = > mailbox "Deleted items" { > special_use = \Trash > } > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent items" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > mailbox inbox { > auto = subscribe > } > prefix = > separator = / > type = private > } > passdb { > args = /etc/dovecot/master-users > driver = passwd-file > master = yes > } > passdb { > args = failure_show_msg=yes dovecot > driver = pam > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > skip = authenticated > } > plugin { > acl = vfile > acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db > mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename append > mail_log_fields = uid box msgid from subject > quota = maildir > quota_rule = ?:storage=5G > quota_rule2 = Trash:storage=+100M > quota_warning = storage=97%% quota-warning 97 %u > quota_warning2 = storage=95%% quota-warning 95 %u > quota_warning3 = storage=90%% quota-warning 90 %u > quota_warning4 = storage=85%% quota-warning 85 %u > quota_warning5 = storage=80%% quota-warning 80 %u > quota_warning6 = -storage=100%% quota-warning below %u > sieve = ~/.dovecot.sieve > sieve_default = /var/lib/dovecot/default.sieve > sieve_dir = ~/sieve > } > protocols = imap lmtp sieve > service auth { > unix_listener /var/spool/postfix/private/auth { > mode = 0666 > } > unix_listener auth-userdb { > group = vmail > mode = 0666 > user = vmail > } > } > service imap-login { > process_limit = 500 > process_min_avail = 2 > } > service quota-warning { > executable = script /usr/local/bin/quota-warning.sh > unix_listener quota-warning { > user = vmail > } > user = dovecot > } > ssl_ca = </etc/ssl/comodo/chain.crt > ssl_cert = </etc/ssl/comodo/server.crt > ssl_key = # hidden, use -P to show it > ssl_protocols = !SSLv2 !SSLv3 > userdb { > args = uid=vmail gid=vmail home=/var/vmail/%n allow_all_users=yes > driver = static > } > verbose_proctitle = yes > protocol lda { > mail_plugins = acl lazy_expunge zlib quota mail_log notify sieve quota > } > protocol imap { > imap_max_line_length = 2 M > mail_max_userip_connections = 30 > mail_plugins = acl lazy_expunge zlib quota mail_log notify imap_quota imap_acl > } and dovecot-ldap.conf.ext: > hosts = 127.0.0.1:391 > dn = cn=search,cn=users,dc=company,dc=com > dnpass = secret > tls = no > debug_level = 0 > auth_bind = yes > base = CN=Users, DC=samba, DC=cmpany, DC=com > scope = subtree > user_attrs = =home=/var/vmail/%n/Maildir:LAYOUT=fs:DIRNAME=mAildir:INDEX=/var/vmail/%n/shared/%n,=mail=maildir:/var/vmail/%n/Maildir:LAYOUT=fs:DIRNAME=mAildir:INDEX=/var/vmail/%n/shared/%n > user_filter = (&(objectclass=person)(sAMAccountName=%n)(!(userAccountControl=514))) > pass_filter = (&(objectclass=person)(sAMAccountName=%n)(!(userAccountControl=514))) > iterate_attrs = sAMAccountName=user > iterate_filter = (objectClass=person)

1 0

[PATCH] dsync: fix splitting login from host
by Thomas Reifferscheid 04 Jul '17

04 Jul '17

Using strchr() was splitting login and host at the first occurrence of '@' which leads to troublesome behaviour. When calling strace one would notice the misbehaviour: execve("/usr/sbin/ssh", ["ssh", "-lthomas", "domain.org(a)10.8.13.2" using strrch() however splits login and host at the last occurrence of '@'. Signed-off-by: Thomas Reifferscheid <thomas(a)reifferscheid.org> --- src/doveadm/doveadm-dsync.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/doveadm/doveadm-dsync.c b/src/doveadm/doveadm-dsync.c index caf569f1d..3b8d4549a 100644 --- a/src/doveadm/doveadm-dsync.c +++ b/src/doveadm/doveadm-dsync.c @@ -479,7 +479,7 @@ parse_ssh_location(const char *location, const char *username) { const char *host, *login; - host = strchr(location, '@'); + host = strrchr(location, '@'); if (host != NULL) login = t_strdup_until(location, host++); else { -- 2.11.0

2 1

NOTIFY broken in 2.2.31?
by Bojan Smojver 04 Jul '17

04 Jul '17

Hi, I just updated my Dovecot to the new build in Fedora 26, which is based on 2.2.31. After I did that, Evolution (3.24.3) is no longer receiving notifications about new mail in folders other than inbox (the same version of Evo that worked fine against Dovecot 2.2.30.2). The only folder that still gets notifications is inbox. I see there have been changes to NOTIFY code in this release. What would you like me to send to you in order to debug this problem? When I run Evo with some debugging options turned on, I can see: ---------------- [imapx:B] I/O: 'B00010 NOTIFY SET (selected (MessageNew (UID RFC822.SIZE RFC822.HEADER FLAGS) MessageExpunge FlagChange)) (personal (MessageNew MessageExpunge MailboxName SubscriptionChange))' [imapx:B] I/O: 'B00010 OK NOTIFY completed (0.001 + 0.000 secs).' ---------------- So, notify setting appears to be happening and it looks pretty much the same as it does against version 2.2.30.2. -- Bojan

3 3

replication and notify
by Vitali Quiering 03 Jul '17

03 Jul '17

Hello, we are using dovecot 2.2.13 on debian jessie from default repositories in multiple two node replication cluster. For another cluster I was trying to set this up on debian stretch with current dovecot 2.2.27. It seemed that notifiy was not working at all. Running replicate manually did work though. I found several mailing list questions regarding this issue. It looks like there is some locking issue with maildir storage engine or notifying the replicator might not work. Tried to setup sdbox without any improvements. In version 2.2.31 there is a change in the changelog: - imap: NOTIFY command has been almost completely broken since the beginning. I guess nobody has been trying to use it. Question 1: Is this change regarding the notify process that notifies the replicator? Question 2: When will this version be available on dovecot stretch-auto repository? I installed sid version to test. Question 3: What else can I do to make replication work? Thanks, Vitali Config: > # OS: Linux 4.9.0-3-amd64 x86_64 Debian 9.0 ext4 > auth_mechanisms = plain login > default_internal_user = vmail > doveadm_password = # hidden, use -P to show it > doveadm_port = 12345 > dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u > info_log_path = /var/log/dovecot/dovecot-info.log > log_path = /var/log/dovecot/dovecot.log > log_timestamp = "%Y-%m-%d %H:%M:%S " > mail_debug = no > mail_location = maildir:/var/vmail/%d/%n > mail_plugins = " notify replication" > mail_privileged_group = vmail > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > args = /etc/dovecot/dovecot-sql.conf > driver = sql > } > plugin { > mail_replica = tcp:mx02.example.com > replication_full_sync_interval = 24 hour > sieve = /var/vmail/%d/%n/.dovecot.sieve > sieve_dir = /var/vmail/%d/%n/ > sieve_storage = /var/vmail/%d/%n/sieve/ > } > protocols = " imap pop3" > service aggregator { > fifo_listener replication-notify-fifo { > mode = 0666 > user = vmail > } > unix_listener replication-notify { > mode = 0666 > user = vmail > } > } > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0666 > user = postfix > } > unix_listener auth-master { > mode = 0600 > user = vmail > } > user = root > } > service doveadm { > inet_listener { > port = 12345 > } > } > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > process_min_avail = 1 > } > service pop3-login { > inet_listener pop3 { > port = 110 > } > inet_listener pop3s { > port = 995 > ssl = yes > } > } > service replicator { > process_min_avail = 1 > unix_listener replicator-doveadm { > mode = 0666 > } > } > ssl = required > ssl_cert = </etc/ssl/certs/cert.crt > ssl_cipher_list = HIGH:MEDIUM:+TLSv1:!SSLv2:+SSLv3 > ssl_key = # hidden, use -P to show it > userdb { > args = /etc/dovecot/dovecot-sql.conf > driver = sql > } > protocol lda { > auth_socket_path = /var/run/dovecot/auth-userdb > log_path = /var/log/dovecot/dovecot-deliver.log > mail_plugins = " notify replication sieve" > postmaster_address = postmaster(a)example.com > } > protocol pop3 { > pop3_uidl_format = %08Xu%08Xv > } Log from mx01: > 2017-07-03 21:50:54 imap-login: Info: Login: user=<user(a)example.com>, method=PLAIN, rip=1.2.3.4, lip=172.31.1.100, mpid=9584, TLS, session=<JhSzFW9TxO3VPWNi> > 2017-07-03 21:50:54 imap(user): Debug: Loading modules from directory: /usr/lib/dovecot/modules > 2017-07-03 21:50:54 imap(user): Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so > 2017-07-03 21:50:54 imap(user): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_replication_plugin.so > 2017-07-03 21:50:54 imap(user): Debug: Added userdb setting: mail=maildir:/var/vmail/example.com/user > 2017-07-03 21:50:54 imap(user): Debug: Effective uid=5000, gid=5000, home=/var/vmail/example.com/user > 2017-07-03 21:50:54 imap(user): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/example.com/user > 2017-07-03 21:50:54 imap(user): Debug: maildir++: root=/var/vmail/example.com/user, index=, indexpvt=, control=, inbox=/var/vmail/example.com/user, alt= > 2017-07-03 21:50:54 imap(user): Debug: INBOX: Mailbox opened because: SELECT > 2017-07-03 21:50:54 imap(user): Debug: Deleted Messages: Mailbox opened because: STATUS > 2017-07-03 21:50:54 imap-login: Info: Login: user=<user(a)example.com>, method=PLAIN, rip=1.2.3.4, lip=172.31.1.100, mpid=9586, TLS, session=<HvO9FW9Txu3VPWNi> > 2017-07-03 21:50:54 imap(user): Debug: Loading modules from directory: /usr/lib/dovecot/modules > 2017-07-03 21:50:54 imap(user): Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so > 2017-07-03 21:50:54 imap(user): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_replication_plugin.so > 2017-07-03 21:50:54 imap(user): Debug: Added userdb setting: mail=maildir:/var/vmail/example.com/user > 2017-07-03 21:50:54 imap(user): Debug: Effective uid=5000, gid=5000, home=/var/vmail/example.com/user > 2017-07-03 21:50:54 imap(user): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/example.com/user > 2017-07-03 21:50:54 imap(user): Debug: maildir++: root=/var/vmail/example.com/user, index=, indexpvt=, control=, inbox=/var/vmail/example.com/user, alt= > 2017-07-03 21:50:54 imap(user): Debug: Deleted Messages: Mailbox opened because: SELECT > 2017-07-03 21:50:55 imap(user): Debug: Mailbox Deleted Messages: Opened mail UID=4 because: 10/17 headers not cached (first=CC) (Mail has other cached fields, reset_id=1498996658) > 2017-07-03 21:50:55 imap(user): Debug: replication: Replication requested by 'transaction commit', priority=1 > 2017-07-03 21:50:55 imap(user): Debug: Deleted Messages: Mailbox opened because: STATUS > 2017-07-03 21:50:55 doveadm(user): Debug: auth PASS input: > 2017-07-03 21:50:55 doveadm(user): Debug: auth USER input: > 2017-07-03 21:50:57 imap(user): Debug: Deleted Messages: Mailbox opened because: STATUS > 2017-07-03 21:51:01 imap(user): Debug: replication: Replication requested by 'transaction commit', priority=2 > 2017-07-03 21:51:02 doveadm(user): Debug: auth PASS input: > 2017-07-03 21:51:02 doveadm(user): Debug: auth USER input:

1 0

Any way to limit number of active IMAP/POP3 sessions from a single user / per user?
by Alexey Asemov (Alex/AT) 03 Jul '17

03 Jul '17

Hello, Just wonder: is there any way in Dovecot to limit number of active IMAP/POP3 connections for a single user, not touching any other users? Basically, the situation is single user hammering servers by lots of POP3 connections from time to time, and limiting exactly one user could be good.

3 5

dovecot 2.2.31: linking error
by Rupert Gallagher 02 Jul '17

02 Jul '17

-std=gnu99 -mmacosx-version-min=10.12 [...] Undefined symbols for architecture x86_64: "_imapc_client_cmd", referenced from: _imapc_quota_refresh in quota-imapc.o "_imapc_client_get_capabilities", referenced from: _imapc_quota_refresh in quota-imapc.o "_imapc_command_sendf", referenced from: _imapc_quota_refresh in quota-imapc.o "_imapc_simple_callback", referenced from: _imapc_quota_refresh in quota-imapc.o "_imapc_simple_context_init", referenced from: _imapc_quota_refresh in quota-imapc.o "_imapc_simple_run", referenced from: _imapc_quota_refresh in quota-imapc.o "_imapc_storage_client_register_untagged", referenced from: _imapc_quota_refresh in quota-imapc.o ld: symbol(s) not found for architecture x86_64 clang-4.0: error: linker command failed with exit code 1 (use -v to see invocation)

5 9

fsck looping duplicate mdbox GUIDs
by Dirk Koopman 01 Jul '17

01 Jul '17

I have recently updated with 2.2.29.1-avh1~xenial1 ubuntu package on 16.04. It appears that I have a couple of duplicate GUIDs which fsck can't clear so the machine is looping through doing continuous fsck runs. Any way to determine what the offending messages are and how to delete or otherwise stop this? Jul 1 17:09:24 post dovecot: doveadm(djk(a)tobit.co.uk): Warning: fscking index file /home/imap/djk/storage/dovecot.map.index Jul 1 17:09:24 post dovecot: doveadm(djk(a)tobit.co.uk): Error: Fixed index file /home/imap/djk/storage/dovecot.map.index: log_file_tail_offset 0 -> 24 Jul 1 17:09:24 post dovecot: dsync-local(djk): Warning: fscking index file /home/imap/djk/storage/dovecot.map.index Jul 1 17:09:24 post dovecot: doveadm(djk(a)tobit.co.uk): Warning: fscking index file /home/imap/djk/storage/dovecot.map.index Jul 1 17:09:25 post dovecot: doveadm(djk(a)tobit.co.uk): Warning: mdbox /home/imap/djk/storage: rebuilding indexes Jul 1 17:10:15 post dovecot: dsync-local(djk): expunge: box=mup-users, uid=1528, msgid=<48707D70.9070108(a)optusnet.com.au>, size=3159 Jul 1 17:11:00 post dovecot: doveadm(djk(a)tobit.co.uk): Error: mdbox /home/imap/djk/storage: Duplicate GUID a8e15732b4f91b55414f0000f80b9cab in m.385:10102880 (size=860) and m.100:3388046 (size=861) Jul 1 17:11:11 post dovecot: doveadm(djk(a)tobit.co.uk): Error: mdbox /home/imap/djk/storage: Duplicate GUID 67d2801030161c557a710000f80b9cab in m.389:363061 (size=895) and m.169:5349813 (size=896) Jul 1 17:11:43 post dovecot: doveadm(djk(a)tobit.co.uk): Warning: Transaction log file /home/imap/djk/storage/dovecot.map.index.log was locked for 139 seconds (mdbox storage rebuild) Jul 1 17:11:43 post dovecot: dsync-local(djk): Warning: Locking transaction log file /home/imap/djk/storage/dovecot.map.index.log took 88 seconds (syncing) Jul 1 17:11:43 post dovecot: doveadm(djk(a)tobit.co.uk): Warning: fscking index file /home/imap/djk/storage/dovecot.map.index Dirk

1 0