- dovecot - dovecot.org

Best practices for backing up small mailserver to remote location
by Ian Evans 09 Aug '18

09 Aug '18

My webserver also houses our mailserver. There's about six users on that mail system and I'm thinking it would be good to back up the mailboxes to my always on HTPC computer at home, which is reachable via a dynamic IP service. I know (or think) I need to use doveadm-backup for this but rather than reinvent the wheel (or use the wrong wheel altogether) I'm wondering if anyone can recommend a good tutorial or wiki entry that shows the best way to loop through the users and send their backups to a remote server. Thanks.

6 6

Message delivered twice caused by an LMTP error "Got unexpected reply" during upgrade to 2.3
by Gabriele Nencioni 09 Aug '18

09 Aug '18

Hi all, we are upgrading our dovecot platform from: # dovecot --version 2.2.15.14 (39f57c379ded+) to # dovecot --version 2.3.2.1 (0719df592) Our platform is debian based and it is configured as director and backend proxy. We have just upgrade only 4 servers (2 directors and 2 backends) and when the lmtp traffic flow goes through an upgraded director and a not-upgraded backend sometimes the following error has been arised: Aug 6 14:31:28 monti-director07 dovecot: lmtp(13463): Error: eMFVIKA/aFuXNAAAhXvSMA: Failed to send message to <test2(a)internalinboundcm.eu> at 192.168.72.135:24: Got unexpected reply (1/1 at 210 ms) Aug 6 14:31:28 monti-director07 dovecot: lmtp(13463): Error: eMFVIKA/aFuXNAAAhXvSMA: Failed to send message to <test2(a)internalinboundcm.eu> at 192.168.72.135:24: Got unexpected reply (1/1 at 210 ms) where 172.20.44.7 (monti-director07) is a dovecot 2.3.2.1 192.168.72.135 (monti-backend07) is a dovecot 2.2.15.14 When that error occurs an email is delivered twice, as you can see from the following logs. On smtp server you can see the temp fail (by the upgraded director 172.20.44.7), retry and delivered (by a not-upgraded director 172.20.44.3): 20180806 14:31:28.772 core context="Temporary_Delivery_Failure", _fromemail="test1(a)internalinboundcm.eu", _toemail="test2(a)internalinboundcm.eu", _tos="test2(a)internalinboundcm.eu", _size="80294", dip=172.20.44.7 dport=24 type=lmtp msg="4.4.0 Remote server not answering (bad reply)" duration=5 mailfrom=6/6/0/0 rcptto=6/6/0/0 data=6/5/1/0 tls=0/0 20180806 14:32:28.032 core context="Message_Delivered", _fromemail="test1(a)internalinboundcm.eu", _toemail="test2(a)internalinboundcm.eu", _tos="test2(a)internalinboundcm.eu", _size="80294", dip=172.20.44.3 dport=24 type=lmtp msg="2.0.0 <test2(a)internalinboundcm.eu> AS1CJtQ/aFsqMAAAj5cnUg Saved" duration=21457 mailfrom=3586/3586/0/0 rcptto=3586/3586/0/0 data=3586/3584/2/0 tls=0/0 and on backend server there are the related two delivered log entries: Aug 6 14:31:28 monti-backend07 dovecot: lmtp(test2(a)internalinboundcm.eu)<f0WZF5c/aFuPdgAAj5cnUg>: copy from <lmtp DATA>: box=INBOX, uid=2727, msgid=<005b01d42d80$2101fff0$6305ffd0$(a)internalinboundcm.eu> Aug 6 14:31:28 monti-backend07 dovecot: lmtp(test2(a)internalinboundcm.eu)<f0WZF5c/aFuPdgAAj5cnUg>: f0WZF5c/aFuPdgAAj5cnUg: msgid=<005b01d42d80$2101fff0$6305ffd0$(a)internalinboundcm.eu>: saved mail to INBOX Aug 6 14:32:28 monti-backend07 dovecot: lmtp(test2(a)internalinboundcm.eu)<AS1CJtQ/aFsqMAAAj5cnUg>: copy from <lmtp DATA>: box=INBOX, uid=2728, msgid=<005b01d42d80$2101fff0$6305ffd0$(a)internalinboundcm.eu> Aug 6 14:32:28 monti-backend07 dovecot: lmtp(test2(a)internalinboundcm.eu)<AS1CJtQ/aFsqMAAAj5cnUg>: AS1CJtQ/aFsqMAAAj5cnUg: msgid=<005b01d42d80$2101fff0$6305ffd0$(a)internalinboundcm.eu>: saved mail to INBOX This is the strace output of dovecot lmtp director process (13463): 13463 1533558688.759362 read(8, "250 2.0.0 <test2(a)internalinboundcm.eu> f0WZF5c/aFuPdgAAj5cnUg Saved\r\n", 8012) = 71 <0.000028> 13463 1533558688.759493 sendto(14, "<19>Aug 6 14:31:28 dovecot: lmtp(13463): Error: eMFVIKA/aFuXNAAAhXvSMA: Failed to send message to <test2(a)internalinboundcm.eu> at 192.168.72.135:24: Got unexpected reply (1/1 at 210 ms)", 188, MSG_NOSIGNAL, NULL, 0) = 188 <0.000037> So it receives the "Saved" message from backend but it arises the "Got unexpected reply" error anyway. >From tcpdump we have noticed the QUIT response is missed on lmtp trasaction after the "Saved" message from backend at DATA stage: 220 monti-backend07.it.dadainternal Dovecot ready. LHLO monti-director07.it.dadainternal 250-monti-backend07.it.dadainternal 250-8BITMIME 250-ENHANCEDSTATUSCODES 250 PIPELINING MAIL FROM:<test1(a)internalinboundcm.eu> RCPT TO:<test2(a)internalinboundcm.eu> DATA ...truncated message . 250 2.0.0 <test2(a)internalinboundcm.eu> f0WZF5c/aFuPdgAAj5cnUg Saved While it should be something like this: 220 monti-backend07.it.dadainternal Dovecot ready. LHLO monti-director07.it.dadainternal 250-monti-backend07.it.dadainternal 250-8BITMIME 250-ENHANCEDSTATUSCODES 250 PIPELINING MAIL FROM:<test1(a)internalinboundcm.eu> RCPT TO:<test2(a)internalinboundcm.eu> DATA ...truncated message . 250 2.0.0 <test2(a)internalinboundcm.eu> f0WZF5c/aFuPdgAAj5cnUg Saved QUIT 221 2.0.0 OK It follows the both dovecot configurations: # 2.3.2.1 (0719df592): /etc/dovecot/dovecot.conf # OS: Linux 4.9.0-7-amd64 x86_64 Debian 9.5 auth_cache_negative_ttl = 0 auth_verbose = yes auth_worker_max_count = 350 director_mail_servers = 192.168.72.129 192.168.72.130 192.168.72.131 192.168.72.132 192.168.72.133 192.168.72.134 192.168.72.135 192.168.72.136 192.168.72.137 192.168.72.138 192.168.72.139 192.168.72.140 192.168.72.141 192.168.72.142 192.168.72.143 192.168.72.144 192.168.72.145 192.168.72.146 192.168.72.147 192.168.72.148 192.168.72.149 director_servers = 172.20.44.1 172.20.44.2 172.20.44.3 172.20.44.4 172.20.44.5 172.20.44.6 172.20.44.7 172.20.44.8 disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it doveadm_port = 24242 lmtp_proxy = yes log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%Lu> method=%m rip=%r lip=%l mpid=%e %c session=<%{session}> mail_log_prefix = "%s(%Lu)<%{session}>: " mail_max_userip_connections = 500 passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql skip = authenticated } protocols = imap pop3 lmtp service auth-worker { user = dovecot } service auth { client_limit = 0 } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 24242 } } service imap-login { client_limit = 12000 executable = imap-login director process_limit = 0 process_min_avail = 4 service_count = 0 } service ipc { unix_listener ipc { user = $default_internal_user } } service lmtp { client_limit = 1 executable = lmtp -L inet_listener lmtp { port = 24 } process_limit = 240 process_min_avail = 20 service_count = 1 } service pop3-login { client_limit = 12000 executable = pop3-login director process_limit = 0 process_min_avail = 4 service_count = 0 } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol doveadm { auth_socket_path = director-userdb } protocol lmtp { auth_socket_path = director-userdb mail_plugins = } # 2.2.15.14 (39f57c379ded+): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.9 auth_cache_negative_ttl = 0 auth_worker_max_count = 500 default_vsz_limit = 1 G disable_plaintext_auth = no doveadm_password = first_valid_uid = 508 last_valid_uid = 508 lda_mailbox_autocreate = yes log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%Lu> method=%m rip=%r lip=%l mpid=%e %c session=<%{session}> login_trusted_networks = 192.168.72.201 192.168.72.202 192.168.72.203 192.168.72.204 192.168.72.205 192.168.72.206 192.168.72.207 192.168.72.208 mail_fsync = always mail_gid = 508 mail_location = maildir:~/Maildir mail_log_prefix = "%s(%Lu)<%{session}>: " mail_max_userip_connections = 30 mail_plugins = notify mail_log quota mail_uid = 508 maildir_very_dirty_syncs = yes mmap_disable = yes namespace { hidden = yes list = no location = prefix = separator = . } namespace inbox { inbox = yes location = mailbox Drafts { auto = create special_use = \Drafts } mailbox Sent { auto = create special_use = \Sent } mailbox Spam { auto = create special_use = \Junk } mailbox Trash { auto = create special_use = \Trash } prefix = INBOX. separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql skip = authenticated } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid quota = dict:User quota::file:%h/dovecot-quota quota_exceeded_message = Quota exceeded quota_rule2 = Trash:storage=+100M quota_warning = storage=100%% quota-warning -q 100 -n %n -d %d -e OverQuota quota_warning2 = storage=80%% quota-warning -q 80 -n %n -d %d -e FillQuota quota_warning3 = -storage=99%% quota-warning -q 99 -n %n -d %d -e InQuota sieve = ~/.dovecot.sieve sieve_extensions = +editheader sieve_max_redirects = 15 sieve_vacation_default_period = 1h } quota_full_tempfail = yes service auth-worker { user = dovecot } service auth { client_limit = 15000 } service doveadm { inet_listener { port = 24242 } } service imap-login { process_limit = 0 process_min_avail = 16 service_count = 0 } service imap { executable = imap postlogin process_limit = 7000 service_count = 2300 } service lmtp { client_limit = 1 executable = lmtp -L inet_listener lmtp { address = 192.168.72.129 127.0.0.1 port = 24 } process_limit = 240 process_min_avail = 20 service_count = 10 } service pop3-login { process_limit = 0 process_min_avail = 16 service_count = 0 } service pop3 { executable = pop3 postlogin process_limit = 7000 service_count = 2300 } ssl = no submission_host = userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail mail_plugins = notify mail_log quota imap_quota } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes pop3_no_flag_updates = yes pop3_uidl_format = %f } protocol lmtp { mail_plugins = notify mail_log quota sieve passdb { args = /etc/dovecot/dovecot-lmtp.conf driver = sql name = } userdb { args = /etc/dovecot/dovecot-lmtp.conf driver = sql name = result_failure = return-fail skip = never } } Please could someone help me? How can I fix that error, in order to avoid the duplicated email? Thanks in advance Regards, -- Gabriele Nencioni System Administrator eml gabriele.nencioni(a)register.it

2 2

Set X-Original-To based an ORCPT?
by Peer Heinlein 09 Aug '18

09 Aug '18

Since http://dovecot.org/pipermail/dovecot-cvs/2014-November/025241.html Dovecot's LMTP does support ORCPT. Is it possible to set X-Original-To-Header based on that ORCPT? Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

5 5

dovecot Panic: file mail-index-sync-update.c: line 1013
by Eugen I 08 Aug '18

08 Aug '18

An email came to several users but one user didn't receive it and we got 'Mail delivery failed' message. As I see from the log below, there were broken index file. Then dovecot repaired that index and we got the error: Panic: file mail-index-sync-update.c: line 1013 (mail_index_sync_map): assertion failed: (map->hdr.indexid == index->indexid || map->hdr.indexid == 0) It was one-time error and it has not reappeared yet. At the moment the user receives emails successfully (in .Queue.A_Sup.group_05 as well). It is supposed that Dovecot had to repair index file and put the email in mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/ directory but it didn't. Is there something wrong with Dovecot? Thanks. --- Operating system: Linux Centos 7 3.10.0-862.3.2.el7.x86_64 #1 SMP Mon May 21 23:36:36 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux rpm -qa |grep dovecot dovecot-pigeonhole-2.2.10-8.el7.x86_64 dovecot-2.2.10-8.el7.x86_64 dovecot.log output --------------------- Aug 06 23:19:24 lda: Debug: Loading modules from directory: /usr/lib64/dovecot Aug 06 23:19:24 lda: Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so Aug 06 23:19:24 lda(user05): Debug: Effective uid=10492, gid=10001, home=/mnt/mail/user05 Aug 06 23:19:24 lda(user05): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/mnt/mail//user05/Maildir:INBOX=/mnt/mail//user05/Maildir Aug 06 23:19:24 lda(user05): Debug: maildir++: root=/mnt/mail//user05/Maildir, index=, indexpvt=, control=, inbox=/mnt/mail//user05/Maildir, alt= Aug 06 23:19:24 lda(user05): Debug: userdb lookup skipped, username taken from USER environment Aug 06 23:19:24 lda(user05): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Aug 06 23:19:24 lda(user05): Debug: Destination address: user05(a)imap.po.com (source: user@hostname) Aug 06 23:19:24 lda(user05): Debug: sieve: Pigeonhole version 0.4.2 initializing Aug 06 23:19:24 lda(user05): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Aug 06 23:19:24 lda(user05): Debug: sieve: executed before user's personal Sieve script(1): /etc/dovecot/sieve/before/priority_colors.sieve Aug 06 23:19:24 lda(user05): Debug: sieve: using the following location for user's Sieve script: /mnt/mail//user05/.dovecot.sieve;name=main script Aug 06 23:19:24 lda(user05): Debug: sieve: executed after user's Sieve script(3): /etc/dovecot/sieve/after/spam.sieve Aug 06 23:19:24 lda(user05): Debug: sieve: opening script 1 of 3 from /etc/dovecot/sieve/before/priority_colors.sieve Aug 06 23:19:24 lda(user05): Debug: sieve: loading script /etc/dovecot/sieve/before/priority_colors.sieve Aug 06 23:19:24 lda(user05): Debug: sieve: script binary /etc/dovecot/sieve/before/priority_colors.svbin successfully loaded Aug 06 23:19:24 lda(user05): Debug: sieve: binary save: not saving binary /etc/dovecot/sieve/before/priority_colors.svbin, because it is already stored Aug 06 23:19:24 lda(user05): Debug: sieve: executing script from /etc/dovecot/sieve/before/priority_colors.svbin Aug 06 23:19:24 lda(user05): Debug: sieve: opening script 2 of 3 from /mnt/mail//user05/.dovecot.sieve;name=main script Aug 06 23:19:24 lda(user05): Debug: sieve: loading script /mnt/mail//user05/.dovecot.sieve;name=main script Aug 06 23:19:24 lda(user05): Debug: sieve: script binary /mnt/mail//user05/.dovecot.svbin successfully loaded Aug 06 23:19:24 lda(user05): Debug: sieve: binary save: not saving binary /mnt/mail//user05/.dovecot.svbin, because it is already stored Aug 06 23:19:24 lda(user05): Debug: sieve: executing script from /mnt/mail//user05/.dovecot.svbin Aug 06 23:19:24 lda(user05): Error: Index file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index: indexid changed: 1533501509 -> 1464071305 Aug 06 23:19:24 lda(user05): Error: Corrupted transaction log file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index.log seq 3: indexid changed: 1533501509 -> 1464071305 (sync_offset=168) Aug 06 23:19:24 lda(user05): Error: Transaction log file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index.log: marked corrupted Aug 06 23:19:24 lda: Debug: Loading modules from directory: /usr/lib64/dovecot Aug 06 23:19:24 lda(user05): Error: Corrupted index file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index: messages_count too large (2915 > 85) Aug 06 23:19:24 lda(user05): Warning: fscking index file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index Aug 06 23:19:24 lda(user05): Error: Corrupted index file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index: messages_count too large (2915 > 85) Aug 06 23:19:24 lda(user05): Warning: fscking index file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index Aug 06 23:19:24 lda(user05): Error: Fixed index file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index: log_file_seq 670 -> 2 Aug 06 23:19:24 lda(user05): Error: Fixed index file /mnt/mail//user05/Maildir/.Queue.A_Sup.group_05/dovecot.index: messages_count 2915 -> 85 Aug 06 23:19:24 lda(user05): Panic: file mail-index-sync-update.c: line 1013 (mail_index_sync_map): assertion failed: (map->hdr.indexid == index->indexid || map->hdr.indexid == 0) Aug 06 23:19:24 lda(user05): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x6a06e) [0x7f1ada8a106e] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f1ada8a10da] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f1ada85952c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x651) [0x7f1adabda2c1] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_map+0x3e7) [0x7f1adabcab77] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xb937d) [0x7f1adabc637d] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xb9990) [0x7f1adabc6990] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_open+0x8c) [0x7f1adabc6a7c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_storage_mailbox_open+0x87) [0x7f1adabb79c7] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x4d882) [0x7f1adab5a882] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x4d963) [0x7f1adab5a963] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x802b4) [0x7f1adab8d2b4] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_open+0x20) [0x7f1adab8d430] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver_save_open+0xad) [0x7f1adae3240d] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(+0x3f0a2) [0x7f1ad9e130a2] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(sieve_result_execute+0xc5) [0x7f1ad9e0b0f5] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(sieve_multiscript_run+0x119) [0x7f1ad9e1b3c9] -> /usr/lib64/dovecot/lib90_sieve_plugin.so(+0x2e97) [0x7f1ada062e97] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver+0x4a) [0x7f1adae32b3a] -> /usr/libexec/dovecot/deliver(main+0x3b5) [0x556390a1e885] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f1ada48c445] -> /usr/libexec/dovecot/deliver(+0x318c) [0x556390a1f18c] dovecot -n output: =========== # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-862.3.2.el7.x86_64 x86_64 CentOS Linux release 7.5.1804 (Core) fuse.encfs auth_verbose = yes first_valid_uid = 1000 lda_mailbox_autocreate = yes log_path = /var/log/dovecot.log mail_debug = yes mail_home = /mnt/mail/%d/%n mail_location = maildir:/mnt/mail/%d/%n/Maildir:INBOX=/mnt/mail/%d/%n/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox dat e ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { setting_name = value sieve sieve = /mnt/mail/%d/%n/.dovecot.sieve sieve_after = /etc/dovecot/sieve/after/ sieve_before = /etc/dovecot/sieve/before/ sieve_dir = /mnt/mail/%d/%n/sieve } protocols = imap pop3 lmtp sieve service imap-login { process_limit = 2000 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 1024 } ssl = required ssl_ca = </etc/CERT/SSL_CA_Bundle.pem ssl_cert = </etc/CERT/po.com.crt ssl_key = </etc/CERT/po.com.key ssl_protocols = !SSLv2 !SSLv3 userdb { driver = passwd } protocol lda { mail_plugins = " sieve" } protocol imap { mail_max_userip_connections = 20 } ================

2 1

Reproducible SIGSEGV when Dovecot 2.3 compiled against glibc-2.28
by Reuben Farrelly 08 Aug '18

08 Aug '18

Hi, Dovecot 2.3 (release and current -git) versions compile, but fail to run when compiled against glibc-2.28. This is what is logged on startup: Aug 8 08:24:39 thunderstorm.reub.net dovecot[569]: master: Dovecot v2.3.2.1 (0719df592) starting up for imap, lmtp, sieve, submission, sieve Aug 8 08:24:39 thunderstorm.reub.net dovecot[569]: master: Error: service(auth): command startup failed, throttling for 2 secs Aug 8 08:24:39 thunderstorm.reub.net dovecot[574]: auth: Fatal: master: service(auth): child 582 killed with signal 11 (core dumped) Aug 8 08:24:39 thunderstorm.reub.net dovecot[574]: replicator: Error: userdb lookup: Disconnected unexpectedly Aug 8 08:24:52 thunderstorm.reub.net dovecot[569]: master: Warning: Killed with signal 15 (by pid=670 uid=0 code=kill) The issue is specifically with the 'auth' binary. Other components all appear to be unaffected. The 'auth' binary dies with a Segmentation Fault when run as a standalone executable too. As the auth binary is critical to many different parts of Dovecot, a failure of this is catastrophic. This is a 100% reproducible problem. The platform is Gentoo x86_64. thunderstorm /usr/libexec/dovecot # ./auth-old Segmentation fault thunderstorm /usr/libexec/dovecot # [I've renamed the original binary to auth-old, and put in it's place a working 'auth' binary built against glibc-2.27 in order to have a functioning system] Problem matrix looks like this: Build on a glibc-2.27 system, run on a glibc-2.27 - OK Build on a glibc-2.27 system, run on a glibc-2.28 - OK Build on a glibc-2.28 system, run on a glibc-2.27 - SEGFAULT Build on a glibc-2.28 system, run on a glibc-2.28 - SEGFAULT (All other components including gcc otherwise identical) ./configure --prefix=/usr --build=x86_64-pc-linux-gnu --host=x86_64-pc-linux-gnu --mandir=/usr/share/man --infodir=/usr/share/info --datadir=/usr/share --sysconfdir=/etc --localstatedir=/var/lib --disable-dependency-tracking --disable-silent-rules --docdir=/usr/share/doc/dovecot-9999_p20180807 --htmldir=/usr/share/doc/dovecot-9999_p20180807/html --libdir=/usr/lib64 --with-rundir=/run/dovecot --with-statedir=/var/lib/dovecot --with-moduledir=/usr/lib64/dovecot --without-stemmer --disable-rpath --without-libbsd --with-icu --with-ssl --with-systemdsystemunitdir=/lib/systemd/system --with-sodium --with-bzlib --without-libcap --without-gssapi --without-lua --without-ldap --with-lucene --with-lz4 --with-lzma --without-mysql --with-pam --without-pgsql --without-sqlite --without-solr --with-libwrap --without-textcat --without-vpopmail --with-zlib --disable-static Strace: thunderstorm /usr/libexec/dovecot # strace ./auth-old execve("./auth-old", ["./auth-old"], 0x7ffd17c804c0 /* 27 vars */) = 0 brk(NULL) = 0x557e9dc28000 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/tls/x86_64/x86_64/libstats_auth.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/old-stats/tls/x86_64/x86_64", 0x7ffcc7973020) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/tls/x86_64/libstats_auth.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/old-stats/tls/x86_64", 0x7ffcc7973020) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/tls/x86_64/libstats_auth.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/old-stats/tls/x86_64", 0x7ffcc7973020) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/tls/libstats_auth.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/old-stats/tls", 0x7ffcc7973020) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/x86_64/x86_64/libstats_auth.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/old-stats/x86_64/x86_64", 0x7ffcc7973020) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/x86_64/libstats_auth.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/old-stats/x86_64", 0x7ffcc7973020) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/x86_64/libstats_auth.so", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/old-stats/x86_64", 0x7ffcc7973020) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/libstats_auth.so", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0`\t\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=18848, ...}) = 0 mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f3eef676000 mmap(NULL, 2105632, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eef24f000 mprotect(0x7f3eef251000, 2093056, PROT_NONE) = 0 mmap(0x7f3eef450000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1000) = 0x7f3eef450000 close(3) = 0 openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/tls/x86_64/x86_64/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/tls/x86_64/x86_64", 0x7ffcc7973000) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/tls/x86_64/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/tls/x86_64", 0x7ffcc7973000) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/tls/x86_64/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/tls/x86_64", 0x7ffcc7973000) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/tls/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/tls", 0x7ffcc7973000) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/x86_64/x86_64/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/x86_64/x86_64", 0x7ffcc7973000) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/x86_64/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/x86_64", 0x7ffcc7973000) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/x86_64/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) stat("/usr/lib64/dovecot/x86_64", 0x7ffcc7973000) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/libdovecot.so.0", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0p\277\3\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=4783816, ...}) = 0 mmap(NULL, 4186392, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eeee50000 mprotect(0x7f3eef043000, 2093056, PROT_NONE) = 0 mmap(0x7f3eef242000, 40960, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1f2000) = 0x7f3eef242000 mmap(0x7f3eef24c000, 8472, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f3eef24c000 close(3) = 0 openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/libcrypt.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/libcrypt.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 fstat(3, {st_mode=S_IFREG|0644, st_size=54433, ...}) = 0 mmap(NULL, 54433, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f3eef668000 close(3) = 0 openat(AT_FDCWD, "/lib64/libcrypt.so.1", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0 \r\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=39064, ...}) = 0 mmap(NULL, 2322976, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eeec18000 mprotect(0x7f3eeec20000, 2097152, PROT_NONE) = 0 mmap(0x7f3eeee20000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x8000) = 0x7f3eeee20000 mmap(0x7f3eeee22000, 184864, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f3eeee22000 close(3) = 0 openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/libpam.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/libpam.so.0", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/lib64/libpam.so.0", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200&\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=55840, ...}) = 0 mmap(NULL, 2151000, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eeea0a000 mprotect(0x7f3eeea17000, 2093056, PROT_NONE) = 0 mmap(0x7f3eeec16000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xc000) = 0x7f3eeec16000 close(3) = 0 openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/libsodium.so.23", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/libsodium.so.23", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/libsodium.so.23", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\240\305\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=318056, ...}) = 0 mmap(NULL, 2413576, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eee7bc000 mprotect(0x7f3eee809000, 2093056, PROT_NONE) = 0 mmap(0x7f3eeea08000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x4c000) = 0x7f3eeea08000 close(3) = 0 openat(AT_FDCWD, "/usr/lib64/dovecot/old-stats/libc.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/usr/lib64/dovecot/libc.so.6", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) openat(AT_FDCWD, "/lib64/libc.so.6", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\3407\2\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=1869376, ...}) = 0 mmap(NULL, 3975016, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eee3f1000 mprotect(0x7f3eee5b3000, 2093056, PROT_NONE) = 0 mmap(0x7f3eee7b2000, 24576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1c1000) = 0x7f3eee7b2000 mmap(0x7f3eee7b8000, 14184, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f3eee7b8000 close(3) = 0 openat(AT_FDCWD, "/lib64/libdl.so.2", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0P\16\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=14424, ...}) = 0 mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f3eef666000 mmap(NULL, 2109712, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eee1ed000 mprotect(0x7f3eee1f0000, 2093056, PROT_NONE) = 0 mmap(0x7f3eee3ef000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f3eee3ef000 close(3) = 0 openat(AT_FDCWD, "/lib64/libpthread.so.0", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\0j\0\0\0\0\0\0"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=118024, ...}) = 0 mmap(NULL, 2229408, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f3eedfcc000 mprotect(0x7f3eedfe8000, 2093056, PROT_NONE) = 0 mmap(0x7f3eee1e7000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1b000) = 0x7f3eee1e7000 mmap(0x7f3eee1e9000, 13472, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f3eee1e9000 close(3) = 0 mmap(NULL, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f3eef663000 arch_prctl(ARCH_SET_FS, 0x7f3eef663b80) = 0 mprotect(0x7f3eee7b2000, 16384, PROT_READ) = 0 mprotect(0x7f3eee1e7000, 4096, PROT_READ) = 0 mprotect(0x7f3eee3ef000, 4096, PROT_READ) = 0 mprotect(0x7f3eeea08000, 4096, PROT_READ) = 0 mprotect(0x7f3eeec16000, 4096, PROT_READ) = 0 mprotect(0x7f3eeee20000, 4096, PROT_READ) = 0 mprotect(0x7f3eef242000, 28672, PROT_READ) = 0 mprotect(0x7f3eef450000, 4096, PROT_READ) = 0 mprotect(0x557e9c5e7000, 12288, PROT_READ) = 0 mprotect(0x7f3eef678000, 4096, PROT_READ) = 0 munmap(0x7f3eef668000, 54433) = 0 set_tid_address(0x7f3eef663e50) = 19762 set_robust_list(0x7f3eef663e60, 24) = 0 rt_sigaction(SIGRTMIN, {sa_handler=0x7f3eedfd2380, sa_mask=[], sa_flags=SA_RESTORER|SA_SIGINFO, sa_restorer=0x7f3eedfe0400}, NULL, 8) = 0 rt_sigaction(SIGRT_1, {sa_handler=0x7f3eedfd2430, sa_mask=[], sa_flags=SA_RESTORER|SA_RESTART|SA_SIGINFO, sa_restorer=0x7f3eedfe0400}, NULL, 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0 prlimit64(0, RLIMIT_STACK, NULL, {rlim_cur=8192*1024, rlim_max=RLIM64_INFINITY}) = 0 getrandom("\xfb\x47\x75\x83", 4, 0) = 4 brk(NULL) = 0x557e9dc28000 brk(0x557e9dc49000) = 0x557e9dc49000 uname({sysname="Linux", nodename="thunderstorm", ...}) = 0 getpid() = 19762 openat(AT_FDCWD, "/dev/null", O_WRONLY) = 3 fcntl(3, F_GETFD) = 0 fcntl(3, F_SETFD, FD_CLOEXEC) = 0 rt_sigaction(SIGPIPE, {sa_handler=SIG_IGN, sa_mask=[], sa_flags=SA_RESTORER|SA_RESTART, sa_restorer=0x7f3eee4297c0}, NULL, 8) = 0 rt_sigaction(SIGALRM, {sa_handler=0x7f3eeef9899b, sa_mask=[], sa_flags=SA_RESTORER|SA_SIGINFO, sa_restorer=0x7f3eee4297c0}, NULL, 8) = 0 openat(AT_FDCWD, "/proc/sys/crypto/fips_enabled", O_RDONLY) = -1 ENOENT (No such file or directory) --- SIGSEGV {si_signo=SIGSEGV, si_code=SEGV_MAPERR, si_addr=0xffffffffeee4f200} --- +++ killed by SIGSEGV +++ Segmentation fault thunderstorm /usr/libexec/dovecot # gdb: thunderstorm /var/core # gdb auth core.auth.18428 GNU gdb (Gentoo 8.1.1 p1) 8.1.1 Copyright (C) 2018 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <https://bugs.gentoo.org/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from auth...done. warning: exec file is newer than core file. [New LWP 18428] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/auth'. Program terminated with signal SIGSEGV, Segmentation fault. #0 __strcmp_sse2_unaligned () at ../sysdeps/x86_64/multiarch/strcmp-sse2-unaligned.S:31 31 ../sysdeps/x86_64/multiarch/strcmp-sse2-unaligned.S: No such file or directory. (gdb) bt full #0 __strcmp_sse2_unaligned () at ../sysdeps/x86_64/multiarch/strcmp-sse2-unaligned.S:31 No locals. #1 0x000055bbe3362dcf in password_scheme_register_crypt () at password-scheme-crypt.c:191 i = 0 crypted = 0xfffffffffdbcf200 <error: Cannot access memory at address 0xfffffffffdbcf200> __func__ = <optimized out> #2 0x000055bbe33627cb in password_schemes_init () at password-scheme.c:874 i = 27 #3 0x000055bbe332a82a in main_preinit () at main.c:185 mod_set = { abi_version = 0xfe2096c0 <error: Cannot access memory at address 0xfe2096c0>, binary_name = 0x599ce8cff6a85000 <error: Cannot access memory at address 0x599ce8cff6a85000>, setting_name = 0x7f1efdc1b011 <__x86_return_thunk+5> "\363\220\017\256\350\353\371H\215d$\b\303\350\a", filter_callback = 0x7f1efdc51029 <master_getopt+149>, filter_context = 0x7f1efdc1b011 <__x86_return_thunk+5>, require_init_funcs = false, debug = false, ignore_dlopen_errors = false, ignore_missing = false} services = 0x55bbe3819fa0 #4 0x000055bbe332aef5 in main (argc=1, argv=0x55bbe3819ae0) at main.c:392 c = -1 (gdb) Release notes for glibc are here: https://www.sourceware.org/ml/libc-alpha/2018-08/msg00003.htm There are some notes about changes to crypt functions which could be relevant given the gdb has references to crypt password schemes. I have libgcrypt-1.8.3 installed but I _haven't_ specifically disabled crypt in glibc (see release notes). Thanks, Reuben

3 6

Error: connect(ipc-proxy) failed: Permission denied
by MAREN ZUBIZARRETA 08 Aug '18

08 Aug '18

Hello: We have got 2 directors and three backend mailbox servers. I get the following error " Error: connect(ipc-proxy) failed: Permission denied". I have read the article https://www.dovecot.org/list/dovecot/2012-August/137349.html and we have done as signaled in the two director servers with no success, So, we have tried now to set it like this: service ipc { unix_listener ipc { user = dovecot # This is already the default in v2.3.1+ group = mode = 0777 } } that cause the socket to have full permissions: srwxrwxrwx 1 dovecot root 0 ago 8 10:00 /var/run/dovecot/ipc but even so, I still get the same behaviour. And when you try "doveadm director kick user" , nothing happens Can anyone give me any hint. Thanks a lot in advance Maren Zubizarreta Sistemen Analista / Analista de Sistemas maren.zubizarreta(a)ehu.es<mailto:maren.zubizarreta@ehu.es> 94 601 8389 IKT GERENTEORDETZA/VICEGERENCIA TIC UPV/EHU Barrio Sarriena,s/n | 48940 LEIOA T.: +34 946012000 | F.: +34 946012200 www.ehu.es<http://www.ehu.es/> [http://www.unibertsitate-hedakuntza.ehu.es/p268-content/es/contenidos/infor…] ERNE! Baliteke mezu honen zatiren bat edo mezu osoa legez babestuta egotea. Mezuak badu bere hartzailea. Okerreko helbidera heldu bada (helbidea gaizki idatzi, transmisioak huts egin) eman abisu igorleari, korreo honi erantzunda. Kontuz! Mezua ez bada zuretzat, ez erabili, ez zabaldu beste inori, ez kopiatu eta ez baliatu. ¡ATENCIÓN! Este mensaje contiene información privilegiada o confidencial a la que sólo tiene derecho a acceder el destinatario. Si usted lo recibe por error le agradeceríamos que no hiciera uso de la información y que se pusiese en contacto con el remitente. [http://www.unibertsitate-hedakuntza.ehu.es/p077-9030/es/contenidos/informac…] E-mail hau inprimatu baino lehen egiaztatu inprimatzeko beharra. Antes de imprimir este e-mail piense bien si es necesario hacerlo.

1 0

AW: 2.3.2.1 - relay to lmtps from other lan host
by Tobi 06 Aug '18

06 Aug '18

You have lmtp as unix socket configured but want to access from remote via tcp socket? I think you need inet_listener instead of unix_ listener ----- Originale Nachricht ----- Von: "ѽ҉ᶬḳ℠" <vtol(a)gmx.net> Gesendet: 06.08.18 - 20:14 An: dovecot <dovecot(a)dovecot.org> Betreff: 2.3.2.1 - relay to lmtps from other lan host > Hi, > > looked into the [ dovecot wiki ] but a search for [ lmtps ] came up > empty and thus hoping to get some assistance here. > > I am trying to relay with [ msmtp ] via [ lmtps ] from a lan host other > than [ dovecot ] is running on. > > [ dovecot config ] > >> service lmtp { >> unix_listener lmtp { >> #mode = 0666 >> } > > [ ss -wxl | grep lmtp ] >> u_strLISTEN 0 100 /var/run/dovecot/lmtp 68262 * 0 > > So far so good. Now from the other lan host -> [ msmtp --serverinfo > --tls --tls-certcheck=off --host=172.24.109.6 --protocol=lmtp --port=262 > ] produces: > >> msmtp: cannot connect to 172.24.109.6, port 262: Connection refused > >

2 2

2.3.2.1 - relay to lmtps from other lan host
by ѽ҉ᶬḳ℠ 06 Aug '18

06 Aug '18

Hi, looked into the [ dovecot wiki ] but a search for [ lmtps ] came up empty and thus hoping to get some assistance here. I am trying to relay with [ msmtp ] via [ lmtps ] from a lan host other than [ dovecot ] is running on. [ dovecot config ] > service lmtp { > unix_listener lmtp { > #mode = 0666 > } [ ss -wxl | grep lmtp ] > u_strLISTEN 0 100 /var/run/dovecot/lmtp 68262 * 0 So far so good. Now from the other lan host -> [ msmtp --serverinfo --tls --tls-certcheck=off --host=172.24.109.6 --protocol=lmtp --port=262 ] produces: > msmtp: cannot connect to 172.24.109.6, port 262: Connection refused

3 2

dsync not replicating ".dovecot.sieve -> .sieve/managesieve.sieve"
by Tony 06 Aug '18

06 Aug '18

Hi, Currently using dovecot 2.3.2.1 and pigeonhole 0.5.2 on two identical hosts. I recently noticed ".dovecot.sieve" and ".sieve/managesieve.sieve" are not replicating from one host to the other in either direction. Mail is having no trouble replicating on both hosts with dsync, it is only sieve files that are not replicating for unclear reasons. # doveconf -n host 1: https://ptpb.pw/njs3 host 2: https://ptpb.pw/KsfK If I enable sieve debug logs I don't see anything that would cause alarm. The error logs are also not reporting any trouble. I have tested creating filters in Roundcube which is hosted from host1. This creates the sieve files as expected, but the same sieve files do not replicate to host2. When using Sieve with Thunderbird if the sieve files are created on host1 or host2, these are not replicating with dsync. So it does not seem to matter if the sieve files are created on either host and with any mail client, they just do not replicate at all. # host1 stat /home/vmail/example.email/user\(a)example.email/.dovecot.sieve File: /home/vmail/example.email/user(a)example.email/.dovecot.sieve -> .sieve/managesieve.sieve Size: 24 Blocks: 0 IO Block: 4096 symbolic link Device: 800h/2048d Inode: 596605 Links: 1 Access: (0777/lrwxrwxrwx) Uid: ( 5000/ vmail) Gid: ( 5000/ vmail) Access: 2018-08-05 15:24:41.351827516 -0700 Modify: 2018-08-05 15:24:41.351827516 -0700 Change: 2018-08-05 15:24:41.351827516 -0700 Birth: - stat /home/vmail/example.email/user\(a)example.email/.sieve/managesieve.sieve File: /home/vmail/example.email/user(a)example.email/.sieve/managesieve.sieve Size: 65 Blocks: 8 IO Block: 4096 regular file Device: 800h/2048d Inode: 1657978 Links: 1 Access: (0600/-rw-------) Uid: ( 5000/ vmail) Gid: ( 5000/ vmail) Access: 2018-08-05 15:27:30.034984088 -0700 Modify: 2018-08-05 15:27:30.034984088 -0700 Change: 2018-08-05 15:27:30.034984088 -0700 Birth: - # host2 stat /home/vmail/example.email/user\(a)example.email/.dovecot.sieve File: /home/vmail/example.email/user(a)example.email/.dovecot.sieve -> .sieve/managesieve.sieve Size: 24 Blocks: 0 IO Block: 4096 symbolic link Device: fe03h/65027d Inode: 787482 Links: 1 Access: (0777/lrwxrwxrwx) Uid: ( 5000/ vmail) Gid: ( 5000/ vmail) Access: 2018-08-05 16:10:54.832151815 -0700 Modify: 2018-08-05 16:10:54.815484905 -0700 Change: 2018-08-05 16:10:54.815484905 -0700 Birth: - stat /home/vmail/example.email/user\(a)example.email/.sieve/managesieve.sieve File: /home/vmail/example.email/user(a)example.email/.sieve/managesieve.sieve Size: 18 Blocks: 8 IO Block: 4096 regular file Device: fe03h/65027d Inode: 786938 Links: 1 Access: (0600/-rw-------) Uid: ( 5000/ vmail) Gid: ( 5000/ vmail) Access: 2018-08-05 16:10:54.815484905 -0700 Modify: 2018-08-05 16:10:49.818745528 -0700 Change: 2018-08-05 16:10:49.822078910 -0700 Birth: - Here is the Maildir tree view. tree -a /home/vmail/example.email/user\(a)example.email/ /home/vmail/example.email/user(a)example.email/ ├── .dovecot.sieve -> .sieve/managesieve.sieve ├── Maildir │ ├── .Archive │ │ ├── cur │ │ ├── dovecot.index.log │ │ ├── dovecot-uidlist │ │ ├── maildirfolder │ │ ├── new │ │ └── tmp │ ├── cur │ │ ├── 1531611877.M860311P418538.mail,S=5999,W=6167:2,RS │ │ ├── 1531624146.M201381P535494.mail,S=2133,W=2184:2,S │ │ ├── 1533194577.M483202P864896.mail,S=6117,W=6393:2,S │ │ └── 1533195582.M123163P877084.mail,S=1739,W=1786:2,S │ ├── dovecot.index │ ├── dovecot.index.cache │ ├── dovecot.index.log │ ├── dovecot-keywords │ ├── dovecot.list.index │ ├── dovecot.list.index.log │ ├── dovecot.mailbox.log │ ├── dovecot-uidlist │ ├── dovecot-uidvalidity │ ├── dovecot-uidvalidity.5b4a79b5 │ ├── .Drafts │ │ ├── cur │ │ ├── dovecot.index.log │ │ ├── dovecot-uidlist │ │ ├── maildirfolder │ │ ├── new │ │ └── tmp │ ├── maildirsize │ ├── new │ ├── .Sent │ │ ├── cur │ │ │ ├── 1531611855.M403833P418688.mail,S=3510,W=3623:2,S │ │ │ └── 1531624037.M238133P535494.mail,S=436,W=451:2,S │ │ ├── dovecot.index.cache │ │ ├── dovecot.index.log │ │ ├── dovecot-uidlist │ │ ├── maildirfolder │ │ ├── new │ │ └── tmp │ ├── .Sent Messages │ │ ├── cur │ │ ├── dovecot.index.log │ │ ├── dovecot-uidlist │ │ ├── maildirfolder │ │ ├── new │ │ └── tmp │ ├── .Spam │ │ ├── cur │ │ ├── dovecot.index.cache │ │ ├── dovecot.index.log │ │ ├── dovecot-uidlist │ │ ├── maildirfolder │ │ ├── new │ │ └── tmp │ ├── subscriptions │ ├── tmp │ └── .Trash │ ├── cur │ ├── dovecot.index.cache │ ├── dovecot.index.log │ ├── dovecot-uidlist │ ├── maildirfolder │ ├── new │ └── tmp └── .sieve ├── managesieve.sieve └── tmp 30 directories, 41 files I know at one point sieve files must have been replicating with dsync, it's just not clear to me at which version of dovecot and pigeonhole this began with the exception of mail files which are replicating. Cheers, Tony

2 1

Re: replication fails and corrupts index with zlib enabled
by fauno 05 Aug '18

05 Aug '18

El 04/08/18 a las 13:13, Aki Tuomi escribió: > There has definetly been fixes in this area since 2.2.13 and most likely your issue is fixed. Thanks! I built 2.2.36, I'll test it and come back with results :)

1 0

Assertion failure with IMAP NOTIFY
by Florian Pritz 05 Aug '18

05 Aug '18

Hi, For a few weeks I've been running a custom notification script[1] that uses IMAP NOTIFY. The script uses a single connection, sets up a NOTIFY watch on a couple of mailboxes + automatic FETCH for the selected mailbox. If a status update arrives for a different mailbox, it selects that box and fetches the mail. Today I got the following error in the log: > Aug 5 14:56:12 karif dovecot[1881]: imap(xxxx)<22699><TBjUXqtyZI5R2c0k>: Panic: file mail.c: line 242 (mail_get_header_stream): assertion failed: (headers->box == mail->box) > Aug 5 14:56:12 karif dovecot[1881]: imap(xxxx)<22699><TBjUXqtyZI5R2c0k>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xcfbff) [0x7fda11806bff] -> /usr/lib/dovecot/libdovecot.so.0(+0xcfcba) [0x7fda11806cba] -> /usr/lib/dovecot/libdovecot.so.0(+0x414bb) [0x7fda117784bb] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x3566e) [0x7fda11aec66e] -> /usr/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0x43b) [0x7fda11bb3a1b] -> dovecot/imap(+0x211ed) [0x55e00d2a21ed] -> dovecot/imap(+0x1f69c) [0x55e00d2a069c] -> dovecot/imap(imap_fetch_more_no_lock_update+0xf) [0x55e00d2a17ff] -> dovecot/imap(+0x23891) [0x55e00d2a4891] -> dovecot/imap(imap_client_notify_newmails+0xfa) [0x55e00d2a4a6a] -> dovecot/imap(imap_sync_more+0x755) [0x55e00d2a9f75] -> dovecot/imap(+0x29006) [0x55e00d2aa006] -> dovecot/imap(cmd_sync_delayed+0x27b) [0x55e00d2aa50b] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0x10d) [0x7fda1181c82d] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xd2) [0x7fda1181df52] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x4d) [0x7fda1181caad] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x41) [0x7fda1181cc11] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x14) [0x7fda117a0074] -> dovecot/imap(main+0x342) [0x55e00d28fb82] -> /usr/lib/libc.so.6(__libc_start_main+0xeb) [0x7fda1139e06b] -> dovecot/imap(_start+0x2a) [0x55e00d28fd1a] > Aug 5 14:56:12 karif dovecot[1881]: imap(xxxx)<22699><TBjUXqtyZI5R2c0k>: Fatal: master: service(imap): child 22699 killed with signal 6 (core not dumped - https://dovecot.org/bugreport.html#coredumps - set /proc/sys/fs/suid_dumpable to 2) I'm not sure what happened exactly, but I can tell you that a new mail, that went to the selected mailbox (INBOX), was arriving at the time of the crash. The script logs the IMAP traffic (sadly without timestamps so far). Here's a slightly censored (3 dots in a few places) and stripped log in the hope that it helps. Lines prefixed with >> are sent to the server, those with << are received from the server. > [login stuff] > server-speed >> CMD-2 notify set (selected (MessageExpunge MessageNew (uid body.peek[header.fields (from to subject)]))) (mailboxes (INBOX INBOX.Postmaster ... ... ... ...) (MessageNew MessageExpunge MailboxName)) > server-speed << CMD-2 OK NOTIFY completed (0.002 + 0.000 + 0.001 secs). > [various untagged fetches/selects + fetch/noops] > [script was in a different mailbox, status update for INBOX arrives thus script select INBOX] > server-speed >> CMD-51 select INBOX > server-speed << * OK [CLOSED] Previous mailbox closed. > server-speed << * FLAGS (\Answered \Flagged \Deleted \Seen \Draft $MDNSent Junk redirected $label2 $label4 $label5 NonJunk $Forwarded $label3 $label1 done Old) > server-speed << * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft $MDNSent Junk redirected $label2 $label4 $label5 NonJunk $Forwarded $label3 $label1 done Old \*)] Flags permitted. > server-speed << * 20 EXISTS > server-speed << * 1 RECENT > server-speed << * OK [UNSEEN 14] First unseen. > server-speed << * OK [UIDVALIDITY 1336752926] UIDs valid > server-speed << * OK [UIDNEXT 41885] Predicted next UID > server-speed << * OK [HIGHESTMODSEQ 138681] Highest > server-speed << CMD-51 OK [READ-WRITE] Select completed (0.001 + 0.000 secs). > server-speed >> CMD-52 uid fetch 41884 (body.peek[header.fields (from to subject)]) > server-speed << * 20 FETCH (UID 41884 BODY[HEADER.FIELDS (FROM TO SUBJECT)] {164} > server-speed << From: ... > server-speed << To: ... > server-speed << Subject: ... > server-speed << > server-speed << ) > server-speed << CMD-52 OK Fetch completed (0.001 + 0.000 secs). > Got data for notification: [...] > Sending notification with data: {...} > [the next few lines happen over a span of roughly 9 minutes] > server-speed << * 20 EXPUNGE > server-speed << * 0 RECENT > server-speed << * 8 EXPUNGE > server-speed << * 11 EXPUNGE > server-speed << * 18 EXISTS > server-speed << * 1 RECENT > server-speed << * 18 FETCH (UID 41885 > [this is apparnently when the server crashed] I'm afraid I can't reproduce the issue and I don't have the time to try right now, so I can't provide much more information than what is in here. Still, if you have questions, feel free to ask me. Just know that I won't be getting you a better backtrace/coredump any time soon. [1] https://git.server-speed.net/users/flo/App-ImapNotify/tree/ Florian

1 1

limit sharing ability to certain users
by simeon.ott＠onnet.ch 05 Aug '18

05 Aug '18

Hello Is it possible to limit the ability of sharing it’s own mailboxes to only a few users? We have a few sensitive mailboxes of users where the ability to share via IMAP SETACL should be prevented. I tried the following so far… doveadm acl remove -u test(a)onnet.ch <mailto:test@onnet.ch> INBOX user=test(a)onnet.ch <mailto:user=test@onnet.ch> admin but when doing this the admin rights are still there doveadm acl rights -u test(a)onnet.ch <mailto:test@onnet.ch> INBOX vmail@buserver:~$ doveadm acl rights -u test(a)onnet.ch <mailto:test@onnet.ch> INBOX Rights lookup read write write-seen write-deleted insert post expunge create delete admin Thanks in advance for your help Simeon

1 0

replication fails and corrupts index with zlib enabled
by fauno 04 Aug '18

04 Aug '18

Hi, I have two Debian Jessie servers with Dovecot 2.2.13 TCP replication on that have worked fine for years, but now one of them is running low on disk space, so I wanted to try enabling zlib. I crafted a script following the description given in https://wiki.dovecot.org/Plugins/Zlib and xz'ed some inboxes on the stand-by server, the one with low disk space. So every email in those inboxes is xz'ed but the file name hasn't changed and contains the original size. This server is on stand-by so most of the email is replicated unidirectionally to it. But administrative emails like cronjobs and monitoring are delivered locally, so it replicates those to the hot server. The issue appeared when this stand-by server receives such an email and tries to replicate them to the other server. I'm attaching the full snippet of the log from the hot server, because it throws a longer backtrace. The short version is like this: dovecot[8438]: imap(redacted(a)address.org): Error: Cached message size larger than expected (478 > 289) dovecot[8438]: imap(redacted(a)address.org): Error: Maildir filename has wrong S value, renamed the file from /srv/email/address.org/redacted/Maildir/cur/1533393328.M502775P20341.standby_server,S=478:2, to /srv/email/address.org/redacted/Maildir/cur/1533393328.M502775P20341.standby_server,S=289:2, dovecot[8438]: imap(redacted(a)address.org): Error: Corrupted index cache file /srv/email/address.org/redacted/Maildir/dovecot.index.cache: Broken physical size for mail UID 45123 After this there's an error and the replication fails. The file is there, it's gzipped and can be zcat'ed but it appears as a blank email on clients. I've recovered a backup but the issue persists. I also changed from xz to gz because the Debian package docs only mention gz and bzip2, but the issue is the same. From what I understand and tested, the stand-by server is receiving the email and compressing it but maintaining the original size on the file name. So that's ok, but when the hot server receives the copy, it believes the size is wrong and changes it to the compressed size. Then for some reason the index gets corrupted. I'm attaching the doveconf for both servers. They're mostly the same, and the only changes introduced were the zlib plugin and its options. Also the script(s) that I used to compress the inboxes. Am I correct? Is it an issue of replicator not understanding the emails are compressed? I couldn't find anything related to zlib with replication. Maybe it's something fixed in newer versions and I should go that rabbit hole? Thanks! :)

2 1

Proxy lmtp to smtp server
by grupo correo 03 Aug '18

03 Aug '18

Hi, I need to use lmtp server proxy, to proxy a remote smtp server, the documentation says "It's possible to use Dovecot LMTP server as a proxy to remote LMTP or SMTP servers", but i do not find how to configure. Can anybody gel me to understand? Best regards

3 6

Re: ssl_dh required, even though DH is disabled.
by Aki Tuomi 03 Aug '18

03 Aug '18

Hi! This change has now been committed, please find it at https://github.com/dovecot/core/compare/cd08262%5E...dd6323.patch Aki On 16.07.2018 09:53, Aki Tuomi wrote: > This is a known issue, but thanks for reporting it. > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Eric Toombs <ewtoombs(a)uwaterloo.ca> > Date: 16/07/2018 08:41 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: ssl_dh required, even though DH is disabled. > > Here's my config: > > # 2.3.2 (582970113): /etc/dovecot/dovecot.conf > # OS: Linux 4.17.5-1-ARCH x86_64 Arch Linux > # Hostname: vault > passdb { > driver = pam > } > protocols = imap > service imap-login { > inet_listener imap { > port = 0 > } > } > ssl = required > ssl_cert = </etc/letsencrypt/live/myhostname.com/fullchain.pem > ssl_cipher_list = > ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA:ECDHE-ECDSA-AES256-SHA:ECDHE-ECDSA-AES128-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-RSA-AES256-SHA:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA384 > ssl_key = # hidden, use -P to show it > ssl_min_protocol = TLSv1.2 > > My filesystem is ext4. > > Even though I use ssl_cipher_list to forbid DH, dovecot still doesn't > work unless I provide an ssl_dh, delivering the following error: > > > Jul 14 21:48:08 vault dovecot[8349]: imap-login: Error: Failed to > initialize SSL server context: Couldn't parse DH parameters: > error:0906D06C:PEM routines:PEM_read_bio:no start line: Expecting: DH > PARAMETERS: user=<>, rip=10.0.0.1, lip=10.0.0.2, > session=<4sGi5/9w3pwKAAAB> > > While providing an ssl_dh is only a minor annoyance, it would be nice if > I didn't have to.

1 0

Dovecot lifecycle announcement
by Aki Tuomi 03 Aug '18

03 Aug '18

Hi! We are giving the following end of life (EOL) statements: For any version before 2.2, we are not going to be providing any patches or fixes. This has been the case before, but we are now officially declaring them EOL. For 2.2 versions, we are going to provide security and critical bug fixes for 2.2.36 only. If you are using 2.2.x version prior to .36, we will not be providing anything other than critical security fixes. This means that if you are experiencing a problem with Dovecot, we need you to upgrade into latest 2.3 release and reproduce the problem there. If this happens, please file a bug report and we are more than happy to take a look! If you are using a 2.2.x version packaged from an Operating System Vendor, please open a bug against them for fixing it. We do not provide patches or bug fixes against these OS Vendor specific releases. 2.3.x is the current main release, which will receive feature, bug and security patches. We accept bug reports against latest 2.3 version or master version of Dovecot. If you need packages for 2.3, please see https://repo.dovecot.org. Thank you for using Dovecot! Note: Users with a commercial agreement with Open-Xchange (Dovecot Pro) have a separate EOL policy, so this announcement does not apply to those customers. Aki Tuomi Open-Xchange Oy

1 0

Debugging rules with Pigeonhole Sieve
by Pete Gonzalez 03 Aug '18

03 Aug '18

I have a lot of rules in my Sieve script. Sometimes an email message ends up in the wrong folder, due to a problem with one of the rules. However, this is very difficult to debug, because I have no idea which rule matched the email. A log file might be helpful, but that wouldn't be readable without shell access to the mail server. This is not a solution that would work for everyday users, who configure their rules via a web page UI. What would be great would be for the Sieve interpreter to append a custom header to each email message after it gets processed. This header would record which Sieve rules matched the email. Does this feature exist already? Or is there a way to accomplish it via the Dovecot server configuration? Thanks!

1 0

Managesieve stopped working - Undefined symbol "i_stream_read_memarea"
by Henrik Larsson 02 Aug '18

02 Aug '18

After upgrading Dovecot to 2.3.2.1 and Pigeonhole to 0.5.2, managesieve stopped working. I'm using FreeBSD ports tree, to build these. Only domains have been modified in below output. A FreeBSD bug report have also been created. But I'm not sure if this is FreeBSD ports related or Dovecot/Pigeonhole related: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=228067 %uname -a FreeBSD 10.4-RELEASE-p9 FreeBSD 10.4-RELEASE-p9 #0: Sat Jul 14 22:38:37 CEST 2018 /usr/obj/usr/src/sys/GENERIC amd64 %pkg version -v dovecot-2.3.2.1 = up-to-date with index dovecot-pigeonhole-0.5.2_2 = up-to-date with index %dmesg -a /usr/local/libexec/dovecot/managesieve: Undefined symbol "i_stream_read_memarea" doveconf: Error: managesieve-login: dump-capability process returned 1 % dovecot -n # 2.3.2.1 (0719df592): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.5.2 (7704de5e) /usr/local/libexec/dovecot/managesieve: Undefined symbol "i_stream_read_memarea" doveconf: Error: managesieve-login: dump-capability process returned 1 # OS: FreeBSD 10.4-RELEASE-p9 amd64 # Hostname: mail.example.com auth_mechanisms = plain login first_valid_uid = 125 hostname = mail.example.com listen = * log_path = /var/log/dovecot mail_plugins = zlib mail_privileged_group = postfix mail_temp_dir = /var/db/dovecot namespace compat { hidden = yes inbox = no list = no location = prefix = INBOX. separator = . type = private } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox "Sent Items" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = . type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { fts = squat fts_squat = partial=4 full=10 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)example.com protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { unix_listener /home/mail/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } service lmtp { executable = lmtp -L unix_listener /home/mail/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/example.com-chained.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { log_path = /var/log/dovecot-deliver mail_plugins = zlib sieve } protocol lda { mail_plugins = zlib sieve } protocol imap { mail_max_userip_connections = 30 mail_plugins = zlib imap_zlib }

2 5

Re: LMTP error, mysterious
by Andras Kemeny 02 Aug '18

02 Aug '18

you mean i should define another, "fallback" userdb service if prefetch doesn't work for some reason? is it the problem that it's a chicken and egg scenario and with LMTP address verification (from postfix) there is no login beforehand so then dovecot needs to consult the userdb once again and having no fallback mechanism, it gives up? i can understand that, but then it would need to be emphasized in either the prefetch document or the lmtp document on the wiki. i've tried it and now it works, thank you ever so much. (but please make a mental note to add this info on the wiki.) cheers, a 2018. 08. 02. 1:10 keltezéssel, Aki Tuomi írta: > applies for ldap too if you use prefetch. > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Andras Kemeny <pdx(a)pdx.hu> > Date: 02/08/2018 01:59 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: Re: LMTP error, mysterious > > ah well, but i'm not using sql at all. > > here's doveconf -n: > > # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.16 (fed8554) > # OS: Linux 4.9.0-4-amd64 x86_64 Debian 9.4 > auth_cache_negative_ttl = 0 > auth_mechanisms = plain login > hostname = rhyno.tech > mail_debug = yes > mail_location = maildir:~/mail > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > protocols = " imap lmtp pop3" > service auth-worker { > user = $default_internal_user > } > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > } > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > } > service lmtp { > process_min_avail = 5 > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0600 > user = postfix > } > } > service pop3-login { > inet_listener pop3 { > port = 0 > } > inet_listener pop3s { > port = 0 > } > } > ssl_cert = </etc/letsencrypt/live/wc-rhyno.tech/fullchain.pem > ssl_key = # hidden, use -P to show it > submission_host = localhost:25 > userdb { > driver = prefetch > } > protocol lmtp { > mail_plugins = sieve > } > protocol lda { > mail_plugins = sieve > } > protocol imap { > imap_client_workarounds = tb-extra-mailbox-sep > } > > > 2018. 08. 02. 0:48 keltezéssel, Aki Tuomi írta: >> protocol lmtp { >> userdb { >> driver = sql >> args = /path/to/dovecot-sql.conf.ext >> } >> } >> >> >> >> --- >> Aki Tuomi >> Dovecot oy >> >> -------- Original message -------- >> From: Andras Kemeny <pdx(a)pdx.hu> >> Date: 02/08/2018 01:35 (GMT+02:00) >> To: dovecot(a)dovecot.org >> Subject: LMTP error, mysterious >> >> hi (especially to you, Aki), >> >> so to solve the previous UID issue, i went the full LMTP route. however, >> i seem to be having problems with the prefetch userdb (i'm trying to >> minimize load on the LDAP server). namely, the log says: >> >> Aug 2 00:15:35 rhyno postfix/submission/smtpd[21158]: 5EEF35C05C5: >> client=localhost[127.0.0.1], sasl_method=login, sasl_username=aik >> Aug 2 00:15:40 rhyno postfix/cleanup[22201]: 5EEF35C05C5: >> message-id=<20180801221535.5EEF35C05C5(a)beach.rhyno.tech> >> Aug 2 00:15:40 rhyno postfix/qmgr[17437]: 5EEF35C05C5: >> from=<pdx(a)pdx.hu>, size=295, nrcpt=1 (queue active) >> Aug 2 00:15:40 rhyno dovecot: lmtp(20321): Connect from local >> Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): >> userdb lookup not possible with only userdb prefetch >> Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user >> aik(a)rhyno.tech: Auth USER lookup failed >> Aug 2 00:15:41 rhyno postfix/lmtp[22211]: 5EEF35C05C5: >> to=<aik(a)rhyno.tech>, relay=beach.rhyno.tech[private/dovecot-lmtp], >> delay=13, delays=13/0.01/0/0.03, dsn=4.3.0, status=deferred (host >> beach.rhyno.tech[private/dovecot-lmtp] said: 451 4.3.0 <aik(a)rhyno.tech> >> Internal error occurred. Refer to server log for more information. (in >> reply to RCPT TO command)) >> Aug 2 00:15:41 rhyno dovecot: lmtp(20321): Disconnect from local: >> Successful quit >> Aug 2 00:15:42 rhyno postfix/submission/smtpd[21158]: disconnect from >> localhost[127.0.0.1] ehlo=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=6 >> >> (the above is a transcript of a full session i've done over telneting to >> localhost 587 and auth login-ing with valid credentials) >> >> so, i've tested the actual login process, and it works flawlessly, and >> it looks like IMAP is up and running: >> >> Connected to localhost. >> Escape character is '^]'. >> * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE >> IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. >> 0 login aik(a)rhyno.tech ofCourseThisIsN0TtheRealPassword >> 0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE >> IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS >> THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN >> NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH >> ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE >> SPECIAL-USE] Logged in >> 1 list "" "%" >> * LIST (\HasNoChildren \Sent) "." Sent >> * LIST (\HasNoChildren \Trash) "." Trash >> * LIST (\HasNoChildren) "." INBOX >> 1 OK List completed (0.000 + 0.000 secs). >> 2 status INBOX (MESSAGES) >> * STATUS INBOX (MESSAGES 2) >> 2 OK Status completed (0.000 + 0.000 secs). >> >> this is how i send the test mails: >> >> Connected to localhost. >> Escape character is '^]'. >> 220 beach.rhyno.tech mail server >> ehlo x >> 250-beach.rhyno.tech >> 250-PIPELINING >> 250-SIZE 10240000 >> 250-ETRN >> 250-STARTTLS >> 250-AUTH PLAIN LOGIN >> 250-AUTH=PLAIN LOGIN >> 250-ENHANCEDSTATUSCODES >> 250-8BITMIME >> 250-DSN >> 250 SMTPUTF8 >> auth login >> 334 VXNlcm5hbWU6 >> ***obviously_masked*** >> 334 UGFzc3dvcmQ6 >> ***obviously_masked*** >> 235 2.7.0 Authentication successful >> mail from:<pdx(a)pdx.hu> >> 250 2.1.0 Ok >> rcpt to:<aik(a)rhyno.tech> >> 250 2.1.5 Ok >> data >> 354 End data with <CR><LF>.<CR><LF> >> test >> . >> 250 2.0.0 Ok: queued as 5EEF35C05C5 >> quit >> 221 2.0.0 Bye >> Connection closed by foreign host. >> >> my concern is these two: >> >> Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): >> userdb lookup not possible with only userdb prefetch >> Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user >> aik(a)rhyno.tech: Auth USER lookup failed >> >> 10-auth.conf has these settings: >> >> passdb { >> driver = ldap >> args = /etc/dovecot/dovecot-ldap.conf.ext >> } >> userdb { >> driver = prefetch >> } >> >> dovecot-ldap.conf.ext has these settings (only the relevant ones) >> >> dn = ***whatever, it works*** >> dnpass = ***whatever, it works*** >> auth_bind = no >> base = dc=rhyno,dc=tech >> pass_attrs = \ >> =user=%{ldap:uid}, \ >> =password=%{ldap:userPassword}, \ >> =userdb_home=%{ldap:homeDirectory}, \ >> =userdb_uid=%{ldap:uidNumber}, \ >> =userdb_gid=%{ldap:gidNumber} >> pass_filter = >> (&(objectclass=postfixUser)(mailacceptinggeneralid=%n)(mailacceptinggeneralid=@%d)) >> >> so what am i missing? also, this format of setting variables >> (=<output_field>=%{<whatever_special_result_field>}) is never explained >> on the wiki (or am i just blind?) >> >> thanks in advance, >> a >> >

1 0

Re: LMTP error, mysterious
by Andras Kemeny 02 Aug '18

02 Aug '18

ah well, but i'm not using sql at all. here's doveconf -n: # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-4-amd64 x86_64 Debian 9.4 auth_cache_negative_ttl = 0 auth_mechanisms = plain login hostname = rhyno.tech mail_debug = yes mail_location = maildir:~/mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocols = " imap lmtp pop3" service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl_cert = </etc/letsencrypt/live/wc-rhyno.tech/fullchain.pem ssl_key = # hidden, use -P to show it submission_host = localhost:25 userdb { driver = prefetch } protocol lmtp { mail_plugins = sieve } protocol lda { mail_plugins = sieve } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep } 2018. 08. 02. 0:48 keltezéssel, Aki Tuomi írta: > protocol lmtp { > userdb { > driver = sql > args = /path/to/dovecot-sql.conf.ext > } > } > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Andras Kemeny <pdx(a)pdx.hu> > Date: 02/08/2018 01:35 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: LMTP error, mysterious > > hi (especially to you, Aki), > > so to solve the previous UID issue, i went the full LMTP route. however, > i seem to be having problems with the prefetch userdb (i'm trying to > minimize load on the LDAP server). namely, the log says: > > Aug 2 00:15:35 rhyno postfix/submission/smtpd[21158]: 5EEF35C05C5: > client=localhost[127.0.0.1], sasl_method=login, sasl_username=aik > Aug 2 00:15:40 rhyno postfix/cleanup[22201]: 5EEF35C05C5: > message-id=<20180801221535.5EEF35C05C5(a)beach.rhyno.tech> > Aug 2 00:15:40 rhyno postfix/qmgr[17437]: 5EEF35C05C5: > from=<pdx(a)pdx.hu>, size=295, nrcpt=1 (queue active) > Aug 2 00:15:40 rhyno dovecot: lmtp(20321): Connect from local > Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): > userdb lookup not possible with only userdb prefetch > Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user > aik(a)rhyno.tech: Auth USER lookup failed > Aug 2 00:15:41 rhyno postfix/lmtp[22211]: 5EEF35C05C5: > to=<aik(a)rhyno.tech>, relay=beach.rhyno.tech[private/dovecot-lmtp], > delay=13, delays=13/0.01/0/0.03, dsn=4.3.0, status=deferred (host > beach.rhyno.tech[private/dovecot-lmtp] said: 451 4.3.0 <aik(a)rhyno.tech> > Internal error occurred. Refer to server log for more information. (in > reply to RCPT TO command)) > Aug 2 00:15:41 rhyno dovecot: lmtp(20321): Disconnect from local: > Successful quit > Aug 2 00:15:42 rhyno postfix/submission/smtpd[21158]: disconnect from > localhost[127.0.0.1] ehlo=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=6 > > (the above is a transcript of a full session i've done over telneting to > localhost 587 and auth login-ing with valid credentials) > > so, i've tested the actual login process, and it works flawlessly, and > it looks like IMAP is up and running: > > Connected to localhost. > Escape character is '^]'. > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. > 0 login aik(a)rhyno.tech ofCourseThisIsN0TtheRealPassword > 0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS > THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN > NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH > ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE > SPECIAL-USE] Logged in > 1 list "" "%" > * LIST (\HasNoChildren \Sent) "." Sent > * LIST (\HasNoChildren \Trash) "." Trash > * LIST (\HasNoChildren) "." INBOX > 1 OK List completed (0.000 + 0.000 secs). > 2 status INBOX (MESSAGES) > * STATUS INBOX (MESSAGES 2) > 2 OK Status completed (0.000 + 0.000 secs). > > this is how i send the test mails: > > Connected to localhost. > Escape character is '^]'. > 220 beach.rhyno.tech mail server > ehlo x > 250-beach.rhyno.tech > 250-PIPELINING > 250-SIZE 10240000 > 250-ETRN > 250-STARTTLS > 250-AUTH PLAIN LOGIN > 250-AUTH=PLAIN LOGIN > 250-ENHANCEDSTATUSCODES > 250-8BITMIME > 250-DSN > 250 SMTPUTF8 > auth login > 334 VXNlcm5hbWU6 > ***obviously_masked*** > 334 UGFzc3dvcmQ6 > ***obviously_masked*** > 235 2.7.0 Authentication successful > mail from:<pdx(a)pdx.hu> > 250 2.1.0 Ok > rcpt to:<aik(a)rhyno.tech> > 250 2.1.5 Ok > data > 354 End data with <CR><LF>.<CR><LF> > test > . > 250 2.0.0 Ok: queued as 5EEF35C05C5 > quit > 221 2.0.0 Bye > Connection closed by foreign host. > > my concern is these two: > > Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): > userdb lookup not possible with only userdb prefetch > Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user > aik(a)rhyno.tech: Auth USER lookup failed > > 10-auth.conf has these settings: > > passdb { > driver = ldap > args = /etc/dovecot/dovecot-ldap.conf.ext > } > userdb { > driver = prefetch > } > > dovecot-ldap.conf.ext has these settings (only the relevant ones) > > dn = ***whatever, it works*** > dnpass = ***whatever, it works*** > auth_bind = no > base = dc=rhyno,dc=tech > pass_attrs = \ > =user=%{ldap:uid}, \ > =password=%{ldap:userPassword}, \ > =userdb_home=%{ldap:homeDirectory}, \ > =userdb_uid=%{ldap:uidNumber}, \ > =userdb_gid=%{ldap:gidNumber} > pass_filter = > (&(objectclass=postfixUser)(mailacceptinggeneralid=%n)(mailacceptinggeneralid=@%d)) > > so what am i missing? also, this format of setting variables > (=<output_field>=%{<whatever_special_result_field>}) is never explained > on the wiki (or am i just blind?) > > thanks in advance, > a >

2 1

LMTP error, mysterious
by Andras Kemeny 02 Aug '18

02 Aug '18

hi (especially to you, Aki), so to solve the previous UID issue, i went the full LMTP route. however, i seem to be having problems with the prefetch userdb (i'm trying to minimize load on the LDAP server). namely, the log says: Aug 2 00:15:35 rhyno postfix/submission/smtpd[21158]: 5EEF35C05C5: client=localhost[127.0.0.1], sasl_method=login, sasl_username=aik Aug 2 00:15:40 rhyno postfix/cleanup[22201]: 5EEF35C05C5: message-id=<20180801221535.5EEF35C05C5(a)beach.rhyno.tech> Aug 2 00:15:40 rhyno postfix/qmgr[17437]: 5EEF35C05C5: from=<pdx(a)pdx.hu>, size=295, nrcpt=1 (queue active) Aug 2 00:15:40 rhyno dovecot: lmtp(20321): Connect from local Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): userdb lookup not possible with only userdb prefetch Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user aik(a)rhyno.tech: Auth USER lookup failed Aug 2 00:15:41 rhyno postfix/lmtp[22211]: 5EEF35C05C5: to=<aik(a)rhyno.tech>, relay=beach.rhyno.tech[private/dovecot-lmtp], delay=13, delays=13/0.01/0/0.03, dsn=4.3.0, status=deferred (host beach.rhyno.tech[private/dovecot-lmtp] said: 451 4.3.0 <aik(a)rhyno.tech> Internal error occurred. Refer to server log for more information. (in reply to RCPT TO command)) Aug 2 00:15:41 rhyno dovecot: lmtp(20321): Disconnect from local: Successful quit Aug 2 00:15:42 rhyno postfix/submission/smtpd[21158]: disconnect from localhost[127.0.0.1] ehlo=1 auth=1 mail=1 rcpt=1 data=1 quit=1 commands=6 (the above is a transcript of a full session i've done over telneting to localhost 587 and auth login-ing with valid credentials) so, i've tested the actual login process, and it works flawlessly, and it looks like IMAP is up and running: Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. 0 login aik(a)rhyno.tech ofCourseThisIsN0TtheRealPassword 0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SPECIAL-USE] Logged in 1 list "" "%" * LIST (\HasNoChildren \Sent) "." Sent * LIST (\HasNoChildren \Trash) "." Trash * LIST (\HasNoChildren) "." INBOX 1 OK List completed (0.000 + 0.000 secs). 2 status INBOX (MESSAGES) * STATUS INBOX (MESSAGES 2) 2 OK Status completed (0.000 + 0.000 secs). this is how i send the test mails: Connected to localhost. Escape character is '^]'. 220 beach.rhyno.tech mail server ehlo x 250-beach.rhyno.tech 250-PIPELINING 250-SIZE 10240000 250-ETRN 250-STARTTLS 250-AUTH PLAIN LOGIN 250-AUTH=PLAIN LOGIN 250-ENHANCEDSTATUSCODES 250-8BITMIME 250-DSN 250 SMTPUTF8 auth login 334 VXNlcm5hbWU6 ***obviously_masked*** 334 UGFzc3dvcmQ6 ***obviously_masked*** 235 2.7.0 Authentication successful mail from:<pdx(a)pdx.hu> 250 2.1.0 Ok rcpt to:<aik(a)rhyno.tech> 250 2.1.5 Ok data 354 End data with <CR><LF>.<CR><LF> test . 250 2.0.0 Ok: queued as 5EEF35C05C5 quit 221 2.0.0 Bye Connection closed by foreign host. my concern is these two: Aug 2 00:15:40 rhyno dovecot: auth: Error: prefetch(aik(a)rhyno.tech): userdb lookup not possible with only userdb prefetch Aug 2 00:15:40 rhyno dovecot: lmtp(aik(a)rhyno.tech): Error: user aik(a)rhyno.tech: Auth USER lookup failed 10-auth.conf has these settings: passdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext } userdb { driver = prefetch } dovecot-ldap.conf.ext has these settings (only the relevant ones) dn = ***whatever, it works*** dnpass = ***whatever, it works*** auth_bind = no base = dc=rhyno,dc=tech pass_attrs = \ =user=%{ldap:uid}, \ =password=%{ldap:userPassword}, \ =userdb_home=%{ldap:homeDirectory}, \ =userdb_uid=%{ldap:uidNumber}, \ =userdb_gid=%{ldap:gidNumber} pass_filter = (&(objectclass=postfixUser)(mailacceptinggeneralid=%n)(mailacceptinggeneralid=@%d)) so what am i missing? also, this format of setting variables (=<output_field>=%{<whatever_special_result_field>}) is never explained on the wiki (or am i just blind?) thanks in advance, a

2 1

[SIEVE] pipe :copy to external program with arguments
by spamvoll＠googlemail.com 02 Aug '18

02 Aug '18

Hi all, quick questions about sieve pipe: I want to pipe spam messages to an external program with additional parameters my spamlearn.sieve script: require ["vnd.dovecot.pipe", "copy", "imapsieve"]; pipe :copy "mybin" ["-h 127.0.0.1:44444" , "markspam"]; I also tried: pipe :copy "mybin" ["-h 127.0.0.1:44444 markspam"]; pipe :copy "mybin" ["-h 127.0.0.1:44444"] ["markspam"]; pipe :copy :args ["-h 127.0.0.1:44444 markspam"] "mybin" ; It never executes correct, it always ends with: Error: sieve: Execution of script /my/path/to/spamlearn.sieve failed So whats the correct syntax ? What works is a single argument: pipe :copy "myscript" ["markspam"]; Dovecot Version 2.3.2.1

3 2

Problems with Sieve and vnd.dovecot.pipe
by Haiko Hertes 02 Aug '18

02 Aug '18

Hello all! I have changed my mailserver from spamassasin and procmail to rspamd and sieve. Rspamd is working, but with some sieve script I still have problems. I have created a script to learn spam: haiko@SERVERNAME:~$ sudo cat /var/vmail/sieve/global/learn-spam.sieve require ["vnd.dovecot.pipe", "copy", "imapsieve"]; pipe :copy "rspamd-learn-spam.sh"; If I run sieve to use this script I get this: haiko@SERVERNAME:~$ sudo sieve /var/vmail/sieve/global/learn-spam.sieve sieve: vnd.dovecot.pipe: file not found sieve: can't require vnd.dovecot.pipe Speicherzugriffsfehler I think, my configs are OK: haiko@SERVERNAME:~$ doveconf -n # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.9.0-7-amd64 x86_64 Debian 9.5 auth_debug_passwords = yes auth_mechanisms = plain login PLAIN LOGIN auth_username_format = %Ln debug_log_path = /var/log/dovecot.log info_log_path = /var/log/dovecot.log listen = * log_path = /var/log/dovecot.log mail_gid = postfix mail_location = maildir:~/Maildir mail_privileged_group = postfix mail_uid = postfix managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacati on subaddress comparator-i;ascii-numeric relational regex imap4flags copy includ e variables body enotify environment mailbox date index ihave duplicate mime for everypart extracttext imapsieve namespace inbox { inbox = yes location = mailbox "Deleted Items" { special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . } passdb { driver = pam } passdb { driver = pam } plugin { imapsieve_mailbox1_before = file:/var/vmail/sieve/global/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/var/vmail/sieve/global/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * quota = maildir:User quota quota_exceeded_message = Benutzer %u hat das Speichervolumen überschritten. / User %u has exhausted allowed storage space. sieve = ~/.dovecot.sieve sieve_before = /var/vmail/sieve/global/spam-global.sieve sieve_extensions = +vnd.dovecot.pipe +vnd.dovecot.filter sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.filter sieve_implicit_extensions = +vnd.dovecot.pipe +vnd.dovecot.filter sieve_pipe_bin_dir = /var/vmail/sieve/global sieve_plugins = sieve_imapsieve sieve_extprograms sieve_trace_level = tests sieve_user_log = ~/.dovecot.sieve.log } postmaster_address = postmaster(a)hertes.net protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imaps { address = * } process_min_avail = 1 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { process_limit = 1024 } service pop3-login { inet_listener pop3s { address = * } } ssl = required ssl_cert = </etc/letsencrypt/live/hertes.net/fullchain.pem ssl_cipher_list = EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA256:EECD H:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:! RC4: !SEED:!IDEA:!ECDSA:kEDH:CAMELLIA128-SHA:AES128-SHA ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/%n driver = passwd } userdb { driver = passwd } protocol lmtp { mail_plugins = " sieve" postmaster_address = postmaster(a)hertes.net } protocol imap { imap_idle_notify_interval = 29 mins mail_max_userip_connections = 20 mail_plugins = " imap_quota imap_sieve quota imap_quota imap_sieve" } Does anyone of you have a hint what could be wrong here?? Thanks! Best regards, Haiko

2 1

Basic question about file permissions for sieve error log
by J Doe 02 Aug '18

02 Aug '18

Hello, I have an admittedly very basic question, but I am not able to get it to work. I store my global sieve script in: /etc/dovecot. I recently made a mistake in my global sieve script which causes Dovecot to attempt to log the errors in: /etc/dovecot/sieve-global.log In /var/log/dovecot.log I see: Jul 24 15:33:32 lmtp(test(a)example.com): Error: ABVWGAx/V1uKLAAA1B5X9w: sieve: failed to open logfile (LOGGING TO STDERR): open(/etc/dovecot/sieve-global.log) failed: Permission denied (euid=5000(vmail) egid=5000(vmail) missing +w perm: /etc/dovecot, we're not in group 122(dovecot), dir owned by 0:122 mode=0775) …but the group membership shows: $ sudo -u vmail groups vmail dovecot …and I restarted Dovecot, but the same error happens. What am I doing wrong ? Thanks, - J

3 2

LMTP Log
by Thomas Kristensen 02 Aug '18

02 Aug '18

Hey I got a server setup where the Postfix and dovecot is on separated servers. In the postfis log is goes like this on mail in: Jul 26 10:23:13 edimailsl2 postfix/smtpd[12812]: 41blTs18Bzz40nl: client=unknown[172.0.0.12] Jul 26 10:23:21 edimailsl2 postfix/cleanup[12825]: 41blTs18Bzz40nl: message-id=<> Jul 26 10:23:21 edimailsl2 postfix/qmgr[10666]: 41blTs18Bzz40nl: from=<tk(a)multimed.dk>, size=225, nrcpt=1 (queue active) Jul 26 10:23:21 edimailsl2 postfix/lmtp[12827]: 41blTs18Bzz40nl: to=<test(a)domain.dk>, relay=172.26.248.178[172.26.248.178]:2003, delay=8.6, delays=8.5/0.06/0.01/0.08, dsn=2.0.0, status=sent (250 2.0.0 <test(a)domain.dk> oCuyJ/mEWVvFfwAAbOxY/Q Saved) Jul 26 10:23:21 edimailsl2 postfix/qmgr[10666]: 41blTs18Bzz40nl: removed And the LMTP on the Dovecot server is: Jul 26 10:23:21 vanslmtpsl1 dovecot: lmtp(32709): Connect from 172.0.0.1 Jul 26 10:23:21 vanslmtpsl1 dovecot: lmtp(test@ domain.dk): msgid=unspecified: saved mail to INBOX Jul 26 10:23:21 vanslmtpsl1 dovecot: lmtp(32709): Disconnect from 172.0.0.1: Successful quit How can I make LMTP log the ID it gives postfix (oCuyJ/mEWVvFfwAAbOxY/Q)? So I can relate the logs from the 2 servers. Med venlig hilsen Thomas Kristensen [MM_mail_logo_3_AS] Storhaven 12 - 7100 Vejle Tlf: 75 72 54 99 - Fax: 75 72 65 33 E-mail: tk(a)multimed.dk<mailto:tk@multimed.dk>

2 1

question about using procmail
by Joe Wong 01 Aug '18

01 Aug '18

Hello, I am new to Dovecot, testing the setup with Solr FTS plugin. Currently I am using procmail to delivery email into user's mailbox. I am using maildir on file system. I found that if email is delivered via procmail, the indexer-worker is not being called. But when I move the email between folders via IMAP, indexer is involved. Is this expected? - Joe

3 5

lmtp + tcpwrap
by A. Schulze 01 Aug '18

01 Aug '18

Hello, Using the TCP Wrapper Dovecot could control access to IMAP and POP3 servers. Is it also possible to controll access to an LMTP Server listening on Port 24? Andreas

1 0

Re: Get rid of the "dbox-Mails"-folder
by Hativ 31 Jul '18

31 Jul '18

Hey Aki, DIRNAME with empty value has no effect, just like with FULLDIRNAME. "~/sdbox" instead of "~/" doesn't change that.. Greetings, Hativ Am 07.07.2018 um 20:24 schrieb Aki Tuomi: > Does it work better if you use > > mail_location=sdbox:~/sdbox:DIRNAME= > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Hativ <hativ3(a)gmail.com> > Date: 07/07/2018 20:53 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: Re: Get rid of the "dbox-Mails"-folder > > Hey again, > > sorry, but I have to correct me: Even with dot it's not working > completely. The subscriptions file is not created and the dovecot-acl > file has the wrong path, too. > > :-( > > Greetings, > > Hativ > > Am 07.07.2018 um 02:26 schrieb Hativ: >> Hey again, >> >> I've found a working configuration: mail_location = >> sdbox:~/:FULLDIRNAME=. >> >> I use a dot instead of slash or empty value. >> >> Now my folder structure looks like I want and Dovecot is working fine. >> >> Can anyone (maybe even a Dovecot developer?) say if the configuration >> is okay? I've tried to check the source code, but I don't know C as >> good as it's needed for that. >> >> Greetings, >> >> Hativ >> >> Am 06.07.2018 um 16:10 schrieb Hativ: >>> Hey to all, >>> >>> is it possible to get rid of the "dbox-Mails"-folder when using sdbox? >>> >>> Currently my folder structure looks like this (I hope the output >>> from tree would be formatted well): >>> /srv/mail/ >>> └── example.com >>> └── user >>> ├── dovecot-acl-list >>> ├── dovecot-attributes >>> ├── dovecot.list.index.log >>> ├── dovecot.mailbox.log >>> ├── dovecot-uidvalidity >>> ├── dovecot-uidvalidity.5b3f746f >>> ├── mailboxes >>> │ ├── Drafts >>> │ │ └── dbox-Mails >>> │ │ └── dovecot.index.log >>> │ ├── INBOX >>> │ │ └── dbox-Mails >>> │ │ ├── dovecot.index.cache >>> │ │ ├── dovecot.index.log >>> │ │ └── u.1 >>> │ ├── Junk >>> │ │ └── dbox-Mails >>> │ │ └── dovecot.index.log >>> │ ├── Sent >>> │ │ └── dbox-Mails >>> │ │ └── dovecot.index.log >>> │ └── Trash >>> │ └── dbox-Mails >>> │ └── dovecot.index.log >>> └── subscriptions >>> >>> I would like to let it look like this: >>> /srv/mail/ >>> └── example.com >>> └── user >>> ├── dovecot-acl-list >>> ├── dovecot-attributes >>> ├── dovecot.list.index.log >>> ├── dovecot.mailbox.log >>> ├── dovecot-uidvalidity >>> ├── dovecot-uidvalidity.5b3f746f >>> ├── mailboxes >>> │ ├── Drafts >>> │ │ └── dovecot.index.log >>> │ ├── INBOX >>> │ │ └── dovecot.index.cache >>> │ │ └── dovecot.index.log >>> │ │ └── u.1 >>> │ ├── Junk >>> │ │ └──dovecot.index.log >>> │ ├── Sent >>> │ │ └── dovecot.index.log >>> │ └── Trash >>> │ └── dovecot.index.log >>> └── subscriptions >>> >>> My path configuration: >>> mail_attribute_dict = file:%h/dovecot-attributes >>> mail_home = /srv/mail/%d/%n/ >>> mail_location = sdbox:~/ >>> >>> I have tried >>> mail_location = sdbox:~/:FULLDIRNAME= >>> and >>> mail_location = sdbox:~/:FULLDIRNAME=/ >>> but it doesn't work. >>> >>> The first doesn't change anything. The second auto-creates the >>> folders after first login like I want, but after next login they are >>> greyed out and no longer accessible. >>> >>> Is it possible to get rid of the "dbox-Mails"-folder? I want this >>> because I don't like to have an unneeded deep folder structure. Or >>> is there a good reason to let the "dbox-Mails" folder in my setup? >>> >>> Greetings, >>> >>> Hativ >>> >> >

2 2

Re: uid problem
by Aki Tuomi 31 Jul '18

31 Jul '18

https://wiki2.dovecot.org/HowTo/PostfixDovecotLMTP Aki On 31.07.2018 14:35, Andras Kemeny wrote: > > can you point me to an url regarding LTMP between postfix and dovecot? > it might be an area worth exploring for me. > > thanks, > a > > > 2018. 07. 31. 12:46 keltezéssel, Aki Tuomi írta: >> >> Well, I don't know about yuuuge security risk (not saying there isn't >> any...), but if this concerns you, you can also use LTMP instead, >> which is probably a better solution here. >> >> Aki >> >> >> On 31.07.2018 13:42, Andras Kemeny wrote: >>> >>> yeah, the only problem about that is it's a yuuuge security risk :), >>> and also, postfix simply won't let me: >>> >>> Jul 31 02:20:37 rhyno postfix/pipe[29532]: fatal: user= command-line >>> attribute specifies root privileges >>> >>> so it's entirely possible i'm knocking on the wrong door, and >>> instead i should be asking this in the postfix mailing list. >>> >>> however, i'm also worried about this: "to bypass this check, set: >>> service auth { unix_listener /var/run/dovecot/auth-userdb { >>> mode=0777 } }", as i have done what it says, and the check wasn't >>> bypassed so i'm wary about something bad coming up once i somehow >>> fix this initial UID problem. >>> >>> thanks, >>> a >>> >>> >>> 2018. 07. 31. 7:12 keltezéssel, Aki Tuomi írta: >>>> You could run dovecot-lda as root. It will setuid to correct account. >>>> >>>> >>>> >>>> --- >>>> Aki Tuomi >>>> Dovecot oy >>>> >>>> -------- Original message -------- >>>> From: Andras Kemeny <pdx(a)pdx.hu> >>>> Date: 31/07/2018 04:46 (GMT+02:00) >>>> To: dovecot(a)dovecot.org >>>> Subject: uid problem >>>> >>>> hi, >>>> >>>> contacting this mailing list is my last-ditch effort to somehow >>>> come to >>>> a working configuration where postfix "ends in" dovecot, IE for >>>> special >>>> LDAP-based users, featured in the virtual mailbox delivery, dovecot >>>> would act as LDA. >>>> >>>> here's the deal. >>>> >>>> i've set up dovecot's access to the LDAP server, and for the >>>> purposes of >>>> being an IMAP server and a SASL auth backend, dovecot works >>>> brilliantly >>>> and without a glitch. i can access my test mailbox (in maildir >>>> format), >>>> i can use the LDA as root and it delivers the message correctly >>>> (after a >>>> switch to the target user's UID), and even postfix's submission works >>>> with dovecot as its SASL backend. >>>> >>>> what does not work is dovecot as LDA from postfix. >>>> >>>> i'm getting these errors in the log: >>>> >>>> Jul 31 03:40:40 rhyno dovecot: lda(aik): Error: user aik: Auth USER >>>> lookup failed >>>> Jul 31 03:40:40 rhyno dovecot: auth: Error: userdb(aik): client >>>> doesn't >>>> have lookup permissions for this user: userdb uid (10001) doesn't >>>> match >>>> peer uid (5000) (to bypass this check, set: service auth { >>>> unix_listener >>>> /var/run/dovecot/auth-userdb { mode=0777 } }) >>>> Jul 31 03:40:40 rhyno dovecot: lda: Fatal: Internal error occurred. >>>> Refer to server log for more information. >>>> >>>> for the sake of clarity, i've tried the "to bypass this check" >>>> instructions, didn't help. >>>> >>>> also, for the sake of operational clarity, "aik" is the LDAP account >>>> with the following parameters: >>>> >>>> dn: uid=aik,ou=People,dc=rhyno,dc=tech >>>> objectClass: account >>>> objectClass: posixAccount >>>> objectClass: postfixUser >>>> cn: aik >>>> uid: aik >>>> uidNumber: 10001 >>>> gidNumber: 10001 >>>> homeDirectory: /home/aik >>>> loginShell: /bin/sh >>>> gecos: aik >>>> description: User account >>>> structuralObjectClass: account >>>> entryUUID: db947584-0369-1038-98b3-675e2f0cea17 >>>> creatorsName: cn=admin,dc=rhyno,dc=tech >>>> createTimestamp: 20180613152616Z >>>> email: *********** >>>> userPassword:: ************************* >>>> mailacceptinggeneralid: andras.kemeny >>>> mailacceptinggeneralid: kemeny.andras >>>> mailacceptinggeneralid: aik >>>> mailacceptinggeneralid: pdx >>>> mailacceptinggeneralid: @rhyno.tech >>>> mailacceptinggeneralid: @rhynotechnologies.com >>>> maildrop: aik >>>> >>>> and postfix's master.cf says: >>>> >>>> dovecot unix - n n - - pipe >>>> flags=ODRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -e -f >>>> ${sender} -d ${user} >>>> >>>> so i'm stuck at this point. obviously, if the LDA is spawned with >>>> vmail:vmail perms, it cannot become uid 10001 (btw, the LDAP and >>>> passwd >>>> accounts were once connected, but for security reasons, the connection >>>> has been severed -- still the /home/aik/mail dir is owned by uid >>>> 10001 etc). >>>> >>>> what am i doint wrong? >>>> >>>> thanks, >>>> a >>> >> >

1 0

Almost there with Sieve
by Danny Horne 31 Jul '18

31 Jul '18

Hi all, Dovecot - 2.2.35 Pigeonhole - 0.4.23 I've recently moved mail filtering from local filtering (using Thunderbird) to Sieve. I've got filtering into folders and flagging emails working fine, but for possibly one tiny glitch. When specifying folders to filter into I have to use the format 'INBOX/Folder name' instead of just 'Folder name'. Can this be corrected? No real biggie but would be nice if it could. [root@kepler ~]# dovecot -n # 2.2.35 (b1cb664): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.23 (b2e41927) # OS: Linux 4.17.3-200.fc28.x86_64 x86_64 Fedora release 28 (Twenty Eight) xfs # Hostname: kepler.trisect.uk auth_mechanisms = cram-md5 base_dir = /var/run/dovecot/ mail_access_groups = mail mail_home = /var/spool/vhosts/homedir/%d/%n mail_location = mbox:/var/spool/vhosts/%d/%n:INBOX=/var/spool/mail/%d/%n managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=cram-md5 /etc/cram-md5.pwd driver = passwd-file } passdb { driver = pam } plugin { sieve = file:/var/spool/vhosts/sieve-scripts;active=/var/spool/vhosts/sieve-scripts/%u.sieve sieve_user_email = postmaster(a)trisect.uk } protocols = imap lmtp sieve sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 0 vsz_limit = 256 M } service managesieve { process_limit = 1024 } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = # hidden, use -P to show it userdb { args = uid=vmail gid=vmail driver = static } userdb { driver = passwd } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol imap { mail_max_userip_connections = 200 } protocol sieve { mail_max_userip_connections = 25 managesieve_implementation_string = Dovecot Pigeonhole managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } Thanks for looking

2 2

Re: uid problem
by Aki Tuomi 31 Jul '18

31 Jul '18

Well, I don't know about yuuuge security risk (not saying there isn't any...), but if this concerns you, you can also use LTMP instead, which is probably a better solution here. Aki On 31.07.2018 13:42, Andras Kemeny wrote: > > yeah, the only problem about that is it's a yuuuge security risk :), > and also, postfix simply won't let me: > > Jul 31 02:20:37 rhyno postfix/pipe[29532]: fatal: user= command-line > attribute specifies root privileges > > so it's entirely possible i'm knocking on the wrong door, and instead > i should be asking this in the postfix mailing list. > > however, i'm also worried about this: "to bypass this check, set: > service auth { unix_listener /var/run/dovecot/auth-userdb { mode=0777 > } }", as i have done what it says, and the check wasn't bypassed so > i'm wary about something bad coming up once i somehow fix this initial > UID problem. > > thanks, > a > > > 2018. 07. 31. 7:12 keltezéssel, Aki Tuomi írta: >> You could run dovecot-lda as root. It will setuid to correct account. >> >> >> >> --- >> Aki Tuomi >> Dovecot oy >> >> -------- Original message -------- >> From: Andras Kemeny <pdx(a)pdx.hu> >> Date: 31/07/2018 04:46 (GMT+02:00) >> To: dovecot(a)dovecot.org >> Subject: uid problem >> >> hi, >> >> contacting this mailing list is my last-ditch effort to somehow come to >> a working configuration where postfix "ends in" dovecot, IE for special >> LDAP-based users, featured in the virtual mailbox delivery, dovecot >> would act as LDA. >> >> here's the deal. >> >> i've set up dovecot's access to the LDAP server, and for the purposes of >> being an IMAP server and a SASL auth backend, dovecot works brilliantly >> and without a glitch. i can access my test mailbox (in maildir format), >> i can use the LDA as root and it delivers the message correctly (after a >> switch to the target user's UID), and even postfix's submission works >> with dovecot as its SASL backend. >> >> what does not work is dovecot as LDA from postfix. >> >> i'm getting these errors in the log: >> >> Jul 31 03:40:40 rhyno dovecot: lda(aik): Error: user aik: Auth USER >> lookup failed >> Jul 31 03:40:40 rhyno dovecot: auth: Error: userdb(aik): client doesn't >> have lookup permissions for this user: userdb uid (10001) doesn't match >> peer uid (5000) (to bypass this check, set: service auth { unix_listener >> /var/run/dovecot/auth-userdb { mode=0777 } }) >> Jul 31 03:40:40 rhyno dovecot: lda: Fatal: Internal error occurred. >> Refer to server log for more information. >> >> for the sake of clarity, i've tried the "to bypass this check" >> instructions, didn't help. >> >> also, for the sake of operational clarity, "aik" is the LDAP account >> with the following parameters: >> >> dn: uid=aik,ou=People,dc=rhyno,dc=tech >> objectClass: account >> objectClass: posixAccount >> objectClass: postfixUser >> cn: aik >> uid: aik >> uidNumber: 10001 >> gidNumber: 10001 >> homeDirectory: /home/aik >> loginShell: /bin/sh >> gecos: aik >> description: User account >> structuralObjectClass: account >> entryUUID: db947584-0369-1038-98b3-675e2f0cea17 >> creatorsName: cn=admin,dc=rhyno,dc=tech >> createTimestamp: 20180613152616Z >> email: *********** >> userPassword:: ************************* >> mailacceptinggeneralid: andras.kemeny >> mailacceptinggeneralid: kemeny.andras >> mailacceptinggeneralid: aik >> mailacceptinggeneralid: pdx >> mailacceptinggeneralid: @rhyno.tech >> mailacceptinggeneralid: @rhynotechnologies.com >> maildrop: aik >> >> and postfix's master.cf says: >> >> dovecot unix - n n - - pipe >> flags=ODRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -e -f >> ${sender} -d ${user} >> >> so i'm stuck at this point. obviously, if the LDA is spawned with >> vmail:vmail perms, it cannot become uid 10001 (btw, the LDAP and passwd >> accounts were once connected, but for security reasons, the connection >> has been severed -- still the /home/aik/mail dir is owned by uid >> 10001 etc). >> >> what am i doint wrong? >> >> thanks, >> a >

1 0

2.3.2.1 - EC keys suppport?
by ѽ҉ᶬḳ℠ 31 Jul '18

31 Jul '18

Hi, facing [ no shared cipher ] error with EC private keys. This happens when the private key is generated with [ openssl ecparam -name brainpoolP512t1 -genkey ] with OpenSSL 1.1.0hh on the same machine Dovecot is running on. Tried some variations of [ ssl_cipher_list ] but to no avail - the [ no shared cipher ] error persists. Once the key is generated with [ openssl genpkey -algorithm RSA ] however the error is gone. Thus wondering whether (1) I am missing something or (2) this a bug or (3) there is no support for EC keys?

3 21

Re: dsync: expunge from pop3 does not replicate
by Jakub Lánský 31 Jul '18

31 Jul '18

Here is it # 2.3.2.1 (0719df592): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.2 (5d6d7c92) # OS: Linux 4.4.0-112-generic x86_64 Ubuntu 16.04.4 LTS # Hostname: mda22 auth_cache_negative_ttl = 2 secs auth_cache_size = 16 M auth_cache_ttl = 1 mins auth_master_user_separator = / auth_mechanisms = plain login auth_verbose = yes default_client_limit = 2000 default_process_limit = 2000 default_vsz_limit = 16894 M deliver_log_format = %m %f/%e %s -> %e %p: %$ dict { sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlsieve = mysql:/etc/dovecot/dovecot-dict-sqlsieve.conf.ext } disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lmtp_rcpt_check_quota = yes login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c login_trusted_networks = 10.3.13.0/24 10.3.14.0/24 mail_gid = nogroup mail_home = /datastore/maildir/%d/%n mail_location = maildir:~/ mail_plugins = " quota mail_log notify old_stats replication" mail_uid = nobody maildir_copy_with_hardlinks = no managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Inbox { auto = subscribe } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = subscriptions = yes type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = box msgid from subject size mail_replica = tcp:10.3.13.51:54321 old_stats_command_min_time = 1 mins old_stats_domain_min_time = 12 hours old_stats_ip_min_time = 12 hours old_stats_memory_limit = 16 M old_stats_refresh = 30 secs old_stats_session_min_time = 15 mins old_stats_track_cmds = yes old_stats_user_min_time = 1 hours quota = dict:User quota::proxy::sqlquota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 50%% quota_warning = storage=95%% quota-warning 95 %u %d size quota_warning2 = messages=95%% quota-warning 95 %u %d count recipient_delimiter = + sieve = file:/datastore/sieve/%d/%n/;active=/datastore/sieve/%d/%n/active.sieve sieve_before = dict:proxy::sqlsieve;name=before_inbox_forward;bindir=/datastore/sieve/%d/%n/ sieve_max_actions = 32 sieve_max_redirects = 50 sieve_max_script_size = 1M sieve_redirect_envelope_from = recipient sieve_user_log = /datastore/sieve/%d/%n/.sieve.log } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_reuse_xuidl = yes pop3_save_uidl = yes protocols = " imap lmtp sieve pop3 sieve" replication_max_conns = 100 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = nobody } unix_listener replication-notify { mode = 0666 user = nobody } } service auth { inet_listener { port = 12345 ssl = yes } } service dict { unix_listener dict { group = nogroup user = nobody } } service doveadm { inet_listener { port = 54321 ssl = no } } service imap-login { process_limit = 32 process_min_avail = 8 service_count = 0 } service imap { process_limit = 16384 } service lmtp { executable = lmtp -L inet_listener lmtp { port = 24 ssl = no } process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 2 service_count = 1 vsz_limit = 196 M } service managesieve { process_limit = 2048 } service old-stats { fifo_listener old-stats-mail { mode = 0666 user = nobody } inet_listener { address = 127.0.0.1 port = 24242 } } service pop3 { process_limit = 2048 } service quota-warning { executable = script /etc/dovecot/quota-warning.sh unix_listener quota-warning { mode = 0666 user = nobody } user = nobody } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 user = nobody } } service stats { idle_kill = 5 mins unix_listener stats-reader { group = nogroup mode = 0666 user = nobody } unix_listener stats-writer { group = nogroup mode = 0666 user = nobody } } ssl_cert = </etc/dovecot/private/mda.vshosting.cloud/fullchain.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes submission_host = 10.3.14.30:587 userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " quota mail_log notify old_stats replication sieve" } protocol lda { mail_plugins = " quota mail_log notify old_stats replication sieve" } protocol imap { mail_max_userip_connections = 50 mail_plugins = " quota mail_log notify old_stats replication imap_quota imap_old_stats" } protocol sieve { managesieve_max_line_length = 65536 } protocol pop3 { mail_max_userip_connections = 50 } -- Jakub Lánský IT administration/support technician jakub(a)lansky.biz GSM: +420776172737 Jabber/GTalk: lenny(a)blesmrt.net -------- Původní zpráva -------- Od: Aki Tuomi <aki.tuomi(a)dovecot.fi> Komu: Jakub Lánský <jakub(a)lansky.biz>, dovecot(a)dovecot.org Předmět: Re: dsync: expunge from pop3 does not replicate Datum: Wed, 25 Jul 2018 14:04:14 +0300 Please provide doveconf -n --- Aki Tuomi Dovecot oy -------- Original message -------- From: Jakub Lánský <jakub(a)lansky.biz> Date: 25/07/2018 11:37 (GMT+02:00) To: dovecot(a)dovecot.org Subject: dsync: expunge from pop3 does not replicate Hi, I'm using dovecot 2.3.2.1 on Xenial from upstream packages on two Dovecot servers connected with dsync over TCP. E-mails which are deleted via POP3 protocol are not correctly deleted on second server via dsync. Jul 25 09:29:19 mda11 dovecot: pop3(jakub@***)<7587><8xaJ1c1x9uEqAB7QADwAAAAAAAAAAL7v>: expunge: box=INBOX, msgid=<6a75db5d84ff257216a4340d7c0405b2(a)blesmrt.eu>, size=3238, from=lenny@***, subject=dovecot pop3 test Nothing happened on the second machine then. After running # doveadm replicator replicate "jakub@***", e-mail got expunged immediately on second server. Jul 25 09:50:56 mda22 dovecot: dsync- local(jakub@***)<Xt6oFy8nWFsjIwAA0YRh9g>: expunge: box=INBOX, msgid=< 6a75db5d84ff257216a4340d7c0405b2(a)blesmrt.eu>, size=3238, from=lenny@***, subject=dovecot pop3 test Any ideas what to do or test? Thank you

2 3

Welcome plugin - user and domain vars?
by Tony 31 Jul '18

31 Jul '18

Hi List, I have multiple mail domains and depending on the domain name was looking for a way to pass the user and domain into a welcome.sh script. I looked at the quota script and saw of the 3 vars one of them is for the user. BOUNDARY="$1" USER="$2" MSG="" For the username - could we still reference USER="$2" in order to pass the username in the welcome email or is this only supported with the quota plugin? For the domain - how could one pass the 1st time login user's mail domain to the script? I looked at the welcome-plugin.c source, but didn't find anything that might reference a domain. Ideally I was hoping maybe something similar to the quota script could work.. MSG="" if [[ "$DOMAIN" = "domain.net" ]]; then MSG="..." elif [[ "$DOMAIN" = "domain.com" ]]; then MSG="..." elif [[ "$DOMAIN" = "domain.me" ]]; then MSG="..." elif [[ "$DOMAIN" = "domain.email" ]]; then MSG="..." fi Thanks for any suggestions. Cheers, Tony

2 1

uid problem
by Andras Kemeny 31 Jul '18

31 Jul '18

hi, contacting this mailing list is my last-ditch effort to somehow come to a working configuration where postfix "ends in" dovecot, IE for special LDAP-based users, featured in the virtual mailbox delivery, dovecot would act as LDA. here's the deal. i've set up dovecot's access to the LDAP server, and for the purposes of being an IMAP server and a SASL auth backend, dovecot works brilliantly and without a glitch. i can access my test mailbox (in maildir format), i can use the LDA as root and it delivers the message correctly (after a switch to the target user's UID), and even postfix's submission works with dovecot as its SASL backend. what does not work is dovecot as LDA from postfix. i'm getting these errors in the log: Jul 31 03:40:40 rhyno dovecot: lda(aik): Error: user aik: Auth USER lookup failed Jul 31 03:40:40 rhyno dovecot: auth: Error: userdb(aik): client doesn't have lookup permissions for this user: userdb uid (10001) doesn't match peer uid (5000) (to bypass this check, set: service auth { unix_listener /var/run/dovecot/auth-userdb { mode=0777 } }) Jul 31 03:40:40 rhyno dovecot: lda: Fatal: Internal error occurred. Refer to server log for more information. for the sake of clarity, i've tried the "to bypass this check" instructions, didn't help. also, for the sake of operational clarity, "aik" is the LDAP account with the following parameters: dn: uid=aik,ou=People,dc=rhyno,dc=tech objectClass: account objectClass: posixAccount objectClass: postfixUser cn: aik uid: aik uidNumber: 10001 gidNumber: 10001 homeDirectory: /home/aik loginShell: /bin/sh gecos: aik description: User account structuralObjectClass: account entryUUID: db947584-0369-1038-98b3-675e2f0cea17 creatorsName: cn=admin,dc=rhyno,dc=tech createTimestamp: 20180613152616Z email: *********** userPassword:: ************************* mailacceptinggeneralid: andras.kemeny mailacceptinggeneralid: kemeny.andras mailacceptinggeneralid: aik mailacceptinggeneralid: pdx mailacceptinggeneralid: @rhyno.tech mailacceptinggeneralid: @rhynotechnologies.com maildrop: aik and postfix's master.cf says: dovecot unix - n n - - pipe flags=ODRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -e -f ${sender} -d ${user} so i'm stuck at this point. obviously, if the LDA is spawned with vmail:vmail perms, it cannot become uid 10001 (btw, the LDAP and passwd accounts were once connected, but for security reasons, the connection has been severed -- still the /home/aik/mail dir is owned by uid 10001 etc). what am i doint wrong? thanks, a

2 1

dovecot 2.3.x, ECC and wildcard certificates, any issues
by David Mehler 31 Jul '18

31 Jul '18

Hello, Does dovecot 2.3.x have any issues recognizing or using certificates that are ECC and wildcard? I'm trying to switch my letsencrypt implementation from acme-client which does not support either of those capabilities to acme.sh which does. Since then external clients checking their email has not worked. A manual telnet to mail.example.com 993 gives a connected message but then nothing no greeting or capabilities. The certificate is for example.com with an alt name of *.example.com if that's not right let me know, i'm not sure about that one, connecting to the web sites of these pages seems noticeably slower, I'm wondering if both of these issues aren't key related? Thanks. Dave.

5 12

mdbox_deleted proper syntax
by Johan Huldtgren 31 Jul '18

31 Jul '18

hello, on the wiki, https://wiki2.dovecot.org/MailboxFormat/dbox, it says that one can use either doveadm fetch or doveadm import, however I can find no correct syntax with fetch that'll actually work. Is the idea to simply override the mail_location with -o ? That seems to work for doveadm mailbox but not for doveadm fetch or search # doveadm -f table mailbox status -u johan all dovecot mailbox messages recent uidnext uidvalidity unseen highestmodseq vsize guid firstsaved dovecot 0 0 1 1362145026 0 1 164208086 64bd9f0003af305190040000b9256959 1471825482 # doveadm -f table -o "mail_location=mdbox_deleted:~/mdbox" mailbox status -u johan all dovecot mailbox messages recent uidnext uidvalidity unseen highestmodseq vsize guid firstsaved dovecot 0 0 1 0 0 1 0 ddb9421479f0595bf21b0100b9256959 18446744073709551615 # doveadm -f flow fetch -u johan size.virtual mailbox dovecot size.virtual=2869 size.virtual=2960 size.virtual=8023 size.virtual=6683 ... # # doveadm -f flow -o "mail_location=mdbox_deleted:~/mdbox" fetch -u johan size.virtual mailbox dovecot # # doveadm search -u johan mailbox dovecot subject "LMTP Log" 64bd9f0003af305190040000b9256959 8642 64bd9f0003af305190040000b9256959 21302 64bd9f0003af305190040000b9256959 21373 64bd9f0003af305190040000b9256959 21420 64bd9f0003af305190040000b9256959 21434 64bd9f0003af305190040000b9256959 21435 64bd9f0003af305190040000b9256959 21460 64bd9f0003af305190040000b9256959 21461 64bd9f0003af305190040000b9256959 21463 64bd9f0003af305190040000b9256959 23684 # doveadm -o "mail_location=mdbox_deleted:~/mdbox" search -u johan mailbox dovecot subject "LMTP Log" # What I'm really trying to accomplish is see if a mail which a user deleted still exists in mdbox_deleted, so I wanted to do a fetch / search to see and then try to copy / import that message back. This is on OpenBSD 6.3-current with dovecot 2.2.36, doveconf -n below. thanks, .jh --- # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.24 (124e06aa) # OS: OpenBSD 6.3 amd64 # Hostname: www.example.com auth_mechanisms = plain login first_valid_gid = 0 first_valid_uid = 507 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_id_log = * last_valid_uid = 1059 listen = 127.0.0.1 mail_home = /home/vmail/%d/%n mail_location = mdbox:~/mdbox mail_plugins = stats fts fts_solr mail_privileged_group = _dovecot mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext spamtest spamtestplus virustest mbox_write_locks = fcntl mmap_disable = yes namespace { inbox = yes location = mailbox spam { auto = subscribe special_use = \Junk } mailbox drafts { auto = subscribe special_use = \Drafts } mailbox sent-mail { auto = subscribe special_use = \Sent } mailbox trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-pgsql.conf driver = sql } passdb { args = /etc/dovecot/dovecot-pgsql2.conf driver = sql } passdb { args = cache_key=%u%r%l * driver = bsdauth } plugin { antispam_backend = mailtrain antispam_mail_notspam = learn_ham antispam_mail_sendmail = /usr/local/bin/rspamc antispam_mail_sendmail_args = -h;127.0.0.1:11334;-P;q1 antispam_mail_spam = learn_spam antispam_spam = caughtspam antispam_trash = trash fts = solr fts_autoindex = yes fts_solr = url=http://127.0.0.1:8983/solr/dovecot/ recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /var/dovecot/sieve/before/ sieve_default = /var/dovecot/sieve/default.sieve sieve_extensions = +spamtest +spamtestplus +virustest sieve_spamtest_max_header = X-Spamd-Result: default: [[:alnum:]]+ \[-?[[:digit:]]+\.[[:digit:]]+ / (-?[[:digit:]]+\.[[:digit:]]+)\] sieve_spamtest_status_header = X-Spamd-Result: default: [[:alnum:]]+ \[(-?[[:digit:]]+\.[[:digit:]]+) / -?[[:digit:]]+\.[[:digit:]]+\] sieve_spamtest_status_type = score sieve_virustest_status_header = X-Virus-Scan: Found to be (.+)\. sieve_virustest_status_type = text sieve_virustest_text_value1 = clean sieve_virustest_text_value5 = infected stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = _postfix mode = 0666 user = _postfix } } service imap-login { inet_listener imaps { port = 993 ssl = yes } process_limit = 200 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = _postfix user = _postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service stats { fifo_listener stats-mail { mode = 0666 user = _postfix } } ssl = required ssl_cert = </etc/ssl/acme/example.com/fullchain.pem ssl_key = # hidden, use -P to show it userdb { args = uid=507 gid=507 driver = static } userdb { driver = passwd } verbose_proctitle = yes protocol lmtp { mail_plugins = stats fts fts_solr sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = stats fts fts_solr antispam imap_stats }

2 2

Doveadm protocol; dovecot v2.2.10
by David White 31 Jul '18

31 Jul '18

Hi there, Just wondering what is considered current best practice for managing dovecot? The options I see are: Doveadm binary Doveadm protocol via socket Doveadm http protocol I’m currently on v2.2.10 and it appears the doveadm protocol command set is limited to just the “mailbox” commands and the http protocol hasn’t been implemented. Is the doveadm http protocol still experimental in v2.3.2? Thanks, David White ISP Engineer Trustpower T 021 223 6208 E david.white(a)trustpower.co.nz<mailto:david.white@trustpower.co.nz> Trustpower Limited, Private Bag 12023, Tauranga Mail Centre, Tauranga 3143 ------------------------------------------------------------------------------------ The contents of this email and any attachments are confidential and may be privileged. If you are not the intended recipient, you may not use, copy or disclose this email or its attachments. Please notify the sender immediately by e-mail if you have received this e-mail in error and delete both emails from your system. It is your responsibility to check this email and any attachments for viruses or other harmful code before opening or sending on. Trustpower Limited and its subsidiaries (collectively, Trustpower) accepts no responsibility for any such virus or any effects of a virus on your systems or data. Trustpower does not endorse anything in this email that is not related to its official business. Please think of the environment before printing this email. ------------------------------------------------------------------------------------

2 1

2.3.2.1 - ssl_alt_key revealed with dovecot -n
by ѽ҉ᶬḳ℠ 31 Jul '18

31 Jul '18

Seems like a minor cosmetic bug with [ dovecot -n ] ssl_alt_key = </etc/pki/private/some.key.pem ssl_key = # hidden, use -P to show it

1 0

Restricting SSL/TLS protocol versions on Dovecot 2.2.22
by J Doe 30 Jul '18

30 Jul '18

Hello, I have a question regarding SSL/TLS settings for Dovecot version 2.2.22. In: 10-ssl.conf there are two parameters: ssl_protocols ssl_cipher_list ssl_protocols is commented with “SSL protocol to use” and ssl_cipher_list is commented with “SSL ciphers to use”. If I want to disable SSLv3, for example, do I need to use both parameters or will disabling SSLv3 ciphers in ssl_cipher_list do the same thing ? So is: ssl_cipher_list = !SSLv3 …equivalent to: ssl_protocols = !SSLv3 ssl_cipher_list = !SSLv3 Thanks, - J

4 4

[Dovecot] quota-status not working in distributed environment
by Benoit Panizzon 30 Jul '18

30 Jul '18

Hello List Quick overview of our set-up: Postfix / Dovecot (2.2.2.1) / MySQL Cluster on (at the moment) three Servers to create a HA environment where you could easily add additional servers as the demand or load grows. Circular dovecot replication is used so each server uses another one as replication partner and allowing one server to fail. Dovecot Proxy Feature being used, so we can use round-robin DNS and each server can forward the connecting user to the correct 'master' for his mailbox. So far, everything works as expected. Now we want to reject emails to 'full' mailboxes during SMTP to prevent backscatter and use the quota-status policy service from within postfix. That works fine, if the mailbox or it's replica is present on the machine where quota-status is called, but it fails if it's run on a machine where neither the mailbox or the replica is present. In our case, we get a correct SMTP 550 'Mailbox Full' Reject in two cases and a LMTP generated bounce in the later case. Also `doveadm quota get -u user(a)example.com` return the correct quota if run on the two machines which have the mailbox and it's copy locale, but return 0% used if run on the other machine. Is there a way to get quota-status to also use the proxy feature to request the quota information from the correct machine? Or is the postfix policy daemon call to the quota-status socket documented somewhere (it must be, but where?) so we could implement it from within the Milter? (we use the sendmail Milter API from postfix to filter spam and viruses, do sender/recipient rewriting, forward bounce matching, rate limmiting, login/IP statistics to block botnets abusing phished addresses and legal intercept stuff anyway) Kind regards Benoit Panizzon -- I m p r o W a r e A G - ______________________________________________________ Zurlindenstrasse 29 Tel +41 61 826 93 07 CH-4133 Pratteln Fax +41 61 826 93 02 Schweiz Web http://www.imp.ch ______________________________________________________

5 6

OT - copied maildir from 2T drive to 4T drive
by Marc Perkel 30 Jul '18

30 Jul '18

And it's taking up more space on the 4T drive. What did I miss?

2 1

[SOLR] Where is solr-schema.xml?
by Peter Nabbefeld 27 Jul '18

27 Jul '18

Hello, running dovecot 2.3.2.1 on Arch Linux, and installed solr 7.4.0. According to the wiki, there should be doc/solr-schema.xml, but I cannot find it. Tried "whereis dovecot": dovecot: /usr/bin/dovecot /usr/lib/dovecot /etc/dovecot /usr/include/dovecot /usr/share/dovecot /usr/share/man/man1/dovecot.1.gz But I cannot find any xml files using find /usr/{lib,share}/dovecot -name "*.xml" Kind regards Peter

4 5

Imap post-login script
by j.emerlik 27 Jul '18

27 Jul '18

Dovecot v.2.2.32 and I have configured two imap post-login scripts and it seems like after successfully login scripts are not closed (dovecot_node/imap imap-postlogin : multiple processes are running still) and after some times there are too many processes and the limit is reached (imap proces_limit 1500): 1) #!/bin/sh case $IP in 10.10.1[1-2][0-7].*) exec "$@" ;; 10.11.2.4[0-9]) exec "$@" ;; esac CHECK_USER=`PGPASSWORD="password" /usr/local/pg952/bin/psql -h 10.11.1.3 -q -t -U postfixuser -d mail -c "select imap_allowed from users where name = '$USER' LIMIT 1"` if [ $CHECK_USER == "t" ] ; then exec "$@" fi if [ $CHECK_USER == "f" ] ; then exit 0 fi 2) PGPASSWORD="password" /usr/local/pg952/bin/psql -U postfixuser -d mail2 -h 10.11.1.3 -c "select last_auth('$USER','$RIP2','1')" > /dev/null exec "$@" Regards, Jack

1 0

Aw: Re: Re: Re: Panic: Leaked view for index - virtual mailbox
by wertstoffe＠nurfuerspam.de 26 Jul '18

26 Jul '18

1 0

Aw: Re: Re: Re: Panic: Leaked view for index - virtual mailbox
by wertstoffe＠nurfuerspam.de 26 Jul '18

26 Jul '18

1 0

Panic: Leaked view for index - virtual mailbox
by Jakobus Schürz 26 Jul '18

26 Jul '18

Hi There! I run into this problem with virtual Mailboxes on release-2.3.2 (and also in master and in older versions of dovecot) I added the core-file. Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11292><rg2GZclxHaPAqADc>: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: Opened in index-storage.c:338 Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11292><rg2GZclxHaPAqADc>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7ffad9ac0df1] -> /usr/local/lib/dovecot/libdovecot.so.0(+ 0xceeba) [0x7ffad9ac0eba] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7ffad9a2efe8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) [0x7ffad9c66022] -> /usr/local/lib/dovecot/libdovecot-s torage.so.0(index_storage_mailbox_close+0x9a) [0x7ffad9c3d72a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7ffad9bbb1aa] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 x7ffad9792b80] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7ffad9792d3b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) [0x7ffad9795f1 9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7ffad9bbd6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7ffad9bbd787] -> /usr/local/lib/dovecot/libdo vecot-storage.so.0(index_storage_get_status+0x31) [0x7ffad9c3bed1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7ffad9791ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7ffad 9c1ff83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7ffad97b4602] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7ffad99e9813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox _get_status+0x31) [0x7ffad9bbdb91] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) [0x7ffad9795b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 x7ffad9bbd6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7ffad9bbd787] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7ffad9c3bed1] -> /usr/loca l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7ffad9791ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7ffad9c1ff83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7ffad97b460 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7ffad99e9813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7ffad9bbdb91] -> /usr/local/lib/dovecot/lib20_virtual_plug in.so(virtual_storage_sync_init+0xf0b) [0x7ffad9795b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7ffad9bbd6d1] Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11292><rg2GZclxHaPAqADc>: Fatal: master: service(imap): child 11292 killed with signal 6 (core dumped) Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: AUTH 19 PLAIN service=imap secured=tls session=9KKNZclxHqPAqADc lip=192.168.0.14 rip=192.168.0.2 20 lport=143 rport=41758 local_name=aldebaran.xundeenergie.at ssl_cipher=ECDHE-RSA-AES128-GCM-SHA256 ssl_cipher_bits=128 ssl_pfs=KxECDHE ssl_protocol=TLSv1.2 Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb out: CONT 19 Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client in: CONT<hidden> Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: user=jakob file=/usr/local/etc/dovecot/users Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: client passdb out: OK 19 user=jakob Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master in: REQUEST 2436366337 10570 19 dd4c468bbfe617d4ef06a1b8ce6c111d session_pid=11298 request_auth_token Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: passwd-file(jakob,192.168.0.220,<9KKNZclxHqPAqADc>): lookup: user=jakob file=/usr/local/etc/dovecot/users Jul 25 04:11:29 aldebaran dovecot[10573]: auth: Debug: master userdb out: USER 2436366337 jakob home=/var/mail/jakob acl_groups=home,admin auth_token=3ea3b630e131 3bf5beb0f26ff740450189f63e3e Jul 25 04:11:29 aldebaran dovecot[10573]: imap-login: Login: user=<jakob>, method=PLAIN, rip=192.168.0.220, lip=192.168.0.14, mpid=11298, TLS, session=<9KKNZclxHqPAqADc> Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11298><9KKNZclxHqPAqADc>: Panic: Leaked view for index /var/lib/dovecot/db/indexes/Maildir/jakob/&ANY-BB/dovecot.index: Opened in index-storage.c:338 Jul 25 04:11:29 aldebaran dovecot[10573]: imap(jakob)<11298><9KKNZclxHqPAqADc>: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xcedf1) [0x7fbd982b2df1] -> /usr/local/lib/dovecot/libdovecot.so.0(+ 0xceeba) [0x7fbd982b2eba] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbd98220fe8] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf7022) [0x7fbd98458022] -> /usr/local/lib/dovecot/libdovecot-s torage.so.0(index_storage_mailbox_close+0x9a) [0x7fbd9842f72a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7fbd983ad1aa] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xab80) [0 x7fbd97f84b80] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7fbd97f84d3b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x12a9) [0x7fbd97f87f1 9] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7fbd983af6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7fbd983af787] -> /usr/local/lib/dovecot/libdo vecot-storage.so.0(index_storage_get_status+0x31) [0x7fbd9842ded1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7fbd97f83ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7fbd9 8411f83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7fbd97fa6602] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7fbd981db813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox _get_status+0x31) [0x7fbd983afb91] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xf0b) [0x7fbd97f87b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0 x7fbd983af6d1] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7fbd983af787] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7fbd9842ded1] -> /usr/loca l/lib/dovecot/lib20_virtual_plugin.so(+0x9ead) [0x7fbd97f83ead] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xb0f83) [0x7fbd98411f83] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10602) [0x7fbd97fa660 2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xf813) [0x7fbd981db813] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7fbd983afb91] -> /usr/local/lib/dovecot/lib20_virtual_plug in.so(virtual_storage_sync_init+0xf0b) [0x7fbd97f87b7b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x51) [0x7fbd983af6d1] Jul 25 04:11:30 aldebaran dovecot[10573]: imap(jakob)<11298><9KKNZclxHqPAqADc>: Fatal: master: service(imap): child 11298 killed with signal 6 (core dumped) jakob

4 12

doveadm who reverse dns lookups
by Michael Grant 25 Jul '18

25 Jul '18

Perhaps this is a feature request... It would be nice if the ‘doveadm who’ command printed out the reverse dns name of where the user was logged in from. Would it be possible to either add some option to doveadm who for this, or make it the do it by default and add a ‘-n’ option (like many of the other programs that look up ip addresses by default) and take a -n option to not do that? Not sure if that would break some existing thing which is why I hesitate. Might be safer to add, say, a -r option to do the rDNS lookup. However, it would definitely save me a step in figuring out where someone was logged in from to know if it’s legit. Michael Grant

3 2

Re: doveadm expunge didn't clear Trash mailbox
by Joseph Tam 25 Jul '18

25 Jul '18

On Mon, 23 Jul 2018, Michael Wagner wrote: > here works a dovecot 2.2.27 on a raspberrypi and the behaviour is as > expected. > > doveadm -f tab fetch -u <user> "uid date.saved" mailbox Trash > uid date.saved > 314 2018-06-23 00:35:59 > 315 2018-06-23 12:39:10 > 316 2018-06-24 10:32:43 > ... > > And I have a cron script that expunges the mails older than 30 days. > /usr/bin/doveadm expunge -u <user> mailbox Trash savedbefore 30d Hi Michael, Thanks for your observation. I think you probably use maildir format, yes? I think my problem stems from the fact I use mbox, so one file contains many messages, whereas maildir uses one file for each message. Dovecot, from my understanding, will use the message file's mtime for date.saved if it doesn't have it in the cached. This is probably why I am seeing multiple messages with the same value. What's confusing is that if I query a message's date.saved, that value -- whether from the cache or the mailbox's mtime -- remains in the cache, so the next query will give me that value. So running "doveadm fetch ... date.saved", will get the mailbox's mtime at the time I fetched those values. In order to get near accurate date.saved values, I would have to run "doveadm fetch ... date.saved" frequently. (I think this behaviour must have changed recently because this no longer works consistently.) However, if each message is stored in a separate file (like maildir does), then each message can have an accurate date.saved(=mtime). Once you have accurate date.saved, then the "expunge savedbefore" works correctly. Another reason I really ought to switch to maildir. Joseph Tam <jtam.home(a)gmail.com>

2 1

Re: Panic: Leaked view for index - virtual mailbox
by Jakob Schuerz 25 Jul '18

25 Jul '18

1 0