- dovecot - dovecot.org

zlib corrupted data
by Angel L. Mateo 03 Jun '16

03 Jun '16

Hello, We are having performance problems with one of our users. We are having a server (2.1.16) for about 8000 users. This server is a vmware vm with 8 cores and 32GB of RAM. Normally, it is working fine, but when one of our users access his email, then the load increases a lot and this high load is maintained while the user is connected. Looking for problems with this user I have found that trying to move messages from one folder to another I have errors like: doveadm(mctm(a)um.es): Error: zlib.read(/mail/users/mailboxes/um.es/mc/mctm/mdbox/storage/m.1486): corrupted data at 30152376 doveadm(mctm(a)um.es): Error: zlib_istream.seek(/mail/users/mailboxes/um.es/mc/mctm/mdbox/storage/m.1486) failed: Invalid argument doveadm(mctm(a)um.es): Error: zlib.read(/mail/users/mailboxes/um.es/mc/mctm/mdbox/storage/m.1473): corrupted data at 7175520 doveadm(mctm(a)um.es): Error: zlib_istream.seek(/mail/users/mailboxes/um.es/mc/mctm/mdbox/storage/m.1473) failed: Invalid argument but a doveadm dump of these files shows no problem. Is there any way to debug this problem? How could I fix it? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337

1 0

AD query timeout might be result size limit exceeded
by Julien Lambot 03 Jun '16

03 Jun '16

Hello list I've been struggling for a while trying to configure multiple domain ldap authentication with full e-mail address authentication. Which in fact was not the issue. There where some discrepancies between the doc and our actual configuration (see appendix A/ ) Seems that pass_filters and user_filters don't need much special settings for our setup. Now it's working correctly at the sole exception that when an OU contains "lots" of users (>200) i suspect that the ldapseach query fails. We can well authenticate when we have 50 users in an OU, but not when the number raises (I don't have the exact number above which it locks). Is there a parameter that we can set to increase the result size limit (as i suspect this to be the cause of this possible bug)? If I query manually it's ok (ldapsearch) if I use "doveadm auth user.name(a)domain.tld", it succeed also but I wonder if it doesn't use the winbind authentication instead. Here is our ldap-auth configuration hosts = master.domain.local:389 dn = DOMAIN\ro-user dnpass = password debug_level = 2 auth_bind = yes #auth_bind_userdn = cn=%u,OU=_myou,OU=Utilisateurs,OU=ouname,DC=domain,DC=local (tried with and without with no better results) ldap_version = 3 #deref = never #base = OU=InfrastructureManagement,DC=domain,DC=local (works has a few users) base = OU=_myou,OU=Utilisateurs,OU=ouname,DC=domain,DC=local scope = subtree user_filter = (&(objectclass=person)(mail=%u)) pass_filter = (&(objectclass=person)(mail=%u)) and some logs in appendix B/ Thanks for any hints on this. Have a nice day appendix A/ # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.7 auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb default_vsz_limit = 1 G disable_plaintext_auth = no first_valid_gid = 5000 first_valid_uid = 5000 last_valid_gid = 50000 last_valid_uid = 50000 mail_gid = 5000 mail_home = /var/vmail/%d/%n mail_location = maildir:~/mail mail_privileged_group = virtmail mail_uid = 5000 namespace inbox { hidden = no inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = subscriptions = yes } passdb { args = scheme=plain-md5 username_format=%u /etc/dovecot/users driver = passwd-file } passdb { args = scheme=plain-md5 username_format=%u /etc/dovecot/users driver = passwd-file } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = /etc/dovecot/pirisusers-ldap.conf.ext driver = ldap } protocols = imap service auth { unix_listener auth-userdb { mode = 0666 user = virtmail } } ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } userdb { args = /etc/dovecot/dovecot-ldap-users.conf.ext driver = ldap } userdb { args = /etc/dovecot/pirisusers-ldap-users.conf.ext driver = ldap } protocol lda { postmaster_address = postmaster(a)domain.tld } protocol imap { mail_plugins = } appendix B/ May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_int_select May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: read1msg: ld 0x7fcc0a585fa0 msgid 14 all 1 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: read1msg: ld 0x7fcc0a585fa0 msgid 11 message type search-reference May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_chase_v3referrals May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_url_parse_ext(ldap://ForestDnsZones.domain.local/DC=ForestDnsZones,DC=domain,DC=local) May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: re_encode_request: new msgid 15, new dn <DC=ForestDnsZones,DC=domain,DC=local> May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: re_encode_request new request is: May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_chase_v3referral: msgid 11, url "ldap://ForestDnsZones.domain.local/DC=ForestDnsZones,DC=domain,DC=local" May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_send_server_request May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_new_connection 0 1 1 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_int_open_connection May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_connect_to_host: TCP ForestDnsZones.domain.local:389 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_new_socket: 21 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_prepare_socket: 21 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_connect_to_host: Trying 10.1.2.34:389 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_pvt_connect: fd: 21 tm: -1 async: 0 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: anonymous rebind via ldap_sasl_bind("") May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_sasl_bind May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_send_initial_request May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_send_server_request May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ldap_result ld 0x7fcc0a585fa0 msgid 16 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: wait4msg ld 0x7fcc0a585fa0 msgid 16 (timeout 100000 usec) May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: wait4msg continue ld 0x7fcc0a585fa0 msgid 16 all 1 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ** ld 0x7fcc0a585fa0 Connections: May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: * host: ForestDnsZones.domain.local port: 0 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: refcnt: 2 status: Connected May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: last used: Thu May 19 12:57:36 2016 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: rebind in progress May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: queue is empty May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: * host: DomainDnsZones.domain.local port: 0 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: refcnt: 2 status: Connected May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: last used: Thu May 19 12:57:36 2016 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: rebind in progress May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: queue is empty May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: * host: master.domain.local port: 389 (default) May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: refcnt: 4 status: Connected May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: last used: Thu May 19 12:57:36 2016 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: ** ld 0x7fcc0a585fa0 Outstanding Requests: May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: * msgid 16, origid 16, status InProgress May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: outstanding referrals 0, parent count 0 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: * msgid 14, origid 14, status InProgress May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: outstanding referrals 0, parent count 0 May 19 12:57:36 iftstpupimap1 dovecot: auth: Error: * msgid 11, origid 11, status InProgress May 19 13:00:06 iftstpupimap1 dovecot: auth: Error: PLAIN(): Request 0.1 timeouted after 150 secs, state=1

1 1

Blowfish hashed passwords
by KT Walrus 03 Jun '16

03 Jun '16

The PHP app I’m using on my website uses PHP to generate password hashes to be stored into the user database. These password hashes use Blowfish encryption ("$2y$”). In fact, since PHP 5.3.0, PHP contains its own implementation of the hash types it supports including: - CRYPT_STD_DES - CRYPT_EXT_DES - CRYPT_MD5 - CRYPT_BLOWFISH - CRYPT_SHA256 - CRYPT_SHA512 The C code for these hash types is in https://github.com/php/php-src/tree/master/ext/standard <https://github.com/php/php-src/tree/master/ext/standard> I’m working on adding Dovecot to my site, but Dovecot doesn’t seem to support Blowfish password hashes (at least on Ubuntu 14.04). Would you consider adding built-in “fallback” support for Blowfish and SHA512 (which doesn’t seem to be supported either on Ubuntu 14.04 last time I checked) to an upcoming Dovecot release? You could probably take the source code from the GitHub PHP repo to incorporate support for these hash types in Dovecot. That way, Dovecot could easily use the same hash types that PHP supports regardless of what hash types are installed in the OS running Dovecot. And, I wouldn’t have to deal with a second set of hashes for Dovecot passdb for my existing user accounts. See PHP manual for crypt function: http://php.net/manual/en/function.crypt.php Kevin

2 1

stat .../.dovecot.sieve/tmp failed: Not a directory
by Robert Schetterer 02 Jun '16

02 Jun '16

Hi, i have stat .../.dovecot.sieve/tmp failed: Not a directory using sieve = file:~/sieve;active=~/.dovecot.sieve dovecot_2.2.24-1-auto-38 cause i can subscribe to dovecot sieve cant remember to see this in previous versions any idea ? Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Schleißheimer Straße 26/MG, 80333 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

3 5

special-use for virtual folder
by Wolfgang Rosenauer 02 Jun '16

02 Jun '16

Hi, I'm running two different Dovecot servers (actually more but those are pretty similar and same versions 2.2.24). Today I configured a virtual All folder on both: namespace { location = virtual:/etc/dovecot/virtual:INDEX=~/virtual prefix = virtual. separator = . } mailbox virtual.All { special_use = \All } On this system the special-use flag is not applied to the folder (checked via LIST "" "*"). On the other system: namespace { location = virtual:/etc/dovecot/virtual:INDEX=~/virtual prefix = virtual/ separator = / } mailbox virtual/All { special_use = \All } On the second system I can see * LIST (\HasNoChildren \All) "/" virtual/All Besides the separator I don't see a big difference between both configurations. Any idea? Thanks, Wolfgang

1 1

forwarding emails using sieve
by Thorsten von Eicken 01 Jun '16

01 Jun '16

I know this is a tad tangential to dovecot, but maybe someone has some pointers for me. I'm trying to forward emails using the sieve filtering and redirect doesn't do it because it doesn't wrap the message in a new email, instead, it seems to just change the envelope From (and To). This causes the outbound relay to reject the message for security/spam reasons (forged From). It looks like the dovecot sieve implementation doesn't let me change the From header in the sieve script. Is there a way to accomplish what I'm looking for? Thanks!

3 3

Full subject on dovecot log
by Fabio S. Schmidt 01 Jun '16

01 Jun '16

Hi, I've noticed that when a subject is very long Dovecot doesn't show its full lenght on the logs. Is there any way to always register the full subject on the log? (I'm using dovecot 2.2) My best regards, Fabio S. Schmidt

1 0

Fatal Error with sdbox and attachment storage
by Wolfgang Baumgartner 01 Jun '16

01 Jun '16

Hello, we've shortly migrated to sdbox with attachment storage. Now there are many errors like this: May 30 14:11:17 rzw-x-mail2 dovecot: lmtp(21310, xxx.xxx(a)hswt.de) Panic: file fs-api.c: line 615 (fs_copy): assertion failed: (src->fs == dest->fs) May 30 14:11:17 rzw-x-mail2 dovecot: lmtp(21310, xxx.xxx(a)hswt.de) Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x6b6fe) [0x7fae10a6d6fe] -> /usr/lib/dovecot/libdovecot.so.0(+0x6b7ec) [0x7fae10a6d7ec] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fae10a248fb] -> /usr/lib/dovecot/libdovecot.so.0(fs_copy+0x90) [0x7fae10a2e4a0] -> /usr/lib/dovecot/libdovecot-storage.so.0(sdbox_copy+0x4e0) [0x7fae10d20c10] -> /usr/lib/dovecot/modules/lib10_quota_plugin.so(+0xbaab) [0x7fae10037aab] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x7d) [0x7fae10d5d01d] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver_save+0x196) [0x7fae110049d6] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0xf3) [0x7fae11004e13] -> dovecot/lmtp [DATA](+0x6171) [0x7fae11434171] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x3f) [0x7fae10a7ed0f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xf9) [0x7fae10a7fd09] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7fae10a7ed79] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fae10a7edf8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fae10a29dc3] -> dovecot/lmtp [DATA](main+0x165) [0x7fae114329b5] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7fae10678b45] -> dovecot/lmtp [DATA](+0x4a95) [0x7fae11432a95] May 30 14:11:17 rzw-x-mail2 dovecot: lmtp(21310, xxx.xxx(a)hswt.de) Fatal: master: service(lmtp): child 21310 killed with signal 6 (core dumps disabled) What can we do now? Migrate back to Maildir? Greetings Wolfgang Baumgartner System: Debian 8 with Dovecot 2.2.13 dovecot -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.4 auth_master_user_separator = * auth_mechanisms = plain login auth_verbose_passwords = yes disable_plaintext_auth = no mail_attachment_dir = /srv/archive/attachments mail_location = auto: mail_plugins = quota zlib acl managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { hidden = no list = children location = auto: prefix = shared.%%n. separator = . subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes quota = dict:User quota::file:%h/dovecot-quota quota_grace = 20M quota_rule = *:storage=400M quota_rule2 = INBOX.Archiv:ignore quota_rule3 = INBOX.Trash:storage=+20M quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full / Mailbox ist voll quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_default_name = roundcube sieve_dir = ~/sieve sieve_max_redirects = 15 zlib_save = gz zlib_save_level = 6 } protocols = " imap lmtp sieve pop3" service auth { inet_listener saslauth_via_dovecot { address = 141.40.2.7 port = 12341 } unix_listener auth-userdb { group = vmail user = vmail } } service imap-login { process_min_avail = 4 service_count = 0 } service imap { process_limit = 8192 } service lmtp { inet_listener lmtp { address = 141.40.2.7 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { process_min_avail = 4 service_count = 0 } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { address = 141.40.2.7 port = 12340 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl_cert = </etc/ssl/certs/cert.pem ssl_cipher_list = EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA256:EECDH:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:!RC4:!SEED:!IDEA:!ECDSA:kEDH:CAMELLIA128-SHA:AES128-SHA ssl_key = </etc/ssl/private/key.pem ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv3 !SSLv2 userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = quota zlib acl sieve } protocol lda { mail_plugins = quota zlib acl sieve } protocol imap { mail_plugins = quota zlib acl imap_acl imap_quota imap_zlib } -- -------------------------------------------------------------- Hochschule Weihenstephan-Triesdorf, Rechenzentrum Dipl.-Ing. (FH) Wolfgang Baumgartner Am Weihenstephaner Berg 4, 85350 Freising Tel. 08161/71-5276 Fax: 08161/71-5116 E-Mail: wolfgang.baumgartner(a)hswt.de --------------------------------------------------------------

1 1

Not receiving mails
by Vijay Kumar 01 Jun '16

01 Jun '16

Hi, I have setup spam filter and opendkim key on our mail server with Postfix,Dovecot and OpenDKIM server. Following are few lines from dovecot.conf which were added to dovecot.conf. After troubleshooting, we removed the following lines and the login from webUI roundcube started working. Can someone please explain the importance of following lines in accordance with Opendkim? Should we disable plaintext authentication for opendkim to work? ----------------------------------------------------- disable_plaintext_auth = no mail_privileged_group = mail mail_location = mbox:~/mail:INBOX=/var/mail/%u userdb { driver = passwd } passdb { args = %s driver = pam } protocol imap { mail_plugins = " autocreate" } plugin { autocreate = Trash autocreate2 = Sent autosubscribe = Trash autosubscribe2 = Sent } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } ssl=required ----------------------------------------------------- Thanks, Vijay --- http://www.matchfinder.in

1 0

cool stuff
by dovecot 31 May '16

31 May '16

Hi, I've read about some cool things recently and I though you might be inerested too, here is the link <http://hafeprodi.vampiresorority.com/aekcb> Yours, dovecot

1 0

IMAP Timeouts
by Vince42 30 May '16

30 May '16

Hi, from time to time the IMAP login times out ... my external monitoring says "connection reset by peer (SSL)" and Thunderbird tries to connect forever. After a short while everything returns back to normal operation. The system resources are plenty, there are no error messages and no greedy background tasks running. I read a little about tweaking imap-login - but all the default parameters seem to be set more generously than what was recommended. Where should I start the debugging process? I really wish there was some "dovecot optimizer tool" ... :P -- Cheers, \\|// Vince (o o) ----------------------------ooO-(_)-Ooo------------------------- ''' (o)_(o) [ ][0][ ] ô¿ô (=°o°=) World Domination by Copy and Paste [ ][ ][0] - (")_(") [0][0][0] () ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments Ooo. ---------------------------.ooO----( )------------------------- ( ) (_/ \_)

3 4

[PATCH 0/7] Fixes for lib-mail message-address
by Pali Rohár 30 May '16

30 May '16

Hello, I borrowed dovecot parser for email addresses and going to use it in new perl module as replacement for Email::Address. During implementation and testing I found bugs in dovecot parser & generator. So I'm sending my patches together with tests. Pali Rohár (7): lib-mail: message_address_write: Fix generating empty group list lib-mail: message_address_write: Fix generating group list with empty name lib-mail: parse_addr_spec: Like in rfc822_skip_comment() check if last_comment is not NULL lib-mail: parse_addr_spec: Email address without local-part is invalid lib-mail: parse_mailbox: Set display name instead mailbox when parsing failed lib-mail: message_address_write: Quote and escape strings if needed lib-mail: Update tests for message address src/lib-mail/message-address.c | 99 +++++++++++++++++++++++++++++++---- src/lib-mail/test-message-address.c | 11 +++- 2 files changed, 98 insertions(+), 12 deletions(-) -- 1.7.9.5

4 13

pread() failures when using mdbox on btrfs
by Marc Joliet 28 May '16

28 May '16

(Note: I am not subscribed to this ML, so please be sure to CC me in replies.) Hello, I see a strange bug when running dovecot under btrfs with a mailbox in mdbox format. At some point, which can take a few minutes or more than a day, dovecot starts logging pread() failures, like so: Apr 02 23:43:42 thetick dovecot[570]: imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/LinuxAudio/User/dbox- Mails/dovecot.index.log: Input/output error These would trigger when getmail runs (which in turn is configured to use dovecot-lda). It's only ever the *.index.log files, and it would usually happen to the same one many times in a row. To demonstrate, this is the full list of unique pread() failures on one host (my desktop PC): # journalctl -u dovecot -p 3 -o cat | sort -u | grep pread imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/BTRFS/dbox-Mails/dovecot.index.log: Input/output error imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/Gentoo/User/dbox-Mails/dovecot.index.log: Input/output error imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.log: Input/output error imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/LinuxAudio/User/dbox-Mails/dovecot.index.log: Input/output error imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/Newsletters/dbox-Mails/dovecot.index.log: Input/output error imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/SCons/User/dbox-Mails/dovecot.index.log: Input/output error imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/storage/dovecot.map.index.log: Input/output error and on the current host (a home server): # journalctl -u dovecot -p 3 -o cat | sort -u | grep pread imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/mailboxes/Privat/dbox-Mails/dovecot.index.log: Input/output error imap(marcec): Error: pread() failed with file /home/marcec/.mdbox/storage/dovecot.map.index.log: Input/output error Rebooting the system would make it go away (without loss of mails), though remounting the file system should have worked, too. I tried a variety of options, but the only one that helped was to convert the mailbox from mdbox to maildir. I have not seen any pread() failures in the two weeks since. I originally wrote to the btrfs ML, see the thread at [0], in particular my messages [1] and [2], for additional details, including references to what little I could find on the web. However, nothing much came of that thread, so I am now posting here. My dovecot configuration: # doveconf -n # 2.2.19: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.9 (357ac0a0e68b+) # OS: Linux 4.4.8-gentoo x86_64 Gentoo Base System release 2.2 auth_mechanisms = plain login mail_location = maildir:~/.maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = * driver = pam } plugin { sieve = file:~/.sieve;active=~/.dovecot.sieve } postmaster_address = root@diefledermaus protocols = imap sieve service imap-login { inet_listener imap { port = 10087 } inet_listener imaps { port = 10887 } } ssl = required ssl_cert = </etc/ssl/dovecot/dovecot.pem ssl_key = </etc/ssl/dovecot/dovecot.key userdb { driver = passwd } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = sieve } protocol sieve { managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date } I used to use claws-mail, then switched to KMail in September 2015. So the errors happened with both clients. [0] http://thread.gmane.org/gmane.comp.file-systems.btrfs/49637 [1] http://article.gmane.org/gmane.comp.file-systems.btrfs/49647 [2] http://article.gmane.org/gmane.comp.file-systems.btrfs/55552 Greetings -- Marc Joliet -- "People who think they know everything really annoy those of us who know we don't" - Bjarne Stroustrup

2 3

first_valid_uid
by Vince42 28 May '16

28 May '16

Hi, I have error log entries like dovecot: lmtp(22155, mail): Error: user mail: Mail access for users with UID 8 not permitted (see first_valid_uid in config file, uid from userdb lookup). This obviously tells me that the user mail (UID 8) is trying to access the LMTP daemon. How can I find out why he is doing so and how I can get rid of this error message? The mail system (Ubuntu 14.04 LTS : Postfix + Dovecot) is working - but probably not properly configured. -- Cheers, \\|// Vince (o o) ----------------------------ooO-(_)-Ooo------------------------- ''' (o)_(o) [ ][0][ ] ô¿ô (=°o°=) World Domination by Copy and Paste [ ][ ][0] - (")_(") [0][0][0] () ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments Ooo. ---------------------------.ooO----( )------------------------- ( ) (_/ \_)

2 4

ot: migrating TB user's email to new laptop
by voytek＠sbt.net.au 25 May '16

25 May '16

another OT: setting up new W10 laptop with TBird: user has three accounts, several hundred emails on old laptop BUT NO LONGER on server two of the accounts are on my Dovecot server, one on ISP server what's best way to transfer local emails: transfer TBird files laptop to laptop ? or, is there some way to sync old laptop to server, then retrieve on new laptop ? thanks, V

6 7

Unable to view shared mailbox
by dev 25 May '16

25 May '16

Hi All, I have a mailing list I'd like to archive and share with a handful of users. The users are all in OpenLDAP. 10-auth-system.conf.ext is setup with "driver=pam" so it appears anyone in LDAP who already is able to SSH into the server may also connect to dovecot with same username/password they use in LDAP. I have a shared mailbox directory called LISTS_Archive. The system directory is /home/shared_imap. I can connect to dovecot using LDAP credentials (using Thunderbird) and this shared folder (LISTS_Archive) is grayed out. I assume I have acls wrong? What I want is for users in LDAP to access the LISTS_Archive imap folder as a shared folder for everyone. Only R/O access however (which is 'lr' in acl file I think). Would someone please point out what I've missed? Thank you. # # egrep -v '(^$|\#)' /etc/dovecot/conf.d/10-mail.conf # mail_location = maildir:~/.maildir namespace inbox { type = private separator = / inbox = yes } mail_plugins = acl plugin { acl = vfile:/etc/dovecot/acls } namespace { hidden = no inbox = no location = maildir:/home/shared_imap/:INDEX=~/Maildir/shared/%%u:INDEXPVT=~/Maildir/shared/%%u prefix = LISTS_Archive/ separator = / type = public list = yes subscriptions = no } # # egrep -v '(^$|\#)' /etc/dovecot/conf.d/20-imap.conf # protocol imap { mail_plugins = $mail_plugins imap_acl } # # dir /home/shared_imap/ # total 8 drwxr-xr-x 7 root root 4096 May 25 10:26 .. -rw-rw-r-- 1 user384 mail-user 0 May 25 10:43 dovecot-acl-list drwxrwsr-x 2 root mail-user 4096 May 25 10:43 . # # cat /etc/dovecot/acls # * user=user384 lr

1 0

ot: selfcert IMAP StartTLS 143 Win10 Tbird woes
by voytek＠sbt.net.au 25 May '16

25 May '16

I was trying to set up a replacement laptop running W10/64 to replace a Win7 laptop, installed TBird, and, attempted normal setup: IMAP StartTLS 143, SMTP StartTLS 587 (like on old laptop), and, to cut a long story, eventually discovered it won't work till I changed IMAP SSL/TLS 993 ? SMTP seems OK, only IMAP didn't (I recall earlier similar type of issues with either Outlook or OE or WLive?) is this the self certified part ? or what is it ? what's the best way around ? or just leave it as 993 ? thanks for any hints , pointers or even words of encouragement

2 1

Re: New feature: HTTP API
by aki.tuomi＠dovecot.fi 25 May '16

25 May '16

> On April 5, 2016 at 9:27 AM Tom Sommer <mail(a)tomsommer.dk> wrote: > > > On 2016-04-04 20:22, aki.tuomi(a)dovecot.fi wrote: > > > Since the API is still a little beta, it will not return anything in > > case > > doveadm does not like the arguments (that is, calls i_fatal). Also, > > success is > > often indicated with 200 OK along with [["doveadmResponse",[],"c01"]]. > > I don't see the "doveadm proxy kick" command in the list? Not all commands are included, unfortunately. Also, the list only shows commands that are available with doveadm as per configuration. Aki

4 7

Error: Filename keeps changing
by Ward Romp 24 May '16

24 May '16

Dear all, Two days ago, my ldap server (for authentication) crashed and I had to set up a new one. Everything works fine except the mailbox for one user (let's name him debugger). When I try to access his mail whatever way, dovecot complains about "Error: maildir_file_do(........): Filename keeps changing" For example, a command "doveadm copy -u debugger(a)boontje.net Archive mailbox Netspar" returns doveadm(debugger(a)boontje.net): Error: maildir_file_do(/var/mail/vmail/boontje.net/debugger/mail/Netspar/cur/14230…: Filename keeps changing doveadm(debugger(a)boontje.net): Error: Copying message UID 1 from 'Netspar' failed: Internal error occurred. Refer to server log for more information. [2016-05-24 13:19:58] doveadm(debugger(a)boontje.net): Error: maildir_file_do(/var/mail/vmail/boontje.net/debugger/mail/Netspar/cur/14472…: Filename keeps changing doveadm(debugger(a)boontje.net): Error: Copying message UID 2 from 'Netspar' failed: Internal error occurred. Refer to server log for more information. [2016-05-24 13:19:58] doveadm(debugger(a)boontje.net): Error: maildir_file_do(/var/mail/vmail/boontje.net/debugger/mail/Netspar/cur/14472…: Filename keeps changing doveadm(debugger(a)boontje.net): Error: Copying message UID 3 from 'Netspar' failed: Internal error occurred. Refer to server log for more information. [2016-05-24 13:19:58] doveadm(debugger(a)boontje.net): Error: maildir_file_do(/var/mail/vmail/boontje.net/debugger/mail/Netspar/cur/14498…: Filename keeps changing doveadm(debugger(a)boontje.net): Error: Copying message UID 4 from 'Netspar' failed: Internal error occurred. Refer to server log for more information. [2016-05-24 13:19:58] It does this on ALL mailboxes of this user and only this user. Other users give no problems. Accessing the mails via a mail client (Roundcube, Thunderbird, etc...) give the same error. Dovecot runs on a virtual machine and the mailboxes are stored via a CIFS-share on a NAS. I rebooted both machines, checked the filesystem (no errors), CIFS-share, directories and mail files are readable and writeable by dovecot user (vmail on the mail server). The mails are intact, cat <filename> shows the full mail. I'm baffled, any suggestions? Kind regards, Ward Romp The configuration etc.... ================================================ # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 4.2.0-36-generic x86_64 Ubuntu 14.04.4 LTS cifs auth_mechanisms = plain login auth_verbose = yes listen = * mail_home = /var/mail/vmail/%d/%n mail_location = maildir:/var/mail/vmail/%d/%n/mail:LAYOUT=fs managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/conf.d/ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_after = /var/mail/vmail/sieve-after sieve_before = /var/mail/vmail/sieve-before sieve_dir = ~/sieve } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/private/mail.boontje.net-chain.crt ssl_cipher_list = ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+3DES:DH+3DES:RSA+AES:RSA+3DES:!ADH:!AECDH:!MD5:!DSS ssl_client_ca_dir = /etc/ssl/certs ssl_key = </etc/ssl/private/mail.boontje.net.key userdb { args = uid=5000 gid=5000 home=/var/mail/vmail/%d/%n allow_all_users=yes driver = static } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 10 } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve postmaster_address = webmaster(a)boontje.net quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r

1 0

Growing number of dovecot processes
by John Oliver 24 May '16

24 May '16

OS is CentOS 6, dovecot-2.0.9-19 Just started using this server as a replacement for an old Debian server running an old dovecot. The number of dovecot processes just grows and grows until there are 100 concurrent login processes (we have maybe 40 or 50 users), and then nobody can log in any more. A reload resets, but the number of stuck processes climbs very quickly. We're authenticating against an OpenLDAP. Unfortunately, this system is not connected to the Internet so I cannot paste logs or output of commands. I've been Googling, but aren't hitting on the right phrase to describe this issue to uncover possible answers :-( If anyone can get me pointed in the right direction, I'd appreciate it. -- *********************************************************************** * John Oliver http://www.john-oliver.net/ * * * ***********************************************************************

2 1

No implicit INBOX with mailbox_list_index = yes?
by Karsten Heiken 23 May '16

23 May '16

Hello all, I am running a Dovecot Cluster (2.2.13 and 2.2.23 show the same behaviour) using dsync replication (as described here: http://wiki.dovecot.org/Replication) In addition to that I allow users to share mailboxes using IMAP ACLs. My problem is that I need to set "mail_shared_explicit_inbox = yes" if I want my users to see Inboxes of other users. If I leave mail_shared_explicit_inbox = no, then the user cannot see any Inboxes of other users: > * LIST (\Subscribed \UnMarked) "/" Sent > * LIST (\Subscribed \UnMarked) "/" Drafts > * LIST (\Subscribed) "/" INBOX When I set explicit_inbox = yes, then I can see the shared mailboxes: > * LIST (\Subscribed \UnMarked) "/" Sent > * LIST (\Subscribed \UnMarked) "/" Drafts > * LIST (\NonExistent) "/" shared > * LIST (\NonExistent) "/" shared/bob(a)luis.uni-hannover.de > * LIST (\Subscribed) "/" shared/bob(a)luis.uni-hannover.de/INBOX > * LIST (\Subscribed) "/" INBOX After some digging I found out that if I set mailbox_list_index = NO, then everything works even without explicit_inbox: > * LIST (\Subscribed) "/" Sent > * LIST (\Subscribed) "/" Drafts > * LIST (\NonExistent) "/" shared > * LIST (\Subscribed) "/" shared/bob(a)luis.uni-hannover.de > * LIST (\Subscribed) "/" INBOX Since we are migrating from Cyrus to Dovecot, our users are used to the behaviour of explicit_inbox = no, so I would like to keep it that way. I would simply leave mailbox_list_index disabled, but the comment states it is required for NOTIFY, which in turn is required by the rolling replication -- am I corrent? > # Mailbox list indexes can be used to optimize IMAP STATUS commands. They are > # also required for IMAP NOTIFY extension to be enabled. > # mailbox_list_index = yes What am I doing wrong or don't understand? Thanks, Karsten -----8<----- # doveconf -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-44-pve x86_64 Debian 8.1 default_vsz_limit = 512 M dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } lmtp_rcpt_check_quota = yes mail_gid = 7777 mail_location = maildir:%h/Maildir mail_plugins = " zlib quota acl notify" mail_uid = 7777 mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify namespace { hidden = no ignore_on_failure = no inbox = no list = children location = maildir:/var/vmail/%%d/%%n/Maildir:INDEXPVT=~/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox 30dTrash { auto = subscribe special_use = \Junk } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=5 acl_shared_dict = proxy::acl quota = maildir:Postfach-Limit quota_grace = 2%% quota_rule = *:storage=8G quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_max_redirects = 25 zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster(a)luis.uni-hannover.de protocols = " imap lmtp sieve pop3 sieve" replication_dsync_parameters = -d -l 30 -U -n inbox service auth { unix_listener auth-userdb { group = vmail user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service doveadm { inet_listener { port = 24245 } } service imap-login { process_min_avail = 16 service_count = 0 } service imap { executable = imap postlogin process_limit = 30000 } service lmtp { inet_listener lmtp { port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { process_limit = 1024 } service pop3-login { process_min_avail = 4 service_count = 0 } service pop3 { process_limit = 2500 } service postlogin { executable = script-login -d rawlog /usr/local/bin/dovecot-postlogin.sh } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } ssl_cert = </etc/dovecot/private/fullchain.pem ssl_key = </etc/dovecot/private/privkey.pem syslog_facility = local6 userdb { args = /etc/dovecot/dovecot-ldap.conf.ext default_fields = home=/var/vmail/%Ld/%Ln quota_rule=*:bytes=8589934592 driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = " zlib quota acl notify sieve quota" } protocol lda { mail_plugins = " zlib quota acl notify sieve" } protocol imap { mail_max_userip_connections = 50 mail_plugins = " zlib quota acl notify imap_quota imap_acl" } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = " zlib quota acl notify" } -- Karsten Heiken Leibniz Universität IT Services Kommunikationssysteme E-Mail, XMPP, Kalender Schloßwender Str. 5 D-30159 Hannover

1 0

solr does not index files in the mailbox
by Andreas Meyer 21 May '16

21 May '16

Hello! I startet solr and configured dovecot to use it. Dovecot just indexes two files dovecot.index.log and dovecot.mailbox.log but nothing in the cur directory. ./post -c myfiles /home/a.meyer/Postfach java -classpath /home/andreas/solr-5.5.1/dist/solr-core-5.5.1.jar -Dauto=yes -Dc=myfiles -Ddata=files -Drecursive=yes org.apache.solr.util.SimplePostTool /home/a.meyer/Postfach SimplePostTool version 5.0.0 Posting files to [base] url http://localhost:8983/solr/myfiles/update... Entering auto mode. File endings considered are xml,json,jsonl,csv,pdf,doc,docx,ppt,pptx,xls,xlsx,odt,odp,ods,ott,otp,ots,rtf,htm,html,txt,log Entering recursive mode, max depth=999, delay=0s Indexing directory /home/a.meyer/Postfach (2 files, depth=0) POSTing file dovecot.index.log (text/plain) to [base]/extract POSTing file dovecot.mailbox.log (text/plain) to [base]/extract Indexing directory /home/a.meyer/Postfach/cur (0 files, depth=1) Indexing directory /home/a.meyer/Postfach/new (0 files, depth=1) Indexing directory /home/a.meyer/Postfach/tmp (0 files, depth=1) 2 files indexed. COMMITting Solr index changes to http://localhost:8983/solr/myfiles/update... Time spent: 0:00:00.751 If I give the cur folder as startingpoint ./post -c myfiles /home/a.meyer/Postfach/cur java -classpath /home/andreas/solr-5.5.1/dist/solr-core-5.5.1.jar -Dauto=yes -Dc=myfiles -Ddata=files -Drecursive=yes org.apache.solr.util.SimplePostTool /home/a.meyer/Postfach/cur SimplePostTool version 5.0.0 Posting files to [base] url http://localhost:8983/solr/myfiles/update... Entering auto mode. File endings considered are xml,json,jsonl,csv,pdf,doc,docx,ppt,pptx,xls,xlsx,odt,odp,ods,ott,otp,ots,rtf,htm,html,txt,log Entering recursive mode, max depth=999, delay=0s Indexing directory /home/a.meyer/Postfach/cur (0 files, depth=0) 0 files indexed. COMMITting Solr index changes to http://localhost:8983/solr/myfiles/update... Time spent: 0:00:00.102 nothing is indexed although the directory contains 4 mails. What am I doing wrong? Greetings Andreas

1 0

Dovecot-FTS:
by Peer Heinlein 20 May '16

20 May '16

We're running Dovecot with SOLR Lucene 5.5 and we have several errors like badMessage: 414 for HttpChannelOverHttp@5216da8e{r=0,c=false,a=IDLE,uri=-} 20.5.2016, 14:10:16 and URI is too large >8192 in our solr-logfile. I don't know if this is a problem in SOLR or in Dovecot, so I just bring it to your attention. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

dovecot-sieve: require "mailbox" fails (Unbuntu 16.04)
by Karim 'Kasi Mir' Senoucci 20 May '16

20 May '16

Hello everyone, I'm moving some old procmail recipes to sieve, but having problems with it. The problem lies with the mailbox extension, which I'm trying to use as proposed in an example in the Dovecot wiki: > require ["variables","date","fileinto","mailbox"]; > > # Extract date info > if currentdate :matches "year" "*" { set "year" "${1}"; } > if currentdate :matches "month" "*" { set "month" "${1}"; } > > # Archive Dovecot mailing list items by year and month. > # Create folder when it does not exist. > if header :is "list-id" "dovecot.dovecot.org" { > fileinto :create "INBOX.Lists.${year}.${month}.dovecot"; > } I'm trying a similar rule (different condition, different mail folder), but cannot seen to get it to work. I always get the errors: > .DOVECOT: LINE 16: ERROR: UNEXPECTED '}' FOUND AT (THE PRESUMED) END OF FILE. > .DOVECOT: ERROR: PARSE FAILED. I'm using the standard dovecot packages from Ubuntu 16.04: > II DOVECOT-CORE 1:2.2.22-1UBUNTU2 AMD64 SECURE POP3/IMAP SERVER - CORE FILES > II DOVECOT-IMAPD 1:2.2.22-1UBUNTU2 AMD64 SECURE POP3/IMAP SERVER - IMAP DAEMON > II DOVECOT-MANAGESIEVED 1:2.2.22-1UBUNTU2 AMD64 SECURE POP3/IMAP SERVER - MANAGE SIEVE SERVER > II DOVECOT-SIEVE 1:2.2.22-1UBUNTU2 AMD64 SECURE POP3/IMAP SERVER - SIEVE FILTERS SUPPORT I was under the impression that these sieve extensions, including "mailbox", are builtin into dovecot/pigeonhole, or at least packaged into dovecot-sieve. Is that not the case? How can I get the example working under Ubuntu linux 16.04? Do I need to add or reconfigure something by hand? Thanks in advance for any help on the subject. Greetings Kasi Mir

1 0

Re: BUG?: Dsync over piped process (DSYNC_RUN_TYPE_CMD): EPIPE if X (done) is received in another write after F (finish)
by J. Nick Koston 20 May '16

20 May '16

Hi Timo, The below solved the problem for me as far as I can tell I was getting a EPIPE about 1:30 dsync runs over the socket. I have received 0 in 10000 runs with this change. https://github.com/dovecot/core/pull/10 <https://github.com/dovecot/core/pull/10> You know the code much better then I do so you might have a better way? Also I have a commit to address the constant warnings when the prefix is set to INBOX. with the quota_quota plugin here: https://github.com/dovecot/core/pull/7 <https://github.com/dovecot/core/pull/7> Thanks -Nick Timo Sirainen tss at iki.fi <mailto:dovecot%40dovecot.org?Subject=Re%3A%20BUG%3F%3A%20Dsync%20over%20piped%20process%20%28DSYNC_RUN_TYPE_CMD%29%3A%20EPIPE%20if%20X%0A%09%28done%29%20is%20received%20in%20another%20write%20after%20F%20%28finish%29&In-Reply-To=%3CA5A2C866-9A65-439B-B232-231202B94525%40iki.fi%3E>Thu May 19 23:15:18 UTC 2016 > > On 19 May 2016, at 03:54, J. Nick Koston <nick at cpanel.net <http://dovecot.org/cgi-bin/mailman/listinfo/dovecot>> wrote: > > > > Hi, > > > > It appears that dsync closes the file handle once it gets the F (finish) response even if it hasn’t received the X (done) response. > > If the X (done) response gets delivered in another write this will generate EPIPE in the connected process. > > > > This is much easier to replicate over SSL, however the trace is provided without SSL since its easier to see whats going on. > > Do you see this as causing some problem? I think this is intentional. The F(inish) tells the final response whether everything was OK or not, so all the work is done after that. The 'X' is described in code as: > > /* notify remote that we're closing. this is mainly to avoid > "read() failed: EOF" errors on failing dsyncs */ > o_stream_nsend_str(ibc->output, > t_strdup_printf("%c\n", items[ITEM_DONE].chr)); > > and on the receiving side: > > if (line[0] == items[ITEM_DONE].chr) { > /* remote cleanly closed the connection, possibly because of > some failure (which it should have logged). we don't want to > log any stream errors anyway after this. */ > dsync_ibc_stream_stop(ibc); > return DSYNC_IBC_RECV_RET_TRYAGAIN; > } > > So I think it only matters in error handling.

1 0