- dovecot - dovecot.org

send and receive error message
by Chandran Manikandan 29 Jan '19

29 Jan '19

Hi Folks, I am running qmailtoaster on COS6 32 bit. Send and receive error message coming frequently and inbox emails are not downloading in outlook 2016 of office 365 email client. But if i restart the dovecot service then start downloading the emails in inbox then send and receive error message gone. Outlook 2010 doesn't have the same issue. Is this server issue? or email client version issues? or if i need to use standalone outlook product instead office 365? I do the dovecot service restart every one hour for this issue . if possible to do the cron job for dovecot service restart for every one hour daily or any other solution there. Kindly Any one help me. -- *Thanks,* *Manikandan.C* *System Administrator*

1 0

Re: Rsync to backup dbox with SIS (Daniel Miller)
by ash-dovecot＠comtek.co.uk 28 Jan '19

28 Jan '19

> Probably not the answer you want - but I would strongly suggest using > Dovecot replication.? Dovecot replication Just Works - so don't reinvent > the wheel when Timo provided such a polished tool already.? Okay, thanks, I'll look at replication for the warm spare. Although we do use shared folders, which your link below says don't work properly. > And based on > my previous SIS experience - while dbox is nice I would suggest avoiding > SIS until there are reports of more development.? Sdbox will be solid - > which is what you want for an archive - though maildir would be the > safest.? Archives don't need to be rapid-access - they need to be > dependable.? SIS is wonderful for space saving - but until there's more > safety checks built-in I'd suggest avoiding it for production backups.? > Drives are cheap - lost data, lost time, lost hair, lost sanity...is not. Our main motivation for dbox is SIS. We don't have a very high volume of mail, so maildir speed is unlikely to be an issue. What we do have is a lot of users who like to mail around large files. Drives are cheap, but there are advantages to a smaller mailstore. That said, data security wins. We will probably abandon dbox entirely and continue with maildir, thanks. > The backups don't have to be "visible" to other machines - don't even > have to be running IMAP/POP services (I think).? And the replication > command is run - via ssh (https://wiki.dovecot.org/Replication) - so > what's the problem? Well, our backup servers are supposed to be running a minimalist set of software. If we need to restore from backup after a security issue or application bug on a production machine, then we are trying to minimise the chance that the backup machine itself could be affected. Anyway, if we aren't using SIS, then we needn't use dbox, and therefore backup machines can continue to run a minimalist OS with only rsync. Thanks, Ash --- To opt-in to receiving communications from us or to update your email preferences please go to https://lists.comtek.co.uk/prefs. To be removed from receiving all communications from the Comtek Group, please unsubscribe at https://lists.comtek.co.uk/prefs and accept our apologies for any inconvenience caused. The Comtek Group respects your privacy. Please find our privacy policy at http://www.comtek.co.uk/privacy-policy This email and any attachments are confidential. If you are not the named recipient, please notify the sender immediately. The unauthorised use, disclosure, copying or alteration of this message or its attachments is strictly prohibited. Opinions expressed in this message are those of the individual and not Comtek Network Systems (UK) Ltd unless indicated by an authorised representative independent of this message. Comtek Network Systems does not accept responsibility for any changes to this message after it has been sent. Company Details: Comtek Network Systems (UK) Ltd. Registered Office: Comtek Network Systems (UK) Ltd, Unit 108, Tenth Avenue (Zone 3), Deeside Industrial Park, Deeside, Flintshire, CH5 2UA. Comtek Network Systems (UK) Ltd is a company registered in England and Wales with company number 05929974.

1 0

all of a sudden, slow resync
by Victor Sudakov 27 Jan '19

27 Jan '19

Dear Colleagues, All of a sudden, I've begun receiving this output when reindexing my mail boxes: # /usr/local/bin/doveadm force-resync -u vas "*" doveadm(vas): Warning: Transaction log file /home/vas/Mail/sibptus/.imap/sent/dovecot.index.log was locked for 55 seconds (Mailbox was synchronized) doveadm(vas): Warning: Transaction log file /home/vas/Mail/sibptus/.imap/dss-30-06-2010/dovecot.index.log was locked for 56 seconds (Mailbox was synchronized) doveadm(vas): Warning: Transaction log file /home/vas/Mail/sibptus/.imap/dss-2014/dovecot.index.log was locked for 95 seconds (Mailbox was synchronized) doveadm(vas): Warning: Transaction log file /home/vas/Mail/sibptus/.imap/dss-20-06-2012/dovecot.index.log was locked for 72 seconds (Mailbox was synchronized) doveadm(vas): Warning: Transaction log file /home/vas/Mail/sibptus/.imap/dss-18-05-2009/dovecot.index.log was locked for 31 seconds (Mailbox was synchronized) doveadm(vas): Warning: Transaction log file /home/vas/Mail/sibptus/.imap/dss-07-12-2008/dovecot.index.log was locked for 56 seconds (Mailbox was synchronized) doveadm(vas): Warning: Transaction log file /home/vas/Mail/sibptus/.imap/dns-operations/dovecot.index.log was locked for 95 seconds (Mailbox was synchronized) And it really takes forever to finish. What could cause this? FreeBSD 11.2-RELEASE-p8, dovecot-2.3.3_4 -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/

1 0

auth-worker: Error: double free or corruption (fasttop)
by Marcel Lorenz 27 Jan '19

27 Jan '19

Dear list, since the distri upgrade to glibc 2.28, i can't build working dovecot binary's. Older with glibc 2.27 are working. The distri is LFS based. MariaDB 10.2.18 and 10.3.11 makes no difference. Having this on different systems. Messages Log: Dec 19 17:10:38 test kernel: traps: auth[30189] general protection ip:7f4b96d6598c sp:7ffef1f31710 error:0 in libmariadb.so.3[7f4b96d4e000+67000] Dec 19 17:11:39 test kernel: auth[30299]: segfault at 560c57366c40 ip 0000560c57366c40 sp 00007fffe5b51f18 error 15 Dec 19 17:12:39 test kernel: traps: auth[30346] general protection ip:7f55601f298c sp:7ffe597929c0 error:0 in libmariadb.so.3[7f55601db000+67000] Dec 19 17:13:39 test kernel: traps: auth[30392] general protection ip:7fcd2317298c sp:7ffecd6f4cb0 error:0 in libmariadb.so.3[7fcd2315b000+67000] Dovecot log: 2018-12-19 17:07:37 auth-worker: Fatal: master: service(auth-worker): child 30053 killed with signal 11 (core dumped) 2018-12-19 17:09:38 auth-worker: Error: double free or corruption (fasttop) 2018-12-19 17:09:38 auth-worker: Fatal: master: service(auth-worker): child 30098 killed with signal 6 (core dumped) 2018-12-19 17:10:38 auth-worker: Fatal: master: service(auth-worker): child 30189 killed with signal 11 (core dumped) Output of dovecot -n: # 2.3.4 (0ecbaf23d): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 (60b0f48d) # OS: Linux 4.14.80 x86_64 # Hostname: test.testing.local auth_mechanisms = plain login auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@+*#" base_dir = /var/run/dovecot/ debug_log_path = /var/log/dovecot/debug.log dict { expire = mysql:/etc/dovecot/dovecot-dict-sql-expire.conf sqldomainquota = mysql:/etc/dovecot/dovecot-dict-sql-domain.conf sqluserquota = mysql:/etc/dovecot/dovecot-dict-sql-user.conf } info_log_path = /var/log/dovecot/info.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * log_path = /var/log/dovecot/main.log log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = dovecot ready login_log_format = %s login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_location = mdbox:/var/vmail/%d/%n/ mail_max_userip_connections = 4 mail_plugins = " zlib quota expire acl fts fts_lucene" mailbox_idle_check_interval = 1 mins maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { list = children location = maildir:/var/vmail/%d/public:INDEXPVT=/var/vmail/%d/public prefix = Public. separator = . subscriptions = no type = public } namespace { list = children location = maildir:/var/vmail/%d/%%u:CONTROL=/var/vmail/%d/shared/%%u:INDEX=/var/vmail/$ prefix = shared.%%n. separator = . subscriptions = yes type = shared } namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes al = vfile expire = Trash expire2 = Trash/* expire3 = Spam expire_cache = yes expire_dict = proxy::expire fts = lucene fts_lucene = whitespace_chars=@.-+_*:/\"' last_login_key = # hidden, use -P to show it quota = dict:User Quota::proxy::sqluserquota quota_exceeded_message = Quota exceeded quota_grace = 10%% quota_rule2 = Trash:storage=+15%% quota_rule3 = Spam:ignore quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is over quota / Postfach ist voll quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = /var/vmail/%d/%n/sieve/active-script.sieve sieve_before = /var/vmail/sieve/spam-global.sieve sieve_dir = /var/vmail/%d/%n/sieve/scripts/ sieve_global = /var/lib/dovecot/sieve/global/ sieve_max_actions = 32 sieve_max_redirects = 4 sieve_max_script_size = 1M trash = /etc/dovecot/dovecot-trash.conf zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster(a)testing.local protocols = imap pop3 lmtp sieve service auth-worker { user = doveauth } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0660 user = doveauth } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 0 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 10022 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = vmail } ssl_alt_cert = </etc/ssl/certs/postfix-rsa.crt ssl_alt_key = # hidden, use -P to show it ssl_cert = </etc/ssl/certs/postfix-ecc.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_min_protocol = TLSv1.2 ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol imap { imap_logout_format = in=%i out=%o imap_max_line_length = 64 k mail_max_userip_connections = 10 mail_plugins = " zlib quota expire acl fts fts_lucene acl imap_acl imap_quota mail_log last_login notify imap_zlib trash" } protocol pop3 { mail_max_userip_connections = 4 mail_plugins = " zlib quota expire acl fts fts_lucene last_login expire" pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_enable_last = no pop3_lock_session = no pop3_logout_format = retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = yes pop3_reuse_xuidl = no pop3_save_uidl = yes pop3_uidl_format = %08Xu%08Xv } protocol lmtp { mail_plugins = " zlib quota expire acl fts fts_lucene sieve" postmaster_address = postmaster(a)test.local } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = /var/log/dovecot/deliver.log log_path = /var/log/dovecot/deliver.log mail_fsync = optimized mail_plugins = " zlib quota expire acl fts fts_lucene trash autocreate sieve" postmaster_address = postmaster(a)testing.local quota_full_tempfail = yes rejection_reason = Your message to <%t> with subject of <%s> was automatically rejected:%n%r rejection_subject = Mailbox Full: %s } protocol sieve { mail_max_userip_connections = 10 managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } Thanks in advance! Marcel

3 3

download Dovecot emails over rsync (done!), possible alternatives
by Carles Pina i Estany 27 Jan '19

27 Jan '19

Hello, Apologies for the extra long email. It's a situation with a solved problem and I might need to solve it again, I'd like to have some feedback. Two years ago, in a trip around the Antarctic with a very limited communication I deployed a mail system based on Postfix+Dovecot. I need to do something similar again and I used a "hack" that I thought that I might avoid (that time, let's say, everything was last minute... or later than last minute!). I installed Dovecot on the internet server and the server on the ship. On the ship I had a fetchmail downloading "small emails" (up to 100 KB if I remember correctly) and delivering to the local server. For bigger emails fetchmail had a "size limit" and fetchmail was not downloading them. I wrote a Python script that was connecting from the ship, to the internet server, and was listing the emails that were "too big to be downloaded" (this was for each user. I could have done something different with procmailrc I think on the receiving time). The Python script was fetching, if I remember correctly, the email ID, date, subject and size. The Python script was sending an email to the ship server's user saying "there is an email for you with this size, from, date and subject and this is the email ID" (and inserting this into a database to avoid sending the same notification to the users again). Then the scientists sometimes were ignoring the email, were asking to the sender to send a smaller version, or asking me to download it when possible. If they wanted me to download the email: I had a script that was connecting to the internet server, opening /home/$USER/Maildir/dovecot-uidlist, finding the file for that email UUID (this was a simple script on the internet server and I was executing it using ssh and getting the output). Then it was creating a new IMAP folder named "Downloaded" in the ship's server (it was just creating the folder in the file system and adding it in the subscriptions file, all using file system operations from Python). Then using rsync it was downloading the email file from the internet's server to the ship's server temporary file (taking whatever it would take, with many retries, etc.) and then moving it to the Downloaded folder. (note: it was using rsync and not IMAP because the connection was slow and very unstable. With rsync and the correct options it was continuing the download and retrying until success). For the next expedition I'll have more time to prepare for a similar setup. I've considered if I should stop relying on dovecot-uidlist, local file system's, subscriptions, etc. and if I should write a plugin for Dovecot to expose part of this information using... a JSON API? IMAP commands? The local ship's server bit: could I inject a SMTP mail file (downloaded) using Dovecot admin commands? some API? Any advantage? To discover which file to download using rsync: instead of opening the dovecot-uidlist any better method? Any other different approach that I might want to consider? Sorry again for the long message. I thought that this might need some context. Also, thanks to the design of Dovecot I could do what I did in a very simple way. Actually Dovecot design was as I would have designed for this use case (the index file, subscription from the mailing list, etc.). Thank you very much again! and thanks for the great Dovecot as well! -- Carles Pina i Estany Web: http://pinux.info || Blog: http://pintant.cat GPG Key 0x8CD5C157

1 1

Rsync to backup dbox with SIS
by ash-dovecot＠comtek.co.uk 26 Jan '19

26 Jan '19

We will be deploying a replacement Dovecot server soon, and we are planning to use maildir for the primary storage, but with an archive namespace using mdbox (or perhaps sdbox), and SIS. Our backup servers and (luke)warm spare server need to obtain full copies of the mail store. For the maildirs I know I can simply use rsync (we already use it here). I'm a little wary of using rsync with mdbox and SIS though. Obviously we would have to use the -H option of rsync to avoid duplicating the hard linked data, does anybody have any experience with how this scales? I've considered simply rsyncing the /var/mail/dovecot/attach/??/??/hashes folders. Is there a tool that can reconstruct the /var/mail/dovecot/attach/??/??/*-* links for a list of messages in that case? I'm aware of "doveadm backup", and (although it currently throws up a few errors) it seems like it might be a valid solution for our warm spare server. Our backup servers, on the other hand, aren't supposed to be visible to the production machines, with the exception of the backup machine sshing in to do an rsync each night. We can't install dovecot on them. To perform partial email recovery in maildir, we can simply log into a backup server, grep for emails of interest, and then scp them into a maildir new/ subfolder on the mail server to recover them. What about using dbox? I can identify /var/mail/dovecot/archive/ash/dbox/storage/m.* files, and identify necessary attachments under /var/mail/dovecot/attach/??/??/ but once I've copied them over to the mail server is there a safe way to import them? Actually, converting to a maildir style file would be adequate if there is a script anywhere to do this. We'd still rather be backing up the deduplicated mailstore for obvious reasons. Has anybody got any suggestions? I'm aware of "dsync backup questions" ( https://www.dovecot.org/list/dovecot/2013-February/088070.html ) but there didn't really seem to be a solution. Thanks, Ash PS Our current server has 257 users (though perhaps 100 are active), using around 225G in total. PPS Proposed new server configuration: mail_location = maildir:~/Maildir:LAYOUT=fs mail_attachment_dir = /var/mail/dovecot/attach mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} mail_attachment_min_size = 128 k namespace _archive { list = yes location = mdbox:/var/mail/dovecot/archive/%n/dbox prefix = Archive/ separator = / subscriptions = yes type = private } namespace _private { inbox = yes type = private separator = / subscriptions = yes prefix = } --- To opt-in to receiving communications from us or to update your email preferences please go to https://lists.comtek.co.uk/prefs. To be removed from receiving all communications from the Comtek Group, please unsubscribe at https://lists.comtek.co.uk/prefs and accept our apologies for any inconvenience caused. The Comtek Group respects your privacy. Please find our privacy policy at http://www.comtek.co.uk/privacy-policy This email and any attachments are confidential. If you are not the named recipient, please notify the sender immediately. The unauthorised use, disclosure, copying or alteration of this message or its attachments is strictly prohibited. Opinions expressed in this message are those of the individual and not Comtek Network Systems (UK) Ltd unless indicated by an authorised representative independent of this message. Comtek Network Systems does not accept responsibility for any changes to this message after it has been sent. Company Details: Comtek Network Systems (UK) Ltd. Registered Office: Comtek Network Systems (UK) Ltd, Unit 108, Tenth Avenue (Zone 3), Deeside Industrial Park, Deeside, Flintshire, CH5 2UA. Comtek Network Systems (UK) Ltd is a company registered in England and Wales with company number 05929974.

2 1

problem in setting up proxy
by Ted 25 Jan '19

25 Jan '19

Hello, We're having difficulty with our updated cluster of dovecot servers accessing the email storage on the NFS mounts. It seems index files get corrupted when 2 backend mailservers access the same account, and from documentation setting up a director proxy in front of the backup servers. I'm trying to just set up a straight proxy first, which the documents say is the first step, and although I can see the connections coming into the server when I try to login via the proxy, the connection times out and there are no logs from dovecot anywhere saying what happened to the connection. The configs I have set up for this in dovecot are: dovecot.conf # Protocols we want to be serving. protocols = imap pop3 #when re-enabling quota enforcement add quota in below: mail_plugins = $mail_plugins mail_log notify protocol imap { # Space separated list of plugins to load (default is global mail_plugins). #when re-enabling quota enforcement add imap_quota in below: mail_plugins = $mail_plugins } # A comma separated list of IPs or hosts where to listen in for connections. # "*" listens in all IPv4 interfaces, "::" listens in all IPv6 interfaces. # If you want to specify non-default ports or anything more complex, # edit conf.d/master.conf. #listen = *, :: # Base directory where to store runtime data. #base_dir = /var/run/dovecot/ # Name of this instance. In multi-instance setup doveadm and other commands # can use -i <instance_name> to select which instance is used (an alternative # to -c <config_path>). The instance name is also added to Dovecot processes # in ps output. #instance_name = dovecot # Greeting message for clients. login_greeting = Welcome to easyMail. shutdown_clients = yes # Most of the actual configuration gets included below. The filenames are # first sorted by their ASCII value and parsed in that order. The 00-prefixes # in filenames are intended to make it easier to understand the ordering. !include conf.d/*.conf # A config file can also tried to be included without giving an error if # it's not found: !include_try local.conf service auth { unix_listener auth-master { mode = 0600 user = vmail } } conf.d/10-auth.conf ## ## Authentication processes ## # Username formatting before it's looked up from databases. You can use # the standard variables here, eg. %Lu would lowercase the username, %n would # drop away the domain if it was given, or "%n-AT-%d" would change the '@' into # "-AT-". This translation is done after auth_username_translation changes. auth_username_format = %Lu # Space separated list of wanted authentication mechanisms: # plain login digest-md5 cram-md5 ntlm rpa apop anonymous gssapi otp skey # gss-spnego # NOTE: See also disable_plaintext_auth setting. auth_mechanisms = plain login # # Password database is used to verify user's password (and nothing more). # You can have multiple passdbs and userdbs. This is useful if you want to # allow both system users (/etc/passwd) and virtual users to login without # duplicating the system users into virtual database. # # <doc/wiki/PasswordDatabase.txt> # # User database specifies where mails are located and what user/group IDs # own them. For single-UID configuration use "static" userdb. # # <doc/wiki/UserDatabase.txt> #!include auth-deny.conf.ext #!include auth-master.conf.ext #!include auth-system.conf.ext #!include auth-sql.conf.ext #!include auth-ldap.conf.ext #!include auth-passwdfile.conf.ext #!include auth-checkpassword.conf.ext #!include auth-vpopmail.conf.ext !include auth-static.conf.ext conf.d/auth-static.conf.ext # Static passdb. Included from auth.conf. # This can be used for situations where Dovecot doesn't need to verify the # username or the password, or if there is a single password for all users: # # - proxy frontend, where the backend verifies the password # - proxy backend, where the frontend already verified the password # - authentication with SSL certificates # - simple testing passdb static { driver = static args = nopassword=y default_fields = proxy=y host=10.5.10.121 } #passdb { # driver = static # args = password=test #} #userdb { # driver = static # args = uid=vmail gid=vmail home=/home/%u #} conf.d/10-logging.conf ## ## Log destination. ## # Log file to use for error messages. "syslog" logs to syslog, # /dev/stderr logs to stderr. #log_path = syslog # Log file to use for informational messages. Defaults to log_path. #info_log_path = # Log file to use for debug messages. Defaults to info_log_path. #debug_log_path = # Syslog facility to use if you're logging to syslog. Usually if you don't # want to use "mail", you'll use local0..local7. Also other standard # facilities are supported. #syslog_facility = mail ## ## Logging verbosity and debugging. ## # Log unsuccessful authentication attempts and the reasons why they failed. auth_verbose = yes # In case of password mismatches, log the attempted password. Valid values are # no, plain and sha1. sha1 can be useful for detecting brute force password # attempts vs. user simply trying the same password over and over again. # You can also truncate the value to n chars by appending ":n" (e.g. sha1:6). #auth_verbose_passwords = no # Even more verbose logging for debugging purposes. Shows for example SQL # queries. auth_debug = yes # In case of password mismatches, log the passwords and used scheme so the # problem can be debugged. Enabling this also enables auth_debug. #auth_debug_passwords = no # Enable mail process debugging. This can help you figure out why Dovecot # isn't finding your mails. mail_debug = yes # Show protocol level SSL errors. verbose_ssl = yes # mail_log plugin provides more event logging for mail processes. plugin { # Events to log. Also available: flag_change append #mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename # Available fields: uid, box, msgid, from, subject, size, vsize, flags # size and vsize are available only for expunge and copy events. #mail_log_fields = uid box msgid size } I'm basically expecting this to forward the login requests on to 10.5.10.121 when I try to access the email account through the proxy. When I attempt this I am able to see the connections in a tcp dump, but dovecot does not log anything about the attempt. I clearly must be missing something, can you let me know what I need to do or check? Thank you Ted easyDNS Technologies

4 6

Garbled mails in Maildir storage
by Florian Lohoff 25 Jan '19

25 Jan '19

Hi, from time to time i am having mails delivered to my anon maildrop which completely break mailbox listing. I ignored it mostly as this is an anon maildrop for one time emails so loosing spam wasnt an issue. Today i had a mailbox which wouldnt list at all which was caused by 50 consecutive mails beeing broken. (I am showing the last 20 in the web interface) After some debugging i found a bunch of mails like this: Return-Path: <*************************> X-Original-To: test(a)wasteland.rfc822.org Delivered-To: inbox(a)wasteland.rfc822.org Received: from node11.tmdvps.com (unknown [184.154.211.109]) by pax.zz.de (Postfix) with SMTP id 3B73DD00B5 for <test(a)wasteland.rfc822.org>; Thu, 8 Jun 2017 17:09:25 +0200 (CEST) <U+FEFF>Date: Thu, 8 Jun 2017 10:09:24 +0000 (GMT) From: Apple Support <*************************> REPLY-TO: do_not_reply(a)apple.com To: test(a)wasteland.rfc822.org [ ... ] Yes - there is an UTF-8 BOM in the middle of the mail header. Breaks parsing of the mail header of dovecot. No From and To in the listing. And i found even more: Return-Path: <**********************> X-Original-To: test(a)wasteland.rfc822.org Delivered-To: inbox(a)wasteland.rfc822.org Received: from 36.248.164.233 (unknown [36.248.164.233]) by pax.zz.de (Postfix) with SMTP id B2B0F1000FF; Tue, 22 Jan 2019 10:37:35 +0100 (CET) Received: from 6.51.138.64 by ; Tue, 22 Jan 2019 04:36:35 -0500 Message-ID: <B[20 Mails that end with garbage in them middle of the mail header. This is a standard Maildir storage using the dovecot transport via postfix. Does anyone have an explanation for these kind of mailstorage breakage? How could broken mails like this even be processed by postfix, dovecot deliver etc. As the last mail is pretty current i quickly grepped the postfix logs: Jan 22 10:37:35 pax postfix/smtpd[20269]: B2B0F1000FF: client=unknown[36.248.164.233] Jan 22 10:37:37 pax postfix/cleanup[20371]: B2B0F1000FF: message-id=<B[20 Jan 22 10:37:37 pax postfix/qmgr[9371]: B2B0F1000FF: from=<**********************>, size=233, nrcpt=2 (queue active) Jan 22 10:37:37 pax postfix/pipe[19192]: B2B0F1000FF: to=<inbox(a)wasteland.rfc822.org>, orig_to=<test108(a)wasteland.rfc822.org>, relay=wasteland, delay=2.2, delays=1.7/0/0/0.41, dsn=2.0.0, status=sent (delivered via wasteland service) Jan 22 10:37:37 pax postfix/pipe[21064]: B2B0F1000FF: to=<inbox(a)wasteland.rfc822.org>, orig_to=<test(a)wasteland.rfc822.org>, relay=wasteland, delay=2.2, delays=1.7/0.01/0/0.48, dsn=2.0.0, status=sent (delivered via wasteland service) Jan 22 10:37:37 pax postfix/qmgr[9371]: B2B0F1000FF: removed So even postfix found the message id to be truncated. Does dovecot have a "broken maildir mail storage mail dictionary" for automated tests? Flo -- Florian Lohoff f(a)zz.de UTF-8 Test: The 🐈 ran after a 🐁, but the 🐁 ran away

1 0

Discard mail with from date older than xxxx
by Trever L. Adams 25 Jan '19

25 Jan '19

I know that sieve doesn't do math. The file would be created externally. Based on examples in section 4.4 of https://tools.ietf.org/html/rfc5260#section-4 I figured something like this would work. if date :value "le" :originalzone "date" "date" "2018-10-25" { fileinto "SPAM"; stop; } However, I get the following. spam: line 41: error: unknown tagged argument ':value' for the date test (reported only once at first occurrence). spam: error: validation failed. sievec(root): Fatal: failed to compile sieve script 'spam.sieve' Does anyone have any advice on how to get this working? Thank you. Trever

4 7

Shared instance
by Stepan Khlebalov 25 Jan '19

25 Jan '19

Hello. I have inbox instance for incoming messages and second private instance for archiving mails with different maildir location. Sharing for folders in inbox instance works perfectly. But it does not work for folders in archiving instance. I can't create two shared instances, dovecot fails. Can I have two locations in one shared instance?

3 7

jmap
by Maciej Milaszewski IQ PL 25 Jan '19

25 Jan '19

Hi Is there any chance that Dovecot-2.2.36 supports "jmap" ? -- Maciej Miłaszewski IQ PL Sp. z o.o. Starszy Administrator Systemowy Biuro Obsługi Klienta: e-mail: bok(a)iq.pl tel.: +48 58 326 09 90 - 94 fax: +48 58 326 09 99 Dział pomocy: https://www.iq.pl/pomoc Informacja dotycząca przetwarzania danych osobowych: https://www.iq.pl/kontakt Jakość gwarantuje: ISO 9001:2000 IQ PL Sp. z o.o. z siedzibą w Gdańsku (80-298), ul. Geodetów 16, KRS 0000007725, Sąd rejestrowy: Sąd Rejonowy w Gdańsku VII Wydział KRS, kapitał zakładowy: 140.000 PLN, NIP 5832736211, REGON 192478853

2 1

debian10+dovecot-2.2.33.2
by Maciej Milaszewski IQ PL 24 Jan '19

24 Jan '19

Hi I have little problem with debian10 and dovecot 2.2.33.2 ps -ax 21815 ? S 0:00 dovecot/pop3-login director 21816 ? S 0:00 dovecot/pop3-login director 21817 ? S 0:00 dovecot/pop3-login director 21818 ? S 0:00 dovecot/pop3-login director 21819 ? S 0:00 dovecot/pop3-login director 21821 ? S 0:00 dovecot/pop3-login director 21822 ? S 0:00 dovecot/pop3-login director But if I testes via telnet like this: telnet 46.xxx.xxx.113 143 Trying 46.xxx.xxx.113... Connected to 46.xxx.xxx.113. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Imap ready. ^] telnet> q Connection closed. and ps: 21808 ? S 0:00 dovecot/imap-login ??????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????? 21826 ? S 0:00 dovecot/imap-login ????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????? strace: strace -p 21808 strace: Process 21808 attached gettimeofday({tv_sec=1548168193, tv_usec=419420}, NULL) = 0 epoll_wait(14, doveconf: doveconf -n |head -n 4 # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 4.19.0-1-amd64 x86_64 Debian buster/sid auth_cache_negative_ttl = 5 mins Probably dovecot not closed correctly imap-login and this same for imap-pop3. Any idea ? -- Maciej Miłaszewski IQ PL Sp. z o.o. Starszy Administrator Systemowy Biuro Obsługi Klienta: e-mail: bok(a)iq.pl tel.: +48 58 326 09 90 - 94 fax: +48 58 326 09 99 Dział pomocy: https://www.iq.pl/pomoc Informacja dotycząca przetwarzania danych osobowych: https://www.iq.pl/kontakt Jakość gwarantuje: ISO 9001:2000 IQ PL Sp. z o.o. z siedzibą w Gdańsku (80-298), ul. Geodetów 16, KRS 0000007725, Sąd rejestrowy: Sąd Rejonowy w Gdańsku VII Wydział KRS, kapitał zakładowy: 140.000 PLN, NIP 5832736211, REGON 192478853

2 13

[FTS Xapian] RC release
by Joan Moreau 24 Jan '19

24 Jan '19

Hi, FTS Xapian matches my targets for the plugins (replacing deprecated fts-squat in a production environment) https://github.com/grosjo/fts-xapian Please do not hesitate to add "issues" on github, if the case happen Hope it helps JM

3 2

Moving messages between servers with different configurations
by Marc Roos 22 Jan '19

22 Jan '19

I wanted to move messages from a mbox mailbox on server A to mdbox on server B. I thought I could do this by connecting to the remote server with "doveadm move -S x.x.x.x:x -u testuser Archive/2017 mailbox INBOX/test" but I guess this will only allow and move messages internally on server B? Should I use dsync, or is there another way to move the messages?

3 5

Having temp mdbox files, what to do with them?
by Marc Roos 22 Jan '19

22 Jan '19

Can I delete these because doveadm is only purging from source, when it is confirmed they are correctly at the destination? [@ storage]# ls -ac1rt m.554 m.569 m.564 m.559 m.561 .temp.1548002572.P1969Q0M313023.mail03 .temp.1548002572.P1969Q1M313023.mail03 .temp.1548002572.P1969Q2M313023.mail03 . .temp.1548002572.P1969Q3M313023.mail03

1 1

Encoding input
by Joan Moreau 22 Jan '19

22 Jan '19

Hi Are data inputs of fts_backend_update_build_more(struct fts_backend_update_context *_ctx, const unsigned char *data, size_t size) already converted to UTF8 ? Thanks

1 0

Changing the imaps port #
by Patrick Mahan 22 Jan '19

22 Jan '19

Dovecot 2.3.4, FreeBSD 11.2 Due to comcast buisness ISP intercepting imaps I need to have my clients connect to non-standard port (9999). Previously I had been using stunnel to receive the imaps connection and forward it to the imap port over 127.0.0.1. But I would like to retire stunnel and have my imap clients connect remotely. I have configured the imap-login service - service imap-login { inet_listener imap { address = 127.0.0.1, ::1 port = 143 } inet_listener imaps { port = 9999 } process_min_avail = 3 service_count = 0 vsz_limit = 1 G } But I am not seeing any listeners on port 9999 - root@ns(1001)# netstat -an | grep 9999 Using sockstat on FreeBSD: root@ns(1002)# sockstat | grep dovecot | grep tcp root dovecot 34800 15 tcp4 *:4190 *:* root dovecot 34800 37 tcp4 127.0.0.1:143 *:* root dovecot 34800 38 tcp6 ::1:143 *:* I have mail_debug = yes, but I don't see any failures. What is the best way to debug why I am not seeing this port number? Thanks, Patrick

4 6

RE: How to connect to a remote server and execute eg a search
by Marc Roos 22 Jan '19

22 Jan '19

Thanks Sami, And I should allow access on the remote server via login_access_sockets? And the authenticated user via this connection is then testuser I presume? > > > Is there a page that explains how to connect to a remote server? What > is the syntax of socket_path? > > > doveadm search -S XXXXXXX -u testuser mailbox INBOX ALL -S <ip>:<port> Sami

2 1

How to connect to a remote server and execute eg a search
by Marc Roos 21 Jan '19

21 Jan '19

Is there a page that explains how to connect to a remote server? What is the syntax of socket_path? doveadm search -S XXXXXXX -u testuser mailbox INBOX ALL

2 1

FOSDEM
by Michael Slusarz 21 Jan '19

21 Jan '19

Hello all, Several Open-Xchange/Dovecot folks will be attending FOSDEM in Brussels on 2-3 February 2019. For those of you planning to attend: we would love to meet and chat with members of the Dovecot community! Come find us wandering around the talks, or look for us in the evening. Rumor is Brussels has some good beer... Also, we'd love to invite everyone to a talk we are giving on the Chat Over IMAP initiative we have been working on. It takes place Sunday at 1105 in the Real-Time Communications room: https://fosdem.org/2019/schedule/event/chat_over_imap/ Hope to see some of you there! michael

1 0

Dovecot can't access mailbox that exists (nested)
by Edgaras Lukoševičius 21 Jan '19

21 Jan '19

Hello, I have this strange situation on nested mailboxes (directories) # dovecot --version 2.2.36 (1f10bfa63) # doveconf -n # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.24 (124e06aa) # OS: Linux 3.10.0-693.21.1.el7.x86_64 x86_64 CentOS Linux release 7.5.1804 (Core) mail_access_groups = vmail mail_location = maildir:%h mail_plugins = quota stats quota_clone mailbox_list_index = yes managesieve_sieve_capability = fileinto envelope encoded-character subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. separator = . type = private } protocols = imap lmtp pop3 sieve service imap-login { inet_listener imap-dsync { port = 1143 } inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 300 process_min_avail = 1 } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 ssl = yes } process_min_avail = 5 } service pop3-login { inet_listener pop3-dsync { port = 1110 } inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_limit = 300 process_min_avail = 1 } service stats { fifo_listener stats-mail { group = vmail mode = 0600 user = vmail } fifo_listener stats-user { group = vmail mode = 0600 user = vmail } } protocol lmtp { mail_plugins = quota stats quota_clone sieve } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 50 mail_plugins = quota stats quota_clone imap_quota imap_stats } protocol sieve { mail_max_userip_connections = 10 } protocol pop3 { mail_plugins = quota stats quota_clone pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_enable_last = yes } # ls -1a (Mailbox structure) cur dovecot.index dovecot.index.cache dovecot.index.log dovecot.list.index dovecot.list.index.log dovecot.mailbox.log dovecot-uidlist dovecot-uidvalidity .Drafts .Junk maildirfolder maildirsize new .Received 1.1522486 - Subdirname.Received .Received 1.1522486 - Subdirname.Sent .Sent sieve subscriptions tmp .Trash .Trash.Sent (2) # doveadm mailbox list -u name(a)domain.com INBOX INBOX.Trash INBOX.Trash.Sent (2) INBOX.Sent INBOX.Received 1 INBOX.Received 1.1522486 - Subdirname INBOX.Received 1.1522486 - Subdirname.Sent INBOX.Received 1.1522486 - Subdirname.Received INBOX.Junk INBOX.Drafts # doveadm mailbox status -u name(a)domain.com -t all INBOX.* doveadm(name(a)domain.com): Error: Mailbox INBOX.Received 1: Failed to lookup mailbox status: Mailbox doesn't exist: INBOX.Received 1 doveadm(name(a)domain.com): Error: Mailbox INBOX.Received 1.1522486 - Subdirname: Failed to lookup mailbox status: Mailbox doesn't exist: INBOX.Received 1.1522486 - Subdirname messages=16 recent=0 unseen=1 vsize=3432379 The problem is that it's not possible to move this mailbox between servers using dovecot dsync/imapc. But I can see the messages inside these mailboxes using external IMAP/POP clients.

3 2

Unexpected accounts showing up in replication status (doveadm replicator status '*')
by Daniel Schütze 21 Jan '19

21 Jan '19

I have a replication set up with two dovecot 2.3.4 servers. Messages appear to be replicating fine between them, however there is an oddity when I run doveadm replicator status '*' and I'm worried work is being carried out needlessly. Both machines have identical configs and have a mysql backend for username/passwords. Both machines point to the same mysql server and same tables. When I run doveadm user '*' On either machine I am presented with the same correct list of users. The users are presented in the form: username and not username@domain. When I run doveadm replicator status '*' On either machine I receive a list of usernames which includes not only username but also username@domain. Both of these "accounts" have fast sync, full sync and success sync entries and these are not the same times between username and username@domain (hence I'm worried unnecessary work is being carried out). My ee dovecot-sql.conf.ext Has these entires re usernames user_query = SELECT home, uid, gid FROM users WHERE username = '%n' password_query = SELECT username AS user, domain, password, home AS userdb_home, uid AS userdb_uid, gid AS userdb_gid FROM users WHERE username = '%u' [Having copied these in I do see the different usage of %u and %n] iterate_query = SELECT username AS user,domain FROM users The users table is as follows +--------------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +--------------+--------------+------+-----+---------+-------+ | username | varchar(128) | NO | | NULL | | | domain | varchar(128) | NO | | NULL | | | password | varchar(64) | NO | | NULL | | | home | varchar(255) | NO | | NULL | | | uid | int(11) | NO | | NULL | | | gid | int(11) | NO | | NULL | | | active | char(1) | NO | | Y | | | mail_replica | varchar(255) | NO | | NULL | | +--------------+--------------+------+-----+---------+-------+ I assume that the duplication of username with and without domains isn't as intended, any suggestions where I am going wrong? I did previously have the servers running with the iterate query commented out and when that was the case doveadm user '*' returned the correct number of accounts but in the format username@domain and the replicator status again 'double listed' accounts as described above. Thank you for any tips! -- Daniel Schütze Director ------------------ CWA International Balmoral House 9 John Street London WC1N 2ES (t) + 44 (0)20 7242 8444 (e) dms(a)cwa.uk.com (w) http://www.cwa.uk.com/

1 1

doveadm proxy list repeats header line
by Michael Goth 20 Jan '19

20 Jan '19

Hi all, just a minor thing: Why does `doveadm proxy list` repeat the header line after each entry? Too me, that just makes the output harder to read. So instead of this: root@mail1 ~ # doveadm proxy list username proto src ip dest ip port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 username service src-ip dest-ip dest-port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 username service src-ip dest-ip dest-port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 username service src-ip dest-ip dest-port tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 username service src-ip dest-ip dest-port tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 I'd prefer this: root@mail1 ~ # doveadm proxy list username proto src ip dest ip port info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 info(a)domain1.de imap 80.152.196.98 222.133.127.53 993 tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 tj(a)domain1.de imap 83.149.131.71 222.133.127.53 993 The repeated header lines also happen with other formatters. Regards, Michael

3 3

Panic…
by SH Development 20 Jan '19

20 Jan '19

I have started getting these in my log. What does this mean and what do I need to do? Panic: file mail-index-util.c: line 37 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000) Dec 12 23:29:44 mail dovecot: imap(jeff(a)stariontech.com): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x3cafa) [0x7f38c5a2cafa] -> /usr/lib64/dovecot/libdovecot.so.0(+0x3cb46) [0x7f38c5a2cb46] -> /usr/lib64/dovecot/libdovecot.so.0(+0x16e2a) [0x7f38c5a06e2a] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_uint32_to_offset+0x74) [0x7f38c5d0d3f4] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x81abd) [0x7f38c5cf3abd] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_cache_compress+0x77) [0x7f38c5cf4247] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_commit+0x1d2) [0x7f38c5d08012] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x5fd88) [0x7f38c5cd1d88] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x570a0) [0x7f38c5cc90a0] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_storage_sync_force+0x52) [0x7f38c5cc94c2] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_file_do+0x99) [0x7f38c5cc9f49] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x59b7f) [0x7f38c5ccbb7f] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mail_set_seq+0x112) [0x7f38c5cb64f2] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x16b) [0x7f38c5cbae9b] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x20) [0x7f38c5ca2240] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_search_next+0x26) [0x7f38c5ca2296] -> dovecot/imap(imap_fetch_more+0x2bf) [0x41221f] -> dovecot/imap(cmd_fetch+0x42c) [0x40a33c] -> dovecot/imap() [0x40f90d] -> dovecot/imap() [0x40f9fa] -> dovecot/imap(client_handle_input+0x135) [0x40fc25] -> dovecot/imap(client_input+0x5f) [0x41054f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x48) [0x7f38c5a37e98] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f38c5a38e0f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f38c5a37e28] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f38c5a26293] -> dovecot/imap(main+0x2f9) [0x418849] -> /lib64/libc.so.6(__libc_start_main+0x10 Dec 12 23:29:44 mail dovecot: master: Error: service(imap): child 11157 killed with signal 6 (core dumps disabled)

6 5

I never touched nuthin'
by mick crane 20 Jan '19

20 Jan '19

hello, do you mind if I ask before I start poking about ? suddenly I notice that gmail is ignoring or because there is an error getmail is not sending the delete request. Mails are sent and received but not deleted gmail so I keep getting them. mick@rapunzel:~/.getmail$ getmail --rcfile getmailrc1 Delivery error (command deliver 1363 wrote to stderr: lda(mick,)Error: net_connect_unix(/var/run/dovecot//stats-writer) failed: Permission denied) I think is apt install dovecot on debian buster probably I updated yesterday but was working OK since so I dunno what happened. is log full or something ? advices appreciated mick -- Key ID C7D6E24C

4 6