- dovecot - dovecot.org

doveadm-server protocol change?
by Heiko Schlittermann 13 Jun '16

13 Jun '16

Hi, I'm doing quota checks from a remote machine (the real setup is a bit more complex, if necessary I can explain it in more detail, but I just extracted the bits that are easily reproduceable) # nc backend1 24245 VERSION doveadm-server 1 0 PLAIN agrVMDvHgz0ya2HHzax5svwB2ZHS¹ + heiko quota get But since the backend is upgraded to 2.2.22 it's not possible anymore. The exuse in the log of the backend is: dovecot: doveadm(149.1.1.1¹): Fatal: USER environment is missing and -u option not used Running the `doveadm quota get -u heiko` locally on the backend works as expected. But using the the doveadm-server it doesn't. # 2.2.22 (fe789d2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: Linux 4.4.0-22-generic x86_64 Ubuntu 16.04 LTS … auth_cache_negative_ttl = 0 auth_cache_ttl = 0 auth_master_user_separator = * base_dir = /run/dovecot/ imap_metadata = yes lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_attribute_dict = file:%h/dovecot-attributes mail_location = maildir:~:INBOX=/volumes/dovecot/inbox/%2.256Nn/%n:INDEX=/volumes/dovecot/cache/%2.256Nn/%n mail_plugins = quota mbox_md5 = all mmap_disable = yes namespace inbox { … passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.passdb.conf.ext driver = ldap } plugin { quota = maildir:User quota quota_grace = 10%% sieve = /volumes/dovecot/sieve/%2.256Nn/%n/.dovecot.sieve sieve_dir = /volumes/dovecot/sieve/%2.256Nn/%n } pop3_uidl_format = %v.%u protocols = " imap lmtp pop3" service auth { extra_groups = ssl-cert } service doveadm { inet_listener { port = 24245 } } service lmtp { inet_listener lmtp { port = 2525 } } ssl = required ssl_cert = </etc/ssl/certs/snakeoil-crt.pem ssl_key = </etc/ssl/private/snakeoil-key.pem userdb { driver = prefetch override_fields = home=/volumes/dovecot/home/%2.256Nn/%n uid=vmail gid=vmail } userdb { args = /etc/dovecot/dovecot-ldap.userdb.conf.ext driver = ldap override_fields = home=/volumes/dovecot/home/%2.256Nn/%n uid=vmail gid=vmail } verbose_proctitle = yes protocol lmtp { mail_plugins = quota sieve quota } protocol lda { mail_plugins = quota sieve } protocol imap { mail_plugins = quota imap_quota } local 149.1.1.0/24¹ { doveadm_password = # hidden, use -P to show it } ¹) It's changed :)

5 13

doveadm fts rescan <namespace> doesn't seem(!) to find <namespace>
by Larry Rosenman 13 Jun '16

13 Jun '16

thebighonker.lerctr.org ~ $ doveadm fts rescan \#ARCHIVE doveadm(ler): Error: Namespace prefix not found: #ARCHIVE thebighonker.lerctr.org ~ $ doveadm fts rescan #ARCHIVE thebighonker.lerctr.org ~ $ doveadm fts rescan inbox doveadm(ler): Error: Namespace prefix not found: inbox thebighonker.lerctr.org ~ $ Doveconf -n attached. -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

1 1

Potential bug report: Cannot use ":args" option via Pigeonhole Sieve pipe plugin
by Zeeshan Muhammad 13 Jun '16

13 Jun '16

Hi all, Following the instructions noted at http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Pipe , I am trying to make use of the Pigeonhole sieve pipe plugin to execute an application with custom arguments via my test sieve script: require ["vnd.dovecot.pipe"]; if address :is "to" "test(a)example.com" { pipe :args [ "first-arg", "second-arg" ] "sieve-pipe-example"; } I am editing my test sieve script via Mozilla Thunderbird v45.1.1 using the Sieve email-client addon (v0.2.3h, see https://github.com/thsmi/sieve#releases and https://addons.mozilla.org/en-US/thunderbird/addon/sieve/ ) When I attempt to save the example sieve script above, I get the following error returned by ManageSieve via Mozilla Thunderbird's Sieve addon: "The script could not be saved: Sieve mail filter: line 3: error: unknown tagged argument ':args' for the pipe command (reported only once at first occurrence). Sieve mail filter: error: validation failed." I have setup sieve-pipe-example as follows in my 90-sieve.conf configuration: service sieve-pipe-script { executable = script /usr/bin/echo user = dovenull # socket name is program-name in Sieve unix_listener sieve-pipe-example { } } I cannot see where I am going wrong. I have combed through the specification at http://hg.rename-it.nl/dovecot-2.2-pigeonhole/raw-file/tip/doc/rfc/spec-bos… as well as the official Dovecot/Pigeonhole wiki-pages and cannot find a solution. If I omit the :args option (and the arguments array), the sieve script successfully gets accepted by ManageSieve. Am I encountering a potential bug or am I doing something silly in my test setup? # Dovecot version: v2.2.24 # Pigeonhole version: v0.4.14 # Operating system: CentOS Linux release 7.2.1511 (Core) # CPU architecture: x86_64 # Dovecot -n output (I have filtered my IP addresses and mail server's FQDN): # 2.2.24 (a82c823): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.14 (099a97c) # OS: Linux 3.10.0-327.18.2.el7.x86_64 x86_64 CentOS Linux release 7.2.1511 (Core) auth_default_realm = example.com base_dir = /var/run/dovecot/ default_login_user = vpopmail first_valid_uid = 500 info_log_path = /dev/stderr last_valid_uid = 500 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /dev/stderr mail_debug = yes mail_location = maildir:~/Maildir mail_max_userip_connections = 20 mail_plugins = " fts fts_lucene" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext editheader vnd.dovecot.pipe namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = vpopmail } plugin { fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@. sieve = file:~/sieve;active=~/.dovecot.sieve sieve_execute_socket_dir = sieve-execute sieve_extensions = +editheader +vnd.dovecot.pipe sieve_pipe_socket_dir = sieve-pipe sieve_plugins = sieve_extprograms } protocols = imap pop3 sieve service auth { unix_listener auth-userdb { group = vchkpw mode = 0666 user = vpopmail } } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 ssl = no } inet_listener imaps { address = 192.168.1.1 port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { address = 127.0.0.1 port = 110 ssl = no } inet_listener pop3s { address = 192.168.1.1 port = 995 ssl = yes } } service sieve-pipe-script { executable = script /usr/bin/echo group = dovenull user = dovenull } ssl_cert = </etc/ssl/certs/example.com.crt ssl_key = </etc/ssl/certs/example.com.key ssl_protocols = !SSLv2 !SSLv3 userdb { driver = vpopmail } verbose_proctitle = yes protocol lda { hostname = mail.example.com info_log_path = /var/log/dovecot/dovecot-lda.log log_path = /var/log/dovecot/dovecot-lda-errors.log mail_plugins = " fts fts_lucene sieve" postmaster_address = postmaster(a)example.com } protocol imap { mail_plugins = " fts fts_lucene imap_zlib" }

2 2

Marking an entire mailbox read
by ＠lbutlr 13 Jun '16

13 Jun '16

I have an archive mailbox that contains in excess of 100,000 mail messages (stored in maildir) that accidentally got marked as unread. It is too large for my mail client to select all the mail and mark it as read without throttling. Is there a simple way that I can use doveadm or something to simply mark every message in that maildir as read? Or do I just loop through every message and move it to <messaage>+S? find ~/Maildir/.Archive/cur/* -type f -name “1*:2” --exec mv {} {}S \; -- By the way, I think you might be the prettiest girl I've ever seen outside the pages of a really filthy magazine

2 2

sieve vacation script exclude based on sender email address
by Harondel J. Sibble 13 Jun '16

13 Jun '16

I thought I'd asked this question a few years ago but can't seem to find any eveidence of that so here goes. I've been looking at the sieve docs and recipes, done a lot of googling but no joy so far. Using stanard vacation script and that works great, however I want to exclude certain sender email addressess from ever receiving a vacation autoresponse, how do I go about adding that to my existing vacation recipe. I suspect my search terminology is what is causing me not to find anything as I typically am using exclude and similar search terms. -- Harondel J. Sibble Sibble Computer Consulting Ltd. Creating Solutions for the small and medium business computer user. harondel(a)pdscc.com (use pgp keyid 0x3CC3CFCE not 0x3AD5C11D) http://www.pdscc.com Blog: http://www.pdscc.com/blog (604) 739-3709 (voice)

2 3

Unknow Imap Fatal Panic
by Sven Roellig 12 Jun '16

12 Jun '16

Hello, when i sync an Mailbox from old Dovecot to the new Dovecot System the new dovecot Imap create an Fatal/Panic log. Error Log <5Je8ahM17oSwCVUI>: Fatal: master: service(imap): child 4670 killed with signal 6 (core dumps disabled) <ArG9ahM174SwCVUI>: Panic: file mail-index-transaction-update.c: line 803 (mail_index_ext_resize): assertion failed: (record_align != (uint16_t)-1) <ArG9ahM174SwCVUI>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x8d04e) [0x7fb23526104e] -> /usr/lib/dovecot/libdovecot.so.0(+0x8d13c) [0x7fb23526113c] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fb2351ffd1e] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_ext_resize+0x3d0) [0x7fb2355c1780] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_update_header+0x133) [0x7fb235545493] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5d5bc) [0x7fb2355455bc] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_mailbox_create_indexes+0x10) [0x7fb235545710] -> /usr/lib/dovecot/libdovecot-storage.so.0(dbox_mailbox_create_indexes+0x93) [0x7fb235549f93] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5d87a) [0x7fb23554587a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa06cc) [0x7fb2355886cc] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_get_metadata+0x63) [0x7fb23552d253] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync_name+0x2a7) [0x7fb2355892d7] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync+0x12c) [0x7fb2355899ec] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_refresh_force+0xc5) [0x7fb23558b095] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9f571) [0x7fb235587571] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa074f) [0x7fb23558874f] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_get_metadata+0x63) [0x7fb23552d253] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x3a43e) [0x7fb23552243e] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_user_autoexpunge+0x105) [0x7fb2355226b5] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_user_unref+0x88) [0x7fb235532838] -> dovecot/imap(+0x1b224) [0x7fb235c6a224] -> dovecot/imap(client_input+0xba) [0x7fb235c69d9a] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7fb23527508c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x101) [0x7fb2352764f1] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7fb235275115] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fb2352752b8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fb235206273] -> dovecot/imap(main+0x322) [0x7fb235c5cad2] dovecot -n # 2.3.0.alpha0 (90dd3c6) [XI:2:2.3.0~alpha0-1~auto+111]: /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.alpha0 (67dfb5a) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.5 ext4 auth_mechanisms = plain login auth_verbose_passwords = plain dict { expire = mysql:/etc/dovecot/dovecot-dict-expire.conf.ext } imap_hibernate_timeout = 10 secs lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_gid = vmail mail_location = mdbox:/var/vmail/dovecot/mailboxes/%d/%n:INDEX=/var/vmail/dovecot/indexes/%d/%n:ALT=/var/vmail_altstorage/dovecot/mailboxes/%d/%n mail_plugins = quota zlib acl expire mail_uid = vmail namespace inbox { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe } mailbox Trash { auto = subscribe autoexpunge = 10 days special_use = \Trash } mailbox name { special_use = \Drafts \Junk \Sent \Trash \Archive } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/var/vmail/dovecot/shared-mailboxes expire = Trash expire2 = Trash/* expire3 = Spam expire_cache = yes expire_dict = proxy::expire quota = dirsize:User quota quota_exceeded_message = Quota überschritten ..... quota_grace = 10%% quota_over_flag_value = TRUE quota_over_script = quota-warning mismatch %u quota_rule = Trash:storage=+500M quota_rule2 = Spam:storage=+500M quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is over quota / Mailbox ist voll quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = -storage=100%% quota-warning below %u sieve = /var/vmail/sieve/%d/%n/dovecot.sieve sieve_dir = /var/vmail/sieve/%d/%n/dovecot sieve_global_dir = /var/vmail/sieve/sieve sieve_global_path = /var/vmail/sieve/sieveglobalfilter.sieve zlib_save = lz4 zlib_save_level = 9 } protocols = " imap lmtp" service auth { unix_listener /var/spool/postfix/private/auth { group = mail mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0660 } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-hibernate { unix_listener imap-hibernate { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { port = 2003 } unix_listener lmtp { mode = 0666 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 10000 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { group = users mode = 0666 user = vmail } user = root } ssl_cert = </etc/dovecot/private/....de.pem ssl_key = </etc/dovecot/private/.....pem userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = quota zlib acl expire sieve } protocol imap { mail_plugins = quota zlib acl expire imap_zlib imap_quota imap_acl } protocol lmtp { mail_plugins = quota zlib acl expire sieve postmaster_address = postmaster(a)blabla.blubb quota_full_tempfail = yes } Sorry for my English Sven

1 0

Scalability of Dovecot in the Cloud
by KT Walrus 12 Jun '16

12 Jun '16

Does anyone have any idea of how many IMAP connections a single cloud VM (4 vCores at 2.4GHz, 30GB RAM, local SSD storage - non-RAID) can be expected to handle in production. The mailboxes are fairly small (average 5MB total - 50MB max, as I don’t store attachments in Dovecot expect those saved through IMAP in the Sent/Drafts folders) and each user will probably have an average of 2 devices that have the mail clients configured to access each mailbox. Can such a server handle 100,000 mailboxes (200,000 devices/clients)? Or is it more like 10,000? Or, even smaller? I can scale the cloud VM up to 32 vCores and 240GB RAM (at 8 times the price) or split the mailboxes onto multiple VMs. The VM will also be running LMTP and other Dovecot services (I don’t plan on supporting POP3 at this time). The mailboxes will be sync’d to a backup VM running Dovecot for high availability so has some load from this background activity. LMTP will not be that high a load, I think, since most messages will be delivered by at night. But, clients will have IMAP connections 24/7. Just trying to get an idea of the cost of running a potentially huge/growing mail service in the cloud… I’m going to have to support around a million mailboxes before the site will generate significant revenue to support operations. Kevin

4 4

postfix+dovecot and usernames different to e-mail addresses
by Benjamin 10 Jun '16

10 Jun '16

Hi, I want to replace an old mailserver setup with postfix+dovecot. The problem I'm facing now is, that the old system had usernames different to the e-mail address of the user. For example: E-Mail-Address: foo(a)example.com Username: foo-example.com I configured postfix so that it passes mails to dovecot using the following command (master.cf): dovecot unix - n n - - pipe flags=DRhu user=mail-data:mail-data argv=/usr/lib/dovecot /dovecot-lda -a $(recipient) When dovecot now receives an e-mail from postfix it logs dovecot: lda(mail-data): Error: User initialization failed: Namespace 'INBOX.': Home directory not set for user. Can't expand ~/ for mail root dir in: ~/Maildir dovecot: lda: Fatal: Invalid user settings. Refer to server log for more information. My dovecot-ldap configuration looks quite simple: hosts = 192.168.0.1,192.168.0.2 dn = cn=mailadmin,dc=example,dc=com dnpass = foo auth_bind = yes ldap_version = 3 base = ou=users,dc=example,dc=com user_attrs = mailMessageStore=home user_filter = (&(objectClass=qmailUser)(uid=%u)) pass_filter = (&(objectClass=qmailUser)(uid=%u)) I think dovecot does not know that the username is not the e-mail address, but how can I tell him? Furthermore we have alternative addresses here, so for example there may be an e-mail address bar(a)example.com owned by foo-example.com who has foo(a)example.com as primary address. Dovecot itself (IMAP) works fine, so here it can find the correct Maildir for the user. The difference is, that I connect using the username instead of the e-mail address in this case. # dovecot --version 2.2.22 (fe789d2) # postconf -d | grep mail_version mail_version = 3.1.0 # lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 16.04 LTS Release: 16.04 Codename: xenial Thanks for your help Benjamin

2 5

Easily kick and flush dovecot cache for all dovecot mailboxes in a domain
by Murray T. | Dreamscape 10 Jun '16

10 Jun '16

Hi, We are running a dovecot director cluster. We want to be able to easily kick all mailboxes in a domain off all backend mailstores. We also then want to flush the dovecot cache for all dovecot mailboxes in the domain. Is there a single command we can run on one of the front-end director mail proxies or backend mailstores that will do this instead of having to kick or flush each mailbox in a domain individually on each mailstore. Thanks Murray Trainer Regards, Murray T. Level 3 Project Manager P: +61 8 9422 0894 F: +61 8 9422 0801 www.DreamscapeNetworks.com<http://www.dreamscapenetworks.com/> [dreamscape]<http://www.dreamscapenetworks.com/> DISCLAIMER: This e-mail and/or attachments are confidential and may also be privileged. If you are not the named recipient, please notify the sender immediately and do not disclose the contents to other persons or use it for any purpose or store or copy the information in any medium. Any views expressed in this message are those of the individual sender, except where the sender specifically states them to be the views of Dreamscape Networks. Copyright (c) 2016 www.DreamscapeNetworks.com<http://www.dreamscapenetworks.com/>, All rights reserved.

1 0

Re: Advice on once a day message delivery setup
by Joseph Tam 09 Jun '16

09 Jun '16

KT Walrus <kevin(a)my.walr.us> writes: > Just looking for any advice? I kind of like the idea of modeling my > mail service after the US Post Office where the mailman delivers new > mail once a day rather than like Twitter/Facebook where messages are > posted in real time to encourage users to monitor their boxes > throughout the day. You've rediscovered digesting, which many mailing list (including this one), will batch up messages and periodically send them as one large message (using MIME multipart or some other combination technique). The only difference is that your doing it at the receiving end. I wouldn't recommend it for all mail, but it could be useful to aggregate high-volume low-priority mail into managable chunks. There are many ways you could accomplish it, but the most straightforward way is to deliver new mail to sideline mailbox, and have a cron script deliver them to the user's INBOX (possibly digesting them into one message). Joseph Tam <jtam.home(a)gmail.com>

1 0

password expire warning for dovecot users in IMAP/POP login
by mkawada＠redhat.com 09 Jun '16

09 Jun '16

Dear list, Is it possible to give a notification about password exprire warning to users authenticated by OpenLDAP when the users login via dovecot using IMAP or POP? For example, when you ssh to a server and/or run ldapsearch, you can be warned with password expire warning like below: # ssh testuser@localhost testuser@localhost's password: Your password will expire in 31 minute(s). <== Last login: Wed Jun 8 12:22:08 2016 from localhost.localdomain ]$ ldapsearch -LLL -D uid=testuser,ou=People,dc=example,dc=com -w redhat "cn=testuser" -e ppolicy ldap_bind: Success (0) (Password expires in 1808 seconds) <== dn: uid=testuser,ou=People,dc=example,dc=com Does the same can be done for dovecot users authenticated by OpenLDAP in IMAP/POP? Thanks, -- Masaharu Kawada

7 11

userdb for imap proxy
by KT Walrus 08 Jun '16

08 Jun '16

If I’m running only imap-login service in my dovecot imap proxy, do I need to configure userdb or only passdb?

2 2

Fw: Can't delete emails from or write replies to Inbox
by chaouche yacine 08 Jun '16

08 Jun '16

----- Forwarded Message ----- From: chaouche yacine <yacinechaouche(a)yahoo.com> To: Edwin Humphries <edwinh(a)earthcaretech.com.au> Sent: Wednesday, June 8, 2016 10:31 AM Subject: Re: Can't delete emails from or write replies to Inbox We have made a copy of our mail server and we sometimes rsync files between the original server and the copy so that when we need to do maintenance work we unplug the production server and put the copy server in lieu. We later found out that rsync needs to be run with the --no-numeric-ids argument to keep owners and groups intact, otherwise you end up with weired owners and groups. Yassine. ________________________________ From: Edwin Humphries <edwinh(a)earthcaretech.com.au> To: chaouche yacine <yacinechaouche(a)yahoo.com> Sent: Wednesday, June 8, 2016 5:23 AM Subject: Re: Can't delete emails from or write replies to Inbox Chaouche Duh! I reproduced the issue, then found the log file (mail.log, in my case) and found that that user wasn't in the mail group (which is itself a puzzle, because it used to be, but not sure I'm going to spend much time investigating why); added the user to the mail group, restarted dovecot, and hey presto, everything works. Regards, Edwin Humphries Mobile: 0419 233 051 EarthCare Technology (a division of Ironstone Technology Pty Ltd) 79 Barney St, Kiama, NSW, 2533 Web: http://www.earthcaretech.com.au -- This email is intended for the named addressee/s only and may contain confidential or privileged information. If you are not a named addressee please delete it and notify the sender. -- "Sometimes when I consider what tremendous consequences come from little things…I am tempted to think…there are no little things." Bruce Barton "The activist is not the man who says the river is dirty. The activist is the man who cleans up the river." Ross Perot "Our world has enough for each person's need, but not for his greed." Mahatma Gandhi "The best way to predict the future...is to create it." Source unknown "He who knows that enough is enough will always have enough." Lao Tzu "For man two wings are necessary. One wing is physical power and material civilisation; the other is spiritual power and divine civilisation. With one wing only, flight is impossible. Two wings are essential. Therefore, no matter how much material civilisation advances, it cannot attain to perfection except through the uplift of spiritual civilisation." 'Abdu'l-Baha, Promulgation of Universal Peace On 07/06/16 19:20, chaouche yacine wrote: How about some /var/log/dovecot.log lines ? ----- Original Message ----- From: Edwin Humphries <edwinh(a)earthcaretech.com.au> To: Dovecot Mailing List <dovecot(a)dovecot.org> Sent: Tuesday, June 7, 2016 1:22 AM Subject: Can't delete emails from or write replies to Inbox Hi, I'm running Dovecot and Thunderbird, with 2 separate accounts (business and personal). One operates fine, but the other one won't allow me to write replies to the Inbox (so that I can track current threads), and if I move emails to another folder, it copies them instead. New emails do appear in the Inbox. I've checked the permissions on the two Inboxes, and they are the same (except for the owner name). I've tried compacting the problem Inbox, but that hasn't changed things. Edwin

1 0

segfault in IMAP APPEND with compressed maildir
by Roland Rosenfeld 08 Jun '16

08 Jun '16

Hi! After upgrading from Debian wheezy with (self compiled) dovecot 2.2.15 to Debian jessie with (self compiled) 2.2.24, I observe the following segmentation fault in the logs: Jun 7 09:23:09 imap dovecot: imap(user(a)example.com): Error: read(<imap client>) failed: read(size=8003) failed: Connection reset by peer (uid=0, box=trash) Jun 7 09:23:09 imap dovecot: imap(user(a)example.com): Error: zlib.read(/srv/mailstore/user(a)example.com/mail/.trash/tmp/1465283884.M336492P22902.imap): unexpected EOF at 88001 Jun 7 09:23:09 imap dovecot: imap(user(a)example.com): Error: read(zlib(/srv/mailstore/user(a)example.com/mail/.trash/tmp/1465283884.M336492P22902.imap)) failed: read(/srv/mailstore/user(a)example.com/mail/.trash/tmp/1465283884.M336492P22902.imap) failed: zlib.read(/srv/mailstore/user(a)example.com/mail/.trash/tmp/1465283884.M336492P22902.imap): unexpected EOF at 88001 (uid=0, box=trash) Jun 7 09:23:09 imap dovecot: imap(user(a)example.com): Fatal: master: service(imap): child 22902 killed with signal 11 (core dumped) We also observed the same (rare) error in the past on the old system. But on the old system, there were only the first 3 lines without the segmentation fault, so we ignored the issue until now. The problem always happens on IMAP folders where the client writes to, like "trash", "drafts", "sent" and the like. I wasn't able to actively reproduce this issue, but can only observe in the logs that some customers run into this issue from time to time. So all I have is a core dump with the following backtrace: Core was generated by `dovecot/imap'. Program terminated with signal SIGSEGV, Segmentation fault. (gdb) bt full #0 0x00007f57e276f29f in i_stream_default_get_size (stream=0x1fd2790, exact=<optimized out>, size_r=0x7ffed3839718) at istream.c:807 No locals. #1 0x00007f57e17024e4 in zlib_mail_close (_mail=0x1fd4de0) at zlib-plugin.c:170 mail = 0x1fd4de0 zmail = 0x1fd5398 zuser = 0x1fbd040 cache = 0x1fbd050 size = 33201320 #2 0x00007f57e2a2a8b9 in mailbox_save_cancel (_ctx=_ctx@entry=0x1fc4d48) at mail-storage.c:2117 ctx = 0x1fd3dd0 keywords = 0x0 mail = <optimized out> __FUNCTION__ = "mailbox_save_cancel" #3 0x000000000040c759 in cmd_append_finish (ctx=0x1fc4cf0) at cmd-append.c:149 __FUNCTION__ = "cmd_append_finish" #4 0x000000000040c835 in client_input_append (cmd=0x1fc4bc0) at cmd-append.c:89 ctx = <optimized out> client = 0x1fc3fc0 reason = 0x1f9e0b8 "Disconnected in APPEND (1 msgs, 306 secs, 188416/1122858 bytes)" finished = <optimized out> lit_offset = <optimized out> __FUNCTION__ = "client_input_append" #5 0x00007f57e2778dcc in io_loop_call_io (io=0x1fc4ad0) at ioloop.c:564 ioloop = 0x1fa6750 t_id = 2 __FUNCTION__ = "io_loop_call_io" #6 0x00007f57e277a0f1 in io_loop_handler_run_internal (ioloop=ioloop@entry=0x1fa6750) at ioloop-epoll.c:220 ctx = 0x1fa8260 io = <optimized out> tv = {tv_sec = 1799, tv_usec = 997118} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 j = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #7 0x00007f57e2778e55 in io_loop_handler_run (ioloop=ioloop@entry=0x1fa6750) at ioloop.c:612 No locals. #8 0x00007f57e2778ff8 in io_loop_run (ioloop=0x1fa6750) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #9 0x00007f57e2713713 in master_service_run (service=0x1fa65f0, callback=callback@entry=0x423a20 <client_connected>) at master-service.c:640 No locals. #10 0x000000000040c427 in main (argc=1, argv=0x1fa6390) at main.c:460 set_roots = {0x42c480 <imap_setting_parser_info>, 0x635440 <lda_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0x1f9e048 "ailed: Connection reset by peer", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x424170 <login_client_connected>, failure_callback = 0x423b30 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 auth_socket_path = 0x42d42e "auth-master" c = <optimized out> This is on a server, which uses compressed maildir on a NFS storage. Here's dovecot -n output: # 2.2.24 (a82c823): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.14 (099a97c) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.4 auth_cache_negative_ttl = 5 mins auth_cache_size = 100 M auth_cache_ttl = 15 mins auth_default_realm = example.com auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf } disable_plaintext_auth = no listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = always mail_gid = 999 mail_location = maildir:~/mail mail_plugins = acl quota zlib mail_uid = 999 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapflags mmap_disable = yes namespace { list = children location = maildir:%%h/mail:INDEX=~/mail/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl quota = maildir sieve = ~/.dovecot.sieve sieve_dir = ~/mail/sieve sieve_extensions = +imapflags zlib_save = gz } pop3_no_flag_updates = yes pop3_uidl_format = %v.%u protocols = imap pop3 sieve service auth { unix_listener auth-master { group = vmail mode = 0600 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap { process_limit = 4000 } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { process_limit = 100 } service pop3 { process_limit = 1000 } shutdown_clients = no ssl = no syslog_facility = local2 userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol imap { mail_max_userip_connections = 10 mail_plugins = acl quota zlib imap_quota imap_acl } protocol pop3 { mail_plugins = acl quota zlib } I hope, that this is all required information to find and solve this issue. Greetings Roland

2 4

Re: [g.danti@assyoma.it: [Dovecot] Re: Questions about hardlinks, alternate storage and compression]
by Gionatan Danti 08 Jun '16

08 Jun '16

Il 26-11-2015 15:15 John R. Dennison ha scritto: > You are strongly encouraged to update that CentOS system. Current is > 6.7 (released some 3 months ago) and dovecot-2.0.9-19. Ouch! I copied outdated information from my old post. My current system _is_ CentOS 6.7 with dovecot dovecot-2.0.9-19.el6_7.2.x86_64 Sorry for the confusion. Still, the problems remain > If you find you need a more modern dovecot version you will find that > dovecot-2.2.19-1 is in the GhettoForge 3rd-party repo, packaged and > maintained by a respected CentOS community member. Information > on this repo can be found by following the links off of: > > http://wiki.centos.org/AdditionalResources/Repositories > The point is that I _don't know_ if more recent Dovecot version have the same problem or not. Moreover, as this is a production machine, I would like to leave a key package as Dovecot as near as possible to the shipping O.S. Thanks. -- Danti Gionatan Supporto Tecnico Assyoma S.r.l. - www.assyoma.it email: g.danti(a)assyoma.it - info(a)assyoma.it GPG public key ID: FF5F32A8

3 10

Slow auth
by Ranbir 07 Jun '16

07 Jun '16

Hi Everyone, I'm running dovecot on a CentOS 7 box using PLAIN and GSSAPI auth. I need to use both because I have some clients that can't use GSSAPI. I haven't been able to get the userdb working properly without a password file and a userdb file. For example, I have to set the home default and change the username_format. I use FreeIPA and the dovecot server is joined properly to the realm. Authentication works (I don't have any passwords in the userdb file). The problem is authentication is slow. When I use Roundcube, the login takes longer than it should. In fact, every operation (changing folders, opening an email, replying, etc.) is just slow. The web server where Roundcube is running is barely loaded, the dovecot server isn't loaded and the FreeIPA server is basically sitting idle. When I watch /var/log/secure as I login to roundcube, I see this in the logs: http://pastebin.ca/3620032 Why is pam_unix being hit and then pam_sss? I'm thinking the pam_unix failures are the reason why the auth is slow. Here's the output from dovecot -n: http://pastebin.ca/3620029 I'm sure I haven't configured something correctly, hence the performance problems. Any help would be appreciated. -- Ranbir

4 6

Multiple recipient delimiter support?
by Tanstaafl 07 Jun '16

07 Jun '16

Trying to find out if dovecot supports the use of multiple recipient delimiters, as postfix does, but can't find an answer... The wiki only mentions it in two meaningful places (that I can find)... With respect to postfix: /wiki.dovecot.org/LDA/Postfix The above seems to imply that for postfix/LDA all I need to do is define it in postfix (which supports multiple recipient delimiters). And with Pigeonhole/Sieve: wiki.dovecot.org/Pigeonhole/Sieve/Configuration It seems to be saying that I must also define the same recipient_delimiters in dovecot config if using LMTP, and also if I want to use sieve for filtering of mail. But, the example and text says nothing about the use of multiple delimiters... So, is this supported? If so, the wiki should be updated to reflect this...

2 4

Can't delete emails from or write replies to Inbox
by Edwin Humphries 07 Jun '16

07 Jun '16

Hi, I'm running Dovecot and Thunderbird, with 2 separate accounts (business and personal). One operates fine, but the other one won't allow me to write replies to the Inbox (so that I can track current threads), and if I move emails to another folder, it copies them instead. New emails do appear in the Inbox. I've checked the permissions on the two Inboxes, and they are the same (except for the owner name). I've tried compacting the problem Inbox, but that hasn't changed things. Edwin

2 1

Re: Blowfish hashed passwords
by KT Walrus 07 Jun '16

07 Jun '16

(I subscribed to a daily digest for this list and can’t figure out how to reply to a reply.) Anyway, Aki Tuomi replied to my feature request saying: > We support in latest 2.2 release > > MD5 MD5-CRYPT SHA SHA1 SHA256 SHA512 SMD5 SSHA SSHA256 SSHA512 PLAIN > CLEAR CLEARTEXT PLAIN-TRUNC CRAM-MD5 SCRAM-SHA-1 HMAC-MD5 DIGEST-MD5 > PLAIN-MD4 PLAIN-MD5 LDAP-MD5 LANMAN NTLM OTP SKEY RPA CRYPT SHA256-CRYPT > SHA512-CRYPT > > There is also blowfish support as BLF-CRYPT, but that requires that your > system supports it. CRYPT supports whatever your crypt() supports. > The reason I suggest building in fallback hash type support is that my install of Dovecot on Ubuntu 14.04 didn’t support SHA512-CRYPT or BLF-CRYPT. If Dovecot just included the PHP .c files to make sure it can process Blowfish/SHA512 password hashes on all installs, it would greatly simplify adding Dovecot as a service for my existing user accounts (without forcing them to give their password for the site so I can generate new hashes in a form that Dovecot supports). SHA256-CRYPT is probably my best option for password hashing since it supports ROUNDS to make hash generation slower. But, I would rather use BLF-CRYPT so I can re-use my existing hashes for my user accounts. Kevin

5 9

Update Kills Dovecot
by Sven Roellig 07 Jun '16

07 Jun '16

Hi,i run Dovecot 2.3.0 Alpha The last two Updates broken dovecot.in the mail.war log i became the error, on every mail, ..........de)<3+RHF1k4VFfDOwAApDKQ5A>: Fatal: master: service(lmtp): child 15299 killed with signal 6 (core dumps disabled) Jun 5 16:39:40 director dovecot: lmtp(roellig(a)*******.org)<1o6JAKw5VFcPPAAApDKQ5A>: Panic: file imem.c: line 60 (i_strconcat): assertion failed: (str1 != NULL) ....dovecot: lmtp(roellig(a)*******.org)<1o6JAKw5VFcPPAAApDKQ5A>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x8cfbe) [0x7f62fe5defbe] -> /usr/lib/dovecot/libdovecot.so.0(+0x8d0ac) [0x7f62fe5df0ac] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f62fe57dd1e] -> /usr/lib/dovecot/libdovecot.so.0(i_strconcat+0x146) [0x7f62fe5e6bb6] -> /usr/lib/dovecot/libdovecot-lda.so.0(duplicate_init+0x5d) [0x7f62feba1dfd] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0x3c) [0x7f62feba47bc] -> dovecot/lmtp(+0x6ac8) [0x7f62fefd3ac8] -> dovecot/lmtp(+0x73cf) [0x7f62fefd43cf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7f62fe5f2ffc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x101) [0x7f62fe5f4461] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7f62fe5f3085] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f62fe5f3228] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f62fe584273] -> dovecot/lmtp(main+0x165) [0x7f62fefd21a5] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f62fe1c8b45] -> dovecot/lmtp(+0x5293) [0x7f62fefd2293] the errors is from update to dovecot-lmtpd_2%3a2.3.0~alpha0-1~auto+67_amd64.deb on debian 8.3on the morning it came an update to debian 8.4 an dovecot dovecot-lmtpd_2%3a2.3.0~alpha0-1~auto+78_amd64.deb can anyone help Sorry for my english. Sven

3 2

[PATCH v2 0/7] Fixes for lib-mail message-address
by Pali Rohár 05 Jun '16

05 Jun '16

Hello, I borrowed dovecot parser for email addresses and I'm using it in my new perl module Email::Address::XS for parsing & formatting list of email addresses. That perl module is available at github [1]. During implementation and testing I found bugs in dovecot code. So I'm sending my patches (together with tests) which I'm using in my perl module. Lot of other (normal & corner) test cases are part of that perl module [2], so if you are interested feel free to reuse them. Because writing new test cases for dovecot is hard for me, I'm not going to do it. In perl for perl modules it is a lot of easier for me. [1] - https://github.com/pali/Email-Address-XS [2] - https://github.com/pali/Email-Address-XS/blob/master/t/Email-Address-XS.t Changes since v1: * Updated description with test example * Rebased on top of master branch Pali Rohár (7): lib-mail: message_address_write: Fix generating empty group list lib-mail: message_address_write: Fix generating group list with empty name lib-mail: parse_addr_spec: Like in rfc822_skip_comment() check if last_comment is not NULL lib-mail: parse_addr_spec: Email address without local-part is invalid lib-mail: parse_mailbox: Set display name instead mailbox when parsing failed lib-mail: message_address_write: Quote and escape strings if needed lib-mail: Update tests for message address src/lib-mail/message-address.c | 99 +++++++++++++++++++++++++++++++---- src/lib-mail/test-message-address.c | 11 +++- 2 files changed, 98 insertions(+), 12 deletions(-) -- 1.7.9.5

1 7

Shared Mailbox?
by craig 04 Jun '16

04 Jun '16

Hi, I've been doing a lot of reading on this topic, I'm just finding a lot of doco that's potentially out of date now? System: Red Hat Enterprise Linux Server release 7.2 (Maipo) dovecot-2.2.10-5.el7.x86_64 The need: 1. I'd like to create a mailbox called "accounts", email would simply get delivered to the account via "accounts(a)example.com" (Maildir format) 2. Share this mailbox so it appears in three other accounts as an extra folder called "accounts" 3. If a user reads an email in the "accounts" folder, I'd like the other users to know this. Clients: * Latest Thunderbird * Outlook 2013. Any advice welcome ;) Cheers, Craig

3 2

Doveadm HTTP API - Disconnected for inactivity
by Ricardo Machini Barbosa 04 Jun '16

04 Jun '16

Hello, I am doing some calls using doveadm http API and I noticed that when some calls took more than 5 seconds the connection are closed, this happen general with huge mailbox's. There are some kind of timeout that I have to set ? For example: # curl call time curl -v --user doveadm:senha -H "Content-Type: application/json" -d '[["purge",{"user":"email(a)dominio.com.br"},"c01"]]' http://192.168.0.1:8080/doveadm/v1 * About to connect() to 192.168.0.1 port 8080 (#0) * Trying 192.168.0.1... connected * Connected to host (192.168.0.1) port 8080 (#0) * Server auth using Basic with user 'doveadm' > POST /doveadm/v1 HTTP/1.1 > Authorization: Basic XXXXXX > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > Host: 192.168.0.1:8080 > Accept: */* > Content-Type: application/json > Content-Length: 69 > * Empty reply from server * Connection #0 to host 192.168.0.1 left intact curl: (52) Empty reply from server * Closing connection #0 real 0m5.432s user 0m0.003s sys 0m0.002s # server log Jun 3 17:11:09 host dovecot: doveadm(192.168.0.2): Executing command 'purge' as 'email(a)dominio.com.br' Jun 3 17:11:14 host dovecot: doveadm: http-server: conn 192.168.0.2:59617 [1]: Disconnected for inactivity Regards, Ricardo

2 1

dovecot-sieve help
by 句号先生。 | 03 Jun '16

03 Jun '16

hi, I have a question hope to get everybody's help, thank you. I write the dovecot sieve rules, use notify:mailto. such as mailto:mymail@dovecot.org, this is ok.but i want to go to a url address,like this,mailto:"http://http://wiki.dovecot.org/".but i don't know how to do it.I hope you can help me.thanks.

3 2

nginx proxy to dovecot servers
by KT Walrus 03 Jun '16

03 Jun '16

I’m trying to understand how the nginx mail proxy and dovecot work. As a I understand it, nginx can listen on a IP:port for IMAP connections. NGINX then can invoke a PHP script to do authorization and backend server selection. Does NGINX than proxy to the backend dovecot IMAP server all subsequent IMAP commands that the user’s mail client requests? Does the backend dovecot IMAP server do its own authentication with another MySQL password lookup? Or, since NGINX has done the authentication, the password_query lookup is skipped on the dovecot server? I assume the dovecot IMAP server still needs to do a MySQL user_query lookup (to find the location of the user’s mailbox on the server), but I am wondering whether the password will be checked twice, once by NGINX and a second time by dovecot IMAP. Kevin

4 6