June 2016 - dovecot - dovecot.org

Marking an entire mailbox read
by ＠lbutlr 13 Jun '16

13 Jun '16

I have an archive mailbox that contains in excess of 100,000 mail messages (stored in maildir) that accidentally got marked as unread. It is too large for my mail client to select all the mail and mark it as read without throttling. Is there a simple way that I can use doveadm or something to simply mark every message in that maildir as read? Or do I just loop through every message and move it to <messaage>+S? find ~/Maildir/.Archive/cur/* -type f -name “1*:2” --exec mv {} {}S \; -- By the way, I think you might be the prettiest girl I've ever seen outside the pages of a really filthy magazine

2 2

sieve vacation script exclude based on sender email address
by Harondel J. Sibble 13 Jun '16

13 Jun '16

I thought I'd asked this question a few years ago but can't seem to find any eveidence of that so here goes. I've been looking at the sieve docs and recipes, done a lot of googling but no joy so far. Using stanard vacation script and that works great, however I want to exclude certain sender email addressess from ever receiving a vacation autoresponse, how do I go about adding that to my existing vacation recipe. I suspect my search terminology is what is causing me not to find anything as I typically am using exclude and similar search terms. -- Harondel J. Sibble Sibble Computer Consulting Ltd. Creating Solutions for the small and medium business computer user. harondel(a)pdscc.com (use pgp keyid 0x3CC3CFCE not 0x3AD5C11D) http://www.pdscc.com Blog: http://www.pdscc.com/blog (604) 739-3709 (voice)

2 3

Unknow Imap Fatal Panic
by Sven Roellig 12 Jun '16

12 Jun '16

Hello, when i sync an Mailbox from old Dovecot to the new Dovecot System the new dovecot Imap create an Fatal/Panic log. Error Log <5Je8ahM17oSwCVUI>: Fatal: master: service(imap): child 4670 killed with signal 6 (core dumps disabled) <ArG9ahM174SwCVUI>: Panic: file mail-index-transaction-update.c: line 803 (mail_index_ext_resize): assertion failed: (record_align != (uint16_t)-1) <ArG9ahM174SwCVUI>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x8d04e) [0x7fb23526104e] -> /usr/lib/dovecot/libdovecot.so.0(+0x8d13c) [0x7fb23526113c] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fb2351ffd1e] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_ext_resize+0x3d0) [0x7fb2355c1780] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_update_header+0x133) [0x7fb235545493] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5d5bc) [0x7fb2355455bc] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_mailbox_create_indexes+0x10) [0x7fb235545710] -> /usr/lib/dovecot/libdovecot-storage.so.0(dbox_mailbox_create_indexes+0x93) [0x7fb235549f93] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5d87a) [0x7fb23554587a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa06cc) [0x7fb2355886cc] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_get_metadata+0x63) [0x7fb23552d253] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync_name+0x2a7) [0x7fb2355892d7] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync+0x12c) [0x7fb2355899ec] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_refresh_force+0xc5) [0x7fb23558b095] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9f571) [0x7fb235587571] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xa074f) [0x7fb23558874f] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_get_metadata+0x63) [0x7fb23552d253] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x3a43e) [0x7fb23552243e] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_user_autoexpunge+0x105) [0x7fb2355226b5] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_user_unref+0x88) [0x7fb235532838] -> dovecot/imap(+0x1b224) [0x7fb235c6a224] -> dovecot/imap(client_input+0xba) [0x7fb235c69d9a] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7fb23527508c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x101) [0x7fb2352764f1] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7fb235275115] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fb2352752b8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fb235206273] -> dovecot/imap(main+0x322) [0x7fb235c5cad2] dovecot -n # 2.3.0.alpha0 (90dd3c6) [XI:2:2.3.0~alpha0-1~auto+111]: /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.alpha0 (67dfb5a) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.5 ext4 auth_mechanisms = plain login auth_verbose_passwords = plain dict { expire = mysql:/etc/dovecot/dovecot-dict-expire.conf.ext } imap_hibernate_timeout = 10 secs lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_gid = vmail mail_location = mdbox:/var/vmail/dovecot/mailboxes/%d/%n:INDEX=/var/vmail/dovecot/indexes/%d/%n:ALT=/var/vmail_altstorage/dovecot/mailboxes/%d/%n mail_plugins = quota zlib acl expire mail_uid = vmail namespace inbox { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe } mailbox Trash { auto = subscribe autoexpunge = 10 days special_use = \Trash } mailbox name { special_use = \Drafts \Junk \Sent \Trash \Archive } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/var/vmail/dovecot/shared-mailboxes expire = Trash expire2 = Trash/* expire3 = Spam expire_cache = yes expire_dict = proxy::expire quota = dirsize:User quota quota_exceeded_message = Quota überschritten ..... quota_grace = 10%% quota_over_flag_value = TRUE quota_over_script = quota-warning mismatch %u quota_rule = Trash:storage=+500M quota_rule2 = Spam:storage=+500M quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is over quota / Mailbox ist voll quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = -storage=100%% quota-warning below %u sieve = /var/vmail/sieve/%d/%n/dovecot.sieve sieve_dir = /var/vmail/sieve/%d/%n/dovecot sieve_global_dir = /var/vmail/sieve/sieve sieve_global_path = /var/vmail/sieve/sieveglobalfilter.sieve zlib_save = lz4 zlib_save_level = 9 } protocols = " imap lmtp" service auth { unix_listener /var/spool/postfix/private/auth { group = mail mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0660 } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-hibernate { unix_listener imap-hibernate { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { port = 2003 } unix_listener lmtp { mode = 0666 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 10000 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { group = users mode = 0666 user = vmail } user = root } ssl_cert = </etc/dovecot/private/....de.pem ssl_key = </etc/dovecot/private/.....pem userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = quota zlib acl expire sieve } protocol imap { mail_plugins = quota zlib acl expire imap_zlib imap_quota imap_acl } protocol lmtp { mail_plugins = quota zlib acl expire sieve postmaster_address = postmaster(a)blabla.blubb quota_full_tempfail = yes } Sorry for my English Sven

1 0

Scalability of Dovecot in the Cloud
by KT Walrus 12 Jun '16

12 Jun '16

Does anyone have any idea of how many IMAP connections a single cloud VM (4 vCores at 2.4GHz, 30GB RAM, local SSD storage - non-RAID) can be expected to handle in production. The mailboxes are fairly small (average 5MB total - 50MB max, as I don’t store attachments in Dovecot expect those saved through IMAP in the Sent/Drafts folders) and each user will probably have an average of 2 devices that have the mail clients configured to access each mailbox. Can such a server handle 100,000 mailboxes (200,000 devices/clients)? Or is it more like 10,000? Or, even smaller? I can scale the cloud VM up to 32 vCores and 240GB RAM (at 8 times the price) or split the mailboxes onto multiple VMs. The VM will also be running LMTP and other Dovecot services (I don’t plan on supporting POP3 at this time). The mailboxes will be sync’d to a backup VM running Dovecot for high availability so has some load from this background activity. LMTP will not be that high a load, I think, since most messages will be delivered by at night. But, clients will have IMAP connections 24/7. Just trying to get an idea of the cost of running a potentially huge/growing mail service in the cloud… I’m going to have to support around a million mailboxes before the site will generate significant revenue to support operations. Kevin

4 4

postfix+dovecot and usernames different to e-mail addresses
by Benjamin 10 Jun '16

10 Jun '16

Hi, I want to replace an old mailserver setup with postfix+dovecot. The problem I'm facing now is, that the old system had usernames different to the e-mail address of the user. For example: E-Mail-Address: foo(a)example.com Username: foo-example.com I configured postfix so that it passes mails to dovecot using the following command (master.cf): dovecot unix - n n - - pipe flags=DRhu user=mail-data:mail-data argv=/usr/lib/dovecot /dovecot-lda -a $(recipient) When dovecot now receives an e-mail from postfix it logs dovecot: lda(mail-data): Error: User initialization failed: Namespace 'INBOX.': Home directory not set for user. Can't expand ~/ for mail root dir in: ~/Maildir dovecot: lda: Fatal: Invalid user settings. Refer to server log for more information. My dovecot-ldap configuration looks quite simple: hosts = 192.168.0.1,192.168.0.2 dn = cn=mailadmin,dc=example,dc=com dnpass = foo auth_bind = yes ldap_version = 3 base = ou=users,dc=example,dc=com user_attrs = mailMessageStore=home user_filter = (&(objectClass=qmailUser)(uid=%u)) pass_filter = (&(objectClass=qmailUser)(uid=%u)) I think dovecot does not know that the username is not the e-mail address, but how can I tell him? Furthermore we have alternative addresses here, so for example there may be an e-mail address bar(a)example.com owned by foo-example.com who has foo(a)example.com as primary address. Dovecot itself (IMAP) works fine, so here it can find the correct Maildir for the user. The difference is, that I connect using the username instead of the e-mail address in this case. # dovecot --version 2.2.22 (fe789d2) # postconf -d | grep mail_version mail_version = 3.1.0 # lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 16.04 LTS Release: 16.04 Codename: xenial Thanks for your help Benjamin

2 5

Easily kick and flush dovecot cache for all dovecot mailboxes in a domain
by Murray T. | Dreamscape 10 Jun '16

10 Jun '16

Hi, We are running a dovecot director cluster. We want to be able to easily kick all mailboxes in a domain off all backend mailstores. We also then want to flush the dovecot cache for all dovecot mailboxes in the domain. Is there a single command we can run on one of the front-end director mail proxies or backend mailstores that will do this instead of having to kick or flush each mailbox in a domain individually on each mailstore. Thanks Murray Trainer Regards, Murray T. Level 3 Project Manager P: +61 8 9422 0894 F: +61 8 9422 0801 www.DreamscapeNetworks.com<http://www.dreamscapenetworks.com/> [dreamscape]<http://www.dreamscapenetworks.com/> DISCLAIMER: This e-mail and/or attachments are confidential and may also be privileged. If you are not the named recipient, please notify the sender immediately and do not disclose the contents to other persons or use it for any purpose or store or copy the information in any medium. Any views expressed in this message are those of the individual sender, except where the sender specifically states them to be the views of Dreamscape Networks. Copyright (c) 2016 www.DreamscapeNetworks.com<http://www.dreamscapenetworks.com/>, All rights reserved.

1 0

Re: Advice on once a day message delivery setup
by Joseph Tam 09 Jun '16

09 Jun '16

KT Walrus <kevin(a)my.walr.us> writes: > Just looking for any advice? I kind of like the idea of modeling my > mail service after the US Post Office where the mailman delivers new > mail once a day rather than like Twitter/Facebook where messages are > posted in real time to encourage users to monitor their boxes > throughout the day. You've rediscovered digesting, which many mailing list (including this one), will batch up messages and periodically send them as one large message (using MIME multipart or some other combination technique). The only difference is that your doing it at the receiving end. I wouldn't recommend it for all mail, but it could be useful to aggregate high-volume low-priority mail into managable chunks. There are many ways you could accomplish it, but the most straightforward way is to deliver new mail to sideline mailbox, and have a cron script deliver them to the user's INBOX (possibly digesting them into one message). Joseph Tam <jtam.home(a)gmail.com>

1 0

password expire warning for dovecot users in IMAP/POP login
by mkawada＠redhat.com 09 Jun '16

09 Jun '16

Dear list, Is it possible to give a notification about password exprire warning to users authenticated by OpenLDAP when the users login via dovecot using IMAP or POP? For example, when you ssh to a server and/or run ldapsearch, you can be warned with password expire warning like below: # ssh testuser@localhost testuser@localhost's password: Your password will expire in 31 minute(s). <== Last login: Wed Jun 8 12:22:08 2016 from localhost.localdomain ]$ ldapsearch -LLL -D uid=testuser,ou=People,dc=example,dc=com -w redhat "cn=testuser" -e ppolicy ldap_bind: Success (0) (Password expires in 1808 seconds) <== dn: uid=testuser,ou=People,dc=example,dc=com Does the same can be done for dovecot users authenticated by OpenLDAP in IMAP/POP? Thanks, -- Masaharu Kawada

7 11

userdb for imap proxy
by KT Walrus 08 Jun '16

08 Jun '16

If I’m running only imap-login service in my dovecot imap proxy, do I need to configure userdb or only passdb?

2 2

Fw: Can't delete emails from or write replies to Inbox
by chaouche yacine 08 Jun '16

08 Jun '16

----- Forwarded Message ----- From: chaouche yacine <yacinechaouche(a)yahoo.com> To: Edwin Humphries <edwinh(a)earthcaretech.com.au> Sent: Wednesday, June 8, 2016 10:31 AM Subject: Re: Can't delete emails from or write replies to Inbox We have made a copy of our mail server and we sometimes rsync files between the original server and the copy so that when we need to do maintenance work we unplug the production server and put the copy server in lieu. We later found out that rsync needs to be run with the --no-numeric-ids argument to keep owners and groups intact, otherwise you end up with weired owners and groups. Yassine. ________________________________ From: Edwin Humphries <edwinh(a)earthcaretech.com.au> To: chaouche yacine <yacinechaouche(a)yahoo.com> Sent: Wednesday, June 8, 2016 5:23 AM Subject: Re: Can't delete emails from or write replies to Inbox Chaouche Duh! I reproduced the issue, then found the log file (mail.log, in my case) and found that that user wasn't in the mail group (which is itself a puzzle, because it used to be, but not sure I'm going to spend much time investigating why); added the user to the mail group, restarted dovecot, and hey presto, everything works. Regards, Edwin Humphries Mobile: 0419 233 051 EarthCare Technology (a division of Ironstone Technology Pty Ltd) 79 Barney St, Kiama, NSW, 2533 Web: http://www.earthcaretech.com.au -- This email is intended for the named addressee/s only and may contain confidential or privileged information. If you are not a named addressee please delete it and notify the sender. -- "Sometimes when I consider what tremendous consequences come from little things…I am tempted to think…there are no little things." Bruce Barton "The activist is not the man who says the river is dirty. The activist is the man who cleans up the river." Ross Perot "Our world has enough for each person's need, but not for his greed." Mahatma Gandhi "The best way to predict the future...is to create it." Source unknown "He who knows that enough is enough will always have enough." Lao Tzu "For man two wings are necessary. One wing is physical power and material civilisation; the other is spiritual power and divine civilisation. With one wing only, flight is impossible. Two wings are essential. Therefore, no matter how much material civilisation advances, it cannot attain to perfection except through the uplift of spiritual civilisation." 'Abdu'l-Baha, Promulgation of Universal Peace On 07/06/16 19:20, chaouche yacine wrote: How about some /var/log/dovecot.log lines ? ----- Original Message ----- From: Edwin Humphries <edwinh(a)earthcaretech.com.au> To: Dovecot Mailing List <dovecot(a)dovecot.org> Sent: Tuesday, June 7, 2016 1:22 AM Subject: Can't delete emails from or write replies to Inbox Hi, I'm running Dovecot and Thunderbird, with 2 separate accounts (business and personal). One operates fine, but the other one won't allow me to write replies to the Inbox (so that I can track current threads), and if I move emails to another folder, it copies them instead. New emails do appear in the Inbox. I've checked the permissions on the two Inboxes, and they are the same (except for the owner name). I've tried compacting the problem Inbox, but that hasn't changed things. Edwin

1 0