- dovecot - dovecot.org

Re: [Dovecot] Info about sharing mail folder
by Steffen Kaiser 03 Jun '14

03 Jun '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 3 Jun 2014, Gianluca Calloni wrote: > But i need to know if is possible for user_a(a)mydomain.com to share only 1 or > 2 subfolder (E.g. .INBOX.FOLDER_A and .INBOX.FOLDER_B shared, > .INBOX_FOLDER_C not shared) What's the dovecot-acl in .INBOX and the three directories mentioned above? Or: doveadm acl get -u user_a(a)mydomain.com INBOX doveadm acl get -u user_a(a)mydomain.com INBOX.FOLDER_A doveadm acl get -u user_a(a)mydomain.com INBOX.FOLDER_B doveadm acl get -u user_a(a)mydomain.com INBOX.FOLDER_C Did you've share "INBOX" instead of the the subfolders A and B? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBU43RXHz1H7kL/d9rAQIm2Af+KLrxxvgAk8TH2f0U6ldu2NidjnncWDv9 Y6vxbuoT/3gC9hL0XlwT/KE+oh/aKsu1tkDhTSq5TQuGVZ5L26CTntIDE9WPq9jf I6lyTzaP6gT3RjhrV0MZeMGLUerWijVs+sPmZMnqTzIIMGFaSqNv6hfAeVjhw98Y 3RMfNbOudTCrg7DGM/jQ3jTXGyJEhL5aI4mFG7JUPE1eYX8ZbTgHePQQtzaFiseK 6en6o25IYpduoQhwq5KEZFkiNLVZFE0ntbwhgUkF8ovzyp3WzioTihi7n4W/IC3x SXfeq2hdq1KMqmXa1zbNKUHz/lPv+dJlXUl94LKxACwm9+zkkrS4vQ== =R2bc -----END PGP SIGNATURE-----

2 1

[Dovecot] Info about sharing mail folder
by Gianluca Calloni 03 Jun '14

03 Jun '14

Hi to all. First of all.. I'm new on the mailing list.. So.. Sorry in advance for any mistake or error on posting here.. The question (or doubt..) is about sharing mail folder. I use a test mail server. Is not the production server (always dovecot + postfix + spamassassin + clamav) Well.. In test mail server i can use the share folder, follow the conf istruction on wiki dovecot. And work fine. But i need to know if is possible for user_a(a)mydomain.com to share only 1 or 2 subfolder (E.g. .INBOX.FOLDER_A and .INBOX.FOLDER_B shared, .INBOX_FOLDER_C not shared) When i do some test sharing folder, the user with wich user_a(a)mydomain.com share the mailbox can view all the subfolder of user_a(a)mydomain.com Following my dovecot versione e config. Thank's in advance My dovecot version is 2.0.19 My dovecot conf is : # 2.0.19: /etc/dovecot/dovecot.conf doveconf: Fatal: open(/etc/dovecot/dovecot.conf) failed: Permission denied calloni@dovecot:~$ sudo -i [sudo] password for calloni: root@dovecot:~# dovecot -n # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.5.0-49-generic i686 Ubuntu 12.04.4 LTS ext4 dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_uid = 150 last_valid_uid = 150 mail_gid = mail mail_location = maildir:/var/vmail/%d/%u mail_plugins = acl mail_uid = vmail namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = yes location = maildir:%%h:INDEX=~/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl } postmaster_address = postmaster(a)jodovit.local protocols = " imap pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = mail mode = 0600 user = vmail } } service dict { unix_listener dict { group = mail mode = 0600 user = vmail } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } Thi

1 0

[Dovecot] stats error
by Stéphane Cottin 03 Jun '14

03 Jun '14

Hello, Errors still present after upgrading to 2.2.13 : stats: Error: Mail server input error: UPDATE-SESSION test(a)example.com imap: stats shrank: mlpath 378 < 379 stats: Error: Mail server input error: UPDATE-SESSION test(a)example.com imap: stats shrank: mlpath 1 < 2 stats: Error: Mail server input error: UPDATE-SESSION test(a)example.com pop3: stats shrank: mlpath 4 < 8 stats: Error: Mail server input error: UPDATE-SESSION test(a)example.com imap: stats shrank: mrbytes 6028260 < 7487934 stats: Error: Mail server input error: UPDATE-SESSION test(a)example.com imap: stats shrank: mrbytes 11134652 < 13009233 […] doveconf -n : # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.2.53-xenU-8869-x86_64 x86_64 Debian 7.4 auth_mechanisms = plain login cram-md5 default_client_limit = 3003 lda_mailbox_autocreate = yes mail_plugins = " quota stats zlib" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate vacation-seconds namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { antispam_backend = dspam antispam_dspam_args = --source=error;--user;%u;--deliver= antispam_dspam_binary = /usr/bin/dspamc antispam_dspam_notspam = --class=innocent antispam_dspam_result_header = X-DSPAM-Result antispam_dspam_spam = --class=spam antispam_signature = X-DSPAM-Signature antispam_signature_missing = move antispam_spam = Junk antispam_spam_pattern_ignorecase = Junk;Junk.* antispam_trash = trash;Trash;Deleted Items;Deleted Messages fts = lucene fts_lucene = whitespace_chars=@. quota = maildir:User quota quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +vacation-seconds sieve_vacation_default_period = 3h sieve_vacation_max_period = 30d sieve_vacation_min_period = 3m stats_refresh = 30 secs zlib_save = gz zlib_save_level = 9 } protocols = " imap sieve pop3" recipient_delimiter = - service imap-login { service_count = 0 vsz_limit = 256 M } service quota-warning { executable = script /usr/bin/quota-warning.sh unix_listener quota-warning { user = vpopmail } user = vpopmail } service stats { fifo_listener stats-mail { mode = 0600 user = vpopmail } } ssl_cert = </etc/dovecot/dovecot.crt ssl_key = </etc/dovecot/private/dovecot.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = " quota stats zlib sieve" } protocol imap { mail_max_userip_connections = 20 mail_plugins = " quota stats zlib fts fts_lucene antispam imap_zlib imap_quota imap_stats" } Stéphane

1 0

[Dovecot] Postfix mailing list suggestion
by Christian Vaas 03 Jun '14

03 Jun '14

Can anyone suggest a good mailing list for postfix users? Thanks Chris

2 1

Re: [Dovecot] Odd ownership of the dovecot-uidlist file
by Bruce 03 Jun '14

03 Jun '14

Hi Robert (and list), See my response below, On 27/05/14 23:05, dovecot-request(a)dovecot.org wrote: > Message: 4 Date: Mon, 26 May 2014 19:50:01 -0700 From: Robert L > Mathews <lists(a)tigertech.com> To: Dovecot Mailing List > <dovecot(a)dovecot.org> Subject: Re: [Dovecot] Odd ownership of the > dovecot-uidlist file Message-ID: <5383FD59.9050809(a)tigertech.com> > Content-Type: text/plain; charset=UTF-8 On 5/26/14, 6:06 PM, > dclist.hook(a)hook.net.nz wrote: >> >It would be great if someone can give us some hints where the problem >> >maybe as this has us stumped. > Have you tried "stat dovecot-uidlist" after it's changed to look at all > three times of the file? > > The "Change" time is probably more interesting than the modification > time. It should show the time that the ownership was altered or the file > recreated, and maybe you can look at the logs to see what happened then. Thanks for the suggestion, we have had another occurrence of the wrong ownership on the dovecot-uid today. And we took a stat of the file but the logs around the time dont give any indication of the incorrect user logging in, a dovecot error or anything helpful. This is the log entry for the user as the issue started occurring: Jun 3 11:18:13 brio dovecot: pop3-login: Login: user=<hamish@XXXXX>, method=APOP, rip=x.x.x.x, lip=x.x.x.x, mpid=31874, TLS, session=<Cfr6m+L6bgB2lKNI> Jun 3 11:18:13 brio dovecot: Dovecot postlogin.sh running as hamish@XXXXX (/mnt/spool/keepers/h/XXXXX/hamish) userid = 7053 (7053) - uidlist = 7053 Jun 3 11:18:13 brio dovecot: Dovecot for hamish@XXXXX finished, uidlist now = 7053 Jun 3 11:28:13 brio dovecot: pop3(hamish@XXXXX): Disconnected for inactivity top=0 (0 b), retr=0 (0 b), messages=380 (41770867 b), del=0 Jun 3 11:38:51 brio dovecot: pop3-login: Login: user=<hamish@XXXXX>, method=APOP, rip=x.x.x.x, lip=x.x.x.x, mpid=16538, TLS, session=<EyrJ5eL6eAB2lKNI> Jun 3 11:38:51 brio dovecot: Dovecot postlogin.sh running as hamish@XXXXX (/mnt/spool/keepers/h/XXXXX/hamish) userid = 7053 (7053) - uidlist = 26624 Jun 3 11:38:51 brio dovecot: Dovecot for hamish@XXXXX finished, uidlist now = 26624 Jun 3 11:38:51 brio dovecot: pop3(hamish@XXXXX): Error: open(/mnt/spool/keepers/h/XXXXX/hamish/Maildir/dovecot-uidlist) failed: Permission denied Jun 3 11:38:51 brio dovecot: pop3(hamish@XXXXX): Error: open(/mnt/spool/keepers/h/XXXXX/hamish/Maildir/dovecot-uidlist) failed: Permission denied Jun 3 11:38:51 brio dovecot: pop3(hamish@XXXXX): Error: Couldn't init INBOX: Internal error occurred. Refer to server log for more information. [2014-06-03 11:38:51] Jun 3 11:38:51 brio dovecot: pop3(hamish@XXXXX): Mailbox init failed top=0 (0 b), retr=0 (0 b), messages=0 (0 b), del=0 You will notice our postlogin script spits out some information about the uidlist file both before it starts and after it finishes which shows uid it as running as and the owner of the uidlist file. For reference this is the current script (we have pulled a lot of the extra stuff we were doing out for testing): -- 8<-- #!/bin/bash # WARNING: Be sure to use mail_drop_priv_before_exec=yes, otherwise the files are created as root! logger -t dovecot -p mail.info "Dovecot postlogin.sh running as $USER ($HOME) userid = $EUID ($UID) - uidlist = `stat $HOME/Maildir/dovecot-uidlist -c %u`" # Removed the exec so we can run something after the login. Once the uid list issue is fixed this should be set back #exec "$1" "$1" logger -t dovecot -p mail.info "Dovecot for $USER finished, uidlist now = `stat $HOME/Maildir/dovecot-uidlist -c %u`" -- 8<-- root@brio:/mnt/spool/keepers/h/XXXXXXX/hamish/Maildir# stat dovecot-uidlist File: `dovecot-uidlist' Size: 26819 Blocks: 56 IO Block: 1048576 regular file Device: 1ah/26d Inode: 9424182 Links: 3 Access: (0600/-rw-------) Uid: (26624/info-14552) Gid: (11307/domain14552) Access: 2014-06-03 11:18:05.000000000 +1200 Modify: 2014-06-03 01:55:19.000000000 +1200 Change: 2014-06-03 11:18:33.000000000 +1200 Birth: - The stat says the change happened at 11:18:33, so we looked at the logs around that time: Jun 3 11:18:32 brio dovecot: imap-login: Login: user=<test@xxx>, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, mpid=647, session=<Y6oZneL6vwDSMGzL> Jun 3 11:18:32 brio dovecot: pop3(enquiry@xxx): Disconnected: Logged out top=0 (0 b), retr=0 (0 b), messages=64 (7363643 b), del=0 Jun 3 11:18:32 brio dovecot: Dovecot postlogin.sh running as test@xxx/test) userid = 1667 (1667) - uidlist = 1667 Jun 3 11:18:32 brio dovecot: pop3-login: Login: user=<test@xxx>, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, mpid=652, session=<GDsaneL6nwDSMGzL> Jun 3 11:18:32 brio dovecot: imap(test@xxx): Disconnected: Logged out bytes=9/360 Jun 3 11:18:32 brio dovecot: pop3(haidee.b@xxx): Disconnected: Logged out top=0 (0 b), retr=0 (0 b), messages=81 (17665182 b), del=0 Jun 3 11:18:32 brio dovecot: Dovecot for test@xxx finished, uidlist now = 1667 Jun 3 11:18:32 brio dovecot: Dovecot postlogin.sh running as test@xxx/test) userid = 1667 (1667) - uidlist = 1667 Jun 3 11:18:32 brio dovecot: Dovecot for test@xxx finished, uidlist now = 1667 Jun 3 11:18:32 brio dovecot: pop3(test@xxx): Disconnected: Logged out top=0 (0 b), retr=0 (0 b), messages=1 (1756 b), del=0 Jun 3 11:18:32 brio dovecot: pop3(nz@xxx): Disconnected: Logged out top=0 (0 b), retr=0 (0 b), messages=0 (0 b), del=0 Jun 3 11:18:32 brio dovecot: imap-login: Login: user=<manager@xxx>, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, mpid=667, session=<hCUeneL6sADAqMjK> Jun 3 11:18:32 brio dovecot: Dovecot postlogin.sh running as manager@xxx/manager) userid = 12397 (12397) - uidlist = 12397 Jun 3 11:18:32 brio dovecot: Dovecot for manager@xxx finished, uidlist now = 12397 Jun 3 11:18:32 brio dovecot: imap(manager@xxx): Disconnected: Logged out bytes=91/873 Jun 3 11:18:32 brio dovecot: pop3-login: Login: user=<amanda@xxx>, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, mpid=675, session=<NeMeneL6rgDLraCP> Jun 3 11:18:32 brio dovecot: Dovecot postlogin.sh running as amanda@xxx/amanda) userid = 24293 (24293) - uidlist = 24293 Jun 3 11:18:32 brio dovecot: Dovecot for amanda@xxx finished, uidlist now = 24293 Jun 3 11:18:32 brio dovecot: pop3(anton@xxx): Disconnected: Logged out top=0 (0 b), retr=0 (0 b), messages=603 (57517089 b), del=0 Jun 3 11:18:32 brio dovecot: pop3-login: Login: user=<admin@xxx>, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, mpid=685, TLS, session=<hiAjneL6vgDemmai> Jun 3 11:18:32 brio dovecot: Dovecot postlogin.sh running as admin@xxx/admin) userid = 25119 (25119) - uidlist = 25119 Jun 3 11:18:32 brio dovecot: Dovecot for admin@xxx finished, uidlist now = 25119 Jun 3 11:18:32 brio dovecot: pop3-login: Login: user=<info@xxx>, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, mpid=691, session=<ZJQkneL6SgB97OUI> Jun 3 11:18:32 brio dovecot: pop3-login: Login: user=<robb@xxx>, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, mpid=695, session=<7MskneL6TAB97O9T> Jun 3 11:18:32 brio dovecot: Dovecot postlogin.sh running as info@xxx/info) userid = 13732 (13732) - uidlist = 13732 Jun 3 11:18:32 brio dovecot: Dovecot for info@xxx finished, uidlist now = 13732 Jun 3 11:18:32 brio dovecot: Dovecot postlogin.sh running as robb@xxx/robb) userid = 21760 (21760) - uidlist = 21760 Jun 3 11:18:32 brio dovecot: Dovecot for robb@xxx finished, uidlist now = 21760 Jun 3 11:18:33 brio dovecot: pop3(number5@xxx): Disconnected: Logged out top=0 (0 b), retr=0 (0 b), messages=19 (422734 b), del=0 Jun 3 11:18:33 brio dovecot: pop3(admin@xxx): Disconnected: Logged out top=0 (0 b), retr=0 (0 b), messages=256 (8614214 b), del=0 Jun 3 11:18:33 brio dovecot: pop3(info@xxx): Disconnected: Logged out top=0 (0 b), retr=0 (0 b), messages=227 (56540919 b), del=0 Jun 3 11:18:33 brio dovecot: pop3(amanda@xxx): Disconnected: Logged out top=0 (0 b), retr=1 (20185 b), messages=69 (5243134 b), del=0 Jun 3 11:18:33 brio dovecot: pop3-login: Login: user=<sbreed@xxx>, method=APOP, rip=x.x.x.x, lip=x.x.x.x, mpid=712, session=<brAtneL6LgBuiOW3> Jun 3 11:18:33 brio dovecot: Dovecot postlogin.sh running as sbreed@xxx/sbreed) userid = 21761 (21761) - uidlist = 21761 Jun 3 11:18:33 brio dovecot: Dovecot for sbreed@xxx finished, uidlist now = 21761 Jun 3 11:18:33 brio dovecot: pop3(robb@xxx): Disconnected: Logged out top=0 (0 b), retr=0 (0 b), messages=0 (0 b), del=0 Jun 3 11:18:33 brio dovecot: imap-login: Login: user=<gary@xxx>, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, mpid=721, session=<z0MvneL6swDAqMjK> Jun 3 11:18:33 brio dovecot: Dovecot postlogin.sh running as gary@xxx/gary) userid = 26671 (26671) - uidlist = 26671 Jun 3 11:18:33 brio dovecot: Dovecot for gary@xxx finished, uidlist now = 26671 Jun 3 11:18:33 brio dovecot: imap(gary@xxx): Disconnected: Logged out bytes=394/10899 Jun 3 11:18:34 brio dovecot: imap-login: Login: user=<sales@xxx>, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, mpid=733, session=<0kc2neL6tgDAqMjK> Jun 3 11:18:34 brio dovecot: Dovecot postlogin.sh running as sales@xxx/sales) userid = 16696 (16696) - uidlist = 16696 Jun 3 11:18:34 brio dovecot: Dovecot for sales@xxx finished, uidlist now = 16696 Jun 3 11:18:34 brio dovecot: pop3-login: Login: user=<tmeha@xxx>, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, mpid=741, session=<OKg4neL69gB97O9T> Jun 3 11:18:34 brio dovecot: Dovecot postlogin.sh running as tmeha@xxx/tmeha) userid = 4338 (4338) - uidlist = 4338 Jun 3 11:18:34 brio dovecot: Dovecot for tmeha@xxx finished, uidlist now = 4338 Jun 3 11:18:34 brio dovecot: imap(sales@xxx): Disconnected: Logged out bytes=467/14224 Jun 3 11:18:34 brio dovecot: pop3-login: Login: user=<christine@xxx>, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, mpid=753, session=<yrM9neL6xgDbWELK> Jun 3 11:18:34 brio dovecot: pop3-login: Login: user=<john@xxx>, method=APOP, rip=x.x.x.x, lip=x.x.x.x, mpid=754, session=<w7I9neL6JAB5SN1a> Jun 3 11:18:34 brio dovecot: Dovecot postlogin.sh running as christine@xxx/christine) userid = 29127 (29127) - uidlist = 29127 Jun 3 11:18:34 brio dovecot: Dovecot for christine@xxx finished, uidlist now = 29127 Jun 3 11:18:34 brio dovecot: Dovecot postlogin.sh running as john@xxx/john) userid = 15027 (15027) - uidlist = 15027 Jun 3 11:18:34 brio dovecot: Dovecot for john@xxx finished, uidlist now = 15027 Jun 3 11:18:34 brio dovecot: pop3-login: Login: user=<res@xxx>, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, mpid=769, TLS, session=<0oM/neL6YwB97a8j> Jun 3 11:18:34 brio dovecot: Dovecot postlogin.sh running as res@xxx/res) userid = 35375 (35375) - uidlist = 35375 Jun 3 11:18:34 brio dovecot: Dovecot for res@xxx finished, uidlist now = 35375 Jun 3 11:18:34 brio dovecot: pop3(res@xxx): Disconnected: Logged out top=0 (0 b), retr=0 (0 b), messages=0 (0 b), del=0 Jun 3 11:18:34 brio dovecot: pop3(tmeha@xxx): Disconnected: Logged out top=0 (0 b), retr=0 (0 b), messages=0 (0 b), del=0 Jun 3 11:18:34 brio dovecot: imap-login: Login: user=<test@xxx>, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, mpid=781, session=<bRREneL6PgDSMGx8> Jun 3 11:18:34 brio dovecot: Dovecot postlogin.sh running as test@xxx/test) userid = 1667 (1667) - uidlist = 1667 Jun 3 11:18:34 brio dovecot: Dovecot for test@xxx finished, uidlist now = 1667 Jun 3 11:18:34 brio dovecot: imap(test@xxx): Disconnected: Logged out bytes=9/360 Jun 3 11:18:34 brio dovecot: imap-login: Login: user=<priestley@xxx>, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, mpid=792, session=<aX1FneL6OADAqMjL> There is nothing there which indicates anything happened at 11:18:33 which would have gone anywhere near the uidlist file or even from the user that the file changed to (remembering that the directory permission would prevent them writing to the file anyway) The stat also says the change happened at 11:18:33, and there is nothing in the logs for that time which is abnormal (a whole bunch of other logins from other customers but nothing from those two users and no errors) Any further suggestions? Cheers, James

2 1

Re: [Dovecot] list all emails from command line?
by Joseph Tam 03 Jun '14

03 Jun '14

> Therefore, I wanted to do some kind of "IMAP list" of the account, with > a command line tool: > > - specify username, pass and server, > - the tool would return a list of all email in their folders (message > ID, From, To, Date, Subject). > > I would run it i.e. daily and this would let me verify when the mail was > really visible in the account. > > Is anyone aware of a tool I could use to achieve that? Not offhand, but if you want a remote tool, it ought to be simple to cobble together some feeder script and netcat (or openssl s_client). It will also be simpler if you configure the master password feature so you don't have access to all user passwords. So something like this for dumping the INBOX contents #!/bin/sh master-user=masteru master-password=masterp while read user server; do netcat --ssl $server 993 <<_EOF_ >${user}.report 1 LOGIN ${user}*${master-user} ${master-password) 2 SELECT INBOX 3 ... 4 LOGOUT _EOF_ done I don't know enough IMAP to fill in "3 ..." to dump all headers, but I'm sure it's not hard to find out. It's even simpler if you don't need to do it remotely: just use doveadm fetch -A hdr MAILBOX '*' Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] list all emails from command line?
by Tomasz Chmielewski 03 Jun '14

03 Jun '14

This is not strictly Dovecot question, but a more general IMAP one. I'm running a Dovecot server and have a user who is claiming that some email sent to him, say, on 30 May, showed up in his mailbox on 02 Jun. I've checked Postfix logs, and the message was correctly received on 30 May and passed to Dovecot. A similar issue happens every few days. This leaves me with two possibilities: 1) Dovecot is somehow not presenting the new mail to the user in a "timely manner" 2) user's email program is broken Therefore, I wanted to do some kind of "IMAP list" of the account, with a command line tool: - specify username, pass and server, - the tool would return a list of all email in their folders (message ID, From, To, Date, Subject). I would run it i.e. daily and this would let me verify when the mail was really visible in the account. Is anyone aware of a tool I could use to achieve that? -- Tomasz Chmielewski http://www.sslrack.com

3 2

[Dovecot] dovecot: lda(foo): Error: User foo doesn't have home dir set, disabling duplicate database
by Christian Hoffmann 02 Jun '14

02 Jun '14

Hello everyone, I have a small problem with dovecot installed on ubuntu-13.10. I use dovcot as LDA with a LDAP-passdb and a pam-passdb. The userdb is static. A mail to LDAP-user 'foo' is delivered with the error-message dovecot: lda(foo): Error: User foo doesn't have home dir set, disabling duplicate database A mail to the pam-user 'bar' will deliverd without this error. But both users should work with the static-userdb. Where is my mistake? Greetings Christian dovecot --version 2.1.7 ############################################ my dovecot.conf # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.11.0-22-generic i686 Ubuntu 13.10 ext4 disable_plaintext_auth = no first_valid_uid = 107 last_valid_uid = 109 listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " mail_home = /var/mail/%u mail_location = maildir:/var/mail/%u/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { driver = pam } plugin { sieve = /var/mail/%u/dovecot.sieve sieve_before = /etc/dovecot/sieve.global/spamfilter.sieve } protocols = imap pop3 sieve service auth { user = root } service managesieve-login { inet_listener sieve { port = 2000 } } ssl_cert = </etc/exim4/exim.crt ssl_key = </etc/exim4/exim.key syslog_facility = local0 userdb { args = home=/var/mail/%u uid=Debian-exim gid=Debian-exim driver = static } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master hostname = ods2.schule.de mail_plugins = sieve postmaster_address = postmaster sendmail_path = /usr/sbin/sendmail } ############################## my dovecot-ldap.conf uris = ldaps://my.ldap.host.edu dn = chief dnpass = secret auth_bind = yes ldap_version = 3 base = ou=Personen,DC=my,DC=ldap,DC=host,DC=eu scope = subtree pass_filter = (&(objectClass=user)(cn=%u)(memberOf:1.2.840.113556.1.4.1941:=cn=Mail,ou=Gruppen,DC=my,DC=ldap,DC=host,DC=eu))

2 6

[Dovecot] Installing Godaddy Certificate
by The Doctor, 3328-138 Ave Edmonton AB T5Y 1M4, 669-2000, 473-4587 02 Jun '14

02 Jun '14

I have 2 certs to install: One is intermediate the other the 'actual' cert. How do I do this?

2 1

[Dovecot] Dovecot 2 | Creating message rules
by Jos Chrispijn 02 Jun '14

02 Jun '14

Can someone explain how I can create message rules to use with this version of Dovecot? I specially switched to this version because it supports then Pigeonhole Sieve. I would like to volunteer to contribute as a volunteer when someone would like to create a html driven user interface that provides a user friendly configuration interface and would make such configuration a piece of cake. -- Best regards, Jos Chrispijn --- Artificial intelligence is no match for natural stupidity

5 5

[Dovecot] Dovecot 2.1.13: some questions about the mail-filter plugin
by Axel Luttgens 02 Jun '14

02 Jun '14

Looking at mail_filter_mailbox_allocated() of src/plugins/mail-filter/mail-filter-plugin.c: if ((class_flags & MAIL_STORAGE_CLASS_FLAG_OPEN_STREAMS) == 0 && (class_flags & MAIL_STORAGE_CLASS_FLAG_BINARY_DATA) != 0 && muser->out_socket_path != NULL) v->save_begin = mail_filter_mail_save_begin; it seems that a backend with MAIL_STORAGE_CLASS_FLAG_OPEN_STREAMS unset and MAIL_STORAGE_CLASS_FLAG_BINARY_DATA set is expected by the plugin. Technically, this would thus exclude the mbox backend, since its flag configuration seems to be exactly the opposite: struct mail_storage mbox_storage = { .name = MBOX_STORAGE_NAME, .class_flags = MAIL_STORAGE_CLASS_FLAG_MAILBOX_IS_FILE | MAIL_STORAGE_CLASS_FLAG_OPEN_STREAMS | MAIL_STORAGE_CLASS_FLAG_HAVE_MAIL_GUIDS, [...] Is this a correct interpretation? If yes, what is the rationale? I couldn't find any info related to such a limitation in the docs; the README file of http://dovecot.org/patches/2.2/mail-filter.tar.gz even says: "Mail filter plugin can read an email from any storage supported by Dovecot and modify the mail in some way"... All of this stems from my attempts to have working mail filters when I was trying to better understand the behaviors Stanislas was describing in a recent thread... Hence another question; in sdbox-storage.c, the definition of the "alias" for sdbox comes with: struct mail_storage dbox_storage = { .name = "dbox", /* alias */ .class_flags = MAIL_STORAGE_CLASS_FLAG_FILE_PER_MSG, [...] The initialization of member class_flags seems to be incomplete, when compared to the one for the name "sdbox". A typo? On the other hand, Stanislas showed a configuration with mail_location = dbox:/mailboxes/%Ld/%Ln and seemed to have a working mail filter. If above interpretation is correct, this would mean that the "alias" definition isn't used, but that the one for "sdbox" is used instead. Out of curiosity, how/where is that substitution achieved? Regards, Axel

1 0

[Dovecot] "doveadm fetch" fetches mails twice?
by Peer Heinlein 01 Jun '14

01 Jun '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 As far as I understood fetch -u p.heinlein(a)jpberlin.de hdr mailbox-guid [...]93d5 uid 58175 should fetch exactly the header of the specified mail. But on my Dovecot 2.2.12 it fetches the header *twice* (same with body, same with text). ======================================== hdr: Return-Path: <hello(a)example.com> Delivered-To: <p.heinlein(a)jpberlin.de> [...] hdr: Return-Path: <hello(a)example.com> Delivered-To: <p.heinlein(a)jpberlin.de> [...] ======================================== Peer - -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBAgAGBQJTi4ttAAoJEAOLLpq5E82HL/MIAIx1WBDdzP/u5fI/VuyfSzYO gj8M5WL8MkamOpziOfADBdRR1qZwsuS8EjFmdNSrdqrLFM1tle/0Umaa3buJBeyF OuTIodbkv5prgoF/YDxsOKXMSCDx8JP3o5twNbTQfdMT+rYww80GGqDbAFv5VMzJ vNAOQZ3Le1S45da1wL526UcPSHNBXwMMbpCS3LY60iKRbHaURXJuotbXb4DemD0J En2ZjQzmstIBbyFL7X3JfiyiEe3Dmdq5u0XJC5j2Xo3U9mfHB2FBmbEE9KdKPXgu wL2cihep5lDExS2N89ne9Zp6n/Ff104Gki1gwQu0mSBPS8OGFSIJ5iGDBdWIEGk= =4smt -----END PGP SIGNATURE-----

1 0

[Dovecot] Combining userdbs
by Bubreg István 01 Jun '14

01 Jun '14

Hi, I think that using more than one userdb with setting the result actions doesn't work as expected from the documentation. The goal would be to set user-specific quotas for a few users with a specific passwd-file like this : cat /etc/dovecot/quotas foo:x::::::userdb_quota_rule=*:storage=2G The first userdb is passwd (with pam passwd): userdb { driver = passwd result_failure = return-fail result_internalfail = return-fail result_success = continue-ok skip = never } The second one is for the specific quota userdb { args = username_format=%n /etc/dovecot/quotas driver = passwd-file result_failure = continue result_internalfail = continue result_success = return-ok skip = notfound } User 'foo' exists in (pam) passd, but there's no place to store his own quota rule, that's why came handy to use a second userdb for storing just one extra field. That's working quiet well, he default quota is overriding form passwd-file. BUT: I've played a lot with changing the result_* and the 'skip' parameters, but none of them worked in the situation where a user ('bar') _only_ exists in passwd (and has to use the default quota config). doveadm quota get -u bar says doveadm(bar): Fatal: User doesn't exist With changing the parameters this error has gone, but the second userdb doesn't used for user 'foo' - even if the parameters are : userdb { driver = passwd result_failure = return-fail result_internalfail = return-fail result_success = continue <-- in theory, the next userdb is coming skip = never } userdb { args = username_format=%n /etc/dovecot/quotas driver = passwd-file result_failure = continue result_internalfail = continue result_success = return-ok skip = notfound } My question is that how should i set the result_* and 'skip' parameters to solve this : - there's a default quota rule in the config - some (a few) users has a larger quota - there's no way to store the user-specific quotas in the 'real' userdb (because it's pam/passwd) Thank you for your effort. # dovecot -n # 2.2.13 (de9b10f2e168): /etc/dovecot/dovecot.conf # OS: Linux 3.11.0-15-generic i686 Ubuntu 12.04.4 LTS auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = yes disable_plaintext_auth = no listen = * log_path = /var/log/dovecot.log mail_debug = yes mail_location = maildir:~/Maildir mail_plugins = " quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { quota = maildir:User quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap sieve" service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { process_limit = 1024 } ssl = no ssl_cert = </etc/dovecot/private/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = passwd result_failure = return-fail result_internalfail = return-fail result_success = continue-ok } userdb { args = username_format=%n /etc/dovecot/quotas driver = passwd-file result_failure = continue-ok result_internalfail = continue-ok skip = notfound } protocol imap { mail_plugins = quota }

1 0

[Dovecot] Disabling plus sign extension delimiter in lmtp listener (or userdb)
by Benoit Panizzon 01 Jun '14

01 Jun '14

Hello We have migrated our email services from a server, which did not support IMAP and folders, therefore threated the plus sign + as a normal character in a part of an email address. Our new server delivers the emails via lmtp to dovecot. the few users which got a + character in the username first could not log-in (fixed by adding + to auth_username_chars). Now the next problem turn out to be, that the lmtp listener stripps everything after the + sign. The MTA correctly sends the whole email address, so it's not the MTA's fault. It can easily be tested by connecting to the dovecot LMTP listener IP address by telnet: 220 grautvornix.imp.ch Dovecot ready. mail from:<nobody> 250 2.1.0 OK rcpt to:<b+enoit(a)iscan.ch> 550 5.1.1 <b+enoit(a)iscan.ch> User doesn't exist: b(a)iscan.ch I could not find any configuration parameters for the lmtp listener or userdb service to tell it what to do with the + sign. Did I miss something, or is it impossible to have the + sign accepted as a normal character in an email address? Kind regards -Benoit-

3 6

[Dovecot] Upgraded my dovecot?
by Knute Johnson 31 May '14

31 May '14

I upgraded my server from Ubuntu 12.04LTS to 14.04LTS and it upgrade my dovecot too. Probably should have thought about that a little more before I pushed the button but oh well. So it didn't work when it came back up and I had to add a "inbox=yes" line to my namespace in 15-mailboxes.conf and that fixed it. So is there anything else I should update in my config files for this newer version of dovecot? # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-30-generic x86_64 Ubuntu 14.04 LTS auth_mechanisms = plain login mail_location = mbox:~/mail:INBOX=/var/mail/%u namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = " imap" service imap-login { inet_listener imaps { port = 0 } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } protocol imap { imap_capability = IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS mail_max_userip_connections = 30 } Thanks,

1 0

[Dovecot] ot: identifying TB IMAP issues
by voytek＠sbt.net.au 31 May '14

31 May '14

I have a user with with W7/TBird/IMAP to my dovecot 2.1.17 server, the user complains whilst he is composing lengthy emails (with multiple fowrds/replies quoted in the message) he gets 'hour glass' over compose windows with some message about not being able to save drafts, he then powers off ADSL modem, which enables him to continue composing email, powers on ADSL, and sends email what if anything can I assess at server end to identify any issues? any TB tips, what to enable or disable on TB ? looking at dovecot now (past the issue) with 'doveadm who' I don't see the user listed I think the user keeps many messages open concurrently in TB tabs, could that exhaust connection limit ? I expect this to be a TB issue? but, hope for some pointers

3 2

[Dovecot] Panic: file mail-index-transaction-export.c: line 203 (log_append_ext_hdr_update): assertion failed: (u32.offset + u32.size <= ext_hdr_size)
by Andy Dills 31 May '14

31 May '14

Hi there, We recently upgraded to 2.2.12 (the current version in FreeBSD's port tree), and are seeing these errors in our logs (not super frequently, but it happens): May 30 13:20:57 mail1 kernel: pid 15752 (imap), uid 1005: exited on signal 6 May 30 13:20:57 mail1 dovecot: imap(xxx): Fatal: master: service(imap): child 15752 killed with signal 6 (core not dumped - set service imap { drop_priv_before_exec=yes }) I tried manually upgrading to 2.2.13, on the off chance that was fixed, but I couldn't get the new pigeonhole (0.4.3) to compile once I did (perhaps why the FreeBSD port maintainer hasn't updated yet?). Suggestions? Right now we just check every couple of hours for affected users, and then delete all of the dovecot files for the affected user, which ends the error. Thanks, Andy --- Andy Dills Xecunet, Inc. www.xecu.net 301-682-9972 ---

2 3

[Dovecot] doveadm fts optimize CRASH
by Larry Rosenman 30 May '14

30 May '14

thebighonker.lerctr.org /home/ler $ gdb -c doveadm.core `which doveadm` GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"...(no debugging symbols found)... Core was generated by `doveadm'. Program terminated with signal 6, Aborted. Reading symbols from /lib/libz.so.6...(no debugging symbols found)...done. Loaded symbols for /lib/libz.so.6 Reading symbols from /lib/libcrypt.so.5...(no debugging symbols found)...done. Loaded symbols for /lib/libcrypt.so.5 Reading symbols from /usr/local/lib/dovecot/libdovecot-storage.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /usr/local/lib/dovecot/libdovecot.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot.so.0 Reading symbols from /lib/libc.so.7...(no debugging symbols found)...done. Loaded symbols for /lib/libc.so.7 Reading symbols from /usr/local/lib/dovecot/lib20_fts_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/lib20_fts_plugin.so Reading symbols from /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so Reading symbols from /usr/local/lib/libclucene-core.so.1...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/libclucene-core.so.1 Reading symbols from /usr/local/lib/libclucene-shared.so.1...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/libclucene-shared.so.1 Reading symbols from /usr/lib/libc++.so.1...(no debugging symbols found)...done. Loaded symbols for /usr/lib/libc++.so.1 Reading symbols from /lib/libcxxrt.so.1...(no debugging symbols found)...done. Loaded symbols for /lib/libcxxrt.so.1 Reading symbols from /lib/libm.so.5...(no debugging symbols found)...done. Loaded symbols for /lib/libm.so.5 Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols found)...done. Loaded symbols for /lib/libgcc_s.so.1 Reading symbols from /lib/libthr.so.3...(no debugging symbols found)...done. Loaded symbols for /lib/libthr.so.3 Reading symbols from /usr/local/lib/dovecot/lib90_stats_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/lib90_stats_plugin.so Reading symbols from /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Reading symbols from /usr/local/lib/dovecot-2.2-pigeonhole/libdovecot-sieve.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot-2.2-pigeonhole/libdovecot-sieve.so.0 Reading symbols from /usr/local/lib/dovecot/libdovecot-lda.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot-lda.so.0 Reading symbols from /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so Reading symbols from /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so Reading symbols from /libexec/ld-elf.so.1...(no debugging symbols found)...done. Loaded symbols for /libexec/ld-elf.so.1 #0 0x00000008013cc0da in kill () from /lib/libc.so.7 [New Thread 801c2b800 (LWP 101632/doveadm)] (gdb) bt #0 0x00000008013cc0da in kill () from /lib/libc.so.7 #1 0x00000008013ca809 in abort () from /lib/libc.so.7 #2 0x0000000802cf7b39 in __cxa_pure_virtual () from /lib/libcxxrt.so.1 #3 0x00000008025159dc in lucene::store::BufferedIndexOutput::~BufferedIndexOutput () from /usr/local/lib/libclucene-core.so.1 #4 0x000000080251717a in lucene::store::FSDirectory::FSIndexOutput::FSIndexOutput () from /usr/local/lib/libclucene-core.so.1 #5 0x0000000802518983 in lucene::store::FSDirectory::createOutput () from /usr/local/lib/libclucene-core.so.1 #6 0x0000000802544c9d in lucene::index::CompoundFileWriter::close () from /usr/local/lib/libclucene-core.so.1 #7 0x0000000802558b32 in lucene::index::SegmentMerger::createCompoundFile () from /usr/local/lib/libclucene-core.so.1 #8 0x0000000802566b2d in lucene::index::IndexWriter::mergeMiddle () from /usr/local/lib/libclucene-core.so.1 #9 0x00000008025620f8 in lucene::index::IndexWriter::merge () from /usr/local/lib/libclucene-core.so.1 #10 0x0000000802527738 in lucene::index::SerialMergeScheduler::merge () from /usr/local/lib/libclucene-core.so.1 #11 0x000000080255ff45 in lucene::index::IndexWriter::optimize () from /usr/local/lib/libclucene-core.so.1 #12 0x000000080221bfd9 in lucene_index_optimize () from /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so ---Type <return> to continue, or q <return> to quit--- #13 0x000000080400a2b0 in doveadm_fts_plugin_deinit () from /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so #14 0x0000000000413617 in doveadm_mail_single_user () #15 0x0000000000413c60 in doveadm_mail_try_run () #16 0x000000000041c897 in main () (gdb) -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 108 Turvey Cove, Hutto, TX 78634-5688

1 0

Re: [Dovecot] Corrupted Mail?
by Joseph Tam 30 May '14

30 May '14

Arthur Dent <arthurdent.london(a)gmail.com> writes: > I get my mail from a variety of ISP and online email accounts using > fetchmail. I guess there's no change needed there? > > That feeds into procmail. I think I will have to change the mail > procmail configuration file and ALL my procmail recipe rc files (I have > many) - which filter into several different mboxs? As others have intimated, the use of procmail as your LDA is causing your mailbox to become inconsistent with respect to your indices. Procmail is appending your messages to mailboxes, but is ignorant of the existence of dovecot indices, and does not update them. When your IMAP service access those mailboxes, it detects this condition, and that's the log messages you are seeing. I think those messages are benign -- you can probably ignore it. Dovecot will automatically rebuild them. The alternative is to let dovecot's be responsible for message delivery: it can then update the indices, and IMAP/POP will find consistent indices. Try this at the end of procmailrc for regular delivery to the INBOX ################################################################################ # Replace default action using dovecot-lda to maintains caches. ################################################################################ :0 w | /location/of/dovecot-lda -d $USER For for non-INBOX filtering, try something like :0 Hw *^Subject: TEST |/location/of/dovecot-lda -d $USER -m testbox Joseph Tam <jtam.home(a)gmail.com>

5 9

Re: [Dovecot] Filed to write auth token secret file
by Chris Vaas 30 May '14

30 May '14

Just to give it a shot, I took a look into my SELinux log. Problem solved, SELinux blocked it. I added a rule to allow the access and that's it. Thanks for your help Chris On Fri, May 30, 2014 at 2:46 AM, Larry Rosenman <larryrtx(a)gmail.com> wrote: > Can you check all the auth-* process(es) running and make sure they are > all running as root? > > Also, a doveconf -n MIGHT help. > > > On Thu, May 29, 2014 at 1:25 AM, Chris Vaas <chrisvaas(a)gmail.com> wrote: > >> So it seems that the permissions are the same like yours. Hm. Suggestions >> about the next step? >> On May 29, 2014 1:12 AM, "Larry Rosenman" <larryrtx(a)gmail.com> wrote: >> >>> the . directory in that list is /var/run/dovecot. >>> >>> that was a ls -la, after a cd /var/run/dovecot. >>> >>> >>> On 5/28/14, Chris Vaas <chrisvaas(a)gmail.com> wrote: >>> > May I also ask you for the permissions on the parent folder? >>> > /var/run/dovecot >>> > >>> > Thanks! >>> > >>> > >>> > On Thu, May 29, 2014 at 1:07 AM, Larry Rosenman <larryrtx(a)gmail.com> >>> wrote: >>> > >>> >> Here is the entire contents of mine. >>> >> >>> >> drwxr-xr-x 5 root wheel 35 May 27 21:01 . >>> >> drwxr-xr-x 14 root wheel 35 May 28 03:01 .. >>> >> srw------- 1 root wheel 0 May 24 14:12 anvil >>> >> srw------- 1 root wheel 0 May 24 14:12 anvil-auth-penalty >>> >> srw-rw-rw- 1 dovecot wheel 0 May 27 21:01 auth-client >>> >> srw------- 1 dovecot wheel 0 May 27 21:01 auth-login >>> >> srw-rw-rw- 1 root wheel 0 May 27 21:01 auth-master >>> >> -rw------- 1 root wheel 32 May 24 14:12 >>> auth-token-secret.dat >>> >> srw-rw-rw- 1 dovecot wheel 0 May 27 21:01 auth-userdb >>> >> srw------- 1 dovecot wheel 0 May 27 21:01 auth-worker >>> >> srw------- 1 root wheel 0 May 27 21:01 config >>> >> srw------- 1 root wheel 0 May 27 21:01 dict >>> >> srw------- 1 root wheel 0 May 27 21:01 director-admin >>> >> srw------- 1 root wheel 0 May 27 21:01 director-userdb >>> >> srw-rw-rw- 1 root wheel 0 May 27 21:01 dns-client >>> >> srw------- 1 root wheel 0 May 27 21:01 doveadm-server >>> >> lrwx------ 1 root wheel 35 May 24 14:12 dovecot.conf -> >>> >> /usr/local/etc/dovecot/dovecot.conf >>> >> drwxr-xr-x 2 root wheel 2 May 24 14:12 empty >>> >> srw-rw-rw- 1 root wheel 0 May 27 21:01 imap-urlauth >>> >> srw------- 1 dovecot wheel 0 May 27 21:01 imap-urlauth-worker >>> >> srw-rw-rw- 1 root wheel 0 May 27 21:01 indexer >>> >> srw------- 1 dovecot wheel 0 May 27 21:01 indexer-worker >>> >> srw------- 1 root wheel 0 May 27 21:01 ipc >>> >> srw-rw-rw- 1 root wheel 0 May 27 21:01 lmtp >>> >> srw------- 1 root wheel 0 May 27 21:01 log-errors >>> >> drwxr-x--- 2 root dovenull 9 May 27 21:01 login >>> >> -rw------- 1 root wheel 4 May 24 14:12 master.pid >>> >> -rw-r--r-- 1 root wheel 86 May 24 14:12 mounts >>> >> srw------- 1 root wheel 0 May 27 21:01 replication-notify >>> >> prw------- 1 root wheel 0 May 27 21:01 >>> replication-notify-fifo >>> >> srw------- 1 dovecot wheel 0 May 27 21:01 replicator >>> >> srw-rw-rw- 1 root wheel 0 May 27 21:01 ssl-params >>> >> srw-rw-rw- 1 root wheel 0 May 27 21:01 stats >>> >> prw-rw-rw- 1 root wheel 0 May 27 21:01 stats-mail >>> >> drwxr-x--- 2 root dovenull 4 May 27 21:01 token-login >>> >> thebighonker.lerctr.org /var/run/dovecot $ >>> >> >>> >> >>> >> Now, the fact that it was whining about a .tmp file is interesting. >>> >> >>> >> Was there any other whines? >>> >> >>> >> Seems like something(tm) wasn't running as root that should be. >>> >> >>> >> >>> >> On Wed, May 28, 2014 at 5:52 PM, Chris Vaas <chrisvaas(a)gmail.com> >>> wrote: >>> >> >>> >>> What permissions should I have on the folder /var/run/dovecot ? The >>> >>> owner >>> >>> is root and the group dovecot in my case. The access bits are >>> >>> drwxr-xr-x. >>> >>> >>> >>> On Thu, May 29, 2014 at 12:49 AM, Larry Rosenman <larryrtx(a)gmail.com >>> > >>> >>> wrote: >>> >>> >>> >>> > Check the permissions on the directory referenced. >>> >>> > On May 28, 2014 5:06 PM, "Chris Vaas" <chrisvaas(a)gmail.com> wrote: >>> >>> > >>> >>> >> Hey guys, >>> >>> >> I am getting the following error. It seems not be be severe, >>> since my >>> >>> >> setup >>> >>> >> works without any signs of drawbacks. But I'd rather rely on a >>> >>> >> professional >>> >>> >> opinion. >>> >>> >> >>> >>> >> May 28 23:02:54 example dovecot: auth: Error: >>> >>> >> open(/var/run/dovecot/auth-token-secret.dat.tmp) failed: >>> Permission >>> >>> denied >>> >>> >> May 28 23:02:54 example dovecot: auth: Error: Failed to write auth >>> >>> token >>> >>> >> secret file; returned tokens will be invalid once auth restarts >>> >>> >> >>> >>> >> Thanks in advance >>> >>> >> Chris >>> >>> >> >>> >>> > >>> >>> >>> >> >>> >> >>> >> >>> >> -- >>> >> Larry Rosenman http://www.lerctr.org/~ler >>> >> Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com >>> >> US Mail: 108 Turvey Cove, Hutto, TX 78634-5688 >>> >> >>> > >>> >>> >>> -- >>> Larry Rosenman http://www.lerctr.org/~ler >>> Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com >>> US Mail: 108 Turvey Cove, Hutto, TX 78634-5688 >>> >> > > > -- > Larry Rosenman http://www.lerctr.org/~ler > Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com > US Mail: 108 Turvey Cove, Hutto, TX 78634-5688 >

1 0

[Dovecot] Problem with quota calculation...
by Klaus Tachtler 30 May '14

30 May '14

Hello, since I changed the quota backend from maildir (maildir:User quota) to dictionary (dict:User quota::proxy::quota), I have problems with tha calculated size and messages count. --- Input/Output --- # du -hs 23M . # doveadm quota get -u ich(a)tachtler.net Quota name Type Value Limit % User quota STORAGE 46602 1024000 4 User quota MESSAGE 166 - 0 # doveadm quota recalc -u ich(a)tachtler.net # doveadm quota get -u ich(a)tachtler.net Quota name Type Value Limit % User quota STORAGE 23301 1024000 2 User quota MESSAGE 83 - 0 --- Input/Output ---- It seems, that all was counted twice? ----- doveconf -n ----- # dovecot -n # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.17.1.el6.x86_64 x86_64 CentOS release 6.5 (Final) auth_master_user_separator = * auth_mechanisms = plain digest-md5 cram-md5 login auth_verbose = yes dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } hostname = dovecot.tachtler.net listen = * mail_location = maildir:~/Maildir mail_plugins = " quota acl zlib mail_log notify" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace { list = children location = maildir:%%h/Maildir:INDEX=%h/shared/%%u:CONTROL=%h/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX/ separator = / } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db mail_log_fields = uid box msgid size from quota = dict:User quota::proxy::quota quota_grace = 10%% quota_rule = INBOX/Trash:storage=+100M quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is over quota quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster(a)tachtler.net protocols = imap lmtp sieve service auth { unix_listener auth-userdb { group = vmail user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { process_min_avail = 1 service_count = 0 } service lmtp { inet_listener lmtp { address = 192.168.0.80 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { address = 192.168.0.80 port = 12340 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = vmail } ssl_cert = </etc/pki/dovecot/certs/CAcert-class3-wildcard_all_in_one.crt ssl_key = </etc/pki/dovecot/private/tachtler.net.key userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = " quota acl zlib mail_log notify sieve" } protocol imap { mail_plugins = " quota acl zlib mail_log notify imap_quota imap_acl imap_zlib" } Thank you for any help, Klaus. -- ------------------------------------------ e-Mail : klaus(a)tachtler.net Homepage: http://www.tachtler.net DokuWiki: http://www.dokuwiki.tachtler.net ------------------------------------------

3 2

[Dovecot] Filed to write auth token secret file
by Chris Vaas 29 May '14

29 May '14

Hey guys, I am getting the following error. It seems not be be severe, since my setup works without any signs of drawbacks. But I'd rather rely on a professional opinion. May 28 23:02:54 example dovecot: auth: Error: open(/var/run/dovecot/auth-token-secret.dat.tmp) failed: Permission denied May 28 23:02:54 example dovecot: auth: Error: Failed to write auth token secret file; returned tokens will be invalid once auth restarts Thanks in advance Chris

2 4

Re: [Dovecot] Corrupted Mail?
by Joseph Tam 29 May '14

29 May '14

> * ^List-Id:.*users.lists.fedoraproject.org > | $DELIVER -m $DESTDIR/MLists/Fedora You removed the '-d' parameter -- it may or may not work without it, but you'll need it in a virtual user setup. I'm not sure whether procmail sets $USER by itself or it gets passed as an environment variable, so if $USER is not working, use $LOGNAME, or better yet, just hardcode the value if this is your own script. Also, the -m parameter is the name of a mailbox, not a pathname, so I think "MLists/Fedora" is what you want. > This is what I found in the procmail log: > lda: Fatal: destination user parameter (-d user) not given Well, this error couldn't be more explicit, can it? Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] dovecot 2.1.15 hangs while connecting.
by Albert Whale 28 May '14

28 May '14

I am using Dovecot in two Server environments. My Legacy (5 years+ old) servers are running dovecot 1.1.20, and are responding as expected. These servers are using an NFS based storage for the /home directory structure, and are working beautifully. However, I need to replace these inefficient servers, and get more current. That brings me to the problem, where I am implementing Dovecot 2.1.15, which does not complete the authentication cycle. I have converted the 1.1.20 configuration using the documentation available, and I have the following for my running configuration (which is not working): # 2.1.15: /etc/dovecot/dovecot.conf # OS: Linux 3.8.13.4-server-1.mga3 i686 Mageia 3 auth_debug = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no lock_method = dotlock login_greeting = SpamZapper Email ready. login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c mail_debug = yes mail_fsync = always mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_privileged_group = mail mmap_disable = yes passdb { driver = pam } protocols = imap pop3 service auth { user = root } service imap-login { chroot = login client_limit = 256 user = dovecot } service pop3-login { chroot = login client_limit = 256 user = dovecot } ssl = no userdb { driver = passwd } verbose_proctitle = yes protocol pop3 { mail_max_userip_connections = 50 pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_uidl_format = %08Xv%08Xu } protocol lda { postmaster_address = postmaster(a)example.com } I have captured the Debug output of the dovecot process while attempting to connect: May 27 13:02:10 ns dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=pop3#011session=IzAYqGT6pgBCz4Xk#011lip=66.207.133.227#011rip=66.207.133.228#011lport=110#011rport=38566#011resp=<hidden> May 27 13:02:10 ns dovecot: auth-worker(551): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth May 27 13:02:10 ns dovecot: auth-worker(551): Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so May 27 13:02:10 ns dovecot: auth-worker(551): Debug: pam(aewhale,66.207.133.228): lookup service=dovecot May 27 13:02:10 ns dovecot: auth-worker(551): Debug: pam(aewhale,66.207.133.228): #1/1 style=1 msg=Password: May 27 13:02:10 ns dovecot: auth: Debug: client passdb out: OK#0111#011user=aewhale May 27 13:02:10 ns dovecot: auth: Debug: master in: REQUEST#0112671116289#011453#0111#01174d85bf0d878139a83e682a869786da9 May 27 13:02:10 ns dovecot: auth-worker(551): Debug: passwd(aewhale,66.207.133.228): lookup May 27 13:02:10 ns dovecot: auth: Debug: master userdb out: USER#0112671116289#011aewhale#011system_groups_user=aewhale#011uid=501#011gid=501#011home=/home/aewhale May 27 13:02:10 ns dovecot: pop3-login: Login: user=<aewhale>, method=PLAIN, rip=66.207.133.228, lip=66.207.133.227 May 27 13:02:10 ns dovecot: pop3(aewhale): Debug: Effective uid=501, gid=501, home=/home/aewhale May 27 13:02:10 ns dovecot: pop3(aewhale): Debug: maildir++: root=/home/aewhale/Maildir, index=, control=, inbox=/home/aewhale/Maildir, alt= All processing stops here. This is an NFS Storage Mail Spool, which works on 1.1.20 but not 2.1.15? What other pink elephants have I missed? Thank you for your assistance. -- Albert E. Whale, CEH CHS CISA CISSP *President - Chief Security Officer* http://www.IT-Security-inc.com - IT Security, Inc. Phone: 412-515-3010 | Email: Albert.Whale(a)IT-Security-inc.com Cell: 412-889-6870

1 1

[Dovecot] Corrupted Mail?
by Arthur Dent 28 May '14

28 May '14

Hello All, I have a Dovecot v2.2.12 installation running on a Fedora 20 box which is the mailserver for my family. This means that it is serving only 4 accounts. I use fetchmail->procmail to feed Dovecot and I read my mail on clients such as Evolution on (another) Fedora 20 machine, iPad/iPhone or squirrelmail on the web (running on the same Fedora 20 server). The average mail throughput for the whole family is around a couple of hundred messages per day, but each (and every) day I get between 3 and 10 of the following messages: dovecot: imap(mark): Error: Next message unexpectedly corrupted in mbox file /home/mark/mail/MLists/Fail2Ban at 3407473: 1 Time(s) I have googled, but with little success. What I have found seemed to suggest that removing the .index files and allowing Dovecot to rebuild them will solve this. I did: find /home -type f -name "dovecot.index.*" -exec rm -f {} \; but it has made no difference. Can anyone help me solve this please? Thanks in advance Mark

5 12

[Dovecot] both perosnal and global sieve scripts
by Selcuk Yazar 28 May '14

28 May '14

Hi we have redhat 6 EL and dovecot 2.0.9 personel scripts running with no problem, but now i try to add global scripts for sieve i added parameters sieve_global_path = /var/lib/dovecot/sieve/default.sieve sieve_global_dir = /var/lib/dovecot/sieve/ and create folder with owned vmail and creat script default.sieve require ["fileinto"]; # rule:[Move Spam to Junk Folder] if header :is "X-Spam-Flag" "YES" { fileinto "Spam"; stop; } if header :contains ["Subject"] "**global**" { fileinto "Spam" ; stop ; } keep; after that when try to compile this script it says mbox: INBOX defaulted to /home/vmail/domains//root/inbox fs: root=/home/vmail/domains//root, index=, control=, inbox=/home/vmail/domains//root/inbox i think sievec doesnt recognazi mail_location or anothers things, when i try to sent e-mail, it didn't deliver also i saw root folder after domains folder. any idea our conf is dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-131.6.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.0 (Santiago) ext4 auth_debug = yes auth_debug_passwords = yes auth_default_realm = ........................edu.tr auth_mechanisms = plain login auth_verbose = yes debug_log_path = /var/log/dovecot.debug disable_plaintext_auth = no first_valid_uid = 97 info_log_path = /var/log/dovecot.info last_valid_uid = 5000 mail_debug = yes mail_gid = 1001 mail_location = mbox:/home/vmail/domains/%d/%u mail_uid = 1001 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl passdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } plugin { quota = maildir:User quota quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = /var/sieve-scripts/%u.sieve sieve_dir = /home/vmail/domains/sieve/%n/.sieve } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { mode = 0600 user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl = no ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } protocol lda { debug_log_path = /var/log/dovecot-lda-errors.log info_log_path = /var/log/dovecot-lda.log log_path = /var/log/dovecot-lda-errors.log mail_plugins = " sieve quota" } protocol imap { mail_plugins = " quota imap_quota" } thanks in advance -- Selçuk YAZAR

1 0

[Dovecot] doveadm fts: mbox/lucene-indexes, and other errors
by Larry Rosenman 27 May '14

27 May '14

I turned on fts_autoindex today, and wanted to rescan all my mailboxes.... Ran doveadm -Dv fts rescan, and garnered: thebighonker.lerctr.org /home/ler/mail $ doveadm -Dv fts rescan doveadm(ler): Debug: Loading modules from directory: /usr/local/lib/dovecot doveadm(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib20_fts_plugin.so doveadm(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so doveadm(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib90_stats_plugin.so doveadm(ler): Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm doveadm(ler): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: Undefined symbol "acl_user_module" (this is usually intentional, so just ignore this message) doveadm(ler): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: Undefined symbol "expire_set_lookup" (this is usually intentional, so just ignore this message) doveadm(ler): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so: Undefined symbol "quota_user_module" (this is usually intentional, so just ignore this message) doveadm(ler): Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm(ler): Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so doveadm(ler): Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so doveadm(ler): Debug: Effective uid=1002, gid=1002, home=/home/ler doveadm(ler): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=~/mail/INBOX doveadm(ler): Debug: fs: root=/home/ler/mail, index=, indexpvt=, control=, inbox=/home/ler/mail/INBOX, alt= doveadm(ler): Debug: Namespace archive: type=private, prefix=#ARCHIVE/, sep=/, inbox=no, hidden=no, list=no, subscriptions=yes location=mbox:~/MAILARCHIVE doveadm(ler): Debug: mbox: INBOX defaulted to /home/ler/MAILARCHIVE/inbox doveadm(ler): Debug: fs: root=/home/ler/MAILARCHIVE, index=, indexpvt=, control=, inbox=/home/ler/MAILARCHIVE/inbox, alt= doveadm(ler): Error: Couldn't get mailbox lucene-indexes/dovecot-expunges.log GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_a1.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9t.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9z.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9t_1.del GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/segments.gen GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9u.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_a0.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9x.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9v.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/segments_ke GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9w.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9y.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_5w.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_5w_1.del GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: lucene: Couldn't open mailbox (error in mailbox with GUID=21ba3234186a115376580000bbe98eac): Internal error occurred. Refer to server log for more information. [2014-05-27 14:59:45] doveadm(ler): Error: lucene: Couldn't open mailbox (error in mailbox with GUID=77614b1bb0383a530fb30000bbe98eac): Internal error occurred. Refer to server log for more information. [2014-05-27 14:59:45] doveadm(ler): Error: lucene: Couldn't open mailbox (error in mailbox with GUID=c77d8c12ac6b115348590000bbe98eac): Internal error occurred. Refer to server log for more information. [2014-05-27 14:59:45] doveadm(ler): Error: lucene: Couldn't open mailbox (error in mailbox with GUID=d07d8c12ac6b115348590000bbe98eac): Internal error occurred. Refer to server log for more information. [2014-05-27 14:59:45] doveadm(ler): Error: fts rescan failed thebighonker.lerctr.org /home/ler/mail $ 1) why doesn't Dovecot make the lucene-indexes directory \NoSelect or invisible? 2) how can I find the error(s) for the internal errors? (I looked in my debug.maillog and find NOTHING). Dovecot 2.2.13 FreeBSD 10.0 dovecot -n: thebighonker.lerctr.org /home/ler/mail $ dovecot -n # 2.2.13: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.0-STABLE amd64 auth_default_realm = lerctr.org auth_mechanisms = plain login auth_realms = lerctr.org thebighonker.lerctr.org tbh.lerctr.org auth_username_format = %Ln disable_plaintext_auth = no lda_mailbox_autocreate = yes lmtp_save_to_detail_mailbox = yes login_access_sockets = tcpwrap mail_debug = yes mail_location = mbox:~/mail:INBOX=~/mail/INBOX mail_plugins = fts fts_lucene stats mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace archive { hidden = no inbox = no list = no location = mbox:~/MAILARCHIVE prefix = "#ARCHIVE/" separator = / } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox INBOX { auto = create } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = failure_show_msg=yes session=yes max_requests=20 driver = pam } plugin { fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@. normalize no_snowball sieve = ~/.dovecot.sieve sieve_dir = ~/sieve stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 16 M stats_refresh = 5s stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours } service auth { unix_listener auth-client { mode = 0666 } unix_listener auth-master { mode = 0666 } } service stats { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = stats extra_groups = fifo_listener stats-mail { group = mode = 0666 user = } group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener stats { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service tcpwrap { unix_listener login/tcpwrap { group = $default_login_user mode = 0600 user = $default_login_user } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } verbose_proctitle = yes protocol imap { imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags mail_max_userip_connections = 50 mail_plugins = fts fts_lucene stats imap_stats } thebighonker.lerctr.org /home/ler/mail $ -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 108 Turvey Cove, Hutto, TX 78634-5688

1 0

[Dovecot] dsync changing source permission to "root" in backup mode
by Peter Mogensen 27 May '14

27 May '14

Hi, We have dsync failing once in a while when running in "backup" mode. What's strange is that the result is that the file permissions on the *source* machine ends up with the wrong permissions (set to uid 0). Even though the dsync manual clearly says: "Backup mails from default mail location to location2 (or vice versa, if -R parameter is given). No changes are ever done to the source location. Any changes done in destination are discarded." Running: 'dsync -R -o mail_home=/users/maildir backup ssh -c arcfour src-host "dsync -o mail_home=/users/maildir"' I know it's running as root, but even then ... it shouldn't modify the source in "backup" mode ?? The error message from dsync when failing is: dsync-remote(root): Error: Cached message size larger than expected (5292 > 5289) dsync-remote(root): Error: Maildir filename has wrong S value, renamed the file from /users/maildir/.Sent/cur/1381224782.M959810P3574.mail,S=5292,W=5411:2,S to /users/maildir/.Sent/cur/1381224782.M959810P3574.mail,S=5289:2,S dsync-remote(root): Error: Corrupted index cache file /users/maildir/.Sent/dovecot.index.cache: Broken physical size for mail UID 1040 dsync-remote(root): Error: dsync(dst-host): read(/users/maildir/.Sent/cur/1381224782.M959810P3574.mail,S=5292,W=5411:2,S) failed: Cached message size larger than expected (5292 > 5289) /Peter

1 1

[Dovecot] Segfault when deselecting virtual folder 2.2.13+ HG TIP
by Colin Knox 27 May '14

27 May '14

Hello, I'm seeing a segfault in the imap process with the current mercurial tip (including changeset 17382 e99cd21e1f92) when selecting a particular virtual mail folder (but no other virtual mailboxes) and then selecting a different mail folder as in the IMAP transcript below. The same segfaults are triggered with IMAP clients. The situation is worse with the 2.2.13 which segfaults when any virtual mailbox is deselected so the recent patch helps partially. Configuration summary, IMAP session in gbd including backtrace and virtual mailbox spec follow. Any ideas what's causing this? Thank you Colin ======= GDB SESSION INCLUDING BACKTRACE ======= colin@xxxx [ ~ ]$ MAIL=maildir:/var/mail/colin gdb /usr/local/libexec/dovecot/imap GNU gdb (GDB) 7.6.1 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-unknown-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/local/libexec/dovecot/imap...done. (gdb) r Starting program: /usr/local/libexec/dovecot/imap warning: Could not load shared library symbols for linux-vdso.so.1. Do you need "set solib-search-path" or "set sysroot"? process 21455 is executing new program: /usr/local/bin/doveconf warning: Could not load shared library symbols for linux-vdso.so.1. Do you need "set solib-search-path" or "set sysroot"? process 21455 is executing new program: /usr/local/libexec/dovecot/imap warning: Could not load shared library symbols for linux-vdso.so.1. Do you need "set solib-search-path" or "set sysroot"? * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE SEARCH=FUZZY NOTIFY METADATA] Logged in as colin a SELECT PERSONAL.Home * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 23 EXISTS * 0 RECENT * OK [UIDVALIDITY 1261140830] UIDs valid * OK [UIDNEXT 24] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest a OK [READ-WRITE] Select completed (0.001 secs). a SELECT virtual.Conversations * OK [CLOSED] Previous mailbox closed. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 5 EXISTS * 0 RECENT * OK [UNSEEN 3] First unseen. * OK [UIDVALIDITY 1400091139] UIDs valid * OK [UIDNEXT 18] Predicted next UID a OK [READ-WRITE] Select completed (0.017 secs). a SELECT PERSONAL.Home Program received signal SIGSEGV, Segmentation fault. 0x00007ffff75f1c6c in mail_search_args_deinit_sub.30037.5970 () from /usr/local/lib/dovecot/libdovecot-storage.so.0 (gdb) bt full #0 0x00007ffff75f1c6c in mail_search_args_deinit_sub.30037.5970 () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #1 0x00007ffff75f1d41 in mail_search_args_deinit () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #2 0x00007ffff6ca3adb in virtual_mailbox_close_internal.9208 () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #3 0x00007ffff6ca3b39 in virtual_mailbox_close.9256 () from /usr/local/lib/dovecot/lib20_virtual_plugin.so No symbol table info available. #4 0x00007ffff761daac in mailbox_close () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #5 0x00007ffff75ff283 in mailbox_free () from /usr/local/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #6 0x0000000000410a2e in close_selected_mailbox.part.1 (client=client@entry=0x6577c0) at cmd-select.c:383 box = 0x0 #7 0x0000000000410b59 in close_selected_mailbox (client=0x6577c0) at cmd-select.c:376 client = 0x6577c0 #8 cmd_select_full (cmd=0x6583e0, readonly=<optimized out>) at cmd-select.c:427 client = 0x6577c0 ctx = 0x6584e0 args = 0x65ccd8 list_args = 0x632038 mailbox = 0x6322a8 "PERSONAL.Home" error = 0x648748 "" __FUNCTION__ = "cmd_select_full" __FUNCTION__ = "cmd_select_full" #9 0x00000000004129ac in command_exec (cmd=0x6583e0) at imap-commands.c:158 hook = 0x63b5c0 ret = <optimized out> #10 0x00000000004178ef in client_command_input (cmd=0x6583e0) at imap-client.c:778 client = 0x6577c0 command = <optimized out> __FUNCTION__ = "client_command_input" __FUNCTION__ = "client_command_input" #11 0x00000000004179a5 in client_command_input (cmd=0x6583e0) at imap-client.c:839 client = 0x6577c0 command = <optimized out> __FUNCTION__ = "client_command_input" __FUNCTION__ = "client_command_input" #12 0x0000000000417c65 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x6577c0) at imap-client.c:877 No locals. #13 client_handle_input (client=client@entry=0x6577c0) at imap-client.c:889 _data_stack_cur_id = 3 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" __FUNCTION__ = "client_handle_input" #14 0x0000000000417e8f in client_input (client=0x6577c0) at imap-client.c:931 cmd = 0x7ffff732abce <io_loop_context_activate+62> output = 0x658200 bytes = 23 __FUNCTION__ = "client_input" __FUNCTION__ = "client_input" #15 0x00007ffff732d3ff in io_loop_call_io () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #16 0x00007ffff731f407 in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #17 0x00007ffff731f4d9 in io_loop_handler_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #18 0x00007ffff731f558 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #19 0x00007ffff731f5c3 in master_service_run () from /usr/local/lib/dovecot/libdovecot.so.0 No symbol table info available. #20 0x000000000040bfa0 in main (argc=1, argv=0x63a390) at main.c:400 set_roots = {0x4274e0 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0x0, postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x0, failure_callback = 0x0, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> set_roots = {0x4274e0 <imap_setting_parser_info>, 0x0} ===================== DOVECONF -n ===================== colin@xxxx [ /var/mail/colin/virtual ]$ doveconf -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.14.4 x86_64 Linux From Scratch ext4 auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %Ln first_valid_gid = 1000 first_valid_uid = 1000 hostname = mail.theknoxes.co.uk imap_metadata = yes last_valid_gid = 1100 last_valid_uid = 1100 listen = * login_trusted_networks = 127.0.0.1 mail_attribute_dict = file:/var/mail/%n/shared_metadata mail_location = maildir:/var/mail/%n mail_plugins = " fts fts_solr virtual" mail_temp_dir = /tmp/mail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace { location = virtual:/var/mail/%n/virtual prefix = virtual. separator = . subscriptions = no } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox "Junk E-mail" { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox virtual/All { special_use = \All } prefix = separator = . } passdb { driver = pam } plugin { fts = solr fts_autoindex = yes fts_decoder = decode2text fts_solr = url=http://localhost:8080/solr/dovecot/ break-imap-search sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap lmtp sieve sendmail_path = /usr/local/sbin/sendmail service auth { unix_listener auth-client { group = exim mode = 0660 } } service decode2text { executable = script /usr/local/libexec/dovecot/decode2text.sh unix_listener decode2text { mode = 0666 } user = dovecot } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 0 } } service lmtp { unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { process_limit = 1024 } ssl = required ssl_cert = </etc/ssl/certs/dovecot.pem ssl_cipher_list = EECDH:EDH:@STRENGTH:HIGH:!MEDIUM:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS:!RC4:!ADH:!aNULL:!eNULL ssl_dh_parameters_length = 2048 ssl_key = </etc/ssl/private/dovecot.key ssl_prefer_server_ciphers = yes submission_host = localhost:25 userdb { driver = passwd } protocol imap { mail_max_userip_connections = 100 } protocol lmtp { mail_plugins = " fts fts_solr virtual sieve" } =========================== VIRTUAL MAILBOX SPEC =========================== colin@xxxx [ /var/mail/colin/virtual ]$ cat Conversations/dovecot-virtual virtual.All inthread refs x-mailbox Inbox ===========================

2 2

[Dovecot] Odd ownership of the dovecot-uidlist file
by dclist.hook＠hook.net.nz 27 May '14

27 May '14

Hi, We have just recently switched from Courier to Dovecot for both IMAAP and POP access for our shared hosting platform, and while the issues we have been seeing with Courier have gone away a new one has popped up. Unfortunately googling for an answer is difficult as it falls into the ownership and permissions category which people seem to have all the time. But in those cases it always happens, whereas what we are seeing is a random ownership change on the dovecot-uidlist file. Basically what we see is the user is able to login fine for days and then all of a sudden the file has changed ownership to a user under a different domain, what's worse is the other user has not even logged in during that time. Here's a snippet from a case from a month ago which was escalated to us, there are plenty of other examples but its so random we only know its happened when the customer complains or we happen to watch the logs, the current help desk procedure when the customer calls is to just fix the ownership of the file. -- 8<-- Mar 25 11:18:05 brio dovecot: pop3-login: Login: user=<accounts@DOMAIN1>, method=PLAIN, rip=IP, lip=IP, mpid=21739, TLS, session=<mwQLnGH1ZAB2XalI> Mar 25 11:18:08 brio dovecot: pop3(accounts@DOMAIN1): Disconnected: Logged out top=0 (0 b), retr=4 (274142 b), messages=27 (10797760 b), del=0 Mar 25 11:19:24 brio dovecot: pop3(accounts@DOMAIN1): Error: open(/mnt/spool/keepers/t/DOMAIN1/accounts/Maildir/dovecot-uidlist) failed: Permission denied Mar 25 11:19:24 brio dovecot: pop3(accounts@DOAMIN1): Error: open(/mnt/spool/keepers/t/DOMAIN1/accounts/Maildir/dovecot-uidlist) failed: Permission denied -- 8<-- In this case the ownership of the file was: -rw------- 1 jacqui-30747 DOMAIN2 48839 Mar 25 10:31 dovecot-uidlist when it should be: -rw------- 1 accounts-25105 DOMAIN1 48839 Mar 25 10:32 dovecot-uidlist As you can see both the user and the group have changed to a different user as if that user had recreated the file. Its worth noting that the parent directory does not change: drwx------ 8 accounts-25105 DOMAIN1 4096 Mar 25 10:31 . so this user should not even be able to access this file. It would be great if someone can give us some hints where the problem maybe as this has us stumped. Some more detail if it helps: root@brio:~# dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_mechanisms = plain login cram-md5 apop auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@& default_process_limit = 3000 disable_plaintext_auth = no lock_method = dotlock mail_fsync = always mail_location = maildir:~/Maildir:INDEX=/home/indexes/%1d/%n@%d mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " quota" maildir_stat_dirs = yes mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . subscriptions = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql-cram.conf.ext driver = sql } plugin { quota = maildir:User quota } protocols = " imap pop3" service imap-login { inet_listener imap25 { port = 25143 } } service imap-postlogin { executable = script-login -d /usr/local/bin/postlogin.sh } service imap { executable = imap imap-postlogin } service pop3-login { inet_listener pop325 { port = 25110 } } service pop3 { executable = pop3 imap-postlogin } ssl_cert = </var/www/mailadmin/ssl/cert.pem ssl_crypto_device = dynamic ssl_key = </var/www/mailadmin/ssl/mailx.hosts.net.nz.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { args = /etc/dovecot/dovecot-sql-cram.conf.ext driver = sql } verbose_proctitle = yes protocol imap { imap_capability = +XHOST_brio imap_logout_format = bytes=%i/%o mail_max_userip_connections = 50 mail_plugins = " quota imap_quota" } protocol pop3 { mail_max_userip_connections = 10 pop3_lock_session = no pop3_logout_format = top=%t (%p b), retr=%r (%b b), messages=%m (%s b), del=%d pop3_save_uidl = yes pop3_uidl_format = %f } root@brio:~# dpkg -l|grep dovecot ii dovecot-core 1:2.1.7-7 amd64 secure mail server that supports mbox, maildir, dbox and mdbox mailboxes ii dovecot-imapd 1:2.1.7-7 amd64 secure IMAP server that supports mbox, maildir, dbox and mdbox mailboxes ii dovecot-mysql 1:2.1.7-7 amd64 MySQL support for Dovecot ii dovecot-pop3d 1:2.1.7-7 amd64 secure POP3 server that supports mbox, maildir, dbox and mdbox mailboxes Mailbox storage is done over various NFS stores, however each user has a specific NFS store Connections are load balanced using LVS and keepalived over approx 10 real servers, persistant connections are setup so that a single user should only hit a single dovecot server (this is different from our courier setup due to the known NFS limitations with dovecot) We also have IMAP indexes stored on the dovecot servers ext3 file system itself rather than NFS. Each server is setup and maintained by puppet, and any one of the servers may see the issue. All servers are x86 with at least 2Gb of RAM User information comes from a MySQL database, and testing the SQL statements only ever return the correct record. Exim is writing to the Maildir with the correct permissions, and after fixing the ownership of the file dovecot can read and change the mailboxes. We do have a postlogin.sh script which runs after authentication to convert the old courier files over to the dovecot ones, this only happens however when the process has not run before (it appears dovecot deletes the files and recreates them, so we use a state file). Adding debugging to the script shows its running as the correct user at the last successful login. It does not run at all after the ownership has changed. There are some users who this is happening regularly, and other users who it has happened to only once. It is also not just limited to POP3, although this is where we commonly see it as dovecot accepts the IMAP connection if the ownership on a sub folders uidlist is different. If you need any further detail, I can provide it. Debugging could be much more difficult because of how random it is, while it can happen daily there have been periods of up to one week before its seen. Any help in finding this would be greatly appreciated, Cheers, Bruce

2 1

[Dovecot] Incorrect IMAP search results when FTS/Squat indexes are present with 2.1.7
by Robert L Mathews 27 May '14

27 May '14

We recently upgraded from Dovecot 1.2.15 (on Debian squeeze) to Dovecot 2.1.7 (on Debian wheezy/stable). For now, we continue to use FTS with Squat indexes. We'd like to eventually switch to Lucene but it's not yet supported in Debian stable. Since upgrading to 2.1.7, we've seen some problems with IMAP search results when an FTS Squat index is present (i.e., when the "dovecot.index.search" and "dovecot.index.search.uids" files are present). If it's present, even header searches sometimes give incorrect results (such as searches on FROM or SUBJECT headers). I'm wondering if this is a known issue with 2.1.7 and whether upgrading to a later version of Dovecot with Squat is likely to fix this (due to, say, <http://www.dovecot.org/list/dovecot-cvs/2012-June/020881.html>), or if Squat in all versions is a lost cause and I need to switch to Lucene. I can demonstrate the problem by showing the results of three searches on my mailbox. First, here are the correct results for header FTS searches when no "dovecot.index.search[.uids]" file is present: ---- . UID SEARCH FROM "Nick" * SEARCH 9 66 100 116 179 212 274 338 347 386 494 519 579 603 643 766 781 788 827 1107 1280 1626 1641 1667 1688 1702 1703 2184 2187 3202 3519 3716 3798 3885 3886 4024 4166 4345 4400 4401 4436 4491 4561 4595 4618 4676 4711 4712 4746 4788 4883 5217 5253 5577 5602 5722 . OK Search completed (0.059 secs). . UID SEARCH ALL FROM "Nick" * SEARCH 9 66 100 116 179 212 274 338 347 386 494 519 579 603 643 766 781 788 827 1107 1280 1626 1641 1667 1688 1702 1703 2184 2187 3202 3519 3716 3798 3885 3886 4024 4166 4345 4400 4401 4436 4491 4561 4595 4618 4676 4711 4712 4746 4788 4883 5217 5253 5577 5602 5722 . OK Search completed (0.058 secs). . UID SEARCH SUBJECT "Nick" * SEARCH 3466 3467 3507 . OK Search completed (0.054 secs). ---- These results are consistent (and correct) whether "mail_plugins = fts fts_squat" is enabled or not, as long as no "dovecot.index.search[.uids]" file is present. Now I generate an FTS index: ---- . UID SEARCH TEXT "Nick" * OK Indexed 98% of the mailbox, ETA 0:00 * OK Mailbox indexing finished * SEARCH 9 32 66 100 111 112 113 116 179 199 212 228 229 240 274 303 338 347 386 393 448 478 491 494 519 579 591 603 614 618 624 643 649 742 766 781 788 827 837 839 841 1095 1106 1107 1174 1188 1225 1227 1228 1240 1254 1261 1278 1280 1452 1482 1519 1520 1595 1626 1641 1656 1667 1688 1702 1703 1724 1758 2184 2187 2798 2883 2932 3034 3198 3202 3206 3230 3371 3432 3454 3457 3466 3467 3507 3519 3631 3637 3685 3702 3703 3716 3765 3798 3799 3803 3853 3854 3855 3857 3873 3885 3886 3962 3969 4024 4033 4050 4051 4058 4161 4166 4173 4176 4224 4273 4345 4400 4401 4436 4461 4490 4491 4498 4561 4595 4618 4651 4676 4711 4712 4713 4729 4731 4736 4737 4738 4739 4746 4786 4787 4788 4813 4816 4822 4847 4883 4885 4933 4941 4942 4957 4958 5029 5052 5097 5135 5136 5182 5217 5253 5271 5357 5543 5551 5565 5577 5589 5602 5612 5643 5692 5722 . OK Search completed (11.078 secs). ---- Now I run the same original three searches, but they return completely different results(!): ---- . UID SEARCH FROM "Nick" * SEARCH 9 66 100 116 179 212 228 240 274 338 347 386 448 494 519 579 603 643 766 781 788 827 1095 1107 1174 1240 1254 1261 1280 1595 1626 1641 1667 1688 1702 1703 1724 2184 2187 2883 2932 3202 3371 3432 3457 3466 3467 3507 3519 3631 3637 3685 3716 3765 3798 3803 3853 3854 3855 3885 3886 3969 4024 4050 4166 4176 4224 4345 4400 4401 4436 4461 4490 4491 4498 4561 4595 4618 4676 4711 4712 4729 4731 4746 4788 4883 5029 5135 5136 5182 5217 5253 5577 5602 5722 . OK Search completed (0.001 secs). . UID SEARCH ALL FROM "Nick" * SEARCH . OK Search completed (0.001 secs). . UID SEARCH SUBJECT "Nick" * SEARCH 9 66 100 116 179 212 228 240 274 338 347 386 448 494 519 579 603 643 766 781 788 827 1095 1107 1174 1240 1254 1261 1280 1595 1626 1641 1667 1688 1702 1703 1724 2184 2187 2883 2932 3202 3371 3432 3457 3466 3467 3507 3519 3631 3637 3685 3716 3765 3798 3803 3853 3854 3855 3885 3886 3969 4024 4050 4166 4176 4224 4345 4400 4401 4436 4461 4490 4491 4498 4561 4595 4618 4676 4711 4712 4729 4731 4746 4788 4883 5029 5135 5136 5182 5217 5253 5577 5602 5722 . OK Search completed (0.001 secs). ---- The "ALL" one returns nothing at all, even though an "AND" search on "ALL" should make no difference, and the "FROM" and "SUBJECT" ones now return identical incorrect results, many of which do not actually match the header requested when examined -- it's returning messages with "Nick" in *any* header. For example, message 9 does not contain "Nick" in the subject, despite the results shown above: ---- . FETCH 9 UID * 9 FETCH (UID 9) . OK Fetch completed. FETCH 9 BODY.PEEK[HEADER.FIELDS (SUBJECT)] * 9 FETCH (BODY[HEADER.FIELDS (SUBJECT)] {47} Subject: Re: Finishing Gallery support page ) . OK Fetch completed. ---- If I delete the "dovecot.index.search" and "dovecot.index.search.uids" files, or if I disable fts in the configuration entirely, the results immediately become correct again. As I mentioned above, I'm wondering if anyone knows the cause of (and fix for) this. Here's my doveconf -n: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 auth_master_user_separator = * auth_mechanisms = plain login auth_username_format = default_vsz_limit = 1 G disable_plaintext_auth = no lda_mailbox_autosubscribe = yes listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = pid=[%p] user=<%u> method=%m rip=%r lip=%l %c mail_fsync = never mail_location = maildir:~/ mail_max_userip_connections = 100 mail_plugins = fts fts_squat mail_log notify managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave spamtest spamtestplus namespace { inbox = yes location = prefix = INBOX. separator = . type = private } namespace { hidden = yes inbox = no list = no location = prefix = separator = . type = private } passdb { args = /etc/dovecot/dovecot.users driver = passwd-file } passdb { args = /etc/dovecot/master-passwords driver = passwd-file master = yes pass = yes } plugin { fts = squat mail_log_events = copy expunge mail_log_fields = box msgid size from sieve = %h/mailbox.sieve sieve_after = %h/../../domain-after.sieve sieve_before = %h/../../domain-before.sieve sieve_dir = %h/sieve sieve_extensions = -reject +spamtest +spamtestplus sieve_global_dir = %h/../../sieve-global-include-scripts sieve_spamtest_max_value = 7 sieve_spamtest_status_header = X-Spam-Level sieve_spamtest_status_type = strlen } protocols = pop3 imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { process_min_avail = 8 service_count = 0 } service imap { process_limit = 2000 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service pop3-login { process_min_avail = 8 service_count = 0 } service pop3 { process_limit = 2000 } ssl = no userdb { args = /etc/dovecot/dovecot.users driver = passwd-file } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail imap_logout_format = %i bytes in, %o bytes out } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_logout_format = ; %i bytes in, %o bytes out, %t top (%p bytes), %r retr (%b bytes), %d of %m deleted, mailbox size %s bytes pop3_uidl_format = UID%u-%v } protocol lda { mail_fsync = optimized mail_plugins = sieve postmaster_address = postmaster(a)tigertech.net sendmail_path = /usr/local/bin/dovecot-sendmail-wrapper } protocol lmtp { mail_fsync = optimized mail_plugins = sieve postmaster_address = postmaster(a)tigertech.net sendmail_path = /usr/local/bin/dovecot-sendmail-wrapper } -- Robert L Mathews, Tiger Technologies, http://www.tigertech.net/

1 0

[Dovecot] LDAP: allow pop3, restrict imap
by Andreas Schulze 26 May '14

26 May '14

Hello, I have all userdata in a ldapserver. Every user has the right to use pop3. There is no explicit attribute allowing that. It's simply possible. Now I like to add imap. For a starting period I like to restrict, who may use imap. http://wiki2.dovecot.org/Authentication/RestrictAccess mention a solution where I could modify ldap pass_filter. But that require an attribute "service=pop3" to be present in the ldap servers. In my case I have to add it for every existing user :-/ No way... Are there other options? Thanks, Andreas

3 3

[Dovecot] socket /var/spool/postfix/private/auth not created
by lister171254 26 May '14

26 May '14

I'm on Ubuntu 13.10 and followed these instructions http://wiki2.dovecot.org/HowTo/PostfixAndDovecotSASL to configure Dovecot for Postfix. No matter what I try, the listener is not created. <http://dovecot.2317879.n4.nabble.com/file/n48182/32.png> dovecot -n does not show the listener (I guess that's why its not created) This is the extract from the /etc/dovecot/conf.d/10-master.conf --------------- service auth { # auth_socket_path points to this userdb socket by default. It's typically # used by dovecot-lda, doveadm, possibly imap process, etc. Users that have # full permissions to this socket are able to get a list of all usernames and # get the results of everyone's userdb lookups. # # The default 0666 mode allows anyone to connect to the socket, but the # userdb lookups will succeed only if the userdb returns an "uid" field that # matches the caller process's UID. Also if caller's uid or gid matches the # socket's uid or gid the lookup succeeds. Anything else causes a failure. # # To give the caller full permissions to lookup all users, set the mode to # something else than 0666 and Dovecot lets the kernel enforce the # permissions (e.g. 0777 allows everyone full permissions). unix_listener auth-userdb { #mode = 0666 #user = #group = } # Postfix smtp-auth unix_listener /var/spool/postfix/private/auth { mode = 0600 user = postfix group = postfix } # Auth process is run as this user. #user = $default_internal_user } ---------------- Postfix is not involved in this right now as I expect the socket to be created when I restart dovecot. Can't find any meaningfull errors in the logs either. I hope I'm missing something obvious Thanks, Leo -- View this message in context: http://dovecot.2317879.n4.nabble.com/socket-var-spool-postfix-private-auth-… Sent from the Dovecot mailing list archive at Nabble.com.

6 14

[Dovecot] Copies of outgoing emails in the Sent folder
by Dmitry Podkovyrkin 26 May '14

26 May '14

Hi! My mail server works in tandem: Dovecot (IMAP) + Postfix. How can I configure in Gmail: Outgoing email copied to the Sent folder using postfix without mail client? This question is for the mailing list for Postfix? Mail client itself copies outgoing messages in the folder Sent, but the messages are large, and the server is far away. And to transmit email twice for sending and copying is not effective. Sorry for my English ). -- Regards Dmitry Podkovyrkin mobile: +7 922 20 56 756 email: dmirty(a)rutelecom.company skype: dmitryrw

6 15

[Dovecot] Multilayer mail handling
by Jimmy Thrasibule 26 May '14

26 May '14

Hi, I'm wondering what is the correct architecture and configuration to setup a multilayer mail handling? What I have in mind is something more like what we can found in Web platform architectures. 1. First layer does first checks: user authentication and SSL offloading. If all checks are OK request is proxied to layer 2. 2. Second layer, will actually handle the IMAP/POP3 connection proxied by layer 1, no major checks should be done as already made by layer 1. 3. Finally, layer 3 to do some virus checks on the emails and maybe some other things I can't think about. Do you have some pointers on how to set up such a mail stack where each layer can be on multiple other hosts? Best regards, Jimmy

1 0

[Dovecot] Index cache errors worse with 2.2.x
by Alexander 'Leo' Bergolth 25 May '14

25 May '14

Hi! I am getting "Cached message size smaller than expected" errors since dovecot-2.1.x. Until now, I thought that those errors don't do any harm, I assumed that the cache will just be rebuilt after the error had been detected. However, since dovecot 2.2.x (I tried 2.2.7 and 2.2.10), the errors sometimes seem to actually cause mail access to fail. With dovecot-2.1.1, only the first two messages were logged, since using 2.2.7 and 2.2.10, the "read ... failed: Invalid argument" sometimes appear: -------------------- 8< -------------------- May 7 17:03:52 samba dovecot: imap(xyz): Error: Cached message size smaller than expected (2246 < 2247) May 7 17:03:52 samba dovecot: imap(xyz): Error: Corrupted index cache file /home/xyz/mail/.imap/INBOX/dovecot.index.cache: Broken physical size for mail UID 11277 May 7 17:03:52 samba dovecot: imap(xyz): Error: read(/var/mail/xyz) failed: Invalid argument May 7 17:03:52 samba dovecot: imap(xyz): Error: read(/var/mail/xyz) failed: Invalid argument (uid=11277) -------------------- 8< -------------------- I am using dovecot on RHEL6 with mbox mailboxes. Message size differences are always 1 byte. Any hints would be appreciated! Cheers, --leo P.S.: Those errors occur some times a day and affect different users.. (Upgrade 2.1.1 -> 2.2.7 was on 2013-11-22, 2.2.10 was installed on 2014-01-20.) # for f in maillog* ; do echo -n "$f: "; grep "dovecot:.*Error: read.*failed.*Invalid arg" $f | wc -l; done maillog: 31 maillog-20130801: 0 maillog-20130901: 1 maillog-20131001: 0 maillog-20131101: 0 maillog-20131201: 30 maillog-20140101: 92 maillog-20140201: 110 maillog-20140301: 99 maillog-20140401: 133 maillog-20140501: 100 # for f in maillog* ; do echo -n "$f: "; grep "dovecot:.*Error: Cached message size smaller than expected" $f | wc -l; done maillog: 99 maillog-20130801: 465 maillog-20130901: 484 maillog-20131001: 512 maillog-20131101: 460 maillog-20131201: 520 maillog-20140101: 402 maillog-20140201: 400 maillog-20140301: 355 maillog-20140401: 481 maillog-20140501: 434 -- e-mail ::: Leo.Bergolth (at) wu.ac.at fax ::: +43-1-31336-906050 location ::: IT-Services | Vienna University of Economics | Austria

4 13

[Dovecot] Conditional jump or move depends on uninitialised value
by Daminto Lie 23 May '14

23 May '14

Hi, My Server runs on Ubuntu Server 12.04 LTS 32 bits. I'm getting the following error messages when I run "make check" during the compilation of dovecot-2.2.13. <snip> ==2058== Conditional jump or move depends on uninitialised value(s) ==2058== at 0x4049DD8: inflateReset2 (in /lib/i386-linux-gnu/libz.so.1.2.3.4) ==2058== by 0x4049EC7: inflateInit2_ (in /lib/i386-linux-gnu/libz.so.1.2.3.4) ==2058== by 0x804AFEF: i_stream_zlib_init (istream-zlib.c:320) ==2058== by 0x804B122: i_stream_create_zlib (istream-zlib.c:475) ==2058== by 0x804AA18: test_compression_handler (test-compression.c:72) ==2058== by 0xEFCDAB88: ??? ==2058== make[2]: *** [check-test] Error 1 make[2]: Leaving directory `/usr/src/dovecot-2.2.13/src/lib-compression' make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory `/usr/src/dovecot-2.2.13/src' make: *** [check-recursive] Error 1 Any help would be greatly appreciated. Thank you

2 1

[Dovecot] dsync incredibly slow
by Alan McGinlay 23 May '14

23 May '14

Hi! While performing a dsync from cyrus imap to dovecot 2.2.12, dsync seems to stop for perhaps a minute without disk / cpu / memory activity (that I can see). This happens several times per sync per user so it takes an enormous amount of time to sync just a couple of gigs of mail. dsync -D -v -o mail_fsync=never mirror -f -R -u user(a)example.com imapc: What could possibly be the cause of this slowness? Is it protocol dependent or just dsync it's self? Thanks!

2 1

[Dovecot] Mail logger plugin, improvement request
by Gilles Chauvin 23 May '14

23 May '14

Hi Timo, Would it be possible for the mail logger plugin to also log the imap MOVE events (RFC6851) ? Thanks. Regards, Gilles.

1 0

[Dovecot] Dovecot ontop of glusterfs issue.
by Eliezer Croitoru 23 May '14

23 May '14

Hey, I am testing Glusterfs as a storage backend for dovecot as a LDA and imap server. I have seen similar lines in the logs to these: May 21 10:46:01 mailgw dovecot: imap(eliezer(a)ngtech.co.il): Warning: Created dotlock file's timestamp is different than current time (1400658105 vs 1400658361): /home/vmail/ngtech.co.il/eliezer/Maildir/.Mailing_lists.ceph_users/dovecot-uidlist May 21 10:46:01 mailgw dovecot: imap(eliezer(a)ngtech.co.il): Error: Transaction log /home/vmail/ngtech.co.il/eliezer/Maildir/dovecot.index.log: duplicate transaction log sequence (2713) The volume is mounted only by one server with ubutntu 14.04. I have seen threads and posts about similar issue with nfs. I want to try to debug the issue but note that with the same settings of the server nfs worked fine but slower. dovecot -n output: http://pastebin.centos.org/9626/ The glusterfs is a replicated volume constructed of two bricks which is mounted only on one dovecot server. All three servers are using the same ntp pool and are synced. Any direction is better then the state I am now. Thanks, Eliezer

4 6

[Dovecot] director with same director / backend servers
by Will Yardley 23 May '14

23 May '14

I know this has been covered somewhat, but I'm still not totally clear. I'm trying to setup a 3 node cluster with 3 directors and 3 backend systems. This post (from 2012) suggests that proxy_maybe should work with director: http://www.dovecot.org/list/dovecot/2012-December/069806.html However, these two posts (from 2013) seem to say that it will not: http://dovecot.org/pipermail/dovecot/2013-November/093776.html http://dovecot.org/pipermail/dovecot/2013-November/093809.html When I try to just set =proxy_maybe=y in my LDAP config's pass_attrs, and not have an explicit 'director' listener for pop3-login / imap-login, it complains about lack of a host. May 22 14:28:08 XXXX dovecot: pop3-login: Error: proxy: host not given: user=<XXXXXXX>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Guessing the answer is "no", but is there any way (with v 2.x) to have one regular "listener" for imap / pop3, and one "director" listener for each as well, using the same instance of Dovecot? Has anyone gotten this to work successfully? I'm using LDAP, and do not want to explicitly specify a host for each username, I just want director to balance users across the 3 hosts. Obviously, I can just create two instances, but not only does this make the config more convoluted (especially following the convention of having the config files broken out into a bunch of files), but means I have to modify the default init script to really do it cleanly (something we were doing on the older iteration of this system that I had really been hoping to avoid). I'm assuming it's not possible to simply have the listeners for 'foo-login' execute something different depending on the port? I tried a couple different ways of configuring this, but it didn't seem to work. Dovecot is version 2.0.9 from RHEL 6. w

1 0

[Dovecot] Dovecot pam
by Tommy Berglund 22 May '14

22 May '14

Hello! How can I disable passdb { driver = pam } in /etc/dovecot/conf.d/auth-system.conf.ext from file /etc/dovecot/local.conf. I have postfix and dovecot set up to only use virtual users. I'd rather do all the configuration in local.conf if possible. My doveconf-n # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-24-generic x86_64 Ubuntu 14.04 LTS auth_failure_delay = 5 secs auth_mechanisms = plain login cram-md5 listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " mail_home = /var/vmail/%d/%n mail_location = mdbox:~/ managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = scheme=cram-md5 /etc/dovecot/passwd driver = passwd-file } plugin { sieve = /vmail/%d/%n/.dovecot.sieve sieve_dir = /vmail/%d/%n/sieve sieve_global_path = /vmail/dovecot/sieve/default.sieve } protocols = imap lmtp sieve service auth { executable = /usr/lib/dovecot/auth unix_listener /var/spool/postfix/private/auth-client { group = postfix mode = 0660 user = postfix } user = root } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = passwd } userdb { args = /etc/dovecot/users driver = passwd-file } protocol lmtp { mail_plugins = sieve postmaster_address = postmaster@localhost } Best regards

2 2

[Dovecot] When the subject portion of an e-mail contains a control character, dovecot.sieve terminates unexpectatedly.
by Atsuko Tanaka 22 May '14

22 May '14

Hello. We have currently set dovecot.sieve to insert the text "[SPAM]" at the beginning of an e-mail's subject when it's X-Spam-Score is above 80%. After we set our system as stated the following errors occur: 1) When an e-mail's subject contains control characters like [Ctrl+V|^V], dovecot.sieve terminates with an error and an e-mail is not able to be sent. When a MIME encoded Subject like [ＴＥＳＴ^VＭＡＩＬ] is sent we're not able to edit the subject and dovecot ends with an error. This is a sample of the data that was used in testing. Subject: =?ISO-2022-JP?B?GyRCI1QjRSNTI1QbKEIWGyRCI00jQSNJI0wbKEI=?= X-Spam-Score: 100.00% ↓ Subject: =?ISO-2022-JP?B?GyRCI1QjRSNTI1QbKEIWGyRCI00jQSNJI0wbKEI=?= X-Spam-Score: 100.00% This is the log generated by the data above. ---------------------------------------------------------------------- sieve: info: started log at May 02 10:46:22. main script: line 14: error: addheader action: specified value `[SPAM] ＴＥＳＴ?・・' is invalid. ---------------------------------------------------------------------- Aside from [Ctrl + V] the following control charcters also cause errors: backspace Ctrl + A Ctrl + C Ctrl + [ Ctrl + X Ctrl + Y 2) When an e-mail's subject line contains a "\0" character, everything following the null character is deleted. When a MIME encoded Subject is sent, for example "ＴＥＳＴ\0ＭＡＩＬ", the subject becomes "[SPAM]ＴＥＳＴ", the characters after the NULL character are deleted and dovecot.sieve ends normally. This is a sample of the data that we collected. Subject: =?ISO-2022-JP?B?GyRCI1QjRSNTI1QbKEIAGyRCI00jQSNJI0wbKEI=?= X-Spam-Score: 100.00% ↓ Subject: [SPAM] =?utf-8?b?77y077yl77yz77y0?= X-Spam-Score: 100.00% -Environment ・OS CentOS release 6.5 (Final) x86_64 ・Software Version dovecot-2.2.12 dovecot-2.2-pigeonhole-0.4.2 ・Results from the "dovecot -n" command. ---------------------------------------------------------------------- # 2.2.12: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.5.1.el6.x86_64 x86_64 CentOS release 6.5 (Final) disable_plaintext_auth = no lock_method = dotlock mail_fsync = always mail_gid = vmail mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota mail_temp_dir = /var/tmp mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave spamtest spamtestplus editheader mbox_write_locks = dotlock mmap_disable = yes passdb { driver = passwd } plugin { quota = maildir:User quota sieve = ~/Maildir/dovecot.sieve sieve_dir = ~/Maildir/sieve sieve_editheader_max_header_size = 1k sieve_editheader_protected = X-Verified sieve_extensions = +editheader +spamtest +spamtestplus sieve_max_actions = 250 sieve_max_redirects = 100 sieve_spamtest_max_value = 100.00 sieve_spamtest_status_header = X-Spam-Score: ([[:digit:]]+\.[[:digit:]]+)% sieve_spamtest_status_type = score sieve_user_log = /var/log/dovecot.sieve/%d/%u.log } postmaster_address = postmaster(a)example.jp protocols = pop3 imap service auth { unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } ssl_ca = </etc/pki/tls/certs/CA.crt ssl_cert = </etc/pki/tls/certs/example.jp.crt ssl_key = </etc/pki/tls/private/example.jp.key submission_host = 127.0.0.1:20025 userdb { args = /etc/dovecot/ldap/userdb.conf.ext driver = ldap } protocol lda { mail_plugins = quota sieve } protocol imap { mail_plugins = quota imap_quota passdb { args = /etc/dovecot/ldap/passdb.conf.ext driver = ldap } } protocol pop3 { passdb { args = /etc/dovecot/ldap/passdb.conf.ext driver = ldap } } ---------------------------------------------------------------------- -Contents of the "dovecot.sieve" file user/Maildir/dovecot.sieve ---------------------------------------------------------------------- require "fileinto"; require "mailbox"; require "envelope"; require "variables"; require "editheader"; require "spamtestplus"; require "relational"; require "enotify"; require "comparator-i;ascii-numeric"; if spamtest :percent :value "ge" :comparator "i;ascii-numeric" "80" { if exists "subject" { deleteheader :matches "subject" "*"; addheader "Subject" "[SPAM] ${1}"; } else { addheader "Subject" "[SPAM]"; } } ---------------------------------------------------------------------- Please reply. Thank you. -- ---------------------------------------- Atsuko Tanaka DesigNET Inc. e-mail：tanaka(a)designet.co.jp ----------------------------------------

4 5

[Dovecot] Sieve fileinto extension and redirect action
by FUSTE Emmanuel 21 May '14

21 May '14

Hello, Is there any way to limit the use of the "redirect" action (local user only or silent ignore) as provisioned by the RFC in the Pigeonhole implementation ? The only way I found for the moment is to completely disable the fileinto extension which hardly beat the users experience. "redirect" is forbidden by my organization policy. Regards, Emmanuel.

3 3

[Dovecot] LMTP hostname ignoring ENV variables
by G H 21 May '14

21 May '14

I am having an issue with LMTP appending the local hostname to received mail from Postfix. I either want to append localhost, a custom string, or nothing at all. Looking through the source code, I believe I should be able to set "export DOVECOT_HOSTNAME" and "export DOVECOT_HOSTDOMAIN" in my initscript to override the hostname set in lmtp/commands.c, client_get_added_headers() I'm using Centos 5; my hostname is mailtest1.atest.qq -- it is not defined in /etc/hosts. The added header is below: Received: from mail.mailorxyz.de by mailtest1.atest.qq (Dovecot) with LMTP id sreUK1+sfFOseQAAPYI4hw for <admin(a)mailorxyz.de>; Wed, 21 May 2014 13:39:03 +0000 Received: by mail.mailorxyz.de (Postfix, from userid 97) id CC743116AB5; Wed, 21 May 2014 13:39:03 +0000 (UTC) I have the following defined in /etc/init.d/dovecot: export DOVECOT_HOSTDOMAIN=dovecot.mailorxyz.de export DOVECOT_HOSTNAME=dovecot.mailorxyz.de Am I missing something or did I misunderstand the source code? Thanks.

2 1

Re: [Dovecot] Per-user Sieve script location question
by Selcuk Yazar 21 May '14

21 May '14

Hi Again, we have one domain, i suppose we don't have any problem with %n parameter. our mail server has mapped LUN Storage disk , we have some empty space problems, so i think it's better keep user things in storage for backup etc. we have totally 40K users(most of students) but i think at most 50 of them use this filter, autorespond etc. :) thank you for your reply. Selçuk On Wed, May 21, 2014 at 3:15 PM, Steffen Kaiser < skdovecot(a)smail.inf.fh-brs.de> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Wed, 21 May 2014, Selcuk Yazar wrote: > > Hi Selcuk, > > > i changed my 90-sieve.conf >> >> to >> >> sieve = /var/sieve-scripts/%u.sieve >> sieve_dir = /home/vmail/domains/sieve/%n/.sieve >> > > Yeah, looks good. However, do you host multiple domains? In your config > you differ domains: > > mail_location = mbox:/home/vmail/domains/%d/%u > > with sieve = /var/sieve-scripts/%u.sieve , too, but > with sieve_dir = /home/vmail/domains/sieve/%n/.sieve you do not. > > http://wiki2.dovecot.org/Variables > %u user full username (e.g. user@domain) > %n username user part in user@domain, same as %u if there's no domain > %d domain domain part in user@domain, empty if user with no domain > > I suppose, you should use: > > sieve_dir = /home/vmail/domains/sieve/%u/.sieve > > otherwise info(a)example.org and info@localhost share the same Sieve dir. > > BTW: Because you have an unique directory per user now anyway, why not use > is that as home directory? I'm not sure, what other things use the home > for. E.g. use > > mail_home = /home/vmail/domains/home/%d/%u > > and keep the home-relative paths for Sieve: ~/... > > > On Wed, May 21, 2014 at 12:10 PM, Steffen Kaiser < >> skdovecot(a)smail.inf.fh-brs.de> wrote: >> >> -----BEGIN PGP SIGNED MESSAGE----- >>> Hash: SHA1 >>> >>> On Wed, 21 May 2014, Selcuk Yazar wrote: >>> >>> my dovecot conf is >>> >>>> >>>> doveconf -n >>>> # 2.0.9: /etc/dovecot/dovecot.conf >>>> >>>> [...] >>> >>> mail_location = mbox:/home/vmail/domains/%d/%u >>>> >>>> [...] >>> >>> userdb { >>>> args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext >>>> driver = ldap >>>> } >>>> >>>> you're right we have mail_location , >>>> >>>> should i add mail_home value >>>> >>>> >>> That depends on if your LDAP configuration contains a (for the mailserver >>> usable) home for the individual user. >>> >>> mail_home = /home/vmail/domains/%d/%u >>> >>>> >>>> >>> The value shows that you did not followed my advice from the last >>> response: "Read the link above about why not store Sieve files below an >>> user's mail location." maybe because you missed it because you toppost. >>> >>> to 10-mail.conf file ? >>> >>>> >>>> >>> never use the same dir for mail location and user's home. >>> >>> >>> On Wed, May 21, 2014 at 11:43 AM, Steffen Kaiser < >>> >>>> skdovecot(a)smail.inf.fh-brs.de> wrote: >>>> >>>> -----BEGIN PGP SIGNED MESSAGE----- >>>> >>>>> >>>>> >>>> On Wed, 21 May 2014, Selcuk Yazar wrote: >>> >>>> >>>>> our users stored OpenLdap and users home folder like below: >>>>> >>>>> >>>>>> >>>>>> without seeing your current doveconf -n output and the ldap >>>>> configuration >>>>> file, I would guess that your users have no home directory: >>>>> http://wiki2.dovecot.org/VirtualUsers/Home >>>>> >>>>> >>>>> >>>>> /home/vmail/domains/domainname.edu.tr/username/... >>>>> >>>>>> >>>>>> now when i used default settings for dovecot sieve >>>>>> >>>>>> sieve = ~/.dovecot.sieve >>>>>> sieve_dir = ~/sieve >>>>>> >>>>>> sieve script write and work globaly and stored, >>>>>> /home/vmail/domains/sieve >>>>>> >>>>>> i looked up Dovecot docs for per user but i don't understand clearly >>>>>> >>>>>> can i replace sieve parameters like >>>>>> >>>>>> sieve = /home/vmail/domains/..................edu.tr/%n/.dovecot. >>>>>> sieve >>>>>> sieve_dir = /home/vmail/domains/.........................edu.tr/%n/. >>>>>> sieve >>>>>> >>>>>> for per user scirpt. >>>>>> >>>>>> >>>>>> Read the link above about why not store Sieve files below an user's >>>>> mail >>>>> location. >>>>> >>>>> >>>> - -- Steffen Kaiser >>> -----BEGIN PGP SIGNATURE----- >>> Version: GnuPG v1.4.11 (GNU/Linux) >>> >>> iQEVAwUBU3xtn3z1H7kL/d9rAQIu1wf/XMXuEC1O1PQssoU1uHfTM5jOHpH1KHis >>> yUL1z2/WV8c7engx+CNtGPxnRewC1UFKBZcHaAyXHNxQM+jsYf+NkUo4PDlKkzfi >>> /JIn+SGOlwZKJUYarnAJbt0CdZG7f8auvMLsoovR8iNitSAdyH5AkRt9i25YFndW >>> Nm0lYO1CPJzKp3CVhDS0Lxs6sSD21xsMvuauzMmS4ZpYhXXEdOf4jqNkIYdJbSHz >>> nBHx8sjlJaKNKO3OWs1S5T7DxlRz+VYGw1IZ1BUgpBBD3LxDIOwTLG7NNjWRG2lB >>> nTB+WK02fvh0T+oJORVuKmgoXG5WKvZjFOa4oVqdbbzM6V4ZJSx9Sw== >>> =bLQp >>> -----END PGP SIGNATURE----- >>> >>> >> >> >> >> > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBU3yY9Hz1H7kL/d9rAQIIpwf/bfNNbI3zCEuJs3xYq5Nl+Td2QGX0uUzk > 8PA4taMNrq00W3jBtTi8J4/ZlqT+l15r5nDr6O/VSgffymi9l0JmRMRIfUyzfjBy > IThSQTrbjx9t+gCJa15Q2JISYEhXC0WYDpseEZle5vFyIKxWT01FYH5cJe45n9ci > LcY3QmCdrQ4JYuYPiECfOx5rFw7dvZBnS4YDLg/A/O3dUzx7BV6V+cSepAecpoom > 4U5udqoWRF1pDgKywn0elB0WorEbgnyOHLSrd5uPOuQuP9aW2bcWJGSpr1/j5tQk > tOYd/czhNhpPEKbzH/MJyn6mbhu4F3DGMAfuD9tweIAD25A41HgVpQ== > =6w4r > -----END PGP SIGNATURE----- > -- Selçuk YAZAR http://www.selcukyazar.blogspot.com

1 0

Re: [Dovecot] Per-user Sieve script location question
by Selcuk Yazar 21 May '14

21 May '14

Hi, Steffen i changed my 90-sieve.conf to sieve = /var/sieve-scripts/%u.sieve sieve_dir = /home/vmail/domains/sieve/%n/.sieve and it works. thank you. On Wed, May 21, 2014 at 12:10 PM, Steffen Kaiser < skdovecot(a)smail.inf.fh-brs.de> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Wed, 21 May 2014, Selcuk Yazar wrote: > > my dovecot conf is >> >> doveconf -n >> # 2.0.9: /etc/dovecot/dovecot.conf >> > [...] > >> mail_location = mbox:/home/vmail/domains/%d/%u >> > [...] > >> userdb { >> args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext >> driver = ldap >> } >> >> you're right we have mail_location , >> >> should i add mail_home value >> > > That depends on if your LDAP configuration contains a (for the mailserver > usable) home for the individual user. > > mail_home = /home/vmail/domains/%d/%u >> > > The value shows that you did not followed my advice from the last > response: "Read the link above about why not store Sieve files below an > user's mail location." maybe because you missed it because you toppost. > > to 10-mail.conf file ? >> > > never use the same dir for mail location and user's home. > > > On Wed, May 21, 2014 at 11:43 AM, Steffen Kaiser < >> skdovecot(a)smail.inf.fh-brs.de> wrote: >> >> -----BEGIN PGP SIGNED MESSAGE----- >>> >> > On Wed, 21 May 2014, Selcuk Yazar wrote: >>> >>> our users stored OpenLdap and users home folder like below: >>> >>>> >>>> >>> without seeing your current doveconf -n output and the ldap configuration >>> file, I would guess that your users have no home directory: >>> http://wiki2.dovecot.org/VirtualUsers/Home >>> >>> >>> >>> /home/vmail/domains/domainname.edu.tr/username/... >>>> >>>> now when i used default settings for dovecot sieve >>>> >>>> sieve = ~/.dovecot.sieve >>>> sieve_dir = ~/sieve >>>> >>>> sieve script write and work globaly and stored, >>>> /home/vmail/domains/sieve >>>> >>>> i looked up Dovecot docs for per user but i don't understand clearly >>>> >>>> can i replace sieve parameters like >>>> >>>> sieve = /home/vmail/domains/..................edu.tr/%n/.dovecot.sieve >>>> sieve_dir = /home/vmail/domains/.........................edu.tr/%n/. >>>> sieve >>>> >>>> for per user scirpt. >>>> >>>> >>> Read the link above about why not store Sieve files below an user's mail >>> location. >>> >> > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBU3xtn3z1H7kL/d9rAQIu1wf/XMXuEC1O1PQssoU1uHfTM5jOHpH1KHis > yUL1z2/WV8c7engx+CNtGPxnRewC1UFKBZcHaAyXHNxQM+jsYf+NkUo4PDlKkzfi > /JIn+SGOlwZKJUYarnAJbt0CdZG7f8auvMLsoovR8iNitSAdyH5AkRt9i25YFndW > Nm0lYO1CPJzKp3CVhDS0Lxs6sSD21xsMvuauzMmS4ZpYhXXEdOf4jqNkIYdJbSHz > nBHx8sjlJaKNKO3OWs1S5T7DxlRz+VYGw1IZ1BUgpBBD3LxDIOwTLG7NNjWRG2lB > nTB+WK02fvh0T+oJORVuKmgoXG5WKvZjFOa4oVqdbbzM6V4ZJSx9Sw== > =bLQp > -----END PGP SIGNATURE----- > -- Selçuk YAZAR http://www.selcukyazar.blogspot.com

2 1

[Dovecot] dovecot auth ldap attributes - unused?
by Maciej Uhlig 21 May '14

21 May '14

Please explain the following dovecot (2.2.13) behaviour: I run dovecot in ldap auth debug mode and log file excerpt follows: 2014-05-21T08:22:01+02:00 dovecot/ip dovecot: auth: Debug: ldap(user@domain,pcip,<bdKvA+P5HQCbnmFI>): bind search: base=o=tree,dc=do,dc=ma,dc=in filter=(&(objectClass=MailAccount)(accountActive=TRUE)(mail=user@domain)) 2014-05-21T08:22:01+02:00 dovecot/ip dovecot: auth: Debug: ldap(user@domain,pcip,<bdKvA+P5HQCbnmFI>): result: mail=user@domain; mail unused 2014-05-21T08:22:01+02:00 dovecot/ip dovecot: auth: Debug: ldap(user@domain,pcip,<bdKvA+P5HQCbnmFI>): result: mail=user@domain 2014-05-21T08:22:01+02:00 dovecot/ip dovecot: auth: Debug: client passdb out: OK 24 user=user@domain 2014-05-21T08:22:01+02:00 dovecot/ip dovecot: auth: Debug: ldap(user@domain,pcip,<bdKvA+P5HQCbnmFI>): user search: base=o=tree,dc=do,dc=ma,dc=in scope=subtree filter=(&(objectClass=MailAccount)(accountActive=TRUE)(mail=user@domain)) fields=mail,quota,mailbox 2014-05-21T08:22:01+02:00 dovecot/ip dovecot: auth: Debug: ldap(user@domain,pcip,<bdKvA+P5HQCbnmFI>): result: mailbox=maildir:/mail/domain/user/mail/ quota=1G mail=user@domain; mail,mailbox,quota unused 2014-05-21T08:22:01+02:00 dovecot/ip dovecot: auth: Debug: ldap(user@domain,pcip,<bdKvA+P5HQCbnmFI>): result: mailbox=maildir:/mail/domain/user/mail/ quota=1G mail=user@domain 2014-05-21T08:22:01+02:00 dovecot/ip dovecot: auth: Debug: master userdb out: USER 3606315009 user@domain quota_rule=*:bytes=1G mail=maildir:/mail/domain/user/mail/ home=/mail/domain/user Question: why are there two ldap result log lines while the first line shows unused attributes and the second doesn't. Does the first occurence show some code being excessive somehow? Thanks. MU

2 1

[Dovecot] allow_nets + default + ldap
by Andreas Schulze 21 May '14

21 May '14

Hello, I'm playing with allow_nets function. It is really cool! In a filebased passwd backend you simply add "allow_nets=192.0.2.143/32" as mentioned in http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/AllowNets But if I use an LDAP backend it looks different. Following http://wiki2.dovecot.org/AuthDatabase/LDAP/AuthBinds and http://wiki2.dovecot.org/AuthDatabase/LDAP/Userdb#Attribute_templates_.28v2… my pass_attrs looks this: pass_attrs = =user=%{ldap:uid}, \ =allow_nets=%{ldap:allownets} Using this syntax I could add an attribute "allownets" in the ldapserver to limit access for a user. A problem occour if the attribute is not present. For example if a user should not be limited or only some but not any user should be limited. So I extend my pass_attrs with a default. pass_attrs = =user=%{ldap:uid}, \ =allow_nets=%{ldap:allownets:10.0.0.0/8} Again, that's fine. Any user was allowed to connect from my private network. But then some users connect via ipv6. I tried to extend my default to pass_attrs = =user=%{ldap:uid}, \ =allow_nets=%{ldap:allownets:10.0.0.0/8,fec0::/16} That syntax, a comma separated list, produces errors no matter if quoting using " or ' or no quoting at all. So I looked at the source (thanks, it's open!) and wrote a little patch to allow simple defaults: - ALL -> allow any address - NONE -> deny any address Now I could write pass_attrs = =user=%{ldap:uid}, =allow_nets=%{ldap:allownets:ALL} or pass_attrs = =user=%{ldap:uid}, =allow_nets=%{ldap:allownets:NONE} to allow or deny any ldap account not having an attribute allownets. Maybe there are other solutions, but that's my way... Andreas

2 3

Re: [Dovecot] Per-user Sieve script location question
by Selcuk Yazar 21 May '14

21 May '14

Hi my dovecot conf is doveconf -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-131.6.1.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.0 (Santiago) ext4 auth_debug = yes auth_debug_passwords = yes auth_default_realm = hostname.domainname.edu.tr auth_mechanisms = plain login auth_verbose = yes debug_log_path = /var/log/dovecot.debug disable_plaintext_auth = no first_valid_uid = 97 info_log_path = /var/log/dovecot.info last_valid_uid = 5000 mail_debug = yes mail_gid = 1001 mail_location = mbox:/home/vmail/domains/%d/%u mail_uid = 1001 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl passdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { mode = 0600 user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl = no ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } protocol lda { debug_log_path = /var/log/dovecot-lda-errors.log info_log_path = /var/log/dovecot-lda.log log_path = /var/log/dovecot-lda-errors.log mail_plugins = " sieve" } you're right we have mail_location , should i add mail_home value mail_home = /home/vmail/domains/%d/%u to 10-mail.conf file ? thanks. On Wed, May 21, 2014 at 11:43 AM, Steffen Kaiser < skdovecot(a)smail.inf.fh-brs.de> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > > On Wed, 21 May 2014, Selcuk Yazar wrote: > > our users stored OpenLdap and users home folder like below: >> > > without seeing your current doveconf -n output and the ldap configuration > file, I would guess that your users have no home directory: > http://wiki2.dovecot.org/VirtualUsers/Home > > > >> /home/vmail/domains/domainname.edu.tr/username/... >> >> now when i used default settings for dovecot sieve >> >> sieve = ~/.dovecot.sieve >> sieve_dir = ~/sieve >> >> sieve script write and work globaly and stored, /home/vmail/domains/sieve >> >> i looked up Dovecot docs for per user but i don't understand clearly >> >> can i replace sieve parameters like >> >> sieve = /home/vmail/domains/..................edu.tr/%n/.dovecot.sieve >> sieve_dir = /home/vmail/domains/.........................edu.tr/%n/.sieve >> >> for per user scirpt. >> > > Read the link above about why not store Sieve files below an user's mail > location. > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBU3xnMHz1H7kL/d9rAQIiRAgAmZYxZo1fn/5Iw0WHB2v3FpF1snq1VH4t > tvyhS/ISj3snMB7dbViUkjvYhzaIsWQKP9eXM3YtOmwpSdlwozqwq/5PvckQgAkU > cI8UIyXCErsdsvp7/aod/n+Qd+tnjf91b3PY9R7xYd6Qjf/8H7lSmX/xBMBltu7N > AVqwgHTivR9dwsDyTkIqQIfULWvwcWf5eXbKzP1YxamYzF+lMk6ippK7RebMrspe > CTg1BLCCLiHMTdSQrOrnfmNjgS/rAZctOEyc3/M98U8HxmEhT6ZFpTjQ4i0T0/17 > +9DQovMUi2/bZ1IhgBpS9u+YkPeuu+y4vAhMqCAT+fcEW1+MgfK2Lg== > =Sc/m > -----END PGP SIGNATURE----- > -- Selçuk YAZAR http://www.selcukyazar.blogspot.com

2 1