- dovecot - dovecot.org

Re: Outlook 2013/2010 nightmare #3
by David.M.Clark 10 Mar '15

10 Mar '15

Hi All, Sorry for the extra e-mail. Given I am helping roll out this identical setup again I am thinking I will test another approach which I am hoping will work but given having two or more PCs trying to access the 'mail' folder crashed at this site on the weekend, I went away from this. But in my thinking perhaps it 'might' work if same login ID is not used to access the exact same area. Example: 1. Setup user "accounts" and open the permissions of its folders. (${HOME} = /u/home/accounts) 2. Create "accounts2" but have its ${HOME} directory set to the same as "accounts". (${HOME} = /u/home/accounts) Make sure accounts2 can fully access everything - perhaps I will need to enforce a central GID (group ID) for each user to belong to (eg., accounts). 3. See if the same crash issue happens if using a different login name. This is using the reverse approach of not having separate Root Folder paths for the same Linux login ID. If this does work I can then reverse engineer the issue at the site over the weekend as well. Will keep you posted. -- As always, I remain at your service. Kindest Regards, David.M.Clark

1 0

Re: Outlook 2013/2010 nightmare #2
by David.M.Clark 10 Mar '15

10 Mar '15

Hi All and my sincere thanks to Jakob and Joseph for your responses. I got around the nightmare for this site but it is far from satisfactory and given both Thunderbird, Roundcube and the Android e-mail client work perfectly as expected, this following links comments enforce what I experienced over the weekend: http://comments.gmane.org/gmane.mail.imap.dovecot/79231 I have not struck this for other sites using Outlook 2013 (though I continually banter that Outlook version 'anything' is designed for MS Exchange and nothing else), but then again I have not had Outlook needing to share the same e-mail accounts across PCs. So the bottom line for this particular site is: Set the "Root Folder" for IMAP in outlook to "mail". This is messy from my beloved Linux command line perspective in that you end up with ${HOME}/login_name/mail/mail. But it does work and stops the Outlook crashes. If you set it to the Outlook recommended "INBOX" or "Inbox", you can't see or access subfolders. Now here comes the ugly part of Outlook 2013 using IMAP to Linux (at least for this site): If you want to share a single e-mail account across multiple PCs running Outlook 2013, you _cannot_ use the "Root Folder" of "mail" as I have indicated above. The workaround is to create each subsequent PC with a "mail2", "mail3" etc folder (without the quote marks of course). If you set up two PCs with the same Root Folder, the new PC crashes out of Outlook and eventually so does the original PC. The only way around this is to delete the identity and PST files in Outlook and strictly set them up again to different "mail" something folders. Almost reminds me of the old MS "Share Violation" issue :-) So after the user is set to the mail2/mail3 folder and it appears under the user's original "mail" folder, you then have to blow away the mail2/mail3 folder and then do a symbolic link to the mail folder: ln -s mail mail2 In this way, both users on the PCs will be seeing the same IMAP folders, being mail and mail2 on two different PCs. Naturally to add a third PC to this would be "mail3" etc. Now the other ugly part of this is you also need to update their .subscriptions file in ${HOME}/login_name/mail to show folders like: mail/Sent Items mail/Junk E-mails mail2/Sent Items mail2/Junk E-mails Given you would need to manually do this above, and is just not suitable, I have written two scripts to automate this process and it works cleanly so far. The first script does the automatic removal of the mail2/mail3 etc directory and creates the symbolic link, the second script is used to redo the .subscriptions file if the contents of the 'mail' directory change. You may need to mod these but I have a cron running as root to do this. Script 1 (mail_root_enforce): =----------------------------------------------------------------------------------= COMPLETE_HOME=/u/home cd ${COMPLETE_HOME} for USERHOME in * do ls -d ${USERHOME}/mail/mail? | while read CHECKME do JUST_CHECKME=`basename ${CHECKME}` if [ -d ${CHECKME} -a -L ${CHECKME} ] then #echo "${CHECKME} is ok" : else echo "${CHECKME} is _not_ ok" cd ${USERHOME}/mail rm -rf ${COMPLETE_HOME}/${CHECKME} ln -s mail ${JUST_CHECKME} fi done cd ${COMPLETE_HOME} done =----------------------------------------------------------------------------------= Script 2 (mail_multi_users): =----------------------------------------------------------------------------------= cd /u/home for THIS_USER in * do MORE_THAN_1=`ls -d ${THIS_USER}/mail/mail* | wc -l` if [ "${MORE_THAN_1}" -gt "1" ] then # echo "${THIS_USER} has more than one" ls ${THIS_USER}/mail/mail >${THIS_USER}/subcount if [ ! -f ${THIS_USER}/subcount_last ] then >${THIS_USER}/subcount_last fi ISDIFF=`diff ${THIS_USER}/subcount ${THIS_USER}/subcount_last | wc -l | awk '{print $1}'` if [ "${ISDIFF}" -gt "0" ] then # echo "Is Different" ls ${THIS_USER}/mail/mail >${THIS_USER}/subscription_tmp >${THIS_USER}/subscription_new for ROOT_MAIL_DIR in ${THIS_USER}/mail/mail* do MAIL_BASE_NAME=`basename ${ROOT_MAIL_DIR}` cat ${THIS_USER}/subscription_tmp | sed "s:^:$MAIL_BASE_NAME/:g" >>${THIS_USER}/subscription_new done cp ${THIS_USER}/subscription_new ${THIS_USER}/mail/.subscriptions chown ${THIS_USER}:popusers ${THIS_USER}/mail/.subscriptions cp ${THIS_USER}/subcount ${THIS_USER}/subcount_last fi fi done =----------------------------------------------------------------------------------= You will note the ${HOME} directories are all under /u/home so if you do sadly need to use these scripts, please change the /u/home to suite the ${HOME} location set on your server. I prefer to run this as root to enforce things and not have any funny permission errors, and also to save needing to run multiple instances for multiples users. One annoying caveat that the site will have to get used to: the mail2, mail3 folders do show up when using good e-mail clients like Thunderbird, SOGo, Roundcube or Android e-mail client. This is because they are seeing the contents of the .subscriptions file. I haven't looked into Dovecot doco for possible multiple .subscription files to make the folders bit look 'nicer'. I will look at something like 'namespace' to see if this might help. Please bear in mind this was in an emergency to get things at least 'working' so the users were happy when they hit the office on Monday. A documented story for your perusal and use if you are 'stuck' like I was. I will continue to try and see if there is a more elegant work-around but for now, this is all I can come up with. PS: I notice everyone suppresses their e-mail footer so doing the same here :-) -- As always, I remain at your service. Kindest Regards, David.M.Clark

1 0

Outlook 2013/2010 nightmare
by David.M.Clark 09 Mar '15

09 Mar '15

Hi All, This is my first post so forgive me if this hits the wrong list. I have been using dovecot for years happily with SendMail on mainly CentOS servers, and my customers are starting to more and more use Thunderbird, so my perfect model is: Linux --> Dovecot --> SendMail --> Thunderbird (or mobile phone e-mail app). I do have some customers using Outlook or Windows Live Mail, and these are for the most part working fine with IMAP - I don't do POP. My mod to the dovecot.conf file: disable_plaintext_auth=no My mod to conf.d/10-mail.conf: #mail_location = mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u My mod to conf.d/10-master.conf: #default_internal_user = dovecot service imap-login { inet_listener imap { port = 143 } inet_listener imap_second { port = 10143 } inet_listener imaps { #port = 993 #ssl = yes } - I do the 10143 bit so I can pseudo hide port 143 for clients with devices that access both internally and externally - port forwarded on MikroTik routers for my customers. All goes well for many years with the above configs, and continues to be awesome as always. Under the user's ${HOME} directory they end up with a lovely 'mail' directory and all of the e-mail client folders live in harmony under there. This weekend I am helping a customer cut over his customer from legacy POP based e-mail uses with splatterings of Outlook 2010 and 2013 throughout the company, to using Linux with IMAP in the setup as described above as per my standard configs. The issue starts when you add an IMAP user to the Outlook client and upon opening it, initially, it tries to find a "Sent" Items folder under IMAP to send from. To this end I have traditionally gone into the dialogue box that opens, click on the IMAP account to receive a list of possible folders, but it now immediately crashes indicating Outlook has had an error, and it all goes to hell from there. Outlook then cannot open but keeps crashing with its "unknown error". Up to last week at another site with Windows Live Mail, this was not an issue. By modifying the e-mail account via Control Panel, I can delete or modify the account and try again. Here is what I found: If I don't specify a 'root' folder under the "Advanced" tab which also contains the port selections for 143 and 25, it fails. If I follow the MS recommended root folder example from Microsoft and use INBOX, or Inbox, it 'does' stop the error but you can't create subfolders - I am assuming as this is picking up the .imap/INBOX folder or something and makes sense that it can't create folders under INBOX/Inbox, particularly if this is a file rather than a directory that dovecot/Outlook are pointing to. What I have found is I can 'lie' to Outlook and put in a 'mail' folder. This results in a ${HOME}/login_name/mail/mail folder, but I don't care, as it happily puts files under mail/mail. Now here is something totally strange: If I try to put this same account on another PC so users can 'share' the same e-mail account, even with my 'mail' root folder work-around, it crashes again. All through this, Thuderbird works fine and so does RoundCube - SOGo will be up and working a bit later once I get the initial part up and going... but I digress but good to know it is only Outlook doing this. To share multiple accounts I am currently getting the subsequent PCs that need to share a universal account to select a root folder mail2, mail3 etc. I then delete these folders and symbolic link the mail2, mail3 etc to the mail directory - yucky fix, but kind of works with some auto scripting of .subscriptions to follow so all of the Outlook clients sync to the one 'real' root folder. I have never seen this before and have customers running all kinds of IMAP e-mail clients to dovecot on Linux. I saw an MS posted bug on something for IMAP and they recommend rolling back MS updates to fix it - but I am not sure the client can or will do that. This kind of random issue that only affects this site at present is why I only recommend people use e-mail clients like Thunderbird because it just 'works'. The users at this site would not switch and will cite they have been working in a POP situation on their other Linux box since Adam was a boy. Any help would be very much appreciated. I like to think I can do this with my eyes shut by now, but this one has got me stumped. -- As always, I remain at your service. Kindest Regards, David.M.Clark (Director - Senior Linux/UNIX Consultant) =----------------------------------------------------------------------= Davrom Consulting Pty Ltd E-mail : david(a)davrom.com PO Box 1644, Sunnybank Hills, 4109 Twitter: @DavidClark1961 ABN: 81 096 990 804 MSN: david(a)davrom.com Phone/Fax: 61-7-32720267 Skype: dmc1961 Mobile: 0418-763124 Google: dmc1961(a)gmail.com Podcast: http://www.davrom.com/ldup/ldup_rss.xml =---------------------- http://www.davrom.com -------------------------= Specialising in: Linux (Fedora/RedHat/CentOS), UNIX, SCO, MikroTik, Networking/Internet, E-mail/Web Technologies =----------------------------------------------------------------------= Please note: Any e-mail communication bearing this signature is for the exclusive purpose of the sender and is not for publication without the expressed permission of the sender or respective sender's organisation. =----------------------------------------------------------------------=

2 1

Expunge messages older than
by absolutely_free＠libero.it 09 Mar '15

09 Mar '15

Hi, I am using Dovecot 2.2.13 on cPanel server. Is there a way to delete messages older than some date for a number of users (in every subfolder)? Thank you

3 2

Re: Outlook 2013/2010 nightmare
by Joseph Tam 09 Mar '15

09 Mar '15

"David.M.Clark" <david(a)davrom.com> writes: > I do have some customers using Outlook or Windows Live Mail, and these > are for the most part working fine with IMAP - I don't do POP. > ... > The issue starts when you add an IMAP user to the Outlook client and > upon opening it, initially, it tries to find a "Sent" Items folder under > IMAP to send from. To this end I have traditionally gone into the > dialogue box that opens, click on the IMAP account to receive a list of > possible folders, but it now immediately crashes indicating Outlook has > had an error, and it all goes to hell from there. Outlook then cannot > open but keeps crashing with its "unknown error". > Up to last week at another site with Windows Live Mail, this was not an > issue. Just a shot in the dark, but have you enabled the workarounds? http://wiki2.dovecot.org/Clients Some clients like, like Outlook, have known problems which dovecot can dance around. in 20-imap.conf # Workarounds for various client bugs: # delay-newmail: # Send EXISTS/RECENT new mail notifications only when replying to NOOP # and CHECK commands. Some clients ignore them otherwise, for example OSX # Mail (<v2.1). Outlook Express breaks more badly though, without this it # may show user "Message no longer in server" errors. Note that OE6 still # breaks even with this workaround if synchronization is set to # "Headers Only". # tb-extra-mailbox-sep: # Thunderbird gets somehow confused with LAYOUT=fs (mbox and dbox) and # adds extra '/' suffixes to mailbox names. This option causes Dovecot to # ignore the extra '/' instead of treating it as invalid mailbox name. # tb-lsub-flags: # Show \Noselect flags for LSUB replies with LAYOUT=fs (e.g. mbox). # This makes Thunderbird realize they aren't selectable and show them # greyed out, instead of only later giving "not selectable" popup error. # # The list is space-separated. imap_client_workarounds = delay-newmail Joseph Tam <jtam.home(a)gmail.com>

1 0

dovecot auth-worker error happens when I enabled the dovecot to consider both the system account and the MySQL virtual mailbox databases.
by Emmanuel Chanel 08 Mar '15

08 Mar '15

Version: 2.2.9 & 2.2.15 ( http://ppa.launchpad.net/malte.swart/dovecot-2.2/ubuntu ) OS: Ubuntu 14.04 Server LTS I installed Ubuntu 14.04.2 LTS newly on my new server... And I try to configure the mail server considering both my system account and the virtual mailboxes, by seeing https://www.exratione.com/2014/05/a-mailserver-on-ubuntu-1404-postfix-dovec… But when I configured by uncommenting #!include auth-sql.conf.ext , it doesn't auth... Possibly, it's a trouble with the configurations of postfix and of dovecot. But I don't understand why... When I enable either auth-system.conf.ext or auth-sql.conf.ext , it works... My doveconf -n http://pastebin.com/MU1LL63d dovecot-sql.conf.ext http://pastebin.com/PJkTnPB3 tail /var/log/mail.log by debug mode / dovecot 2.2.15 http://pastebin.com/1TRQL49d Mar 6 07:45:12 gateway dovecot: auth: Debug: client in: AUTH#0114#011PLAIN#011service=imap#011secured#011session=xS6uSpIQvQDAqAAC#011lip=192.168.0.1#011rip=192.168.0.2#011lport=143#011rport=38333 Mar 6 07:45:12 gateway dovecot: auth: Debug: client passdb out: CONT#0114#011 Mar 6 07:45:12 gateway dovecot: auth: Debug: client in: CONT<hidden> Mar 6 07:45:12 gateway dovecot: auth-worker(22933): Debug: pam(emmanuel,192.168.0.2): lookup service=dovecot Mar 6 07:45:12 gateway dovecot: auth: Error: auth worker: Aborted PASSV request for emmanuel: Worker process died unexpectedly Mar 6 07:45:12 gateway dovecot: auth-worker(22936): Debug: sql(emmanuel,192.168.0.2): query: SELECT username as user, password, '/home/vmail//emmanuel' as userdb_home, 'maildir:/home/vmail//emmanuel' as userdb_mail, 65000 as userdb_uid, 8 as userdb_gid FROM mailbox WHERE username = 'emmanuel' AND active = '1' Mar 6 07:45:12 gateway dovecot: auth-worker(22933): Fatal: master: service(auth-worker): child 22933 killed with signal 11 (core dumped) Mar 6 07:45:12 gateway dovecot: auth-worker(22936): sql(emmanuel,192.168.0.2): unknown user Mar 6 07:45:12 gateway dovecot: auth-worker(23755): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Mar 6 07:45:12 gateway dovecot: auth-worker(23755): Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Mar 6 07:45:14 gateway dovecot: auth: Debug: client passdb out: FAIL#0114#011user=emmanuel#011temp Mar 6 07:45:14 gateway dovecot: auth: Debug: client in: AUTH#0115#011LOGIN#011service=imap#011secured#011session=xS6uSpIQvQDAqAAC#011lip=192.168.0.1#011rip=192.168.0.2#011lport=143#011rport=38333 Mar 6 07:45:14 gateway dovecot: auth: Debug: client passdb out: CONT#0115#011VXNlcm5hbWU6 Mar 6 07:45:14 gateway dovecot: auth: Debug: client in: CONT<hidden> Mar 6 07:45:14 gateway dovecot: auth: Debug: client passdb out: CONT#0115#011UGFzc3dvcmQ6 Mar 6 07:45:14 gateway dovecot: auth: Debug: client in: CONT<hidden> Mar 6 07:45:14 gateway dovecot: auth-worker(22936): Debug: pam(emmanuel,192.168.0.2): lookup service=dovecot Mar 6 07:45:14 gateway dovecot: auth: Error: auth worker: Aborted PASSV request for emmanuel: Worker process died unexpectedly Mar 6 07:45:14 gateway dovecot: auth-worker(23755): Debug: sql(emmanuel,192.168.0.2): query: SELECT username as user, password, '/home/vmail//emmanuel' as userdb_home, 'maildir:/home/vmail//emmanuel' as userdb_mail, 65000 as userdb_uid, 8 as userdb_gid FROM mailbox WHERE username = 'emmanuel' AND active = '1' Mar 6 07:45:14 gateway dovecot: auth-worker(22936): Fatal: master: service(auth-worker): child 22936 killed with signal 11 (core dumped) Mar 6 07:45:14 gateway dovecot: auth-worker(23755): sql(emmanuel,192.168.0.2): unknown user Mar 6 07:45:14 gateway dovecot: auth-worker(23764): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Mar 6 07:45:14 gateway dovecot: auth-worker(23764): Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Mar 6 07:45:16 gateway dovecot: auth: Debug: client passdb out: FAIL#0115#011user=emmanuel#011temp Mar 6 07:45:16 gateway dovecot: auth: Debug: client in: AUTH#0116#011PLAIN#011service=imap#011secured#011session=xS6uSpIQvQDAqAAC#011lip=192.168.0.1#011rip=192.168.0.2#011lport=143#011rport=38333#011resp=<hidden> Mar 6 07:45:16 gateway dovecot: auth-worker(23755): Debug: pam(emmanuel,192.168.0.2): lookup service=dovecot Mar 6 07:45:16 gateway dovecot: auth: Error: auth worker: Aborted PASSV request for emmanuel: Worker process died unexpectedly Mar 6 07:45:16 gateway dovecot: auth-worker(23764): Debug: sql(emmanuel,192.168.0.2): query: SELECT username as user, password, '/home/vmail//emmanuel' as userdb_home, 'maildir:/home/vmail//emmanuel' as userdb_mail, 65000 as userdb_uid, 8 as userdb_gid FROM mailbox WHERE username = 'emmanuel' AND active = '1' Mar 6 07:45:16 gateway dovecot: auth-worker(23755): Fatal: master: service(auth-worker): child 23755 killed with signal 11 (core dumped) Mar 6 07:45:16 gateway dovecot: auth-worker(23764): sql(emmanuel,192.168.0.2): unknown user Mar 6 07:45:16 gateway dovecot: auth-worker(23767): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Mar 6 07:45:16 gateway dovecot: auth-worker(23767): Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Mar 6 07:45:18 gateway dovecot: auth: Debug: client passdb out: FAIL#0116#011user=emmanuel#011temp -- Emmanuel Chanel( emmanuelchanel(a)gmail.com )

1 3

Sieve can't find Extprograms or Extdata
by E.B. 08 Mar '15

08 Mar '15

Hi, On a new install-from-source with Dovecot 2.2.16rc1, Piegeonhole 0.4.6 and a grab of the newest Extdata code, I confirmed basic Sieve functionality is working (made a simple sieve script with a test on message subject resulting in a fileinto action). But I cannot get Sieve to see Extdata or Extprograms. sievec reports "Warning: sieve: ignored unknown extension 'vnd.dovecot.filter' while configuring available extensions" and the same for vnd.dovecot.extdata. And of course for the user script, "error: require command: unknown Sieve capability `vnd.dovecot.filter'" (same with extdata) I'm pretty sure this is a library path problem, but I've tried symlinking and restarting dovecot with as many iterations of library paths as I can think of but still same problem. The lib90_sieve_extdata_plugin.so and lib90_sieve_extprograms_plugin.so are in /usr/local/lib/dovecot/sieve and all the rest of the normal dovecot libraries are one level above in /usr/local/lib/dovecot. I tried creating symlinks for a "modules" directory and a "modules/sieve" directory, I tried symlinking these two librarie files themselves into the top level dovecot library directory, and a few other ideas, but no luck. Is there a way I can tell where Sieve expects its libraries to reside? To see where it is looking? I didn't provide any arguments to the configure command for pigeonhole as well as extdata and it seems like the libs got placed somewhere sensible, but I don't know what else to do.

2 3

[PATCH] Fix dovecot 1.2 build with LibreSSL
by Bernard Spil 07 Mar '15

07 Mar '15

Hi All, mail/dovecot build fails when linked against LibreSSL. This is due to LibreSSL no longer including comp.h from ssl.h/ssl3.h. See https://wiki.freebsd.org/LibreSSL as well. This patch fixes the build failure. Build log attached as well (not any more, too large! Get it via link just above). Please commit this fix to the 1.2 branch (2.1 branch is not affected) Kind regards, Bernard Spil.

1 0

Identify mail for attachment hash
by Daniel Miller 06 Mar '15

06 Mar '15

How can I find the message associated with a given attachment hash? For example, if I know that: /ff/23/ff23873c712474ad0f48cbd81485eaeaba3d8468-e1b4513a2eb8eb53b16400009db5accb is missing, I want to find the message associated with it so I can determine if it's critical and I need to recover it from another source, or if I can simply delete the old message. -- Daniel

1 0

Sieve editheader should support adding Received and Auto-Submitted headers
by Lee Maguire 06 Mar '15

06 Mar '15

In order to simplify auto-response suppression and other filtering, I want to synthesise an Auto-Submitted header on notification mails that should have them but do not. In a sieve file I add the following: if anyof ( header :contains ["From","Sender"] “info(a)example.com" ) { if header :contains "Subject" [" just joined "," just left "] { if not exists "Auto-Submitted" { addheader "Auto-Submitted" "auto-generated (via sieve)"; } } However this doesn’t work and results in the following error > main script: line 205: warning: addheader action: specified header field `Auto-Submitted' is protected; modification denied. (Workaround for this specific issue would probably be to use a List-* header instead.) Looking at http://hg.rename-it.nl/dovecot-2.2-pigeonhole/file/c8edece267cd/src/lib-sie… I can see that "Auto-Submitted” and “Received” are hardcoded to be blocked without reference to whether they are to be added or removed. However, the hard restriction in RFC 5293 on Auto-Submitted and Received only applies to the use of deleteheader and not addheader. https://tools.ietf.org/html/rfc5293#section-6 > As a matter of local policy, implementations MAY limit which header > fields may be deleted and which header fields may be added. However, > implementations MUST NOT permit attempts to delete "Received" and > "Auto-Submitted" header fields and MUST permit both addition and > deletion of the "Subject" header field. Using Dovecot version 2.1.7 but I assume it’s not version specific issue.

2 1