September 2015 - dovecot

Shortcomings of Maildir++ layout
by Hadmut Danisch 21 Nov '15

21 Nov '15

Hi, I am trying to deal with the problem, that under regular mbox format a path can lead to either a file or a directory, but not both, while under IMAP, a path is usually both, a message folder containing subfolders. I found dovecot's approach to this problem, the Maildir++ layout described under http://wiki2.dovecot.org/MboxChildFolders , and was astonished to see, what problems come with Maildir++ and how complicated dovecot tries to deal with them. I wonder why dovecot is not using a much easier approach and just uses a configurable prefix and/or suffix like .dir or ____ for directory names, e.g. INBOX -> ~/mail/inbox abc -> ~/mail/abc abc/def -> ~/mail/abc.dir/def or ~/mail/___abc___/def which would make all that trouble with .subscriptions and .index much more easier. In my eyes the Maildir++ layout is overcomplicated because of the heap of workarounds to the self-created problems. regards Hadmut

4 5

Re: My dovecot works fine against Active Directory 2003, but not against AD2008
by Mark Foley 29 Oct '15

29 Oct '15

Fran - thanks for your reply. I'm cc'ing you directly on this as well as posting to the list as I'm not sure how often you check the list and I'm down to hanging by my last fingernail on this project. I have some preliminary questions interspersed below. Thanks, --Mark -----Original Message----- > Subject: Re: My dovecot works fine against Active Directory 2003, but not > against AD2008 > To: dovecot(a)dovecot.org > From: Fran <cumc-4361-2(a)chguadalquivir.es> > Date: Thu, 10 Sep 2015 13:26:21 +0200 > > Hi Mark, > > when I say AD 2003/8 I mean Active Directory 2003/8. Hmmm, I've not heard of "Active Directory 2003" or 2008. The year numbers indicated to me you might be talking about Windows Small Business Server 2003 or 2008. Is your AD Server Windows? Linux? Something else? I'm using Samba4 AD/DC on Linux. > > My configuration is attached. Thank you very much for that. If I make some headway, I'll likely have more questions on specifics. > > I based my installation (dovecot+postfix) in the guides of this site: > http://www.linuxmail.info > > The LDAP part is this: > http://www.linuxmail.info/postfix-dovecot-ldap-centos-5/ If you were able to make sense out of these sites' tiny screen-shots and one-line descriptions my hat's off to you. "Your a better man that I am Gunga-Din!" If there was more detailed narrative somewhere I couldn't find it. Also, I don't have jXplorer on my system, so probably I couldn't get too far anyway. BIG QUESTIONS: 1. Are you using MS Outlook IMAP clients in your environment? If so, how are you making them connect with LDAP? By checking the SPA checkbox? 2. The mail_gid/mail_uid as vmail confuses me. I see that setting a lot, including in your config. http://wiki2.dovecot.org/VirtualUsers says, "You can create, for example, one vmail user which owns all the mails, or you can assign a separate UID for each user." I have assigned a separte UID for each based on the UID returned by `wbinfo -u <username>`. Does assigning separate UIDs mess up my ability to adapt your configuration? little questions: 3. I'm not planning on using quotas. Can I safely omit your mail_plugins = " quota" setting and all your plugin { quota_...} settings? I want to be as simple as possible to start. 4. Likewise, dovecot seems to be able to find users' mailboxes just fine. Can I omit the namespace inbox {} setting? These may seem like amaturish questions, but little details have foiled me a lot on this Dovecot project. If I feel confident with the answers you provide here, I'll move on to trying some things. Thanks a lot for your help!!! --Mark > > You can also use PAM to connect to AD > (http://www.linuxmail.info/active-directory-dovecot-pam-authentication/) > but that way doesn't allow to retrieve custom fields from the AD (ex. a > field to set quota per user), so I'm using the standard LDAP method. > > Regards > > El 10/09/2015 a las 4:51, Mark Foley escribió: > > Fran and/or Matthias, > > > > Could you publish your doveconf -n? I can't get dovecot to authenticate with my > > AD. Maybe you have a solution I could try. > > > > What mail client(s) are you using? I assume by "AD 2003/8" You mean SBS2003/8 > > and are therefore using Outlook? > > > > --Mark > > > > -----Original Message----- [deleted]

3 3

Maildir: ACLs/Unix perms and unable to see content of specific mailbox
by Olaf Marzocchi 10 Oct '15

10 Oct '15

Dear Dovecot users, hello. I will merge two issues I have into a single email because they may be related. I used dovecot on a OmniOS server since 2014 (currently OmniOS r151014) with the following configuration (it shows 2.2.18 because I recently updated dovecot, skipping only the PostgreSQL plugin): # 2.2.18: /etc/dovecot/dovecot.conf # OS: SunOS 5.11 i86pc zfs mail_location = maildir:/tank/home/%u/Maildir mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = imap ssl = required ssl_cert = </etc/dovecot/certs/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = passwd } You can see that I set the Maildir folder inside the shared home folders of my server (it is only one user, anyway). It always worked perfectly, but one-two months ago I changed the permissions of my whole home folder, recursively, to add proper ACLs. I needed them because the clients started using illumos kernel SMB (relying on ACLs) instead of Netatalk/AFP (relying on Unix perms only). I didn't realise I applied the ACLs also to the Maildir folder. Dovecot worked for several weeks fine, I noticed the issue only yesterday when a mailbox (see below) appeared in Thunderbird completely empty even if the "cur" subfolder on the server still contains all the mails. Dovecot was throwing some errors like: dovecot: [ID 583609 mail.error] imap(olaf): Error: rename(/tank/home/olaf/Maildir/.&A6k- Mailing Lists.Log/dovecot.index.cache) failed: Permission denied (euid=501(olaf) egid=501(olaf) UNIX perms appear ok (ACL/MAC wrong?)) dovecot: [ID 583609 mail.error] imap(olaf): Error: rename(/tank/home/olaf/Maildir/.&A6k- Mailing Lists.Log/dovecot.index.tmp, /tank/home/olaf/Maildir/.&A6k- Mailing Lists.Log/dovecot.index) failed: Permission denied dovecot: [ID 583609 mail.error] imap(olaf): Error: unlink(/tank/home/olaf/Maildir/subscriptions.lock) failed: Permission denied dovecot: [ID 583609 mail.error] imap(olaf): Error: rename(/tank/home/olaf/Maildir/subscriptions.lock, /tank/home/olaf/Maildir/subscriptions) failed: Permission denied I will post here the current permissions of the folder containing Maildir, of the Maildir itself, of its contents, and of the folder that appears empty when browsed with a client (Thunderbird). /tank/home/olaf $ ls -lV .. drwx------+ 16 olaf olaf 17 Sep 19 01:52 olaf user:olaf:rwxpdDaARWcCos:fd-----:allow group:2147483648:rwxpdDaARWcCos:fd-----:allow everyone@:rwxpdDaARWcCos:fd-----:deny /tank/home/olaf $ ls -lV drwxrwx--- 348 olaf olaf 359 Sep 19 01:51 Maildir owner@:rwxp--aARWcCos:-------:allow group@:rwxp--a-R-c--s:-------:allow everyone@:------a-R-c--s:-------:allow /tank/home/olaf $ ls -lV Maildir/ drwxrwx--- 2 olaf olaf 2 Jan 30 2014 cur owner@:rwxp--aARWcCos:-------:allow group@:rwxp--a-R-c--s:-------:allow everyone@:------a-R-c--s:-------:allow -rwxrwx--- 1 olaf olaf 21 Jan 30 2014 dovecot-keywords owner@:rwxp--aARWcCos:-------:allow group@:rwxp--a-R-c--s:-------:allow everyone@:------a-R-c--s:-------:allow (ALL THE SAME PERMISSIONS FOR THE OTHER FILES EXCEPT...) -rwxrwx--- 1 olaf olaf 13735 Jan 24 2015 subscriptions owner@:rwxp--aARWcCos:-------:allow group@:rwxp--a-R-c--s:-------:allow everyone@:------a-R-c--s:-------:allow -rw-rw---- 1 olaf olaf 13709 Sep 19 01:51 subscriptions.lock owner@:rw-p--aARWcCos:-------:allow group@:rw-p--a-R-c--s:-------:allow everyone@:------a-R-c--s:-------:allow The folder that appears empty: /tank/home/olaf $ ls -lV Maildir/.Generiche/ total 513 drwxrwx--- 2 olaf olaf 949 Sep 18 01:42 cur owner@:rwxp--aARWcCos:-------:allow group@:rwxp--a-R-c--s:-------:allow everyone@:------a-R-c--s:-------:allow -rwxrwx--- 1 olaf olaf 46 May 18 2014 dovecot-keywords owner@:rwxp--aARWcCos:-------:allow group@:rwxp--a-R-c--s:-------:allow everyone@:------a-R-c--s:-------:allow (ALL THE SAME PERMISSIONS FOR THE OTHER FILES) I really hope you will have the time to help me because I already applied the permissions recursively and I removed the ACLs, almost as it was before my mistake. I specified "almost" because originally (I checked the backups) the Maildir folder had an ACL that gave access permissions also to the group "mail": drwxrwx---+349 olaf olaf 359 Feb 16 2014 Maildir group:mail:rwxpdDaARWcCos:fd-----:allow owner@:rwxpdDaARWcCos:fd----I:allow group@:rwxpdDaARWcCos:fd----I:allow everyone@:rwxpdDaARWcCos:fd----I:deny Yesterday I haven't replicated it because from the documentation I understood it was not necessary. My questions, in short: - what are the permissions I need to give to the Maildir folder? I understood from the documentation it's 700, with my user/group (the one of the user accessing the mail). What about ACLs? and what about group "mail"? - the (only!) subfolder which appears empty in Thunderbird, may it depend on the permissions? maybe due to them the index was not updated and UIDs don't match. If after applying the correct permissions I still cannot see its contents, is there a way to recover the mails? the files are all still there. Sorry for the long email, but after several tries yesterday I exhausted my ideas. Regards, Olaf

2 4

Double Dots
by Ken Mandelberg 09 Oct '15

09 Oct '15

I've noticed lately that Dovecot seems to be inserting an extra dot in some url's contained in html email. The most consistent example I see is in the newsletters from the Washington Post. For example, if I look at the raw email on the mail server I see text that starts <http://link.washingtonpost.com/click But if I look at what Thunderbird shows it starts http://link..washingtonpost.com/click/ I don't think its Thunderbird adding the dot, since K9 mail on my Android phone shows the same issue. It's only after the IMAP delivery that the extra dot appears. We are running dovecot 2.0.12 Incidentally, the newsletter is full of these link.washington post url's. For each article it appears 3 times, once on title, once on a "read full article" link, and one on a picture. Its only the one on title, that gets the extra dot after its been through dovecot. Furthermore, it only happens from the second article on. Any ideas?

2 1

imap_logout_format improvements / ideas
by Timo Sirainen 03 Oct '15

03 Oct '15

http://hg.dovecot.org/dovecot-2.2/rev/93bba97afb2a http://hg.dovecot.org/dovecot-2.2/rev/e0a17714f0c9 So all in all, you can now add to imap_logout_format: # %i - total number of bytes read from client # %o - total number of bytes sent to client # %{fetch_hdr_count} - Number of mails with mail header data sent to client # %{fetch_hdr_bytes} - Number of bytes with mail header data sent to client # %{fetch_body_count} - Number of mails with mail body data sent to client # %{fetch_body_bytes} - Number of bytes with mail body data sent to client # %{deleted} - Number of mails where client added \Deleted flag # %{expunged} - Number of mails that client expunged # %{trashed} - Number of mails that client copied/moved to the # special_use=\Trash mailbox. Any thoughts on what else would be useful? I was also thinking about separating (deletes and) expunges from Trash vs non-Trash, but I'm not sure how useful that would be (and what would it be called?) It's also a bit annoying that a copy+expunge to a Trash will return expunged=1 trashed=1, but a move to Trash (via IMAP MOVE) will return expunged=0 trashed=1. But trying to fix that would be too much trouble.

4 4

[IMAP] Nothing in INBOX
by Yvon Thoraval 01 Oct '15

01 Oct '15

Hey all, I've just installed Postfix + Dovecot on Xubunto 14.04 LTS. Following this page : Setup a mail server with Postfix and Dovecot on Ubuntu / Debian <http://www.binarytides.com/install-postfix-dovecot-debian/> although I'm able to send emails to GMail and other kind of domain, nothing appears on Thunderbird INBOX, nor using openssl : ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- $ openssl s_client -connect imap.<DOMAIN>.<TLD>:993 CONNECTED(00000003) <snip /> Start Time: 1443543797 Timeout : 300 (sec) Verify return code: 18 (self signed certificate) --- * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot (Ubuntu) ready. A1 LOGIN <USER>@<DOMAIN>.<TLD> <PASSWORD 4 USER> A1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in A2 LIST "" "*" * LIST (\HasNoChildren) "." GMail * LIST (\HasNoChildren \Drafts) "." Drafts * LIST (\HasNoChildren) "." j-kiosk * LIST (\HasNoChildren \Trash) "." Trash * LIST (\HasNoChildren) "." Pourriel * LIST (\HasNoChildren) "." "Linux Mint" * LIST (\HasNoChildren) "." free * LIST (\HasNoChildren \Sent) "." Sent * LIST (\HasNoChildren) "." INBOX A2 OK List completed. A3 EXAMINE INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS ()] Read-only mailbox. * 0 EXISTS * 0 RECENT * OK [UIDVALIDITY 1443454274] UIDs valid * OK [UIDNEXT 1] Predicted next UID * OK [NOMODSEQ] No permanent modsequences A3 OK [READ-ONLY] Examine completed (0.000 secs). ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- However, using mail, i can read the emails : ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- $ mail Heirloom mailx version 12.5 6/20/10. Type ? for help. "/var/mail/desktop": 20 messages 9 new 18 unread U 1 Desktop User Sun Sep 27 13:01 19/621 ceci est le sujet <snip /> N 20 Yvon Thoraval Tue Sep 29 18:02 25/1042 another mail with Maildir... ? ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- my dovecot setup uses vhosts : ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- $ ls -al /var/mail/vhosts/<DOMAIN>/<USER>/ total 76K drwxr-sr-x 14 vmail vmail 4,0K sept. 29 18:01 ./ drwxr-sr-x 4 vmail vmail 4,0K sept. 27 10:31 ../ drwxr-sr-x 2 vmail vmail 4,0K sept. 28 17:31 cur/ -rw-r--r-- 1 vmail vmail 272 sept. 28 17:31 dovecot.index.log -rw-r--r-- 1 vmail vmail 168 sept. 29 16:16 dovecot.mailbox.log -rw-r--r-- 1 vmail vmail 51 sept. 28 17:31 dovecot-uidlist -rw-r--r-- 1 vmail vmail 8 sept. 29 16:17 dovecot-uidvalidity -r--r--r-- 1 vmail vmail 0 sept. 28 17:31 dovecot-uidvalidity.56095d49 drwxr-sr-x 5 vmail vmail 4,0K sept. 29 15:09 .Drafts/ drwxr-sr-x 5 vmail vmail 4,0K sept. 28 18:40 .free/ drwxr-sr-x 5 vmail vmail 4,0K sept. 28 18:41 .GMail/ drwxr-sr-x 5 vmail vmail 4,0K sept. 29 16:17 .j-kiosk/ drwxr-sr-x 5 vmail vmail 4,0K sept. 29 16:17 .Linux Mint/ drwxr-sr-x 2 vmail vmail 4,0K sept. 29 18:01 Maildir/ -rw-r--r-- 1 vmail vmail 0 sept. 28 17:31 maildirfolder drwxr-sr-x 2 vmail vmail 4,0K sept. 28 17:31 new/ drwxr-sr-x 5 vmail vmail 4,0K sept. 29 15:08 .Pourriel/ drwxr-sr-x 5 vmail vmail 4,0K sept. 29 16:17 .Sent/ -rw-r--r-- 1 vmail vmail 48 sept. 29 16:16 subscriptions drwxr-sr-x 2 vmail vmail 4,0K sept. 28 17:31 tmp/ drwxr-sr-x 5 vmail vmail 4,0K sept. 29 15:06 .Trash/ ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- with nothing in new subfolder: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- $ ls -al /var/mail/vhosts/<DOMAIN>/<USER>/new total 8,0K drwxr-sr-x 2 vmail vmail 4,0K sept. 28 17:31 ./ drwxr-sr-x 14 vmail vmail 4,0K sept. 29 18:01 ../ ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- my Postfix version : ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- $ postconf -d | grep mail_version mail_version = 2.11.0 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- my Dovecot version : ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- $ dovecot --version 2.2.9 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- my Dovecot conf : ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- $ sudo dovecot -n # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.14.32-xxxx-std-ipv6-64 x86_64 Ubuntu 14.04.3 LTS ext4 auth_mechanisms = plain login listen = * log_path = /var/log/dovecot.log mail_location = maildir:/var/mail/vhosts/%d/%n namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = scheme=PLAIN username_format=%u /etc/dovecot/dovecot-users driver = passwd-file } postmaster_address = desktop(a)j-kiosk.com protocols = " imap lmtp pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = passwd } userdb { args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n driver = static } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep } ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- my Postfix conf: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- $ postconf -n alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases append_dot_mydomain = no biff = no config_directory = /etc/postfix inet_interfaces = all inet_protocols = all mailbox_size_limit = 51200000 mydestination = $myhostname, $mydomain, localhost.$mydomain, localhost mydomain = <DOMAIN>.<TLD> myhostname = smtp.<DOMAIN>.<TLD> mynetworks = <DOMAIN IP>.0/24, 127.0.0.0/8 myorigin =<DOMAIN>.<TLD> readme_directory = no recipient_delimiter = relayhost = smtp_tls_session_cache_database = btree:${data_directory}/smtp_scache smtpd_banner = $myhostname ESMTP $mail_name (Ubuntu) smtpd_relay_restrictions = permit_mynetworks permit_sasl_authenticated defer_unauth_destination smtpd_sasl_auth_enable = yes smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot smtpd_tls_auth_only = yes smtpd_tls_cert_file = /etc/ssl/certs/ssl-cert-snakeoil.pem smtpd_tls_key_file = /etc/ssl/private/ssl-cert-snakeoil.key smtpd_tls_session_cache_database = btree:${data_directory}/smtpd_scache smtpd_use_tls = yes virtual_mailbox_domains = /etc/postfix/virtual_mailbox_domains virtual_transport = lmtp:unix:private/dovecot-lmtp ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------

3 3

Re: [IMAP] Nothing in INBOX
by Joseph Tam 30 Sep '15

30 Sep '15

Yvon Thoraval writes: > although I'm able to send emails to GMail and other kind of domain, nothing > appears on Thunderbird INBOX, nor using openssl : I haven't combed through your diagnostic, but two things junp out at me. Your "mail" output states > "/var/mail/desktop": 20 messages 9 new 18 unread indicating that the INBOX is held in /var/mail/desktop, whereas your dovecot configuration states > mail_location = maildir:/var/mail/vhosts/%d/%n So there seems to be a disagreement as to where the INBOX is located. Maybe you need to set the INBOX parameter directly. http://wiki2.dovecot.org/MailLocation Joseph Tam <jtam.home(a)gmail.com>

1 0

Re: Newbie why is dovecot classified diff then sendmail or courier
by David Niklas 30 Sep '15

30 Sep '15

Enlightenment succeeded! Thanks, David

1 0

userdb prefetch doesn't work with imapc (2.2.18)
by Nagy, Attila 30 Sep '15

30 Sep '15

Hi, I have the following config in dovecot 2.2.18: # doveconf -n userdb passdb userdb { driver = prefetch } passdb { args = host=127.0.0.1 port=1430 default_fields = userdb_imapc_user=%u userdb_imapc_password=%w driver = imap } I guess it should cause a single login to the backend IMAP server when issuing a LOGIN to dovecot. Yet, dovecot opens two TCP sessions. In the first, it issues a LOGIN and in the second it logs in again (LOGIN) and issues LIST "" "". At the end (after LOGIN succeeds to dovecot), only one of the two connections remain open to the backend server. Any ideas about this? Thanks,

2 1

v2.2.19 release candidate 2 released
by Timo Sirainen 30 Sep '15

30 Sep '15

http://dovecot.org/releases/2.2/rc/dovecot-2.2.19.rc2.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.19.rc2.tar.gz.sig There were still a bit too many bugs in RC1, so here's RC2. Hopefully this will be stable enough to become v2.2.19 final. Please test now rather than wait for v2.2.19 final, since v2.2.20 is unlikely to arrive anytime soon (unless there are some major problems). Some fixes since RC1: - dict fixes, especially with pgsql - virtual plugin crashfixes - quota "count" backend fixes - lib-http fixes - some compiling fixes

2 1