Le 2 août 2013 à 10:25, Nigel Smith a écrit :

[...]

As demonstrated in my initial post, I can do :

#cat /srv/mail/ops.example.com/test/new/1375430267.M868397P2192.ukc-vm02-mx01\,S\=477\,W\=486

[...]

Hello Nigel,

Somewhat blindly, what's the output of:

id its-virtmail
grep 'test@ops.example.com' /etc/dovecot/users
ls -al '/srv/mail/ops.ops.example.com/test/new/1375430267.M868397P2192.ukc-vm02-mx01\,S\=477\,W\=486'

Axel

Le 2 août 2013 à 11:02, Nigel Smith a écrit :

Hello Axel,

# id its-virtmail uid=1001(its-virtmail) gid=1001(its-virtmail) groups=1001(its-virtmail)

# grep 'test@ops.example.com' /etc/dovecot/users test@ops.example.com:{SSHA512}xxxxxxxxxxxxx:1001:1001::/srv/mail/ops.example.com/test/./:/bin/false::

# ls -al /srv/mail/ops.example.com/test/new/1375430267.M868397P2192.ukc-vm02-mx01\,S\=477\,W\=486 -rw-r--r-- 1 its-virtmail its-virtmail 477 Aug 2 08:57 /srv/mail/ops.example.com/test/new/1375430267.M868397P2192.ukc-vm02-mx01,S=477,W=486

Thanks!

So, it's a single uid/gid setting, and the permissions seem to be consistent. (you could probably simplify your config, but it's another matter)

Looking at the home folder for test@ops.example.com:

/srv/mail/ops.example.com/test/./

I'm not sure how Dovecot is supposed to interpret the ending "/./" part.

On the other hand, according to your global setting:

mail_location = maildir:/srv/mail/%d/%n

this would translate as:

maildir:/srv/mail/ops.example.com/test

for user test@ops.example.com.

Someone more knowledgeable than I am with maildir?

Axel

PS - Yes, Stan is right: always better to provide the output doveconf -n (and postconf -n), and even better in a message's body. :-)

Le 2 août 2013 à 11:39, Axel Luttgens a écrit :

[...]

Someone more knowledgeable than I am with maildir?

I wanted to add before above question that I would at least try something like this:

mail_location = maildir:~/mails

test@ops.example.com:{SSHA512}xxxxxxxxxxxxx:1001:1001::/srv/mail/ops.example.com/test:::

Sorry, Axel

Le 2 août 2013 à 12:13, Nigel Smith a écrit :

...

I wanted to add before above question that I would at least try something like this: mail_location = maildir:~/mails test@ops.example.com:{SSHA512}xxxxxxxxxxxxx:1001:1001::/srv/mail/ops.example.com/test:::

I'll admit I'm a little confused Axel .... ;-)

Me too...

Are you just saying I should test removing the "/./" chroot from the user homedir ? (I think I already tried this, but happy to try again if that's what you're saying)

In a first time, yes, for various reasons:

• I haven't checked in the code whether that /./ convention applies to non-system users
• your global config valid_chroot_dirs = /srv/mail doesn't, strictly speaking, apply to directories below /srv/mail
• those chrooting matters often come with their own problems: better be sure to have everything working without in a first time

I'm not quite sure how proposed changing mail_location to ~/mails would work ?

Since you're already providing the home directory thru the passdb/userdb databases, lets simplify... On the other hand, having all maildir data in its own subdirectory, rather than the home directory itself, appears safer to me.

Axel

Also re-ran Axel's test with a forward slash after the username, no better....

Although unlike my original config, With Axel's new user home,  Dovecot seems to be creating an extra directory /srv/mail/srv/mail/ops.example.com/test/

Messages are being delivered to the original path though /srv/mail/ops.example.com/test/new/

Aug  2 11:53:08 ukc-vm02-mx01 postfix/smtpd[3967]: connect from unknown[10.16.15.43] Aug  2 11:53:26 ukc-vm02-mx01 postfix/smtpd[3967]: 13D87448D4: client=unknown[10.16.15.43] Aug  2 11:53:31 ukc-vm02-mx01 postfix/cleanup[3971]: 13D87448D4: message-id=<> Aug  2 11:53:31 ukc-vm02-mx01 postfix/qmgr[2093]: 13D87448D4: from=an@example.com, size=207, nrcpt=1 (queue active) Aug  2 11:53:31 ukc-vm02-mx01 dovecot: lmtp(3953): Debug: none: root=, index=, control=, inbox=, alt= Aug  2 11:53:31 ukc-vm02-mx01 dovecot: lmtp(3953): Connect from local Aug  2 11:53:31 ukc-vm02-mx01 dovecot: lmtp(3953): Debug: auth input: test@ops.example.com uid=1001 gid=1001 home=/srv/mail/ops.example.com/test/ Aug  2 11:53:31 ukc-vm02-mx01 dovecot: lmtp(3953, test@ops.example.com): Debug: Effective uid=1001, gid=1001, home=/srv/mail/srv/mail/ops.example.com/test/ Aug  2 11:53:31 ukc-vm02-mx01 dovecot: lmtp(3953, test@ops.example.com): Debug: maildir++: root=/srv/mail/ops.example.com/test, index=, control=, inbox=/srv/mail/ops.example.com/test, alt= Aug  2 11:53:31 ukc-vm02-mx01 dovecot: lmtp(3953, test@ops.example.com): Debug: Namespace : Using permissions from /srv/mail/ops.example.com/test: mode=0755 gid=-1 Aug  2 11:53:31 ukc-vm02-mx01 dovecot: lmtp(3953, test@ops.example.com): QhhaFauP+1FxDwAAwf4bjw: msgid=unspecified: saved mail to INBOX Aug  2 11:53:31 ukc-vm02-mx01 postfix/lmtp[3972]: 13D87448D4: to=test@ops.example.com, relay=ukc-vm02-mx01.ops.example.com[private/dovecot-lmtp], delay=17, delays=17/0.01/0/0.16, dsn=2.0.0, status=sent (250 2.0.0 test@ops.example.com QhhaFauP+1FxDwAAwf4bjw Saved) Aug  2 11:53:31 ukc-vm02-mx01 dovecot: lmtp(3953): Disconnect from local: Client quit (in reset) Aug  2 11:53:31 ukc-vm02-mx01 postfix/qmgr[2093]: 13D87448D4: removed

Aug  2 11:54:03 ukc-vm02-mx01 dovecot: imap-login: Login: user=test@ops.example.com, method=PLAIN, rip=10.16.15.43, lip=10.17.10.71, mpid=3977, TLS Aug  2 11:54:03 ukc-vm02-mx01 dovecot: imap(test@ops.example.com): Error: chdir(/srv/mail/ops.example.com/test/) failed: No such file or directory Aug  2 11:54:03 ukc-vm02-mx01 dovecot: imap(test@ops.example.com): Debug: Effective uid=1001, gid=1001, home=/srv/mail/ops.example.com/test/ Aug  2 11:54:03 ukc-vm02-mx01 dovecot: imap(test@ops.example.com): Debug: Home dir not found: /srv/mail/ops.example.com/test/ Aug  2 11:54:03 ukc-vm02-mx01 dovecot: imap(test@ops.example.com): Debug: maildir++: root=/srv/mail/ops.example.com/test, index=, control=, inbox=/srv/mail/ops.example.com/test, alt= Aug  2 11:54:03 ukc-vm02-mx01 dovecot: imap(test@ops.example.com): Debug: Namespace : /srv/mail/ops.example.com/test doesn't exist yet, using default permissions Aug  2 11:54:03 ukc-vm02-mx01 dovecot: imap(test@ops.example.com): Debug: Namespace : Using permissions from /srv/mail/ops.example.com/test: mode=0700 gid=-1 Aug  2 11:54:23 ukc-vm02-mx01 dovecot: imap(test@ops.example.com): Disconnected: Logged out bytes=43/908

Looking more promising with the chroot commented out Axel (doveconf at the bottom) ..... ;-)

# rm -rf /srv/mail/ops.example.com/test

Aug  2 12:25:50 ukc-vm02-mx01 postfix/smtpd[4480]: connect from unknown[17.16.10.43] Aug  2 12:26:04 ukc-vm02-mx01 postfix/smtpd[4480]: 8E0454470E: client=unknown[17.16.10.43] Aug  2 12:26:09 ukc-vm02-mx01 postfix/cleanup[4484]: 8E0454470E: message-id=<> Aug  2 12:26:09 ukc-vm02-mx01 postfix/qmgr[2093]: 8E0454470E: from=an@example.com, size=210, nrcpt=1 (queue active) Aug  2 12:26:09 ukc-vm02-mx01 dovecot: lmtp(4466): Debug: none: root=, index=, control=, inbox=, alt= Aug  2 12:26:09 ukc-vm02-mx01 dovecot: lmtp(4466): Connect from local Aug  2 12:26:09 ukc-vm02-mx01 dovecot: lmtp(4466): Debug: auth input: test@ops.example.com uid=1001 gid=1001 home=/srv/mail/ops.example.com/test/ Aug  2 12:26:09 ukc-vm02-mx01 dovecot: lmtp(4466, test@ops.example.com): Debug: Effective uid=1001, gid=1001, home=/srv/mail/ops.example.com/test/ Aug  2 12:26:09 ukc-vm02-mx01 dovecot: lmtp(4466, test@ops.example.com): Debug: maildir++: root=/srv/mail/ops.example.com/test, index=, control=, inbox=/srv/mail/ops.example.com/test, alt= Aug  2 12:26:09 ukc-vm02-mx01 dovecot: lmtp(4466, test@ops.example.com): Debug: Namespace : /srv/mail/ops.example.com/test doesn't exist yet, using default permissions Aug  2 12:26:09 ukc-vm02-mx01 dovecot: lmtp(4466, test@ops.example.com): Debug: Namespace : Using permissions from /srv/mail/ops.example.com/test: mode=0700 gid=-1 Aug  2 12:26:09 ukc-vm02-mx01 dovecot: lmtp(4466, test@ops.example.com): wD94LVGX+1FyEQAAwf4bjw: msgid=unspecified: saved mail to INBOX Aug  2 12:26:09 ukc-vm02-mx01 postfix/lmtp[4485]: 8E0454470E: to=test@ops.example.com, relay=ukc-vm02-mx01.ops.example.com[private/dovecot-lmtp], delay=12, delays=12/0.01/0/0.16, dsn=2.0.0, status=sent (250 2.0.0 test@ops.example.com wD94LVGX+1FyEQAAwf4bjw Saved) Aug  2 12:26:09 ukc-vm02-mx01 dovecot: lmtp(4466): Disconnect from local: Client quit (in reset) Aug  2 12:26:09 ukc-vm02-mx01 postfix/qmgr[2093]: 8E0454470E: removed Aug  2 12:26:15 ukc-vm02-mx01 postfix/smtpd[4480]: disconnect from unknown[17.16.10.43]

• OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. a1 LOGIN test@ops.example.com test a1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in a2 EXAMINE INBOX
• FLAGS (\Answered \Flagged \Deleted \Seen \Draft)
• OK [PERMANENTFLAGS ()] Read-only mailbox.
• 1 EXISTS
• 1 RECENT
• OK [UNSEEN 1] First unseen.
• OK [UIDVALIDITY 1375442769] UIDs valid
• OK [UIDNEXT 2] Predicted next UID
• OK [HIGHESTMODSEQ 1] Highest a2 OK [READ-ONLY] Select completed. a3 FETCH 1 BODY[]
• 1 FETCH (BODY[] {488} Return-Path: an@example.com Delivered-To: test@ops.example.com Received: from ukc-vm02-mx01.ops.example.com by ukc-vm02-mx01.ops.example.com (Dovecot) with LMTP id wD94LVGX+1FyEQAAwf4bjw for test@ops.example.com; Fri, 02 Aug 2013 12:26:09 +0100 Received: from x (unknown [17.16.10.43]) by ukc-vm02-mx01.ops.example.com (Postfix) with ESMTP id 8E0454470E for test@ops.example.com; Fri,  2 Aug 2013 12:25:57 +0100 (BST) Subject: x

s ) a3 OK Fetch completed. a4 LOGOUT

• BYE Logging out a4 OK Logout completed. closed

Aug  2 12:26:34 ukc-vm02-mx01 dovecot: imap-login: Login: user=test@ops.example.com, method=PLAIN, rip=17.16.10.43, lip=10.17.10.71, mpid=4490, TLS Aug  2 12:26:34 ukc-vm02-mx01 dovecot: imap(test@ops.example.com): Debug: Effective uid=1001, gid=1001, home=/srv/mail/ops.example.com/test/ Aug  2 12:26:34 ukc-vm02-mx01 dovecot: imap(test@ops.example.com): Debug: maildir++: root=/srv/mail/ops.example.com/test, index=, control=, inbox=/srv/mail/ops.example.com/test, alt= Aug  2 12:27:15 ukc-vm02-mx01 dovecot: imap(test@ops.example.com): Disconnected: Logged out bytes=44/1170

# doveconf -n                                                            [20/270] # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.5.0-37-generic x86_64 Ubuntu 12.04.2 LTS ext4 mail_debug = yes mail_location = maildir:/srv/mail/%d/%n managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeri c relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap lmtp service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = its-virtmail user = its-virtmail } } service lmtp { process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = its-virtmail } ssl_cert = was automatically rejected:%n%r }

So, I'll now be a bit insisting, but could you now try with: mail_location = maildir:~/mails

Ok, will go try now.

If it works, this may prove useful in the future (for example, should you want make use of sieve or easily avoid to have >the control/index files taken into account for the quotas).

Ah yes, Sieve.  That's going to be my next challenge.  I have not tested it yet, but have been wondering if the various sieve directory settings (e.g. sieve_dir,sieve,sieve_global_dir etc. etc.) operate independently of the "general" Dovecot directory settings (e.g. mail_location, the home directory in user files etc.) ? 

As a last step, you could then try to chroot again.

Only if someone can suggest why my original chroot config didn't work first, otherwise I'll just be breaking things again  ;-)

Le 2 août 2013 à 14:17, Nigel Smith a écrit :

Axel,

This seems to bring up a new problem. ;-(

Before that change, I could see the new mails in both Telnet and Apple Mail.

Now, I can only see the mail in Telnet and not in Apple Mail. No config changes apart form your suggestion (mail_location = maildir:~/Maildir)

A quick test would be to delete the account (and all local copies of emails) in Mail, then to re-create it. Mail is of course a more sophisticated client than telnet, and may choke on various niceties such as uidvalidity...

Axel

On 8/2/2013 3:25 AM, Nigel Smith wrote:

...

Probably a namespace issue. The imap daemon is telling you there's not new mail. So wherever it's looking it sees no mail. So either it's looking in the wrong place, and the configuration isn't correct. Error logs will inform you about the latter, 'dovecot -n' about the former. Show dovecot client connection and error logging, and dovecot -n.

Hi Stan,

Unfortunatley not.

Unfortunately you failed to provide 'dovecot -n' output which makes assisting you much more difficult. Providing this is standard operating procedure.

As demonstrated in my initial post, I can do :

#cat /srv/mail/ops.example.com/test/new/1375430267.M868397P2192.ukc-vm02-mx01\,S\=477\,W\=486

And the debug shows the MUA looking in the same place (forgot to include the Dovecot MUA debug earlier) :

Aug 2 09:01:09 ukc-vm02-mx01 postfix/anvil[2642]: statistics: max connection rate 1/60s for (smtp:192.168.198.199) at Aug 2 08:57:17 Aug 2 09:01:09 ukc-vm02-mx01 postfix/anvil[2642]: statistics: max connection count 1 for (smtp:192.168.198.199) at Aug 2 08:57:17 Aug 2 09:01:09 ukc-vm02-mx01 postfix/anvil[2642]: statistics: max cache size 1 at Aug 2 08:57:17 Aug 2 09:03:38 ukc-vm02-mx01 dovecot: imap-login: Login: user=test@ops.example.com, method=PLAIN, rip=192.168.198.199, lip=79.170.177.71, mpid=2667, TLS Aug 2 09:03:38 ukc-vm02-mx01 dovecot: imap(test@ops.example.com): Debug: Effective uid=1001, gid=1001, home=/ Aug 2 09:03:38 ukc-vm02-mx01 dovecot: imap(test@ops.example.com): Debug: maildir++: root=/srv/mail/ops.example.com/test, index=, control=, inbox=/srv/mail/ops.example.com/test, alt= Aug 2 09:03:51 ukc-vm02-mx01 dovecot: imap(test@ops.example.com): Disconnected: Logged out bytes=26/599

All of this logging isn't telling us anything. Seeing your configuration should. Given that Dovecot relies on indexes for everything it does, including listing of INBOX and mailbox contents, the fact that you're not seeing new mail is likely due to an index problem of some sort, either misconfiguration or corrupion, etc.

Unfortunately all I can do is make general educated guesses about your problem because you refuse to provide your 'dovecot -n' output.

-- Stan

Am 02.08.2013 11:34, schrieb Nigel Smith:

...

Unfortunately you failed to provide 'dovecot -n' output which makes assisting you much more difficult. Providing this is standard operating procedure.

Sorry, but ....What on earth are you on about ? From the ***TOP*** of my original email :

Dovecot : 2.0.19 (see config at http://pastebin.com/raw.php?i=KMaQ9Ccc) Postfix : 2.9.6 (see config at http://pastebin.com/raw.php?i=EEeevHfk)

The configs are right there.... for both postifx and dovecot. I was being courteous by posting them on pastebin instead of pasting them into an email which would become clutterd with lines of config !

thats fine *but* on mailing-lists you should paste the output *inline* nobody likes to c&p things for quoting from whatever online services nor is it useful in context of list-archives as well as nobody right on his mind clicks on tiny-urls

Am 02.08.2013 11:47, schrieb Nigel Smith:

...

thats fine *but* on mailing-lists you should paste the output *inline*

nobody likes to c&p things for quoting from whatever online services nor is it useful in context of list-archives as well as nobody right on his mind clicks on tiny-urls

Fine, but then just ask me to post them on the list instead of making up a stupid story that I never provided them in the first place ! ;-(

maybe people simply oversee it because for them who knows how the output looks like it is one short view on the message to find out if they are present

On Fri, 2 Aug 2013 10:34:41 +0100 (BST) Nigel Smith articulated:

The configs are right there.... for both postifx and dovecot.   I was being courteous by posting them on pastebin instead of pasting them into an email which would become clutterd with lines of config !

The problem isn't the posting of the documentation into the email, it is the stupidity of those replying to the post who are either too lazy, stupid or inconsiderate (perhaps a combination of all three) of others to properly trim the message when replying.

-- Jerry ♔

Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header.

On 8/2/2013 4:34 AM, Nigel Smith wrote:

...

Unfortunately you failed to provide 'dovecot -n' output which makes assisting you much more difficult. Providing this is standard operating procedure.

Sorry, but ....What on earth are you on about ?

From the man page " -n Dump non-default settings to stdout and exit successfully. The same as doveconf -n."

From the ***TOP*** of my original email :

Dovecot : 2.0.19 (see config at http://pastebin.com/raw.php?i=KMaQ9Ccc) Postfix : 2.9.6 (see config at http://pastebin.com/raw.php?i=EEeevHfk)

The configs are right there.... for both postifx and dovecot. I was being courteous by posting them on pastebin instead of pasting them into an email which would become clutterd with lines of config !

My apologies Nigel. I completely missed the links. I guess I'm so used to seeing configs inline that I skimmed over those links. My visual acuity problems aside, for future reference it's usually better to inline config output so folks can highlight problems and point out exactly where corrections need to be made. In this particular case it wouldn't be necessary to include postconf -n output though. -- Stan

To save Stan the inconvenience of clicking on a link, I hereby copy my configs from pastbin and paste to the list, apologies for the clutter.......

Happy now Stan ?  ;-)

(1) Doveconf # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.5.0-37-generic x86_64 Ubuntu 12.04.2 LTS ext4 mail_chroot = /srv/mail mail_debug = yes mail_location = maildir:/srv/mail/%d/%n managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap lmtp service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = its-virtmail user = its-virtmail } } service lmtp { process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = its-virtmail } ssl_cert = was automatically rejected:%n%r } (2) Postifx alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases append_dot_mydomain = no biff = no broken_sasl_auth_clients = yes config_directory = /etc/postfix home_mailbox = Maildir/ html_directory = /usr/share/doc/postfix/html inet_interfaces = all mailbox_command = /usr/lib/dovecot/deliver -c /etc/dovecot/conf.d/01-mail-stack-delivery.conf -m "${EXTENSION}" mailbox_size_limit = 0 mydestination = ukc-vm02-mx01.ops.example.com, localhost.ops.example.com, , localhost myhostname = ukc-vm02-mx01.ops.example.com mynetworks = 127.0.0.0/8 [::ffff:127.0.0.0]/104 [::1]/128 10.17.18.0/24 myorigin = /etc/mailname readme_directory = /usr/share/doc/postfix recipient_delimiter = + relayhost = smtp_tls_session_cache_database = btree:${data_directory}/smtp_scache smtp_use_tls = yes smtpd_banner = $myhostname ESMTP $mail_name (Ubuntu) smtpd_recipient_restrictions = reject_unknown_sender_domain, reject_unknown_recipient_domain, reject_unauth_pipelining, permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination smtpd_sasl_auth_enable = yes smtpd_sasl_authenticated_header = yes smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = private/dovecot-auth smtpd_sasl_security_options = noanonymous smtpd_sasl_type = dovecot smtpd_sender_restrictions = reject_unknown_sender_domain smtpd_tls_auth_only = yes smtpd_tls_cert_file = /etc/ssl/certs/ssl-mail.pem smtpd_tls_key_file = /etc/ssl/private/ssl-mail.key smtpd_tls_mandatory_ciphers = high smtpd_tls_mandatory_protocols = SSLv3, TLSv1 smtpd_tls_received_header = yes smtpd_tls_session_cache_database = btree:${data_directory}/smtpd_scache smtpd_use_tls = yes tls_random_source = dev:/dev/urandom virtual_alias_maps = cdb:/etc/postfix/virtual virtual_gid_maps = static:1001 virtual_mailbox_base = /srv/mail virtual_mailbox_domains = /etc/postfix/vhosts virtual_mailbox_maps = cdb:/etc/postfix/vmaps virtual_minimum_uid = 1000 virtual_transport = lmtp:unix:private/dovecot-lmtp virtual_uid_maps = static:1001