- dovecot - dovecot.org

Re: [Dovecot] Shared Mailboxes with VirtualUsers and mail_location retrieved from ldap
by mailing lists 09 Sep '11

09 Sep '11

and for the time that user001 execute the imap 'list' command, this is the log trace in dovecot: Sep 9 13:09:12 imap1 dovecot: imap(user001): Debug: Namespace : type=shared, prefix=shared.%u., sep=., inbox=no, hidden=no, list=children, subscriptions=no location=maildir:%h/mailSubDir:INDEX=~/mailSubDir/shared/%u Sep 9 13:09:12 imap1 dovecot: imap(user001): Debug: shared: root=/var/run/dovecot/, index=, control=, inbox=, alt= [...] Sep 9 13:10:44 imap1 dovecot: auth: Debug: master in: USER 1 user002 service=lib-storage Sep 9 13:10:44 imap1 dovecot: auth: Debug: ldap(user002): user search: base=dc=example,dc=com scope=subtree filter=(&(objectClass=CourierMailAccount)(uid=user002)) fields=mailbox,homeFilter Sep 9 13:10:44 imap1 dovecot: auth: Debug: ldap(user002): result: mailbox(mail=maildir:/var/maildir/%$)=vol05/4/40/user002 homeFilter(home)=/var/mailfilter/vol05/4/40/user002 Sep 9 13:10:44 imap1 dovecot: auth: Debug: master out: USER 1 user002 mail=maildir:/var/maildir/vol05/4/40/user002 home=/var/mailfilter/vol05/4/40/user002 Sep 9 13:10:44 imap1 dovecot: imap(user001): Debug: auth input: user002 mail=maildir:/var/maildir/vol05/4/40/user002 home=/var/mailfilter/vol05/4/40/user002 Sep 9 13:10:44 imap1 dovecot: imap(user001): Debug: maildir++: root=/var/mailfilter/vol05/4/40/user002/mailSubDir, index=/var/mailfilter/vol04/4/46/user001/mailSubDir/shared/user002, control=, inbox=/var/mailfilter/vol05/4/40/user002/mailSubDir, alt= Sep 9 13:10:44 imap1 dovecot: imap(user001): Debug: acl: initializing backend with data: vfile Sep 9 13:10:44 imap1 dovecot: imap(user001): Debug: acl: acl username = user001 Sep 9 13:10:44 imap1 dovecot: imap(user001): Debug: acl: owner = 0 Sep 9 13:10:44 imap1 dovecot: imap(user001): Debug: acl vfile: Global ACL directory: (none) Sep 9 13:10:44 imap1 dovecot: imap(user001): Debug: acl: Mailbox not in dovecot-acl-list: shared.user002.INBOX

1 0

Re: [Dovecot] Shared Mailboxes with VirtualUsers and mail_location retrieved from ldap
by mailing lists 09 Sep '11

09 Sep '11

(I'm sorry for breaking the thread with each mail) On 09/09/2011 10:04 AM, Jan-Frode Myklebust wrote: > On Fri, Sep 09, 2011 at 08:18:40AM +0100, mailing lists wrote: >> >> and how to I might configure dovecot to use the mail directory as a subdirectory of the home directory? >> >> this way all lookups for home (with %%h fetched from ldap) will return the correct locationand mail will be in (i.e.) ~/mailSubDir >> >> is this configuration possible? > > In the main dovecot.conf: > > mail_location = maildir:~/mailSubDir > > In the ldap-config: > > user_attrs = homeFilter=home and which is the value for the location directive in namespace declaration ?? namespace { list = children location = maildir:%%h/mailSubDir:INDEX=~/mailSubDIr/shared/%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } with the above conf. no shared folders are seen by tests users and afaik %%h is retrieved from ldap. this is that I had done until now: # telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. . login user001 secret . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAME . create INBOX.docs-user001 . OK Create completed. . setacl INBOX.docs-user001 user002 lr . OK Setacl complete. . logout * BYE Logging out . OK Logout completed. Connection closed by foreign host. # telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. . login user002 secret . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAME . create INBOX.docs-user002 . OK Create completed. . setacl INBOX.docs-user002 user001 lr . OK Setacl complete. . logout * BYE Logging out . OK Logout completed. Connection closed by foreign host. # cat /var/maildir/shared-mailboxes shared/shared-boxes/user/user002/user001 1 shared/shared-boxes/user/user002/user002 1 shared/shared-boxes/user/user001/user001 1 shared/shared-boxes/user/user001/user002 1 # cat /var/maildir/vol04/4/46/user001/.docs-user001/dovecot-acl user=user002 lr # cat /var/maildir/vol05/4/40/user002/.docs-user002/dovecot-acl user=user001 lr # telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. . login user001 secret . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk] Logged in . namespace * NAMESPACE (("INBOX." ".")) (("shared." ".")) NIL . OK Namespace completed. . list "shared." "*" . OK List completed. /--------------/ # grep ^[^#] /etc/dovecot/dovecot-ldap.conf.ext uris = ldap://ldap.example.com dn = cn=testuser,dc=example,dc=com dnpass = secret sasl_bind = no tls = no auth_bind = yes ldap_version = 3 base = dc=example,dc=com deref = never scope = subtree user_attrs = mailbox=mail=maildir:/var/maildir/%$,homeFilter=home user_filter = (&(objectClass=CourierMailAccount)(uid=%u)) pass_filter = (&(objectClass=CourierMailAccount)(uid=%u)) # dovecot -n # 2.0.14: /etc/dovecot/dovecot.conf # OS: Linux 2.6.34.7-0.7-xen x86_64 openSUSE 11.3 (x86_64) auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain base_dir = /var/run/dovecot/ disable_plaintext_auth = no mail_debug = yes mail_fsync = always mail_gid = 5000 mail_location = maildir:~/mailSubDir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = acl mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. separator = . } namespace { list = children location = maildir:%%h/mailSubDir:INDEX=~/mailSubDir/shared/%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/var/maildir/shared-mailboxes sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap lmtp service lmtp { inet_listener lmtp { port = 24 } unix_listener lmtp { user = vmail } } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = acl } protocol lda { mail_plugins = acl } protocol imap { mail_max_userip_connections = 100 mail_plugins = acl imap_acl autocreate }

1 0

Re: [Dovecot] Shared Mailboxes with VirtualUsers and mail_location retrieved from ldap
by mailing lists 09 Sep '11

09 Sep '11

On 09/08/2011 03:07 PM, Timo Sirainen wrote: > On Thu, 2011-09-08 at 12:14 +0100, mailing lists wrote: > >> yes, my virtual users have separate directories for home and mail. >> Their locations are stored in ldap attributes (with random generated >> paths), so a flat scheme like /var/maildr/%%u isn't valid. > > Sorry, you're out of luck with that kind of a setup. Only the %%h can > look up a home directory from LDAP. Maybe some day in future there will > be other variables that can be looked up. and how to I might configure dovecot to use the mail directory as a subdirectory of the home directory? this way all lookups for home (with %%h fetched from ldap) will return the correct locationand mail will be in (i.e.) ~/mailSubDir is this configuration possible?

2 1

[Dovecot] lmtp -- save failed to INBOX: BUG: Unknown internal error
by Jan-Frode Myklebust 09 Sep '11

09 Sep '11

I've had 18 instances of this error the last 24 hours: Sep 8 08:56:00 popimap1 dovecot:: lmtp(10529, first.last(a)example.om) mGdAOtdlaE4hKQAAg/aw4w: msgid=<B8FA3D5B230184409450D51D522678404E5052(a)ASP-EX02.ASP.lan>: save failed to INBOX: BUG: Unknown internal error 17 on lmtp-server A, and one on lmtp-server B. On server A it was a message with 55 recepients, where 17 failed initially -- and the was then successfully delivered. lmtp pid 10529, 08:55:57-08:56:01 - 11 successfull deliveries, 17 BUGs lmtp pid 10609, 08:56:00 - 1 successfull deliveries lmtp pid 31291, 08:56:06 - 2 successfull deliveries lmtp pid 10482, 08:56:04-06 - 3 successfull deliveries lmtp pid 6738, 08:56:06 - 1 successfull deliveries lmtp pid 24488, 08:56:06-07 - 5 successfull deliveries lmtp pid 7101, 08:56:01-07 - 19 successfull deliveries lmtp pid 21330, 08:56:08 - 1 successfull deliveries lmtp pid 2177, 08:56:09 - 3 successfull deliveries lmtp pid 7085, 08:56:10 - 3 successfull deliveries lmtp pid 6633, 08:56:08-10 - 6 successfull deliveries The one on lmtp-server B was a different msgid from A, and also had several recepients (6). It was successfully delivered to the recepient that initially failed the same second. Config here: # 2.0.14: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-194.26.1.el5 x86_64 Red Hat Enterprise Linux Server release 5.5 (Tikanga) auth_verbose = yes auth_verbose_passwords = sha1 disable_plaintext_auth = no mail_gid = 3000 mail_location = maildir:~/:INDEX=/indexes/%1u/%1.1u/%u mail_plugins = quota mail_uid = 3000 mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { quota = maildir:User quota } service auth-worker { user = $default_internal_user } service auth { client_limit = 4396 } service imap-login { inet_listener imap { address = * port = 143 } } service imap { executable = /usr/local/sbin/imap-wrapper.sh process_limit = 2048 } service lmtp { client_limit = 1 inet_listener lmtp { address = * port = 24 } process_limit = 25 } service pop3-login { inet_listener pop3 { address = * port = 110 } } service pop3 { executable = /usr/local/sbin/pop-wrapper.sh process_limit = 2048 } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = quota } protocol imap { imap_client_workarounds = delay-newmail mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = UID%u-%v } -jf

2 7

[Dovecot] copy and empty userA folder1, append to /var/mail/userB
by mathog 08 Sep '11

08 Sep '11

Dovecot 2.0.13 on a 64 bit linux. We have an archiver account on one machine. Most mailing lists that handles go directly to it and everything is fine. However, there is one campus list that will only send to real people. So for that one I subscribed. When one of these messages comes in, which is 1-2x per week, I copy it to an export folder and then manually run a script which does: cat ~me/mail/export >>/var/mail/archiver echo "" > ~me/mail/export That worked fine on our last system, but dovecot doesn't like it. It leaves the imap indices for the export mailbox in an inconsistent state, so that roundcube (through dovecot) refuses to drop messages into it. The error message roundcube emits is: ServerError: Mailbox isn't a valid mbox file. Presumably the second half is from dovecot. I need a supported way to go about this, so that the next time one comes in I can copy to that folder again. The export mailbox is always completely emptied. It would suffice if there was some way to force dovecot to create "empty"" .imap/export: dovecot.index.cache dovecot.index.log files. Note this isn't a problem for the archiver itself, since it doesn't have any imap indexed files. Suggestions? Thank you, David Mathog mathog(a)caltech.edu Manager, Sequence Analysis Facility, Biology Division, Caltech

2 2

Re: [Dovecot] Shared Mailboxes with VirtualUsers and mail_location retrieved from ldap
by mailing lists 08 Sep '11

08 Sep '11

Hello, On 09/07/2011 07:22 PM, Timo Sirainen wrote: > On 6.9.2011, at 14.27, mailing lists wrote: >> At this point I need shared mailboxes but since user mail/home locations are ldap attributes, how is it supposed I must configure this for shared mailboxes? >> >> for the users' mail/home directories I set this line: >> >> user_attrs = mailbox=mail=maildir:/var/maildir/%$,homeFilter=home > > Are home dirs and mail dirs related in any way? The only way you can get it working is by using home dirs, e.g.: > > user_attrs = mailbox=home=/var/maildir/%$ yes, my virtual users have separate directories for home and mail. Their locations are stored in ldap attributes (with random generated paths), so a flat scheme like /var/maildr/%%u isn't valid. for typical (virtual) users the location returned looks like: Sep 8 12:48:33 imap1 dovecot: auth: Debug: ldap(user012,::1): result: mailbox(mail=maildir:/var/maildir/%$)=vol06/1/15/user012 homeFilter(home)=/var/mailfilter/vol06/1/15/user012 ... Sep 8 12:54:50 imap1 dovecot: imap(user012): Debug: maildir++: root=/var/maildir/vol06/1/15/user012, index=, control=, inbox=/var/maildir/vol06/1/15/user012, alt= > Then in dovecot.conf: > > mail_location = maildir:~/ > >> namespace { >> type = shared >> separator = / >> prefix = shared/%%u/ >> subscriptions = no >> list = children > > location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u this is that I see in logs and not shared folders are seen by imap clients: Sep 8 12:57:11 imap1 dovecot: imap(user012): Debug: Namespace : type=shared, prefix=shared.%u., sep=., inbox=no, hidden=no, list=children, subscriptions=no location=maildir:%h/Maildir:INDEX=~/Maildir/shared/%u Sep 8 12:57:11 imap1 dovecot: imap(user012): Debug: shared: root=/var/run/dovecot/, index=, control=, inbox=, alt= Sep 8 12:57:11 imap1 dovecot: imap(user012): Debug: acl: initializing backend with data: vfile I fail to understand how %%u is retrieved from ldap... /----------/ # dovecot -n # 2.0.14: /etc/dovecot/dovecot.conf # OS: Linux 2.6.34.7-0.7-xen x86_64 openSUSE 11.3 (x86_64) auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain base_dir = /var/run/dovecot/ disable_plaintext_auth = no mail_debug = yes mail_fsync = always mail_gid = 5000 mail_location = maildir:~/ mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = acl mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. separator = . } namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/var/maildir/shared-mailboxes sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap ssl = no userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol imap { mail_max_userip_connections = 100 mail_plugins = acl imap_acl autocreate }

2 1

Re: [Dovecot] is it necessary lmtp and director to avoid index corruption in mail delivery?
by mailing lists 08 Sep '11

08 Sep '11

JF, thank you for the reply. I'm just curious how to big players fix this problem, which seems impact systems with shared storage. Have a nice day. On 09/07/2011 12:59 PM, Jan-Frode Myklebust wrote: > On Wed, Sep 07, 2011 at 11:26:28AM +0100, mailing lists wrote: >> Hello all, >> If I have several postfix/dovecot-lda boxes with shared nfs storage, >> how director helps in this scenario? > > The director can help by directing each unique user to the same backend > server for each delivery, which should give you better performance > (indexes cached in memory on only one machine instead of on all, > inotify will work for IMAP NOTIFY), and also avoid some apparent race > conditions that has lead to index corruption when several nodes are > writing to the same mailbox at the same time. > >> is it necesary to use lmtp instead of dovecot-lda? > > Yes. > > >> With postfix/dovecot-lda boxes incoming mail happens at the smtp layer >> but director redirects are working in the lmtp/imap/pop3 layer. > > Right. > > With LMTP you can have dovecot listening on the network (port 24/tcp) > for incoming mail. No need for postfix on the backend mailstorage > servers. > > Our setups has been: > > Mailgw[1-14] ---smtp--> dovecot-server[1-5] (postfix + dovecot/lda) > > and used MX priorities to make all deliveries go to the same > dovecot-server with the others as backup. > > $ dig mx deliver.example.com +short > 10 dove2.example.com. > 15 dove3.example.com. > 20 dove4.example.com. > 25 dove5.example.com. > 5 dove1.example.com. > > > Now I'm moving towards: > > Mailgw[1-14] ---lmtp--> dovecot-server[1-5] (dovecot/lmtp) > > but worry that the index corruption might hit me again.. Ideally > I want: > > Mailgw[1-14] ---lmtp--> directors --lmtp--> dovecot-server[1-5] (dovecot/lmtp) > > but lmtp-proxying seems to have bugs (ref: my latest mails to this > list). > > > -jf

1 0

[Dovecot] limit number of simultaneous lmtp deliveries ?
by Jan-Frode Myklebust 08 Sep '11

08 Sep '11

We have quite a few frontend mail gateways that deliver incoming email trough our dovecot director (lmtp proxy) to the backend lmtp servers, and are seeing this logged on the frontend mail gateways: Sep 5 10:51:56 mailgw1 postfix/lmtp[23443]: 0E2F41C01A: to=<me(a)example.com>, relay=loadbalancers.example.com[192.168.42.15]:24, delay=61, delays=0.02/0.3/31/30, dsn=4.4.0, status=deferred (host loadbalancers.example.com[192.168.42.15] said: 451 4.4.0 Remote server not answering (DATA output timeout) (in reply to end of DATA command)) It's a bit unclear to me if this leads to duplicate deliveries, or just delayed deliveries, but -- is there any way to limit the number of simultanous deliveries on either the dovecot director or the backend lmtp-servers ? Will "process_limit=10" work for "service lmtp"? -jf

2 4

[Dovecot] test
by Adrian Stoica 08 Sep '11

08 Sep '11

Hello i use dovecot 2.0.14 , with exim 4.76 using dovecot-lda. We have the following problem: when I receive mail from the site http://www.transfer.ro, which is a file transfer site, most emails appear to be empty. Empty rows appear in email body slipped through the existing, and this makemy mail client to show me an empty mail. You can see the content only by viewing the message source. instead of "- np4e68592849da7 Content-type: text / plain, charset = utf-8 " appear "- np4e68592849da7 Content-type: text / plain, charset = utf-8 " , and that blank line spoil everything. You can check if there is somethingwrong ?

2 2

[Dovecot] ManageSieve with SSL/TLS only
by Karol Babioch 08 Sep '11

08 Sep '11

Hi, I'm quite new to Dovecot and ManageSieve, so probably I've missed something, although I couldn't find any hints in the wiki. I'm interested in running ManageSieve with SSL/TLS only. So is there any way to reject any non encrypted connections? I couldn't find any parameter for this purpose. I'm currently using dovecot 1.2.15 provided with Debian Squeeze, but I couldn't find any parameter in the 2.0 branch neither. Best regards, Karol Babioch

2 1