- dovecot - dovecot.org

[Dovecot] Mails repopping
by Simon Brereton 09 Sep '11

09 Sep '11

HI I don't know if this is a dovecot issue or a client one. But as Dovecot is the most recent change, I'll start here. I have a server that's been running Courier for about 6 years and in all that time I think I've only ever had 1 issues where an entire mail box was repopped by a webmail client. However, since moving to a new server and dovecot 4 weeks ago, I've now had the webmail client repop this account 4 times (there are about 230 mails in the account). Is there a setting I need to tighten to prevent/remedy this? I have no idea if it's happening on other accounts, but this is one that I see. The format is maildir. There has been no changes to the webmail client. Thanks. Simon

1 0

Re: [Dovecot] 2.1: imapc LIST problem / usage question
by Lutz Preßler 09 Sep '11

09 Sep '11

On Fr, 09 Sep 2011, Lutz Preßler wrote: > On Fr, 09 Sep 2011, Timo Sirainen wrote: > > > On Fri, 2011-09-09 at 12:01 +0200, Lutz Preßler wrote: > [...] > > > For the Gmail mailboxe the INBOX.gmail prefix is missing and / is used > > > as separator. > > > > Fixed in hg. > Thanks. LIST is now working correctly in my setup, but SUBSCRIBE ist not. With subscriptions=no, as written (but same behaviour with subscriptions=yes), SUBSCRIBE INBOX.gmail.INBOX (or others) yields 0 NO [SERVERBUG] Internal error occurred. Refer to server log for more information. [2011-09-09 16:39:40] logging (with mail_debug=yes) only Sep 9 16:39:40 host dovecot: imap(1143, user): Error: stat((null)) failed: Bad address Lutz

1 0

[Dovecot] Quota fs (ignore mount)
by Peter Ignatov 09 Sep '11

09 Sep '11

> I set "quota: fs:INBOX:noenforcing:mount=/var/spool/mail", but receive: "fs quota add storage dir = /home/pit/mail"... > Why ? Well .. I'm not entirely sure if the current behavior is good or not, but what you need to do to get it working is to add two quota roots. One for /home/pit/mail (i.e. without specifying mount=) and another for the INBOX's /var/spool/mail. Don't work... :-( # dovecot -n # 1.2.17: /etc/dovecot.conf # OS: Linux 2.6.18-274.el5.asp121 x86_64 Red Hat Enterprise Linux Server release 5.6 (Tikanga) log_path: /var/log/dovecot.log protocols: pop3 pop3s listen: * login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/pop3-login verbose_proctitle: yes mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u mail_debug: yes mail_executable: /usr/libexec/dovecot/pop3 mail_plugins: quota mail_plugin_dir: /usr/lib64/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd plugin: quota: fs:INBOX:noenforcing quota2: fs:boxes:noenforcing:mount=/var/spool/mail quota_rule: *:storage=10240 quota_rule2: *:storage=15000 dovecot.log: ------------ Sep 09 16:13:46 pop3-login: Info: Login: user=<pit>, method=PLAIN, rip=192.168.3.10, lip=192.168.6.3, TLS Sep 09 16:13:46 POP3(pit): Info: Loading modules from directory: /usr/lib64/dovecot/pop3 Sep 09 16:13:46 POP3(pit): Info: Module loaded: /usr/lib64/dovecot/pop3/lib10_quota_plugin.so Sep 09 16:13:46 POP3(pit): Info: Effective uid=500, gid=500, home=/home/pit Sep 09 16:13:46 POP3(pit): Info: Quota root: name=INBOX backend=fs args=noenforcing Sep 09 16:13:46 POP3(pit): Info: Quota rule: root=INBOX mailbox=* bytes=10485760 messages=0 Sep 09 16:13:46 POP3(pit): Info: Quota rule: root=INBOX mailbox=* bytes=15360000 messages=0 Sep 09 16:13:46 POP3(pit): Info: Quota root: name=boxes backend=fs args=noenforcing:mount=/var/spool/mail Sep 09 16:13:46 POP3(pit): Info: mbox: data=~/mail:INBOX=/var/spool/mail/pit Sep 09 16:13:46 POP3(pit): Info: fs: root=/home/pit/mail, index=, control=, inbox=/var/spool/mail/pit Sep 09 16:13:46 POP3(pit): Info: fs quota add storage dir = /home/pit/mail Sep 09 16:13:46 POP3(pit): Info: fs quota block device = /dev/cciss/c0d0p3 Sep 09 16:13:46 POP3(pit): Info: fs quota mount point = / Sep 09 16:13:46 POP3(pit): Info: fs quota mount type = ext3 Sep 09 16:13:46 POP3(pit): Info: Disconnected: Logged out top=0/0, retr=0/0, del=0/2, size=1249

1 0

Re: [Dovecot] Shared Mailboxes with VirtualUsers and mail_location retrieved from ldap
by mailing lists 09 Sep '11

09 Sep '11

and for the time that user001 execute the imap 'list' command, this is the log trace in dovecot: Sep 9 13:09:12 imap1 dovecot: imap(user001): Debug: Namespace : type=shared, prefix=shared.%u., sep=., inbox=no, hidden=no, list=children, subscriptions=no location=maildir:%h/mailSubDir:INDEX=~/mailSubDir/shared/%u Sep 9 13:09:12 imap1 dovecot: imap(user001): Debug: shared: root=/var/run/dovecot/, index=, control=, inbox=, alt= [...] Sep 9 13:10:44 imap1 dovecot: auth: Debug: master in: USER 1 user002 service=lib-storage Sep 9 13:10:44 imap1 dovecot: auth: Debug: ldap(user002): user search: base=dc=example,dc=com scope=subtree filter=(&(objectClass=CourierMailAccount)(uid=user002)) fields=mailbox,homeFilter Sep 9 13:10:44 imap1 dovecot: auth: Debug: ldap(user002): result: mailbox(mail=maildir:/var/maildir/%$)=vol05/4/40/user002 homeFilter(home)=/var/mailfilter/vol05/4/40/user002 Sep 9 13:10:44 imap1 dovecot: auth: Debug: master out: USER 1 user002 mail=maildir:/var/maildir/vol05/4/40/user002 home=/var/mailfilter/vol05/4/40/user002 Sep 9 13:10:44 imap1 dovecot: imap(user001): Debug: auth input: user002 mail=maildir:/var/maildir/vol05/4/40/user002 home=/var/mailfilter/vol05/4/40/user002 Sep 9 13:10:44 imap1 dovecot: imap(user001): Debug: maildir++: root=/var/mailfilter/vol05/4/40/user002/mailSubDir, index=/var/mailfilter/vol04/4/46/user001/mailSubDir/shared/user002, control=, inbox=/var/mailfilter/vol05/4/40/user002/mailSubDir, alt= Sep 9 13:10:44 imap1 dovecot: imap(user001): Debug: acl: initializing backend with data: vfile Sep 9 13:10:44 imap1 dovecot: imap(user001): Debug: acl: acl username = user001 Sep 9 13:10:44 imap1 dovecot: imap(user001): Debug: acl: owner = 0 Sep 9 13:10:44 imap1 dovecot: imap(user001): Debug: acl vfile: Global ACL directory: (none) Sep 9 13:10:44 imap1 dovecot: imap(user001): Debug: acl: Mailbox not in dovecot-acl-list: shared.user002.INBOX

1 0

Re: [Dovecot] Shared Mailboxes with VirtualUsers and mail_location retrieved from ldap
by mailing lists 09 Sep '11

09 Sep '11

(I'm sorry for breaking the thread with each mail) On 09/09/2011 10:04 AM, Jan-Frode Myklebust wrote: > On Fri, Sep 09, 2011 at 08:18:40AM +0100, mailing lists wrote: >> >> and how to I might configure dovecot to use the mail directory as a subdirectory of the home directory? >> >> this way all lookups for home (with %%h fetched from ldap) will return the correct locationand mail will be in (i.e.) ~/mailSubDir >> >> is this configuration possible? > > In the main dovecot.conf: > > mail_location = maildir:~/mailSubDir > > In the ldap-config: > > user_attrs = homeFilter=home and which is the value for the location directive in namespace declaration ?? namespace { list = children location = maildir:%%h/mailSubDir:INDEX=~/mailSubDIr/shared/%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } with the above conf. no shared folders are seen by tests users and afaik %%h is retrieved from ldap. this is that I had done until now: # telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. . login user001 secret . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAME . create INBOX.docs-user001 . OK Create completed. . setacl INBOX.docs-user001 user002 lr . OK Setacl complete. . logout * BYE Logging out . OK Logout completed. Connection closed by foreign host. # telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. . login user002 secret . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAME . create INBOX.docs-user002 . OK Create completed. . setacl INBOX.docs-user002 user001 lr . OK Setacl complete. . logout * BYE Logging out . OK Logout completed. Connection closed by foreign host. # cat /var/maildir/shared-mailboxes shared/shared-boxes/user/user002/user001 1 shared/shared-boxes/user/user002/user002 1 shared/shared-boxes/user/user001/user001 1 shared/shared-boxes/user/user001/user002 1 # cat /var/maildir/vol04/4/46/user001/.docs-user001/dovecot-acl user=user002 lr # cat /var/maildir/vol05/4/40/user002/.docs-user002/dovecot-acl user=user001 lr # telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. . login user001 secret . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk] Logged in . namespace * NAMESPACE (("INBOX." ".")) (("shared." ".")) NIL . OK Namespace completed. . list "shared." "*" . OK List completed. /--------------/ # grep ^[^#] /etc/dovecot/dovecot-ldap.conf.ext uris = ldap://ldap.example.com dn = cn=testuser,dc=example,dc=com dnpass = secret sasl_bind = no tls = no auth_bind = yes ldap_version = 3 base = dc=example,dc=com deref = never scope = subtree user_attrs = mailbox=mail=maildir:/var/maildir/%$,homeFilter=home user_filter = (&(objectClass=CourierMailAccount)(uid=%u)) pass_filter = (&(objectClass=CourierMailAccount)(uid=%u)) # dovecot -n # 2.0.14: /etc/dovecot/dovecot.conf # OS: Linux 2.6.34.7-0.7-xen x86_64 openSUSE 11.3 (x86_64) auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain base_dir = /var/run/dovecot/ disable_plaintext_auth = no mail_debug = yes mail_fsync = always mail_gid = 5000 mail_location = maildir:~/mailSubDir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = acl mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. separator = . } namespace { list = children location = maildir:%%h/mailSubDir:INDEX=~/mailSubDir/shared/%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/var/maildir/shared-mailboxes sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap lmtp service lmtp { inet_listener lmtp { port = 24 } unix_listener lmtp { user = vmail } } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = acl } protocol lda { mail_plugins = acl } protocol imap { mail_max_userip_connections = 100 mail_plugins = acl imap_acl autocreate }

1 0

Re: [Dovecot] Shared Mailboxes with VirtualUsers and mail_location retrieved from ldap
by mailing lists 09 Sep '11

09 Sep '11

On 09/08/2011 03:07 PM, Timo Sirainen wrote: > On Thu, 2011-09-08 at 12:14 +0100, mailing lists wrote: > >> yes, my virtual users have separate directories for home and mail. >> Their locations are stored in ldap attributes (with random generated >> paths), so a flat scheme like /var/maildr/%%u isn't valid. > > Sorry, you're out of luck with that kind of a setup. Only the %%h can > look up a home directory from LDAP. Maybe some day in future there will > be other variables that can be looked up. and how to I might configure dovecot to use the mail directory as a subdirectory of the home directory? this way all lookups for home (with %%h fetched from ldap) will return the correct locationand mail will be in (i.e.) ~/mailSubDir is this configuration possible?

2 1

[Dovecot] lmtp -- save failed to INBOX: BUG: Unknown internal error
by Jan-Frode Myklebust 09 Sep '11

09 Sep '11

I've had 18 instances of this error the last 24 hours: Sep 8 08:56:00 popimap1 dovecot:: lmtp(10529, first.last(a)example.om) mGdAOtdlaE4hKQAAg/aw4w: msgid=<B8FA3D5B230184409450D51D522678404E5052(a)ASP-EX02.ASP.lan>: save failed to INBOX: BUG: Unknown internal error 17 on lmtp-server A, and one on lmtp-server B. On server A it was a message with 55 recepients, where 17 failed initially -- and the was then successfully delivered. lmtp pid 10529, 08:55:57-08:56:01 - 11 successfull deliveries, 17 BUGs lmtp pid 10609, 08:56:00 - 1 successfull deliveries lmtp pid 31291, 08:56:06 - 2 successfull deliveries lmtp pid 10482, 08:56:04-06 - 3 successfull deliveries lmtp pid 6738, 08:56:06 - 1 successfull deliveries lmtp pid 24488, 08:56:06-07 - 5 successfull deliveries lmtp pid 7101, 08:56:01-07 - 19 successfull deliveries lmtp pid 21330, 08:56:08 - 1 successfull deliveries lmtp pid 2177, 08:56:09 - 3 successfull deliveries lmtp pid 7085, 08:56:10 - 3 successfull deliveries lmtp pid 6633, 08:56:08-10 - 6 successfull deliveries The one on lmtp-server B was a different msgid from A, and also had several recepients (6). It was successfully delivered to the recepient that initially failed the same second. Config here: # 2.0.14: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-194.26.1.el5 x86_64 Red Hat Enterprise Linux Server release 5.5 (Tikanga) auth_verbose = yes auth_verbose_passwords = sha1 disable_plaintext_auth = no mail_gid = 3000 mail_location = maildir:~/:INDEX=/indexes/%1u/%1.1u/%u mail_plugins = quota mail_uid = 3000 mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { quota = maildir:User quota } service auth-worker { user = $default_internal_user } service auth { client_limit = 4396 } service imap-login { inet_listener imap { address = * port = 143 } } service imap { executable = /usr/local/sbin/imap-wrapper.sh process_limit = 2048 } service lmtp { client_limit = 1 inet_listener lmtp { address = * port = 24 } process_limit = 25 } service pop3-login { inet_listener pop3 { address = * port = 110 } } service pop3 { executable = /usr/local/sbin/pop-wrapper.sh process_limit = 2048 } ssl = no userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = quota } protocol imap { imap_client_workarounds = delay-newmail mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = UID%u-%v } -jf

2 7

[Dovecot] copy and empty userA folder1, append to /var/mail/userB
by mathog 08 Sep '11

08 Sep '11

Dovecot 2.0.13 on a 64 bit linux. We have an archiver account on one machine. Most mailing lists that handles go directly to it and everything is fine. However, there is one campus list that will only send to real people. So for that one I subscribed. When one of these messages comes in, which is 1-2x per week, I copy it to an export folder and then manually run a script which does: cat ~me/mail/export >>/var/mail/archiver echo "" > ~me/mail/export That worked fine on our last system, but dovecot doesn't like it. It leaves the imap indices for the export mailbox in an inconsistent state, so that roundcube (through dovecot) refuses to drop messages into it. The error message roundcube emits is: ServerError: Mailbox isn't a valid mbox file. Presumably the second half is from dovecot. I need a supported way to go about this, so that the next time one comes in I can copy to that folder again. The export mailbox is always completely emptied. It would suffice if there was some way to force dovecot to create "empty"" .imap/export: dovecot.index.cache dovecot.index.log files. Note this isn't a problem for the archiver itself, since it doesn't have any imap indexed files. Suggestions? Thank you, David Mathog mathog(a)caltech.edu Manager, Sequence Analysis Facility, Biology Division, Caltech

2 2

Re: [Dovecot] Shared Mailboxes with VirtualUsers and mail_location retrieved from ldap
by mailing lists 08 Sep '11

08 Sep '11

Hello, On 09/07/2011 07:22 PM, Timo Sirainen wrote: > On 6.9.2011, at 14.27, mailing lists wrote: >> At this point I need shared mailboxes but since user mail/home locations are ldap attributes, how is it supposed I must configure this for shared mailboxes? >> >> for the users' mail/home directories I set this line: >> >> user_attrs = mailbox=mail=maildir:/var/maildir/%$,homeFilter=home > > Are home dirs and mail dirs related in any way? The only way you can get it working is by using home dirs, e.g.: > > user_attrs = mailbox=home=/var/maildir/%$ yes, my virtual users have separate directories for home and mail. Their locations are stored in ldap attributes (with random generated paths), so a flat scheme like /var/maildr/%%u isn't valid. for typical (virtual) users the location returned looks like: Sep 8 12:48:33 imap1 dovecot: auth: Debug: ldap(user012,::1): result: mailbox(mail=maildir:/var/maildir/%$)=vol06/1/15/user012 homeFilter(home)=/var/mailfilter/vol06/1/15/user012 ... Sep 8 12:54:50 imap1 dovecot: imap(user012): Debug: maildir++: root=/var/maildir/vol06/1/15/user012, index=, control=, inbox=/var/maildir/vol06/1/15/user012, alt= > Then in dovecot.conf: > > mail_location = maildir:~/ > >> namespace { >> type = shared >> separator = / >> prefix = shared/%%u/ >> subscriptions = no >> list = children > > location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u this is that I see in logs and not shared folders are seen by imap clients: Sep 8 12:57:11 imap1 dovecot: imap(user012): Debug: Namespace : type=shared, prefix=shared.%u., sep=., inbox=no, hidden=no, list=children, subscriptions=no location=maildir:%h/Maildir:INDEX=~/Maildir/shared/%u Sep 8 12:57:11 imap1 dovecot: imap(user012): Debug: shared: root=/var/run/dovecot/, index=, control=, inbox=, alt= Sep 8 12:57:11 imap1 dovecot: imap(user012): Debug: acl: initializing backend with data: vfile I fail to understand how %%u is retrieved from ldap... /----------/ # dovecot -n # 2.0.14: /etc/dovecot/dovecot.conf # OS: Linux 2.6.34.7-0.7-xen x86_64 openSUSE 11.3 (x86_64) auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain base_dir = /var/run/dovecot/ disable_plaintext_auth = no mail_debug = yes mail_fsync = always mail_gid = 5000 mail_location = maildir:~/ mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = acl mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. separator = . } namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/var/maildir/shared-mailboxes sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap ssl = no userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol imap { mail_max_userip_connections = 100 mail_plugins = acl imap_acl autocreate }

2 1

Re: [Dovecot] is it necessary lmtp and director to avoid index corruption in mail delivery?
by mailing lists 08 Sep '11

08 Sep '11

JF, thank you for the reply. I'm just curious how to big players fix this problem, which seems impact systems with shared storage. Have a nice day. On 09/07/2011 12:59 PM, Jan-Frode Myklebust wrote: > On Wed, Sep 07, 2011 at 11:26:28AM +0100, mailing lists wrote: >> Hello all, >> If I have several postfix/dovecot-lda boxes with shared nfs storage, >> how director helps in this scenario? > > The director can help by directing each unique user to the same backend > server for each delivery, which should give you better performance > (indexes cached in memory on only one machine instead of on all, > inotify will work for IMAP NOTIFY), and also avoid some apparent race > conditions that has lead to index corruption when several nodes are > writing to the same mailbox at the same time. > >> is it necesary to use lmtp instead of dovecot-lda? > > Yes. > > >> With postfix/dovecot-lda boxes incoming mail happens at the smtp layer >> but director redirects are working in the lmtp/imap/pop3 layer. > > Right. > > With LMTP you can have dovecot listening on the network (port 24/tcp) > for incoming mail. No need for postfix on the backend mailstorage > servers. > > Our setups has been: > > Mailgw[1-14] ---smtp--> dovecot-server[1-5] (postfix + dovecot/lda) > > and used MX priorities to make all deliveries go to the same > dovecot-server with the others as backup. > > $ dig mx deliver.example.com +short > 10 dove2.example.com. > 15 dove3.example.com. > 20 dove4.example.com. > 25 dove5.example.com. > 5 dove1.example.com. > > > Now I'm moving towards: > > Mailgw[1-14] ---lmtp--> dovecot-server[1-5] (dovecot/lmtp) > > but worry that the index corruption might hit me again.. Ideally > I want: > > Mailgw[1-14] ---lmtp--> directors --lmtp--> dovecot-server[1-5] (dovecot/lmtp) > > but lmtp-proxying seems to have bugs (ref: my latest mails to this > list). > > > -jf

1 0