- dovecot - dovecot.org

[Dovecot] INBOX lost in virtual namespace
by Xueron Nee 16 Apr '09

16 Apr '09

Hi, I have set a virtual namespace to create Virtual POP3 INBOX follow: http://wiki.dovecot.org/Plugins/Virtual dovecot.conf: mail_location = maildir:~/Maildir # default namespace namespace private { separator = / prefix = list = yes hidden = no subscriptions = yes } # virtual mailbox, for pop3 namespace private { separator = / prefix = virtual/ location = virtual:~/Maildir/virtual:LAYOUT=maildir++ list = no hidden = yes } # Copy of the default namespace. We'll use this in dovecot-virtual file. namespace private { separator = / prefix = secret/ list = no hidden = yes subscriptions = no } # cat ~/Maildir/virtual/.INBOX/dovecot-virtual secret/* all but, the INBOX lost in secret/ namespace :( When list in IMAP: a1 list "" "*" * LIST (\HasNoChildren) "/" "Sent" * LIST (\HasNoChildren) "/" "Spam" * LIST (\HasNoChildren) "/" "Junk" * LIST (\HasNoChildren) "/" "Draft" * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "INBOX" a1 OK List completed. a1 list "secret/" "*" * LIST (\HasNoChildren) "/" "secret/Sent" * LIST (\HasNoChildren) "/" "secret/Spam" * LIST (\HasNoChildren) "/" "secret/Junk" * LIST (\HasNoChildren) "/" "secret/Draft" * LIST (\HasNoChildren) "/" "secret/Trash" a1 OK List completed. INBOX lost, So, the virtual namespace for POP3 cannot see the messages in IMAP's INBOX. Am I doing anything wrong? Thanks.. -- Xueron Nee http://www.xueron.com

2 1

[Dovecot] Can virtual mailboxes created automatically?
by Xueron Nee 16 Apr '09

16 Apr '09

Hi, I set a virtual namespace, and for new users, there is no root dir for it. namespace private { separator = / prefix = virtual/ location = virtual:~/Maildir/virtual list = no hidden = yes } log: Apr 10 12:14:41 mail dovecot: IMAP(test1@xueron.com):Namespace 'virtual/': virtual: Root mail directory doesn't exist:/home/data/test1@xueron.com/Maildir/virtual Apr 10 12:14:41 mail dovecot: Fatal: IMAP(test1(a)xueron.com): Namespace initialization failed Apr 10 12:15:27 mail dovecot: Killed with signal 15 (by pid=26918 uid=0 code=kill) How to do then? Thanks :) -- Xueron Nee http://www.xueron.com

2 3

[Dovecot] help with ldap config
by Ricardo Kleemann 16 Apr '09

16 Apr '09

Hi, I've been using courier with ldap and I'm trying to configure dovecot to do the same. I'm not exactly sure how to setup the ldap binds and filters... Here's my dovecot info: # 1.0.10: /etc/dovecot/dovecot.conf log_path: /var/log/dovecot.log log_timestamp: %Y-%m-%d %H:%M:%S login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail mail_debug: yes auth default: verbose: yes debug: yes passdb: driver: pam passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap-userdb.conf plugin: quota: maildir $ sudo grep -v '^ *$#.*$\?$' /etc/dovecot/dovecot-ldap.conf uris = ldap://ldap dn = cn=admin, dc=americasnet, dc=com dnpass = xxxxx auth_bind = yes auth_bind_userdn = uid=%u,ou=%d,dc=americasnet,dc=com ldap_version = 3 base = uid=%u,ou=%d,dc=americasnet,dc=com user_filter = (&(objectClass=posixAccount)(uid=%u,ou=%d)) So I try to login with an LDAP user, say ricardo(a)domain.com. This is how it exists in the database. It's accessed as: uid=ricardo(a)domain.com,ou=domain.com,dc=americasnet,dc=com This is what I get in the error log: dovecot: 2009-04-11 11:36:07 Info: auth(default): client in: AUTH 1 PLAIN service=IMAP secured lip=127.0.0.1 rip=127.0.0.1 resp=<hidden> dovecot: 2009-04-11 11:36:07 Info: auth(default): pam(ricardo(a)domain.com,127.0.0.1): lookup service=dovecot dovecot: 2009-04-11 11:36:11 Info: auth(default): pam(ricardo(a)domain.com,127.0.0.1): pam_authenticate() failed: User not known to the underlying authentication module dovecot: 2009-04-11 11:36:11 Info: auth(default): ldap(ricardo(a)domain.com,127.0.0.1): bind: dn=uid=ricardo(a)domain.com,ou=domain.com,dc=americasnet,dc=com dovecot: 2009-04-11 11:36:11 Info: auth(default): client out: OK 1 user=ricardo(a)domain.com dovecot: 2009-04-11 11:36:11 Info: auth(default): master in: REQUEST 1 5398 1 dovecot: 2009-04-11 11:36:11 Info: auth(default): ldap(ricardo(a)domain.com,127.0.0.1): user search: base=uid=ricardo(a)domain.com,ou=domain.com,dc=americasnet,dc=com scope=subtree filter=(&(objectClass=posixAccount)(uid=ricardo(a)domain.com,ou=domain.com)) fields=uid,homeDirectory,uidNumber,gidNumber dovecot: 2009-04-11 11:36:11 Error: auth(default): ldap(ricardo(a)domain.com,127.0.0.1): Authenticated user not found dovecot: 2009-04-11 11:36:11 Error: auth(default): userdb(ricardo(a)domain.com,127.0.0.1): user not found from userdb dovecot: 2009-04-11 11:36:11 Info: auth(default): master out: NOTFOUND 1 dovecot: 2009-04-11 11:36:11 Info: imap-login: Internal login failure: user=<ricardo(a)domain.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured

3 6

Re: [Dovecot] auth-master: Permission denied [sigh]
by James Butler 15 Apr '09

15 Apr '09

Here is everything I could think of that might pertain to this, as currently configured on my dedicated server. It's all fresh! :) ## SYSTEM ## Fedora 10 Postfix 2.55 Dovecot 1.2.rc2 Spamassassin 3.2.5 SELinux (no SELinux restrictions. Testing done with SELinux=permissive.) SASLAuthd (not required for local delivery) ## dovecot -n ## # 1.2.rc2: /usr/local/etc/dovecot.conf # OS: Linux 2.6.27.15-170.2.24.fc10.i686 i686 Fedora rel 10 (Cambridge) protocols: imaps listen: *:993 ssl_cert_file: /etc/pki/dovecot/certs/dovecot.pem ssl_key_file: /etc/pki/dovecot/private/dovecot.pem login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login first_valid_gid: 0 mail_location: maildir:~/Maildir auth default: passdb: driver: pam userdb: driver: passwd ## /usr/local/etc/dovecot.conf ## socket listen { master { path = /var/run/dovecot/auth-master mode = 0666 # user = group = dovecot } client { path = /var/run/dovecot/auth-client mode = 0666 # user = group = dovecot } } ## POSTFIX CONFIG ## /etc/postfix/main.cf: mailbox_transport = spamassassin /etc/postfix/master.cf: spamassassin unix - n n - - pipe user=spam:dovecot argv=/usr/bin/spamc -f -e /usr/libexec/dovecot/deliver -f ${sender} -d ${user} -m ${extension} ## PERMISSIONS / OWNERSHIP ## /usr/local/libexec/dovecot: -rwxr-xr-x 1 root root 197513 2009-04-03 13:52 checkpassword-reply -rwxr-xr-x 1 root dovecot 4044835 2009-04-14 13:52 deliver -rwxr-xr-x 1 root root 1044608 2009-04-03 13:52 dovecot-auth /var/run: drwxrwxrwx 3 root dovecot 4096 2009-04-14 12:07 dovecot /var/run/dovecot: drwxr-x--- 2 root dovecot 4096 2009-04-09 06:56 login /usr/bin/spamassassin: -rwxr-xr-x 1 root root 27023 2008-09-04 14:51 spamassassin /home/user: drwx------ 4 user dovecot 4096 2009-04-14 12:00 user ## 'ps aux' OUTPUT (trimmed) ## root Ss 11:14 0:02 /usr/local/sbin/dovecot root S 12:07 0:00 dovecot-auth root S 12:07 0:00 dovecot-auth -w root Ss 11:14 0:31 /usr/bin/spamd -d -c -m5 -H --username spam -r \ /var/run/spamd.pid spam S 11:14 0:27 spamd child spam S 11:14 0:08 spamd child ## 'ps aux | grep deliver' numerous times until I caught one: ## postfix S 12:47 0:00 pipe -n spamassassin -t unix user=spam:dovecot \ argv=/usr/bin/spamc -f -e /usr/libexec/dovecot/deliver -f ${sender} \ -d ${user} -m ${extension} spam Ss 12:47 0:00 /usr/bin/spamc -f -e /usr/libexec/dovecot/deliver \ -f sender(a)example.com -d user -m ## /var/log/maillog OUTPUT ## Apr 14 14:53:15 ltfs450 postfix/smtpd[23173]: connect from \ IP-ADD-RES-SS.dedicatedprovider.com[IP.ADD.RES.SS] Apr 14 14:53:15 ltfs450 postfix/smtpd[23173]: C7FB9FA00FA: \ client=IP-ADD-RES-SS.dedicatedprovider.com[IP.ADD.RES.SS] Apr 14 14:53:15 ltfs450 postfix/cleanup[23177]: C7FB9FA00FA: \ message-id=<49E4EA41.6020908(a)example-send.com> Apr 14 14:53:15 ltfs450 postfix/qmgr[23171]: C7FB9FA00FA: \ from=<sender(a)example-send.com>, size=2215, nrcpt=1 (queue active) Apr 14 14:53:15 ltfs450 postfix/smtpd[23173]: disconnect from \ IP-ADD-RES-SS.dedicatedprovider.com[IP.ADD.RES.SS] Apr 14 14:53:16 ltfs450 spamd[4121]: spamd: connection from \ localhost.localdomain [127.0.0.1] at port 50035 Apr 14 14:53:16 ltfs450 spamd[4121]: spamd: processing message \ <49E4EA41.6020908(a)example-send.com> for spam:653 Apr 14 14:53:20 ltfs450 spamd[4121]: spamd: clean message (2.2/5.0) \ for spam:653 in 4.7 seconds, 2167 bytes. Apr 14 14:53:21 ltfs450 spamd[4121]: spamd: result: . 2 - \ AWL,RDNS_DYNAMIC,TVD_SPACE_RATIO scantime=4.7,size=2167,user=spam,\ uid=653,required_score=5.0,rhost=localhost.localdomain,raddr=127.0.0.1,\ rport=50035,mid=<49E4EA41.6020908(a)example-send.com>,autolearn=no Apr 14 14:53:21 ltfs450 deliver(user): Can't connect to auth server \ at /var/run/dovecot/auth-master: Permission denied Apr 14 14:53:21 ltfs450 postfix/pipe[23179]: C7FB9FA00FA: \ to=<user(a)example-receive.com>, relay=spamassassin, delay=5.2, \ delays=0.01/0.01/0/5.2, dsn=4.3.0, status=deferred (temporary failure) Apr 14 14:53:21 ltfs450 spamd[4119]: prefork: child states: II

2 2

Re: [Dovecot] auth-master: Permission denied [sigh]
by James Butler 15 Apr '09

15 Apr '09

Oh, that was fun. Making the change below resulted in mail getting deferred with "Fatal: destination user parameter (-d user) not given" ... which apparently is caused by running deliver as 'root'! (http://archive.netbsd.se/?ml=dovecot-general&a=2008-02&t=6558196) So I am back to: -rwxr-xr-x 1 root dovecot 4044835 2009-04-03 13:52 deliver which doesn't produce the error and delivers the mail. Still no joy with Postfix+Spamassassin+Dovecot. This is unbelievably hard to get going. I started with the default installations of everything on a brand new system. I only made minimal changes as indicated by the docs. Then I made small changes as indicated by this and other mailing lists. I always reverted back to the original defaults between each effort. Now I'm just stumped. I'm not a newbie ... I've been administrating public servers for over 10 years, and using and working on the Internet since 1968! This is just the first time I've tried to use Postfix+Spamassassin+Dovecot. Previous installations have all used Sendmail+Spamassassin+Dovecot with zero issues. I want the benefits of using the Maildir storage system, but the past two weeks of trying to get this going are making me question whether that benefit is worth it. Can anyone please post their successful Postfix+Spamassassin+Dovecot setup for me to learn from? I would really appreciate it. James > I have changed /usr/local/libexec/dovecot/deliver permissions as follows: > > -rwsr-s--- 1 root dovecot 4044835 2009-04-03 13:52 deliver > > Because of message returned to 'sender(a)example-send.com': > > "local configuration error. Command output: > /usr/local/libexec/dovecot/deliver must not be both world-executable and > setuid-root. This allows root exploits. See [LDA#multipleuids wiki page]." > > Same auth-master "Permission denied" error. > > Thanks again. > > James

3 5

Re: [Dovecot] auth-master: Permission denied [sigh]
by James Butler 14 Apr '09

14 Apr '09

I have changed /usr/local/libexec/dovecot/deliver permissions as follows: -rwsr-s--- 1 root dovecot 4044835 2009-04-03 13:52 deliver Because of message returned to 'sender(a)example-send.com': "local configuration error. Command output: /usr/local/libexec/dovecot/deliver must not be both world-executable and setuid-root. This allows root exploits. See [LDA#multipleuids wiki page]." Same auth-master "Permission denied" error. Thanks again. James

2 1

[Dovecot] auth-master: Permission denied [sigh]
by James Butler 14 Apr '09

14 Apr '09

I've been messing with this for too long, now, and I'm blind to whatever's wrong. Or I'm simply being dense. Either way, I need help with a common issue. I'm trying to get Postfix+Spamassassin+Dovecot going on Fedora 10. (I'll get back to the global Sieve thingy soon, but I need to get this going, first.) When using the simple: mailbox_command = /usr/local/libexec/dovecot/deliver everything is cool, except there's no Spamassassin involvement, obviously. The problem shows itself when the Spamassassin user hands off to the recipient user and Deliver + the recipient user tries to access /var/run/dovecot/auth-master. Thank you for any insight you can provide. /var/run/dovecot: 755 root:dovecot /var/run/dovecot/login: 750 root:dovecot /var/run/dovecot/auth-master: 750 root:dovecot (I think. auth-master is a temporary file? Comes and goes.) >From /etc/postfix/main.cf mailbox_transport = spamassassin >From /etc/postfix/master.cf: spamassassin unix - n n - - pipe user=spam argv=/usr/bin/spamc -f -e /usr/libexec/dovecot/deliver -f ${sender} -d ${user} -m ${extension} Here's my 'socket listen' section from /usr/local/etc/dovecot.conf: socket listen { master { path = /var/run/dovecot/auth-master mode = 0666 #user = group = dovecot } client { path = /var/run/dovecot/auth-client mode = 0666 #user = group = dovecot } } >From /var/log/maillog: Postfix receives the message: postfix/smtpd[29447]: connect from \ IP-ADD-RE-SS.ptr.example-send.com[IP.ADD.RE.SS] postfix/smtpd[29447]: 60990FA01BA: \ client=IP-ADD-RE-SS.ptr.example-send.com[IP.ADD.RE.SS] postfix/cleanup[29451]: 60990FA01BA: \ message-id=<49E20BF2.4090408(a)example-send.com> postfix/qmgr[29441]: 60990FA01BA: from=<sender(a)example-send.com>, \ size=812, nrcpt=1 (queue active) postfix/smtpd[29447]: disconnect from \ IP-ADD-RE-SS.ptr.example-send.com[IP.ADD.RE.SS] Spamassassin processes the message as user 'spam': spamd[4121]: spamd: processing message\ <49E20BF2.4090408(a)example-send.com> for spam:653 spamd[4121]: spamd: clean message (3.0/5.0) for spam:653 in 5.2 seconds,\ 793 bytes. spamd[4121]: spamd: result: . 2 - RDNS_DYNAMIC,TVD_SPACE_RATIO \ scantime=5.2,size=793,user=spam,uid=653,required_score=5.0, \ rhost=localhost.localdomain,raddr=127.0.0.1,rport=42493, \ mid=<49E20BF2.4090408(a)example-send.com>,autolearn=no Spamassassin pipes result to Deliver which runs as recipient user. Deliver as recipient user doesn't have permission to auth: deliver(recipient): Can't connect to auth server at \ /var/run/dovecot/auth-master: Permission denied postfix/pipe[29452]: 60990FA01BA: to=<recipient(a)example-receive.com>, \ relay=spamassassin, delay=6, delays=0.33/0.01/0/5.7, dsn=4.3.0, \ status=deferred (temporary failure) 1) I must use the 'user=' arg for spamc 2) Can't use 'user=${user}' or $user: fatal: get_service_attr: unknown username: ${user} 3) Must use '-d ${user}' Deliver arg, otherwise message gets delivered to user 'spam' AArrgh! TIA.

4 9

[Dovecot] uw-imap to dovecot conversion tool
by Joe Pruett 14 Apr '09

14 Apr '09

i plan to switch from uw-imap to dovecot on a couple of medium size systems and so i have written a conversion tool that understands mbox, mbx, and mix formats and converts to maildir format while trying to preserve uid info, keywords, flags, subscriptions, etc. it seems to work for me now, but i think some feedback might be useful. so if you have some files to convert and a desire to help, please download: http://www.spiretech.com/~joey/uw2dovecot.pl and give it a whirl. it is very sparsely documented right now but isn't too complex (yet). by default it copies your INBOX, mail dir, and .mailboxlist info into Maildir. those filenames can be overridden. i'd suggest running with -v to watch it. it requires that the output directory not exist before starting, so it should be relatively safe. it doesn't lock any files being read, so an active uw tree could cause it indigestion. it's designed to run while inbound mail and pop/imap sessions are disabled. it uses a few perl modules, but they should be standard with perl itself. it does do everthing in memory, so the largest message you have will be in memory and will be duplicated at least once as crlf pairs are replaced. also, this assumes you'll change the uid format in dovecot.conf to %08Xu%08Xv so that it doesn't change uids for the clients. send feedback to me and cc the list if you feel it useful. once this is stable, i'll get it added to the dovecot wiki.

2 2

[Dovecot] why not install utils (idxview logview ...) with dovecot in bin/sbin dir?
by Xueron Nee 14 Apr '09

14 Apr '09

Hi, I just found these useful tools :) they were installed in libexec dir :) -- Xueron Nee http://www.xueron.com

3 4

[Dovecot] Handling ENFILE
by Mike Abbott 14 Apr '09

14 Apr '09

My mail server consumed all of its configured file table slots and started returning ENFILE ("Too many open files in system") for many operations. This wreaked havoc with dovecot-1.1.13. Here are some areas where dovecot should detect and more gracefully handle ENFILE error returns: 1. Deliver should report an error more helpful than "Unknown internal error" when fdatasync_path fails: deliver(user): Apr 10 14:53:20 Error: fdatasync_path(/Volumes/MailData/ user/new) failed: Too many open files in system deliver(user): Apr 10 14:53:20 Info: msgid=<...>: save failed to INBOX: BUG: Unknown internal error 2. Index files should not be fscked when they could not be opened due to ENFILE: Error: IMAP(user): open() failed with index file /Volumes/MailData/ user/.Deleted Messages/dovecot.index: Too many open files in system Warning: IMAP(user): fscking index file /Volumes/MailData/ user/.Deleted Messages/dovecot.index 3. Dovecot should not crash when mail transaction logs become corrupt, or appear to have become corrupt due to ENFILE. Here is a sequence of error messages from the log but I can't tell whether the IMAP ones up through the panic in the middle are all from the same process, or from different processes. deliver(user): Apr 10 14:55:32 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:55:54 Error: open() failed with index file / Volumes/MailData/user/dovecot.index: Too many open files in system deliver(user): Apr 10 14:55:54 Error: open() failed with file /Volumes/ MailData/user/dovecot.index.log.2: Too many open files in system deliver(user): Apr 10 14:55:57 Error: open() failed with index cache file /Volumes/MailData/user/dovecot.index.cache: Too many open files in system dovecot: Apr 10 14:56:08 Warning: IMAP(user): fscking index file / Volumes/MailData/user/dovecot.index dovecot: Apr 10 14:56:16 Error: IMAP(user): Fixed index file /Volumes/ MailData/user/dovecot.index: log_file_seq 15 -> 2 deliver(user): Apr 10 14:56:19 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:56:20 Error: Corrupted transaction log file / Volumes/MailData/user/dovecot.index.log seq 2: record size too small (type=0x0, offset=23088, size=0) (sync_offset=36848) deliver(user): Apr 10 14:56:20 Warning: fscking index file (in-memory index) deliver(user): Apr 10 14:56:21 Info: msgid=<...>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2009-04-10 14:56:20] dovecot: Apr 10 14:56:40 Panic: IMAP(user): file mail-transaction-log- view.c: line 103 (mail_transaction_log_view_set): assertion failed: (min_file_seq <= max_file_seq) dovecot: Apr 10 14:56:40 Error: IMAP(user): Raw backtrace: [see below for better backtrace] deliver(user): Apr 10 14:56:45 Error: Transaction log file /Volumes/ MailData/user/dovecot.index.log: marked corrupted deliver(user): Apr 10 14:57:04 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:57:23 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:57:49 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:58:21 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:58:41 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:59:09 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:59:28 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:59:43 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 15:00:57 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 15:03:01 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 15:03:27 Info: msgid=<...>: saved mail to INBOX dovecot: Apr 10 15:21:41 Error: IMAP(user): Corrupted transaction log file /Volumes/MailData/user/dovecot.index.log seq 2: Invalid transaction log size (36848 vs 23088): /Volumes/MailData/user/ dovecot.index.log (sync_offset=36848) dovecot: Apr 10 15:21:42 Info: imap-login: Login: user=<user>, method=CRAM-MD5, rip=..., lip=..., TLS The backtrace for the assertion failure was: 0 libSystem.B.dylib 0x00007fff8007c102 __kill + 10 1 libSystem.B.dylib 0x00007fff800f7ffc abort + 83 2 imap 0x000000010006a22e default_fatal_finish + 70 3 imap 0x000000010006a27c i_syslog_fatal_handler + 0 4 imap 0x00000001000699db i_info + 0 5 imap 0x0000000100058542 mail_transaction_log_view_set + 104 6 imap 0x0000000100053b4c view_sync_set_log_view_range + 125 7 imap 0x0000000100053fc5 mail_index_view_sync_begin + 378 8 imap 0x000000010003c26e index_mailbox_sync_init + 129 9 imap 0x0000000100018457 maildir_storage_sync_init + 229 10 imap 0x000000010000c6bb imap_sync_init + 132 11 imap 0x000000010000c90d cmd_sync_delayed + 477 12 imap 0x000000010000716a client_handle_input + 409 13 imap 0x0000000100007244 client_input + 148 14 imap 0x0000000100071228 io_loop_handler_run + 272 15 imap 0x00000001000705ed io_loop_run + 55 16 imap 0x000000010000e219 main + 1635 17 imap 0x00000001000016c0 start + 52 I have since configured more open files, and enabled core dumps and added the pid to the mail_log_prefix for better tracking, but this is all I have to work with for now. Too bad the values of min_file_seq and max_file_seq are not logged in the panic.

2 1