- dovecot - dovecot.org

[Dovecot] mbox bug in 1.0.0
by bhayden＠umn.edu 01 Aug '07

01 Aug '07

Hi folks. We're moving users from rc24 and 27 to 1.0.0. On four mailboxes so far we've seen these errors after the move (quick and dirty anonymizing follows): Apr 23 13:22:41 server.umn.edu dovecot: [ID 107833 local6.info] imap-login: Login: user=<USER>, pid=<9046>, method=PLAIN, rip=***.***.***.***, lip=***.***.***.***, TLS Apr 23 13:22:41 server.umn.edu dovecot: [ID 107833 local6.error] [9073] IMAP(USER): mbox /var/mail/user: seq=1 uid=8808 uid_broken=0 originally needed 10 bytes, now needs 23 bytes Apr 23 13:22:41 server.umn.edu dovecot: [ID 107833 local6.error] [9073] IMAP(USER): Raw backtrace: 0x7b800 -> 0x43434 -> 0x3e018 -> 0x3fc34 -> 0x40080 -> 0x6d3cc -> 0x29a88 -> 0x21324 -> 0x214c0 -> 0x22f48 -> 0x22ec0 -> 0x230c0 -> 0x81c18 -> 0x814e4 -> 0x2b5cc -> 0x1dc58 Points of interest: 1. I can't reproduce this. It still happens after the user's .imap directories are removed. If I make a copy of the mailbox on another machine running the same version of Dovecot with the same config, the problem doesn't occur. Weird. 2. So far, have only seen it on quite large mailboxes (close to or over 100MB). Most large boxes have not had the problem, but the ones that have are all large. Any thoughts? Dovecot -n output below. -Brian Hayden OIT Internet Services U of Minnesota # dovecot -n # /etc/opt/dovecot/dovecot.conf syslog_facility: local6 protocols: imap imaps pop3 pop3s listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(pop3): *:995 ssl_cert_file: /etc/opt/openssl/certs/dovecot.pem ssl_key_file: /etc/opt/openssl/private/dovecot.pem shutdown_clients: no login_dir: /var/opt/dovecot/run/dovecot/login login_executable(default): /opt/dovecot/libexec/dovecot/imap-login login_executable(imap): /opt/dovecot/libexec/dovecot/imap-login login_executable(pop3): /opt/dovecot/libexec/dovecot/pop3-login login_log_format_elements: user=<%u> pid=<%p> method=%m rip=%r lip=%l %c login_processes_count: 32 login_max_processes_count: 4096 max_mail_processes: 8192 first_valid_uid: 100 default_mail_env: mbox:~/:INBOX=/var/mail/%u mail_location: mbox:~/:INBOX=/var/mail/%u mail_full_filesystem_access: yes mbox_lazy_writes: no mail_executable(default): /opt/dovecot/libexec/dovecot/imap mail_executable(imap): /opt/dovecot/libexec/dovecot/imap mail_executable(pop3): /opt/dovecot/libexec/dovecot/pop3 mail_plugin_dir(default): /opt/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /opt/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /opt/dovecot/lib/dovecot/pop3 mail_log_prefix: [%p] %Us(%u): imap_client_workarounds(default): delay-newmail outlook-idle tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv namespace: type: private separator: / location: mbox:~/:INBOX=/var/mail/%u inbox: yes hidden: yes auth default: username_format: %Lu verbose: yes debug: yes passdb: driver: pam args: session=yes * userdb: driver: passwd

2 4

[Dovecot] dovecot-uidlist locking
by Tony Tsang 01 Aug '07

01 Aug '07

Hi all, I've a dovecot server setup and occassionally clients cannot get mails from their inbox. When I inspect the maildir for that user, there is stale dovecot-uidlist.lock file, and imap process keeps waiting for release of the lock. Is there any other method to perform locking on dovecot-uidlist instead of using dotlock mechanism? It is creating maintenance problems if I need to remove those stale lock files everytime clients hit this problem Tony.

2 2

[Dovecot] user name before and after authentication
by François Wautier 01 Aug '07

01 Aug '07

Hi, I am new to dovecot and spend the last few hours trying to configure it to my liking. I am using version 1.0.2 I have a setup where I only have "virtual" mailboxes in various domain ( mydomain.com, mydomain.biz,...). I setup Exim to deliver the email into <some path>/domains/<domainname>/<user> Now I am trying to get dovecot to access those mailboxes I setup LDAP bind authentication against an AD server. it works fine... but I have a problem getting the correct path to the mailboxes. The user logs in as user(a)domain.ext The mailbox path being at <some path>/domains/%n/%u The LDAP module gets the DN for my user and verify that it can binds, and in the process changes the "user" to cn=<real name>,cn=Users,dc=domain,dc=ext There goes my path To make matter worse, the uid and gid are the same for all users and are fixed (exim user and group). Hence cannot be retrieved from AD I tried to use userdb static, but I can't seem to be able to reset "user" to its pre-authentication value userdb prefetch/ldap but I can't set the uid/gid So here are my request for help... Is there a way to set home dir/ mail dir before authentication? Is there a way to reference the pre-auth user name? Is there a way to create arbitrary variables and used them? Is there a way to fix the uid/gid to use to access the mailboxes? Any one of these could probably solve my problem. Any suggestion is most welcome. François

2 1

[Dovecot] IMAPs and POP3s poxying
by Jason Russler 01 Aug '07

01 Aug '07

Hi All, I have a polotical situation at work that requires that I off-load mail access to a host other than the one our users have configured in their clients. I don't have access to any of the switching or routing to our hosts, and there's only a 1 to 1 relationship between the proxy I want to set up and the actual mail handler. I was looking at the proxying Howto in the Wiki and was presented with an SQL server requirement to do user/ip address look-ups. In my case, it will always be proxying the same host. How would I configure Dovecot to proxy another single system without doing the SQL look-up? Is there a port-forwarding solution that would work better (for POP3s and IMAPS)? These are RedHat 5 hosts so Netfilter is fair game if the protocols allow. Thanks, -Jason

2 1

[Dovecot] apparent bug with filesystem quota and message lists
by Stewart Dean 01 Aug '07

01 Aug '07

Don't know if anyone else uses Berkeley derived filesystem quota, but IBM's AIX does. A little over a week after migrating from UWIMAP to DC (with mbox format unchanged) everything is clean except for this one problem: When users go over quota, when they login the next time, the folder list is blank. You can imagine the panicked calls to the Helpdesk. If their quotas are raised or re-graced, Get Mail returns the expected list. This behavior happens with a variety of clients: Pine, MacMail,TBird, Horde Webmail, etc. The index filesystem has no quota on it. I would have to imagine the Dovecot is using (or trying to use) some space in the quota'ed filesystems which the operating system won't allow, and this results in there being an empty file that DC uses for the message list sent to the client. There are NO messages in syslog (other than the expected login and logout) indicating any problems. Our legacy setup has the inboxes in /var/spool/mail, and the folders in ~/mail. The problem can happen either place. dovecot -n returns: > # 1.0.1: /usr/local/etc/dovecot.conf > listen: *:143 > ssl_listen: *:993 > disable_plaintext_auth: no > login_dir: /var/run/dovecot/login > login_executable: /usr/local/libexec/dovecot/imap-login > login_processes_count: 12 > login_max_processes_count: 774 > verbose_proctitle: yes > first_valid_uid: 200 > mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=/var/dcindx/%u > mbox_dirty_syncs: no > mbox_lazy_writes: no > auth default: > passdb: > driver: pam > userdb: > driver: passwd Suggestions? -- ==== Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

2 2

[Dovecot] Dovecot won't build against recent version of GnuTLS
by Jasper Bryant-Greene 01 Aug '07

01 Aug '07

Hi all, Dovecot won't build against recent versions of GnuTLS. The problem starts on line 34 of src/master/ssl-init-gnutls.c, where Dovecot generates DH params using gnutls_dh_params_generate(), a function which no longer exists [replaced with gnutls_dh_params_generate2()]. I'd fix it myself, but the signature of the function has changed to take gnutls_dh_params_t rather than prime & generator, and I'm not keen on hacking SSL code unless I really understand what's going on. It looks like the code goes on to save & free those values. I'm tracking HG and am happy to test any changes. Appreciate it if someone with more knowledge of GnuTLS and perhaps this code in particular could take a look. Thanks, J

4 3

[Dovecot] pop3 connections hanging
by Arjun Datta 01 Aug '07

01 Aug '07

Hi, dovecot --version 1.0.beta8 dovecot -n login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd It is running with sendmail-8.13.5-3 on FC5 2.6.15-1.2054_FC5 I find that occasionally a pop3 connection will just sit there for hours on end. It will not release the lock on the user mailbox and so mail to that user cannot be delivered. As a result the mailq backs up mostly with mail to that user. Closing the MUA does not help. I have to kill -9 PID the process to clear the hung connection. This happens with both Outlook and Thunderbird. Is there an option in the dovecot configuration that I can set to automatically close connections after say 30 minutes ? In the workaround section it says that it will close connections from Outlook & Outlook Express after 30 minutes dues to an IDLE bug in those 2. Regards, Arjun Datta

3 6

[Dovecot] Dovecot LDAP schema?
by Hadmut Danisch 30 Jul '07

30 Jul '07

Hi, does dovecot define its own LDAP schema or should I create my own one? (I want to provide IMAP boxes for virtual users that do not have a Unix account on the mail server and thus do not want to use the plain uid/gid entries of the posix account objectclass to avoid confusion and accidently giving access to accounts.) regards Hadmut

2 3

[Dovecot] High cpu usage OpenSolaris
by Gary Gendel 29 Jul '07

29 Jul '07

Hi, I've built 64-bit dovecot 1.0.2 on Opensolaris to replace version 1.0.0rc10. It functions fine, but when I connect, it eats up all available cpu. My guess is that the poll thread is running continuously. Any ideas on what I should do to verify this or does anyone know of a fix? Thanks, Gary

1 0

[Dovecot] Shared mailboxes (maildir, symlinks) and permissions
by Andreas Ntaflos 28 Jul '07

28 Jul '07

Hello list, I am trying to set up a public mailbox for users to put spam in so that sa-learn can do its job at night. Only I can't seem to fully understand how and which permissions should be set. I've read [1] and am using Dovecot 1.0.1. First some background information: I do not host or care (at the moment) about virtual users or virtual mail hosting. All users have Unix system accounts and shell access. I'd like to have a Spam folder, say /var/mail/public/.Spam that is a maildir where users can put Spam that got through the server-side filter. Spamassassin's sa-learn runs nightly and learns from the contents of the Spam folder. After reading [1] I think I should have under /var/mail/public a file called dovecot-shared that belongs to root:mail and has permissions 0660 (with user dovecot being a member of group mail) so that it looks like this: root@host:/var/mail/public# ls drwxr-sr-x 2 root mail 4096 2007-07-28 03:29 . drwxrwsr-x 3 root mail 4096 2007-07-28 02:19 .. -rw-rw---- 1 root mail 0 2007-07-28 02:46 dovecot-shared root@host:/var/mail/public# The first question arises: should Dovecot have write access to /var/mail/public itself? Now I should create the Spam folder called /var/mail/public/.Spam. Should this directory be in maildir format, i.e. should it already contain the subdirectories cur, tmp and new? What of the permissions of this directory? I am pretty sure Dovecot needs write access to it, so it should look like this: root@host:/var/mail/public# ls drwxr-sr-x 3 root mail 4096 2007-07-28 03:44 . drwxrwsr-x 3 root mail 4096 2007-07-28 02:19 .. -rw-rw---- 1 root mail 0 2007-07-28 02:46 dovecot-shared drwxrwsr-x 2 root mail 4096 2007-07-28 03:44 .Spam root@host:/var/mail/public# The .Spam directory here is completely empty. Now in a user's Maildir (/home/user1/Maildir) there are the user's private folders; a symlink to /var/mail/public/.Spam should be added: root@host:/home/user1/Maildir# ln -s /var/mail/public/.Spam . root@host:/home/user1/Maildir# ls ... drwx------ 5 user1 user1 4096 2007-07-19 16:14 .INBOX.foo drwx------ 5 user1 user1 4096 2007-07-06 23:01 .INBOX.bar ... lrwxrwxrwx 1 user1 user1 22 2007-07-28 03:51 .Spam -> /var/mail/public/.Spam ... root@host:/home/user1/Maildir# Is that all I have to do? Probably not, because I keep getting errors like the following when connecting (after subscribing of course): Jul 28 03:52:35 host dovecot: IMAP(user1): mkdir(/home/user1/Maildir/.Spam/cur) failed: Permission denied Should I have created the cur, tmp and new subdirectories manually and set their permissions like /var/mail/public/.Spam? But that still wouldn't give user1 write access. If I gave the users (or "others": chmod o+w) write permissions then Dovecot's index files would be owned by the first user that connects to the server and uses that folder. Apparently also not a solution. I also don't think I should have to make my users members of the mail group, but I could be wrong here. So I am not sure what I am missing, or if what I want to do is at all possible (without taking out the sledgehammer and setting all permissions to 0777). I also apologise for this lengthy post with many details and little interesting questions. It's getting late and I fear I've reached a dead end. I'd really appreciate it if someone knowledgeable could point me in the right direction here. Thanks in advance! Andreas [1] http://wiki.dovecot.org/SharedMailboxes -- Andreas "daff" Ntaflos Vienna, Austria GPG Fingerprint: 6234 2E8E 5C81 C6CB E5EC 7E65 397C E2A8 090C A9B4

2 1