- dovecot - dovecot.org

[Dovecot] mbox inbox default
by bhayden＠umn.edu 01 Aug '07

01 Aug '07

HI Timo & all. We're an mbox environment, inboxes in /var/mail/$USER (I'll include dovecot -n output at the bottom of this mail). mail_location is set accordingly for deliver. I'd assumed that if the /var/mail/$USER file doesn't exist, dovecot would create it, but we've discovered from experience (and I verified it in mbox-storage.c) that if access(path, R_OK|W_OK) fails--as it does if the file doesn't exist--that dovecot defaults then to delivering in root_dir/inbox. I'm curious why this is. It seems like if the configured INBOX file doesn't exist, dovecot should create it if possible; it's a different case than if, say, the user doesn't have write access to that directory, in which case it of course would be appropriate to fall back to some other location rather than rejecting mail. Is there something I'm missing that makes my idea wrong? Thanks, -Brian Hayden OIT Internet Services University of MN # ./dovecot -n # /etc/opt/dovecot/dovecot.conf syslog_facility: local6 protocols: imap imaps pop3 pop3s listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(pop3): *:995 ssl_cert_file: /etc/opt/openssl/certs/dovecot.pem ssl_key_file: /etc/opt/openssl/private/dovecot.pem shutdown_clients: no login_dir: /var/opt/dovecot/run/dovecot/login login_executable(default): /opt/dovecot/libexec/dovecot/imap-login login_executable(imap): /opt/dovecot/libexec/dovecot/imap-login login_executable(pop3): /opt/dovecot/libexec/dovecot/pop3-login login_log_format_elements: user=<%u> pid=<%p> method=%m rip=%r lip=%l %c login_processes_count: 32 login_max_processes_count: 6000 max_mail_processes: 8192 first_valid_uid: 100 mail_location: mbox:~:INBOX=/var/mail/%u:INDEX=/var/mail/.dovecot-index/%1u/%u/ mail_debug: yes mbox_lazy_writes: no mail_executable(default): /opt/dovecot/libexec/dovecot/mail_path.sh mail_executable(imap): /opt/dovecot/libexec/dovecot/mail_path.sh mail_executable(pop3): /opt/dovecot/libexec/dovecot/pop3 mail_plugins(default): acl mail_plugins(imap): acl mail_plugins(pop3): mail_plugin_dir(default): /opt/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /opt/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /opt/dovecot/lib/dovecot/pop3 mail_log_prefix: [%p] %Us(%u): mail_log_max_lines_per_sec: 0 imap_client_workarounds(default): delay-newmail outlook-idle tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv namespace: type: private separator: / location: mbox:~:INBOX=/var/mail/%u:INDEX=/var/mail/.dovecot-index/%1u/%u/ inbox: yes namespace: type: private separator: / prefix: mail/ location: mbox:~/mail/:INDEX=/var/mail/.dovecot-index/%1u/%u/ hidden: yes namespace: type: private separator: / prefix: ~/mail/ location: mbox:~/mail/:INDEX=/var/mail/.dovecot-index/%1u/%u/ hidden: yes namespace: type: private separator: / prefix: ~%u/mail/ location: mbox:~/mail/:INDEX=/var/mail/.dovecot-index/%1u/%u/ hidden: yes namespace: type: private separator: / prefix: Shared/ location: maildir:~/Maildir/Shared/:INDEX=/var/mail/.dovecot-index/%1u/%u/shared:CONTROL=/var/mail/.dovecot-index/%1u/%u/shared-control auth default: username_format: %Lu passdb: driver: pam args: session=yes * userdb: driver: passwd plugin: acl: vfile:

2 2

[Dovecot] High cpu usage OpenSolaris
by Gary Gendel 01 Aug '07

01 Aug '07

All, Nevermind... I discovered the problem. It was in the Solaris Sun Studio 12 compiler. I created a debug version to begin testing, but that version worked without sucking up the cpu. So it looks like the optimizer messed up. If I used the -fast optimization, it sucks up cpu, but with -xO5 all is well. Gary --------------------------------------------------------------------- Hi, I've built 64-bit dovecot 1.0.2 on Opensolaris to replace version 1.0.0rc10. It functions fine, but when I connect, it eats up all available cpu. My guess is that the poll thread is running continuously. Any ideas on what I should do to verify this or does anyone know of a fix? Thanks, Gary

4 4

[Dovecot] RFE: please include quota waning patch
by Farkas Levente 01 Aug '07

01 Aug '07

hi, it'd be very useful to include the quota warning patch in official release. without it the quota support is not really useful since mail simple dropped when quota is over. and most enduser never know what happend, they just recognize mails are not coming:-( thanks. -- Levente "Si vis pacem para bellum!"

4 5

[Dovecot] Missing MIME-Version header in e-mails.
by Tan Shao Yi 01 Aug '07

01 Aug '07

Hi, I notice that in src/lib-mail/message-parser.c, there is a section of code that checks for the presence of MIME-Version before allowing processing of the Content-* headers. Is there a possibility of relaxing this rule? There are some broken mailers, in particular newsletter mailers that do not seem to honour the MIME-Version header, though they do send the Content-Type. Cheers.

2 1

[Dovecot] Mount options and NFS: just checking...
by Mike Brudenell 01 Aug '07

01 Aug '07

Greetings - I'm now in the last couple of weeks before going live with Dovecot (v1.0.3) on our revamped IMAP service. I'd like to double-check about the best mount options to use; could someone advise, please? I have three separate directory trees for the message store, the control files and the index files. These are arranged as follows: Message Store Mounted over NFS from a NetApp filer; filestore quotas are ENABLED. Control Files Mounted over NFS from the NetApp filer; filestore quotas are DISABLED. Index Files Mounted on local disk; filestore quotas are DISABLED. We will have a pair of Solaris 10 servers on which Dovecot 1.0.3 is running. Users are normally directed to their "preferred" server but, if it is unavailable, will go via the other server. Q1. Am I right in thinking that for the Message Store and Control Files I should NFS-mount both of them with the "actimeo=0"? (Or would "noac" be better, which also turns off client write- caching as well as the attribute cache?) Q2. Should I NFS-mount either or both of the Message Store and Control Files with the "noxattr" option to turn off extended attributes? Q3. Which of the filestores should I mount with the "noatime" option? (I understand that for the filer-based NFS mounts this can be done on the filer, as the option isn't available with "mount" for NFS-monted filestores.) Q4. Any other options to use/miss out? Currently my understanding from the list and the NFS page at the Wiki is: A1. Use "actimeo=0" for both Message Store and Control Files. No idea about the need for/impact of using "noac". A2. No idea. A3. Safe to use "noatime" for all three filestores. (I understand Dovecot will use utime() when needed on such filestores, but am not sure if it will work on the NFS-mounted filestores from the filer if access times are turned off at the filer end.) Any thoughts, please? Cheers, Mike B-) -- The Computing Service, University of York, Heslington, York Yo10 5DD, UK Tel:+44-1904-433811 FAX:+44-1904-433740 * Unsolicited commercial e-mail is NOT welcome at this e-mail address. *

2 3

[Dovecot] mbox bug in 1.0.0
by bhayden＠umn.edu 01 Aug '07

01 Aug '07

Hi folks. We're moving users from rc24 and 27 to 1.0.0. On four mailboxes so far we've seen these errors after the move (quick and dirty anonymizing follows): Apr 23 13:22:41 server.umn.edu dovecot: [ID 107833 local6.info] imap-login: Login: user=<USER>, pid=<9046>, method=PLAIN, rip=***.***.***.***, lip=***.***.***.***, TLS Apr 23 13:22:41 server.umn.edu dovecot: [ID 107833 local6.error] [9073] IMAP(USER): mbox /var/mail/user: seq=1 uid=8808 uid_broken=0 originally needed 10 bytes, now needs 23 bytes Apr 23 13:22:41 server.umn.edu dovecot: [ID 107833 local6.error] [9073] IMAP(USER): Raw backtrace: 0x7b800 -> 0x43434 -> 0x3e018 -> 0x3fc34 -> 0x40080 -> 0x6d3cc -> 0x29a88 -> 0x21324 -> 0x214c0 -> 0x22f48 -> 0x22ec0 -> 0x230c0 -> 0x81c18 -> 0x814e4 -> 0x2b5cc -> 0x1dc58 Points of interest: 1. I can't reproduce this. It still happens after the user's .imap directories are removed. If I make a copy of the mailbox on another machine running the same version of Dovecot with the same config, the problem doesn't occur. Weird. 2. So far, have only seen it on quite large mailboxes (close to or over 100MB). Most large boxes have not had the problem, but the ones that have are all large. Any thoughts? Dovecot -n output below. -Brian Hayden OIT Internet Services U of Minnesota # dovecot -n # /etc/opt/dovecot/dovecot.conf syslog_facility: local6 protocols: imap imaps pop3 pop3s listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(pop3): *:995 ssl_cert_file: /etc/opt/openssl/certs/dovecot.pem ssl_key_file: /etc/opt/openssl/private/dovecot.pem shutdown_clients: no login_dir: /var/opt/dovecot/run/dovecot/login login_executable(default): /opt/dovecot/libexec/dovecot/imap-login login_executable(imap): /opt/dovecot/libexec/dovecot/imap-login login_executable(pop3): /opt/dovecot/libexec/dovecot/pop3-login login_log_format_elements: user=<%u> pid=<%p> method=%m rip=%r lip=%l %c login_processes_count: 32 login_max_processes_count: 4096 max_mail_processes: 8192 first_valid_uid: 100 default_mail_env: mbox:~/:INBOX=/var/mail/%u mail_location: mbox:~/:INBOX=/var/mail/%u mail_full_filesystem_access: yes mbox_lazy_writes: no mail_executable(default): /opt/dovecot/libexec/dovecot/imap mail_executable(imap): /opt/dovecot/libexec/dovecot/imap mail_executable(pop3): /opt/dovecot/libexec/dovecot/pop3 mail_plugin_dir(default): /opt/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /opt/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /opt/dovecot/lib/dovecot/pop3 mail_log_prefix: [%p] %Us(%u): imap_client_workarounds(default): delay-newmail outlook-idle tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv namespace: type: private separator: / location: mbox:~/:INBOX=/var/mail/%u inbox: yes hidden: yes auth default: username_format: %Lu verbose: yes debug: yes passdb: driver: pam args: session=yes * userdb: driver: passwd

2 4

[Dovecot] dovecot-uidlist locking
by Tony Tsang 01 Aug '07

01 Aug '07

Hi all, I've a dovecot server setup and occassionally clients cannot get mails from their inbox. When I inspect the maildir for that user, there is stale dovecot-uidlist.lock file, and imap process keeps waiting for release of the lock. Is there any other method to perform locking on dovecot-uidlist instead of using dotlock mechanism? It is creating maintenance problems if I need to remove those stale lock files everytime clients hit this problem Tony.

2 2

[Dovecot] user name before and after authentication
by François Wautier 01 Aug '07

01 Aug '07

Hi, I am new to dovecot and spend the last few hours trying to configure it to my liking. I am using version 1.0.2 I have a setup where I only have "virtual" mailboxes in various domain ( mydomain.com, mydomain.biz,...). I setup Exim to deliver the email into <some path>/domains/<domainname>/<user> Now I am trying to get dovecot to access those mailboxes I setup LDAP bind authentication against an AD server. it works fine... but I have a problem getting the correct path to the mailboxes. The user logs in as user(a)domain.ext The mailbox path being at <some path>/domains/%n/%u The LDAP module gets the DN for my user and verify that it can binds, and in the process changes the "user" to cn=<real name>,cn=Users,dc=domain,dc=ext There goes my path To make matter worse, the uid and gid are the same for all users and are fixed (exim user and group). Hence cannot be retrieved from AD I tried to use userdb static, but I can't seem to be able to reset "user" to its pre-authentication value userdb prefetch/ldap but I can't set the uid/gid So here are my request for help... Is there a way to set home dir/ mail dir before authentication? Is there a way to reference the pre-auth user name? Is there a way to create arbitrary variables and used them? Is there a way to fix the uid/gid to use to access the mailboxes? Any one of these could probably solve my problem. Any suggestion is most welcome. François

2 1

[Dovecot] IMAPs and POP3s poxying
by Jason Russler 01 Aug '07

01 Aug '07

Hi All, I have a polotical situation at work that requires that I off-load mail access to a host other than the one our users have configured in their clients. I don't have access to any of the switching or routing to our hosts, and there's only a 1 to 1 relationship between the proxy I want to set up and the actual mail handler. I was looking at the proxying Howto in the Wiki and was presented with an SQL server requirement to do user/ip address look-ups. In my case, it will always be proxying the same host. How would I configure Dovecot to proxy another single system without doing the SQL look-up? Is there a port-forwarding solution that would work better (for POP3s and IMAPS)? These are RedHat 5 hosts so Netfilter is fair game if the protocols allow. Thanks, -Jason

2 1

[Dovecot] apparent bug with filesystem quota and message lists
by Stewart Dean 01 Aug '07

01 Aug '07

Don't know if anyone else uses Berkeley derived filesystem quota, but IBM's AIX does. A little over a week after migrating from UWIMAP to DC (with mbox format unchanged) everything is clean except for this one problem: When users go over quota, when they login the next time, the folder list is blank. You can imagine the panicked calls to the Helpdesk. If their quotas are raised or re-graced, Get Mail returns the expected list. This behavior happens with a variety of clients: Pine, MacMail,TBird, Horde Webmail, etc. The index filesystem has no quota on it. I would have to imagine the Dovecot is using (or trying to use) some space in the quota'ed filesystems which the operating system won't allow, and this results in there being an empty file that DC uses for the message list sent to the client. There are NO messages in syslog (other than the expected login and logout) indicating any problems. Our legacy setup has the inboxes in /var/spool/mail, and the folders in ~/mail. The problem can happen either place. dovecot -n returns: > # 1.0.1: /usr/local/etc/dovecot.conf > listen: *:143 > ssl_listen: *:993 > disable_plaintext_auth: no > login_dir: /var/run/dovecot/login > login_executable: /usr/local/libexec/dovecot/imap-login > login_processes_count: 12 > login_max_processes_count: 774 > verbose_proctitle: yes > first_valid_uid: 200 > mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=/var/dcindx/%u > mbox_dirty_syncs: no > mbox_lazy_writes: no > auth default: > passdb: > driver: pam > userdb: > driver: passwd Suggestions? -- ==== Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

2 2

[Dovecot] Dovecot won't build against recent version of GnuTLS
by Jasper Bryant-Greene 01 Aug '07

01 Aug '07

Hi all, Dovecot won't build against recent versions of GnuTLS. The problem starts on line 34 of src/master/ssl-init-gnutls.c, where Dovecot generates DH params using gnutls_dh_params_generate(), a function which no longer exists [replaced with gnutls_dh_params_generate2()]. I'd fix it myself, but the signature of the function has changed to take gnutls_dh_params_t rather than prime & generator, and I'm not keen on hacking SSL code unless I really understand what's going on. It looks like the code goes on to save & free those values. I'm tracking HG and am happy to test any changes. Appreciate it if someone with more knowledge of GnuTLS and perhaps this code in particular could take a look. Thanks, J

4 3

[Dovecot] pop3 connections hanging
by Arjun Datta 01 Aug '07

01 Aug '07

Hi, dovecot --version 1.0.beta8 dovecot -n login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd It is running with sendmail-8.13.5-3 on FC5 2.6.15-1.2054_FC5 I find that occasionally a pop3 connection will just sit there for hours on end. It will not release the lock on the user mailbox and so mail to that user cannot be delivered. As a result the mailq backs up mostly with mail to that user. Closing the MUA does not help. I have to kill -9 PID the process to clear the hung connection. This happens with both Outlook and Thunderbird. Is there an option in the dovecot configuration that I can set to automatically close connections after say 30 minutes ? In the workaround section it says that it will close connections from Outlook & Outlook Express after 30 minutes dues to an IDLE bug in those 2. Regards, Arjun Datta

3 6

[Dovecot] Dovecot LDAP schema?
by Hadmut Danisch 30 Jul '07

30 Jul '07

Hi, does dovecot define its own LDAP schema or should I create my own one? (I want to provide IMAP boxes for virtual users that do not have a Unix account on the mail server and thus do not want to use the plain uid/gid entries of the posix account objectclass to avoid confusion and accidently giving access to accounts.) regards Hadmut

2 3

[Dovecot] High cpu usage OpenSolaris
by Gary Gendel 29 Jul '07

29 Jul '07

Hi, I've built 64-bit dovecot 1.0.2 on Opensolaris to replace version 1.0.0rc10. It functions fine, but when I connect, it eats up all available cpu. My guess is that the poll thread is running continuously. Any ideas on what I should do to verify this or does anyone know of a fix? Thanks, Gary

1 0

[Dovecot] Shared mailboxes (maildir, symlinks) and permissions
by Andreas Ntaflos 28 Jul '07

28 Jul '07

Hello list, I am trying to set up a public mailbox for users to put spam in so that sa-learn can do its job at night. Only I can't seem to fully understand how and which permissions should be set. I've read [1] and am using Dovecot 1.0.1. First some background information: I do not host or care (at the moment) about virtual users or virtual mail hosting. All users have Unix system accounts and shell access. I'd like to have a Spam folder, say /var/mail/public/.Spam that is a maildir where users can put Spam that got through the server-side filter. Spamassassin's sa-learn runs nightly and learns from the contents of the Spam folder. After reading [1] I think I should have under /var/mail/public a file called dovecot-shared that belongs to root:mail and has permissions 0660 (with user dovecot being a member of group mail) so that it looks like this: root@host:/var/mail/public# ls drwxr-sr-x 2 root mail 4096 2007-07-28 03:29 . drwxrwsr-x 3 root mail 4096 2007-07-28 02:19 .. -rw-rw---- 1 root mail 0 2007-07-28 02:46 dovecot-shared root@host:/var/mail/public# The first question arises: should Dovecot have write access to /var/mail/public itself? Now I should create the Spam folder called /var/mail/public/.Spam. Should this directory be in maildir format, i.e. should it already contain the subdirectories cur, tmp and new? What of the permissions of this directory? I am pretty sure Dovecot needs write access to it, so it should look like this: root@host:/var/mail/public# ls drwxr-sr-x 3 root mail 4096 2007-07-28 03:44 . drwxrwsr-x 3 root mail 4096 2007-07-28 02:19 .. -rw-rw---- 1 root mail 0 2007-07-28 02:46 dovecot-shared drwxrwsr-x 2 root mail 4096 2007-07-28 03:44 .Spam root@host:/var/mail/public# The .Spam directory here is completely empty. Now in a user's Maildir (/home/user1/Maildir) there are the user's private folders; a symlink to /var/mail/public/.Spam should be added: root@host:/home/user1/Maildir# ln -s /var/mail/public/.Spam . root@host:/home/user1/Maildir# ls ... drwx------ 5 user1 user1 4096 2007-07-19 16:14 .INBOX.foo drwx------ 5 user1 user1 4096 2007-07-06 23:01 .INBOX.bar ... lrwxrwxrwx 1 user1 user1 22 2007-07-28 03:51 .Spam -> /var/mail/public/.Spam ... root@host:/home/user1/Maildir# Is that all I have to do? Probably not, because I keep getting errors like the following when connecting (after subscribing of course): Jul 28 03:52:35 host dovecot: IMAP(user1): mkdir(/home/user1/Maildir/.Spam/cur) failed: Permission denied Should I have created the cur, tmp and new subdirectories manually and set their permissions like /var/mail/public/.Spam? But that still wouldn't give user1 write access. If I gave the users (or "others": chmod o+w) write permissions then Dovecot's index files would be owned by the first user that connects to the server and uses that folder. Apparently also not a solution. I also don't think I should have to make my users members of the mail group, but I could be wrong here. So I am not sure what I am missing, or if what I want to do is at all possible (without taking out the sledgehammer and setting all permissions to 0777). I also apologise for this lengthy post with many details and little interesting questions. It's getting late and I fear I've reached a dead end. I'd really appreciate it if someone knowledgeable could point me in the right direction here. Thanks in advance! Andreas [1] http://wiki.dovecot.org/SharedMailboxes -- Andreas "daff" Ntaflos Vienna, Austria GPG Fingerprint: 6234 2E8E 5C81 C6CB E5EC 7E65 397C E2A8 090C A9B4

2 1

[Dovecot] Issues upgrading to 1.1alpha1
by Luca Corti 27 Jul '07

27 Jul '07

I'm trying to upgrade from 1.0.2 to 1.1alpha1. I can build and start dovecot correctly. dovecot -n says: # 1.1.alpha1: /usr/local/etc/dovecot.conf protocols: imap pop3 ssl_cert_file: /etc/postfix/server.pem ssl_key_file: /etc/postfix/server.pem login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_location: maildir:/mnt/shared/mail/%u:INDEX=/var/indexes/%u mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 auth default: passdb: driver: pam passdb: driver: passwd userdb: driver: passwd socket: type: listen client: path: /usr/local/var/run/dovecot/auth-client mode: 436 master: path: /usr/local/var/run/dovecot/auth-master mode: 384 user: root group: dovecot When I try to access my 1.4G Maildir via IMAP I can see messages in INBOX, but accessing mail in other folders returns a "resource temporarily unavailable" error in my client. In the server logs I see killed by signal 10 errors for dovecot imap processes. I'm on Linux 2.6.21 sparc64, mail is stored in NFS, indexes on local disk. ciao Luca

2 1

[Dovecot] auth_cache_...
by Frank Elsner 26 Jul '07

26 Jul '07

Hello, the dovecot-example.conf states: # Authentication cache size in kilobytes. 0 means it's disabled. # Note that bsdauth, PAM and vpopmail require cache_key to be set for caching # to be used. #auth_cache_size = 0 # Time to live in seconds for cached data. After this many seconds the cached # record is no longer used, *except* if the main database lookup returns # internal failure. We also try to handle password changes automatically: If # user's previous authentication was successful, but this one wasn't, the # cache isn't used. For now this works only with plaintext authentication. #auth_cache_ttl = 3600 auth_cache_size = 0, does it mean "cache can grow ad infinitum" or does it mean "no cache at all" ? Kind regards ______________________________________________________________ Frank Elsner / c/o Technische Universitaet Berlin | ____________/ tubIT [BD], Sekr. E-N 50 | | Einsteinufer 17 | | Phone: +49 30 314 23897 D-10587 Berlin | | eMail: Frank.Elsner(a)TU-Berlin.DE Germany __________________| |_________________________________________________________| in dubio pro exim

4 4

[Dovecot] quota: maildrop + dovecot. dovecot doesn't update maildirsize file
by Frittella Laurento 26 Jul '07

26 Jul '07

Hi all, I'm trying to implement quota support in postfix using maildrop + dovecot but I think dovecot doesn't update info stored in maildirsize file. # 1.0.2: /etc/dovecot/dovecot.conf base_dir: /var/run/dovecot/ listen: 127.0.0.1 ssl_listen: * ssl_ca_file: ... ssl_cert_file: ... ssl_key_file: ... ssl_cipher_list: ALL:!LOW:!SSLv2 login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login valid_chroot_dirs: /home/vmail/domains first_valid_uid: 1001 last_valid_uid: 1001 first_valid_gid: 1001 last_valid_gid: 1001 mail_location: maildir:/home/vmail/domains/%d/%n auth default: user: dovecot-auth passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf plugin: quota: maildir:ignore=Trash When a mail arrives maildrop delivers it and update info in the maildirsize file, but when I delete messages through dovecot (using thunderbird) the maildirsize remains the same and so users reach overquota very soon. What's wrong? Thanks in advance, Laurento

4 8

[Dovecot] migration from cyrus to dovecot
by Dirk Müller 26 Jul '07

26 Jul '07

hi there, just a short question. ;-) are the tools mentioned in the wiki for migration from cyrus (http://wiki.dovecot.org/Migration/Cyrus) still working fine with the latest dovecot release 1.0.2? i remember there have been some internal changes from 1.0.1 to 1.0.2 to keep compatible with the upcoming 1.1. thanks and best regards, dirk

2 1

[Dovecot] dspam plugin
by Oliver Kohll 26 Jul '07

26 Jul '07

Hello, I'm trying to install the dspam plugin to dovecot. So far, I've Installed dovecot 1.0.2 from RPM and set up Installed dspam 3.8.0, set up and integrated with postfix, using dspam as local delivery agent before dovecot's deliver Downloaded the dovecot 1.0.2 source in order to compile the C file http://johannes.sipsolutions.net/Projects/dovecot-dspam-integration/ beta7-code with the command cc -fPIC -shared -Wall -I../src/ -I../src/lib -I.. -I../src/lib- storage -I../src/lib-mail -I../src/lib-imap -I../src/imap/ - DHAVE_CONFIG_H -DDSPAM=\"/usr/local/bin/dspam\" dspam.c -o lib_dspam.so and copied the resulting lib_dspam.so to /usr/lib/dovecot/imap/ In dovecot.conf, set protocol imap { mail_plugins = dspam mail_plugin_dir = /usr/lib/dovecot/imap } Created a SPAM folder. However, when I move a message into or out of the SPAM folder, dspam doesn't seem to execute. Nothing appears in /usr/local/var/dspam/system.log or /var/log/maillog and "SELECT * FROM dspam_stats;" in the dspam database returns unchanged numbers: dspam=> select * from dspam_stats ; uid | spam_learned | innocent_learned | spam_misclassified | innocent_misclassified | spam_corpusfed | innocent_corpusfed | spam_classified | innocent_classified -----+--------------+------------------+-------------------- +------------------------+----------------+-------------------- +-----------------+--------------------- 505 | 18 | 1870 | 3 | 3 | 0 | 3 | 0 | 0 (1 row) One thing that may be relevant is that I have a namespace in dovecot.conf namespace private { prefix = INBOX. inbox = yes } Any ideas? Regards Oliver p.s. the page http://johannes.sipsolutions.net/Projects/dovecot-dspam- integration seems to be blank now but the Google cache http:// 216.239.59.104/search?q=cache:K_yW5wV88uwJ:johannes.sipsolutions.net/ Projects/dovecot-dspam-integration+dovecot +dspam&hl=en&ct=clnk&cd=3&client=safari is still there for now. oliver(a)gtwm.co.uk / 0845 456 1810 / 07814 828608 The Old Bank, 4 Ravenhill Rd, Swansea SA5 5AW, UK NOTE No contracts may be concluded on behalf of GT webMarque by means of e- mail communications. The contents of this e-mail are confidential to the intended recipient at the e-mail address to which it has been addressed; it may not be disclosed to or used by anyone other than this addressee, nor may it be copied in any way. If received in error please return to sender via e-mail. DISCLAIMER Please note that neither GT webMarque Ltd nor the sender accept any responsibility for viruses transmitted via e-mail. It is your responsibility to scan attachments (if any).

1 1

[Dovecot] Vacation message functionality
by Charles Marcus 25 Jul '07

25 Jul '07

Hi, Since I will soon be attempting to get this working on one of my client's systems, I posed a question on the postfix list - since they mostly dislike vacation messages - but *ardent haters* of badly configured vacation message systems - as to the quality of the dovecot vacation message function. The only response I got did seem to have a few very good suggestions for additional conditions to test for, so I'm posting the response here to see if they can be incorporated (I'm not a coder or I'd attempt it myself). The original text (prefixed by double quote characters) in the following exchange is what I copied/pasted from the wiki, and the reply (prefixed by one quote character) is the suggested change/enhancement (this reply is from a trusted source on the postfix list): >> Vacation auto-reply >> >> The vacation replies are sent to the envelope sender. Currently this >> is taken from the Return-Path: header in the message. > comment: > or from the command line if this is supported. > > also, if the envelope sender is not available, no reply should be > sent. >> List of autoreplied senders is stored in .dovecot.lda-dupes file in >> user's home directory. When you're testing the vacation feature, it's >> easy to forget that the reply is sent only once in the number of >> configured days. If you've problems getting the vacation reply, try >> deleting this file. If that didn't help, make sure the problem isn't >> related to sending mails in general by trying the "reject" Sieve >> command. > if you support extensions, you can test using a unique sender each > time: foo+12345(a)domain.example. >> The automatic replies aren't sent if any of the following is true: >> >> <snip> >> >> o begins with "owner-" (case-sensitive) > replace with: > o starts with "${token}-" (not case sensitive), where token > is one of: owner, request, bounces > > It is safer to send nothing than send a risky one. >> o contains the string "-request" anywhere within it >> (case-sensitive) > replace with: > o contains "-${token}@" (not case sensitive), where token is > one of: owner, request, bounces >> * The envelope sender and envelope recipient are the same >> * The envelope recipient is not found in the message To:, Cc: or >> Bcc: fields. > add: > * There is a "Sender:" header containing one of the tokens listed > above. > * There is a List-Id or List-Post header > * There is no header suggesting that this is possible spam > > Unlike delivery, safety here is to not send a reply if the message > may be spam. so you don't rely on recipient preferences, and you > don't fear false positives too much (the guy who receives your > auto-rep may have a better filter, and besides annoying him, would > find you stupid to miss an obvious spam ;-p) >> The envelope sender is taken from a Return-Path: header in the >> message. The envelope recipient is taken from the recipient user >> (-d parameter with virtual user setup). A bare username without a >> domain gets canonicalised by the libsieve code to >> "<username>@unspecified-domain", which means it is highly unlikely >> to pass the last two tests in the list above. > note: > the envelope recipient can also be retrieved in the Delivered-To > header if this is available ('D' flag). Comments appreciated... -- Best regards, Charles

3 4

[Dovecot] Thunderbird body search and multiple imap process
by Oliver Schulze L. 25 Jul '07

25 Jul '07

Hi, I'm having an issue with dovecot and Thunderbird and it is reproducible all the time. You do many body search from TB and you end up with multiple imap processess consuming all the CPU and with linux load 20+ Setup: - Centos 4.5 - Thunderbird 2.0.0.5 - Dovecot 1.0-7_53.rc29 and 1.0.1-1_58.el4 How to reproduce: - have an imap account in Thunderbird with 12000+ emails - user maildir in dovecot - do a: ps auwx|grep user1|grep imap|wc -l - in the main window of TB, in the sarch box select "Entire Message" - search one random word and wait 30 seconds - search another random word and wait 30 seconds - search another random word and wait 30 seconds - search another random word and wait 30 seconds - do another: ps auwx|grep user1|grep imap|wc -l - watch that the user1 have now more imap process - watch the linux load, it just rocketed from 1 to 20 - killall -9 imap - watch the linux load return to 1 I'm thinking its TB fault, anyone has seen this issue too? Thanks Oliver -- Oliver Schulze L. | http://tinymailto.com/oliver Asuncion - Paraguay | http://www.solojuegos.mobi

2 2

Re: [Dovecot] Move deleted to trash
by Timo Sirainen 25 Jul '07

25 Jul '07

On 25.7.2007, at 16.02, Donald Nash wrote: > I do have to point out that you didn't actually answer my > question. :-) You originally asserted as fact that a server-managed > trash folder is evil from IMAP's point of view. However, when > asked to explain this, you changed from an assertion of fact to a > statement of personal preference: "I hate the move-to-Trash feature." > > Don't get me wrong, I'm not trying to say that your opinion is > wrong, nor am I trying to brow-beat you into implementing something > you don't think should be implemented. I'm just curious to know > what your motivation is. Why is it evil? Why do you hate it? EXPUNGE command is specified to expunge the mails, not move them to another mailbox. This would make having the message really gone a 4 stage operation: Mark deleted, expunge, mark deleted in Trash, expunge Trash. In many clients when you mark a message deleted it also copies it to Trash. So a server side expunge-to-trash feature causes the message to get copied there twice. A Trash mailbox also has the problem that all of your messages get there. There's no way to have an easy "unexpunge" operation, because the original mailbox isn't saved anywhere. You have to manually copy the message to the wanted mailbox. Perhaps lazy-expunge is a bit similar, but it preserves the mailboxes and doesn't conflict with clients' move-to-Trash feature. Also the concept in general is about having easily restorable backups of mails and not some kind of a idea that mails should go to a Trash mailbox when they're deleted. Maybe that whole Trash concept is the reason I consider it evil. I don't like that Trash concept in desktop environments either. I wish the undelete feature was in filesystems, so that when disk is full, the oldest deleted files would automatically get overwritten with new data, but until then the files would be undeletable. >> I think having a virtual Trash mailbox that contained all messages >> marked >> as deleted in all mailboxes would be a good solution for this. > > That's not quite the same thing. All the trash folders I've seen > are for messages which have been expunged from other folders, not > just marked for deletion. It's to give you one last chance to > retrieve a message that you realize shouldn't have been deleted. I think I'd prefer the lazy-expunge way for that more than having everything go to Trash. The virtual Trash would make client-side "delete=mark deleted + copy to Trash" feature unnecessary. >> It's not a requirement to subscribe to post. The messages to go to >> moderation queue and I approve them from there. > > Quoting from your web site: > > * You can post to the list without subscribing. The mail then > waits > in a moderator queue. However a lot of spam arrives there, > so it's > possible that your message gets accidentally discarded as spam. > > I didn't want to take a chance on my message getting lost in the > spam. If you want, I will join the mailing list and we can replay > this discussion there so everyone else can benefit from it. Well, I Cc'd the list now. > I hadn't anticipated that it would evolve into this much of a > discussion (I was hoping for a simple "It's evil because of X, Y, > and Z" sort of answer), or I would have done that in the first place. Evilness is subjective. :)

2 1

[Dovecot] Errors logging in
by Cassidy B. Larson 25 Jul '07

25 Jul '07

Out of the blue my proxy installations started showing this: dovecot: login: tried to change state 2 -> 2 (if you can't login at all, see src/lib/fdpass.c) Nobody can login. Running 1.0.0 on the proxy and 1.0.2 on my storage boxes. Anybody have any insights? -c

1 1

[Dovecot] Quota plugin, Maildir, dict backend loop problem
by David Jonas 25 Jul '07

25 Jul '07

Hello, I've been working with the quota plugin(s) the past few days and have been having some real trouble. Only a few entries are appearing in the database, a couple more when I restarted dovecot. None of the current entries were being updated either. I think I've tracked it down to somewhere in the dict backend. I put in a few i_info() statements and recompiled. A few queries get through, then it seems to try the same query about three times and then no new more queries at all (the i_info is right after the allocation of the query string). I couldn't find any errors in the log. An strace of the dict pid shows the following loop. Dovecot -n to follow as well. A quick tcpdump showed a loop something like this: < SELECT current FROM quota WHERE ... > 513965019 < BEGIN < INSERT INTO quota (current, ... < COMMIT > ?? (error_r appears to be (null)) .. repeat .. In all my tests it appears that the quota value being set during the loop is 0, but that would be the most common case anyway. An insert query would look like this: INSERT INTO quota (current, path, username) VALUES (0, 'quota/storage', 'user(a)example.com') ON DUPLICATE KEY UPDATE current = current + 0; Help on what to do/try next would greatly be appreciated. Thanks, David $ strace -p 19816 epoll_wait(5, {{EPOLLIN, {u32=153555248, u64=153555248}}, {EPOLLIN, {u32=153601240, u64=153601240}}, {EPOLLIN|EPOLLHUP, {u32=153567344, u64=153567344}}}, 29, 2147483647) = 3 gettimeofday({1185308526, 494477}, {420, 0}) = 0 read(20, "Lpriv/quota/storage\n", 4044) = 20 fcntl64(9, F_SETFL, O_RDWR|O_NONBLOCK) = 0 read(9, 0x9271eb8, 8192) = -1 EAGAIN (Resource temporarily unavailable) fcntl64(9, F_SETFL, O_RDWR) = 0 setsockopt(9, SOL_SOCKET, SO_SNDTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 write(9, "l\0\0\0\3SELECT current FROM quota W"..., 112) = 112 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "\1\0\0\1", 4) = 4 read(9, "\1", 1) = 1 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "6\0\0\2", 4) = 4 read(9, "\3def\10vpopmail\5quota\5quota\7curren"..., 54) = 54 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "\1\0\0\3", 4) = 4 read(9, "\376", 1) = 1 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "\n\0\0\4", 4) = 4 read(9, "\t582670292", 10) = 10 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "\5\0\0\5", 4) = 4 read(9, "\376\0\0\2\0", 5) = 5 write(20, "O582670292\n", 11) = 11 read(10, "B1\nA1\tpriv/quota/storage\t-24324\n"..., 4043) = 35 fcntl64(9, F_SETFL, O_RDWR|O_NONBLOCK) = 0 read(9, 0x9271eb8, 8192) = -1 EAGAIN (Resource temporarily unavailable) fcntl64(9, F_SETFL, O_RDWR) = 0 setsockopt(9, SOL_SOCKET, SO_SNDTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 write(9, "\6\0\0\0\3BEGIN", 10) = 10 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "\7\0\0\1", 4) = 4 read(9, "\0\0\0\3\0\0\0", 7) = 7 fcntl64(9, F_SETFL, O_RDWR|O_NONBLOCK) = 0 read(9, 0x9271eb8, 8192) = -1 EAGAIN (Resource temporarily unavailable) fcntl64(9, F_SETFL, O_RDWR) = 0 setsockopt(9, SOL_SOCKET, SO_SNDTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 write(9, "\247\0\0\0\3INSERT INTO quota (current,"..., 171) = 171 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "\7\0\0\1", 4) = 4 read(9, "\0\2\0\3\0\0\0", 7) = 7 fcntl64(9, F_SETFL, O_RDWR|O_NONBLOCK) = 0 read(9, 0x9271eb8, 8192) = -1 EAGAIN (Resource temporarily unavailable) fcntl64(9, F_SETFL, O_RDWR) = 0 setsockopt(9, SOL_SOCKET, SO_SNDTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 write(9, "\7\0\0\0\3COMMIT", 11) = 11 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "\7\0\0\1", 4) = 4 read(9, "\0\0\0\2\0\0\0", 7) = 7 write(10, "O\n", 2) = 2 read(14, "", 3998) = 0 epoll_ctl(5, EPOLL_CTL_DEL, 14, {0, {u32=153567344, u64=153567344}}) = 0 close(14) = 0 epoll_wait(5, {{EPOLLIN|EPOLLHUP, {u32=153601240, u64=153601240}}}, 29, 2147483647) = 1 gettimeofday({1185308526, 500644}, {420, 0}) = 0 read(10, "", 4008) = 0 epoll_ctl(5, EPOLL_CTL_DEL, 10, {0, {u32=153601240, u64=153601240}}) = 0 close(10) = 0 epoll_wait(5, <unfinished ...> Process 19816 detached $ /usr/local/dovecot/sbin/dovecot -n # 1.0.2: /etc/dovecot.conf protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable(default): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3-login login_greeting: postoffice.no-ip.com login_log_format_elements: user=<%u@%d> method=%m rip=%r lip=%l %c login_process_per_connection: no verbose_proctitle: yes first_valid_uid: 89 maildir_stat_dirs: yes maildir_copy_with_hardlinks: yes mail_executable(default): /usr/local/dovecot/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot/lib/dovecot/pop3 mail_log_prefix: %Us(%u)[%p]: pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %f pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: cache_size: 100 cache_ttl: 600 user: nobody username_translation: %@ username_format: %Lu verbose: yes passdb: driver: sql args: /etc/dovecot-sql.conf userdb: driver: prefetch plugin: quota: dict:storage=102400000 proxy::quotadict dict: quotadict: mysql:/etc/dovecot-dict-quota.conf $ cat /etc/dovecot-dict-quota.conf connect = host=192.168.15.25 dbname=vpopmail user=xxx password=xxx table = quota select_field = current where_field = path username_field = username $ cat /etc/redhat-release Red Hat Enterprise Linux ES release 4 (Nahant Update 5) $ rpm -qa | grep -i mysql MySQL-devel-standard-4.1.22-0.rhel4 MySQL-shared-standard-4.1.22-0.rhel4 MySQL-client-standard-4.1.22-0.rhel4 $ lsof -c dict -n COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME dict 19816 root cwd DIR 8,5 4096 464289 /usr/local/dovecot/var/run/dovecot dict 19816 root rtd DIR 8,7 4096 2 / dict 19816 root txt REG 8,5 1868454 464309 /usr/local/dovecot/libexec/dovecot/dict dict 19816 root mem REG 8,7 47404 160369 /lib/libnss_files-2.3.4.so dict 19816 root mem REG 8,7 112168 160456 /lib/ld-2.3.4.so dict 19816 root mem REG 8,7 1529008 163193 /lib/tls/libc-2.3.4.so dict 19816 root mem REG 8,7 16732 165083 /lib/libdl-2.3.4.so dict 19816 root mem REG 8,7 213772 165079 /lib/tls/libm-2.3.4.so dict 19816 root mem REG 8,7 107800 165077 /lib/tls/libpthread-2.3.4.so dict 19816 root mem REG 8,7 28476 165086 /lib/libcrypt-2.3.4.so dict 19816 root mem REG 8,7 97120 165087 /lib/libnsl-2.3.4.so dict 19816 root 0r CHR 1,3 1797 /dev/null dict 19816 root 1r CHR 1,3 1797 /dev/null dict 19816 root 2w FIFO 0,7 52832717 pipe dict 19816 root 3u unix 0xf4e58180 52832640 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 4r CHR 1,9 466 /dev/urandom dict 19816 root 5r 0000 0,8 0 52832719 eventpoll dict 19816 root 6r FIFO 0,7 52832720 pipe dict 19816 root 7w FIFO 0,7 52832720 pipe dict 19816 root 8u unix 0xf6fac480 52884208 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 9u IPv4 52832745 TCP 192.168.15.55:46058->192.168.15.25:mysql (ESTABLISHED) dict 19816 root 10u unix 0xdae69240 52881759 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 11u unix 0xf36af680 52884148 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 12u unix 0xf505f6c0 52881064 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 13u unix 0xd5d84280 52884278 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 15u unix 0xd1ab9b00 52883941 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 16u unix 0xf6faca80 52884264 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 17u unix 0xf63cb1c0 52884235 /usr/local/dovecot/var/run/dovecot/dict-server

3 7