July 2008 - dovecot - dovecot.org

[Dovecot] Problem: delivery with mode 600 into shared folder
by seriv＠parkheights.dyndns.org 04 Aug '08

04 Aug '08

Hi, I have a problem, delivery called from /etc/aliases file by pipe delivers with mode 0600. I need system users with shared mail folders (Maildir format). When I changed alias to pipe to shell wrapper with mode 002 set in it, nothing changed. MTA is sendmail, OS Solaris, and dovecot version 1.1.1. Can somebody help? Here are dovecot settings: --- /opt/dovecot11/sbin/dovecot -n # 1.1.1: /opt/dovecot11/etc/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/dovecot.log login_dir: /var/run/dovecot//login login_executable: /opt/dovecot11/libexec/amd64/dovecot/imap-login max_mail_processes: 128 mail_location: maildir:/home/vmail/listuser/Maildir:CONTROL=/home/vmail/%u/Maildir/control:INDEX=/home/vmail/%u/Maildir/index mail_debug: yes auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: pam args: imap userdb: driver: passwd socket: type: listen master: path: /var/run/dovecot/auth-master mode: 432 user: daemon group: other plugin: sieve: /opt/dovecot11/sieve-scripts/folders.sieve --- And this is the alias to pipe: --- grep deliver /etc/aliases listuser(a)domain.com: "|/opt/dovecot11/libexec/dovecot/deliver -d listuser" -- Sergey Ivanov.

3 4

[Dovecot] Recieving e-mail is not updating quota
by M. Rodrigo Monteiro 04 Aug '08

04 Aug '08

Hello again. When I send e-mail locally from userX@mydomain to userY@mydomain the quota in userY@mydomain isn't updated with the new message, but the message arrives fine. It's not a userX problem, because it's equal if it's userY sending userX. When I save an message, the quota is updated. Or when the userX sends the e-mail, his quota is updated too. The problem is that the quota don't update when a new message arrives. What could it be? Now I empty the mailbox of the userY, and the maildirsize is like this: 16777216S 0 0 1151862 1 2837616 1 2838683 1 5674797 2 -5674797 -2 -5674797 -2 1151862 1 -1151862 -1 -1151862 -1 The user quota from ldap is 16MB. In the user dir, the size is 452K # du -kh . --max-depth=0 452K . Now, I send an e-mail about 900k from userX to userY, and the quota display still 0M, but the user dir is 1,6M # du -kh . --max-depth=0 1,6M . My confs/logs # /usr/local/dovecot/sbin/dovecot -n # 1.1.1: /usr/local/dovecot/etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot-info.log ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable: /usr/local/dovecot/libexec/dovecot/imap-login valid_chroot_dirs: /home/vmail/domains verbose_proctitle: yes first_valid_uid: 200 last_valid_uid: 200 first_valid_gid: 200 last_valid_gid: 200 mail_privileged_group: vmail mail_uid: 200 mail_gid: 200 mail_location: maildir:/home/vmail/domains/%d/%n mail_debug: yes mail_plugins: quota imap_quota auth default: user: dovecot-auth passdb: driver: ldap args: /usr/local/dovecot/etc/dovecot-ldap.conf userdb: driver: ldap args: /usr/local/dovecot/etc/dovecot-ldap.conf plugin: quota_rule: *:storage=1G quota_rule2: Trash:storage=10%% quota_rule3: Lixeira:storage=10%% quota_rule4: Spam:storage=10%% quota: maildir # grep -v '^ *$#.*$\?$' /usr/local/dovecot/etc/dovecot-ldap.conf hosts = localhost dn = cn=dovecot,dc=xxxxxx,dc=ce,dc=gov,dc=br dnpass = xxxxx ldap_version = 3 base = o=mail, dc=xxxxxx, dc=ce, dc=gov, dc=br deref = never scope = subtree user_attrs = homeDirectory=home,quota=quota_rule=*:storage=%$M user_filter = (&(objectClass=JammMailAccount)(mail=%u)(accountActive=TRUE)(delete=FALSE)) pass_attrs = userPassword=password pass_filter = (&(objectClass=JammMailAccount)(mail=%u)(accountActive=TRUE)(delete=FALSE)) # tail /var/log/mail.log dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Loading modules from directory: /usr/local/dovecot/lib/dovecot/imap dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Module loaded: /usr/local/dovecot/lib/dovecot/imap/lib10_quota_plugin.so dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Module loaded: /usr/local/dovecot/lib/dovecot/imap/lib11_imap_quota_plugin.so dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Effective uid=200, gid=200, home=/home/vmail/domains dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Quota root: name= backend=maildir args= dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Quota rule: root= mailbox=* bytes=16777216 (0%) messages=0 (0%) dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Quota rule: root= mailbox=Trash bytes=1677721 (10%) messages=0 (0%) dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Quota rule: root= mailbox=Lixeira bytes=1677721 (10%) messages=0 (0%) dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Quota rule: root= mailbox=Spam bytes=1677721 (10%) messages=0 (0%) dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): maildir: data=/home/vmail/domains/xxxxxx.ce.gov.br/rodrigo dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): maildir++: root=/home/vmail/domains/xxxxxx.ce.gov.br/rodrigo, index=, control=, inbox=/home/vmail/domains/xxxxxx.ce.gov.br/rodrigo Regards, Rodrigo. -- M. Rodrigo Monteiro falecom(a)rodrigomonteiro.net "Free as in Freedom, not free as in free beer" Linux User # 403730

2 2

[Dovecot] dovecot 1.1.2 assertion
by Nuno Lopes 04 Aug '08

04 Aug '08

Hi, I've upgraded to last version of dovecot and am now getting the following assertions: Jul 25 00:00:34 bld3 dovecot: Panic: IMAP(example1(a)example.com): file index-sort-string.c: line 542 (index_sort_add_ids_range): assertion failed: (left_idx == 0 && right_idx == rightmost_idx) Jul 25 00:00:34 bld3 dovecot: IMAP(example1(a)example.com): Raw backtrace: imap [0x5555555d30f0] -> imap [0x5555555d3157] -> imap [0x5555555d27d8] -> imap(index_sort_list_finish_string+0xe8e) [0x5555555a01de] -> imap(index_storage_search_next_nonblock+0x432) [0x55555559caa2] -> imap(mailbox_search_next+0x21) [0x5555555a4051] -> imap(imap_sort+0xdc) [0x555555577d3c] -> imap(cmd_sort+0x33d) [0x555555570e1d] -> imap(cmd_uid+0x54) [0x555555571894] -> imap [0x5555555722ac] -> imap [0x555555572362] -> imap [0x555555572b7f] -> imap(client_input+0x62) [0x555555572da2] -> imap(io_loop_handler_run+0xf8) [0x5555555da0c8] -> imap(io_loop_run+0x1d) [0x5555555d918d] -> imap(main+0x462) [0x55555557a552] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x2ae31494c154] -> imap [0x55555556c859] in another instance: Jul 25 00:08:48 bld4 dovecot: Panic: IMAP(example2(a)example.com): file index-sort-string.c: line 607 (index_sort_add_ids_range): assertion failed: (skip > 0) Jul 25 00:08:48 bld4 dovecot: IMAP(example2(a)example.com): Raw backtrace: imap [0x5555555d30f0] -> imap [0x5555555d3157] -> imap [0x5555555d27d8] -> imap(index_sort_list_finish_string+0xedc) [0x5555555a022c] -> imap(index_storage_search_next_nonblock+0x432) [0x55555559caa2] -> imap(mailbox_search_next+0x21) [0x5555555a4051] -> imap(imap_sort+0xdc) [0x555555577d3c] -> imap(cmd_sort+0x33d) [0x555555570e1d] -> imap(cmd_uid+0x54) [0x555555571894] -> imap [0x5555555722ac] -> imap [0x555555572362] -> imap [0x555555572b7f] -> imap(client_input+0x62) [0x555555572da2] -> imap(io_loop_handler_run+0xf8) [0x5555555da0c8] -> imap(io_loop_run+0x1d) [0x5555555d918d] -> imap(main+0x462) [0x55555557a552] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b64897fc154] -> imap [0x55555556c859] If this is not enough for you to solve it ... Some problems were solved upgrading from 1.1.1 but these ones remained. Thanks, -- Nuno

2 3

[Dovecot] Server power loss and "Dovecot is already running with PID xxx"
by Pekka Savola 04 Aug '08

04 Aug '08

Hi, I'm running Dovecot 1.0.7 (with various patches) on CentOS 5.2. The server has suffered a couple of power loss events. Dovecot is run as a standalone server. The problem is that dovecot refuses to start up at boot because the PID file from before the power loss is left behind. The message is as follows: $ /sbin/service dovecot start Starting Dovecot Imap: Error: Dovecot is already running with PID 10825 (read from /var/run/dovecot/master.pid) Fatal: Invalid configuration in /etc/dovecot.conf [FAILED] (Note: there is nothing wrong in the configuration file so the error message is somewhat misleading.) I looked at the release notes of 1.0.xx releases and they didn't mention this. Is this already a known problem? Should the start-up logic be made more robust (e.g. check whether a process corresponding to the PID actually exists)? -- Pekka Savola "You each name yourselves king, yet the Netcore Oy kingdom bleeds." Systems. Networks. Security. -- George R.R. Martin: A Clash of Kings

4 6

[Dovecot] POP3 locking
by Adrian Overbury 02 Aug '08

02 Aug '08

I'm trying to understand what dovecot's behavior will be in a given scenario to see if it will work as a (hopefully better) replacement for the home-grown pop3 server we currently use. User A is on a slow dialup connection, and uses, oh, let's say Outlook, since that's where most of our problems seem to spring from. User A uses outlook to download his mail over pop3. Half way through downloading a particularly large message, Outlook decides that the whole process isn't happening fast enough, so it opens another connection to the server and tries to download (potentially) the same message again. Now, our current server establishes a lock on the mailbox, and when that second connection happens it simply responds that there's no messages to collect... we used to have it terminate the connection, but this brings up confusing error messages on User A's client, and they call up and complain -- not an ideal situation. I've got a dovecot installation on my testing server, and I think I've set everything up correctly; it authenticates from my LDAP database, finds the home directory, lists the mail, all that... I believe somewhere it there it uses fcntl to establish an advisory lock on the mailbox (oh, we're using Maildir, by the way). I'm not sure where, though, or how long the lock persists for, or what its actual purpose is, because my tests show me that I can log the same users in with two concurrent sessions and get the same message twice. It's probably a fault in my understanding of how locking in user sessions of a pop3 server should work, but that doesn't sound right to me. Can someone explain if what I'm seeing is correct, or what problem it may be symptomatic of? Does dovecot even do concurrent-user-session locking? So far I've enjoyed playing with dovecot -- far more than the current server we use. I'd like to use it as our primary pop3 server, but preventing users from having concurrent sessions and getting the same message more than once, and keeping them from seeing errors because of their client trying to open multiple sessions is important. Oh, and I'm user dovecot 1.0.beta3, since I don't really have the option of upgrading the OS on my mail servers any time soon. Adrian

9 13

[Dovecot] Permission denied creating inbox file in /var/mail
by Steve Ochani 01 Aug '08

01 Aug '08

Hello all, I'm using dovecot version 1.07 on CentoOS 5 (clone of RHEL 5). When there is no existing mbox file for a user in /var/mail I get the following error: --------------- Jul 31 16:32:32 newnewton dovecot: imap-login: Login: user=<testm2>, method=PLAIN, rip=::ffff:127.0.0.1, lip=::ffff:127.0.0.1, secured Jul 31 16:32:32 newnewton dovecot: IMAP(testm2): open(/var/mail/testm2, O_CREAT) failed: Permission denied Jul 31 16:32:32 newnewton dovecot: IMAP(testm2): access() failed with mbox file /var/mail/testm2: No such file or directory Jul 31 16:32:32 newnewton dovecot: IMAP(testm2): stat() failed with mbox file /var/mail/testm2: No such file or directory Jul 31 16:32:32 newnewton dovecot: IMAP(testm2): Connection closed ---------------- My persimmons on /var/mail (which is a symlink to /var/spool/mail) : drwxrwxr-x 2 root mail 4096 Jul 31 16:32 mail I have tried adding the mail group as mail_privileged_group, the output of dovecot -n : -------------------- # 1.0.7: /etc/dovecot.conf login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_privileged_group: mail mail_location: mbox:~/IMAPmail:INBOX=/var/mail/%u mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd -------------------- Here is the permission on /etc/dovecot.conf -rw-r--r-- 1 root root 42833 Jul 31 15:30 /etc/dovecot.conf I've searched google and the mailing list archive and tried the couple of things commonly suggested. As for a test I changed perms on /var/spool/mail to 777 and then dovecot made the inbox file. The file ended up being owned by the user and the group owner was the group that the user belongs to, not mail. When I create new users using useradd there is a 0 byte file created in /var/mail for the user but I use scripts to create student accounts every semester (about 10,000) so I'm trying to avoid having to add more things that the script will have to create. Any help is greatly appreciated. Thanks -Steve O.

3 4

[Dovecot] dovecot.sieve file location?
by kbajwa 01 Aug '08

01 Aug '08

CentOS 5.2 Postfix-2.3.3 Dovecot-1.1.1 Dovecot.Sieve-1.1.5 I have setup with: home_mailbox = Maildir/ (/etc/postfix/main.cf) & mail-location = maildir:~/Maildir (/etc/dovecot.conf) I have created a 'test' user to test Sieve 'Vacation' setup. My questions are: 1. Which folder '.dovecot.sieve' script is copied into? Is it 'home/test' -or- 'home/test/Maildir' or someplace else? 2. '.dovecot.sieve' script parameter ":days 1" means that the reply is sent once a day. Is it possible to send the reply 'immediately'? Kirti

2 1

[Dovecot] Dovecot load balancing
by Thomas Hummel 01 Aug '08

01 Aug '08

Hello, I'd like to figure out how to set up a site running dovecot on multiple computers for load balancing reasons. I'm currently running dovecot-1.0.14 on a 8GB RAM, 2 quad-core 2.66Ghz Xeon single server which runs FreeBSD 6.2-STABLE SMP. . the mailbox format was mbox and I successfully migrated to Maildir only . mailboxes are on an NFS NetApp server, attribute caching is off . indexes are locally stored . the number of users is around 2500, some of them having huge mailboxes (~ 1 or 2 GB) . a large amount of users is using IMAP but there are also many POP3 users . the passdb/userdb is openLDAP . for now, I neither use namespaces, nor quotas nor deliver, nor any plugin, but I plan to use namespaces and ACL to implement shared mailboxes. The same machine is running postfix-2.4.6 with amavisd-new-2.5.4 (no spamassassin) and clamav-0.93.1. I'm using procmail-3.22 as the LDA. I installed dovecot-1.1.2 on non-standard ports for test and plan to switch to it as I read on this list it performs better, load wise. This setup (1.0.14) works great except that, compared to the time mailboxes were in mbox format, the load average (as shown by 'top') goes higher from a significant amout on a regular basis and sometimes goes over the top. On "normal" circumstances, the number of processes is around 1400 and the load oscillates between 1 to 10 and 30 to 60. Most of the time, I'd say the load average is around 20. Every friday a message (no attachement, decent size) is sent to all users : in such circumstances (but only sometimes, not every time : let's say half the time such a message is sent), the load goes so high that I have to stop dovecot to let procmail deliver the message or even reboot the machine. Sometimes, the load climbs up to something like 150, then goes back to the 'normal' case described above. I know multi-master replication is on the roadmap. I know some dovecot sites use in the meantime several dovecot servers. I'd like to know how those sites do the load balancing, the main problem beeing to be able to direct each user to the same dovecot server each time as stated in the Wiki (http://wiki.dovecot.org/NFS). I don't think that DNS round robin would do the trick because some UA (for instance Thunderbird) often open up to 5 connexions for the same user, unless maybe such UA makes a single 'gethostbyname()', thus connecting 5 times to the same physical server ? What are the options to achieve such a setup ? Any successful experiences ? Thank you -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

8 13

[Dovecot] One LDAP attribute for many variables
by Juan Asensio Sánchez 31 Jul '08

31 Jul '08

Hi Using Dovecot 1.1.2 with LDAP. If i have this: user_attrs = uid=home=/var/vmail/%$,mailuserquota=quota_rule=*:storage=%$,=mail=maildir:/var/vmail/%n/Maildir OK. But if i have this: user_attrs = uid=home=/var/vmail/%$,mailuserquota=quota_rule=*:storage=%$,uid=mail=maildir:/var/vmail/%$/Maildir I get this error: deliver(usuario1): Jul 25 12:59:08 Error: Per-user script path is unknown. See http://wiki.dovecot.org/LDA/Sieve#location The only difference is that I use the uid LDAP attribute twice. Why does this happen?

2 1

[Dovecot] Seen flag in maildir filename not being respected
by Eduardo M KALINOWSKI 31 Jul '08

31 Jul '08

Hi, I'm using dovecot 1.1.2 (but I've noticed this since 1.1.1 which I was using until yesterday). It seems dovecot is ignoring the "S" flag in Maildir filenames, and is relying only in its Index Files to determine if a message has been read or not. I say that because if I delete the dovecot.index.* files for a mail folder, all the mails in there appear as unread. Also, I've tried accessing the maildir directly (using heirloom-mailx, but mutt should have done, too) and reading a new message. The file name was changed to add a "S" to the end, but this message was still marked as "unread" when the mail folder was accessed via IMAP. The flags R, F and T are correctly read from the filename if no index is present. I haven't tested the other flags. I'm using dovecot's deliver, and it creates filenames such as "1217450416.M77457P5201.mail.kalinowski.com.br,S=1377,W=1411:2,S", that is, perfectly fine. dovecot -n: # 1.1.2: /etc/dovecot/dovecot.conf log_path: /var/log/dovecot/main.log info_log_path: /var/log/dovecot/info.log log_timestamp: %Y-%m-%d %H:%M:%S ssl_cert_file: /etc/ssl/certs/server.pem ssl_key_file: /etc/ssl/private/server.pem login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_processes_count: 1 first_valid_uid: 100 mail_privileged_group: mail mail_location: maildir:/home/vmail/%d/%n/INBOX:INDEX=/home/vmail/%d/%n/dovecotidx mail_plugins: quota imap_quota zlib auth default: mechanisms: plain login cram-md5 passdb: driver: passwd-file args: username_format=%n /home/vmail/%d/db/passwd passdb: driver: pam userdb: driver: static args: uid=104 gid=8 home=/home/vmail/%d/%n userdb: driver: passwd socket: type: listen client: path: /var/run/dovecot/auth-client mode: 438 master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: mail plugin: quota: maildir quota_rule: ?:storage=0 quota_rule2: Trash:ignore quota_rule3: Spam:ignore quota_rule4: Spam.Errado:ignore sieve: /home/vmail/%d/db/sieves/%n.sieve

2 3