- dovecot - dovecot.org

[Dovecot] 1.1.2: imap crash with SIGSEGV
by Ralf Hildebrandt 04 Aug '08

04 Aug '08

GNU gdb 6.8-debian Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu"... Reading symbols from /lib/i686/cmov/libdl.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libdl-2.7.so...done. done. Loaded symbols for /lib/i686/cmov/libdl.so.2 Reading symbols from /lib/i686/cmov/libc.so.6...Reading symbols from /usr/lib/debug/lib/i686/cmov/libc-2.7.so...done. done. Loaded symbols for /lib/i686/cmov/libc.so.6 Reading symbols from /lib/ld-linux.so.2...Reading symbols from /usr/lib/debug/lib/ld-2.7.so...done. done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /usr/local/lib/dovecot/imap/lib10_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib10_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib11_trash_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib11_trash_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_fts_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_fts_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so Core was generated by `/usr/local/libexec/dovecot/imap'. Program terminated with signal 11, Segmentation fault. [New process 23474] #0 mail_transaction_log_file_lock (file=0x0) at mail-transaction-log-file.c:257 257 if (file->locked) #0 mail_transaction_log_file_lock (file=0x0) at mail-transaction-log-file.c:257 #1 0x080ba2fd in mail_transaction_log_lock_head (log=0x91cfd68) at mail-transaction-log.c:419 #2 0x080ba36d in mail_transaction_log_sync_lock (log=0x91cfd68, file_seq_r=0xbff348a4, file_offset_r=0xbff34880) at mail-transaction-log.c:451 #3 0x080c44bb in mail_index_fsck (index=0x91cf828) at mail-index-fsck.c:424 #4 0x080b0296 in mail_index_map (index=0x91cf828, type=MAIL_INDEX_SYNC_HANDLER_HEAD) at mail-index-map.c:888 #5 0x080acde3 in mail_index_try_open (index=0x91cf828) at mail-index.c:290 #6 0x080ad0a7 in mail_index_open (index=0x91cf828, flags=49, lock_method=FILE_LOCK_METHOD_FCNTL) at mail-index.c:338 #7 0x080a1112 in index_storage_mailbox_open (ibox=0x91d02b0) at index-storage.c:383 #8 0x0807094b in maildir_open (storage=0x91bacc0, name=0x91bf6ee "Drafts", flags=0) at maildir-storage.c:448 #9 0x08070ab4 in maildir_mailbox_open (_storage=0x91bacc0, name=0x91bf6ee "Drafts", input=0x0, flags=0) at maildir-storage.c:512 #10 0xb7ea61ca in mail_log_mailbox_open (storage=0x91bacc0, name=0x91bf6ee "Drafts", input=0x0, flags=0) at mail-log-plugin.c:450 #11 0xb7eb761a in quota_mailbox_open (storage=0x91bacc0, name=0x91bf6ee "Drafts", input=0x0, flags=0) at quota-storage.c:366 #12 0x080a51d9 in mailbox_open (storage=0x91bacc0, name=0x91bf6ee "Drafts", input=0x0, flags=0) at mail-storage.c:459 #13 0x08060c89 in cmd_select_full (cmd=0x91bb5f0, readonly=false) at cmd-select.c:32 #14 0x08060e69 in cmd_select (cmd=0x91bb5f0) at cmd-select.c:87 #15 0x0806271c in client_command_input (cmd=0x91bb5f0) at client.c:580 #16 0x080627b3 in client_command_input (cmd=0x91bb5f0) at client.c:629 #17 0x08062d6d in client_handle_input (client=<value optimized out>) at client.c:670 #18 0x080631ee in client_input (client=0x91bb3a8) at client.c:725 #19 0x080dd730 in io_loop_handler_run (ioloop=0x91b79b0) at ioloop-epoll.c:201 #20 0x080dcc10 in io_loop_run (ioloop=0x91b79b0) at ioloop.c:308 #21 0x0806b35a in main (argc=152894696, argv=0xbff34f34, envp=0xbff34f3c) at main.c:293 -- Ralf Hildebrandt (Ralf.Hildebrandt(a)charite.de) snickebo(a)charite.de Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de "FOOT-AND-MOUTH BELIEVED TO BE FIRST VIRUS UNABLE TO SPREAD THROUGH MICROSOFT OUTLOOK Researchers Shocked to Finally Find Virus That Email App Doesn't Like".

2 2

[Dovecot] related, but off-topic: how to allow users to change password?
by Sahil Tandon 04 Aug '08

04 Aug '08

My dovecot is currently configured to authenticate vs. a userdb/passdb passwd-file that contains, for each user: username:passhash:5000:5000::/path/to/home::userdb_mail=/path/to/maildir Is it possible to let users authenticate and change their passwords? There are some webmail client add-ons that allow such things if users are system accounts or in a MySQL/LDAP db. Does anyone else use passdb/userdb passwd-files like above and have a method for allowing users to change their passwords from the web? Sorry for the slightly off-topic question, but hoping another Dovecot admin has solved this problem. Preference is to not to be tied to any particular webmail client just for this change password feature.

3 7

[Dovecot] Thunderbird and Dovecot on FC5 taking a long time to retrieve message
by Bruen, Mark 02 Aug '08

02 Aug '08

I'm running FC5 (2.6.15-1.2054_FC5smp) and Dovecot dovecot-1.0-0.beta8.2.fc5 with Thunderbird 2.0.0.16. I set up imap (dovecot) so I can access my mail locally or remotely. It seems to take a very long time (minutes sometimes) for an Email to be retrieved after I select it in the folder list and/or in the Email list locally or remotely. I've traced the imap process and found it doing a lot of reading (read() system calls) for a long time. I do have a high message count in some of these folders (i.e.: 20000 or so). Is there any way to improve performance (use more memory, cache indexes, tune I/O parameters, etc...) ? Thanks. -Mark

2 1

[Dovecot] POP3 locking
by Adrian Overbury 02 Aug '08

02 Aug '08

I'm trying to understand what dovecot's behavior will be in a given scenario to see if it will work as a (hopefully better) replacement for the home-grown pop3 server we currently use. User A is on a slow dialup connection, and uses, oh, let's say Outlook, since that's where most of our problems seem to spring from. User A uses outlook to download his mail over pop3. Half way through downloading a particularly large message, Outlook decides that the whole process isn't happening fast enough, so it opens another connection to the server and tries to download (potentially) the same message again. Now, our current server establishes a lock on the mailbox, and when that second connection happens it simply responds that there's no messages to collect... we used to have it terminate the connection, but this brings up confusing error messages on User A's client, and they call up and complain -- not an ideal situation. I've got a dovecot installation on my testing server, and I think I've set everything up correctly; it authenticates from my LDAP database, finds the home directory, lists the mail, all that... I believe somewhere it there it uses fcntl to establish an advisory lock on the mailbox (oh, we're using Maildir, by the way). I'm not sure where, though, or how long the lock persists for, or what its actual purpose is, because my tests show me that I can log the same users in with two concurrent sessions and get the same message twice. It's probably a fault in my understanding of how locking in user sessions of a pop3 server should work, but that doesn't sound right to me. Can someone explain if what I'm seeing is correct, or what problem it may be symptomatic of? Does dovecot even do concurrent-user-session locking? So far I've enjoyed playing with dovecot -- far more than the current server we use. I'd like to use it as our primary pop3 server, but preventing users from having concurrent sessions and getting the same message more than once, and keeping them from seeing errors because of their client trying to open multiple sessions is important. Oh, and I'm user dovecot 1.0.beta3, since I don't really have the option of upgrading the OS on my mail servers any time soon. Adrian

9 13

[Dovecot] Quota warnings wrong behaviour (1.1.2)
by Włodek Waligórski 02 Aug '08

02 Aug '08

Hi, I use the latest version of dovecot 1.1.2. Thanks to the excellent docs I managed to get everything working so far, but ... I'm experiencing such strange behaviour when user gets over 90% of quota (the threshold is such): 1. user uses say 89% of his ~/Maildir 2. message arrives that increases quota usage to 92% 3. quota_warning is _NOT_ triggered 4. user deletes the surplus message and gets back to 89% (quota_rule2: Trash:ignore) 5. quota_warning is triggered and quota warning message arrives So the event gets triggered when user passes the quota threshold, but from a "wrong direction". I would expect that message should arrive together with the surplus message. Below I paste my dovecot.conf and "./configure" opts: -------------------cut--------------------------------------- # dovecot -n # 1.1.2: /usr/local/etc/dovecot.conf base_dir: /usr/local/var/run/dovecot/ log_path: /dev/stderr info_log_path: /dev/stderr log_timestamp: listen: 127.0.0.1:143 ssl_listen: 0:993 ssl_cert_file: /var/qmail/control/servercert.pem ssl_key_file: /var/qmail/control/servercert.pem ssl_cipher_list: ALL:!LOW verbose_ssl: yes login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 89 last_valid_uid: 89 mail_uid: vpopmail mail_gid: vchkpw mail_location: maildir:~/Maildir mail_debug: yes mail_plugins: quota imap_quota imap_client_workarounds: outlook-idle auth default: user: vpopmail verbose: yes debug: yes passdb: driver: vpopmail args: quota_template=quota_rule=*:backend=%q userdb: driver: vpopmail plugin: quota: maildir quota_rule: ?:storage=110485760 quota_rule2: Trash:ignore quota_warning: storage=90%% /usr/local/bin/imap-quota-warning 90 ----------------------------------------------------------------------------------- # grep "./configure" config.log | head -1 $ ./configure --disable-ipv6 --without-passwd --without-passwd-file --without-shadow --without-pam --without-checkpassword --without-bsdauth --without-gssapi --without-sia --without-ldap --with-vpopmail --without-static-userdb --without-prefetch-userdb --without-sql --without-pgsql --without-mysql --without-sqlite --with-ssl=openssl ------------------------------------------------------------------------------------ My system is x86 Debian-testing, SMP. -Włodek

1 0

[Dovecot] Permission denied creating inbox file in /var/mail
by Steve Ochani 01 Aug '08

01 Aug '08

Hello all, I'm using dovecot version 1.07 on CentoOS 5 (clone of RHEL 5). When there is no existing mbox file for a user in /var/mail I get the following error: --------------- Jul 31 16:32:32 newnewton dovecot: imap-login: Login: user=<testm2>, method=PLAIN, rip=::ffff:127.0.0.1, lip=::ffff:127.0.0.1, secured Jul 31 16:32:32 newnewton dovecot: IMAP(testm2): open(/var/mail/testm2, O_CREAT) failed: Permission denied Jul 31 16:32:32 newnewton dovecot: IMAP(testm2): access() failed with mbox file /var/mail/testm2: No such file or directory Jul 31 16:32:32 newnewton dovecot: IMAP(testm2): stat() failed with mbox file /var/mail/testm2: No such file or directory Jul 31 16:32:32 newnewton dovecot: IMAP(testm2): Connection closed ---------------- My persimmons on /var/mail (which is a symlink to /var/spool/mail) : drwxrwxr-x 2 root mail 4096 Jul 31 16:32 mail I have tried adding the mail group as mail_privileged_group, the output of dovecot -n : -------------------- # 1.0.7: /etc/dovecot.conf login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_privileged_group: mail mail_location: mbox:~/IMAPmail:INBOX=/var/mail/%u mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd -------------------- Here is the permission on /etc/dovecot.conf -rw-r--r-- 1 root root 42833 Jul 31 15:30 /etc/dovecot.conf I've searched google and the mailing list archive and tried the couple of things commonly suggested. As for a test I changed perms on /var/spool/mail to 777 and then dovecot made the inbox file. The file ended up being owned by the user and the group owner was the group that the user belongs to, not mail. When I create new users using useradd there is a 0 byte file created in /var/mail for the user but I use scripts to create student accounts every semester (about 10,000) so I'm trying to avoid having to add more things that the script will have to create. Any help is greatly appreciated. Thanks -Steve O.

3 4

[Dovecot] dovecot.sieve file location?
by kbajwa 01 Aug '08

01 Aug '08

CentOS 5.2 Postfix-2.3.3 Dovecot-1.1.1 Dovecot.Sieve-1.1.5 I have setup with: home_mailbox = Maildir/ (/etc/postfix/main.cf) & mail-location = maildir:~/Maildir (/etc/dovecot.conf) I have created a 'test' user to test Sieve 'Vacation' setup. My questions are: 1. Which folder '.dovecot.sieve' script is copied into? Is it 'home/test' -or- 'home/test/Maildir' or someplace else? 2. '.dovecot.sieve' script parameter ":days 1" means that the reply is sent once a day. Is it possible to send the reply 'immediately'? Kirti

2 1

[Dovecot] Dovecot load balancing
by Thomas Hummel 01 Aug '08

01 Aug '08

Hello, I'd like to figure out how to set up a site running dovecot on multiple computers for load balancing reasons. I'm currently running dovecot-1.0.14 on a 8GB RAM, 2 quad-core 2.66Ghz Xeon single server which runs FreeBSD 6.2-STABLE SMP. . the mailbox format was mbox and I successfully migrated to Maildir only . mailboxes are on an NFS NetApp server, attribute caching is off . indexes are locally stored . the number of users is around 2500, some of them having huge mailboxes (~ 1 or 2 GB) . a large amount of users is using IMAP but there are also many POP3 users . the passdb/userdb is openLDAP . for now, I neither use namespaces, nor quotas nor deliver, nor any plugin, but I plan to use namespaces and ACL to implement shared mailboxes. The same machine is running postfix-2.4.6 with amavisd-new-2.5.4 (no spamassassin) and clamav-0.93.1. I'm using procmail-3.22 as the LDA. I installed dovecot-1.1.2 on non-standard ports for test and plan to switch to it as I read on this list it performs better, load wise. This setup (1.0.14) works great except that, compared to the time mailboxes were in mbox format, the load average (as shown by 'top') goes higher from a significant amout on a regular basis and sometimes goes over the top. On "normal" circumstances, the number of processes is around 1400 and the load oscillates between 1 to 10 and 30 to 60. Most of the time, I'd say the load average is around 20. Every friday a message (no attachement, decent size) is sent to all users : in such circumstances (but only sometimes, not every time : let's say half the time such a message is sent), the load goes so high that I have to stop dovecot to let procmail deliver the message or even reboot the machine. Sometimes, the load climbs up to something like 150, then goes back to the 'normal' case described above. I know multi-master replication is on the roadmap. I know some dovecot sites use in the meantime several dovecot servers. I'd like to know how those sites do the load balancing, the main problem beeing to be able to direct each user to the same dovecot server each time as stated in the Wiki (http://wiki.dovecot.org/NFS) I don't think that DNS round robin would do the trick because some UA (for instance Thunderbird) often open up to 5 connexions for the same user, unless maybe such UA makes a single 'gethostbyname()', thus connecting 5 times to the same physical server ? What are the options to achieve such a setup ? Any successful experiences ? Thank you -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

8 13

[Dovecot] One LDAP attribute for many variables
by Juan Asensio Sánchez 31 Jul '08

31 Jul '08

Hi Using Dovecot 1.1.2 with LDAP. If i have this: user_attrs = uid=home=/var/vmail/%$,mailuserquota=quota_rule=*:storage=%$,=mail=maildir:/var/vmail/%n/Maildir OK. But if i have this: user_attrs = uid=home=/var/vmail/%$,mailuserquota=quota_rule=*:storage=%$,uid=mail=maildir:/var/vmail/%$/Maildir I get this error: deliver(usuario1): Jul 25 12:59:08 Error: Per-user script path is unknown. See http://wiki.dovecot.org/LDA/Sieve#location The only difference is that I use the uid LDAP attribute twice. Why does this happen?

2 1

[Dovecot] Seen flag in maildir filename not being respected
by Eduardo M KALINOWSKI 31 Jul '08

31 Jul '08

Hi, I'm using dovecot 1.1.2 (but I've noticed this since 1.1.1 which I was using until yesterday). It seems dovecot is ignoring the "S" flag in Maildir filenames, and is relying only in its Index Files to determine if a message has been read or not. I say that because if I delete the dovecot.index.* files for a mail folder, all the mails in there appear as unread. Also, I've tried accessing the maildir directly (using heirloom-mailx, but mutt should have done, too) and reading a new message. The file name was changed to add a "S" to the end, but this message was still marked as "unread" when the mail folder was accessed via IMAP. The flags R, F and T are correctly read from the filename if no index is present. I haven't tested the other flags. I'm using dovecot's deliver, and it creates filenames such as "1217450416.M77457P5201.mail.kalinowski.com.br,S=1377,W=1411:2,S", that is, perfectly fine. dovecot -n: # 1.1.2: /etc/dovecot/dovecot.conf log_path: /var/log/dovecot/main.log info_log_path: /var/log/dovecot/info.log log_timestamp: %Y-%m-%d %H:%M:%S ssl_cert_file: /etc/ssl/certs/server.pem ssl_key_file: /etc/ssl/private/server.pem login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_processes_count: 1 first_valid_uid: 100 mail_privileged_group: mail mail_location: maildir:/home/vmail/%d/%n/INBOX:INDEX=/home/vmail/%d/%n/dovecotidx mail_plugins: quota imap_quota zlib auth default: mechanisms: plain login cram-md5 passdb: driver: passwd-file args: username_format=%n /home/vmail/%d/db/passwd passdb: driver: pam userdb: driver: static args: uid=104 gid=8 home=/home/vmail/%d/%n userdb: driver: passwd socket: type: listen client: path: /var/run/dovecot/auth-client mode: 438 master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: mail plugin: quota: maildir quota_rule: ?:storage=0 quota_rule2: Trash:ignore quota_rule3: Spam:ignore quota_rule4: Spam.Errado:ignore sieve: /home/vmail/%d/db/sieves/%n.sieve

2 3

[Dovecot] wrong permission
by Cor Bosman 31 Jul '08

31 Jul '08

Im still finding a number of control directories that have the wrong permission: Jun 26 00:02:34 userimap13.xs4all.nl dovecot: IMAP(xxx): file_dotlock_create(/var/spool/mail/dovecot-control/g/gl/xxx/INBOX/.Apple Mail To Do/dovecot-uidlist) failed: Permission denied userimap1# ls -al "/var/spool/mail/dovecot-control/g/gl/xxx/INBOX/.Apple Mail To Do" total 8 drw------- 2 xxx user 4096 May 12 23:43 . drwx------ 7 xxx user 4096 May 12 23:43 .. This folder was created May 12, well after us starting to use 1.1RC versions. I currently fixed a few hundred of these (out of millions of folders), and whats interesting is that a very large percentage of those (1/3th) is the folder "Apple Mail To Do", created by Mail.App I think. Obviously that same folder is no where near 1/3th of our total folder number, so thats a bit strange. I really doubt this is some local setting issue, because then id see much more of those. Right now it's a tiny fraction of our total folder amount, which leads me to believe it's some weird edge case in the dovecot code. Anyone have any ideas? Cor

2 9

[Dovecot] dovecot-imap displays empty domainalias mailboxen
by Kacper Wysocki 31 Jul '08

31 Jul '08

Hi folks, I'm using dovecot 1.0.13 as the IMAPS frontend for a vpopmail/qmail virtual domain setup. Dovecot is set up as follows: passdb vpopmail{ } userdb vpopmail{ } I've added a domain alias for the main domain with vaddaliasdomain and email to post@aliasdomain is delivered to post@maindomain and can be checked with pop. However, when I try to check IMAP through the account post@aliasdomain I am confronted with an empty mailbox. If I log in using post@maindomain I get the expected contents. Why can't my users log in using user@aliasdomain to check their emails? Regards, Kacper Wysocki -- http://kacper.doesntexist.org http://windows.dontexist.net There is symmetry in chaos, and chaos in excessive order. Though you may see heaven or hell, remember that it is your mind which creates them. Avoid grasping the one or fleeing the other.

1 0

Re: [Dovecot] Some help required - dovecot: IMAP(matthew): unlink(/home/matthew/Maildir/cur/new) failed: Operation not permitted
by Matthias Andree 31 Jul '08

31 Jul '08

Hi I hope you're not offended by posting a quote to the list... you sent the mail just to me. On Thu, 31 Jul 2008, matbic(a)gmail.com wrote: > Here here is an excerpt: > > ls -l home/matthew/Maildir/cur > ... > drwx------ 2 matthew matthew 512 Jul 30 17:48 cur:2,ST > drwx------ 2 matthew matthew 512 Jul 31 06:55 new > drwx------ 2 matthew matthew 512 Jul 30 18:21 tmp:2,ST > > Is this to be expected or is this my problem? These (in .../Maildir/cur) are your problem - someone created a Maildir underneath Maildir/cur, and dovecot or some other software considered the three directories messages, and goofed up. Check your delivery recipes so that none deliver to .../Maildir/, if you find any, adjust them deliver to .../Maildir/ instead. I'd suggest to: cd /home/matthew/Maildir/cur # move potential messages out to the proper new/... directory # if mv complains about nonexistent .../*, all the better! mv 'cur:2,ST/'* 'new/'* 'tmp:2,ST/'* ../new/ # get rid of the bogus directories rmdir '???:2,ST/' new cd - and see if that fixes the problem. If rmdir fails because there are hidden files, see what they are and where to move them, if the {cur,tmp}:2,ST or new are empty, fine, someone accidentally ran maildirmake with bogus arguments. HTH Matthias

2 1

[Dovecot] .files in dovecot-1.1.1
by John Baker 31 Jul '08

31 Jul '08

Hi there We had been using the stock Ubuntu Dapper Dovecot which is an early 1.0 beta but just upgraded to 1.1.1 to fix some read flag issues with Horde. Previously dovecot seemed to ignore files beginning with "." in the ~/mail (mbox format) directory but now shows them. There doesn't seem to be any switch in the dovcot.conf file to change this. Any such settings are about maildir. Is there anyway to make dovecot-1.1.1 ignore hidden files? Thanks -- John Baker Network Systems Administrator Marlboro College Phone: 451-7551 off campus; 551 on campus

2 1

[Dovecot] login processes from attacks staying for hours
by Kai Schaetzl 31 Jul '08

31 Jul '08

I'm in the process of rolling out new setups with dovecot on CentOS 5.2 and I notice that dovecot doesn't handle the brute-force attacks too nice. I reduced the limit a bit to some reasonable looking value: login_max_processes_count = 32 to stop them earlier and the number of processes stops at that figure when an attack happens. However, it stays at this count for hours although the attack is already over since long. For instance, my monitoring alerts me at the moment when the process count for pop3-login goes over 20 processes. This happened on three machines at 2 am with a brute-force attack from the same source that didn't last longer than a minute or so. However, the process count dropped only at 7am under 20 on two machines and on the third machine it was still over 20 when I was in the office at 9 am and finally killed them. As these machines are all not in production yet, there weren't any other logins and the single brute-force ended within one minute according to the logs (obviously when pop3-logins hit the limit). Shouldn't these processes go down to login_processes_count (3) within a few minutes? An strace shows that they are mostly doing gettimeofday lookups (=sleeping). This is the default dovecot (1.07) coming with CentOS 5.2. I've been running only one other instance of dovecot in production (0.99.11) on CentOS 4.6 so far and I don't know which behavior that displayed in the past as I just recognize that I accidentally ommitted it from monitoring. :-( I had this mailing list searched for "brute-force" to see how others handle this and what dovecot provides to stop these attacks. I have found not many threads about this. There is one with a bit more information: "Delay on failed pw attempts" from January 1. Unfortunately, this functionality is only in a later version of dovecot and it's not clear if it was implemented or not or if it would be helpful. Was it implemented? This thread also mentions fail2ban which may be one way to go, although I don't like this log parsing approach too much. Does anyone use iptables for rate-limiting per IP on the pop/imap ports to prevent brute-force attacks? Kai -- Kai Schätzl, Berlin, Germany Get your web at Conactive Internet Services: http://www.conactive.com

7 9

[Dovecot] installing plugin (autocreate_plugin.c)
by Marcin Gryszkalis 31 Jul '08

31 Jul '08

Hi I want to enable autocreate-plugin, I downloaded http://dovecot.org/patches/1.1/autocreate-plugin.c compiled as specified in comment and got autocreate_plugin.so but I'm not sure how do I install it. I have many plugins in /usr/local/lib/dovecot/ (it's FreeBSD) and subdirs, but they all have libXX_ prefixes (what do they mean?). I couldn't find any information about installing plugins on dovecot's wiki and I don't want to experiment as the server is live (not really important but still live). regards -- Marcin Gryszkalis, PGP 0x9F183FA3 jabber jid:mg@fork.pl, gg:2532994 http://the.fork.pl

2 1

[Dovecot] Some help required - dovecot: IMAP(matthew): unlink(/home/matthew/Maildir/cur/new) failed: Operation not permitted
by matbic＠gmail.com 31 Jul '08

31 Jul '08

Hi all, I have tried very hard to solve this problem but turn to the mailing list as a last resort. In the log I get, for just one account: Jul 31 09:06:17 bickertons dovecot: imap-login: Login: user=<matthew>, method=PLAIN, rip=78.130.81.201, lip=168.143.5.18, TLS Jul 31 09:06:17 bickertons dovecot: IMAP(matthew): Effective uid=1003, gid=1003, home=/home/matthew Jul 31 09:06:17 bickertons dovecot: IMAP(matthew): maildir: data=/home/ matthew/Maildir Jul 31 09:06:17 bickertons dovecot: IMAP(matthew): maildir: root=/home/ matthew/Maildir, index=/home/matthew/Maildir, control=, inbox= Jul 31 09:06:17 bickertons dovecot: IMAP(matthew): unlink(/home/ matthew/Maildir/cur/new) failed: Operation not permitted Jul 31 09:06:18 bickertons last message repeated 3 times All the other accounts work fine. I have tried removing the dovecote.index and the dovecote-keywords and uidlist files. This gets it working for a while but soon we are back to the same problem. I would really not like to lose all the mail in this account, its that of my boss, (slight note of panic) Matthew bickertons# dovecot --version 1.0.13 bickertons# dovecot -n # 1.0.13: /usr/local/etc/dovecot.conf protocols: imap imaps pop3 pop3s disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_max_processes_count: 30 max_mail_processes: 50 verbose_proctitle: yes first_valid_gid: 0 mail_privileged_group: mail mail_location: maildir:~/Maildir mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape- eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: passdb: driver: pam args: * userdb: driver: passwd

2 1

[Dovecot] lib90_cmusieve_plugin.so: undefined symbol: message_decoder_init
by Thomas Harold 31 Jul '08

31 Jul '08

After upgrading our CentOS 5 box to the latest revisions last week (including Dovecot 1.1), we're seeing the following error message in the log files. Sieve was working fine with Dovecot 1.0. I have yet to turn up anything via Google for this particular error. SELinux is not logging any error messages at the moment, so I'm pretty sure that we've properly allowed all the SELinux permissions. # cat /var/vmail/dovecot-deliver.log deliver(ruth(a)example.com): Jul 28 11:11:44 Error: dlopen(/usr/lib64/dovecot/lda/lib90_cmusieve_plugin.so) failed: /usr/lib64/dovecot/lda/lib90_cmusieve_plugin.so: undefined symbol: message_decoder_init deliver(ruth(a)example.com): Jul 28 11:11:44 Fatal: Couldn't load required plugins # ls -l /usr/libexec/dovecot/sievec -rwxr-xr-x 1 root root 165152 Jun 11 03:21 /usr/libexec/dovecot/sievec # ls -l /usr/lib64/dovecot/lda/lib90_cmusieve_plugin.so -rwxr-xr-x 1 root root 141328 Jun 11 03:21 /usr/lib64/dovecot/lda/lib90_cmusieve_plugin.so # yum list | grep "dovecot" dovecot.x86_64 1:1.1.1-2_76.el5 installed dovecot-sieve.x86_64 1.1.5-8.el5 installed dovecot.x86_64 1:1.1.2-2_77.el5 atrpms dovecot-devel.x86_64 1:1.1.2-2_77.el5 atrpms

3 8

[Dovecot] broken links to xexec module and patches
by mail＠viliar.net.ru 30 Jul '08

30 Jul '08

>From this page attaches cannot be downloaded anymore: http://wiki.dovecot.org/Plugins/xexec Error: You are not allowed to do AttachFile on this page. Login and try again. Clear message Probably files should be placed here http://www.dovecot.org/patches/ And on page above just links to it? A. -------------- "Hic Jacet Ego" gpg key: http://viliar.net.ru/public.gpg

3 3

Re: [Dovecot] broken links to xexec module and patches
by mail＠viliar.net.ru 30 Jul '08

30 Jul '08

I already ask it in maillist. Please, see first letter. I'm not the module author or author of contributed patch to remake links at wiki on my way, for example. There are free files. Original source for xexec module, kindly given by you. Patch from Stephan, to make xexec work with dovecot 1.1 and prepatched source by me after testing Stephan patch. Yes, I have the files too, so at least now it can be downloaded: Original xexec source from wiki. http://files.viliar.net.ru/os/xexec.tar.gz Patch to original xexec for dovecot 1.1 from Stephan. from his site: http://www.rename-it.nl/dovecot/patches/dovecot-xexec-1.1.v2.patch or here: http://files.viliar.net.ru/os/dovecot-xexec-1.1.v2.patch Prepatched: http://files.viliar.net.ru/os/xexec.1.1.v2.tar.gz > Why don't you write Timo about this because I don't think I have the > latest files. Ask why the links don't work. > > mail(a)viliar.net.ru wrote: >>> mail(a)viliar.net.ru wrote: >>> >>>> >From this page attaches cannot be downloaded anymore: >>>> http://wiki.dovecot.org/Plugins/xexec >>>> >>>> Error: >>>> You are not allowed to do AttachFile on this page. Login and try >>>> again. >>>> Clear message >>>> >>>> >>> Oh yeah, that's right. AttachFile got disallowed recently. I have the >>> patch for v1.1 available at: >>> >>> http://www.rename-it.nl/dovecot/patches/dovecot-xexec-1.1.v2.patch >>> >>> I think Marc Perkel will have the original xexec.tar.gz somewhere. >>> Perhaps he could put it online somewhere and adjust the wiki >>> accordingly? >>> >> >> Both ways, imho, good. Just to be assured, it can be downloaded >> somethere. >> ( I just found in my logs (by referer) user googling query, where he >> seek >> place to download xexec... :-) ) >> >> >> >> A. >> >> -------------- >> >> "Hic Jacet Ego" >> >> gpg key: http://viliar.net.ru/public.gpg >> >> >> >> > A. -------------- "Hic Jacet Ego" gpg key: http://viliar.net.ru/public.gpg

1 0

[Dovecot] Xexec Wiki Links Broken?
by Marc Perkel 30 Jul '08

30 Jul '08

Someone pointed out to me that the links to the code on the wiki for xexec no longer work. Can someone fix this?

1 0

[Dovecot] DoveCot IMAP and "inconsistent state" messages
by Chris Richards 30 Jul '08

30 Jul '08

I need some help troubleshooting this problem. It only shows up with IMAP connections. I initially thought it was related to SquirrelMail (because it gives me an 'EXPUNGE' error), but after attempting to send IMAP commands directly to the server as shown below, I'm thinking there is something else going on. The system configuration is PostFix as the MTA delivering to procmail in the mailbox (maildir format), with Dovecot handling POP3 and IMAP Postfix is version 2.3.3 Dovecot is version 1.0.rc15 procmail is version 3.22 2001/09/10 kernel is 2.6.18-53.1.14.el5, CentOS 5 There is additional info about the system configuration after the command sequence and log entries below. I've left my typos in, just in case they somehow bear on the problem. I omitted about 2050 messages from the mailbox FETCH listing, since they were all identical but for the message number, and I didn't figure you'd want to read all of that. :) Command sequence: [me@myserver~]$ telnet locahost 143 locahost/143: Name or service not known [me@myserver~]$ telnet localhost 143 Trying 127.0.0.1... Connected to localhost.localdomain (127.0.0.1). Escape character is '^]'. * OK myserver awaiting command login me mypass login BAD Error in IMAP command received by server. a001 login me mypass a001 OK Logged in. a002 list "Mail" "*" a002 OK List completed. a003 list "Folders" "*" a003 OK List completed. a004 list "Inbox" a004 BAD Error in IMAP command LIST: Invalid arguments. a005 list "Inbox" "*" * LIST (\HasNoChildren) "." "INBOX" a005 OK List completed. a006 list "" "*" * LIST (\HasNoChildren) "." "Drafts" * LIST (\HasNoChildren) "." "Spam" * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "Sent" * LIST (\HasNoChildren) "." "INBOX" a006 OK List completed. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 2088 EXISTS * 1 RECENT * OK [UNSEEN 2088] First unseen. * OK [UIDVALIDITY 1190322195] UIDs valid * OK [UIDNEXT 89700] Predicted next UID a007 OK [READ-WRITE] Select completed. a008 FETCH l:* FLAGS a008 BAD Error in IMAP command FETCH: Invalid messageset a008 FETCH 1:* FLAGS * 1 FETCH (FLAGS (\Seen)) * 2 FETCH (FLAGS (\Seen)) * 3 FETCH (FLAGS (\Seen)) * 4 FETCH (FLAGS (\Seen)) * 5 FETCH (FLAGS (\Seen)) * 6 FETCH (FLAGS (\Seen)) . . . * 2083 FETCH (FLAGS (\Seen)) * 2084 FETCH (FLAGS (\Seen)) * 2085 FETCH (FLAGS (\Seen)) * 2086 FETCH (FLAGS (\Seen)) * 2087 FETCH (FLAGS (\Seen)) * 2088 FETCH (FLAGS (\Recent)) * BYE Mailbox is in inconsistent state, please relogin. Connection closed by foreign host. These are the corresponding entries from my mail syslog during the same time period. I've included the postfix entries, as they might be relevant to the problem. Mar 31 13:55:14 myserver dovecot: imap-login: Login: user=<me>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Mar 31 13:55:33 myserver dovecot: pop3-login: Login: user=<me>, method=PLAIN, rip=xxx.xxx.xxx.xxx, lip=yyy.yyy.yyy.yyy Mar 31 13:55:35 myserver dovecot: POP3(me): Disconnected: Logged out top=0/0, retr=1/18590, del=2/2089, size=10863040 Mar 31 13:56:29 myserver postfix/smtpd[26589]: connect from unknown[79.165.160.211] Mar 31 13:56:30 myserver postfix/smtpd[26589]: 1A57E2F7E6: client=unknown[79.165.160.211] Mar 31 13:56:30 myserver postfix/cleanup[26646]: 1A57E2F7E6: message-id=<000901c89360$061afdf8$11e5c1ae@qawbud> Mar 31 13:56:35 myserver postfix/qmgr[2254]: 1A57E2F7E6: from=<amsonson(a)impsat.com.ar>, size=61232, nrcpt=1 (queue active) Mar 31 13:56:36 myserver postfix/smtpd[26651]: connect from localhost.localdomain [127.0.0.1] Mar 31 13:56:36 myserver postfix/smtpd[26651]: C98262F893: client=localhost.localdomain [127.0.0.1] Mar 31 13:56:36 myserver postfix/cleanup[26646]: C98262F893: message-id=<000901c89360$061afdf8$11e5c1ae@qawbud> Mar 31 13:56:36 myserver postfix/smtpd[26651]: disconnect from localhost.localdomain [127.0.0.1] Mar 31 13:56:36 myserver amavis[26499]: (26499-03) Passed SPAMMY, [79.165.160.211] [79.165.160.211] <amsonson(a)impsat.com.ar> -> <me(a)digitalvoice.com>, Message-ID: <000901c89360$061afdf8$11e5c1ae@qawbud>, mail_id: 47TfQi44++zM, Hits: 17.608, size: 61232, queued_as: C98262F893, 1372 ms Mar 31 13:56:36 myserver postfix/smtp[26648]: 1A57E2F7E6: to=<me(a)mydomain.com>, orig_to=<postmaster(a)digitalvoice.com>, relay=127.0.0.1[127.0.0.1]:10024, delay=6.8, delays=5.4/0.01/0.01/1.4, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as C98262F893)Mar 31 13:56:36 myserver postfix/qmgr[2254]: C98262F893: from=<amsonson(a)impsat.com.ar>, size=62235, nrcpt=1 (queue active) Mar 31 13:56:36 myserver postfix/qmgr[2254]: 1A57E2F7E6: removed Mar 31 13:56:36 myserver postfix/local[26653]: C98262F893: to=<me(a)mydomain.com>, relay=local, delay=0.12, delays=0.1/0.01/0/0.01, dsn=2.0.0, status=sent (delivered to command: /usr/bin/procmail) Mar 31 13:56:36 myserver postfix/qmgr[2254]: C98262F893: removed Mar 31 13:58:07 myserver dovecot: pop3-login: Login: user=<someone>, method=PLAIN, rip=xxx.xxx.xxx.xxx, lip=yyy.yyy.yyy.yyy Mar 31 13:58:07 myserver dovecot: POP3(someone): Disconnected: Logged out top=0/0, retr=0/0, del=0/291, size=11570114 Mar 31 14:00:58 myserver dovecot: IMAP(me): Maildir /home/me/.Maildir sync: UID inserted in the middle of mailbox (85953 > 85053, file = msg.XL7B:2,) Mar 31 14:00:58 myserver dovecot: IMAP(me): Disconnected: Mailbox is in inconsistent state, please relogin. output of dovecot -n: # /etc/dovecot.conf listen: * login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_greeting: myserver awaiting command mail_location: maildir:~/.Maildir mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postdrop master: So, now I've got two questions: 1. Is accessing a mailbox via POP3 and IMAP at the same time considered to be a Bad Thing? 2. Is having procmail drop messages directly into the directory that the IMAP process is scanning a Bad Thing? 3. Is there a better/preferred way to have Postfix/procmail deliver mail to the maildir that will keep Dovecot IMAP happy? (There don't seem to be any issues with pure POP3 access). Thanks in advance for your help, and if there's anything else you need to know that I can provide, please ask. I've tried to provide as much information up front as I can. Later, Chris

8 23

[Dovecot] Sieve extension registration
by Julian Cowley 29 Jul '08

29 Jul '08

Cool, I just happened to notice this while browsing... >From <http://www.iana.org/assignments/sieve-extensions>: Capability name: vnd.dovecot.* (anything starting with "vnd.dovecot.") Description: Extends the Sieve language with vendor-defined functionality specific to the Dovecot Secure IMAP server (http://www.dovecot.org) RFC number: Not applicable Contact address: Stephan Bosch <stephan&rename-it.nl> Timo Sirainen <tss&iki.fi> Registration Date: 2008-07-28 Any current plans for it or is it just a placeholder?

2 2

[Dovecot] Fix available for mmap on FreeBSD zfs
by Adam McDougall 29 Jul '08

29 Jul '08

Saw this just come through for 8-current, 7-stable ought to have it in a week or so. I have not encountered the problem so I would not be able to judge if this fixes it. Patch here: http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/contrib/opensolaris/uts/commo… pjd 2008-03-15 23:23:04 UTC FreeBSD src repository Modified files: sys/contrib/opensolaris/uts/common/fs/zfs zfs_vnops.c Log: Fix mmap(2) on ZFS after some changes in VM subsystem. Submitted by: alc Reported by: kris (originally) and many others Tested with: fsx MFC after: 1 week Revision Changes Path 1.28 +4 -0 src/sys/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c

2 3

[Dovecot] limiting the per-time connections from one single IP address
by suomi 28 Jul '08

28 Jul '08

Hi every we had a havy pop3 attach yesterday morning: about 400'000 connects in three hours from one single IP address within wandadoo.fr. the easiest way, to protect the dovecot server against such attacks would be to limit the number of connections anyone can open from one single IP address to the server in a certain time. this feature is available in newer versions of postfix, where i have limited the number of SMTP connections possible from one single IP address in one minute to three (3). i checked to see in the dovecot-wiki, but found only the #login_max_processes_count = 128 #login_max_connections = 256 which both do not contain neither a per-time constraint nor a per-IP-address constraint. is this already possible with current versions of deovecot? the dovecot -n: # 1.0.14: /etc/dovecot.conf ssl_cert_file: /etc/pki/ldap/mirador.cert.pem ssl_key_file: /etc/pki/ldap/mirador.key.pem login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login first_valid_uid: 51 mail_location: maildir:%h/%m mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: ldap args: /etc/openldap/dovecot.conf userdb: driver: ldap args: /etc/openldap/dovecot.conf thank you very much for any valid hint. suomi

3 2