September 2009 - dovecot

[Dovecot] Dovecot Erros in Logs
by David Cunningham 07 Sep '09

07 Sep '09

I got lots of errors that look like this: Error: write(dnotify pipe) failed: Bad file descriptor I am running dovecot-1.2.4-0_99 on RHEL4 dovecot -n: # 1.2.4: /etc/dovecot.conf # OS: Linux 2.6.9-89.0.3.ELsmp x86_64 Red Hat Enterprise Linux AS release 4 (Nahant Update 8) ext3 log_path: /var/log/dovecot info_log_path: /var/log/dovecot-info login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_process_per_connection: no login_process_size: 1024 login_processes_count: 6 login_max_processes_count: 1024 login_max_connections: 1024 max_mail_processes: 50000 verbose_proctitle: yes first_valid_uid: 50 mail_uid: 93 mail_gid: 12 mail_location: maildir:/var/spool/maildirs/%d/%n/Maildir mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_process_size: 1024 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 namespace: type: private prefix: INBOX. inbox: yes list: yes subscriptions: yes lda: postmaster_address: postmaster(a)example.com auth default: cache_ttl: 43200 cache_negative_ttl: 0 verbose: yes passdb: driver: ldap args: /etc/dovecot-ldap.conf plugin: quota: maildir Any suggestions? Dave

2 4

[Dovecot] IMAP Directory Issues (brand new install)
by Jesse Vollmar 07 Sep '09

07 Sep '09

Hi, I just installed dovecot 1.1.11 and am having some issues. Mail appears to be delivered to the Maildirs just fine, but when a client (Thunderbird) tries to retrieve them I get this: dovecot: IMAP(info(a)aedisit.com): maildir_file_do(/var/mail/ > aedisit.com/info/cur/1251566335.V14I27a91M380600.kim) Filename keeps > changing After turning on mail debug mode, I get this: Aug 29 13:41:48 kim dovecot: IMAP(vollmarj(a)aedisit.com): maildir: > data=/var/mail/ > aedisit.com/vollmarj:INDEX=/var/dovecot/indexes/aedisit.com/vollmarj Aug 29 13:41:48 kim dovecot: IMAP(vollmarj(a)aedisit.com): maildir++: > root=/var/mail/aedisit.com/vollmarj, index=/var/dovecot/indexes/ > aedisit.com/vollmarj, control=, inbox=/var/mail/aedisit.com/vollmarj Here is my dovecot -n output: # 1.1.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.28-15-server x86_64 Ubuntu 9.04 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 auth default: passdb: driver: pam userdb: driver: passwd

2 2

[Dovecot] setting up both system password users AND virtual users
by Markus Bonet 07 Sep '09

07 Sep '09

Hi, I want to pick up this discussion. I am trying to achieve the same, but I am using Maildir instead. Here's the (relevent part of the) config file as configured by the recent suggestion: # We're using Maildir format mail_location = maildir:~/Maildir # Authentication configuration: auth_verbose = yes auth default { mechanisms = plain userdb passwd { } userdb static { args = uid=vmail gid=vmail home=/daten/mailusers/%u } passdb passwd-file { args = /etc/dovecot/passwd } } But when I try to login in to a system's user mailbox, it'll be rejected as unknown in my Dovecot's passwd file. I am converting from courier-imap, so I am kind of new to Dovecot. Markus

2 1

[Dovecot] IMAP activity after disconnect
by Charles Sprickman 07 Sep '09

07 Sep '09

Howdy, I'm running Dovecot 1.1.16 on a staging server to do some testing before building a new server and moving a bunch of qmail/vpopmail/courier accounts over. I wanted to test the migration of courier accounts to dovecot with a few clients, so I copied over a few large accounts. All went well with a small account (100+ messages) when accessing the account via POP - no re-downloads after adjusting the uidl format. IMAP looks good as well after running the conversion script and setting the namespace properly. However, one thing I copied over without paying much attention was a non-quota'd spam box that has literally not been checked in at least a year: [root@nac /var/vmail/xxx.com/spork/Maildir/.Spam]# ls new/| wc -l 70501 Mail.app valiantly tried to sync this, but when I realized just how huge this was, I took the account offline and quit the app. However it seems like Dovecot is still busy doing something in that mailbox: lsof: no pwd entry for UID 5000 imap 27515 5000 7uW VREG 0,95 3372 2968764 /jails/nac.xxx.com/var/vmail/xxx.com/spork/Maildir/.Spam/dovecot.index.log lsof: no pwd entry for UID 5000 imap 27515 5000 8u VREG 0,95 488 3007349 /jails/nac.xxx.com/var/vmail/xxx.com/spork/Maildir/.Spam/dovecot.index lsof: no pwd entry for UID 5000 imap 27515 5000 9u VREG 0,95 25195 27064933 /jails/nac.xxx.com/var/vmail/xxx.com/spork/Maildir/.Spam/dovecot-uidlist lsof: no pwd entry for UID 5000 imap 27515 5000 10r VDIR 0,95 15171072 2968758 /jails/nac.xxx.com/var/vmail/xxx.com/spork/Maildir/.Spam/new My guess is it's trying to build an index. This process is chewing up 100% of whatever cpu it lands on. Is this expected behavior (not the huge cpu usage, but the imap server continuing to work on the box after the client has logged out)? Are there any config settings I've missed to sort of put a cap on how much cpu/time dovecot will spend on a task like this? So far this has been running for about 20 minutes. I'm going to kill it and manually delete the spam since I'm not familiar enough with gdb to dig in and see just what it's doing (although my guess is indexing). On the upside, I have some serious spam magnet addresses in this test domain, so now I've got a great platform to test my amavis/postfix/policy skills. :) Thanks, Charles ___ Charles Sprickman NetEng/SysAdmin Bway.net - New York's Best Internet - www.bway.net spork(a)bway.net - 212.655.9344

2 1

Re: [Dovecot] Dovecot and LDAP-Quotas
by south africa 07 Sep '09

07 Sep '09

> It says nothing about LDAP here, which means that unless you filtered > out some lines it's not using LDAP at all for anything. What does your > dovecot -n output show now? dovecot -n # 1.2.3: /etc/dovecot.conf # OS: Linux 2.6.18-128.4.1.el5 x86_64 CentOS release 5.3 (Final) ext3 log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot.log protocols: pop3 pop3s imap imaps listen(default): 123.456.789.71 listen(imap): 123.456.789.71 listen(pop3): 123.456.789.72 ssl_listen(default): ssl_listen(imap): ssl_listen(pop3): 123.456.789.72:995 ssl_ca_file: /etc/pki/dovecot/certs/pop_core_uk/trustcenter_intermediate.crt ssl_cert_file: /etc/pki/dovecot/certs/pop_core_uk/server.crt ssl_key_file: /etc/pki/dovecot/private/pop_core_uk/server.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_location: maildir:/home/vmail/%Lu/Maildir/ mail_debug: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh lda: debug: yes postmaster_address: postmster(a)core.uk hostname: smtp.core.uk mail_plugins: quota quota_full_tempfail: yes log_path: /var/log/dovecot-deliver.log log_timestamp: %b %d %H:%M:%S rejection_reason: Ihre Nachricht an <%t> wurde automatisiert abgewiesen:%n%r auth default: mechanisms: plain login username_translation: @_._ verbose: yes debug: yes debug_passwords: yes passdb: driver: ldap args: /etc/dovecot-ldap.conf userdb: driver: static args: uid=500 gid=500 home=/home/vmail/%Lu allow_all_users=yes userdb: driver: ldap args: /etc/dovecot-ldap-userdb.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: postfix plugin: quota: maildir:User quota quota_rule: *:storage=8M quota_warning: storage=90%% /usr/local/bin/quota-warning.sh 90 quota_warning2: storage=75%% /usr/local/bin/quota-warning.sh 75 ------------------------------------------------------------------ dovecot-ldap.conf hosts = 123.456.789.123 123.456.789.124 base = OU=one,OU=two,OU=London,OU=GB,OU=User Accounts,DC=three,DC=core,DC=uk ldap_version = 3 auth_bind = yes auth_bind_userdn = %u(a)three.core.uk user_filter = (&(objectClass=person)(cn=%u)) user_attrs = description=quota_rule=*:storage=%$M ------------------------------------------------------------------ dovecot-ldap-userdb.conf is a symbolic link on dovecot-ldap.conf _____________________________________________________________ Get your FREE TheDoghouseMail email address at http://www.thedoghousemail.com

2 1

[Dovecot] mbox to maildir migration question and problems, dovecot-1.0.7-7.el5
by Eric Sammons 07 Sep '09

07 Sep '09

Hi, I am trying to assist a customer with a mbox to maildir migration. I have them using the latest and greatest mb2md.pl; the one that support -K, -U|-u. They have seen overwhelming success with this; however, a recent mbox introduced a new scenario and the result was that all messages were replayed in the client UI. The mbox in question had _no_ X-UID tags. To work-a-round the issue the customer performed the following steps. [snip] We found that the fix was to clear /var/indexes/$USER for the account and log in and log back out. After doing this X-UID's were populated for each respective message. [/snip] The customer also noted that after the migration all messages went to ~/MailDir/new. I would appreciate any thoughts on why this scenario played out the way it did? Is it expected that these messages should reside in ~/MailDir/new? [config] protocol pop3 { pop3_uidl_format = %08Xv%08Xu pop3_reuse_xuidl = yes } [/config] Thank you! -- Eric L. Sammons, RHCE

2 1

[Dovecot] "Disconnected in APPEND" sometimes when with attachment
by Igor Bogomazov 07 Sep '09

07 Sep '09

Hello! When I send a message with an attachment bigger than some undefined size, the folllowing error appears in logs: "Disconnected in APPEND" How to increase the allowed size or anything? # dovecot -n # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: pop3 pop3s imap imaps ssl_cert_file: /usr/local/etc/ssl/certs/highlink.ru.pem ssl_key_file: /usr/local/etc/ssl/private/highlink.ru.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_location: maildir:~/.maildir mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: mechanisms: plain login passdb: driver: passwd-file args: /etc/dovecot/dovecot.passwd userdb: driver: passwd-file args: /etc/dovecot/dovecot.passwd socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: dovecot group: dovecot

3 2

[Dovecot] Problem with ldap error logging
by Stefano Fedrigo 07 Sep '09

07 Sep '09

I configured dovecot to authenticate through ldap. When for some reason the ldap server is not working dovecot writes this message to the system log: dovecot: auth(default): accept(type 1) failed: Too many open files "Too many open files" is caused by an openldap bug. The serious problem is that dovecot repeats that message a huge number of times, something like 20000 times per second, until the ldap daemon starts working or, more likely, no more disk space remains. -- // Stefano Fedrigo - Develer S.r.l. \X/ http://www.develer.com

3 6

[Dovecot] Sieve plugin load error
by Jonathan Siegle 07 Sep '09

07 Sep '09

Running: dovecot revision 9333:15b4b2c904fe dovecot sieve revision: 1091:0fe00772366f AIX 5.3 64bit Deliver gives error: Aug 19 12:30:52 deliver(jsiegle): Error: dlopen(/usr/dovecot-1.2.4/lib/ dovecot/lda/lib90_sieve_plugin.so) failed: rtld: 0712-001 Symbol notify_command was referenced from module /usr/dovecot-1.2.4/lib/dovecot/lda/ lib90_sieve_plugin.so(), but a runtime definition of the symbol was not found. rtld: 0712-001 Symbol notify_operation/usr/dovecot-1.2.4/lib/dovecot/ lda/lib90_sieve_plugin.so was referenced from module /usr/dovecot-1.2.4/lib/dovecot/lda/ lib90_sieve_plugin.so(), but a runtime definition of the symbol was not found. rtld: 0712-002 fatal error: exiting. Aug 19 12:30:52 deliver(jsiegle): Fatal: Couldn't load required plugins Aug 19 12:38:53 deliver(jsiegle): Info: Loading modules from directory: /usr/dovecot-1.2.4/lib/dovecot/lda I see a local symbol referenced in the so and also an Undefined as well. tr27n12.aset.psu.edu# nm -X 64 /usr/ladmin/dovecot-1.2.4/lib/dovecot/ lda/lib90_sieve_plugin.so|grep notify_command notify_command U - notify_command d 4563447648 8 notify_operation is different: # nm lib90_sieve_plugin.so |grep ^notify_operation notify_operation U - # nm lib90_sieve_plugin.a |grep ^notify_operation notify_operation U - notify_operation d 448 8

2 2

[Dovecot] mail_uid and mail_gid are not set in environment (for expire-tool and so)
by Baptiste Malguy 07 Sep '09

07 Sep '09

Hello, I've just subscribed to the list, as a recent user of Dovecot (1.2.4 by now). I eventually missed a point, so I tried to find other doc or comments about my issue, but failed to. If the following has already been discussed, please simply reply with a URL to the corresponding thread or doc ;-) Now that I have covered my ass, here is the problem I meet. In dovecot.conf, I have the following: mail_uid = vmail mail_guid = vmail which is confirmed with 'dovecot -n' I have a script my-expire-tool-test containing: #!/bin/sh set which basically only display environment variables. When I run : /usr/sbin/dovecot --exec-mail ext my-expire-tool-test I do not see any variable MAIL_UID nor MAIL_GID. As a consquence, when I run /usr/sbin/dovecot --exec-mail ext my-expire-tool with my-expire-tool containing: #!/bin/sh # This script is a workaround for Dovecot 1.2 having issue to load modules when running expire-tool. # More information: http://wiki.dovecot.org/Plugins/Expire, search Dovecot v1.2 MAIL_PLUGINS=${MAIL_PLUGINS//antispam/} MAIL_PLUGINS=${MAIL_PLUGINS//imap_acl/} MAIL_PLUGINS=${MAIL_PLUGINS//imap_quota/} MAIL_PLUGINS=${MAIL_PLUGINS//mail_log/} exec /usr/lib/dovecot/expire-tool "$@" It politely tells me: Error: userdb(user@domain) didn't return uid and mail_uid not set Actually, this is this message error that lead me to check the environment variables. Then I also checked the source code, and run: grep -r env_put . | grep -i mail_ No trace of mail_uid nor mail_gid. Did I find a bug or did I miss a point ? Regards, -- Baptiste MALGUY - http://www.malguy.net PGP fingerprint: 49B0 4F6E 4AA8 B149 B2DF 9267 0F65 6C1C C473 6EC2

3 3