April 2008 - dovecot - dovecot.org

Re: [Dovecot] Leave mail on server leads to dup messages
by Arliss Jameson 05 Apr '08

05 Apr '08

Yep, that was it! Though I use only one user for all mail, separate home dirs are still necessary. ----- Original Message ---- From: Arliss Jameson <arlissjameson(a)yahoo.com> To: Arliss Jameson <arlissjameson(a)yahoo.com>; dovecot(a)dovecot.org Sent: Friday, April 4, 2008 5:29:04 PM Subject: Re: [Dovecot] Leave mail on server leads to dup messages Of course right when I press send, I think of something that may be the cause :) It's precisely because they are sharing the same home that this ishappening, yes? If any of the other mbox's are downloaded, dovecotincrements the X-UID count and saves it in the home? Is that right? ____________________________________________________________________________________ You rock. That's why Blockbuster's offering you one month of Blockbuster Total Access, No Cost. http://tc.deals.yahoo.com/tc/blockbuster/text5.com ____________________________________________________________________________________ You rock. That's why Blockbuster's offering you one month of Blockbuster Total Access, No Cost. http://tc.deals.yahoo.com/tc/blockbuster/text5.com

1 0

Re: [Dovecot] Leave mail on server leads to dup messages
by Arliss Jameson 05 Apr '08

05 Apr '08

Of course right when I press send, I think of something that may be the cause :) It's precisely because they are sharing the same home that this ishappening, yes? If any of the other mbox's are downloaded, dovecotincrements the X-UID count and saves it in the home? Is that right? ____________________________________________________________________________________ You rock. That's why Blockbuster's offering you one month of Blockbuster Total Access, No Cost. http://tc.deals.yahoo.com/tc/blockbuster/text5.com

1 0

[Dovecot] Leave mail on server leads to dup messages
by Arliss Jameson 05 Apr '08

05 Apr '08

Hi. I'm a dovecot newbie. I've set my pop client to leave messages on the server for 7 days. I'm downloading the same messages over and over as dovecot appears to be overwriting X-UID's in the mbox's. I can't think of any other program on the system that might write to the mbox other than postfix (and that program doesn't appear to be writing X-UID). My setup has one user (system account: vmail) that owns all mbox's. The user_query always returns vmail's home, uid and gid (you can view the SELECT's in the log snippet below).I have a total of four pop3 virtual mbox's. The example below illustrates what happens to one of them (though this problem extends to the others as well). Here's what happens: 1) Start with an empty mbox 2) Start dovecot 3) Download mail (received one email) cat mbox | egrep "X-UID:" X-UID: 789 4) Download mail again (received another email) cat mbox | egrep "X-UID:" X-UID: 789 X-UID: 790 5) Download mail once more (received three spam emails) cat mbox | egrep "X-UID:" X-UID: 811 X-UID: 812 X-UID: 813 X-UID: 814 X-UID: 815 What the?! 6) Check log dovecot: Apr 04 13:51:42 Info: auth(default): new auth connection: pid=12843 dovecot: Apr 04 13:51:42 Info: auth(default): client in: AUTH 1 PLAIN service=POP3 lip=76.158.191.23 rip=44.156.77.13 resp=<hidden> dovecot: Apr 04 13:51:42 Info: auth-worker(default): sql(imacrawler(a)searchingforaddressestospam.com,44.156.77.13): query: SELECT CONCAT(username, '@', domain) AS user, password FROM (SELECT vuser.username, vuser.password, vdomain.name AS domain FROM vuser LEFT JOIN vdomain ON vuser.vdomain_id=vdomain.id) a WHERE a.username='imacrawler' AND a.domain='searchingforaddressestospam.com' dovecot: Apr 04 13:51:42 Info: auth(default): client out: OK 1 user=imacrawler(a)searchingforaddressestospam.com dovecot: Apr 04 13:51:42 Info: auth(default): master in: REQUEST 7 12837 1 dovecot: Apr 04 13:51:42 Info: auth-worker(default): sql(imacrawler(a)searchingforaddressestospam.com,44.156.77.13): SELECT '/vmail' AS home, CONCAT('mbox:~/mail:INBOX=/var/spool/vmail/', TRIM('searchingforaddressestospam.com'), '/', TRIM('imacrawler')) AS mail, 103 AS uid, 104 AS gid dovecot: Apr 04 13:51:42 Info: auth(default): master out: USER 7 imacrawler(a)searchingforaddressestospam.com home=/vmail mail=mbox:~/mail:INBOX=/var/spool/vmail/searchingforaddressestospam.com/ima… uid=103 gid=104 dovecot: Apr 04 13:51:42 Error: POP3(imacrawler(a)searchingforaddressestospam.com): mbox sync: Expunged message reappeared in mailbox /var/spool/vmail/searchingforaddressestospam.com/imacrawler (UID 789 < 796, seq=1, idx_msgs=0) dovecot: Apr 04 13:51:42 Info: pop3-login: Login: user=<imacrawler(a)searchingforaddressestospam.com>, method=PLAIN, rip=44.156.77.13, lip=76.158.191.23 dovecot: Apr 04 13:51:42 Error: POP3(imacrawler(a)searchingforaddressestospam.com): mbox sync: UID inserted in the middle of mailbox /var/spool/vmail/searchingforaddressestospam.com/imacrawler (796 > 789, seq=1, idx_msgs=5) dovecot: Apr 04 13:51:42 Error: POP3(imacrawler(a)searchingforaddressestospam.com): mbox sync: UID inserted in the middle of mailbox /var/spool/vmail/searchingforaddressestospam.com/imacrawler (801 > 789, seq=1, idx_msgs=5) dovecot: Apr 04 13:51:43 Error: POP3(imacrawler(a)searchingforaddressestospam.com): mbox sync: UID inserted in the middle of mailbox /var/spool/vmail/searchingforaddressestospam.com/imacrawler (806 > 789, seq=1, idx_msgs=5) dovecot: Apr 04 13:51:43 Info: POP3(imacrawler(a)searchingforaddressestospam.com): Disconnected: Logged out top=0/0, retr=5/9032, del=0/5, size=8947 I have no idea why it's complaining about 796 or where that number even came from. Much thanks for any help you can give. Here's my dovecot -n: # 1.0.13: /usr/local/etc/dovecot.conf log_path: /var/log/dovecot protocols: pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/pop3-login first_valid_uid: 103 last_valid_uid: 103 first_valid_gid: 104 last_valid_gid: 104 mail_privileged_group: vmail mail_executable: /usr/local/libexec/dovecot/pop3 mail_plugin_dir: /usr/local/lib/dovecot/pop3 pop3_uidl_format: %08Xu%08Xv auth default: verbose: yes debug: yes passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf ____________________________________________________________________________________ You rock. That's why Blockbuster's offering you one month of Blockbuster Total Access, No Cost. http://tc.deals.yahoo.com/tc/blockbuster/text5.com

1 0

[Dovecot] Dovecot and stale nfs-locks hanging processes
by Søren Schrøder 05 Apr '08

05 Apr '08

Greetings dovecot mailing list. I have implemented a relatively big dovecot setup (250k users) and overall I am very pleased with dovecot functionality and performance. Setup description: * dovecot 1.0.x * FreeBSD 6.3 * Postfix (using dovecot deliver as LDA). * OpenLdap backend * Storage is NFS (Clariion EMC NFSd for Maildir, and FreeBSD NFSd for Indexes). * Locking is fcntl using RPC.lockd. * Users are accessing mail using POP3 and IMAP (IMAP mainly via Squirrelmail, but also direct) * 3 frontends for POP/SMTP and 2 frontends for IMAP (webmail). Round Robin DNS My problem: I am having issues where POP3, IMAP and DELIVER processes gets stuck, apparently waiting for device. fstat shows: bash# fstat -p 93522 USER CMD PID FD MOUNT INUM MODE SZ|DV R/W 302870 pop3 93522 root / 2 drwxr-xr-x 512 r 302870 pop3 93522 wd /home/mnt5 51592 drwxr-xr-x 80 r 302870 pop3 93522 text /usr 121619 -r-xr-xr-x 436616 r 302870 pop3 93522 0* internet stream tcp 302870 pop3 93522 1* internet stream tcp 302870 pop3 93522 2* pipe c778aa48 <-> c778a990 0 rw 302870 pop3 93522 3 /dev 24 crw-rw-rw- random r 302870 pop3 93522 5* pipe ce440b28 <-> ce440be0 0 rw 302870 pop3 93522 6* pipe ce440be0 <-> ce440b28 0 rw 302870 pop3 93522 7 /home/mnt5 9010290 -rw------- 1493 rw 302870 pop3 93522 8 - - bad - 302870 pop3 93522 9 - - bad - 302870 pop3 93522 10 - - bad And the inode in question on /home/mnt5 is a dot-nfs file, indicating stale lock: bash# ls -li | grep 9010290 9010290 -rw------- 1 302870 42 1493 Apr 3 18:05 .nfs.0668c236.6d524.4 ktrace on the pid shows absolutely no activity. The pop3 process is un-killable, and I end up stacking up pop3 processes from the user, as well as deliver to the user. Not healthy.. I was under the impression that POP3 would exit when a lock is set, preventing more than one pop3 processes pr. user, but it doesn't seem to be the case. Stopping dovecot entirely, leaves these stale pop3/imap/deliver processes hanging, even with shutdown_clients = yes The windows-problem-solution (reboot) seems to be the only way to get rid of the locked processes. So: Has anyone else observed this behavior, and eventually found the magic cure ? I wonder if there was a way to implement a "max wall-clock time" per dovecot process type (i.e.. terminate process after for example 120 sec. delivery, 600 sec pop3 etc...), as a crude "garbage-collector". Any hints/suggestions is welcome. -- Søren Schrøder

3 4

[Dovecot] LDAP auth_bind hangs and times out
by Jack McKinney 04 Apr '08

04 Apr '08

I have _almost_ got Dovecot working! One little snag... My users login using their email address as username. Each domain has their own LDAP subtree. Each user has an entry in the ou=users subtree of the domain subtree, and has a mail: field (inetOrgPerson) listing their email address/login name. I am trying to use auth_bind: when I login with jackmc(a)lorentz.com, dovecot should search for mail=jackmc(a)lorentz.com in the onelevel below ou=users,dc=lorentz,dc=com and find me as "cn=Jack McKinney,ou=users,dc=lorentz,dc=com". I have created an entry in LDAP (varmail) that should be able to do this query. Indeed, from the command line, it works: ldapsearch -h ldap.lrtz -b 'ou=users, dc=lorentz, dc=com' -D 'cn=varmail,ou=users,dc=lorentz,dc=com' -x -W -s onelevel '(&(objectClass=inetOrgPerson)(mail=jackmc(a)lorentz.com))' Enter LDAP Password: # extended LDIF # # LDAPv3 # base <ou=users, dc=lorentz, dc=com> with scope oneLevel # filter: (&(objectClass=inetOrgPerson)(mail=jackmc(a)lorentz.com)) # requesting: ALL # # Jack McKinney, users, lorentz.com dn: cn=Jack McKinney,ou=users,dc=lorentz,dc=com objectClass: top objectClass: person objectClass: organizationalPerson objectClass: inetOrgPerson cn: Jack McKinney givenName: Jack McKinney sn: McKinney mail: jackmc(a)lorentz.com # search result search: 2 result: 0 Success # numResponses: 2 # numEntries: 1 ' However, it appears that dovecot performs the above query successfully, but then never uses the password and retrieved DN to attempt to bind and authenticate the user. Instead, it just times out. My dovecot-ldap.conf is: hosts = ldap.lrtz dn = cn=varmail,ou=users,dc=lorentz,dc=com dnpass = ********* ldap_version = 3 auth_bind = yes pass_filter = (&(objectClass=inetOrgPerson)(mail=%Lu)) base = ou=users, dc=%Dd scope = onelevel The dovecot log shows: Apr 3 08:13:21 fourier dovecot: auth(default): new auth connection: pid=15774 Apr 3 08:13:30 fourier dovecot: auth(default): client in: AUTH^I1^IPLAIN^Iservice=IMAP^Isecured^Ilip=x.x.x.x^Irip=y.y.y.y^Iresp=<hidden> Apr 3 08:13:30 fourier dovecot: auth(default): ldap(jackmc(a)lorentz.com,y.y.y.y): bind search: base=ou=users, dc=lorentz,dc=com filter=(&(objectClass=inetOrgPerson)(mail=jackmc(a)lorentz.com)) Apr 3 08:16:30 fourier dovecot: imap-login: Disconnected: Inactivity: method=PLAIN, rip=y.y.y.y, lip=x.x.x.x, TLS The OpenLDAP log shows that the query is received and that it returns a match: Apr 3 08:13:30 fourier slapd[14039]: conn=7 op=3 SRCH base="ou=users,dc=lorentz,dc=com" scope=1 deref=0 filter="(&(objectClass=inetOrgPerson)(mail=jackmc(a)lorentz.com))" Apr 3 08:13:30 fourier slapd[14039]: conn=7 op=3 SRCH attr=uid Apr 3 08:13:30 fourier slapd[14039]: conn=7 op=3 SEARCH RESULT tag=101 err=0 nentries=1 text= When I do the query from the command line, there is an additional pair of lines: Apr 3 08:18:10 fourier slapd[16106]: conn=22 op=2 UNBIND Apr 3 08:18:10 fourier slapd[16106]: conn=22 fd=28 closed I thus conclude that Dovecot is not closing the connection. -- Jack McKinney GPG 1024D/99C6A174 jackmc(a)lorentz.com YM:lfaatsnat2006 AIM:jackmclorentz "There is no parameter that makes it impossible for you to perform still more excellently." -Mario Cuomo, on the lack of a clock in baseball

2 11

[Dovecot] "Dumb" proxying?
by Dan Bongert 04 Apr '08

04 Apr '08

I'm a database noob, and it really seems like it would be overkill for my setup: I just want to proxy all connections from my DMZ to my internal mail server -- same internal server for all users. I used to use perdition for this set up, but am having issues getting it to play nicely with my new servers. Can I bypass all of the SQL stuff and just have dovecot forward all POP/IMAP connections to a specific server? Or perhaps set up a wild card lookup in the database (preferably something serverless like sqlite) so that no matter the query, it'll return one server? I don't really want to add "database management" to my list of jobs I have to do, especially for ~1000 users, and when I don't handle user creation/deletion. -- Dan Bongert dbongert(a)ssc.wisc.edu

4 3

[Dovecot] How to force working of a redirect features in sieve plugin?
by Vitalij Satanivskij 04 Apr '08

04 Apr '08

Hello Trying to setup dovecot installation with sieve plugin, can't configure how to make redirect working. My setup 1 Exim + dovecot lda begin transports dovecot_virtual_delivery: driver = pipe command = /usr/local/dovecot/libexec/dovecot/deliver -d $local_part message_prefix = message_suffix = delivery_date_add envelope_to_add return_path_add log_output user = exim 2 Dovecot protocol lda { postmaster_address = postmaster@******* hostname = ********** mail_plugins = cmusieve mail_plugin_dir = /usr/local/dovecot/lib/dovecot/lda # Binary to use for sending mails. sendmail_path = "/usr/sbin/sendmail" # UNIX socket path to master authentication server to find users. auth_socket_path = /var/run/dovecot/auth-master } /usr/sbin/sendmail it's realy exim binary but I.m try full path to real exim - /usr/local/sbi/exim too. That's I.m getting in log files Mar 28 22:23:10 scorpio deliver(satan): Sending a forward to <*****@**********> with return path <<postmaster@******>> Mar 28 22:23:10 scorpio deliver(satan): Sendmail process terminated abnormally, signal 11 Mar 28 22:23:10 scorpio deliver(satan): sieve runtime error: Redirect: Error sending mail and in exim log 2008-03-28 22:23:10 1JfL6U-000LBj-24 <satan@********>: dovecot_virtual_delivery transport output: /libexec/ld-elf.so.1: environment corrupt; mi Question is - how deliver sending mail thru sendmail_path = "/usr/sbin/sendmail"? Via pipe? -- Vitalij Satanivskij

2 2

[Dovecot] outlook2007 shows frequent imap disconnect no matter what outlook-idle setting in dovecot.conf
by Kielbasiewicz, Peter 04 Apr '08

04 Apr '08

Hello, I saw the problem quite often in various posts but could not find a real solution . Problem is that I frequently get annoying popups from outlook 2007 about imap idle timeouts which block working with outlook until the popup is acknowledged. The popup says: Your IMAP server closed the connection. This can occur if you leave the connection idle for too long. Protocol: IMAP Server: testhost Port: 143 Error Code: 0x800CCCDD I tried to run dovecot with or without "imap_client_workarounds = outlook-idle" but do not see any difference. I am running dovecot on Red Hat Enterprise Linux Client release 5.1 (Tikanga). Below is the output of some commands to get a clue about my config. Background info: Our primary mailboxes are on exchange servers. As there is a size limit on the server mailboxes I am evaluating a local storage solution for our users. Thus I set up an additional mailbox in outlook using IMAP. Local .pst files can not be backuped easily (especially when outlook is running) and I am investigating a local IMAP server where users can move their mails to. This server can easily be backuped (even incrementally when using Maildir) and users do always have access to their mails. The drawbacks are that users must have an extra login to the imap server because I have no ldap access to the company AD server from our local site domain. The solution will not be accepted though if I can not prevent the frequent disconnect popups. Peter #dovecot --version 1.0.rc15 #dovecot -n # /etc/dovecot.conf protocols: imap imaps login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: maildir:~/Maildir maildir_copy_with_hardlinks: yes auth default: passdb: driver: pam userdb: driver: passwd # tail /var/log/messages Mar 26 06:45:28 testhost dovecot: imap-login: Login: user=<peter>, method=PLAIN, rip=::ffff:130.143.81.176, lip=::ffff:130.143.83.92 Mar 26 06:46:01 testhost dovecot: IMAP(peter): Disconnected: Logged out Mar 26 06:46:01 testhost dovecot: IMAP(peter): Disconnected Mar 26 07:15:31 testhost dovecot: imap-login: Login: user=<peter>, method=PLAIN, rip=::ffff:130.143.81.176, lip=::ffff:130.143.83.92 Mar 26 07:15:31 testhost dovecot: imap-login: Login: user=<peter>, method=PLAIN, rip=::ffff:130.143.81.176, lip=::ffff:130.143.83.92 Mar 26 07:16:04 testhost dovecot: IMAP(peter): Disconnected Mar 26 07:16:04 testhost dovecot: IMAP(peter): Disconnected Mar 26 07:40:13 testhost dovecot: imap-login: Login: user=<peter>, method=PLAIN, rip=::ffff:130.143.81.176, lip=::ffff:130.143.83.92 Mar 26 07:40:13 testhost dovecot: imap-login: Login: user=<peter>, method=PLAIN, rip=::ffff:130.143.81.176, lip=::ffff:130.143.83.92 Mar 26 07:40:39 testhost dovecot: IMAP(peter): Disconnected

6 6

[Dovecot] Confusion of Sieve filter scripts and the file separator. (Amatuer Siever)
by Jack 04 Apr '08

04 Apr '08

Hello, I have just been playing around with sieve filters to split up all my incoming mail into the correct directories. I have created some subdirectories to put mailing list emails in and just want to check if my thinking is correct. I am using namespaces with the '/' character as the separator. When creating the fileinto line on my sieve scripts I thought I would have to use the '/' character to separate the folders (as horde mail also does), but that doesn't work (and produces a "Invalid folder" error) instead I must use the '.' character. I am using the dovecot deliver module and managesieve for my sieve stuff (dovecot 1.0.13). I am just wondering if this is the correct behaviour or if it is a bug of sorts. Cheers. From, Jack

2 1

[Dovecot] Dovecot config
by Dien Phan 04 Apr '08

04 Apr '08

Hi, I've installed dovecot 1.0.13 on FreeBSD 6.3 RELEASE and now trying to configure it. Below is my config file: $ dovecot -n # 1.0.13: /usr/local/etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot-info.log protocols: imap ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login mail_location: maildir:~/Maildir dotlock_use_excl: yes maildir_copy_with_hardlinks: yes mail_plugins: antispam imap_client_workarounds: delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep auth default: verbose: yes passdb: driver: checkpassword args: /var/MailRoot/bin/dovecot_xmail userdb: driver: static args: uid=vxmail gid=vxmail home=/var/MailRoot/domains/%d/%n allow_all_users=yes socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: vxmail plugin: antispam_signature: X-DSPAM-Signature antispam_trash: Trash antispam_spam: SPAM antispam_dspam_binary: /usr/local/bin/dspam antispam_dspam_args: --user;%u We are using a web mail software that allows users to login either as us 'abc' or 'abc@domain'. The problem is: when a user logs in as 'abc' (without domain part) dovecots creates a directory /var/MailRoot/domains/abc and check mail there (as I understand because %d is blank). My question is how to config dovecot so it automatically add default domain %d is blank. Thank you for help. Dien Phan

3 2