- dovecot - dovecot.org

[Dovecot] Variable expansion in LDA vs POP/IMAP
by Stephane Enten 27 May '07

27 May '07

Hello all, I'm trying to understand when exactly the variable substitution happens in Dovecot, as I get different results in the LDA and in the POP/IMAP server. Here's my general setup: - Postfix MTA, delivers mail via Dovecot LDA - users list sits in a database - mail directory is stored in the database, but with Dovecot variables inside Delivery works perfectly fine, Dovecot's deliver get a "mail" column from the database (that looks like this: /mail/01/%2LMd/%2.2LMd/%LMd/mail/%Ln/ ) and expands variables, delivers the mail into the maildir's location. Now if I try to access the mailbox through Dovecot's POP/IMAP server, it looks like it gets the right field from the database, but won't expand the variables: May 24 18:31:14 mail1 dovecot: imap-login: Login: user=<XXXXX>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured May 24 18:31:14 mail1 dovecot: IMAP(XXXXX): Effective uid=1021, gid=304, home= May 24 18:31:14 mail1 dovecot: IMAP(XXXXX): maildir: data=/mail/01/%2LMd/%2.2LMd/%LMd/mail/%Ln/ May 24 18:31:14 mail1 dovecot: IMAP(XXXXX): maildir: root=/mail/01/%2LMd/%2.2LMd/%LMd/mail/%Ln, index=/srv/mail/01/%2LMd /%2.2LMd/%LMd/mail/%Ln, control=, inbox= May 24 18:31:14 wmail1-v dovecot: IMAP(XXXXX): Disconnected Am I missing something to get the pop/imap part expand those ? -- Stephane Enten

3 4

[Dovecot] UID confusion
by Kevin 27 May '07

27 May '07

I have just finished reading the info on the wiki on setting up virtual users with Dovecot and Postfix. http://wiki.dovecot.org/DovecotLDAPostfixAdminMySQL I'm confused about the UID and GID's. In the docs it shows a user, vmail being created with a UID of 101. Then it looks like GID 12 is used for Postfix or Mail. I'm not sure which it is and would like to know. Bulldozer

2 1

Re: [Dovecot] question mailbox format
by sc2＠gmx.at 27 May '07

27 May '07

ok after playing a while now it works , but i have one problem open.. a.) now he makes for pop3 index files in /var/indexes/%u/imap/index etc... you said that is correct too if i only use pop3 ? b.) i have as INBOX file /var/spool/mail/%u set, when somebody logs in, and the mailbox exist he gets the email (from mbox file), but when the mbox does not exist he makes a directory, instead of a file like /var/spool/mail/%u. The problem is when a new mail comes and the mbox file does not exist, the mail is saved to the directory as msg and not as mbox file any ideas? Btw im using version 1.0.0 thx

4 7

[Dovecot] locking question
by Paul Amaral 27 May '07

27 May '07

Hi, I'm using Maildir with dovecot .99, I'm getting some errors with fcntl locks. Do I still need to use a locking mechanism if I'm using maildir with pop3 access. For reasons I won't go into I cant upgrade from .99 to version one at the time. I'm getting this error with some users, I have tried to manually delete the .imap.index file but the error comes back, any thoughts? May 24 12:11:21 pop imap(generalg): Timeout while waiting for release of exclusive fcntl() lock for index file /home/g/generalg/Ma ildir/.INBOX/.imap.index TIA, Paul

3 2

[Dovecot] Address extensions with dovecot LDA
by Nick Kartsioukas 27 May '07

27 May '07

Greetings! I'm using Dovecot and Postfix with virtual mailboxes, the mailbox data is contained in a MySQL database. I'd like to use the Dovecot delivery agent so I can support Sieve filters. However, I'm not sure how to get the delivery agent to work with the Dovecot auth mechanism and MySQL to do proper lookups of email addresses with address extensions (such as test-blah(a)example.com) Does anyone have a similar setup that can tell me how I might get this to work? -- Nick Kartsioukas | KF6UZB change(a)nightwind.net | NK2694

1 1

[Dovecot] Quick question on multiple access to dovecot indexes
by Adam McDougall 26 May '07

26 May '07

I have up to 4 servers that will run dovecot behind a load balancer, which means the same user might be accessing the same mailbox from multiple servers, and it seems like dovecot doesn't like multiple access to the dovecot indexes for the one user since I currently have them stored in a nfs home directory. Is this a bad thing? Must I keep a seperate index location per server? Just today I started running dovecot on more than one server like this and started seeing things in the logs like: May 25 11:19:13 boomhauer dovecot: IMAP(mcdouga9): Corrupted transaction log file /home/mcdouga9/Maildir/dovecot/public/indexes/decs/.support.In/dovecot.index.log: end_offset (1332) > current sync_offset (1244) May 25 11:19:13 boomhauer dovecot: IMAP(mcdouga9): broken sync positions in index file /home/mcdouga9/Maildir/dovecot/public/indexes/decs/.support.In/dovecot.index May 25 11:19:13 boomhauer dovecot: IMAP(mcdouga9): fscking index file /home/mcdouga9/Maildir/dovecot/public/indexes/decs/.support.In/dovecot.index May 25 11:19:13 boomhauer dovecot: IMAP(mcdouga9): Fixed index file /home/mcdouga9/Maildir/dovecot/public/indexes/decs/.support.In/dovecot.index: log file sync pos 2,1332 -> 2, 1244 May 25 11:19:13 boomhauer dovecot: IMAP(mcdouga9): Unexpected transaction log desync with index /home/mcdouga9/Maildir/dovecot/public/indexes/decs/.support.In/dovecot.index May 25 11:19:13 boomhauer dovecot: IMAP(mcdouga9): Disconnected: Mailbox is in inconsistent state, please relogin. May 25 11:19:17 dauterive dovecot: IMAP(mcdouga9): file mail-index.c: line 983 (mail_index_sync_from_transactions): assertion failed: (hdr.messages_count == (*map)->hdr.messages_count) May 25 11:19:17 dauterive dovecot: child 16386 (imap) killed with signal 6 ... May 25 11:19:53 dauterive in.imapproxyd[17211]: LOGIN: '"mcdouga9"' (127.0.0.1:53650) on existing sd [9] May 25 11:19:53 dauterive dovecot: IMAP(mcdouga9): Transaction log file /home/mcdouga9/Maildir/dovecot/public/indexes/decs/.support.In/dovecot.index.log: marked corrupted May 25 11:19:53 dauterive dovecot: IMAP(mcdouga9): Transaction log file /home/mcdouga9/Maildir/dovecot/public/indexes/decs/.support.In/dovecot.index.log.2: marked corrupted

2 2

[Dovecot] Dovecot crashes with malformed Qpopper's mbox
by 前田剛 26 May '07

26 May '07

I am testing migration from Qpopper 4.0.5 and have come across a problem. Dovecot dies while processing UIDL command when accessing malformed Qpopper's mbox which has duplicated "From " separator. Qpopper occasionally makes such header while rewriting mbox. In the attached file, unnecessary "From " at line 3. ---------------- * Dovecot 1.0.0 on Debian 4.0(x86) * ext3 filesystem(not NFS) * description Dovecot dies while processing UIDL command with malformed Qpopper's mbox which has duplicated "From " separator. This occurs when "pop3_reuse_xuidl" is "yes". conversation with Dovecot ~~~~~~~~~~~~~~~~~~~~~~~~~ $ telnet localhost 110 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. +OK Dovecot ready. user xxxxxxxx +OK pass xxxxxxxx +OK Logged in. uidl Connection closed by foreign host. * Dovecot configuration # /usr/local/etc/dovecot.conf protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_extra_groups: mail mail_location: mbox:~/:INBOX=/var/mail/%u mail_full_filesystem_access: yes mbox_write_locks: fcntl mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_reuse_xuidl(default): no pop3_reuse_xuidl(imap): no pop3_reuse_xuidl(pop3): yes pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: * how to reproduce 1. set "pop3_reuse_xuidl = yes". 2. replace test user's mailbox with attached file. 3. pop3 login and exec "UIDL". POP3 process will die. -- // -------------------------------------------------------------- // MAEDA, Go <maeda-g(a)secom-sanin.co.jp> POP3(test01): file ../../../src/lib/array.h: line 157 (_array_idx): assertion failed: (idx * array->element_size < array->buffer->used) POP3(test01): Raw backtrace: pop3 [0x80a9fab] -> pop3 [0x80a99a9] -> pop3 [0x807ec2c] -> pop3(index_mail_get_headers+0x254) [0x807eeb4] -> pop3(index_mail_get_first_header+0x18) [0x807ef48] -> pop3(mail_get_first_header+0x16) [0x809b746] -> pop3 [0x8057ae9] -> pop3 [0x8057c7f] -> pop3 [0x805674e] -> pop3(io_loop_handler_run+0x128) [0x80b03e8] -> pop3(io_loop_run+0x28) [0x80af858] -> pop3(main+0x82) [0x8058792] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xc8) [0xb7dffea8] -> pop3 [0x8055c21] child 4788 (pop3) killed with signal 6 From xxx(a)xx.xxxxxxx.xx.xx Sat Feb 17 19:27:47 2007 X-UIDL: i[f"!$h*!!S67!!/RW!! From xxx(a)xx.xxxxxxx.xx.xx Sat Feb 17 19:27:47 2007 Return-Path: <xxx(a)xx.xxxxxxx.xx.xx> X-Original-To: xxxxxxxx(a)xx.xxxxxxx.xx.xx Delivered-To: xxxxxxxx(a)xx.xxxxxxx.xx.xx Received: xxxx xxxx-xxxx-xxxxxx.xxxxxxx.xx.xx (xx [xxx.x.x.x]) xx xx-xxxxxxxx.xxxxxxx.xx.xx (xxxxxxx) xxxx xxxx xx xxxxxxxxxx xxx <xxxxxxxx(a)xx.xxxxxxx.xx.xx>; xxx, xx xxx xxxx xx:xx:xx +xxxx (xxx) Received: xx xx.xxxxxxx.xx.xx (xxxxxxx, xxxx xxxxxx xx) xx xxxxxxxxxx; xxx, xx xxx xxxx xx:xx:xx +xxxx (xxx) X-Mailer: xxxxxxx xx.x xx xxx.xxxxxx.xx.xx X-HTTP_REFERER: xxxx://xxx.xx-xxxxxxx.xx.xx/xxxx/xxxxx.xxxx Errors-To: xxxxxxxxx(a)xx-xxxxxxx.xx.xx To: xxxxxxxxx(a)xx-xxxxxxx.xx.xx From: x.xxxxxxxxx(a)xxxxxxx.xxx Subject: $x<xxx$x$?$$(xx-xxxx Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="ISO-2022-JP" Message-Id: <xxxxxxxxxxxxxx.xxxxxxxxxx(a)xx.xxxxxxx.xx.xx> Date: Sat, 17 Feb 2007 19:27:47 +0900 (JST) Status: RO xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx From xxx(a)xx.xxxxxxx.xx.xx Tue Feb 20 14:06:25 2007 X-UIDL: 7;j"!L;8"!b\%#!pH5!! Return-Path: <xxx(a)xx.xxxxxxx.xx.xx> X-Original-To: xxxxxxxx(a)xx.xxxxxxx.xx.xx Delivered-To: xxxxxxxx(a)xx.xxxxxxx.xx.xx Received: xxxx xxxx-xxxx-xxxxxx.xxxxxxx.xx.xx (xx [xxx.x.x.x]) xx xx-xxxxxxxx.xxxxxxx.xx.xx (xxxxxxx) xxxx xxxx xx xxxxxxxxxx xxx <xxxxxxxx(a)xx.xxxxxxx.xx.xx>; xxx, xx xxx xxxx xx:xx:xx +xxxx (xxx) Received: xx xx.xxxxxxx.xx.xx (xxxxxxx, xxxx xxxxxx xx) xx xxxxxxxxxx; xxx, xx xxx xxxx xx:xx:xx +xxxx (xxx) X-Mailer: xxxxxxx xx.x xx xxx.xxxxxx.xx.xx X-HTTP_REFERER: xxxx://xxx.xx-xxxxxxx.xx.xx/xxxx/xxxxx.xxxx Errors-To: xxxxxxxxx(a)xx-xxxxxxx.xx.xx To: xxxxxxxxx(a)xx-xxxxxxx.xx.xx From: xxxxx(a)xxxxx-xxx.xx.xx Subject: $x<xxx$x$?$$(xx-xxxx Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="ISO-2022-JP" Message-Id: <xxxxxxxxxxxxxx.xxxxxxxxxx(a)xx.xxxxxxx.xx.xx> Date: Tue, 20 Feb 2007 14:06:25 +0900 (JST) Status: RO xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx

3 7

[Dovecot] Return error instead of dying on time back skip?
by Amon Ott 26 May '07

26 May '07

Hello everybody! Currently, dovecot just kills itself if it detects that time has moved backwards more than a hardcoded number of seconds. I accept the reasons, but I do not like to restart dovecot manually after waiting for time to move forward again. A cron job would not help, because time might still be wrong when it restarts dovecot. All our systems run ntpd, but they might be offline for a while before they get contact to a time server, e.g. because of DSL problems. When they do get contact and time is too far off, ntpd sets the new time directly (yes, it could gradually do that, but it might take ages). Now I wonder if Dovecot could return errors to the users instead of dying until time is fine again, e.g. "System time has moved backwards, please come back in n seconds". If the time skip is just a few seconds, it can of course delay and then go on as it does now. With this change, no admin would be needed to carefully restart Dovecot at the right time. I have not looked into Dovecot code myself yet, but could try a patch if necessary. Amon Ott -- Amon Ott - m-privacy GmbH Am Köllnischen Park 1, 10179 Berlin Tel: +49 30 24342334 Fax: +49 30 24342336 Web: http://www.m-privacy.de Handelsregister: Amtsgericht Charlottenburg HRB 84946 Geschäftsführer: Dipl.-Kfm. Holger Maczkowsky, Roman Maczkowsky GnuPG-Key-ID: EA898571

6 7

[Dovecot] dovecot.org DNS finally ok
by Timo Sirainen 26 May '07

26 May '07

All DNS caches that had the old dovecot.org IP should finally be expired by now. About 20 people were unsubscribed because of bounces. I've subscribed them back. I think I'm also going to set up a dovecot.org mirror which can be quickly brought up if the current dovecot.org happens to break for some reason. www.dovecot.org and wiki.dovecot.org at least needs to be up quickly. BTW. Anyone is free to set up their own dovecot.org mirror: rsync -qavz --delete dovecot.org::hg hg rsync -qavz --delete dovecot.org::dovecotweb www rsync -qavz --delete dovecot.org::dovecotwiki wiki rsync -qavz --delete dovecot.org::dovecotmail mail rsync -qavz --delete dovecot.org::dovecotnewsmail mail-news rsync -qavz --delete dovecot.org::dovecotcvsmail mail-cvs I don't want any official mirrors though. They're more trouble than worth. :)

1 0

[Dovecot] question mailbox format
by sc2＠gmx.at 26 May '07

26 May '07

i set mail_location = mbox:/var/spool/mail/%u and protocols = pop3s pop3 why he trys to create and use imap format?` in log are May 25 18:52:25 mail dovecot: pop3-login: Login: user=<richard>, method=PLAIN, rip=80.xx.xx.xx, lip=xx.xx.24.29, TLS May 25 18:52:26 mail dovecot: POP3(richard): open(/var/spool/mail/richard/inbo x, O_CREAT) failed: Not a directory May 25 18:52:26 mail dovecot: POP3(richard): mkdir_parents(/var/spool/mail/richard/.imap/INBOX) failed: Not a directory May 25 18:52:26 mail dovecot: POP3(richard): stat() failed with mbox file /var/ spool/mail/richard/inbox: Not a directory May 25 18:52:26 mail dovecot: POP3(richard): Couldn't init INBOX: Internal erro r occurred. Refer to server log for more information. [2007-05-25 18:52:25] May 25 18:52:26 mail dovecot: POP3(richard): Mailbox init failed top=0/0, retr= 0/0, del=0/0, size=0 friendly regards and thx

3 5