- dovecot - dovecot.org

Re: [Dovecot] Dovecot won't stay running
by Jon Slater 22 Jun '07

22 Jun '07

So I got the same suggestion several times, and I upgraded to Dovecot 1.0.1. At 1:27am and again at 5:23am Dovecot stopped running. My cron was able to restart the service in both instances, but how do I debug why this is happening? Thanks!!! Jon > -----Original Message----- > From: dovecot-bounces(a)dovecot.org [mailto:dovecot-bounces@dovecot.org] > On Behalf Of Jon Slater > Sent: Thursday, June 21, 2007 5:19 PM > To: dovecot(a)dovecot.org > Subject: [Dovecot] Dovecot won't stay running > > This weekend I upgraded my OS from FC4 to FC6. At the same time I > updated > Dovecot from 0.99 to 1.0.0. > > Now, dovecot periodically shuts off. > > It will run fine for several hours then just dies. > > Right now my solution is to run a cron every 5 minutes to see if it’s > still > running, and if not, re-start it. > > I’m also having trouble finding any sort of meaningful logs to tell me > what’s going on. > > Where should I start? > > Thanks in advance! > > Jon > > > No virus found in this outgoing message. > Checked by AVG Free Edition. > Version: 7.5.472 / Virus Database: 269.9.2/858 - Release Date: > 6/21/2007 > 1:46 PM > > > No virus found in this incoming message. > Checked by AVG Free Edition. > Version: 7.5.472 / Virus Database: 269.9.2/858 - Release Date: > 6/21/2007 1:46 PM > No virus found in this outgoing message. Checked by AVG Free Edition. Version: 7.5.472 / Virus Database: 269.9.4/860 - Release Date: 6/21/2007 5:53 PM

1 0

[Dovecot] Dovecot won't stay running
by Jon Slater 22 Jun '07

22 Jun '07

This weekend I upgraded my OS from FC4 to FC6. At the same time I updated Dovecot from 0.99 to 1.0.0. Now, dovecot periodically shuts off. It will run fine for several hours then just dies. Right now my solution is to run a cron every 5 minutes to see if it’s still running, and if not, re-start it. I’m also having trouble finding any sort of meaningful logs to tell me what’s going on. Where should I start? Thanks in advance! Jon No virus found in this outgoing message. Checked by AVG Free Edition. Version: 7.5.472 / Virus Database: 269.9.2/858 - Release Date: 6/21/2007 1:46 PM

1 0

Re: [Dovecot] Fwd: LDAP subtree search on AD
by Bruno Puga 22 Jun '07

22 Jun '07

Timo, I have sent this message below before but I didn't saw that it was delivered to you personal email instead to the list, I just see this now, sorry. Because I'm in a hurry I gave up using Dovecot + AD and start using Mysql as my userdb and passdb and things worked perfect until the moment. I have some doubts but I will open a new thread for this. Anyway, if you get some news about this issue I would appreciate to know, if not, that's OK. Many thanks for your help. Bruno. On 6/18/07, Bruno Puga <brpuga(a)gmail.com> wrote: > > Timo, I had set this in the dovecot.conf: > > auth_verbose = yes > auth_debug = yes > auth_debug_passwords = yes > > ########################################################### > ### My dovecot logs shows this using auth_bind = yes and userdn template > ### > > dovecot: 2007-06-17 12:35:52 Warning: Killed with signal 15 > dovecot: 2007-06-17 12:35:53 Info: Dovecot v1.0.0 starting up > dovecot: 2007-06-17 12:37:23 Info: auth(default): client in: AUTH > 1 PLAIN service=IMAP secured lip= 192.168.0.251 rip=192.168.0.251 > resp=AHRlc3RlAHRlc3Rl > dovecot: 2007-06-17 12:37:23 Info: auth(default): ldap(teste,192.168.0.251): > bind: dn=teste > dovecot: 2007-06-17 12:37:23 Info: auth(default): client out: OK > 1 user=teste > dovecot: 2007-06-17 12:37:23 Info: auth(default): master in: REQUEST > 1 31290 1 > dovecot: 2007-06-17 12:37:23 Info: auth(default): ldap(teste,192.168.0.251): > user search: base=DC=tecnicopias01,DC=com,DC=br scope=subtree > filter=(&(objectClass=organizationalPerson)(sAMAccountName=teste)) > fields=info > dovecot: 2007-06-17 12:40:23 Info: imap-login: Disconnected: Inactivity: > user=<teste>, method=PLAIN, rip=192.168.0.251 , lip=192.168.0.251, secured > > dovecot: 2007-06-17 12:52:46 Error: auth(default): ldap(teste, > 192.168.0.251): ldap_search() failed: Operations error > dovecot: 2007-06-17 12:52:46 Info: auth(default): master out: FAIL 1 > dovecot: 2007-06-17 12:52:46 Error: auth(default): LDAP: ldap_result() > failed: Can't contact LDAP server > dovecot: 2007-06-17 13:07:46 Error: auth(default): LDAP: ldap_result() > failed: Can't contact LDAP server > dovecot: 2007-06-17 13:22:47 Error: auth(default): LDAP: ldap_result() > failed: Can't contact LDAP server > > As we can see, first dovecot bind correct, but after it open a new > connection as showed in the ngrep output, and without bind try to make the > ldap_search, in that point AD blocks the search saying that for the new > connection opened is necessary a successful bind. > ########################################################### > > ### Now, changing for User database Lookups authenticating with krb5 ### > > dovecot: 2007-06-18 10:14:35 Info: auth(default): client in: AUTH > 1 PLAIN service=IMAP secured lip=192.168.0.251 rip= > 192.168.0.251 resp=AHRlc3RlAHRlc3Rl > dovecot: 2007-06-18 10:14:35 Info: auth(default): pam(teste,192.168.0.251): > lookup service=dovecot > dovecot: 2007-06-18 10:14:35 Info: auth(default): client out: OK > 1 user=teste > dovecot: 2007-06-18 10:14:35 Info: auth(default): master in: REQUEST > 1 32029 1 > dovecot: 2007-06-18 10:14:35 Info: auth(default): ldap(teste,192.168.0.251): > user search: base=DC=tecnicopias01,DC=com,DC=br scope=subtree > filter=(&(objectClass=organizationalPerson)(sAMAccountName=teste)) > fields=info > dovecot: 2007-06-18 10:17:35 Info: imap-login: Disconnected: Inactivity: > user=<teste>, method=PLAIN, rip=192.168.0.251 , lip=192.168.0.251, secured > > dovecot: 2007-06-18 10:29:25 Error: auth(default): ldap(teste, > 192.168.0.251): ldap_search() failed: Operations error > dovecot: 2007-06-18 10:29:25 Info: auth(default): master out: FAIL 1 > dovecot: 2007-06-18 10:29:25 Error: auth(default): LDAP: ldap_result() > failed: Can't contact LDAP server > dovecot: 2007-06-18 10:44:26 Error: auth(default): LDAP: ldap_result() > failed: Can't contact LDAP server > dovecot: 2007-06-18 10:59:26 Error: auth(default): LDAP: ldap_result() > failed: Can't contact LDAP server > > ########################################################### > > After some time, the dovecot logs starts logging this last 3 lines saying > it "Can't contact LDAP server", and ngrep shows this: > > ########################################################### > ############# > T 192.168.0.251:49043 -> 192.168.0.11:389 [AP] > 0E...`@....1CN=postfix,CN=Users,DC=tecnicopias01,DC=com,DC=br..post123! > # > T 192.168.0.11:389 -> 192.168.0.251:49043 [AP] > 0........a............ > ### > T 192.168.0.251:49043 -> 192.168.0.11:389 [AP] > 0....B. > ####### > T 192.168.0.251:42083 -> 192.168.0.11:389 [AP] > 0E...`@....1CN=postfix,CN=Users,DC=tecnicopias01,DC=com,DC=br..post123! > # > T 192.168.0.11:389 -> 192.168.0.251:42083 [AP] > 0........a............ > ### > T 192.168.0.251:42083 -> 192.168.0.11:389 [AP] > 0....B. > ####### > T 192.168.0.251:52084 -> 192.168.0.11:389 [AP] > 0E...`@....1CN=postfix,CN=Users,DC=tecnicopias01,DC=com,DC=br..post123! > # > T 192.168.0.11:389 -> 192.168.0.251:52084 [AP] > 0........a............ > # > > Dovecot after a while keep trying to connect to LDAP server without any > requests being sent to server. So it keep logging this line below forever: > > LDAP: ldap_result() failed: Can't contact LDAP server > ########################################################### > > If I change the base to the same location as the user being authenticating > is, the userdb lookup is successfully because he's find at a first > ldap_seach try, and no subtree search is necessary. So again I think dovecot > must not open other connections then that opened at the bind time to make > the subtree search, like postfix do. > > Timo, I'm waiting for your reply. > > Thanks in advance to spent your time to contribute with free software, > Bruno.

1 0

[Dovecot] test program #2: mmaping
by Timo Sirainen 21 Jun '07

21 Jun '07

Attached another test program. I don't expect it to print any errors with any OS, but I'd like to confirm it for non-Linux SMP kernels. (Except for OpenBSD, it doesn't work correctly in it anyway because it doesn't support mixing write()s and mmap())

8 8

[Dovecot] Status update
by Timo Sirainen 21 Jun '07

21 Jun '07

I'm leaving soon and I'll be away until sunday. Sorry about not replying to all mails yet, most of them are somewhat tricky and require some time to reply (other than "I don't know"). The new index code for v1.1 seems to be finally working pretty nicely. After 9 hours of running imaptest I haven't gotten a single error yet. I'll leave it running until I'm back. The new code makes the internal index file design a lot easier to understand. For v1.0 I just wanted to get it working and I didn't dare try to clean up the code, so it was kind of magic sometimes why it worked. :) All that magic is finally gone and I understand completely how everything is supposed to work (and hopefully also how it does work). Most important problem with the new code is that \Recent flags are completely broken. I think they're not completely correctly working in v1.0 either, or at least I'm not sure why they're working even as well as they are now.. Maildir syncing in v1.1 is also a bit bad. For example EXPUNGE command could have to be given twice to get it to work. Again it worked badly with v1.0 also but since the index code worked differently it wasn't visible. Cydir is a pretty nice format for stress testing index code. It's really lightweight so it's practically testing only the index code. Because of it I've found a couple of race conditions in the code that existed also in v1.0 tree (v1.0.2 will fix them). My earlier stress testing with maildir never saw those problems, probably because with maildir there was a lot of other code running as well so the race condition was really unlikely to hit.

1 0

[Dovecot] pop3 creates bad index file
by Onno Molenkamp 21 Jun '07

21 Jun '07

Hi, When I use pop3 to log on to a (Maildir) mailbox that doesn't yet exist in the filesystem, the pop3 server autocreates it for me. This works. Jun 21 10:50:45 mail-04 dovecot: pop3-login: Login: user=<hwx7s(a)gqh7x.test>, method=PLAIN, rip=::ffff:192.168.42.105, lip=::ffff:192.168.42.97 Jun 21 10:50:48 mail-04 dovecot: POP3(hwx7s(a)gqh7x.test): Disconnected: Logged out top=0/0, retr=0/0, del=0/0, size=0 When I log on a second time, it will complain about UIDVALIDITY that has changed, and will disconnect me: Jun 21 10:50:52 mail-04 dovecot: pop3-login: Login: user=<hwx7s(a)gqh7x.test>, method=PLAIN, rip=::ffff:192.168.42.105, lip=::ffff:192.168.42.97 Jun 21 10:50:52 mail-04 dovecot: POP3(hwx7s(a)gqh7x.test): Maildir /data/mail/898/gqh7x.test/hwx7s/Maildir sync: UIDVALIDITY changed (1182415845 -> 1182415852) Jun 21 10:50:52 mail-04 dovecot: POP3(hwx7s(a)gqh7x.test): Disconnected: Mailbox is in inconsistent state. top=0/0, retr=0/0, del=0/0, size=0 Jun 21 10:50:52 mail-04 dovecot: POP3(hwx7s(a)gqh7x.test): Couldn't init INBOX: Internal error occurred. Refer to server log for more information. [2007-06-21 10:50:52] When I log on a third time, everything seems to work from the client side, but the server still complains: Jun 21 10:51:01 mail-04 dovecot: pop3-login: Login: user=<hwx7s(a)gqh7x.test>, method=PLAIN, rip=::ffff:192.168.42.105, lip=::ffff:192.168.42.97 Jun 21 10:51:01 mail-04 dovecot: POP3(hwx7s(a)gqh7x.test): Corrupted index cache file /data/mail/898/gqh7x.test/hwx7s/Maildir/dovecot.index.cache: indexid changed Jun 21 10:51:02 mail-04 dovecot: POP3(hwx7s(a)gqh7x.test): Disconnected: Logged out top=0/0, retr=0/0, del=0/0, size=0 Fourth (and further) logons work without errors. When the Maildir is created by imap or deliver, pop3 works fine from the start. The only real difference I see with idxview between the dovecot.index created by pop3 and one created by imap is that with pop3 sync stamp is 0, and with imap it contains a timestamp. Onno

2 1

[Dovecot] mail_log plugin updates
by Timo Sirainen 21 Jun '07

21 Jun '07

It supports configuration now in devel version: # Events to log. Default is all. #mail_log_events = delete undelete expunge copy mailbox_delete # Group events within a transaction to one line. #mail_log_group_events = # Available fields: uid, box, msgid, size, vsize # size and vsize are available only for expunge and copy events. #mail_log_fields = uid box msgid size Without grouping you get pretty similar output than before: Info: copy: uid=13, dest=Trash, msgid=<20040702035043.7296C300DFC1A@asdf>, size=789 Info: delete: uid=13, msgid=<20040702035043.7296C300DFC1A@asdf> Info: expunge: uid=13, msgid=<20040702035043.7296C300DFC1A@asdf>, size=789 With mail_log_group_events=yes you get output like this: Info: copy: uids=15-17,24,26, dest=Trash, size=1534 Info: delete: uids=15-17,24,26 Info: expunge: uids=15-17,24,26, size=1534 The size is the summed size of all the messages. msgids aren't suppported. "size" means physical message size, "vsize" means the virtual size with CR+LF linefeeds. Does someone want something more?

2 2

[Dovecot] Question about pre-indexing maildirs
by David Favor 21 Jun '07

21 Jun '07

I have a situation with many users and an existing mail delivery agent. Seems like I once saw an imaptest program which I imagine might be used to pre-index maildirs. For example... - remember which users and user maildirs have changed since last pre-index - when system quiet pre-index any maildirs which have had mail delivered and no access by a mail client (using some inotify magic) If this sounds do-able, let me know where I can find an imaptest version which works with latest dovecot trunk code and the syntax for using it. Seems like I saw this once on the dovecot site. Thanks. - David -- Like feeling your best ever, all day, every day? Here's how... Your simple secrets are here - http://RadicalHealth.com

2 1

[Dovecot] how do I download concurrency.c
by Stewart Dean 20 Jun '07

20 Jun '07

When I click on the link I get not found on the server. I run on a 4 way and AIX has some pretty fancy concurrency so it would be interesting. But then I'm leaving this afternoon and won't be back until Monday..... -- ==== Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

2 1

[Dovecot] testing needed: log file concurrency
by Timo Sirainen 20 Jun '07

20 Jun '07

http://dovecot.org/tmp/concurrency.c I'd want to know what results this program gives with different systems. Please test and reply (but don't bother if someone already replied with the same OS+result). I expect it to print: - SMP kernels: "page size cut" once in a while - UP (uniprocessor) kernels: Nothing - The most important thing is that it never prints "broken data" It might take a while for it to print anything. With my computer it takes anything from a few seconds to a minute or so. See the file itself for compiling/running instructions. So far I've tested only with Linux 2.6.21 x86-64/SMP and a slow Solaris/Sparc/UP. If you're interested in knowing what this is about: Dovecot writes to dovecot.index.log files by first writing the transaction with its size being 0. After that it writes the 4 size bytes again (using a bit special format with all bytes ORed with 0x80). I expected that when another process is read()ing the file and it notices the size being valid (all bytes having 0x80) that the whole transaction could always be read. But looks like if the size happens to be just before a memory page boundary, it's possible that the updated size is read, but the rest of the transaction isn't.

13 18