- dovecot - dovecot.org

[Dovecot] wrong dovecot GID while upgrading
by Zbigniew Szalbot 18 Feb '07

18 Feb '07

Hello, I tried to upgrade dovecot from 1.0.rc7 to rc22 but I got this error at the end of the upgrade process: Dovecot has reserved the groupname 'dovecot' and gid '143': ERROR: groupname 'dovecot' already in use by gid '1003' Please resolve these issues and try again: Either remove the conflicting group or if you wish to continue using a legacy gr oup override DOVECOT_GID. *** Error code 1 Stop in /usr/ports/mail/dovecot. So I went to /usr/ports/mail/dovecot and edited the Makefile to change the GID into: DOVECOT_UID?= 1003 DOVECOT_GID?= 1003 SCRIPT_ENV+= DOVECOT_UID=${DOVECOT_UID} \ DOVECOT_GID=${DOVECOT_GID} I saved the makefile and ran portupgrade again but I got stopped by exactly the same error. I'd appreciate suggestions how to resolve this. Thank you! -- Zbigniew Szalbot

3 2

[Dovecot] Reproducible duplicate messages bug with Mail.app+Dovecot
by Andrew Moran 18 Feb '07

18 Feb '07

Hey guys, I am not sure if this is a Mail.app bug or a dovecot bug. I can reproduce it 100% of the time using dovecot and Mail.app. I cannot reproduce it with other imap clients, which at first made me think it was Mail.app, but then I tried Mail.app with other imap servers and couldn't reproduce it either, so it's definitely the combination of the two. So I thought I'd try you guys first before submitting a bug to Apple. The problem: If I move multiple messages (set "A") from one imap folder to another, then delete those messages, and then move another set into that same folder (set "B"), then all the messages in set B show up as duplicates until I relaunch Mail.app. My configuration: Server: Dovecot 1.0rc22 using Maildir on FreeBSD 6.1 Client: Mail.app 2.1 on OS X 10.4.8 Steps to reproduce: (these steps involve trashing messages, so it's best to test this on email you are going to toss anyway) 1) Create a new imap folder (let's say "bar") 2) Drag more than one message (let's say 3 or 4) from existing imap folder "foo" to new folder "bar". 3) Click on new folder "bar" and see messages in there. 4) Select messages and delete them (Delete key). Messages are gone as expected. 5) Go back to original folder "foo" and drag a few more messages into new folder "bar" 6) Click on bar. 7) You will notice that all the second set of messages show up twice. Relaunching Mail.app at this point makes the problem disappear. I'm guessing this has something to do with the deleted messages from Set A being purged until the close of imap connection. Any help narrowing this down would be appreciated. Thank you, --Andy

3 4

[Dovecot] Problem moving emails with attachments or HTML links
by J. Wren Hunt 18 Feb '07

18 Feb '07

I recently switched from UW-IMAP to Dovecot (1.0.rc15 on Ubuntu) and am experiencing a weird problem that I haven't been able to figure out yet: If I try to move a message from one IMAP folder to another, all works fine if the message is plain text. However, *sometimes* the message will not be transferred if it contains either an attachment and/or an HTML link (operation times-out). Not all the time, but just enough to be annoying. I've looked through the logs and for settings in the .conf file and can't find anything obvious that I've overlooked. Can anyone help me with any parameters that might be causing this type of problem? Thanks so much! Wren Hunt Cambridge, MA

3 6

[Dovecot] MySQL question
by spammy 18 Feb '07

18 Feb '07

Hi all, Trying to migrate my actual mailserver postfix Cyrus-IMAP with virtual users to dovecot. done some tests and seems to work quite well except for; I would like to integrate my virtual configuration to share SQL information throw various daemons, like postfix, amavis and so on. By default, Dovecot sets the database users table to "users" but I would like to change it to "mailboxes". this is because I don't want to change all my configiuration files already setup, only for dovecot. is this possible? best regards, xtura Fedora Core 6 Dovecot 1.0 rc22

2 1

[Dovecot] LDA plugins mail_plugin_dir
by Dick Middleton 18 Feb '07

18 Feb '07

The LDA option mail_plugin_dir isn't by any chance like PATH i.e. can have more than one directory? I want to pick up some plugins from /usr/lib and some from elsewhere. Thanks Dick

2 3

[Dovecot] master request not found
by Marshal Newrock 18 Feb '07

18 Feb '07

I am setting up dovecot 1.0-rc15 as a proxy. When I try to log in, I get errors such as the following: Dec 4 17:39:23 vega dovecot: Dovecot v1.0.rc15 starting up Dec 4 17:39:24 vega dovecot: auth-worker(default): mysql: Connected to localhost (ad_mail) Dec 4 17:39:31 vega dovecot: auth(default): client in: AUTH 1 PLAINservice=POP3 lip=xx.xx.xx.xx rip=xx.xx.xx.xx resp=<hidden> Dec 4 17:39:31 vega dovecot: auth(default): client out: CONT 1 Dec 4 17:39:31 vega dovecot: auth(default): client in: CONT<hidden> Dec 4 17:39:31 vega dovecot: auth-worker(default): sql(XXXX,xx.xx.xx.xx: query: SELECT NULL AS password, host, destuser, 'Y' AS proxy FROM exchange_proxy WHERE user='XXXX' Dec 4 17:39:31 vega dovecot: auth(default): client out: OK 1 user=XXXX host=XXXX destuser=newrock.marshal(a)acd.net proxy pass=<hidden> Dec 4 17:39:31 vega dovecot: auth(default): master in: REQUEST 1 171931 Dec 4 17:39:31 vega dovecot: auth(default): Master request 17193.1 not found Dec 4 17:39:31 vega dovecot: auth(default): master out: NOTFOUND 1 Dec 4 17:39:31 vega dovecot: pop3-login: Internal login failure: user=<XXXX>, method=PLAIN, rip=xx.xx.xx.xx, lip=xx.xx.xx.xx dovecot.conf contains: auth default { mechanisms = plain login passdb sql { args = /etc/dovecot/dovecot-sql.conf } userdb static { args = uid=0 gid=0 } user = nobody } In dovecot-sql.conf: password_query = SELECT NULL AS password, host, destuser, 'Y' AS proxy FROM exchange_proxy WHERE user='%u' I have verified that I can log into the remote server from the proxy via pop3. Unfortunately, there isn't currently imap access to the remote server. I am connecting to the proxy using pop3 (with "telnet localhost 110"). Any suggestions what the problem could be? -- Marshal Newrock, Ideal Solution LLC http://www.idealso.com

2 4

[Dovecot] master password 'username contains disallowed character: 0x2a'
by Dale Bewley 18 Feb '07

18 Feb '07

v1.0.rc22 FC6 x86_64 So, here is my config: protocol imap { } protocol pop3 { } protocol lda { postmaster_address = postmaster(a)example.com } auth_master_user_separator = * auth_verbose = yes auth_debug = yes auth_debug_passwords = yes auth default { mechanisms = plain passdb passwd-file { args = /etc/dovecot.masterusers master = yes } passdb pam { } userdb passwd { } user = root } dict { } plugin { } But here is what happens when I try to login as dlbewley*zimbra using the password I put in dovecot.masterusers. Feb 16 23:37:30 tofu dovecot: Dovecot v1.0.rc22 starting up Feb 16 23:37:31 tofu dovecot: auth(default): passwd-file /etc/dovecot.masterusers: Read 1 users Feb 16 23:37:49 tofu dovecot: auth(default): client in: AUTH 1 PLAIN service=IMAP secured lip=::ffff:169.237.1.109 rip=::ffff:169.237.2.160 Feb 16 23:37:49 tofu dovecot: auth(default): client out: CONT 1 Feb 16 23:37:49 tofu dovecot: auth(default): client in: CONT 1 ZGxiZXdsZXkqemltYnJhAGRsYmV3bGV5KnppbWJyYQBjb2tlc2hpdDc= Feb 16 23:37:49 tofu dovecot: auth(default): plain(zimbra,::ffff:169.237.2.160): login user: Username contains disallowed character: 0x2a Feb 16 23:37:49 tofu dovecot: auth(default): client out: FAIL 1 user=zimbra Feb 16 23:37:49 tofu dovecot: imap-login: Disconnected: user=<zimbra>, method=PLAIN, rip=::ffff:169.237.2.160, lip=::ffff:169.237.1.109, TLS If I try setting this: auth_username_chars = I get this: Feb 16 23:45:15 tofu dovecot: Dovecot v1.0.rc22 starting up Feb 16 23:45:16 tofu dovecot: auth(default): passwd-file /etc/dovecot.masterusers: Read 1 users Feb 16 23:45:22 tofu dovecot: auth(default): client in: AUTH 1 PLAIN service=IMAP secured lip=::ffff:169.237.1.109 rip=::ffff:169.237.2.160 Feb 16 23:45:22 tofu dovecot: auth(default): client out: CONT 1 Feb 16 23:45:22 tofu dovecot: auth(default): client in: CONT 1 ZGxiZXdsZXkqemltYnJhAGRsYmV3bGV5KnppbWJyYQBjb2tlc2hpdDc= Feb 16 23:45:22 tofu dovecot: auth(default): passdb(zimbra,::ffff:169.237.2.160,master): Master user logging in as dlbewley*zimbra Feb 16 23:45:22 tofu dovecot: auth(default): client out: OK 1 user=dlbewley*zimbra Feb 16 23:45:22 tofu dovecot: auth(default): master in: REQUEST 1 7537 1 Feb 16 23:45:22 tofu dovecot: auth(default): passwd(dlbewley*zimbra,::ffff:169.237.2.160): unknown user Feb 16 23:45:22 tofu dovecot: auth(default): userdb(dlbewley*zimbra,::ffff:169.237.2.160): user not found from userdb Feb 16 23:45:22 tofu dovecot: auth(default): master out: NOTFOUND 1 Feb 16 23:45:22 tofu dovecot: imap-login: Internal login failure: user=<dlbewley*zimbra>, method=PLAIN, rip=::ffff:169.237.2.160, lip=::ffff:169.237.1.109, TLS

2 2

Re: [Dovecot] 1.0.rc23 tomorrow
by Bill Boebel 18 Feb '07

18 Feb '07

On Sat, February 17, 2007 8:09 am, Timo Sirainen <tss(a)iki.fi> said: > http://dovecot.org/nightly/dovecot-latest.tar.gz > > Would be nice to get some testing before the actual release. > Haven't tested this version yet, but we pulled a copy from CVS around mid-day Friday and it has been running fine for the past 30 hours. Bill

1 0

Re: [Dovecot] I keep getting password mismatches
by Mark 18 Feb '07

18 Feb '07

i have that: #%PAM-1.0auth required pam_nologin.soauth include system-authaccount include system-authsession include system-auth[root@School-Mail ~]# and i`m still not able to login with a webmail ldap client ot with thunderbird (also ldap) the error messages are still the same. > Date: Thu, 15 Feb 2007 10:10:13 -0800> From: tengel(a)fluid.com> To: dovecot(a)dovecot.org> Subject: Re: [Dovecot] I keep getting password mismatches> > Mark wrote:> > > > auth(default): passwd(mark,127.0.0.1): password mismatch> > > > The strange thing is that i can login with ssh using my username and > > password but i can`t do anything related to dovecot..> > Do you have a PAM stack installed to allow your dovecot process access > to authentication? (/etc/pam.d/dovecot e.g.)> > http://wiki.dovecot.org/PasswordDatabase/PAM> > -te> > -- > Troy Engel | Systems Engineer> Fluid, Inc | http://www.fluid.com _________________________________________________________________ Probeer Live.com: je eigen persoonlijke opstartpagina met alleen de dingen die jij belangrijk vindt op één plek. http://www.live.com/getstarted

1 0

[Dovecot] [Fwd: wrong dovecot GID while upgrading]
by Zbigniew Szalbot 17 Feb '07

17 Feb '07

Sorry to have bothered - just read the updating file...! I should have let the upgrading process remove the dovecot user... Warm regards, ZS ---------------------------- Original Message ---------------------------- Subject: wrong dovecot GID while upgrading From: "Zbigniew Szalbot" <zbyszek(a)szalbot.homedns.org> Date: Sat, February 17, 2007 21:10 To: dovecot(a)dovecot.org -------------------------------------------------------------------------- Hello, I tried to upgrade dovecot from 1.0.rc7 to rc22 but I got this error at the end of the upgrade process: Dovecot has reserved the groupname 'dovecot' and gid '143': ERROR: groupname 'dovecot' already in use by gid '1003' Please resolve these issues and try again: Either remove the conflicting group or if you wish to continue using a legacy gr oup override DOVECOT_GID. *** Error code 1 Stop in /usr/ports/mail/dovecot. So I went to /usr/ports/mail/dovecot and edited the Makefile to change the GID into: DOVECOT_UID?= 1003 DOVECOT_GID?= 1003 SCRIPT_ENV+= DOVECOT_UID=${DOVECOT_UID} \ DOVECOT_GID=${DOVECOT_GID} I saved the makefile and ran portupgrade again but I got stopped by exactly the same error. I'd appreciate suggestions how to resolve this. Thank you! -- Zbigniew Szalbot -- Zbigniew Szalbot

1 0

[Dovecot] Dovecot "open files" (again?)
by falz 17 Feb '07

17 Feb '07

I'm a new dovecot user, just began using it last week. I switched from courier because my research showed that Dovecot did indexes, and allows me to store them anywhere I chose. I did this, and it fixed some severe disk IO issues that my server had. (25k horde only webmail install using imap proxy). I'm using quotas, and by default had it set to 'dirsize'. my postfix is already creating 'maildirsize' files, so I opted to change dovecot to use this instead. However, when I do, I run into the "too many open files" issue that's been reported many times on the list. I've seen a lot of mention of too many open files, but I haven't seen it related to the quota type used. It's possible that simply my using 'dirsize' as the quota type slows things down enough to not have the issue? I don't really know. Anyhow. I doubled my max open files in FreeBSD's /boot/loader.conf to: kern.maxfiles="24656", but to no avail. When I have it set to maildirsize, the open files on the system grows uncontrollably. Under normal use, it's somewhere below 5k: sysctl -a | grep openfiles kern.openfiles: 4415 I looked into the patch mentioned here: - http://www.dovecot.org/list/dovecot/2006-November/017536.html - http://dovecot.org/list/dovecot-cvs/2006-November/006776.html Those patches already appear to be in rc15, which I'm already running (Via FreeBSD's ports). I also applied the patch mentioned here awhile back: - http://www.dovecot.org/list/dovecot/2005-June/007647.html and rebuilt, but it didn't help out either. There are also freebsd specific notes on forcing a limit on dovecot itsself using login.conf, but that wouldnt really fix anything, it would just cause dovecot to not interfere with other running daemons. - http://www.mail-archive.com/ports@openbsd.org/msg08646.html Any thoughts? TSS, you mention a few times in these notes that you're unable to reproduce this. Perhaps try with the maildir as quota? More details about my setup: - FreeBSD 4.8 (yea, I know) - Imapproxy (http://www.imapproxy.org/) - Postfix to create maildir++ maildirsize folders - MySQL backend The work of this is spread out between several servers, dovecot is running on the server that's the final SMTP delivery location, and has local disks with the maildirs. --falz

2 5

[Dovecot] upgrade from 1.0rc7
by Zbigniew Szalbot 17 Feb '07

17 Feb '07

Hello, Have been to dovecot website but could not find information on what I need to check before I upgrade from the current 1.0rc7 which I am using on a FreeBSD 6.2 system. Will the old conf (virtual users, no ssl) file work with upgraded dovecot? Many thanks! -- Zbigniew Szalbot

2 1

Re: [Dovecot] Reply-To header
by Kenny Dail 17 Feb '07

17 Feb '07

> On Saturday 17 February 2007 00:13, Mark E. Mallett wrote: > > On Sat, Feb 17, 2007 at 12:33:40AM +0200, Timo Sirainen wrote: > > > On Fri, 2007-02-16 at 15:16 -0600, Richard Laager wrote: > > > > I see you've added a Reply-To header later. The canonical response in > > > > this case is for someone to reference: > > > > http://www.unicom.com/pw/reply-to-harmful.html > > > > A canonical response to that is > > > > http://www.metasystema.net/essays/reply-to.mhtml > > My mind was not changed, sorry. First, RFC 822 is obsolete, and RFC 2822 does > not contain the quoted paragraph. Instead it says that '[w]hen > the "Reply-To:" field is present, it indicates the mailbox(es) to which the > author of the message suggests that replies be sent.' - the author, not the > mailing list software. There are other fields for that. Fortunately Dovecot's set-up, does make it the author's choice. -- Kenny Dail <kend(a)amigo.net>

2 1

[Dovecot] Problem/workaround with X-Keywords and Apple's Mail.app
by Joey Coleman 17 Feb '07

17 Feb '07

Hello, I've just switched from UW-IMAP to Dovecot, and for the most part, things are good. However, I encountered the problem with the X-Keywords header not being written back into individual messages in an mbox file (originally described in [1], and Timo gave a clue as to maybe why in [2]). What was happening for me is that Apple's Mail.app would flag a message as spam, which happily sets a couple keywords in the message, but those weren't being written back (at least, I didn't see them in the file on the server). The "DO NOT DELETE..." message had a perfectly fine X-IMAP header, and up until I switched things were working great. The user visible symptom of this happened every time new spam arrived in my Junk folder [3] --- the new spam would arrive, be flagged as spam by Mail.app, and the earlier pieces of mail would promptly be unflagged! Anyway, Timo's clue in [2] prompted me to turn off both mbox_lazy_writes and mbox_dirty_syncs (the latter just on the off- chance... it's a low-volume server, so I can deal with the inefficiency). Lo and behold, Mail.app started acting sane again *and* the X-Keywords header appeared immediately. Oddly, during all of this, the Status and X-UID keywords would appear in the messages just fine; no clue as to why those and not X- Keywords. Version details are: - Dovecot 1.0rc13 [4] - FreeBSD 5.3-RELEASE - Apple Mail.app 2.1 (752/752.2) cheers, --joey [1] http://dovecot.org/list/dovecot/2006-March/011872.html [2] http://dovecot.org/list/dovecot/2006-June/014126.html [3] And it felt really strange while troubleshooting this as I found myself *hoping* for another piece of spam to arrive. Bleh. [4] Yes, two versions behind current, but in my defense, I did check the announcements and they didn't seem to mention the problem.

2 1

[Dovecot] DON'T DELETE THIS MESSAGE -- FOLDER INTERNAL DATA
by Gerhard Wiesinger 17 Feb '07

17 Feb '07

Hello! I see the internal message from pine with the following subject (mbox format, dovecot 1.0rc22): DON'T DELETE THIS MESSAGE -- FOLDER INTERNAL DATA As far as I know this message should be filtered. I never saw this before in previous 1.0 betas and 1.0rc (nearly every version tested). Any ideas Timo? Ciao, Gerhard -- http://www.wiesinger.com/

3 3

[Dovecot] Going nuts
by Mário Gamito 17 Feb '07

17 Feb '07

Hi, The subject says it all. For two days i've been trying to get IMAP and IMAPS working and nothing. I'm running CentOS 4.4 with qmail-ldap I just can't login in dovecot. Following my signature is some info. You can find my dovecot.conf at http://www.gamito.org/dovecot.conf I'm about to give up :( Any help would be appreciated. Warm Regards, Mário Gamito --------------------------------------------------------------------- [root@mail login]# telnet mail.sincity.lan 143 Trying 192.168.5.129... Connected to mail.sincity.lan (192.168.5.129). Escape character is '^]'. * OK Dovecot ready. O LOGIN gamito(a)mail.sincity.lan 143 O NO Temporary authentication failure. O LOGOUT * BYE Logging out O OK Logout completed. Connection closed by foreign host. -------------------------------------------------- [root@mail login]# tail /var/log/dovecot/dovecot.log dovecot: Feb 17 00:01:02 Info: auth(default): client in: AUTH 1 PLAIN service=IMAP secured lip=192.168.5.129 rip=192.168.5.129 resp=<hidden> dovecot: Feb 17 00:01:02 Info: auth(default): checkpassword(gamito(a)mail.sincity.lan,192.168.5.129): Executed: /usr/local/bin/auth_imap /usr/local/libexec/dovecot/checkpassword-reply dovecot: Feb 17 00:01:02 Info: auth(default): checkpassword(gamito(a)mail.sincity.lan,192.168.5.129): Received no input dovecot: Feb 17 00:01:02 Error: auth(default): checkpassword: Child 31122 died with signal 11 dovecot: Feb 17 00:01:04 Info: auth(default): client out: FAIL 1 user=gamito(a)mail.sincity.lan temp dovecot: Feb 17 00:01:10 Info: imap-login: Aborted login: user=<gamito(a)mail.sincity.lan>, method=PLAIN, rip=192.168.5.129, lip=192.168.5.129, secured -------------------------------------------------------------------------

3 10

[Dovecot] again... cross compiling
by Martin Höfling 17 Feb '07

17 Feb '07

> Create a cache file with the right values, or call configure with those > values set in the environment. OK, i ran configure with -C one time without cross compiler env set, to obtain the variables another time with -C to use the config.cache . I could not find anything related to the check whether size_t is signed. I found a variable which i set that way: ignored_signed_size=${ignore_signed_size=1} What's wrong with that? Cheers Martin P.S.: Is there a way to obtain all variables in an easy way, or to obtain the variable that has to be set by hand? -- Frag' nicht - Du könntest eine Antwort erhalten. (Markus Mehring in d.a.arnooo)

3 2

Re: [Dovecot] Reply-To header
by Kenny Dail 17 Feb '07

17 Feb '07

> On Fri, 2007-02-16 at 15:16 -0600, Richard Laager wrote: > > I see you've added a Reply-To header later. The canonical response in > > this case is for someone to reference: > > http://www.unicom.com/pw/reply-to-harmful.html > > Yes, I've read that page. It says basically that it makes replying > privately to the sender difficult. I'm sure it does, but in this list I > don't think pretty much anyone ever wants to reply to someone only > privately. Since deliberate choice is required to go in and set the maillist option, this is no different than if I configure my MUA to set the reply-to header on messages I send to the list. So the way it has been implemented for this list is not a problem at all. If people feel the need to reply to me off list, I feel that should be a deliberate choice on their part. -- Kenny Dail <kend(a)amigo.net>

1 0

Re: [Dovecot] Bug tracking system
by Kenny Dail 17 Feb '07

17 Feb '07

> > > I don't think I want an anonymous user to be able to create bugs. Maybe > > > what I'm after is an automatic user creation based on the given email > > > address, but the user won't be able to log in before verifying the > > > email. If a user already exists for the given email address, that bug > > > also belongs to that existing user even though no password was asked > > > (but it could mention that it was created anonymously and log the IP). > > > > But that's how most othe rregstration systems work too. All > > bugzilla/mailman etc. typically want is to verify the autheticity of > > the given email address. > > But why? If all you're doing is just adding a new bug, what's the point > of verifying the email address? It's just annoying to the user. Especially if someone like myself is already registered to the mailing list, I don't feel the need to go and register into a bugtracking system and have my email verified yet again. > I just made a simple mockup of what I'd like the "Enter new bug" page to > be like: http://dovecot.org/tmp/bug.html Nice and simple is good. I'd include a couple of other fields to make it easy to get useful info, like dovecot version and OS. But I'd really prefer to just email reports in to the list. > The log in page would then allow logging in with email/password, or > allow "registering" the user by sending a new password to the email. Perhaps it can just be integrated with the maillist login page? -- Kenny Dail <kend(a)amigo.net>

1 0

[Dovecot] filtering out LIST cruft?
by Dan Price 17 Feb '07

17 Feb '07

In planning our migration, I've noticed that lots of users have bits of lint in their ~/mail and/or ~/Mail. For example-- for an mbox called "blah" we may see: blah blah.msf (from Thunderbird) .blah.summary (from... I'm not sure, dtmail maybe) .blah_SIMS_index0003 (from our old IMAP server). When the user goes to "subscribe" they are often overloaded with too many items to choose from-- because all of these files are selectable in the UI-- LIST happily returns them. Is there a way to get dovecot to skip over these, by regex? Could it optionally "taste" files to see if they look like mboxes? I looked at the wiki and the source but didn't find anything. In the absence of this feature, I wonder how other sites have handled this? Obviously I can do some cleanup during migration, but I find that those pesky msf files like to come back. -dp -- Daniel Price - Solaris Kernel Engineering - dp(a)eng.sun.com - blogs.sun.com/dp

2 1

[Dovecot] imap core dump with rc18
by Nicolas STRANSKY 17 Feb '07

17 Feb '07

Hi, I had a core dump while using rc18. Here are the backtraces: Jan 23 01:01:44 rouge dovecot: IMAP(user): file mail-index-view.c: line 386 (_view_lookup_uid_range): assertion failed: (*last_seq_r >= *first_seq_r) Jan 23 01:01:44 rouge dovecot: IMAP(user): Raw backtrace: [0x47f25b00000000] Jan 23 01:01:44 rouge dovecot: child 24319 (imap) killed with signal 6 Core was generated by `imap'. Program terminated with signal 6, Aborted. Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done. Loaded symbols for /lib/libdl.so.2 Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /lib/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 #0 0x00002b3448083545 in raise () from /lib/libc.so.6 (gdb) bt full #0 0x00002b3448083545 in raise () from /lib/libc.so.6 No symbol table info available. #1 0x00002b3448084cce in abort () from /lib/libc.so.6 No symbol table info available. #2 0x0000000000465fd5 in i_set_failure_file () No symbol table info available. #3 0x000000000046585c in i_panic () No symbol table info available. #4 0x000000000044fff3 in mail_index_view_unref_maps () No symbol table info available. #5 0x00000000004505c7 in mail_index_lookup_uid_range () No symbol table info available. #6 0x000000000043be90 in index_storage_get_uids () No symbol table info available. #7 0x0000000000458d37 in mailbox_get_uids () No symbol table info available. #8 0x0000000000419eef in imap_messageset_parse () No symbol table info available. #9 0x000000000041aaae in imap_search_get_arg () No symbol table info available. #10 0x0000000000412e45 in cmd_fetch () No symbol table info available. #11 0x0000000000415910 in cmd_uid () No symbol table info available. #12 0x00000000004164a1 in _client_reset_command () No symbol table info available. #13 0x0000000000416430 in _client_reset_command () No symbol table info available. #14 0x0000000000416591 in _client_input () No symbol table info available. #15 0x000000000046b5bb in io_loop_handler_run () No symbol table info available. #16 0x000000000046ab4c in io_loop_run () No symbol table info available. ---Type <return> to continue, or q <return> to quit--- #17 0x000000000041dd1b in main () No symbol table info available. Regards, -- Nico Ce n'est pas en continuant de faire ce que l'on connaît que l'on pourra faire ce que l'on ne connaît pas

2 3

[Dovecot] severe performance problem (mail cache related?)
by Dan Price 17 Feb '07

17 Feb '07

Hi all, we're having a bad day with email :) I have a user who was complaining of poor performance today when opening mailboxes. Total time to open the box was about 1 minute. Upon truss'ing the imap process during an open, I saw the trace quoted below at the end of the email. As you can see, for each "FETCH" line of response, we were seeing dovecot do a ton of work-- mmaping anon, lots of munmaps(), etc. -- mmap() and munmap() are not free. The stack trace of at least one of the munmaps is captured below, as well-- deep inside of the mail caching code. Then, I moved aside the user's .imap directory, assuming that forcing dovecot to rebuild its indices and caches could help-- and sure enough the user reported that mailbox open times had dropped to 18 seconds. I truss'd that open, briefly, and it was just a ton of preads at high speed. So I don't know why this user was fine for a week, then suddenly hit this. This is a grave concern if I'm going to roll this out from 15 test users to 250 production users. Thanks for your help. PS: Raw logs are also attached below. -dp write(1, " * 1 0 7 9 5 F E T C".., 2050) = 2050 mmap64(0x00000000, 7356416, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANON, -1, 0) = 0xFD800000 munmap(0xFE602000, 1048576) = 0 munmap(0xFE502000, 1048576) = 0 munmap(0xFE402000, 1048576) = 0 munmap(0xFE302000, 1048576) = 0 munmap(0xFE202000, 1048576) = 0 munmap(0xFE102000, 1048576) = 0 munmap(0xFE002000, 1048576) = 0 munmap(0xFE000000, 8192) = 0 pread64(9, " n c o m @ o s s 1 >\n\0".., 8192, 7340032) = 8192 mmap64(0x00000000, 7364608, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANON, -1, 0) = 0xFE800000 munmap(0xFDE04000, 1048576) = 0 munmap(0xFDD04000, 1048576) = 0 munmap(0xFDC04000, 1048576) = 0 munmap(0xFDB04000, 1048576) = 0 munmap(0xFDA04000, 1048576) = 0 munmap(0xFD904000, 1048576) = 0 munmap(0xFD804000, 1048576) = 0 munmap(0xFD802000, 8192) = 0 munmap(0xFD800000, 8192) = 0 pread64(9, " l @ p l a t i n u m >\n".., 8192, 7348224) = 8192 mmap64(0x00000000, 7372800, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANON, -1, 0) = 0xFE000000 munmap(0xFEE06000, 1048576) = 0 munmap(0xFED06000, 1048576) = 0 munmap(0xFEC06000, 1048576) = 0 munmap(0xFEB06000, 1048576) = 0 munmap(0xFEA06000, 1048576) = 0 munmap(0xFE906000, 1048576) = 0 munmap(0xFE806000, 1048576) = 0 munmap(0xFE802000, 16384) = 0 munmap(0xFE800000, 8192) = 0 pread64(9, "\0\0\0 0\0\0\0\0 C c : ".., 8192, 7356416) = 8192 ---------- ---------- ---------- ---------- ---------- ---------- ---------- ff1c3e14 munmap (100000, bdc000, fe6de000, 2dc000, 0, 1ef0) + 8 00080bb4 file_cache_set_size (c03a0, 0, bdc110, 408, 0, 110) + e0 00080cec file_cache_read (0, bdbd08, bdbd08, 408, 0, 684a8) + a4 000594a0 mail_cache_map (191268, bdbd08, 408, ffbff274, 3, fffffffc) + ec 0005ae20 mail_cache_get_record (0, bdbd08, ffbff274, ffbff274, 0, 0) + 20 0005b00c mail_cache_foreach_rec (1959c8, ffbff2ec, 5b3d8, 0, b5760, 7ed8) + 10 0005b2bc mail_cache_foreach (1, 47ae, 5b3d8, 0, 0, 0) + b4 0005b47c mail_cache_field_exists (0, 47ae, 0, c0000000, b4f10, 88184) + 84 0005b64c mail_cache_lookup_field (1959c8, b5898, 47ae, 0, 191d48, 195560) + c 000531ac index_mail_get_fixed_field (195dd8, 0, 195ea0, 4, ffffffff, ffffffff) + 4c 000545e8 index_mail_set_seq (195dd8, 47ae, 19a1c8, b4b4f, 0, 47ae) + bc 00070dac mail_set_seq (195dd8, 47ae, 1, c2ce8, 0, 39c) + c 0005770c index_storage_search_next (1, 195dd8, 1, bd778, 5769c, c8ae0) + 70 00072024 mailbox_search_next (19a1c8, 195dd8, 3, 2, 0, c2b50) + 14 0002b3bc imap_fetch (c4e20, c4de8, ffbff748, 5, c2eb0, 80000000) + 6c 00026210 cmd_fetch (1, c2e88, 0, 75696400, 26054, 80000000) + 1bc 00029000 cmd_uid (0, c22f8, 0, 8, 2a134, c22f8) + 8c 00029b58 client_handle_input (c2b94, c2e80, b5760, bd778, 7ef8, 2000000) + 138 00029ad0 client_handle_input (0, 2f05e860, b5760, bd778, 45d3834d, b5000) + b0 00029cb0 _client_input (c2b50, c2b50, 26ee, 0, 1, 0) + 68 00086338 io_loop_handler_run (c0348, 0, 0, ffbffa14, 4c, 80000000) + 140 00085c14 io_loop_run (c0348, ff212cb0, 1, b573c, bae80, ff215dbc) + 34 00032064 main (ffbffc18, b4400, b5000, b573c, c1314, ff3a0180) + 3f8 00024b18 _start (0, 0, 0, 0, 0, 0) + 5c ------ ------ ------ ------ ------ ------ ------ ------ ------ ------ [in] 3 select "Mail/OpenSolaris/discuss" 4 UID fetch 1:* (FLAGS) 5 IDLE DONE 6 close 7 logout ------ ------ ------ ------ ------ ------ ------ ------ ------ ------ [out, taking 1+ minutes] * OK [RAWLOG TIMESTAMP] 2007-02-14 14:05:35 * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk $Forwarded Junk) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk $Forwarded Junk \*)] Flags permitted. * 20462 EXISTS * 0 RECENT * OK [UIDVALIDITY 1159980013] UIDs valid * OK [UIDNEXT 20487] Predicted next UID 3 OK [READ-WRITE] Select completed. * 1 FETCH (FLAGS (\Seen) UID 1) * 2 FETCH (FLAGS (\Seen) UID 2) * 3 FETCH (FLAGS (\Seen) UID 3) * 4 FETCH (FLAGS (\Seen) UID 4) * 5 FETCH (FLAGS (\Seen) UID 5) * 6 FETCH (FLAGS (\Seen) UID 6) * 7 FETCH (FLAGS (\Seen) UID 7) * 8 FETCH (FLAGS (\Seen) UID 8) * 9 FETCH (FLAGS (\Seen) UID 9) * 10 FETCH (FLAGS (\Seen) UID 10) * 11 FETCH (FLAGS (\Seen) UID 11) * 12 FETCH (FLAGS (\Seen) UID 12) * 13 FETCH (FLAGS (\Seen) UID 13) * 14 FETCH (FLAGS (\Seen) UID 14) * 15 FETCH (FLAGS (\Seen) UID 15) * 16 FETCH (FLAGS (\Seen) UID 16) * 17 FETCH (FLAGS (\Seen) UID 17) * 18 FETCH (FLAGS (\Seen) UID 18) * 19 FETCH (FLAGS (\Seen) UID 19) * 20 FETCH (FLAGS (\Seen) UID 20) * 21 FETCH (FLAGS (\Seen) UID 21) * 22 FETCH (FLAGS (\Seen) UID 22) * 23 FETCH (FLAGS (\Seen) UID 23) [-----elided-----] * 20459 FETCH (FLAGS (\Seen) UID 20483) * 20460 FETCH (FLAGS (\Seen) UID 20484) * 20461 FETCH (FLAGS (\Seen) UID 20485) * 20462 FETCH (FLAGS (\Seen) UID 20486) 4 OK Fetch completed. + idling 5 OK Idle completed. 6 OK Close completed. * BYE Logging out 7 OK Logout completed. -- Daniel Price - Solaris Kernel Engineering - dp(a)eng.sun.com - blogs.sun.com/dp

3 12

[Dovecot] trash plugin sql
by Robert Schetterer 16 Feb '07

16 Feb '07

Hi @ll, with dovecot latest following http://wiki.dovecot.org/DovecotLDAPostfixAdminMySQL i have defined plugin { quota = maildir acl = vfile:/etc/dovecot/acls trash = /etc/dovecot/dovecot-trash.conf } Example dovecot-trash.conf file 1 Spam 2 Trash 3 Sent from wiki The Trash plugin. When saving a message would make user go over quota, this plugin automatically deletes the oldest mails from configured mailboxes until the message can be saved within quota limits. this dont work at my setup where quota is coming out of sql is there any trick to solve this? or did i missunderstand something -- Mit freundlichen Gruessen Best Regards Robert Schetterer https://www.schetterer.org Munich/Bavaria/Germany

3 6

Re: [Dovecot] repeat downloads of message headers in 1.0rc19
by Jim Garrison 16 Feb '07

16 Feb '07

I reported this against rc7 and rc8, and still see it occasionally. (I'm running the rc8 that comes with Fedora 5). It is always associated with this message in dovecot.log: dovecot: Oct 23 19:26:17 Error: POP3(user(a)domain.tld): mbox sync: UID inserted in the middle of mailbox /var/mail/vhosts/domain.tld/user (12 > 4, seq=2, idx_msgs=5) Once this happens, dovecot will refuse to clear out the mbox file when the user retrieves email via POP. Each time the user logs in to retrieve mail s/he gets everything in the mbox, which continues to grow. The only fix I've been able to find is to manually delete the mbox file. I'm using postfix as the MTA.

5 6

[Dovecot] Error message in logs
by Jay Chandler 16 Feb '07

16 Feb '07

Mbox format, running r22. Only happening to two users so far, happened on r19 as well. Feb 12 13:52:29 wurfel dovecot: imap-login: Login: user=<username>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Feb 12 13:52:30 wurfel dovecot: IMAP(username): file mbox-sync-rewrite.c: line 404 (mbox_sync_read_and_move): assertion failed: (need_space == (uoff_t)-mails[idx].space) -- Jay Chandler Network Administrator, Chapman University 714.628.7249 / chandler(a)chapman.edu Today's Excuse: Dyslexics retyping hosts file on servers

2 1