August 2007 - dovecot

[Dovecot] BUG REPORT - Stops logging after sleep
by Bruce Bodger 09 Sep '07

09 Sep '07

Version: dovecot --version: 1.0.0 OS: OS X - 10.4.9 Architecture: G5 Dual/1.8Ghz Had a fairly normal time correction last night: May 9 20:56:56 G518X2 ntpd[219]: time set -1.212733 s Which dovecot duly noted: May 9 20:56:56 G518X2 dovecot: auth(default): Time just moved backwards by 1 seconds. I'll sleep now until we're back in present. This morning all of the dovecot processes are running fine but dovecot has stopped logging. (I have modified nothing in dovecot.conf relative to logging: dovecot logs to syslog using the "mail" syslog_facility.) ps -aux | grep dovecot root 53 0.0 -0.0 27772 544 ?? Ss 4:23PM 0:04.69 /usr/local/sbin/dovecot -F root 79 0.0 -0.0 28176 556 ?? S 4:23PM 0:03.21 dovecot-auth dovecot 9548 0.0 -0.0 27780 496 ?? S 7:12AM 0:00.05 imap-login dovecot 9631 0.0 -0.0 27780 500 ?? S 7:17AM 0:00.03 imap-login dovecot 9632 0.0 -0.0 27780 500 ?? S 7:17AM 0:00.03 imap-login I am starting dovecot via OS X's launchdaemon facility thus the "-F" command line switch requirement. Sending a "kill -HUP" to the process did not get it to start logging. Sending a "Kill -9" to the process forced a restart and logging began again. ps -aux | grep dovecot root 9738 0.0 -0.0 27772 540 ?? Ss 7:26AM 0:00.03 /usr/local/sbin/dovecot -F root 9739 0.0 -0.0 28176 544 ?? S 7:26AM 0:00.02 dovecot-auth dovecot 9740 0.0 -0.0 27780 500 ?? S 7:26AM 0:00.02 imap-login dovecot 9751 0.0 -0.0 27780 500 ?? S 7:27AM 0:00.01 imap-login dovecot 9762 0.0 -0.0 27780 500 ?? S 7:27AM 0:00.01 imap-login Before posting this bug I compared v1.0.0's /src/lib/ioloop.c to that in the nightly snapshot and saw no adjustments in, what I presumed to be, the relevant portion of the code. Output of "dovecot -n" protocols: imap ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login first_valid_uid: 490 mail_extra_groups: mail mail_location: mbox:~/Library/Mail/IMAP:INBOX=/var/mail/%u:INDEX=%h/ Library/Mail/DOVECOT.indexes dotlock_use_excl: yes auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd Thank you.

4 14

[Dovecot] How do I use sieve to move bounces?
by Jef Driesen 06 Sep '07

06 Sep '07

How can I use sieve to move bounces and non delivery reports (i.e. anything with an empty envelope from) to a special mailbox? I placed this snippet at the start of my sieve script require ["envelope", "fileinto"]; if envelope :is "from" "" { fileinto "INBOX.Reports"; stop; } But mails are not moved to the reports mailbox, and they are still processed by the rest of the script.

1 1

[Dovecot] Plugin development question
by Gary Smith 04 Sep '07

04 Sep '07

Hello, >From what I have read on the dovecot site, it's possible to create a plugin for a custom data store format. We have emails in a custom format in a database and would like to create a plugin for accessing these emails through dovecot. Is there any supporting documentation from creating a plugin like this? Are there any samples? TIA, Gary

2 4

[Dovecot] comparing pointer to integer?
by "Bérczi Gábor (Gabucino)" 01 Sep '07

01 Sep '07

For example in src/lib/file-cache.c: if (cache->mmap_base == MAP_FAILED) { Should be fixed, probably like this: if ((int)cache->mmap_base == MAP_FAILED) { There are a lot of occurences for these in the source. GCC only warns because of this, but DEC C is known to consider this an error: Error: file-cache.c, line 79: In this statement, "new_base" and "(-1)" may not be compared for equality or inequality. if (new_base == MAP_FAILED) { And indeed, unsigned integers and -1 are rarely equal. -- Gabucino

3 4

[Dovecot] Calculate Index size for harddisk sizing
by Patrick Ben Koetter 31 Aug '07

31 Aug '07

I need to get a hand on the 'usual size of an index' to do some hard disk sizing. Is that possible at all? I know their size depends a lot on what the clients index. Those clients will mostly be Outlook and Thunderbird and they will be doing more POP than IMAP if that helps to bring it down to some estimation. TIA, p@rick -- state of mind Agentur für Kommunikation, Design und Softwareentwicklung Patrick Koetter Tel: 089 45227227 Echinger Strasse 3 Fax: 089 45227226 85386 Eching Web: http://www.state-of-mind.de Amtsgericht München Partnerschaftsregister PR 563

1 0

[Dovecot] Migrate 0.99 MBox into 1.0rc15-2
by Stephan Holl 30 Aug '07

30 Aug '07

Hello, I have old MBOX-trees from a dovecot-0.99-installation. I would like to integrate them into dovecot 1.0.0rc15 with Maildir. Sadly the old dovecot is no lonfger running, otherwise imapsync could be used. Does anybody can give some hints how to start? TIA Stephan

7 9

[Dovecot] rule of thumb for indexing overhead
by bill-dovecot＠carpenter.ORG 30 Aug '07

30 Aug '07

I realize it's hard to be precise about this, but does anyone have a feel or rule of thumb for a couple of aspects of indexing overhead? 1. Proportionally, how much space does it take for all 4 files? If I want to give my users a quota of 100 MB for messages, how much real space should I plan for so that I won't run out of space for indexing? 2. What's the overhead in rebuilding index files? Suppose I use an LDA other than dovecot, so at least the INBOX index is frequently getting out of date. Does it cost much (in CPU, memory, and disk IO) to rebuild the index files? (I'm using maildir.)

8 11

[Dovecot] Err. msg. while copy.: "Invalid internal data."
by Dominik Springer 30 Aug '07

30 Aug '07

Hi All, While copying 9360 messages from a local folder to a folder on the imap server at message 5792 the client shows the following message from server: "Invalid internal data." The error is reproducible. Any suggestions? Configuration: Versio: 1.0.rc15 (Debian Package) OS: Debian etch (in XEN VM) Kernel: 2.6.18-4-xen-686 (Debian Package) FS: ext3 Mail-Client: Thunderbird 2.0.0.6 on Mac OS X 10.4.10 Br, thx Dominik Springer

4 5

[Dovecot] quota imap_quota
by Bazy 29 Aug '07

29 Aug '07

Hello, I've been frying my brain with quota and mysql... Here is what I do: protocol imap { mail_plugins = quota imap_quota imap_client_workarounds = outlook-idle delay-newmail } plugin { # 10 MB + 1000 messages quota limit # quota = maildir:storage=10240:messages=1000 driver = mysql connect = host=/var/lib/mysql/mysql.sock user=mail_admin password=XXXXXXXX dbname=mail user_query = SELECT CONCAT(('/home/vmail/'), SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1),'/'), CONCAT('5000'), CONCAT('5000'), CONCAT('maildir:storage=', quota) FROM users AS quota WHERE email = '%u'; } The querry output looks like this: +----------------------------------------------------------------------------------------------+----------------+----------------+-----------------------------------+ | CONCAT(('/home/vmail/'), SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1),'/') | CONCAT('5000') | CONCAT('5000') | CONCAT('maildir:storage=', quota) | +----------------------------------------------------------------------------------------------+----------------+----------------+-----------------------------------+ | /home/vmail/goofy.celuloza.ro/bazy/ | 5000 | 5000 | maildir:storage=102400000 | +----------------------------------------------------------------------------------------------+----------------+----------------+-----------------------------------+ I made the query with http://wiki.dovecot.org/Quota?highlight=%28imap_quota%29 as an example. The result is: . OK Logged in. . capability * CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS QUOTA . OK Capability completed. . getquotaroot Inbox . OK No quota. . getquotaroot inbox . OK No quota. . getquotaroot Trash . OK No quota. How can I get quota to work?... I'm out of ideas... and I'm an dovecot NUB... postfix sasl with dovecot with mysql with ENCRYPTED password works great, pop3 imap and imaps work great also. I just can't get quota to work... :( Any advice is welcome. Thank you!

2 2

[Dovecot] (slightly OT) syncing / migrating IMAP mailboxes
by Gunter Ohrner 28 Aug '07

28 Aug '07

Hi! I fear this may be slightly off-topic but it's both related to IMAP and to dovecot: Is there any good and in paticular realiable program for synching / migrating one IMAP mailbox to another? The most important features for me is that a) no mails are lost / left out silently and b) the porgram is able to sync the complete mailbox including all folders without just giving up in the middle of the transfer. If it's somehow possible, I'd like to migrate directly from one IMAP account to the other, without running the synchronizer on one of the servers and without accessing one of the Maildirs directly. I simply want to migrate my existing IMAP account from one Dovecot server (running 1.0beta5) to a new one (running 1.0rc15, as that's the version in Debian stable). Actually, a large part of the mailbox including most / all folders is already present on both servers, but I recently noticed that a few thousand mails are still missing. The current mailbox state is the result of two earlier (obviously incomplete :-( ) migrations a few months ago, from the original Dovecot 1.0beta5 server to a Cyrus server, and - shortly thereafter - from there on to the currently used Dovecot 1.0rc15. So far I've tried offlineimap, imapsync and mailsync, none of which seems to be really usuable. :-( The current state with the incomplete mailbox was caused by mailsync. When I did the first two migrations, mailsync looked like the only program which worked, but seems to have "forgotten" the missing messages. Another extremely suspicious thing is that mailsync reports "phantom changes" if run again immediately after synching a folder and will start to delete and copy / "sync" dozends of messages even if none of the folders actually changed after synching. I've read the name "imapsync" on this list several times, but I just tried it and just tried version 1.219. It happily starts synching the mailboxes and copying messages, but stops after partially synching the first folder - it simply exists, leaving no informational or error message whatsoever... Restarting imapsync will not help, it will appear to start synching the first folder again, but silently exit without doing anything. Some of you seem to use imapsync as a migration tool for production systems, how do you cope with these situations and how do you ensure a mailboxs' migration actually completed successfully? As you're probably not playing Roulette with your customers' or companie's eMails, I'm interested in your receipts to successfully use imapsync myself. As the third application I tried offlineimap (4.0.x-branch). During the migration a few months ago offlineimap (4.0.16 IIRC, synching from a Maildir to a remote IMAP account) was unusuable as it continuously and reproducibly threw exceptions at me during syncing obviously caused by specific messages in the accounts. Unfortunately, I wasn't able ti get any successful help on the offlineimap mailing list this time. :-( Now, synching from one IMAP account to another, specifiying the new server as the "local" account, offlineimap did not throw exceptions caused by mail messages so far, but it's performance is unusuable. It seems to use the "local" IMAP account on my target sevrer in a way which causes Dovecot to utilize all CPU power, copying one message every 10 to 20 seconds - this way, a sync would take ages and frequently aborts because of connection problems. The target server is an Athlon64 3700+ machine... So, does anyone have any pratical solution on how to migrate one IMAP mailbox to another? For various reasons I'd really prefer to go with a tested and working, reliable solution instead of starting to debug complex non-working programs I do not halfway understand and for which I cannot seem to get reliably support from its authors and/or its user community... :-/ Thanks a lot in advance for any pointers to a solution, Gunter -- +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ "The obvious mathematical breakthrough would be development of an easy way to factor large prime numbers." -- Bill Gates from The Road Ahead, p265 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ + PGP-verschlüsselte Mails bevorzugt! + +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+

2 1