- dovecot - dovecot.org

[Dovecot] IMP reading entire mailbox
by Chris O'Regan 16 Jun '09

16 Jun '09

We have been noticing a constant hum of traffic between our IMAP server (Dovecot v1.1.14) and our filers over the past several days. I have narrowed it down to one particular user who has been logged in to IMP/Horde since the problem began (he hadn't logged since we upgraded to Dovecot a week before). IMP is periodically checking this user's mail every five minutes. Each time it does, the his entire mailbox is being read. I initially thought it might be an indexing problem since I am also seeing messages such as this in the logs: Corrupted index cache file /local/data/dovecot/indexes/mail/X/XXXXXXXX/.imap/delivery.log/dovecot.index.cache: Broken MIME parts for mail UID 30880 But the in/out bytes being logged by Dovecot indicate that the entire contents of his mailbox are being sent to the client. That is, this user has a particularly large mailbox (~500M) and about 500M are being sent to IMP every five minutes. (Actually, what is the meaning of the above message? He's the only user logging it.) The user does have some filters defined in IMP, but I can't imagine that it would try to apply them to the entire mailbox each time it is accessed. Surely it would only apply the filters to new messages, right? But I can't think of any other reason why we would be seeing this behaviour, and only for this user. I have not yet contacted the user as I need something to tell him other than "you're a bandwidth hog". I think the next step is to ask him to disable his filters, but I would prefer not shooting in the dark. This user alone is adding about 50Mbps of bandwidth; between the time we upgraded to Dovecot (from uw-imap) and he logged in, we were witnessing a huge drop in traffic. He's ruining our graphs! ;-) Seriously, if anyone has some ideas, please let me know. Thanks! -- Chris O'Regan <chris(a)encs.concordia.ca> Senior Unix Systems Administrator, Academic IT Services Faculty of Engineering and Computer Science Concordia University, Montreal, Canada

5 17

[Dovecot] Dovecot v1.2.rc5 dbox file permissions
by Pascal Volk 16 Jun '09

16 Jun '09

Hi Timo, I've just setup Dovecot v1.2.rc5 and switched the mailbox format of one account to dbox. Therefor I've created an empty directory, called dbox, with access mode 0700, like the user's home directory. After the IMAP login with Thunderbird some dboxes was created. All permissions were set fine (0700 / 0600), except the permissions for the files: * ~/dbox/mailboxes/$FOLDERNAME/dbox-Mails/dbox.index * ~/dbox/mailboxes/$FOLDERNAME/dbox-Mails/dovecot.index.log Those files have the access mode 0666. Regards, Pascal -- The trapper recommends today: cafebabe.0916419(a)localdomain.org

2 1

[Dovecot] mixing dovecot and non-dovecot access to mail
by Michal Szymanski 16 Jun '09

16 Jun '09

Hello, I have recently installed Mailscanner/postfix for the mail server and dovecot for (mainly remote) access to email (via T'bird etc. and/or Webmail). Most users still use text mail clients (mutt, pine, some still old elm) while in the office. These clients access mail (both incoming at /var/mail/ and users' private folders in ~/Mail) directly. I wonder whether this mixing of dovecot and non-dovecot access can make any problems, provide, of course, that the users are not using both ways at the same time. AFAIK dovecot makes some indexing. Will it not be confused if the folder is changed and de-sync-ed with the index? regards, Michal. -- Michal Szymanski (msz at astrouw dot edu dot pl) Warsaw University Observatory, Warszawa, POLAND -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean.

2 1

[Dovecot] dovecot-antispam plugin and "Failed to call dspam" message
by Jeremy Doran 15 Jun '09

15 Jun '09

Hi, I had this working until I recently upgraded Dovecot, and now I'm getting a message back from Thunderbird of "Failed to call dspam." when I attempt to move a message into one of the designated spam folders. However, I know from looking at the dspam system.log file, the retraining actually happens - so it -does- appear to be calling dspam. It appears that the 'move' operation fails. Here's my configuration: dovecot 1.1.16 (built from ports) dovecot-antispam 1.1 (tried from ports as well as unmodified source) dspam 3.6.8 (built from ports) FreeBSD 7.1 Relevant sections from dovecot.conf: protocol imap { mail_plugins = antispam mail_plugin_dir = /usr/local/lib/dovecot/imap ... } plugin { antispam_signature = X-DSPAM-Signature antispam_spam = SPAM;spam;Junk antispam_trash = Deleted Messages;Trash;INBOX.Trash antispam_dspam_binary = /usr/local/bin/dspam antispam_dspam_args = --deliver=;--user;%u ... } .config used by dovecot-antispam: DOVECOT=/usr/ports/mail/dovecot/work/dovecot-1.1.16 BACKEND=dspam-exec PLUGINNAME=antispam DEBUG=syslog DEBUG_VERBOSE=1 (I've tried it both with and without the DEBUG lines present in .config) Plugin debug log when I attempt to move a message: Jun 13 09:29:07 stelleri imap: antispam: mailbox_is_unsure(SPAM): 0 Jun 13 09:29:07 stelleri imap: antispam: mailbox_is_trash(INBOX): 0 Jun 13 09:29:07 stelleri imap: antispam: mailbox_is_trash(SPAM): 0 Jun 13 09:29:07 stelleri imap: antispam: mail copy: from trash: 0, to trash: 0 Jun 13 09:29:07 stelleri imap: antispam: mailbox_is_spam(INBOX): 0 Jun 13 09:29:07 stelleri imap: antispam: mailbox_is_spam(SPAM): 1 Jun 13 09:29:07 stelleri imap: antispam: mailbox_is_unsure(INBOX): 0 Jun 13 09:29:07 stelleri imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 Jun 13 09:29:07 stelleri imap: antispam: /usr/local/bin/dspam --source=error --class=spam --signature=4a339984859385209328925 --deliver= --user frysco Associated log from dspam system.log: 1244903347 M <None Specified> 4a339984859385209328925 <None Specified> 0.066815 frysco Retrained Any help appreciated, Thanks, -jcd

4 8

Re: [Dovecot] Dovecot Antispam plugin
by Johannes Berg 15 Jun '09

15 Jun '09

Timo, Christian has reported an error to me on dovecot 1.0.7, where the following code: 199 if (i_stream_read_data(mailstream, &beginning, &size, 5) < 0 || 200 size < 5) { 201 ret = -1; 202 mail_storage_set_error(t->box->storage, 203 ME(NOTPOSSIBLE) 204 "Failed to read mail beginning"); 205 goto failed_to_copy; 206 } 207 208 /* "From "? skip line */ 209 if (memcmp("From ", beginning, 5) == 0) { 210 i_stream_read_next_line(mailstream); 211 } else { 212 if (o_stream_send(outstream, beginning, 5) != 5) { 213 ret = -1; 214 mail_storage_set_error(t->box->storage, 215 ME(NOTPOSSIBLE) 216 "Failed to write line to temp"); 217 goto failed_to_copy; 218 } 219 } 220 221 if (o_stream_send_istream(outstream, mailstream) < 0) { 222 ret = -1; 223 mail_storage_set_error(t->box->storage, 224 ME(NOTPOSSIBLE) 225 "Failed to copy to spool file"); 226 goto failed_to_copy; 227 } with a mailstream that start with "X-Spam-..." will result in a file stored that starts with "X-SpaX-Spam-...". I've read the above code many times now and tried to find a problem with it, but I don't see it -- could you help us? johannes

2 4

[Dovecot] [Fwd: Re: enourmous amount of disc writes]
by Rainer Sigl 15 Jun '09

15 Jun '09

-------- Original Message -------- Subject: Re: [Dovecot] enourmous amount of disc writes Date: Mon, 15 Jun 2009 18:48:50 +0200 From: Rainer Sigl <sigl(a)mpe.mpg.de> To: Ralf Hildebrandt <Ralf.Hildebrandt(a)charite.de> References: <4A3640C5.1070105(a)mpe.mpg.de> <4A364233.6090001(a)schetterer.org> <4A365913.6030301(a)mpe.mpg.de> <20090615142836.GX29026(a)charite.de> ok, ich haette gerne von iostat 1 die folgenden Werte nach dem ersten. Die erste Zeile zeigt immer einen overall average seit dem letzten Boot an. Dieser Wert ist bei mir auch rel. harmlos. Die Spitzen sind untertags. Gruss Rainer Ralf Hildebrandt wrote: > * Rainer Sigl <sigl(a)mpe.mpg.de>: >> Hi Robert, >> many thanks for your answer! >> Yes I'm aware of the necessity to upgrade the complete system. Beside >> this I wanted to search for a quick solution. Upgrading the system >> entails many other things and is in my eyes not possible on the living >> system. > > Du wärst erstaunt was alles geht... > >> Did you ever measure the ioactiviy with iostat on your machine? >> Please tell me the output values. Which hardware do you use? > > Welches iostat output willst Du? > wir haben READ 2.0MByte/s > WRITE 0.5MBytes/s > bei 12.000 Usern. > -- ----------------- Rainer Sigl, | email: sigl(a)mpe.mpg.de MPI f. extraterrestrische Physik, | phone: +49 (89) 30000-3557 Postfach 1312, | fax: +49 (89) 30000-3569 D-85741 Garching, Germany | web: http://www.mpe.mpg.de/~sigl/ -- ----------------- Rainer Sigl, | email: sigl(a)mpe.mpg.de MPI f. extraterrestrische Physik, | phone: +49 (89) 30000-3557 Postfach 1312, | fax: +49 (89) 30000-3569 D-85741 Garching, Germany | web: http://www.mpe.mpg.de/~sigl/

1 0

[Dovecot] Dovecot Top?
by Andrew Hearn 15 Jun '09

15 Jun '09

Hello, We occasional see high load peaks on our mail servers - these generally don't only last a few minutes. 'Top' show imap taking the lots of CPU resources, is there a dovecot 'top' like program to show dovecot which users are taking system resources? Or how else can this kind of thing be tracked down? (v1.1.7) Thanks. Andrew.

2 2

[Dovecot] Sendmail + Deliver as an LDA
by Natan Vermeersch 14 Jun '09

14 Jun '09

Need help with setup/config. Current situation: (dovecot version : 1.1.7) we have system users and virtual users. (with different domains) Virtual users have procmail as LDA Now we want "deliver" to become the LDA I'm confused reading http://wiki.dovecot.org/LDA/Sendmail sendmail.mc: divert(-1) divert(0)dnl include(`/usr/share/sendmail-cf/m4/cf.m4')dnl VERSIONID(`$Id: sendmail-procmail.mc,v 1.2 2004/12/07 01:59:31 g2boojum Exp $')dnl OSTYPE(linux)dnl DOMAIN(generic)dnl define(`PROCMAIL_MAILER_PATH',`/usr/bin/procmail')dnl define(`confDONT_PROBE_INTERFACES',true)dnl define(`ALIAS_FILE', `/etc/mail/aliases')dnl dnl FEATURE(`smrsh',`/usr/sbin/smrsh')dnl dnl FEATURE(`local_lmtp',`/usr/sbin/mail.local')dnl FEATURE(`local_procmail')dnl FEATURE(`redirect')dnl FEATURE(`access_db')dnl FEATURE(`virtusertable',`hash -o /etc/mail/virtusertable')dnl dnl FEATURE(`mailertable')dnl FEATURE(`always_add_domain')dnl FEATURE(`use_ct_file')dnl FEATURE(`use_cw_file')dnl FEATURE(`blacklist_recipients')dnl dnl FEATURE(`relay_entire_domain')dnl dnl MAILER(local)dnl MAILER(smtp)dnl MAILER(procmail)dnl INPUT_MAIL_FILTER(`mimedefang', `S=unix:/var/spool/MIMEDefang/mimedefang.sock, T=S:5m;R:5m')dnl What setup do we need for both system and virtual users ? Help would be appreciated ! thx Natan _________________________________________________________________ Reageer op foto’s van je vrienden en bekijk hun reacties op de jouwe. Gegarandeerd hilariteit! http://www.microsoft.com/belux/nl/windows/windowslive/products/photos.aspx

3 9

[Dovecot] dovecot-antispam and permissions
by Tom Hendrikx 14 Jun '09

14 Jun '09

hi list, I'm having trouble with a new setup. My server is running postfix (2.5.5), dovecot (1.1.7), dspam (3.8.0). These all seems to work with eachother. When I add dovecot-antispam in the mix, the following problem occurs: New mail arrives, postfix hands the mail to dspam using a content_filter, and dspam clasifies the mail, running as the dspam user. Dspam writes its data away in a sqlite database. Mail then gets reinjected into postfix and delivered to the system user by deliver. When I manually classify a mail using dovecot-antispam, dovecot runs dspam classification as the system user. This gives the error "failed to call dspam" in my client, and the message "dspam[20203]: query error: attempt to write a readonly database: see sql.errors for more details". Since the mentioned sql.errors is owned by the system user and not by the "dspam" user, it seems that the re-classification proces is run as that user, so he has no write access to the sqlite db, which is owned by dspam:dspam. I could fix this by manually changing group ownership to the database, but maybe there is a more generic way to solve this? -- Regards, Tom

1 1

[Dovecot] Error compile dovecot 1.1.16
by Yanmarshus 14 Jun '09

14 Jun '09

/* sorry, my english is bad :-( */ There's error i found while compile dovecot 1.1.16 Compiling run on Slackware 12.2 (fresh install) Error in src/dict/main.c line 85 and line 102 dict_drivers_register_all(); and dict_drivers_unregister_all(); I know C so little, and try to add these line to dict.h void dict_drivers_register_all(void) void dict_drivers_unregister_all(void) After this patch, compiling run without error My question, is that right solution ? Thanks.

2 1