- dovecot - dovecot.org

[Dovecot] shared folders in v1.2 with one uid per user
by Ezequiel Alfíe 16 Jun '09

16 Jun '09

Hello everyone. I'm new to dovecot and I'm setting up a server for one domain only. I have not yet decided whether I will be using one uid per user or one uid for all of them. What are the steps for correctly setting up shared folders with acls if I choose one uid per user? What advantages or disadvantages has setting one uid for all users vs one uid per user, considering I wish to setup shared folders (including security, performance, etc) ? Thanks in advance, Ezequiel

2 1

[Dovecot] Multiple mail locations for a single user
by Ross Burton 16 Jun '09

16 Jun '09

Hi, I use offlineimap to cache my remote IMAP mail for my multiple accounts (personal, work, etc) to several maildirs locally. At the moment in my mail client I'm using Dovecot to access one of the maildirs via IMAP, and then direct maildir access for the others. This is suboptimal however because my clients direct maildir support isn't great. Is there any way to let me access all three maildirs through dovecot? I'm guessing that I can do this with namespaces but I'm not sure. Any suggestions and pointers? Cheers, Ross -- Ross Burton mail: ross(a)burtonini.com jabber: ross(a)burtonini.com www: http://burtonini.com

3 2

[Dovecot] 1.2rc5 crash: Backtrace:dovecot-auth
by Ralf Hildebrandt 16 Jun '09

16 Jun '09

GNU gdb 6.8-debian Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu"... Reading symbols from /lib/i686/cmov/libcrypt.so.1...Reading symbols from /usr/lib/debug/lib/i686/cmov/libcrypt-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libcrypt.so.1 Reading symbols from /lib/libpam.so.0...done. Loaded symbols for /lib/libpam.so.0 Reading symbols from /lib/i686/cmov/libdl.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libdl-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libdl.so.2 Reading symbols from /lib/i686/cmov/libc.so.6...Reading symbols from /usr/lib/debug/lib/i686/cmov/libc-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libc.so.6 Reading symbols from /lib/ld-linux.so.2...Reading symbols from /usr/lib/debug/lib/ld-2.9.so...done. done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /lib/i686/cmov/libnss_compat.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libnss_compat-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libnss_compat.so.2 Reading symbols from /lib/i686/cmov/libnsl.so.1...Reading symbols from /usr/lib/debug/lib/i686/cmov/libnsl-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libnsl.so.1 Reading symbols from /lib/i686/cmov/libnss_nis.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libnss_nis-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libnss_nis.so.2 Reading symbols from /lib/i686/cmov/libnss_files.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libnss_files-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libnss_files.so.2 Reading symbols from /lib/libgcc_s.so.1...done. Loaded symbols for /lib/libgcc_s.so.1 Core was generated by `dovecot-auth'. Program terminated with signal 6, Aborted. [New process 31310] #0 0xb7f7a424 in __kernel_vsyscall () #0 0xb7f7a424 in __kernel_vsyscall () No symbol table info available. #1 0xb7df7680 in *__GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 resultvar = <value optimized out> pid = -1208844300 selftid = 31310 #2 0xb7dfad68 in *__GI_abort () at abort.c:88 act = {__sigaction_handler = {sa_handler = 0x8669618, sa_sigaction = 0x8669618}, sa_mask = {__val = {3219629144, 134653482, 3086120672, 0, 3219629264, 3219629252, 512, 0, 0, 3219629328, 3086583408, 134536646, 541, 0, 0, 0, 1, 134703806, 512, 1, 3219629252, 140940792, 69, 3219629380, 3219629224, 134655078, 140941365, 3219629252, 3219629256, 542, 140940824, 3085563107}}, sa_flags = 542, sa_restorer = 0x807af69 <write_full+57>} sigs = {__val = {32, 0 <repeats 31 times>}} #3 0x0806c7a5 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:160 backtrace = 0x86691e8 "dovecot-auth [0x806c791] -> dovecot-auth [0x806c812] -> dovecot-auth [0x806c199] -> dovecot-auth [0x8056bd4] -> dovecot-auth(auth_request_set_username+0xaf) [0x8056c8f] -> dovecot-auth [0x805cdf2] -> "... #4 0x0806c812 in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=0x807bd34 "file %s: line %d (%s): assertion failed: (%s)", args=0xbfe7a5a4 "\207�\a\bg\003") at failures.c:440 No locals. #5 0x0806c199 in i_panic ( format=0x807bd34 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:207 No locals. #6 0x08056bd4 in auth_request_set_login_username (request=0x87bebc8, username=0x86691b0 "", error_r=0xbfe7a628) at auth-request.c:871 __PRETTY_FUNCTION__ = "auth_request_set_login_username" #7 0x08056c8f in auth_request_set_username (request=0x87bebc8, username=0x866918a "masteruser", error_r=0xbfe7a628) at auth-request.c:859 login_username = 0x86691b0 "" #8 0x0805cdf2 in mech_plain_auth_continue (request=0x87bebc8, data=0x8669188 "", data_size=21) at mech-plain.c:47 authid = 0x8669188 "" authenid = 0x8669189 "*masteruser" error = <value optimized out> pass = 0x86691a0 "xxxxxxxx" i = <value optimized out> count = <value optimized out> #9 0x0805846c in auth_request_handler_auth_begin (handler=0x867c4e8, args=0x86fcc69 "4872\tPLAIN\tservice=imap\tsecured\tlip=127.0.0.1\trip=127.0.0.1\tlport=993\trport=43359\tresp=ACptYXN0ZXJ1c2VyAFppR2FHaW5a") at auth-request-handler.c:385 mech = <value optimized out> request = (struct auth_request *) 0x87bebc8 list = (const char * const *) 0x86690c8 name = 0x8669168 "\210\221f\b\025" arg = 0x8669087 "ACptYXN0ZXJ1c2VyAFppR2FHaW5a" initial_resp = <value optimized out> initial_resp_len = 6 id = 4872 buf = (buffer_t *) 0x8669168 #10 0x080539ce in auth_client_input (conn=0x87c52e0) at auth-client-connection.c:174 _data_stack_cur_id = 3 line = 0x86fcc64 "AUTH\t4872\tPLAIN\tservice=imap\tsecured\tlip=127.0.0.1\trip=127.0.0.1\tlport=993\trport=43359\tresp=ACptYXN0ZXJ1c2VyAFppR2FHaW5a" ret = 2 #11 0x08070430 in io_loop_handler_run (ioloop=0x86711a8) at ioloop-epoll.c:208 ctx = (struct ioloop_handler_context *) 0x8673b58 event = (const struct epoll_event *) 0x8701a90 list = (struct io_list *) 0x875ee00 io = (struct io_file *) 0x87a0768 tv = {tv_sec = 2, tv_usec = 446563} t_id = 2 msecs = <value optimized out> ret = 1 i = 0 j = 0 call = <value optimized out> #12 0x0806f8a0 in io_loop_run (ioloop=0x86711a8) at ioloop.c:338 No locals. #13 0x0805c5a4 in main (argc=) at main.c:347 foreground = false (gdb) quit -- Ralf Hildebrandt Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.computerbeschimpfung.de If you tell them, they never listen. If they listen, they never learn. If they learn, they never remember. If they remember, they never obey.

2 1

[Dovecot] Archiving feature
by Romer Ventura 16 Jun '09

16 Jun '09

It would be nice to have some sort of archiving feature on which dovecot can save emails older than N+1 months to either a remote Dovecot server with MySQL as storage or a separate instance of Dovecot running on the same server but storing the emails in MySQL Is any of this possible now, or in the works...? Thanks

2 1

[Dovecot] IMP reading entire mailbox
by Chris O'Regan 16 Jun '09

16 Jun '09

We have been noticing a constant hum of traffic between our IMAP server (Dovecot v1.1.14) and our filers over the past several days. I have narrowed it down to one particular user who has been logged in to IMP/Horde since the problem began (he hadn't logged since we upgraded to Dovecot a week before). IMP is periodically checking this user's mail every five minutes. Each time it does, the his entire mailbox is being read. I initially thought it might be an indexing problem since I am also seeing messages such as this in the logs: Corrupted index cache file /local/data/dovecot/indexes/mail/X/XXXXXXXX/.imap/delivery.log/dovecot.index.cache: Broken MIME parts for mail UID 30880 But the in/out bytes being logged by Dovecot indicate that the entire contents of his mailbox are being sent to the client. That is, this user has a particularly large mailbox (~500M) and about 500M are being sent to IMP every five minutes. (Actually, what is the meaning of the above message? He's the only user logging it.) The user does have some filters defined in IMP, but I can't imagine that it would try to apply them to the entire mailbox each time it is accessed. Surely it would only apply the filters to new messages, right? But I can't think of any other reason why we would be seeing this behaviour, and only for this user. I have not yet contacted the user as I need something to tell him other than "you're a bandwidth hog". I think the next step is to ask him to disable his filters, but I would prefer not shooting in the dark. This user alone is adding about 50Mbps of bandwidth; between the time we upgraded to Dovecot (from uw-imap) and he logged in, we were witnessing a huge drop in traffic. He's ruining our graphs! ;-) Seriously, if anyone has some ideas, please let me know. Thanks! -- Chris O'Regan <chris(a)encs.concordia.ca> Senior Unix Systems Administrator, Academic IT Services Faculty of Engineering and Computer Science Concordia University, Montreal, Canada

5 17

[Dovecot] Dovecot v1.2.rc5 dbox file permissions
by Pascal Volk 16 Jun '09

16 Jun '09

Hi Timo, I've just setup Dovecot v1.2.rc5 and switched the mailbox format of one account to dbox. Therefor I've created an empty directory, called dbox, with access mode 0700, like the user's home directory. After the IMAP login with Thunderbird some dboxes was created. All permissions were set fine (0700 / 0600), except the permissions for the files: * ~/dbox/mailboxes/$FOLDERNAME/dbox-Mails/dbox.index * ~/dbox/mailboxes/$FOLDERNAME/dbox-Mails/dovecot.index.log Those files have the access mode 0666. Regards, Pascal -- The trapper recommends today: cafebabe.0916419(a)localdomain.org

2 1

[Dovecot] mixing dovecot and non-dovecot access to mail
by Michal Szymanski 16 Jun '09

16 Jun '09

Hello, I have recently installed Mailscanner/postfix for the mail server and dovecot for (mainly remote) access to email (via T'bird etc. and/or Webmail). Most users still use text mail clients (mutt, pine, some still old elm) while in the office. These clients access mail (both incoming at /var/mail/ and users' private folders in ~/Mail) directly. I wonder whether this mixing of dovecot and non-dovecot access can make any problems, provide, of course, that the users are not using both ways at the same time. AFAIK dovecot makes some indexing. Will it not be confused if the folder is changed and de-sync-ed with the index? regards, Michal. -- Michal Szymanski (msz at astrouw dot edu dot pl) Warsaw University Observatory, Warszawa, POLAND -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean.

2 1

[Dovecot] dovecot-antispam plugin and "Failed to call dspam" message
by Jeremy Doran 15 Jun '09

15 Jun '09

Hi, I had this working until I recently upgraded Dovecot, and now I'm getting a message back from Thunderbird of "Failed to call dspam." when I attempt to move a message into one of the designated spam folders. However, I know from looking at the dspam system.log file, the retraining actually happens - so it -does- appear to be calling dspam. It appears that the 'move' operation fails. Here's my configuration: dovecot 1.1.16 (built from ports) dovecot-antispam 1.1 (tried from ports as well as unmodified source) dspam 3.6.8 (built from ports) FreeBSD 7.1 Relevant sections from dovecot.conf: protocol imap { mail_plugins = antispam mail_plugin_dir = /usr/local/lib/dovecot/imap ... } plugin { antispam_signature = X-DSPAM-Signature antispam_spam = SPAM;spam;Junk antispam_trash = Deleted Messages;Trash;INBOX.Trash antispam_dspam_binary = /usr/local/bin/dspam antispam_dspam_args = --deliver=;--user;%u ... } .config used by dovecot-antispam: DOVECOT=/usr/ports/mail/dovecot/work/dovecot-1.1.16 BACKEND=dspam-exec PLUGINNAME=antispam DEBUG=syslog DEBUG_VERBOSE=1 (I've tried it both with and without the DEBUG lines present in .config) Plugin debug log when I attempt to move a message: Jun 13 09:29:07 stelleri imap: antispam: mailbox_is_unsure(SPAM): 0 Jun 13 09:29:07 stelleri imap: antispam: mailbox_is_trash(INBOX): 0 Jun 13 09:29:07 stelleri imap: antispam: mailbox_is_trash(SPAM): 0 Jun 13 09:29:07 stelleri imap: antispam: mail copy: from trash: 0, to trash: 0 Jun 13 09:29:07 stelleri imap: antispam: mailbox_is_spam(INBOX): 0 Jun 13 09:29:07 stelleri imap: antispam: mailbox_is_spam(SPAM): 1 Jun 13 09:29:07 stelleri imap: antispam: mailbox_is_unsure(INBOX): 0 Jun 13 09:29:07 stelleri imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 Jun 13 09:29:07 stelleri imap: antispam: /usr/local/bin/dspam --source=error --class=spam --signature=4a339984859385209328925 --deliver= --user frysco Associated log from dspam system.log: 1244903347 M <None Specified> 4a339984859385209328925 <None Specified> 0.066815 frysco Retrained Any help appreciated, Thanks, -jcd

4 8

Re: [Dovecot] Dovecot Antispam plugin
by Johannes Berg 15 Jun '09

15 Jun '09

Timo, Christian has reported an error to me on dovecot 1.0.7, where the following code: 199 if (i_stream_read_data(mailstream, &beginning, &size, 5) < 0 || 200 size < 5) { 201 ret = -1; 202 mail_storage_set_error(t->box->storage, 203 ME(NOTPOSSIBLE) 204 "Failed to read mail beginning"); 205 goto failed_to_copy; 206 } 207 208 /* "From "? skip line */ 209 if (memcmp("From ", beginning, 5) == 0) { 210 i_stream_read_next_line(mailstream); 211 } else { 212 if (o_stream_send(outstream, beginning, 5) != 5) { 213 ret = -1; 214 mail_storage_set_error(t->box->storage, 215 ME(NOTPOSSIBLE) 216 "Failed to write line to temp"); 217 goto failed_to_copy; 218 } 219 } 220 221 if (o_stream_send_istream(outstream, mailstream) < 0) { 222 ret = -1; 223 mail_storage_set_error(t->box->storage, 224 ME(NOTPOSSIBLE) 225 "Failed to copy to spool file"); 226 goto failed_to_copy; 227 } with a mailstream that start with "X-Spam-..." will result in a file stored that starts with "X-SpaX-Spam-...". I've read the above code many times now and tried to find a problem with it, but I don't see it -- could you help us? johannes

2 4

[Dovecot] [Fwd: Re: enourmous amount of disc writes]
by Rainer Sigl 15 Jun '09

15 Jun '09

-------- Original Message -------- Subject: Re: [Dovecot] enourmous amount of disc writes Date: Mon, 15 Jun 2009 18:48:50 +0200 From: Rainer Sigl <sigl(a)mpe.mpg.de> To: Ralf Hildebrandt <Ralf.Hildebrandt(a)charite.de> References: <4A3640C5.1070105(a)mpe.mpg.de> <4A364233.6090001(a)schetterer.org> <4A365913.6030301(a)mpe.mpg.de> <20090615142836.GX29026(a)charite.de> ok, ich haette gerne von iostat 1 die folgenden Werte nach dem ersten. Die erste Zeile zeigt immer einen overall average seit dem letzten Boot an. Dieser Wert ist bei mir auch rel. harmlos. Die Spitzen sind untertags. Gruss Rainer Ralf Hildebrandt wrote: > * Rainer Sigl <sigl(a)mpe.mpg.de>: >> Hi Robert, >> many thanks for your answer! >> Yes I'm aware of the necessity to upgrade the complete system. Beside >> this I wanted to search for a quick solution. Upgrading the system >> entails many other things and is in my eyes not possible on the living >> system. > > Du wärst erstaunt was alles geht... > >> Did you ever measure the ioactiviy with iostat on your machine? >> Please tell me the output values. Which hardware do you use? > > Welches iostat output willst Du? > wir haben READ 2.0MByte/s > WRITE 0.5MBytes/s > bei 12.000 Usern. > -- ----------------- Rainer Sigl, | email: sigl(a)mpe.mpg.de MPI f. extraterrestrische Physik, | phone: +49 (89) 30000-3557 Postfach 1312, | fax: +49 (89) 30000-3569 D-85741 Garching, Germany | web: http://www.mpe.mpg.de/~sigl/ -- ----------------- Rainer Sigl, | email: sigl(a)mpe.mpg.de MPI f. extraterrestrische Physik, | phone: +49 (89) 30000-3557 Postfach 1312, | fax: +49 (89) 30000-3569 D-85741 Garching, Germany | web: http://www.mpe.mpg.de/~sigl/

1 0

[Dovecot] Dovecot Top?
by Andrew Hearn 15 Jun '09

15 Jun '09

Hello, We occasional see high load peaks on our mail servers - these generally don't only last a few minutes. 'Top' show imap taking the lots of CPU resources, is there a dovecot 'top' like program to show dovecot which users are taking system resources? Or how else can this kind of thing be tracked down? (v1.1.7) Thanks. Andrew.

2 2

[Dovecot] Sendmail + Deliver as an LDA
by Natan Vermeersch 14 Jun '09

14 Jun '09

Need help with setup/config. Current situation: (dovecot version : 1.1.7) we have system users and virtual users. (with different domains) Virtual users have procmail as LDA Now we want "deliver" to become the LDA I'm confused reading http://wiki.dovecot.org/LDA/Sendmail sendmail.mc: divert(-1) divert(0)dnl include(`/usr/share/sendmail-cf/m4/cf.m4')dnl VERSIONID(`$Id: sendmail-procmail.mc,v 1.2 2004/12/07 01:59:31 g2boojum Exp $')dnl OSTYPE(linux)dnl DOMAIN(generic)dnl define(`PROCMAIL_MAILER_PATH',`/usr/bin/procmail')dnl define(`confDONT_PROBE_INTERFACES',true)dnl define(`ALIAS_FILE', `/etc/mail/aliases')dnl dnl FEATURE(`smrsh',`/usr/sbin/smrsh')dnl dnl FEATURE(`local_lmtp',`/usr/sbin/mail.local')dnl FEATURE(`local_procmail')dnl FEATURE(`redirect')dnl FEATURE(`access_db')dnl FEATURE(`virtusertable',`hash -o /etc/mail/virtusertable')dnl dnl FEATURE(`mailertable')dnl FEATURE(`always_add_domain')dnl FEATURE(`use_ct_file')dnl FEATURE(`use_cw_file')dnl FEATURE(`blacklist_recipients')dnl dnl FEATURE(`relay_entire_domain')dnl dnl MAILER(local)dnl MAILER(smtp)dnl MAILER(procmail)dnl INPUT_MAIL_FILTER(`mimedefang', `S=unix:/var/spool/MIMEDefang/mimedefang.sock, T=S:5m;R:5m')dnl What setup do we need for both system and virtual users ? Help would be appreciated ! thx Natan _________________________________________________________________ Reageer op foto’s van je vrienden en bekijk hun reacties op de jouwe. Gegarandeerd hilariteit! http://www.microsoft.com/belux/nl/windows/windowslive/products/photos.aspx

3 9

[Dovecot] dovecot-antispam and permissions
by Tom Hendrikx 14 Jun '09

14 Jun '09

hi list, I'm having trouble with a new setup. My server is running postfix (2.5.5), dovecot (1.1.7), dspam (3.8.0). These all seems to work with eachother. When I add dovecot-antispam in the mix, the following problem occurs: New mail arrives, postfix hands the mail to dspam using a content_filter, and dspam clasifies the mail, running as the dspam user. Dspam writes its data away in a sqlite database. Mail then gets reinjected into postfix and delivered to the system user by deliver. When I manually classify a mail using dovecot-antispam, dovecot runs dspam classification as the system user. This gives the error "failed to call dspam" in my client, and the message "dspam[20203]: query error: attempt to write a readonly database: see sql.errors for more details". Since the mentioned sql.errors is owned by the system user and not by the "dspam" user, it seems that the re-classification proces is run as that user, so he has no write access to the sqlite db, which is owned by dspam:dspam. I could fix this by manually changing group ownership to the database, but maybe there is a more generic way to solve this? -- Regards, Tom

1 1

[Dovecot] Error compile dovecot 1.1.16
by Yanmarshus 14 Jun '09

14 Jun '09

/* sorry, my english is bad :-( */ There's error i found while compile dovecot 1.1.16 Compiling run on Slackware 12.2 (fresh install) Error in src/dict/main.c line 85 and line 102 dict_drivers_register_all(); and dict_drivers_unregister_all(); I know C so little, and try to add these line to dict.h void dict_drivers_register_all(void) void dict_drivers_unregister_all(void) After this patch, compiling run without error My question, is that right solution ? Thanks.

2 1

[Dovecot] dovecot-1.2-managesieve sieve_dir permissions
by Pascal Volk 13 Jun '09

13 Jun '09

Hi Stephan, I've compiled the latest managesieve code from Sun May 17th 2009. ManageSieve had created the sieve directory with 0770 permissions, but the user's home directory has only 0700 permissions. With dovecot-1.{0,1}-managesieve the permissions was set properly. Regards, Pascal -- The trapper recommends today: cafebabe.0916419(a)localdomain.org

1 0

[Dovecot] Couldn't open INBOX: Timeout while waiting for lock
by Eric Sammons 12 Jun '09

12 Jun '09

Hi, So I've been through google and the dovecot source and have not yet found a reasonable explanation for the 'Timeout while waiting for lock' error. My customer's configuration is utilizes mbox with the following mbox configs. [snip] pop3_lock_session = yes mbox_read_locks = fcntl mbox_write_locks = fcntl mbox_lock_timeout = 300 [/snip] I see from the source that this error can occur in one of two places: mbox_lock_dotlock() mbox_update_locking() Given my customer is using fcntl locking I automatically assume that it is the later where they are hitting the error. While I see in the source these errors are Temporary Errors; I do wonder what is the specific cause and what should we be looking at to address the errors. One thing we have noticed is that the errors do not occur regulararly. For exapmle, there were no such errors reported on June 9 or June 10; however on June 11 and 12 the errors started to appear. Any direction / pointers are greatly appreciated. Thank you! -- Eric L. Sammons, RHCE

2 1

[Dovecot] Dovecot as a (quota) policy server for Postfix
by Wolfram Schlich 12 Jun '09

12 Jun '09

Hi guys, I'm currently experimenting with Postfix, Dovecot and OpenLDAP to setup a mail server hosting virtual users. The standard stuff works fine so far. The only thing that doesn't work as I'd like it to do is Quota. Currently, Dovecot handles/enforces quota through the deliver LDA. When Postfix tries to deliver a mail to a mailbox that is over quota, the deliver LDA bounces the mail back to the sender. I don't like that. I'd rather prefer Postfix to reject the mail right after receiving the '.' DATA termination line and having checked whether the users quota is or would be exceeded. This could work by writing a small Postfix policy server/daemon that does exactly that Dovecot does: - get the user quota limit from userdb (from LDAP in my case) - get the user quota used (from maildirsize in my case) _ check whether the current mail size + quota used exceed the quota limit and if true, reject the mail Of course this would only work for mails going to a single local recipient address, but most of the time, that's just the case. Now I can re-implement that part of functionality from Dovecot in Perl and write such a small policy daemon that does exactly fit my setup (LDAP + maildirsize). There's one thing I'd like much better, though: What about extending Dovecot by a small policy server module for Postfix? Dovecot already has all the code to do the "over quota" checks and supports a great number of combinations for quota limit and used quota storage. My Postfix instance already kinda depends on a running Dovecot due to Dovecot-SASL for SMTP-Authentication and Dovecot-deliver for mail delivery, so it wouldn't introduce a completely new dependency either. Timo (and all others), what do you think about such a Postfix policy server implemented as a part of Dovecot? -- Regards, Wolfram Schlich <wschlich(a)gentoo.org> Gentoo Linux * http://dev.gentoo.org/~wschlich/

3 2

[Dovecot] gmail pop3 fetcher sets my emails as read
by Julien Buratto 12 Jun '09

12 Jun '09

Hello, I'm testing gmail to fetch my emails via POP3 and I've noticed that on the server where I run dovecot, the emails that gmail take, are marked as read when I imap my emails with my thunderbird. As I've noticed that this is not true for the email accounts on another mail environment, I was wondering if anyone of you could sugged where I could change the behaviour. My configuration is: # 1.1.8: /etc/dovecot.conf # OS: Linux 2.6.9-67.0.4.EL i686 CentOS release 4.7 (Final) log_path: /var/log/maillog info_log_path: /var/log/maillog protocols: imap pop3 pop3s disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_location: mbox:~/mail/:INBOX=mbox mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: cache_size: 1024 verbose: yes passdb: driver: pam args: session=yes cache_key=%u%s dovecot userdb: driver: passwd Thank you for helping -- Julien Buratto

2 3

[Dovecot] Dovecot fails to deliver in mail clients
by Zwelabantu Ngwenya 12 Jun '09

12 Jun '09

Morning I am new to linux and have configured a Postfix + Dovecot Mail server on my SUSE Linux Server 10 SP2 Machine. Postfix works fine I assume as mail gets delivered to user's mailbox or directories. But when I configure a mail client to download mail from the server it finds no mail. When I check the user's mailbox using Webmin mail is delivered. I have also tried to telnet to the server when I do I am able to log in with user's credentials but when I type the list or stat command telnet says there is no mail 0.0Kb. I have tried everything, mail gets delivered to inboxes but telnet and mail clients don't get mail. Please let me know what I am doing wrong Zwelabantu Ngwenya

3 2

[Dovecot] unable to send mails via postfix/dovecot SASL
by Michal Szymanski 11 Jun '09

11 Jun '09

Hello, I have a freshly setup postfix/dovecot mail server (after a server upgrade I decided to change my sendmail/popper conf to something more modern :) It mostly works, there is no problem in sending/receiving mails in local network, both using text clients like mutt or pine dealing with the incoming/outcoming mail directly. Also dovecot works fine with SSL authentication from the outside world (home computers etc) but only for reading the mail. I have been struggling for several days already to get postfix/dovecot/SSL trio to work for sending (relaying) mail from the home computers (but also from local network) via my server to the final recipients, using authenticated connections. I followed http://wiki.dovecot.org/HowTo/PostfixAndDovecotSASL hints for the configuration of postfix and dovecot (see output of dovecot -n and postconf -n commands below). I also uncommented "smtps" line in /etc/postfix/master.cf file (otherwise postfix was refusing any connections to secure SMTP port). For a while, I uncommented also "submission" line there but to no success either. Now when I try to send a mail from my home PC, using Thuinderbird 2.0.0.21, with SSL connection configured for outgoing smtp server (port 465), using username/password, it shows "Connected to server..." message but after a minute or so, it fails saying that the connection to SMTP server failed. The server log shows: 11:51:24 sirius postfix/smtpd[15126]: connect from my_home_pc_name/ip Jun 11 11:52:25 sirius postfix/smtpd[15126]: lost connection after UNKNOWN from from my_home_pc_name/ip Jun 11 11:52:25 sirius postfix/smtpd[15126]: disconnect from my_home_pc_name/ip There are no dovecot-related messages in the log regarding such an attempt. I am not sure whether this is dovecot or postfix problem but, being no expert on either of those, I am asking help to resolve this annoying problem. with best regards, Michal. -------------- dovecon -n -------------------------- # 1.0.7: /etc/dovecot.conf ssl_cert_file: /etc/pki/dovecot/certs/sirius.pem ssl_key_file: /etc/pki/dovecot/private/sirius.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_location: mbox:~/Mail:INBOX=/var/spool/mail/%u mmap_disable: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(pop3): outlook-idle pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login verbose: yes passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix ----------------- postconf -n ---------------------------- alias_database = hash:/etc/mail/aliases alias_maps = hash:/etc/mail/aliases broken_sasl_auth_clients = yes command_directory = /usr/sbin config_directory = /etc/postfix daemon_directory = /usr/libexec/postfix debug_peer_level = 2 header_checks = regexp:/etc/postfix/header_checks html_directory = no inet_interfaces = all mail_owner = postfix mailbox_command = /usr/bin/procmail mailq_path = /usr/bin/mailq.postfix manpage_directory = /usr/share/man masquerade_domains = astrouw.edu.pl mydestination = $myhostname, localhost.$mydomain, localhost, $mydomain, mail.$mydomain, www.$mydomain, ftp.$mydomain, /etc/mail/local-host-names myhostname = sirius.astrouw.edu.pl newaliases_path = /usr/bin/newaliases.postfix queue_directory = /var/spool/postfix readme_directory = /usr/share/doc/postfix-2.3.3/README_FILES sample_directory = /usr/share/doc/postfix-2.3.3/samples sendmail_path = /usr/sbin/sendmail.postfix setgid_group = postdrop smtp_generic_maps = hash:/etc/postfix/generic smtpd_recipient_restrictions = check_recipient_access hash:/etc/postfix/access, permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination, reject_unlisted_recipient smtpd_sasl_auth_enable = yes smtpd_sasl_path = private/auth smtpd_sasl_security_options = noanonymous smtpd_sasl_type = dovecot unknown_local_recipient_reject_code = 550 --------------------------------------------------------------- -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean.

3 7

[Dovecot] Problem with Courier POP3 Migration to dovecot POP3
by Ashraf 11 Jun '09

11 Jun '09

Hi Timo/all Help me please, i am in the process of migrating courier to dovecot 1.1.14. I want to do migration as users loging so i am using this script * http://www.dovecot.org/tools/courier-dovecot-migrate.pl *, When i do use post-logging script to migrate* POP3*, its downloading messages again (*Duplicating messages)* , as some of our users prefer to leave messages on server. If i run the script manually on particular users home directory and try to download it *still duplicating messages, *as its creating whole new set of dovecot files. * * About my environment -- MailDir's stored in NFS location -- User Authenticated using MySQL my dovecot.conf looks like base_dir = /var/run/dovecot/ protocols = imap pop3 listen = *, [::] log_path =/var/log/dovecot.log info_log_path = /var/log/dovecot-info.log ssl_disable = yes login_process_per_connection = no login_processes_count = 10 login_max_processes_count = 128 login_max_connections = 256 login_greeting = Dovecot ready. mail_location = maildir:~/ mail_debug = yes mmap_disable = yes dotlock_use_excl = yes mail_nfs_index = yes lock_method = dotlock mail_drop_priv_before_exec = yes first_valid_uid = 195 max_mail_processes = 512 mail_process_size = 256 mailbox_idle_check_interval = 20 protocol imap { } protocol pop3 { *mail_executable = /usr/libexec/dovecot/postpop3.sh* mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } auth_verbose = yes auth_debug = yes auth default { mechanisms = plain passdb sql { args = /etc/dovecot-mysql.conf } userdb sql { args = /etc/dovecot-mysql.conf } user = root } dict { } plugin { } ---- my postloggin script -- $ cat /usr/libexec/dovecot/postpop3.sh #!/bin/sh # WARNING: Be sure to use mail_drop_priv_before_exec=yes, # otherwise the files are created as root! /usr/libexec/dovecot/courier-dovecot-migrate.pl --quiet --to-dovecot --recursive --convert ${HOME} # This is for pop3 exec /usr/libexec/dovecot/pop3 ---- Please advise am i doing something wrong, please guide me, let me know if you need any more info about my setup. -- Regards Ashraf

2 1

[Dovecot] Panic with signal 6 core dump with revision 9116:9ae55b68cf61
by Jonathan Siegle 11 Jun '09

11 Jun '09

Jun 2 10:05:14 hostname dovecot: IMAP(testuser): Panic: file istream- raw-mbox.c: line 380: assertion failed: (new_pos > 0) Jun 2 10:05:14 hostname dovecot: dovecot: child 544822 (imap) killed with signal 6 (dbx) where raise(??) at 0x90000000005a68c abort() at 0x900000000085c2c default_fatal_finish(type = LOG_TYPE_PANIC, status = 0), line 160 in "failures.c" i_internal_fatal_handler(type = LOG_TYPE_PANIC, status = 0, fmt = "file %s: line %d: assertion failed: (%s)", args = ""), line 440 in "failures.c" i_panic(format = "file %s: line %d: assertion failed: (%s)", ... = 0x1001731b4, 0x17c, 0x100173328, 0x0, 0x15b5, 0x0, 0x0), line 207 in "failures.c" i_stream_raw_mbox_read(stream = 0x00000001100ca6b0), line 380 in "istream-raw-mbox.c" i_stream_raw_mbox_read(stream = 0x00000001100ca6b0), line 379 in "istream-raw-mbox.c" i_stream_read(stream = 0x00000001100ca700), line 80 in "istream.c" i_stream_limit_read(stream = 0x00000001100cb930), line 64 in "istream- limit.c" i_stream_read(stream = 0x00000001100cb980), line 80 in "istream.c" i_stream_read_copy_from_parent(istream = 0x00000001100cbb20), line 118 in "istream.c" i_stream_header_filter_read(stream = 0x00000001100cbad0), line 315 in "istream-header-filter.c" i_stream_read(stream = 0x00000001100cbb20), line 80 in "istream.c" i_stream_read_copy_from_parent(istream = 0x00000001100cbd20), line 118 in "istream.c" i_stream_mail_stats_read_mail_stats(stream = 0x00000001100cbcd0), line 47 in "istream-mail-stats.c" i_stream_read(stream = 0x00000001100cbd20), line 80 in "istream.c" i_stream_read_data(stream = 0x00000001100cbd20, data_r = 0x0fffffffffffecc0, size_r = 0x0fffffffffffecc8, threshold = 1), line 361 in "istream.c" message_parser_read_more(ctx = 0x00000001100cc118, block_r = 0x0fffffffffffecb0, full_r = 0x0fffffffffffeb84), line 118 in "message- parser.c" parse_next_body_to_boundary(ctx = 0x00000001100cc118, block_r = 0x0fffffffffffecb0), line 330 in "message-parser.c" message_parser_parse_next_block(ctx = 0x00000001100cc118, block_r = 0x0fffffffffffecb0), line 768 in "message-parser.c" message_parser_parse_body(ctx = 0x00000001100cc118, hdr_callback = (nil), context = (nil)), line 831 in "message-parser.c" index_mail_parse_body(mail = 0x00000001100c9878, field = MAIL_CACHE_FLAGS), line 792 in "index-mail.c" index_mail_get_parts(_mail = 0x00000001100c9878, parts_r = 0x0fffffffffffef28), line 224 in "index-mail.c" mail_get_parts(mail = 0x00000001100c9878, parts_r = 0x0fffffffffffef28), line 71 in "mail.c" unnamed block in search_arg_match_text(args = 0x00000001100c7e70, ctx = 0x00000001100c95f0, ret = -1), line 647 in "index-search.c" search_arg_match_text(args = 0x00000001100c7e70, ctx = 0x00000001100c95f0, ret = -1), line 647 in "index-search.c" search_match_next(ctx = 0x00000001100c95f0), line 1101 in "index- search.c" unnamed block in index_storage_search_next_nonblock(_ctx = 0x00000001100c95f0, mail = 0x00000001100c9878, tryagain_r = 0x0ffffffffffff1e0), line 1301 in "index-search.c" index_storage_search_next_nonblock(_ctx = 0x00000001100c95f0, mail = 0x00000001100c9878, tryagain_r = 0x0ffffffffffff1e0), line 1301 in "index-search.c" mailbox_search_next_nonblock(ctx = 0x00000001100c95f0, mail = 0x00000001100c9878, tryagain_r = 0x0ffffffffffff1e0), line 754 in "mail-storage.c" cmd_search_more(cmd = 0x0000000110022058), line 347 in "imap-search.c" cmd_search_more_callback(cmd = 0x0000000110022058), line 434 in "imap- search.c" unnamed block in io_loop_handle_timeouts_real(ioloop = 0x000000011001f310), line 316 in "ioloop.c" io_loop_handle_timeouts_real(ioloop = 0x000000011001f310), line 316 in "ioloop.c" unnamed block in io_loop_handle_timeouts(ioloop = 0x000000011001f310), line 327 in "ioloop.c" io_loop_handle_timeouts(ioloop = 0x000000011001f310), line 327 in "ioloop.c" io_loop_handler_run(ioloop = 0x000000011001f310), line 162 in "ioloop- poll.c" io_loop_run(ioloop = 0x000000011001f310), line 338 in "ioloop.c" main(argc = 1, argv = 0x0ffffffffffff630, envp = 0x0ffffffffffff640), line 323 in "main.c"

2 2

[Dovecot] Quota over NFS with inode limit
by Patrick Domack 11 Jun '09

11 Jun '09

I tried searching this list, but couldn't find anything related to inode limits except for linux quotas. I wanted to add sieve support for our users, so was attempting to get our email system to use dovecot's deliver lda to handle email, instead of postfix's virtual lda, using maildir mailstore. When I did this, I noticed that emails would get stuck in the queue if a user was over quota, this got fixed when I added in quota support, and set it up to check it using the line: quota = fs:User quota:user:inode_per_mail Now if a user excedes disk space via quota, it's bounced with a message. But if a user excedes their inode quota, it's still tempfail and hangs in the queue till it expires. I just wanted to know if anyone knows about this issue, if I made a stupid mistake or anything else, before I go digging into the source.

2 7

[Dovecot] Sieve per virtual mailbox
by Joan 11 Jun '09

11 Jun '09

Hi all, Dovecot with the "new Sieve" works fine, but 1 - how to have a global script AND 1 script per virtual maibox ? 2 - how to allow a user to change this script (from Thunderbird or Outlook) Thanks JM

4 8

[Dovecot] record points outside file error with dovecot revision 9116:9ae55b68cf61
by Jonathan Siegle 11 Jun '09

11 Jun '09

I use mbox with mbox-snarf plugin. I get errors like: dovecot: IMAP(testuser): Corrupted index cache file /full/path/ dovecot.index.cache: record points outside file The errors can be in either folders or INBOX. I put some syslog statements in src/lib-index/mail-cache-lookup.c to help understand this. if (offset + sizeof(*rec) > cache->mmap_length) { mail_cache_set_corrupted(cache, "record points outside file"); syslog(LOG_DEBUG,"mail_cache_get_record rec->size is %d ", rec->size); syslog(LOG_DEBUG,"cache->mmap_length is %d ", cache- >mmap_length); syslog(LOG_DEBUG,"offset is %d ", offset); return -1; } syslog: mail_cache_get_record rec->size is 268595472 syslog: cache->mmap_length is 4096 syslog: offset is 1630760037 Oh I forgot to print off sizeof(*rec). Would that help? Thanks, Jonathan

3 12

Re: [Dovecot] dovecot Digest, Vol 74, Issue 36
by javier.garcia＠ibercom.com 11 Jun '09

11 Jun '09

Estimados Sres. En este momento me encuentro fuera de la oficina hasta el día 22 de Junio. Cualquier tema urgente contacte directamente con Ibercom ya sea por teléfono o por la cuenta de correo de soporte. Perdone las molestias. Un saludo, Javier García.

1 0

[Dovecot] SELinux
by Kenneth Porter 10 Jun '09

10 Jun '09

I've temporarily got SELinux set to permissive mode on a fresh install on CentOS 5. It was blocking Dovecot's access to ~/mail because the files were labeled file_t. What's the correct way to label these?

2 2

Re: [Dovecot] dovecot Digest, Vol 74, Issue 35
by javier.garcia＠ibercom.com 10 Jun '09

10 Jun '09

Estimados Sres. En este momento me encuentro fuera de la oficina hasta el día 22 de Junio. Cualquier tema urgente contacte directamente con Ibercom ya sea por teléfono o por la cuenta de correo de soporte. Perdone las molestias. Un saludo, Javier García.

1 0

Re: [Dovecot] New patch for folder pattern matches
by Steffen Kaiser 10 Jun '09

10 Jun '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sun, 7 Jun 2009, Johannes Berg wrote: Hallo Johannes, > Nice. I gave it an almost complete rewrite again, getting rid of the > magic array indexes and things like that. Please test, I haven't had a es gab einen off-by-one Bug beim Laden der Config. Dort habe ich noch eine "2" durch den Enum-Wert ersetzt. Beim Test sieht's super aus! Man koennte jetzt noch match_fn[] in die match_name[] packen, um alles zusammen zu haben ... . Wie ist das eigentlich, das Feld, auf den der Rueckgabewert von getenv() zeigt, darf nicht veraendert werden, oder? Ansonsten koennte man: strings[i] = p_strsplit(global_pool, tmp, ";"); if (i == MT_PATTERN_IGNCASE) { /* lower case the string */ char **list = strings[i]; while (*list) { lowercase_string(*list, *list); ++list; } } durch if (i == MT_PATTERN_IGNCASE) { lowercase_string(tmp, tmp); } strings[i] = p_strsplit(global_pool, tmp, ";"); ersetzen und Zeit sparen. Tschuess, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iQEVAwUBSi+sAHWSIuGy1ktrAQJVZgf+JpKXXSh2kwthE47OmsGLriaDhRsbiIkx 6ikOgxbvpsHXKri2h9Y0+NSG5mQnfOvT6AAz1dtapJvXxj+Z84s35xzu3xCfjnNV ent383Go6/7lrqJDvwU6Gvg3yQmXGLDPwI7OKTOK6nrcIOwrOfEx/KBfIqfEBMAp P/uxzFpUgwbDduWakKb0YobciXKm/WQ4FzP/gvHVr5cMMXKUi8Cn+EPhqE6U9gNI jwriJyxWNLC+/YIzJZZtmaRb8QXala8gGdIa56mNu2iR9p4JeYIOBWY0UgGWqKV+ TtPRm9g+DZUi3wd5avnt7YRkAbiwVw9T3mrZ9TmDHW05ZCTg41MAKA== =kxfl -----END PGP SIGNATURE-----

1 0

Re: [Dovecot] dovecot and ntp: Fatal: Time just moved backwards
by Eugene 10 Jun '09

10 Jun '09

Hi Timo, > Date: Tue, 9 Jun 2009 09:40:20 -0700 > From: Timo Sirainen <tss(a)iki.fi> > > On Jun 8, 2009, at 11:40 PM, Arno Wald wrote: > >> Timo Sirainen wrote: >>> Hmm. I suppose I could change Dovecot master so that if no imap/ >>> pop3 processes have been created yet, it would silently ignore the >>> clock move. >> >> Also it might be an idea to just restart dovecot instead of >> completely stopping it. If this happens to often in a certain time >> interval it still could be stopped to avoid too many restarts in a >> loop if there is an error situation somehow. > > http://wiki.dovecot.org/TimeMovedBackwards bottom answers this. A > restart isn't much better than just ignoring the time change. But really, all this leads is that admin has to detect the dovecot termination and simply go and restart it manually -- after some bad thoughts. I think that a config option to restart silently (or simply kill all connected imap/pop3 instances) would be quite reasonable. Basically it is the only thing I don't like in Dovecot... and was even planning to hack the time check out of the code =)) Best wishes Eugene

7 12

[Dovecot] 1.2rc5, another crash: Backtrace:dovecot-auth
by Ralf Hildebrandt 10 Jun '09

10 Jun '09

Another crahs with backtrace: GNU gdb 6.8-debian Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu"... Reading symbols from /lib/i686/cmov/libcrypt.so.1...Reading symbols from /usr/lib/debug/lib/i686/cmov/libcrypt-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libcrypt.so.1 Reading symbols from /lib/libpam.so.0...done. Loaded symbols for /lib/libpam.so.0 Reading symbols from /lib/i686/cmov/libdl.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libdl-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libdl.so.2 Reading symbols from /lib/i686/cmov/libc.so.6...Reading symbols from /usr/lib/debug/lib/i686/cmov/libc-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libc.so.6 Reading symbols from /lib/ld-linux.so.2...Reading symbols from /usr/lib/debug/lib/ld-2.9.so...done. done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /lib/i686/cmov/libnss_compat.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libnss_compat-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libnss_compat.so.2 Reading symbols from /lib/i686/cmov/libnsl.so.1...Reading symbols from /usr/lib/debug/lib/i686/cmov/libnsl-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libnsl.so.1 Reading symbols from /lib/i686/cmov/libnss_nis.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libnss_nis-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libnss_nis.so.2 Reading symbols from /lib/i686/cmov/libnss_files.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libnss_files-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libnss_files.so.2 Reading symbols from /lib/libgcc_s.so.1...done. Loaded symbols for /lib/libgcc_s.so.1 Core was generated by `dovecot-auth'. Program terminated with signal 6, Aborted. [New process 7692] #0 0xb8071424 in __kernel_vsyscall () #0 0xb8071424 in __kernel_vsyscall () No symbol table info available. #1 0xb7eee680 in *__GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 resultvar = <value optimized out> pid = -1207832588 selftid = 7692 #2 0xb7ef1d68 in *__GI_abort () at abort.c:88 act = {__sigaction_handler = {sa_handler = 0x8f90618, sa_sigaction = 0x8f90618}, sa_mask = {__val = {3220762632, 134653482, 3087132384, 0, 3220762752, 3220762740, 512, 0, 0, 3220762816, 3087595120, 134536646, 541, 0, 0, 0, 1, 134703806, 512, 1, 3220762740, 150537720, 69, 3220762868, 3220762712, 134655078, 150538293, 3220762740, 3220762744, 542, 150537752, 3086574819}}, sa_flags = 542, sa_restorer = 0x807af69 <write_full+57>} sigs = {__val = {32, 0 <repeats 31 times>}} #3 0x0806c7a5 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:160 backtrace = 0x8f901e8 "dovecot-auth [0x806c791] -> dovecot-auth [0x806c812] -> dovecot-auth [0x806c199] -> dovecot-auth [0x8056bd4] -> dovecot-auth(auth_request_set_username+0xaf) [0x8056c8f] -> dovecot-auth [0x805cdf2] -> "... #4 0x0806c812 in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=0x807bd34 "file %s: line %d (%s): assertion failed: (%s)", args=0xbff8f154 "\207�\a\bg\003") at failures.c:440 No locals. #5 0x0806c199 in i_panic ( format=0x807bd34 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:207 No locals. #6 0x08056bd4 in auth_request_set_login_username (request=0x9060148, username=0x8f901b0 "", error_r=0xbff8f1d8) at auth-request.c:871 __PRETTY_FUNCTION__ = "auth_request_set_login_username" #7 0x08056c8f in auth_request_set_username (request=0x9060148, username=0x8f9018a "masteruser", error_r=0xbff8f1d8) at auth-request.c:859 login_username = 0x8f901b0 "" #8 0x0805cdf2 in mech_plain_auth_continue (request=0x9060148, data=0x8f90188 "", data_size=21) at mech-plain.c:47 authid = 0x8f90188 "" authenid = 0x8f90189 "*masteruser" error = <value optimized out> pass = 0x8f901a0 "xxxxxxxx" i = <value optimized out> count = <value optimized out> #9 0x0805846c in auth_request_handler_auth_begin (handler=0x90dddd0, args=0x90dcf70 "4877\tPLAIN\tservice=imap\tsecured\tlip=127.0.0.1\trip=127.0.0.1\tlport=993\trport=43362\tresp=ACptYXN0ZXJ1c2VyAFppR2FHaW5a") at auth-request-handler.c:385 mech = <value optimized out> request = (struct auth_request *) 0x9060148 list = (const char * const *) 0x8f900c8 name = 0x8f90168 "\210\001�\b\025" arg = 0x8f90087 "ACptYXN0ZXJ1c2VyAFppR2FHaW5a" initial_resp = <value optimized out> initial_resp_len = 6 id = 4877 buf = (buffer_t *) 0x8f90168 #10 0x080539ce in auth_client_input (conn=0x8f9add8) at auth-client-connection.c:174 _data_stack_cur_id = 3 line = 0x90dcf6b "AUTH\t4877\tPLAIN\tservice=imap\tsecured\tlip=127.0.0.1\trip=127.0.0.1\tlport=993\trport=43362\tresp=ACptYXN0ZXJ1c2VyAFppR2FHaW5a" ret = 2 #11 0x08070430 in io_loop_handler_run (ioloop=0x8f981a8) at ioloop-epoll.c:208 ctx = (struct ioloop_handler_context *) 0x8f9ab58 event = (const struct epoll_event *) 0x90d4a20 list = (struct io_list *) 0x8f9afa8 io = (struct io_file *) 0x8f9af80 tv = {tv_sec = 1, tv_usec = 290883} t_id = 2 msecs = <value optimized out> ret = 1 i = 0 j = 0 call = <value optimized out> #12 0x0806f8a0 in io_loop_run (ioloop=0x8f981a8) at ioloop.c:338 No locals. #13 0x0805c5a4 in main (argc=) at main.c:347 foreground = false (gdb) quit ----- End forwarded message ----- -- Ralf Hildebrandt Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.computerbeschimpfung.de >From empirical experience, your Exchange admin needs to put down the crack pipe and open a window to disperse the fumes.

1 0

[Dovecot] dovecot auth(default): Master request xxxx.xxxx not found
by Eric Sammons 09 Jun '09

09 Jun '09

Hi, Wondering if anyone could give some indication as to where to look for the cause of the following error messages. These error messages seem to occur at about the time when users are having problems logging in. Jun 8 10:33:19 host dovecot: auth(default): Master request xxxx.xxxx not found Using ldap for authentication and auth_cache is enabled, not sure if that matters. Thank you! -- Eric L. Sammons, RHCE

2 1

[Dovecot] Resync quota to mysql script
by Oli Schacher 09 Jun '09

09 Jun '09

I changed some quota options in my dovecot config (eg. excluded folders) but afaik this only affects new mail and there is no magic command to recalculate the quota (or is there?). So I wrote this little python script to do this, maybe someone finds it useful. It can output the sql statements (dovecot 1.0/1.1 and 1.2 format) or just print out quota usage to console. Download at : http://wgwh.ch/dovecot/quotasync.py , run-at-own-risk and do-whith-the-code-what-you-want applies. # cd /path/to/a/Maildir # quotasync.py INBOX : 21 messages 516739 bytes .postfix : 982 messages 7572888 bytes .bn_archiv : 77 messages 2092454 bytes .python : 2748 messages 19877135 bytes .testfolder.subfolder1.subsubfolder1 : 2 messages 19443 bytes .testfolder.subfolder2 : 1 messages 9044 bytes .testfolder : 0 messages 0 bytes .Trash : 146 messages 1702297 bytes .Drafts : 0 messages 0 bytes .Sent : 0 messages 0 bytes .Spam : 2459 messages 16152165 bytes .testfolder.subfolder1 : 4 messages 13359 bytes ------------------- TOTAL: 6440 messages 47955524 bytes Example mysql output,dovecot 1.2 format: # quotasync.py -o mysql -a user(a)domain.com INSERT INTO quota (username,bytes,messages) VALUES ('user(a)domain.com',47963905,6441) ON DUPLICATE KEY UPDATE bytes=47963905,messages=6441; Example mysql output, dovecot 1.1 format, Spam folder excluded # quotasync.py -o mysql -a user(a)domain.com -d 1.1 -e .Spam INSERT INTO quota (username,path,current) VALUES ('user(a)domain.com','quota/messages',3982) ON DUPLICATE KEY UPDATE current=3982; INSERT INTO quota (username,path,current) VALUES ('user(a)domain.com','quota/storage',31811740) ON DUPLICATE KEY UPDATE current=31811740; You can pipe this output directly to mysql. eg.: quotasync.py -a user(a)domain.com -o mysql | mysql yourdatabase run quotasync.py --help to see all options

2 2

[Dovecot] Dovecot deliver with ACL plugin enabled truble
by Nikita Koshikov 09 Jun '09

09 Jun '09

Hello folk, I have trouble running /usr/libexec/dovecot/deliver with ACL plugin enabled from my exim configurarion. Everything is working fine if I disable plugin ACL from lda section in dovecot config. This is the string from exim.conf, which request delivery to take place: command = /usr/libexec/dovecot/deliver -e -d $local_part@$domain In dovecot error-log I see this, when deliver tries to "put" message in users maildir: ==> /var/log/dovecot/dovecot-deliver.log <== deliver(user(a)domain.com): Jun 09 15:07:38 Info: Loading modules from directory: /usr/lib/dovecot/lda deliver(user(a)domain.com): Jun 09 15:07:38 Info: Module loaded: /usr/lib/dovecot/lda/lib01_acl_plugin.so deliver(user(a)domain.com): Jun 09 15:07:38 Info: Module loaded: /usr/lib/dovecot/lda/lib10_quota_plugin.so deliver(user(a)domain.com): Jun 09 15:07:38 Info: Module loaded: /usr/lib/dovecot/lda/lib11_trash_plugin.so deliver(user(a)domain.com): Jun 09 15:07:38 Info: Module loaded: /usr/lib/dovecot/lda/lib20_expire_plugin.so deliver(user(a)domain.com): Jun 09 15:07:38 Info: auth input: uid=8 deliver(user(a)domain.com): Jun 09 15:07:38 Info: auth input: gid=12 deliver(user(a)domain.com): Jun 09 15:07:38 Info: auth input: home=/var/mail/domain.com/user deliver(user(a)domain.com): Jun 09 15:07:38 Info: auth input: mail=maildir:/var/mail/domain.com/user/data deliver(user(a)domain.com): Jun 09 15:07:38 Info: Quota root: name=Mailbox quota backend=maildir args= deliver(user(a)domain.com): Jun 09 15:07:38 Info: Quota rule: root=Mailbox quota mailbox=* bytes=524288000 messages=0 deliver(user(a)domain.com): Jun 09 15:07:38 Info: Quota rule: root=Mailbox quota mailbox=Trash bytes=52428800 (10%) messages=0 deliver(user(a)domain.com): Jun 09 15:07:38 Info: maildir: data=/var/mail/domain.com/user/data deliver(user(a)domain.com): Jun 09 15:07:38 Info: maildir++: root=/var/mail/domain.com/user/data, index=, control=, inbox=/var/mail/domain.com/user/data deliver(user(a)domain.com): Jun 09 15:07:38 Info: acl: initializing backend with data: vfile deliver(user(a)domain.com): Jun 09 15:07:38 Info: acl: acl username = user(a)domain.com deliver(user(a)domain.com): Jun 09 15:07:38 Info: acl: owner = 1 deliver(user(a)domain.com): Jun 09 15:07:38 Info: acl vfile: Global ACL directory: (null) deliver(user(a)domain.com): Jun 09 15:07:38 Info: trash plugin: Added 'Spam' with priority 1 deliver(user(a)domain.com): Jun 09 15:07:38 Info: trash plugin: Added 'Trash' with priority 2 deliver(user(a)domain.com): Jun 09 15:07:38 Info: acl: initializing backend with data: vfile deliver(user(a)domain.com): Jun 09 15:07:38 Info: acl: acl username = user(a)domain.com deliver(user(a)domain.com): Jun 09 15:07:38 Info: acl: owner = 1 deliver(user(a)domain.com): Jun 09 15:07:38 Info: acl vfile: Global ACL directory: (null) deliver(user(a)domain.com): Jun 09 15:07:38 Fatal: mail_full_filesystem_access=yes is incompatible with ACLs In my current dovecot config-file option mail_full_filesystem_access is commented out. I have tried both variants to explicitly enable and disable this feature, but errors stayed the same. Please advice. Additional info: Here is my lda config: protocol lda { postmaster_address = postmaster(a)domain.com mail_plugins = quota acl trash expire quota_full_tempfail = yes auth_socket_path = /var/run/dovecot/auth-master log_path = /var/log/dovecot/dovecot-deliver.log info_log_path = /var/log/dovecot/dovecot-deliver.log } This is my dovecot config-file: # 1.1.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-gentoo-r4 i686 Gentoo Base System release 1.12.11.1 ext3 log_path: /var/log/dovecot/dovecot-error.log info_log_path: /var/log//dovecot/dovecot.log protocols: imaps ssl_cert_file: /etc/dovecot/ssl/imaps.crt ssl_key_file: /etc/dovecot/ssl/imaps.key login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login login_greeting_capability: yes login_processes_count: 10 login_max_processes_count: 512 first_valid_uid: 8 last_valid_uid: 8 first_valid_gid: 12 last_valid_gid: 12 mail_location: maildir:/var/mail/%d/%n/data mail_debug: yes mail_plugins: quota imap_quota acl trash mail_log fts fts_squat expire mail_log_max_lines_per_sec: 0 auth default: mechanisms: plain login cache_size: 10240 cache_negative_ttl: 0 user: mail debug: yes worker_max_count: 50 passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf passdb: driver: passwd-file args: scheme=cram-md5 /etc/dovecot/cram-md5.pwd userdb: driver: prefetch userdb: driver: ldap args: /etc/dovecot/dovecot-userdb-ldap.conf userdb: driver: passwd-file args: /etc/dovecot/cram-md5.pwd socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384 user: mail group: mail plugin: quota: maildir:Mailbox quota quota_rule: *:storage=500M quota_rule2: Trash:storage=10%% acl: vfile trash: /etc/dovecot/plugins/dovecot-trash.conf expire: Trash 7 Spam 30 expire_dict: proxy::expire mail_log_events: delete undelete expunge copy mailbox_delete mail_log_group_events: mail_log_fields: uid box msgid size fts: squat dict: expire: sqlite:/etc/dovecot/plugins/expire.conf

1 0

[Dovecot] Managesieve
by Thomas E. Deutsch 09 Jun '09

09 Jun '09

Hi I've a problem. I've built a new mailserver for our company based on dovecot (1.1.15). At the same time, our company's name has changed. The old mail addresses are forwarded to the new addresses. But I've a problem with sieve. It looks like the sieve filters are only working for the new addresses. But due to the change of the name was not long ago, most of the mails are still sent to the old addresses. What can I do to get filters also working for the old addresses? Configuration of managesieve: protocol managesieve { listen = *:2000 login_executable = /usr/lib/dovecot/managesieve-login mail_executable = /usr/lib/dovecot/managesieve sieve = /home/vmail/%Ld/%Ln/sieve/dovecot.sieve sieve_storage = /home/vmail/%Ld/%Ln/sieve managesieve_implementation_string = Cyrus timsieved v2.2.13 # mail_debug=yes } Regards, Thomas

2 1

[Dovecot] Login processes in Dovecot
by Scott Haneda 08 Jun '09

08 Jun '09

I will be deploying Dovecot on OS X shortly. I am looking for clarification on the limits imposed by OS X and sysctl [kern.maxproc]. I understand that it is defaulting to 532, but can be raised to 2500. I believe the OS uses around 100 or so, plus I will have other processes and shells at times. Does Dovecot use one process per user logged in? I find Apple Mail uses about 4 IMAP connections per account. I am not sure that my current number of mail users would be able to be supported on OS X even if I bump up to 2500. Does Dovecot use one process per user logged in differently based on IMAP versus POP? Perhaps this is something that can also be changed in Dovecot, if so, can someone point me to the docs about it, or explain the downsides of going against default behavior. If this is the case, what are my options? Does OS X server have a higher limit in their kernel, or is this across the board? Is it even possible to compile a kernel for OS X with this change, or does that generally mess things up pretty bad? FreeBSD and Solaris seem to have much higher limits, and certainly a much more approachable way of upping those limits. Does anyone know why OS X chose to set these so low, especially given that they do sell server based hardware with a server based OS. Thanks. -- Scott * If you contact me off list replace talklists@ with scott@ *

4 9

[Dovecot] Mailbox isn't a valid mbox file
by Kenneth Porter 08 Jun '09

08 Jun '09

Getting "Mailbox isn't a valid mbox file" on 1.2rc2 after transferring mail from an ancient 0.99.13 system. The first line of the file looks ok. Curiously, it's one of my archival folders of this list. Here's the first header from the top of the file: >From tss at iki.fi Sat May 1 21:48:17 2004 From: tss at iki.fi (Timo Sirainen) Date: Sat May 1 21:54:18 2004 Subject: [Dovecot] 1.0-test2 released Message-ID: <1083437297.21296.19.camel@hurina> X-IMAPbase: 1085322222 20128 Status: RO X-UID: 14065 Content-Length: 226989 X-Keywords: It would be nice if the code that verified the mailbox format would log details about what it disliked.

3 4

Re: [Dovecot] Dovecot + FreeBSD-7.2 + ZFS ?
by Frank Bonnet 08 Jun '09

08 Jun '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello Thanks for the feedback ! I'll plan to run it at 7.2 and of course certainly not on a production server without numerous tests ! Dino Ming wrote: > Just to let you guys know, I have nightmare with FreeBSD 7.0-RELEASE + ZFS. > It brought to me an unrecoverable filesystem error. > It is a good technology. But I would wait for it to be more mature before > production. > > I would highly suggest to run a stress test if you really bring it to production > state. > > Dino. > > Frank Bonnet wrote: > Geoffroy Desvernay wrote: > >>>> Frank Bonnet a écrit : >>>> >>>>> Hello >>>>> >>>>> Anyons has tested this configuration with success ? >>>>> >>>>> I'll test it in few days and I am wondering if I am alone :-) >>>>> >>>>> >>>> Not ZFS, but various combinations of dovecot 1.1.15+FreeBSD(7.1 and >>>> 7.2)+(NFS and UFS). No problem for us® ;) >>>> >>>> > > Yes I too , just curious about ZFS > -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.11 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkos4ZIACgkQ6f7UMO5oSsXUjACeJCrMjVvQwh7sW6h5Vaw6vMqN HRQAoJR7j0jSPtxsBzntaBzZgc4JAJe1 =gVum -----END PGP SIGNATURE-----

5 7

[Dovecot] General performance of RC5
by Joan 08 Jun '09

08 Jun '09

Hi all, Switiching to RC5, there is a visible decrease in performance to access via IMAP large accounts (>1G) with mutiple mailboxes per accounts. In RC4, there was no delay visible by a human when accessing locally. Now it takes up to 4 or 5 secs. (running on OpenSuse, mysql 5.1.35 for auth, dbox as back end) Anybody experienced also this ? Thanks Joan

2 2

[Dovecot] Dovecot 1.2 + AIX setups
by Jonathan Siegle 08 Jun '09

08 Jun '09

Is anyone running Dovecot on AIX? I'm trying to debug the "Corrupted index cache file... record points outside file" problem. I can give gory details about what I've tried, but for now I would just like to see setups on AIX. Thanks, Jonathan

1 0

[Dovecot] Dovecot + FreeBSD-7.2 + ZFS ?
by Frank Bonnet 08 Jun '09

08 Jun '09

Hello Anyons has tested this configuration with success ? I'll test it in few days and I am wondering if I am alone :-) Thanks

3 3

Re: [Dovecot] Password environment variable - logging the password
by Donovan Craig 07 Jun '09

07 Jun '09

Timo Sirainen wrote: > Hmm. I guess it's possible that the password is lost by then.. Then > another possibility would be to use passdb sql + userdb prefetch and: > > password_query = SELECT .., '%w' as userdb_plain_pass, .. That did the trick. Thanks so much for your help.

1 0

Re: [Dovecot] Password environment variable - logging the password
by Donovan Craig 07 Jun '09

07 Jun '09

>> On Jun 6, 2009, at 5:19 AM, Donovan Craig wrote: >> Im using the mysql userdb, but the passwords are stored in MD5. >> I want to be able to get the password within the post login script, >> not from >> the log file. >> >> Is there any way to do this? > Timo Sirainen wrote: > user_query = SELECT '%w' as plain_pass, ... > then it should be in $PLAIN_PASS environment in post-login script. This would be great if it worked, but unfortunately this %w is empty when I try to use it. >From the documentation, it seems that this variable is only available during auth. http://wiki.dovecot.org/Variables Is there any other way I can get the plain password within the postloginscripting? Thanks again. Donovan

2 1

Re: [Dovecot] Password environment variable - logging the password
by Donovan Craig 06 Jun '09

06 Jun '09

> look at the setting: > > # In case of password mismatches, log the passwords and used scheme so the # problem can be debugged. Requires auth_debug=yes to be set. > #auth_debug_passwords = no Thanks for your replies so far. As mentioned, I¹d like to be able to log the username and password in plain text after successful login. I¹m using the mysql userdb, but the passwords are stored in MD5. I want to be able to get the password within the post login script, not from the log file. Is there any way to do this? Thanks. Donovan

2 1

[Dovecot] Multiple Dovecot instances over single mail store
by Zohan 06 Jun '09

06 Jun '09

Hi, I need to run two Dovecot instances with totally different authentication configs: first - passwordless, based on client SSL certificate; and second - regular password based (LDAP, passwd etc.). (As far as I know this cannot be achieved with single Dovecot instance; if I'm mistaken, please correct me). My intention is to give clients dual access to their mailboxes: some do own a SSL cert, others do not. I want to know whether it is possible at all. If possible, how do we implement proper concurrent access (locking, etc.) between the two instances to a single maildir-based store? I guess this should be possible since I know Dovecot can operate NFS-backed mail stores, e.g. in a load-balancing cluster setup. Second, is it OK to run the second instance in the same OS (we use Linux)? or chroot'ed or even virtualized solution will work better? Thank you! Zohan

2 1

[Dovecot] sieve/dovecot folder separator inconsistency
by Daniel Mayer 05 Jun '09

05 Jun '09

Hi, I'm running dovecot 1.0.15 and ran recently into a problem with the folder separators when using sieve scripts. The server is set to use a slash as a folder separator for all namespaces and announces this correctly when issuing the NAMESPACE command. We are using Ingo (http://www.horde.org/ingo/) of the horde framework to manage our sieve scripts. It creates the folder name / folder path to be used in the sieve scripts based on the result of the NAMESPACE given by the IMAP Server. It therefore created the path separated by slashes ("/"). According to my tests, the delivery agent along with sieve expects the folders to be separated by dots (".") instead of slashes. Is this a correct observation or can this be set using a parameter or something similar? The result of this otherwise inconsistent behavior is that a client who sticks to the provided namespace creates a folder path which cannot be understood by the deliver process. Please let me know if you need any additional information. Thanks, Daniel

3 5

[Dovecot] Dovecot under brute force attack - nice attacker
by henry ritzlmayr 05 Jun '09

05 Jun '09

Hi List, optimizing the configuration on one of our servers (which was hit by a brute force attack on dovecot) showed an odd behavior. Dovecot Version 1.0.7 (CentOS 5.2) The short story: On one of our servers an attacker did a brute force attack on dovecot (pop3). Since the attacker closed and reopened the connection after every user/password combination the logs showed many lines like this: dovecot: pop3-login: Aborted login: user=<test>,...... The problem: If the attacker wouldn't have closed and reopened the connection no log would have been generated and he/she would have endless tries. Not even an iptables/hashlimit or fail2ban would have kicked in. How to reproduce: telnet dovecot-server pop3 user test pass test1 user test pass test2 ... QUIT ->Only the last try gets logged. If I enable auth_verbose every attempt gets logged, but if I read the docs correctly this option should only be used for figuring out why authentication isn't working. Question: Is there any way to close the connection after the first wrong user/pass combination. So an attacker would be forced to reopen it? This would be perfect since an easy iptables/hashlimit would avoid such a brute force attack. Any other Ideas? Henry

8 21

[Dovecot] v1.2.rc5 released
by Timo Sirainen 05 Jun '09

05 Jun '09

http://dovecot.org/releases/1.2/rc/dovecot-1.2.rc5.tar.gz http://dovecot.org/releases/1.2/rc/dovecot-1.2.rc5.tar.gz.sig Some small fixes mainly. I guess I'll still have to release rc6 and rc7 after all. I've been a bit busy with v2.0 changes recently. BTW. I'm leaving tomorrow to San Francisco and I'm going to check out what's happening in Apple WWDC next week. * auth_cache_negative_ttl is now used also for password mismatches (currently only with plaintext authentication mechanisms). + Added support for EXTERNAL SASL mechanism. + FETCH X-SAVEDATE can now be used to get messages' save timestamps + deliver_log_format: %s is now in UTF8 - If message body started with a space, some operations could have assert-crashed. - Fixed using LDAP support as a plugin - Fixes to virtual mailboxes.

2 2

[Dovecot] ldap_search() failed "Server Busy"
by Paul Carter-Brown 05 Jun '09

05 Jun '09

Hi, We are using dovecot 1.1.11 on Solaris 10u6. Under load, we are experiencing the following errors: Jun 4 18:30:59 ug1s02-zone1 dovecot: [ID 107833 mail.error] auth(default): ldap(0202934816(a)ug.smilecoms.com,10.31.3.13): ldap_search() failed (filter (uid=0202934816(a)ug.smilecoms.com)) Server is busy We are authenticating against sun directory server yet see no errors in the directory server and it seems to be under low load. Any ideas if there is something on dovecot we should tune to erradicate this? We are running a web front end on top of dovecot and hence have a lot of login/logout happening as the user navigates around. I have included our config below: dovecot.conf: base_dir = /opt/csw/var/run/dovecot/ protocols = imap pop3 listen = * disable_plaintext_auth = no shutdown_clients = yes log_timestamp = "%b %d %H:%M:%S " syslog_facility = mail ssl_listen = ssl_disable = yes login_dir = /opt/csw/var/run/dovecot/login login_chroot = yes login_user = dovecot login_process_size = 128 login_process_per_connection = no login_processes_count = 3 login_max_processes_count = 128 login_max_connections = 256 login_greeting = Dovecot ready. login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c login_log_format = %$: %s mail_location = maildir:/sapool1/mail/%3n/%3.3n/%6.3n/%u mail_full_filesystem_access = yes mail_debug = no fsync_disable = yes first_valid_uid = 101 mail_save_crlf = yes mbox_dirty_syncs = yes protocol imap { login_executable = /opt/csw/libexec/dovecot/imap-login mail_executable = /opt/csw/libexec/dovecot/imap login_greeting_capability = no imap_client_workarounds = outlook-idle } protocol pop3 { login_executable = /opt/csw/libexec/dovecot/pop3-login mail_executable = /opt/csw/libexec/dovecot/pop3 pop3_no_flag_updates = no pop3_enable_last = no pop3_reuse_xuidl = no pop3_lock_session = no pop3_uidl_format = %v-%u pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s } protocol lda { postmaster_address = postmaster(a)example.com hostname = sol10-dev.dutoit.net } auth_anonymous_username = anonymous auth_verbose = no auth_debug = no auth_debug_passwords = no auth_worker_max_count = 30 auth default { mechanisms = plain passdb ldap { args = /opt/csw/etc/dovecot-ldap.conf } userdb static { args = uid=exim gid=mail home=/sapool1/mail/%u } user = root count = 1 ssl_require_client_cert = no ssl_username_from_cert = no socket listen { master { path = /opt/csw/var/run/dovecot/auth-master mode = 0600 user = root group = root } } } dict { } plugin { } dovecot-ldap.conf: hosts = ldap1.it.ug.smilecoms.com:389 dn = cn=Directory Manager dnpass = blahblah sasl_bind = no tls = no ldap_version = 3 base = dc=smilecoms,dc=com deref = never scope = subtree user_filter = (uid=%u) pass_attrs = uid=user,PIN=password pass_filter = (uid=%u) default_pass_scheme = PLAIN Thanks so much! Paul

2 3

[Dovecot] Under POP attack - now to prevent?
by James Brown 05 Jun '09

05 Jun '09

Looks like we are under a dictionary login attack on our POP server: Jun 5 11:48:20 mail dovecot[2620]: pop3-login: Aborted login (auth failed, 1 attempts): user=<audrey>, method=PLAIN, rip=85.189.169.94, lip=192.168.1.9 Jun 5 11:48:24 mail dovecot[2620]: pop3-login: Aborted login (auth failed, 1 attempts): user=<august>, method=PLAIN, rip=85.189.169.94, lip=192.168.1.9 Jun 5 11:48:24 mail dovecot[2620]: pop3-login: Aborted login (auth failed, 1 attempts): user=<autumn>, method=PLAIN, rip=85.189.169.94, lip=192.168.1.9 Jun 5 11:48:25 mail dovecot[2620]: pop3-login: Aborted login (auth failed, 1 attempts): user=<austin>, method=PLAIN, rip=85.189.169.94, lip=192.168.1.9 Jun 5 11:48:27 mail dovecot[2620]: pop3-login: Aborted login (auth failed, 1 attempts): user=<audrey>, method=PLAIN, rip=85.189.169.94, lip=192.168.1.9 Jun 5 11:48:28 mail dovecot[2620]: pop3-login: Aborted login (auth failed, 1 attempts): user=<autumn>, method=PLAIN, rip=85.189.169.94, lip=192.168.1.9 Jun 5 11:48:30 mail dovecot[2620]: pop3-login: Aborted login (auth failed, 1 attempts): user=<august>, method=PLAIN, rip=85.189.169.94, lip=192.168.1.9 Jun 5 11:48:31 mail dovecot[2620]: pop3-login: Aborted login (auth failed, 1 attempts): user=<autumn>, method=PLAIN, rip=85.189.169.94, lip=192.168.1.9 Jun 5 11:48:31 mail dovecot[2620]: pop3-login: Aborted login (auth failed, 1 attempts): user=<austin>, method=PLAIN, rip=85.189.169.94, lip=192.168.1.9 Jun 5 11:48:32 mail dovecot[2620]: pop3-login: Aborted login (auth failed, 1 attempts): user=<atlanta>, method=PLAIN, rip=85.189.169.94, lip=192.168.1.9 Any suggestions on how to prevent this? Using Dovecot 1.2RC4 Thanks, James.

5 5

[Dovecot] feature request - zlib compression via LDA
by J.P. Trosclair 05 Jun '09

05 Jun '09

Any chance of getting compression support via the zlib plugin for dovecot deliver in future versions?

2 4

[Dovecot] imapmagicplus equivalent?
by Juergen Kreileder 04 Jun '09

04 Jun '09

Hi, is anything like Cyrus IMAP's imapmagicplus option available for Dovecot? If not, would it be possible to implement as a plugin? > imapmagicplus: 0 > Only list a restricted set of mailboxes via IMAP by using userid+namespace syntax as the authentication/authorization id. Using userid+ (with an empty namespace) will list only subscribed mailboxes. It's a quite useful option for clients that don't understand subscriptions. E.g., I don't want to see all of my folders on my iPhone, by using userid+ I can limit them to a useful set. Juergen

2 1

[Dovecot] deleteing label (cheating crackers)
by Mohsen Pahlevanzadeh 04 Jun '09

04 Jun '09

Dear all, When i telnet to my server, I see following things: [root@daka ~]# telnet 0 110 Trying 0.0.0.0... Connected to 0. Escape character is '^]'. +OK Dovecot ready. Now i want to delete Dovecot word & put my word. How i do? Yours, Mohsen

3 2

[Dovecot] Password environment variable - logging the password
by Donovan Craig 04 Jun '09

04 Jun '09

Hi, We¹re migrating to a Cpanel hosting system. Our passwords are currently stored in MD5. I looked at the post login scripting to be able to start storing the plain text passwords as people login temporarily so we can automate our migration. It seems that the password is not available in the post login environment variables. Is there any way we can get access to the plain text password upon login so we can insert this into our user table? Best regards, Donovan

3 2

[Dovecot] Some questions about deliver
by Axel Luttgens 04 Jun '09

04 Jun '09

While investigating Dovecot's deliver with Postfix, I encountered some behaviors making me wonder whether I really understand the purpose of that binary. So, if you allow... This is from Postfix' main.cf: mailbox_command = /usr/local/dovecot/libexec/dovecot/deliver -e -n This is my quick setup for Dovecot: # 1.2.rc4: /usr/local/etc/dovecot.conf # OS: Darwin 9.7.0 i386 protocols: pop3 ssl: no disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/dovecot-1.2.rc4/libexec/dovecot/pop3- login first_valid_uid: 2001 mail_location: mbox:~/_mailboxes:INBOX=~/_inbox/mailspool mbox_read_locks: flock mbox_write_locks: flock dotlock mail_executable: /usr/local/dovecot-1.2.rc4/libexec/dovecot/pop3 mail_plugin_dir: /usr/local/dovecot-1.2.rc4/lib/dovecot/pop3 pop3_lock_session: yes pop3_uidl_format: %08Xv%08Xu auth default: passdb: driver: pam args: * userdb: driver: passwd Here is an excerpt from mail.log: postfix/smtpd[4117]: connect from localhost[127.0.0.1] postfix/smtpd[4117]: 163E1CA2675: client=localhost[127.0.0.1] postfix/cleanup[4120]: 163E1CA2675: message-id=<27002A3F-AF44-410D-A500-368D04F5FA9A(a)almbp.local > postfix/qmgr[3232]: 163E1CA2675: from=<testuser(a)almbp.local>, size=2650, nrcpt=1 (queue active) dovecot[4129]: deliver(www): mail_location: mbox: mkdir(/Library/ WebServer/_mailboxes) failed: Permission denied (euid=70(_www) egid=70(_www) missing +w perm: /Library/WebServer) dovecot[4129]: deliver(www): Fatal: Namespace initialization failed postfix/local[4122]: 163E1CA2675: to=<www(a)almbp.local>, relay=local, delay=0.09, delays=0.02/0/0/0.07, dsn=4.3.0, status=deferred (temporary failure) postfix/smtpd[4117]: disconnect from localhost[127.0.0.1] 1. Shouldn't deliver honor the first_valid_uid setting? After all, if some user isn't allowed to login, is that user supposed to receive mail? 2. What exactly is the -e option supposed to do? User _www clearly isn't configured for receiving mail, but Postfix will nevertheless try to deliver the message until maximal_queue_lifetime has expired. From the log excerpt, it appears that Postfix has been led to consider a temporary failure; unless I'm wrong, that's because Postfix didn't receive neither a "D.S.N text" string nor an EX_* fatal return code. From deliver.c, it seems that many calls to i_fatal() are liable to be executed before the -e option is taken into account (through the local variable stderr_rejection). As a result, I'm wondering under which circumstances exactly deliver is liable to return EX_NOPERM, so that Postfix may consider a permanent failure and bounce the message. Note that the question may somehow be re-phrased as: when invoked without the -e option, under which circumstances will deliver send a rejection message? 3. Doesn't failure_exit_callback() in deliver.c tend to merge many (possibly dissimilar) errors into the single EX_TEMPFAIL one? And BTW, is that function guaranteed to be always called with an EX_* value? Seems to be the case, but... ;-) TIA for your patience, Axel

2 5

[Dovecot] Maildir compression utility
by John Fawcett 04 Jun '09

04 Jun '09

Does anyone know of a script to compress old mails stored in a maildir format by carrying out the steps described at http://wiki.dovecot.org/Plugins/Zlib thanks, John

2 2

[Dovecot] Lost sub-mailboxes - not showing after upgrading to Dovecot from Courier-IMAP
by James Brown 04 Jun '09

04 Jun '09

Last night we migrated from Courier-IMAP to Dovecot 1.2RC5 and all seems to work fairly well, but I seem to have lost all my mailboxes apart from INBOX. The maildirs are all on the HD in the correct place (/usr/local/virtual/bordo.com.au/jlbrown): mail:jlbrown root# ls -l total 21400 drwxrwxr-x 13 _vmail _postfix 442 Jun 4 00:11 .4D drwxrwxr-x 14 _vmail _postfix 476 Jun 4 00:06 .ASSP drwxrwxr-x 13 _vmail _postfix 442 Jun 4 00:06 .ATO drwxrwxr-x 12 _vmail _postfix 408 Jun 4 00:06 .Actionable drwxrwxr-x 11 _vmail _postfix 374 Jun 3 23:56 .Apple Mail To Do drwxrwxr-x 13 _vmail _postfix 442 Jun 4 00:12 .ClamAV drwxrwxr-x 10 _vmail _postfix 340 Jun 3 08:28 .Deleted Messages drwxrwxr-x 13 _vmail _postfix 442 Jun 4 00:11 .Drafts drwxrwxr-x 13 _vmail _postfix 442 Jun 4 00:11 .Expenses drwxrwxr-x 12 _vmail _postfix 408 Jun 4 00:06 .Follow Up drwxrwxr-x 10 _vmail _postfix 340 Jun 4 09:11 .INBOX.INBOX.Drafts drwxrwxr-x 9 _vmail _postfix 306 Jun 4 09:11 .INBOX.INBOX.Sent drwxrwxr-x 10 _vmail _postfix 340 Jun 4 09:11 .INBOX.INBOX.Trash drwxrwxr-x 10 _vmail _postfix 340 Jun 4 09:04 .INBOX.Trash drwxrwxr-x 14 _vmail _postfix 476 Jun 4 00:12 .Iain drwxrwxr-x 13 _vmail _postfix 442 Jun 4 00:06 .Jokes drwxrwxr-x 15 _vmail _postfix 510 Jun 4 00:06 .Junk drwxrwxr-x 13 _vmail _postfix 442 Jun 4 00:06 .Nessus drwxrwxr-x 13 _vmail _postfix 442 Jun 4 00:11 .Postfix drwxrwxr-x 14 _vmail _postfix 476 Jun 4 00:11 .Sapphire drwxrwxr-x 15 _vmail _postfix 510 Jun 4 00:08 .Sent drwxrwxr-x 10 _vmail _postfix 340 Jun 3 16:15 .Sent Messages drwxrwxr-x 8 _vmail _postfix 272 May 26 10:28 .ToDos.mbox (Dovecot) drwxrwxr-x 11 _vmail _postfix 374 Jun 3 23:58 .ToDos.mbox (IMAP Account) drwxrwxr-x 11 _vmail _postfix 374 Jun 3 23:58 .ToDos.mbox (jlbrown IMAP) drwxrwxr-x 13 _vmail _postfix 442 Jun 4 00:11 .Trash drwxrwxr-x 3 _vmail _postfix 102 Jun 3 23:58 courierimaphieracl drwxrwxr-x 3 _vmail _postfix 102 Jun 3 23:58 courierimapkeywords -rw-r--r-- 1 _vmail _postfix 290 Dec 16 14:51 courierimapsubscribed -rw-r--r-- 1 _vmail _postfix 394010 Jun 3 17:46 courierimapuiddb -rw-r--r-- 1 _vmail _postfix 513065 May 25 17:04 courierpop3dsizelist drwxrwxr-x 6933 _vmail _postfix 235722 Jun 4 09:09 cur -rwxrwxr-x 1 _vmail _postfix 34 May 26 10:17 dovecot-keywords -rw-rw-r-- 1 _vmail _postfix 537661 Jun 4 09:07 dovecot-uidlist -rwxrwxr-x 1 _vmail _postfix 8 Jun 4 09:09 dovecot- uidvalidity -rwxrwxr-x 1 _vmail _postfix 0 May 26 09:55 dovecot- uidvalidity.4a1b2fff -rw-rw-r-- 1 _vmail _postfix 111504 Jun 4 09:04 dovecot.index -rwxrwxr-x 1 _vmail _postfix 9335808 Jun 4 09:09 dovecot.index.cache -rw-rw-rw- 1 _vmail _postfix 30724 Jun 4 09:11 dovecot.index.log drwxrwxr-x 2 _vmail _postfix 68 Jun 4 09:07 new -rw-rw-r-- 1 _vmail _postfix 118 Jun 4 09:09 subscriptions drwxrwxr-x 3 _vmail _postfix 102 Jun 4 09:07 tmp Any idea how to get them back? Same with my Sent emails - only the emails sent since switching to Dovecot are there. Thanks, James.

4 3

[Dovecot] Help please- Post - Login Script--- Migration
by Ashraf 04 Jun '09

04 Jun '09

Hi all I am in the process of migrating Courier to Dovecot, am using courier-dovecot-migrate.pl<http://www.dovecot.org/tools/courier-dovecot-migrate.pl>it works fine. I want to migrate each user as they login using post-login script (As i have huge no of users). We are using NFS storage, users are authenticated using mysql, User home directories as passed using variable mail ( usign mysql query). I am trying to execute postlogin script which does the conversion but unable to pass the user home directories . --*/etc/dovecot.conf mail_executable = /usr/libexec/dovecot/postloginscript.sh %h ---* %h ---- for home directory. ---*postloginscript.sh #!/bin/sh /usr/libexec/dovecot/courier-dovecot-migrate.pl --quiet --to-dovecot --recursive --convert $1 # This is for pop3 exec /usr/libexec/dovecot/pop3 ----* When i pass %h as argument its creating "%h" directory and writing dovecot-uidlist and rest the files in %h directory. Its not interpreting the %h and not passing the home directory. Its just passing as it is. Hope i am clear in articulating my problem. Please help. -- Regards Ash

2 7

[Dovecot] system accepts my domains without point
by Esteban Torres Rodriguez 03 Jun '09

03 Jun '09

I have postfix+ dovecot + ldap (AD). my system accepts user@domain as user@domain. as user(a)domain.com. To send as much to create the mailbox when I login to squirrelmail, for example. Problem is postfix, dovecot or from AD? Someone can help me? -- ################################################## # Esteban Torres Rodríguez # # Área de Soporte Técnico # # Subdirección de Sistemas Informáticos # # Empresa Pública Desarrollo Agrario y Pesquero # # email: etorres(a)dap.es # ##################################################

2 1

Re: [Dovecot] expire tool - individual user/folder?
by Andre Hübner 03 Jun '09

03 Jun '09

Hello, > The patch shouldn't really have changed anything. > >> in 1.1.16 it works without the patch. > > And I didn't fix anything in 1.1.16 either. Maybe it was some weird > compiling issue or something.. i do not have an explanation, but effect is the same. i repackaged 1.1.15 with and without patch and only the one with the patch works. for 1.1.16 i do not need a patch. gcc is 4.1.2 but its not important for me, just some tests... Andre

1 0

[Dovecot] 1.2.beta1: expire-tool and 'mail_location' setting
by e-frog 03 Jun '09

03 Jun '09

Hi Timo, Trying 1.2.beta1 with expire plugin currently: When I set mail_location = maildir:~/.maildir the expire plugin doesn't delete messages. #: expire-tool --test Info: auth input: system_user=foo Info: auth input: uid=1000 Info: auth input: gid=1000 Info: auth input: home=/home/foo Info: foo/Trash: no messages left I also noticed that above command creates a new but empty directory 'mail' in user's home dir. However using mail_location = maildir:~/Maildir and of course moving the messages to it works. #: expire-tool --test Info: auth input: system_user=foo Info: auth input: uid=1000 Info: auth input: gid=1000 Info: auth input: home=/home/foo Info: foo/Trash: seq=1 uid=4078: Expunge . . Info: foo/Trash: seq=100 uid=4178: Expunge Info: foo/Trash: seq=101 uid=4179: Expunge Info: foo/Trash: timestamp 1235292536 -> 1235325429 My guess is that mail_location is not respected by expire-tool for some reason and in second case mailbox auto-detection makes it working? Thanks, e-frog ---------------------------------------------------------------------------------------------- #: dovecot -n # 1.2.beta1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.27-11-server i686 Ubuntu 8.10 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap managesieve disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_privileged_group: mail mail_location: maildir:~/.maildir mail_debug: yes mail_drop_priv_before_exec: yes mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): quota imap_quota expire fts fts_squat mail_plugins(imap): quota imap_quota expire fts fts_squat mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve auth default: passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 user: dovecot group: Debian-exim master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: maildir quota_rule: *:storage=1GB quota_rule2: Trash:storage=10%% expire: Trash 1 expire_dict: proxy::expiredict sieve: ~/.dovecot.sieve sieve_dir: ~/.sieve fts: squat fts_squat: partial=4 full=10 dict: expiredict: mysql:/etc/dovecot/dovecot-dict-sql.conf

2 9

[Dovecot] expire tool - individual user/folder?
by Andre Hübner 02 Jun '09

02 Jun '09

Hello, is the expire plugin usable to delete mails with different settings for each individual user? If i view sample config at http://wiki.dovecot.org/Plugins/Expire it looks like expire-data are related to foldernames. Is it possible to let each user "activate" the expire-plugin for different folders with different settings? Thanks, Andre

2 11

[Dovecot] Running imaptest revision 209:939fa886391a built against dovecot revision 9116:9ae55b68cf61 on AIX 5.3 core dumps
by Jonathan Siegle 02 Jun '09

02 Jun '09

# ./imaptest host=127.0.0.1 port=143 user=tstem38 pass=pass4you mbox=/ gpfs/users/t/s/tstem38/IMAP/foo4 Panic: file client.c: line 620: assertion failed: (idx >= array_count(&clients) == NULL) IOT/Abort trap(coredump)

3 3

Re: [Dovecot] Missing IMAP folders after Server reboot
by punit_j 02 Jun '09

02 Jun '09

Did you try looking for the folders by connecting to IMAP using command line. telnet servername 143 a1 login username pass a2 list "" * Check if you could see anything.

3 2

[Dovecot] v1.1.16 released
by Timo Sirainen 02 Jun '09

02 Jun '09

http://dovecot.org/releases/1.1/dovecot-1.1.16.tar.gz http://dovecot.org/releases/1.1/dovecot-1.1.16.tar.gz.sig Fixes a couple of bugs in v1.1.15's changes. Hopefully the last v1.1 release before v1.2.0. - v1.1.15 could have crashed if mailbox-closing command was pipelined after a mailbox-accessing command. - v1.1.15's zlib plugin may have caused crashes when fetching INTERNALDATE. - Maildir: If messages had been deleted externally from new/ directory and mailbox was opened with EXAMINE, Dovecot didn't immediately notice that the messages were deleted. - If message body started with a space, some operations could have assert-crashed.

3 3

[Dovecot] Log filenames of saved files to inbox by dovecot-deliver
by Sven Eulberg 02 Jun '09

02 Jun '09

Hello, Is it possible to log the filenames into deliver.log where dovecot- deliver saved incoming emails? If not so, please add this as a feature request. Thanks in advance! Regards, Sven

2 1

[Dovecot] recipient delimiter and lmtp
by John Fawcett 02 Jun '09

02 Jun '09

I read in the list archives about work in progress on an lmtp delivery agent.As a previous cyrus user where that was the preferred delivery method from postfix, this sounds interesting. I was wondering whether it will handle recipient delimiters. ie will it be able to map user+foo(a)example.com to user(a)example.com? I'm not interested in the delivery into folder stuff, just the plain delivery to inbox. thanks, John

6 10

[Dovecot] IMAP labeling sometimes not taken into account
by Olivier Cailloux 02 Jun '09

02 Jun '09

Dear Dovecot list, I recently switched from uw-imapd to dovecot to manage my huge mbox files (about 1 GB). I now observe a very strange behavior, difficult to reproduce reliably, which might be related to some misunderstanding on my part on how either dovecot works or imap labeling works. What I call "labeling" is the fact of marking some e-mail, in my e-mail client (currently Thunderbird), with a label, which can be chosen among five labels (plus the "no-label" case). Evolution also supports labeling. As far as I understood until a few days ago, when I put a label, say, number five, on an e-mail, a keyword "$Label5" is added on the "X-Keywords:" line of the corresponding e-mail in my mbox file. Removing the label simply removes the keyword on the same line. That is, at least, what happened with uw-imapd (not that I have seen that documented somewhere but this is what I observed). The label is thus stored on the e-mail server, not on the client hard disk, which is important for me as I extensively use that feature to sort e-mails, and need to access them from several different places (and find the same labels at the same places, naturally, whatever client I use). Since the change for dovecot, however, things are going strange. Sometimes the labels disappear for some reasons. Sometimes they stay there. And I can't reproduce the behavior, it just seems random. This is very annoying as it totally breaks my e-mail management. Currently there is something strange I can reproduce however, and if someone could explain me what is happening I guess it would be a good step towards a solution. I see a specific e-mail as being labeled in thunderbird, having label number five. I also tried with evolution, accessing the same imap folder, evolution also sees that e-mail as having a label number five. I tried running these clients from my imap server, and I tried thunderbird on a Windows box at home, and every clients agree: this e-mail has a "5" label. BUT when I open the mbox file directly on the imap server (using "less"), and scroll to that given e-mail, I see NO "X-Keywords: " line. How then can the e-mail clients know that this e-mail is labeled? Please note that this behavior does not happen with only one specific e-mail, but I take it as an example of what is strange. In fact I can see, especially at the end of the mbox file (thus the latest e-mails), that plenty of e-mails have either no "X-Keywords: " line or a line with "X-Keywords: " and nothing else, whereas they are seen as being labeled (and indeed I remember having labeled most of those through thunderbird). The former e-mails I checked in the m-box (for example, one month ago) all correctly have an X-Keywords line indicating "$Label5" or other appropriate labels. It seems like dovecot is keeping some track of labeled e-mails somewhere which is NOT in the mbox file, probably related to its indexing capabilities. But I don't know how that works and where these index files are stored, how to purge them and rebuild the index, and so on. Apparently these index files have remembered some e-mails as being labeled (which is good, because I indeed labeled them). But I'd like to know how that works to be able to better troubleshoot why sometimes the label disappear. Note that restarting dovecot does not change the label status of the e-mail, so the status must be stored somewhere on disk and not only in memory. Or is all these labeling stuff some unsupported, non-standard extension to IMAP that only uw-imapd supports? (I hope not because I find it very practical and I'd like to use it with dovecot as well!) Thank you for any help. (Technical informations follow.) Olivier ------ 2-12h38-~#dovecot --version 1.0.15 ------ 2-12h38-~#dovecot -n # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S ssl_cert_file: /etc/ssl/certs/imapd.pem ssl_key_file: /etc/ssl/private/imapd.pem login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail auth default: passdb: driver: pam userdb: driver: passwd ------

2 2

[Dovecot] Capability problems dovecot 2.0
by ja nein 01 Jun '09

01 Jun '09

Hi, I had some problems connecting TB 2.x with dovecot 2.0. TB2 complained about not being an IMAP4 server. TB 3 worked. It seems that dovecot 2.0 doesn't return capabilities when queried. Maybe some wrong config, thoug? Here are the debug logs from TB2 comparing dovecot 2.0 (not working) and dovecot 1.2 (working): Dovecot 2.0: NA:CreateNewLineFromSocket: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. NA:SendData: 1 capability ReadNextLine [stream=26c2d60 nb=15 needmore=0] NA:CreateNewLineFromSocket: * CAPABILITY ReadNextLine [stream=26c2d60 nb=28 needmore=0] NA:CreateNewLineFromSocket: 1 OK Capability completed. ProcessCurrentURL: aborting queued urls NA:SendData: 2 logout Dovecot 1.2: NA:CreateNewLineFromSocket: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. NA:SendData: 1 capability ReadNextLine [stream=27dcf50 nb=303 needmore=0] NA:CreateNewLineFromSocket: * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH QUOTA AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5 ReadNextLine [stream=27dcf50 nb=28 needmore=0] NA:CreateNewLineFromSocket: 1 OK Capability completed. NA:SendData: 2 authenticate plain ReadNextLine [stream=27dcf50 nb=4 needmore=0] NA:CreateNewLineFromSocket: + NA:SendData: Logging suppressed for this command (it probably contained authentication information) ReadNextLine [stream=27dcf50 nb=266 needmore=0] NA:CreateNewLineFromSocket: 2 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH QUOTA] Logged in A:SendData: 3 namespace And all goes well... TB3 seems to be fine without extra capability stuff. Regards, Sebastian

5 20

[Dovecot] For the record: Postfix+Spamassassin+ClamAV+Dovecot
by James Butler 01 Jun '09

01 Jun '09

Postfix 2.5.5 SpamAssassin 3.2.5 (under Perl 5.10.0) ClamAV 0.95.1 Dovecot 1.2.rc2 works fine on Fedora 10. Installed Dovecot and ClamAV from source and everything else using yum. I'm using the ClamAV plugin for Spamassassin: http://wiki.apache.org/spamassassin/ClamAVPlugin I'm calling Spamassassin with: /etc/postfix/main.cf: mailbox_command = /usr/bin/spamc -f -e /usr/local/libexec/dovecot/deliver Postfix hands off to Spamassassin, which processes ALL mail (not just attachments) through the ClamAV plugin before parsing for spam, and then hands the whole mess off to Dovecot for 'deliver' to handle. How simple is that? Since ClamAV scanns all mail, it might be too processor-intensive for really large mail systems, but it is working great for our 120+ user system with lots of spam coming in. If you're using Procmail or some other preprocessor that can hand off to a pipe, then you could skip the plugin and pipe messages over a certain size (i.e. >1024) to clamd, instead. Enjoy! James

4 3

[Dovecot] uid fetch error with revision 9112:9d634c93d28a
by Jonathan Siegle 01 Jun '09

01 Jun '09

This command fails: 2 uid fetch somevaliduid (BODYSTRUCTURE BODY.PEEK[]) 2 BAD Error in IMAP command UID: Unknown command BODYSTRUCTURE Thanks, Jonathan

2 8

[Dovecot] Namespace delimiter...
by Lenthir 01 Jun '09

01 Jun '09

As RFC3501 (IMAP) say: 'A NIL hierarchy delimiter means that no hierarchy exists; the name is a "flat" name.' How to change delimiter to NIL? We have flat namespaces in our storage. Now I hardcoded this and everything is working, but maybe it is another possibility... -- Konrad

2 6

[Dovecot] namespace problem with dovecot 2.0
by reg9009 01 Jun '09

01 Jun '09

Hi all, I've got some namespace problems with dovecot 2.0 again. If I start dovecot 2.0 with same settings of namespace and maildir layout as dovecot 1.2, I don't see my folders above the Inbox. I see them as "INBOX/xxx" in the same root level as my INBOX. If I try to subscribe to the folders, I see them as "INBOX^xxx" (and cannot subscribe). My namespace settings: namespace private { separator = / prefix = "INBOX/" inbox = yes #hidden = yes list = yes subscriptions = yes } I tried nearly every separator/combination, but it won't work. Any ideas (to get it work like dovecot 1.2)? I've got no shared folders/namespaces, etc. Layout is plain Maildir. Regards, Sebastian

2 6

[Dovecot] Connection queue full on dovecot 1.1.14 and 1.1.15
by Sven Eulberg 01 Jun '09

01 Jun '09

Hello, sometimes we get the following errors on out dovecot proxies: dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS dovecot: May 27 20:06:11 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> TLS dovecot: May 27 20:06:12 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> TLS dovecot: May 27 20:06:15 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> dovecot: May 27 20:09:36 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS dovecot: May 27 20:09:36 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> dovecot: May 27 20:09:36 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:09:36 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:09:36 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:11:18 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS dovecot: May 27 20:11:18 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> TLS dovecot: May 27 20:39:22 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:39:22 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> TLS dovecot: May 27 20:39:23 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> Our config: ./dovecot -n # 1.1.15: /usr/local/dovecot-1.1.15/etc/dovecot.conf # OS: Linux 2.6.18-6-686 i686 Debian 4.0 base_dir: /usr/local/dovecot/var/run/dovecot/ log_path: /var/log/dovecot-1.1.log protocols: pop3 pop3s imap imaps ssl_ca_file: /usr/local/dovecot/etc/ssl/de.TR_CRT ssl_cert_file: /usr/local/dovecot/etc/ssl/de.CRT ssl_key_file: /usr/local/dovecot/etc/ssl/de.PKEY disable_plaintext_auth: no login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable(default): /usr/local/dovecot-1.1.15/libexec/dovecot/ imap-login login_executable(imap): /usr/local/dovecot-1.1.15/libexec/dovecot/imap- login login_executable(pop3): /usr/local/dovecot-1.1.15/libexec/dovecot/pop3- login login_log_format_elements: user=<%u> method=%m REMOTE=%r LOCAL=%l %c login_process_per_connection: no login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_processes_count: 10 login_max_processes_count: 256 verbose_proctitle: yes mail_location: maildir:/home/email/%u/Maildir mailbox_idle_check_interval: 60 mmap_disable: yes fsync_disable: yes mail_executable(default): /usr/local/dovecot-1.1.15/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot-1.1.15/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot-1.1.15/libexec/dovecot/pop3 mail_process_size: 512 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/dovecot-1.1.15/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot-1.1.15/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot-1.1.15/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape- eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_lock_session(default): no pop3_lock_session(imap): no pop3_lock_session(pop3): yes pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %v.%u pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login cache_size: 1024 cache_ttl: 28800 failure_delay: 3 passdb: driver: sql args: /usr/local/dovecot/etc/dovecot-mysql.conf It seems to me the error occurs more often after increasing login_processes_count. This errors exists with version 1.1.14 and 1.1.15 and I guess also in earlier versions. Thanks in advance! Best regards, Sven

2 2

[Dovecot] Feature Missing OUTBOX Folder
by Frank Doege 01 Jun '09

01 Jun '09

Hi Dovecot People, i have switched my system from courier-imap to dovecot and iam quite happy with it, the performance is well and i had nearly no problems. One little feature iam missing is in Courier i had a folder called "Outbox" there i could paste mails which i want to sent out. In some networks its not always available to sent mails via port 21, i know i could just set up my email server to another port but it was a nice feature. Is this a big afford or is it just alittle hack ? could it done via a little plugin ? Thanks Timo & all others for the great work ! Frank

5 7

[Dovecot] imap cann't read the mail that foxmail send
by wallace0615 01 Jun '09

01 Jun '09

Hi everyone: I use dovecot only as the imap server, For smtp and pop3, I use apache james. The dovecot version: 1.1.14 And the configuration is : protocols: imap ssl_disable: yes login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: mbox:/usr/local/edupass/mail/repo/%u:INBOX=/usr/local/edupass/mail/%u auth default: passdb: driver: sql args: /etc/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot-sql.conf I have no porblems to login. When I use "telent host 25" to send a email, dovecot read it no problems. But when I use outlook and foxmail to send a email, dovecot cann't read the email data. I compared the data that using the two way to send, and found the reason: use outlook and foxmail: at the beginning of the eamil data is "From zxjteacher_SP_LZU <zxjteacher_SP_LZU@myserver>"; and if I telnet host 25 to send the mail: at the beginning of the eamil data is "From <zxjteacher_SP_LZU@myserver>", so I delete "zxjteacher_SP_LZU", dovecot read it out. "zxjteacher_SP_LZU" is because that outlook and foxmail need an account name to represent the eamil address. So, anyone ever confront with this situation? Any helps appreciate. Thx.

3 2

[Dovecot] Expire Plug-in stopped
by Matt Rude 01 Jun '09

01 Jun '09

Good evening, While working with Dovecot 1.2rc4 on Fedora 10, I have been trying to get the Expire plug-in to auto delete messages for us. When I run the plug-in with the test flag, I receive the following message: /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire-tool --test Info: amy(a)example.com/Trash: stop, expire time in future: 1242953758 All messages were deleted before the expire plug-in was added. I understand that dovecot will only expire messages after they have been in the trash or junk longer then the time in dovecot.conf. So I have let this fail since Monday, but continue to receive the same error. A quick grep for expire from my Dovecot logs doesn't show any output. Also, when I look up this error on google, I see other peaple who's output shows a real date (not 1242953758), how do I know when this date is? Thanks -Matt # 1.2.rc4: /usr/local/etc/dovecot.conf # OS: Linux 2.6.27.21-170.2.56.fc10.i686 i686 Fedora release 10 (Cambridge) ext3 listen: *:143 ssl_listen: *:993 ssl_cert_file: /etc/postfix/SSL/mail.mattrude.com.cert ssl_key_file: /etc/postfix/SSL/mail.mattrude.com.key login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_user: postfix mail_location: maildir:/var/spool/virtualmailboxes/%d/%u/:INDEX=/var/spool/virtualmailboxes/.Index/%d/%u/ mail_plugins: autocreate expire quota imap_quota zlib trash auth default: mechanisms: plain login cram-md5 cache_size: 128 cache_ttl: 600 passdb: driver: sql args: /etc/dovecot-mysql.conf userdb: driver: sql args: /etc/dovecot-mysql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: virtualmail group: virtualmail plugin: autocreate: Drafts autocreate2: Sent autocreate3: Trash autocreate4: Junk autocreate5: Junk.IsSpam autocreate6: Junk.IsNotSpam autocreate7: Save autosubscribe: Drafts autosubscribe2: Sent autosubscribe3: Trash autosubscribe4: Junk autosubscribe5: Junk.IsSpam autosubscribe6: Junk.IsNotSpam autosubscribe7: Save auth_socket_path: /var/run/dovecot/auth-master expire: Trash 1 Junk 3 expire_dict: proxy::expire quota: maildir:User quota quota_rule: *:storage=10M quota_rule2: Trash:storage=10%% quota_rule3: Junk:storage=20%% sieve: /var/spool/virtualmailboxes/%d/%u/dovecot.sieve sieve_storage: = /var/spool/virtualmailboxes/%d/%u/ trash: /etc/dovecot-trash.conf dict: expire: db:/var/spool/imap/expire.db

2 1

[Dovecot] Assertion failure in maildir-mail.c for gzipped maildir files in 1.1.15
by David S. Madole 01 Jun '09

01 Jun '09

I attempted an upgrade from 1.1.7 to 1.1.15 and encountered an apparent regression in handling gzipped maildir files. I have tried to narrow down the conditions under which it happens and reproduce it with as simple a case as possible. The actual mail application that exposed this problem is Squirrelmail. Starting off with the index files removed from the "Folder" maildir directory: * OK Dovecot ready. 1 login x y 1 OK Logged in. 2 select Folder * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 13 EXISTS * 0 RECENT * OK [UIDVALIDITY 1220278111] UIDs valid * OK [UIDNEXT 14] Predicted next UID 2 OK [READ-WRITE] Select completed. 3 UID FETCH 3 (RFC822.SIZE INTERNALDATE) * 3 FETCH (UID 3 RFC822.SIZE 1085 INTERNALDATE "04-Jan-2004 09:23:45 -0500") 3 OK Fetch completed. 4 UID FETCH 4 (RFC822.SIZE INTERNALDATE) Connection closed by foreign host. The fetch of message 3, which is not gzipped succeeds, but the fetch of message 4, which is gzipped, fails with the following assertion in the log: Panic: imap: user=x, Status: file maildir-mail.c: line 85 (maildir_mail_stat): assertion failed: (fd != -1) Repeating, but first fetching only INTERNALDATE from the gzipped message succeeds, and once that value is cached in the index files, the same query that causes the failure before will now succeed, as it doesn't need to read the gzipped file any more to get INTERNALDATE: * OK Dovecot ready. 1 login x y 1 OK Logged in. 2 select Folder * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 13 EXISTS * 0 RECENT * OK [UIDVALIDITY 1220278111] UIDs valid * OK [UIDNEXT 14] Predicted next UID 2 OK [READ-WRITE] Select completed. 3 UID FETCH 4 (INTERNALDATE) * 4 FETCH (UID 4 INTERNALDATE "02-Dec-2003 10:39:18 -0500") 3 OK Fetch completed. 4 UID FETCH 4 (RFC822.SIZE INTERNALDATE) * 4 FETCH (UID 4 RFC822.SIZE 6035 INTERNALDATE "02-Dec-2003 10:39:18 -0500") 4 OK Fetch completed. 5 logout * BYE Logging out 5 OK Logout completed. Connection closed by foreign host. Now that the value is cached, the same previously failing query will continue to execute fine, as long as the indexes remain in place: * OK Dovecot ready. 1 login x y 1 OK Logged in. 2 select Folder * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 13 EXISTS * 0 RECENT * OK [UIDVALIDITY 1220278111] UIDs valid * OK [UIDNEXT 14] Predicted next UID 2 OK [READ-WRITE] Select completed. 3 UID FETCH 4 (RFC822.SIZE INTERNALDATE) * 4 FETCH (UID 4 RFC822.SIZE 6035 INTERNALDATE "02-Dec-2003 10:39:18 -0500") 3 OK Fetch completed. 4 logout * BYE Logging out 4 OK Logout completed. Connection closed by foreign host. Removing the indexes again, and this time first fetching just RFC822.SIZE first: * OK Dovecot ready. 1 login x y 1 OK Logged in. 2 select Folder * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 13 EXISTS * 0 RECENT * OK [UIDVALIDITY 1220278111] UIDs valid * OK [UIDNEXT 14] Predicted next UID 2 OK [READ-WRITE] Select completed. 3 UID FETCH 4 (RFC822.SIZE) * 4 FETCH (UID 4 RFC822.SIZE 6035) 3 OK Fetch completed. 4 UID FETCH 4 (RFC822.SIZE INTERNALDATE) Connection closed by foreign host. In this case, the assertion fails again. Fetching RFC822.SIZE alone does not populate the indexes in a way that then allows RFC822.SIZE and INTERNALDATE to be fetched, as fetching INTERNALDATE alone does. It's all confusing to me, hopefully this make some sense to others. Let me know if there is other testing I can help with. I'm running on Slackware 12.1 and have reproduced the same issue with both kernel 2.6.24.4 and 2.6.27.7. The filesystem is XFS. The content of the gzipped message does not seem to matter. David

2 1

Re: [Dovecot] Missing IMAP folders after Server reboot
by punit_j 31 May '09

31 May '09

Did you try looking for the folders by connecting to IMAP using command line. telnet servername 143 a1 login username pass a2 list "" * Check if you could see anything.

1 0

[Dovecot] Missing IMAP folders after Server reboot
by Eoin Kennedy 31 May '09

31 May '09

Hi, Here is the situation, I hope somebody can help me. Our Email server running ubuntu 8.04.1 and dovecot 1.0.10 rebooted, and when it came back up the dovecot config had changed. Prior to the reboot, users stored their emails and folders in /var/mail/~username. Then the config became /var/mail/username for the main Inbox and /home/~username/mail for Folders. Now, none of the folders that users had created in their IMAP account are visible, and their contents are not in the main Inbox file. For example, the Drafts folder was there prior to the reboot, and now it had to be created in /home/username afterwards. These folders were not subfolders of the Inbox, but of the main IMAP root. All users were running Thunderbird as their client. Can they be recovered? Thanks, Eoin Kennedy ----------------------------------------------------------------------------- Sherling & Sons Ltd, Jamestown Road, Inchicore, Dublin 8, Ireland. Company Reg No. 9294 Website: www.sherlingsteel.com

2 2

[Dovecot] antispam plugin and MUA-Junk folders
by Steffen Kaiser 31 May '09

31 May '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, I have a configuration problem, that I ignored till now. Many MUAs tag SPAM themselves and move SPAM to a junk folder (Thunderbird uses "Junk"). It is said to not automatically train these mails, but let have an human revise them. Currently, I have configured those folders as "trash" folders for antispam, which means that those messages are essentially lost, because a move into a spam folder will not train them. -> The current antispam plugin ignores moves in and out of trash folders completely. I wonder why the move trash -> SPAM is ignored? If I configure those junk folders as "unsure" in antispam, the situation can happen, that an user selects a spam folder, the MUA identifies junk and moves the messages into its Junk folder. Current implementation would train this move as HAM. How about the following: 1) copy from * into trash or unsure -> not train 2) copy from !spam into spam -> train as SPAM 4) copy from spam or unsure into !(trash or unsure or spam) -> train as HAM 6) else -> not train Bye, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iQEVAwUBSh0PdHWSIuGy1ktrAQKmaAf/ew1SixCkkWD2V12Jfw3mLcWnUrUSRq/J nsyMkW2//tX74wSJeMjbzlEkxN3dyfJg7f4WviGPdnUp5sqNGuS9lBfHh3ShQHtt 30+mRzVqizmcNEXBFoZXVy1K5hE8p9ssN9avahmUejBVPaSZHD0OjN5h8nFkNMDI XHU2347g03zr1MxejinWyRiKt1MFQyyJ6Y7gXNf6yascWKJA8W6b4Zu/eIH5uEW+ yiMuweaxJOwuGcwqh/qSKZTXnoCLa9rzvd8i/uZGvn7AXoT5u4P5coZkIHrh64U7 oswuYAZwxkmjGNLdGrovZadRJym16BlfVHH5g3Zo7k4nwX+kGRKyug== =9b+n -----END PGP SIGNATURE-----

2 1

[Dovecot] dovecot with MYSQL on Synology NAS
by heutekinderwirdswasgeben＠gmx.de 30 May '09

30 May '09

hello list, under my table I have a NAS station, the Synology DS-207+ there`s a linux with ipkg. the dovocot fromo ipkg didnt have mysql support. compiling seems to be also difficult, because of configure cant find libmysqlclient. experts, what to do for getting mysql support in dovecot? best regards hkwwg -- Nur bis 31.05.: GMX FreeDSL Komplettanschluss mit DSL 6.000 Flatrate und Telefonanschluss nur 17,95 Euro/mtl.!* http://portal.gmx.net/de/go/dsl02

2 1

[Dovecot] offlineimap with dovecot and sieve
by Dieter Faulbaum 29 May '09

29 May '09

I have a dumb question, is it possible to use this combination: Synchronising a remote IMAP-server and a local dovecot-IMAP-server by offlineimap (with both types = IMAP), which works very well. But it seems, that my sieve-scripts on the local dovecot server are not recognised by this combination. Is there a good debugging way for this? -- Dieter Faulbaum Elektronenspeicherring BESSY II Albert-Einstein-Str. 15, 12489 Berlin phone +49 30 6392-4652 fax +49 30 6392-2939 mail Dieter.Faulbaum(a)bessy.de

5 5

[Dovecot] LDAP (AD) auth problem
by Misha Volodko 29 May '09

29 May '09

I'm trying to authenticate users using MS AD with auth_bind option. Here is my config file: # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps ssl_cert_file: /etc/dovecot/ssl/cert.pem ssl_key_file: /etc/dovecot/ssl/key.pem disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail mail_location: maildir:~/Maildir mail_debug: yes mail_plugins: acl auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf plugin: acl: vfile content of dovecot-ldap.conf hosts = myhost:389 auth_bind = yes auth_bind_userdn = cn=%n,ou=People,dc=company,dc=com base = ou=People,dc=company,dc=com user_attrs = mailNickname=home user_filter = (&(objectClass=user)(sAMAccountName=%n)) user_global_uid = vmail user_global_gid = vmail Using the same options I can fetch info with ldapsearch ldapsearch -h myhost -b 'dc=company,dc=com' -D 'cn=username,ou=People,dc=company,dc=com' -x -W '(&(objectClass=user)(sAMAccountName=username))' Dovecot doesn't work with this setting, shows in log: dovecot: auth(default): ldap(username,10.131.11.147): ldap_search() failed: Operations error Using tcpdump i found a cause of it, seems dovecot binds to AD server, then drop connection and trying to do search without bind. During sniff I see response to my ldap search - LdapErr: DSID-0C090627, comment: In order to perform this operation a successful bind must be completed on the connection Found similar problem in maillist - without solution. http://markmail.org/message/a6pui34ewb5bd55d Kindly asking what to do with it? :) -- Best Regards

2 6

[Dovecot] locking fails
by Oskar Eyb 29 May '09

29 May '09

hello! on one of my servers (freebsd 7.0-R , Jail) I have a very strange problem I guess its something about LOCKing. some programs have issued with locking: saslauthd[38127] :main : could not lock pid lock file: /var/run/saslauthd/saslauthd.pid.lock saslauthd[38127] :main : fcntl: Invalid argument dovecot: 2009-05-29 03:45:50 Info: dovecot v1.1.15 starting up dovecot: 2009-05-29 03:45:50 Info: Generating Diffie-Hellman parameters for the first time. This may take a while.. dovecot: 2009-05-29 03:45:50 Error: ssl-build-param: fcntl(write-lock) locking failed for file /var/db/dovecot/ssl-parameters.dat.tmp: Invalid argument dovecot: 2009-05-29 03:45:50 Fatal: ssl-build-param: file_try_lock(/var/db/dovecot/ssl-parameters.dat.tmp) failed: Invalid argument deliver(user(a)example.com): 2009-05-29 03:43:24 Error: fcntl(write-lock) locking failed for file /data/maildirs/example.com/user/dovecot.index.log: Invalid argument deliver(user(a)example.com): 2009-05-29 03:43:24 Error: mail_index_wait_lock_fd() failed with file /data/maildirs/example.com/user/dovecot.index.log: Invalid argument deliver(user(a)example.com): 2009-05-29 03:43:24 Info: msgid=<BLU129-W212F3C73CDDC4C399CE338FD510(a)phx.gbl>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2009-05-29 03:43:24] -rw------- 1 vmail vmail 24 May 29 03:43 /data/maildirs/example.com/user/dovecot.index.log all directorys are existent and wirtable I`m not sure if this only affects dovecot..maybe its a issue caused of the OS. anyone an idea? maybe its possible to run dovecot without these locking? thanks!! Oskar -- Nur bis 31.05.: GMX FreeDSL Komplettanschluss mit DSL 6.000 Flatrate und Telefonanschluss nur 17,95 Euro/mtl.!* http://portal.gmx.net/de/go/dsl02

2 5

[Dovecot] (no subject)
by Patrick Hemmen 29 May '09

29 May '09

Hi, I use a OpenLDAP for authentication. To authenticate a full DN as the user name must be used, like "cn=jim,ou=users,dc=example,dc=com". There are several domains, like example2.com and example3.com. I want to use Dovecot with ldap and authentication binds. For testing I use "auth_bind_userdn = cn=%n,ou=users,dc=%d" and the user name must provide as "jim@example,dc=com". To allow the special chars ("=,") in user name, I extend "auth_username_chars". Now my questions. Exists a real chance to attack the ldap directory with the extended "auth_username_chars"? And it's possible to use authentication binds with the regular "auth_username_chars" and a provided user names like "jim(a)example.com" in my special ldap directory structure? Thanks in advance - Patrick

2 3

[Dovecot] Clustering dovecot?
by dovecot＠corwyn.net 29 May '09

29 May '09

Currently I have a mail server running postfix and dovecot with users in mysql. I have Outlook (blich) clients checking IMAP mail on the server. I'd like to build some fault-tolerance into that system in case I have hardware failure. I've read through: http://wiki.dovecot.org/MailLocation/SharedDisk but I feel I need more information. My basic understanding is that I'll need 2 clustered systems running with shared disk space and shared IP. Performance/load-balancing isn't an issue for me, it's just fault-tolerance that I'm worried about. I found a nice long doc for Cyrus IMAP (http://cyrusimap.web.cmu.edu//ag.html) anything similar for dovecot? Rick Rick Steeves http://www.sinister.net "The more I learn, it seems, the less I know." Frazz

7 15

[Dovecot] expire: mysql table creation error
by John Fawcett 29 May '09

29 May '09

Don't know if anyone found this already (couldn't see anything in the archives about it) but maybe this is useful to someone else who finds the same problem. When following the instructions for setting up expire on v1.2+ for mysql backend at http://wiki.dovecot.org/Plugins/Expire I got the following error: mysql> CREATE TABLE expires ( -> username varchar(100) not null, -> mailbox varchar(255) not null, -> expire_stamp integer not null, -> primary key (username, mailbox) -> ); ERROR 1071 (42000): Specified key was too long; max key length is 1000 bytes that's because it's a utf8 database where every char is 3 bytes so a 355 char index is 1065 bytes. it worked ok with the following modification: mysql> CREATE TABLE expires ( -> username varchar(100) not null, -> mailbox varchar(255) not null, -> expire_stamp integer not null, -> primary key (username, mailbox(200)) -> ); Query OK, 0 rows affected (0.00 sec) but maybe that's not such a good primary key, probably better to do: mysql> CREATE TABLE expires ( -> id integer not null auto_increment, -> username varchar(100) not null, -> mailbox varchar(255) not null, -> expire_stamp integer not null, -> primary key (id), -> key (username, mailbox(200)) -> ); Query OK, 0 rows affected (0.00 sec) John

2 2

[Dovecot] dovecot: child xxxx (login) returned error 83 (Out of memory)
by Eric Sammons 29 May '09

29 May '09

Hi, Recently started receiving the error $SUBJECT. Soon after a number of segfault errors are reported for pop3-login. Based on my configuration, I believe I am set up to receive core files; however, my ulimit -c is 0. I have tried setting ulimit -c ... in /etc/init.d/dovecot and I have tried modifying /etc/security/limits.conf. In all cases /proc/[pid]/limits continued to report that my ulimit -c value was 0. What is the best process for capturing a core file from a login process (pop3-login). I have found some similar hits on the web for this; however, none appear to lead to resolution and in most cases the implementation includes imap, mysql, etc... Here is my dovecot.conf, any insight into the cause of this problem is greatly appreciated. Dovecot package is that shipped with RHEL 5.2 (dovecot-1.0.7-2.el5). <dovecot.conf> protocols = pop3 pop3s listen = * shutdown_clients = yes #log_path = /var/log/pop.log #info_log_path = /var/log/popinfo.log syslog_facility = local6 ssl_disable = no ssl_cert_file = /etc/pki/dovecot/certs/pop.pem ssl_key_file = /etc/pki/dovecot/private/pop.pem login_dir = /var/run/dovecot/login login_user = dovecot login_process_size = 64 login_process_per_connection = no login_processes_count = 3 login_max_connections = 512 login_max_processes_count = 512 max_mail_processes = 10000 login_greeting = Unauthorized access is prohibited. mail_location = mbox:/var/indexes/%u:INBOX=/var/spool/mail/%u mail_privileged_group = vmail pop3_lock_session = yes ######added for perfomance 61208 MT (Just for testing) # test with and without the following pop3_no_flag_updates = yes mmap_disable = yes mbox_read_locks = fcntl mbox_write_locks = fcntl mbox_lock_timeout = 300 #mbox_dirty_syncs = yes mbox_very_dirty_syncs = yes mbox_lazy_writes = yes mbox_min_index_size = 540 protocol imap { } protocol pop3 { pop3_uidl_format = %08Xv%08Xu } protocol lda { postmaster_address = postmaster(a)example.com } auth default { auth_cache_size = 10240 auth_cache_ttl = 18000 auth_debug=no mechanisms = plain passdb ldap { args = /etc/dovecot-ldap.conf } userdb ldap { args = /etc/dovecot-ldap.conf } auth_verbose = no } dict { } plugin { } ### The following added to troubleshoot segfault issue 6.16.08 by rt mail_drop_priv_before_exec = yes </dovecot.conf>

2 1

[Dovecot] Timeout during imapsync
by Craig Jackson 29 May '09

29 May '09

Hi, I'm using Imapsync to sync messages from an Exchange 2003 server to a Dovecot 1.1.11 server. The problem is that users' mailboxes are huge, several gigabytes with tens of thousands of messages. First Imapsync connects to Exchange and then to Dovecot, and then starts to get Inbox info from Exchange. By the time it gets this info, the connection to Dovecot has timed out. I realize the RFC calls for a 30 minute time out which I believe is hard coded into Dovecot. If there is a way around this by making a configuration change, please tell me. I have posted the same message on the Imapsync list in an attempt to find a work around with patched Imapsync. Thanks in advance. Craig Jackson

2 2

[Dovecot] plugin API docs?
by Dave McGuire 28 May '09

28 May '09

Is there any documentation for the plugin API? A cursory glance through the docs didn't turn up anything. Thanks, -Dave -- Dave McGuire Port Charlotte, FL

2 2

[Dovecot] dbox verses maildir - advantages/disadvantages
by James Brown 28 May '09

28 May '09

I am migrating our mail server from Courier-IMAP to Dovecot. We currently use maildir storage format. What are the advantages and disadvantages of Dovecot's dbox format over maildir? Does anyone have any performance benchmarks for both? What do people use to test performance? We are running on a Mac OS X box (10.5.7) using Postfix 2.6. Thanks, James.

2 1

[Dovecot] Dovecot and Phpgroupware compatibility
by Carlos Xavier 28 May '09

28 May '09

Hi, recently moved our server from mbox format to Maildir format. Almost all the users are very happy with this, since the speed had increased very much. I used mb2md to do the conversion and on this task all the mailboxes that had "." (dot) on their names were converted to "_". But there is one issue with this, we also use the webmail that comes with Phpgroupware, and it uses some mailbox that have fixed named like INBOX.Sent, INBOX.Draft and so on. When their names were changed the sent messages didn't get saved anymore, so I had to move them back to the old names. After that the sent messages returned to be saved again, but another troube showed up. As they start with .INBOX and have "." on the names, Dovecot shown them as a subdirectory of the INBOX and we got some people upset with this. I need help on configuring Dovecot to not show them this way, because if you look the .INBOX.Sent either on the webmail or by outlook, the field displayed is the sender, witch is not desired. When I did the conversion, to keep the compatibility with the old server (quota, avoid I/O botleneck, etc), I set two Maildirs, one at /var/spool/mail/$USER, to be the INBOX and another at the user home. We are using Dovecot version 1.1.13, and below is the relevant configuration on use. namespace public { prefix = "#mbox/" separator = / inbox = yes list = no location= maildir:/var/spool/mail/%u/:CONTROL=~/control:INDEX=~/control } namespace private { separator = / prefix = location= maildir:~/Maildir/:CONTROL=~/control:INDEX=~/control inbox = no } Best Regards, Carlos Xavier.

2 1

[Dovecot] Does a plugin can have root privileges ?
by Fabien 28 May '09

28 May '09

Hello, I wish to get "Fetchmail Wake" works in my environment. This plugin send SIGUSR1 to fetchmail so it wakes up when mail client grabs mail. For the moment "Fetchmail Wake" is executed by mail_uid (defined in dovecot.conf) which is not enough to send signal to fetchmail daemon (and access to fetchmail.pidfile). Thank you!

2 2

[Dovecot] Inotify instance limit for user exceeded, disabling?
by dovecot＠corwyn.net 28 May '09

28 May '09

I'm seeing this message in my /var/log/maillog: May 26 12:35:00 agencymail dovecot: IMAP(info(a)example.com): Inotify instance limit for user exceeded, disabling. Increase /proc/sys/fs/inotify/max_user_instances I rummaged through google, and found : http://www.dovecot.org/list/dovecot-cvs/2008-May/011132.html which says I need to increase /proc/sys/fs/inotify/max_user_instances (no surprise given the error message really). I can fix that with echo 256 > /proc/sys/fs/inotify/max_user_instances , but as /proc is temporary, so if I change it won't it break if/when the system reboots? The error message also implies that something has been disabled. If I increase /proc/sys/fs/inotify/max_user_instances will it fix automatically, or do I need to do something else? since it's a kernel message, I suspect just restarting dovecot won't do it. And what exactly is breaking when I receive this notification? The proc docs indicate: /proc/sys/fs/inotify (since Linux 2.6.13) This directory contains files max_queued_events, max_user_instances, and max_user_watches, that can be used to limit the amount of kernel memory consumed by the inotify interface. For further details, see <http://linux.die.net/man/7/inotify>inotify(7). Is this dovecot monitoring for new mail? thanks Rick [root@agencymail inotify]# dovecot -n # 1.1.8: /etc/dovecot.conf # OS: Linux 2.6.18-92.el5 i686 Red Hat Enterprise Linux Server release 5.2 (Tikanga) ext3 ssl_cert_file: /etc/httpd/certs/agencymail_example_com.crt ssl_key_file: /etc/httpd/certs/agencymail.example.com.key.no.password login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_max_processes_count: 256 mail_uid: 1015 mail_gid: 105 mail_location: maildir:/var/spool/mail/%d/%n/Maildir mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): acl quota imap_quota expire trash mail_plugins(imap): acl quota imap_quota expire trash mail_plugins(pop3): expire quota mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle imap_client_workarounds(imap): delay-newmail outlook-idle imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh dict_db_config: /etc/dovecot-db.conf auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot-sql.conf userdb: driver: passwd userdb: driver: sql args: /etc/dovecot-sql.conf userdb: driver: static socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vuser group: vuser plugin: quota: maildir quota_rule: *:storage=102400000 quota_rule2: Trash:storage=100M acl: vfile:/etc/dovecot/acls trash: /etc/dovecot-trash.conf expire: Trash 14 Trash/* 14 Spam 14 expire_dict: proxy::expire dict: expire: mysql:/etc/dovecot-dict-expire.conf Rick Steeves http://www.sinister.net "The more I learn, it seems, the less I know." Frazz

3 2

[Dovecot] Problem in deliver (Panic: file index-mail-headers.c ...)
by Stefan Roese 28 May '09

28 May '09

Hi All, I'm experiencing a problem with some mails in deliver. Here the logged error message: deliver(stefan(a)roese.nl): 2009-05-06 11:57:36 Panic: file index-mail-headers.c: line 141 (index_mail_parse_header_finish): assertion failed: ((match[match_idx] & HEADER_MATCH_FLAG_FOUND) == 0) deliver(stefan(a)roese.nl): 2009-05-06 11:57:36 Error: Raw backtrace: /usr/lib/dovecot/deliver [0xb801ee51] -> /usr/lib/dovecot/deliver(default_fatal_handler+0x4c) [0xb801ef9c] -> /usr/lib/dovecot/deliver [0xb801e6e5] -> /usr/lib/dovecot/deliver(index_mail_parse_header+0x739) [0xb7fdea19] -> /usr/lib/dovecot/deliver(message_parser_parse_header+0x48) [0xb8016e88] -> /usr/lib/dovecot/deliver(index_mail_parse_headers+0x106) [0xb7fdef76] -> /usr/lib/dovecot/deliver [0xb7fdf566] -> /usr/lib/dovecot/deliver(index_mail_get_headers+0x2f) [0xb7fdf98f] -> /usr/lib/dovecot/deliver(mail_get_headers_utf8+0x25) [0xb7fe7315] -> /usr/lib/dovecot/modules/lda/lib90_cmusieve_plugin.so [0xb7dd7530] -> /usr/lib/dovecot/modules/lda/lib90_cmusieve_plugin.so [0xb7de2169] -> /usr/lib/dovecot/modules/lda/lib90_cmusieve_plugin.so(sieve_eval_bc+0x47e) [0xb7de33ee] -> /usr/lib/dovecot/modules/lda/lib90_cmusieve_plugin.so(sieve_execute_bytecode+0x125) [0xb7de9565] -> /usr/lib/dovecot/modules/lda/lib90_cmusieve_plugin.so(cmu_sieve_run+0x325) [0xb7dd8835] -> /usr/lib/dovecot/modules/lda/lib90_cmusieve_plugin.so [0xb7dd6486] -> /usr/lib/dovecot/deliver(main+0x11e4) [0xb7fa6eb4] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe5) [0xb7e09775] -> /usr/lib/dovecot/deliver [0xb7fa47c1] This is dovecot v1.1.11 used on Kubuntu 9.04. Any ideas what's the source for this problem and how to solve it? Thanks, Stefan

2 5

[Dovecot] A few easy pam and virtual domains questions
by Mauricio Tavares 28 May '09

28 May '09

I am using dovecot with postfix, which was setup to do virtual domains. Dovecot is setup to authenticate against pam (I know, I know) and knows to look for email in /var/spool/vmail/: virtual_mailbox_base = /var/spool/vmail I also have virtual_mailbox_maps defined as virtual_mailbox_maps = hash:/etc/postfix/vmaps.txt where I currently only have one account, % cat /etc/postfix/vmaps.txt raub(a)domain.com domain.com/raub/ % Inside raub we have the usual 3 directories, new,cur, and tmp. When I try to login through imap as raub@domain.com@mail.domain.com (i.e. since we are doing the virtual domain thingie, the username has to indicate the domain it belongs to), it will not take it. But, if I login as raub(a)mail.domain.com, it has no problems authenticating. However, it now expects to retrieve email from /var/spool/vmail/raub instead of /var/spool/vmail/domain.com/raub. Why would it be doing that? Could it be that pam reports raub to be a local account and as a result simply ignoring vmaps.txt? I asked dovecot to log everything it could. When I checked the log file, the following line screamed at me: dovecot: May 27 14:40:28 Info: IMAP(raub): maildir++: root=/var/spool/vmail//raub, index=, control=, inbox=/var/spool/vmail//raub Note the "//" in root and inbox declarations; between those slashes I would expect to be domain.com. Compounding the problem, and perhaps a clue of how pam is telling what these accounts are, postfix is completely ignoring /var/spool/vmail, placing the emails in /home/raub/Maildir (account is actually being nfs-automounted and user authenticated through ldap through pam). Once again I am guessing it too is being told raub is a local user; am I correct?

2 2

[Dovecot] What does "a" flag in Maildir format mean?
by Max Ivanov 28 May '09

28 May '09

Here is sample filename from Maildir: 1243423383.M745917P32169.termserv1,W=1295:2,Sa 1) why there is no S=<size> field? It definetely differs from 1295.I've not quota plugin, could it be the reason of this? 2) what does "a" flag mean? I not found any description of this neither in Maildir spec nor on the Dovecot wiki.

3 2

[Dovecot] syslog
by Mohsen Pahlevanzadeh 28 May '09

28 May '09

Dear all, How i use syslog for dovecot? Yours, Mohsen

2 1

[Dovecot] Testing 1.2
by Marc Perkel 27 May '09

27 May '09

Just installed it. Upgraded from 1.1.15. So far so good.

2 1

[Dovecot] test of mailing list
by Carlos Xavier 27 May '09

27 May '09

Im sendding messages to the list and they do not show up. its just a test, please ignore Regards, Carlos Xavier.

5 4

[Dovecot] RFC 3501 section 7
by Scott Haneda 27 May '09

27 May '09

Hello, been lurking a while, about to move over to Dovecot soon. I have a nice test machine up and running. My previous email server when talking IMAP to Apple Mail, will eventually go "deaf" and new messages will not make it to the Inbox of Apple Mail Client. A restart of the desktop application is required. I am told that the reason for this is that my current email server adheres to RFC 3501, specifically section 7, the second paragraph of which says: The client MUST be prepared to accept any response at all times. Apparently, Apple Mail is not adhering to that, and my email server is sending out that type of response. However, I look at this list, for which I am not entirely sure how accurate the actual test is: http://www.imapwiki.org/ImapTest/ServerStatus It lists Dovecot as one of only two that are fully compliant IMAP servers. Congrats on that. My questions are: Does Dovecot in fact support correctly the above mentioned RFC and subsection? I assume so. That being the case, I have not had issues in my testing of Dovecot, nor heard reports of Apple Mail and IMAP having any significant problems. How, if that is the case, can Apple Mail and Dovecot work well with each other, and my current email server is not able to? My primary reason for moving to Dovecot is to not be burdened by this issue, as well as have what I consider to be a more advanced storage mechanism for the actual messages. What I would like to avoid, is spending a lot of time migrating thousands of users to a new system, to only have them burdened by the same inability to have email come to them without an application relaunch. Thank you for any insight on this. * I have filed a bug report with Apple, which was accepted. Their system does not allow me to see the status on the report once it has been closed. -- Scott * If you contact me off list replace talklists@ with scott@ *

2 1

[Dovecot] Dovecot and Phpgroupware compatibility
by Carlos Xavier 27 May '09

27 May '09

Hi, I am resending this email, since the fist one didn't hit the list. Recently we moved our server from mbox format to Maildir format and started using Dovecot. Almost all the users are very happy with this, since the speed had increased very much. I used mb2md to do the conversion and on this task all the mailboxes that had "." (dot) on their names were converted to "_". But there is one issue with this, we also use the webmail that comes with Phpgroupware, and it uses some mailbox that have fixed named like INBOX.Sent, INBOX.Draft and so on. When their names were changed the sent messages didn't get saved anymore, so I had to move them back to the old names. After that the sent messages returned to be saved again, but another trouble showed up. As they start with .INBOX and have "." on the names, Dovecot shown them as a subdirectory of the INBOX and we got some people upset with this. I need help on configuring Dovecot to not show them this way, because if you reed the .INBOX.Sent either on the webmail or by Outlook, the field displayed is the sender, witch is not desired. When I did the conversion, to keep the compatibility with the old server (quota, avoid I/O bottleneck, etc), I set two Maildirs, one at /var/spool/mail/$USER, to be the INBOX and another at the user home. We are using Dovecot version 1.1.13, and below is the relevant configuration on use. namespace public { prefix = "#mbox/" separator = / inbox = yes list = no location= maildir:/var/spool/mail/%u/:CONTROL=~/control:INDEX=~/control } namespace private { separator = / prefix = location= maildir:~/Maildir/:CONTROL=~/control:INDEX=~/control inbox = no } Best Regards, Carlos Xavier.

2 1

[Dovecot] setgid error
by Roy Sigurd Karlsbakk 27 May '09

27 May '09

Hi all Trying to setup dovecot with mysql and postfix, I have configured it as given below. thecot user has the dovecot group as primary, and is also a member of mail and dovecot-users. Still, it can't setgid to dovecot-users. I tried changing the shell for the dovecot user to something useful and chmod'ing a file to dovecot-users, and it work well. Still, no mail comes through and dovecot gives me this error deliver(roy(a)somedomain.com): 2009-05-23 15:02:52 Fatal: setgid(115) failed with euid=115, gid=114, egid=114: Operation not permitted Any ideas? roy # Dovecot config # 1.0.15: /etc/dovecot/dovecot.conf log_path: /var/log/dovecot/dovecot.log log_timestamp: %Y-%m-%d %H:%M:%S disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login verbose_proctitle: yes mail_privileged_group: mail mail_location: maildir:/var/spool/dovecot/%d/%n auth default: default_realm: eventchief.com verbose: yes debug: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 432 user: dovecot group: mail -- Roy Sigurd Karlsbakk (+47) 97542685 / 98013356 roy(a)karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk.

2 6

Re: [Dovecot] Capability problems dovecot 2.0
by reg9009 27 May '09

27 May '09

answered the wrong address... Timo Sirainen schrieb: > On May 27, 2009, at 2:35 AM, reg9009 wrote: > >> what if TB just needs the "IMAP4rev1" capability before logging in? > > That's a completely different issue. Meaning that v2.0 is buggy here > currently and returning an empty string, because I haven't yet decided > how to fix it. That explains all :) I'll try imap_capability manual override for now. Btw., when I telnet to the server, I get * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. What's this capability string? Couldn't we use this one, at least until a user is logging in? > >> Where is the setting "imap_capability" used? I could try and see how TB >> is behaving, in parallel to Outlook, OE, etc. > > What do you mean by used? You should be able to just set in dovecot.conf: > > imap_capability = imap4rev1 and other stuff > > I didn't know if that shoul be used in some section or directly in dovecot.conf. Thx. Regards, Sebastian

1 0

[Dovecot] [bug] dovecot 1.1.15: segfault after message move
by Juergen Daubert 27 May '09

27 May '09

Hello, found the following in my error log: May 20 13:27:48 ser dovecot: imap-login: Login: user=<juergen>, method=PLAIN, rip=192.168.0.17, lip=192.168.0.90, TLS May 20 13:28:10 ser dovecot: Panic: IMAP(juergen): file imap-sync.c: line 439 (cmd_sync_delayed): assertion failed: (client->mailbox != NULL) May 20 13:28:10 ser dovecot: IMAP(juergen): Raw backtrace: imap [0x80cc01e] -> imap [0x80cc08a] -> imap [0x80cba78] -> imap [0x806642f] -> imap [0x80602c1] May 20 13:28:10 ser dovecot: child 23536 (imap) killed with signal 6 (core dumps disabled) it's almost always reproducible using the Heirloom mailx [1] mail client, with mutt I get a 'connection closed' message but no segfault: - login to the dovecot server via imap/imaps - move a message from INBOX to a another large mbox-file - quit Seems to be a new issue introduced with 1.1.15 because I don't see that with 1.1.14 or older versions. Greetings Juergen [1] http://heirloom.sourceforge.net/mailx.html #:> dovecot -n # 1.1.15: /etc/dovecot.conf # OS: Linux 2.6.27.23 i686 base_dir: /var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/certs/dovecot.crt ssl_key_file: /etc/ssl/keys/dovecot.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_process_per_connection: no login_processes_count: 1 first_valid_gid: 100 mail_location: mbox:~/Mail:INBOX=/var/spool/mail/%u mbox_min_index_size: 100 mbox_very_dirty_syncs: yes mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 auth default: passdb: driver: shadow userdb: driver: passwd -- Juergen Daubert | mailto:jue@jue.li Korb, Germany | http://jue.li/crux

6 16

[Dovecot] example sql acl_shared_dict wiki
by Robert Schetterer 27 May '09

27 May '09

Hi Timo, wiki says --------- Shared mailbox listing ..... You could use any dictionary backend, such as SQL or Berkeley DB, but a simple flat file should work pretty well too: plugin { acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes.db } .... -------- could you include an example for having acl_shared_dict in sql ? -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 6

[Dovecot] FTS Plugin design
by Rui Carneiro 26 May '09

26 May '09

Hi all, Currently I am developing some changes on the solr plugin. I want this plugin indexing also the attachment's content. I have already started to look on plugin's source but I am having some problems understanding how it works. I didn't understood yet what is the plugin's design and how the plugins are called from the core system and I was wondering if anyone could help me with that. Sorry if this doubts sound stupid but I am newcomer on Dovecot. Regards, Rui Carneiro

5 31

[Dovecot] Secure Sockets Layer client certificate authentication
by Stephen Feyrer 26 May '09

26 May '09

Hi everyone. Please note, I've asked a very similar question before and I apologize for sounding like a broken record. Well here it goes. What I want to do is authenticate my users using a certificate. Thereby authenticating both the user and server with strong tokens that are centrally managed. In the worst case scenario the user should only need to enter a password for the certificate store and then the certificate should trigger the appropriate level of access to their account. Is Dovecot the correct tool for the job? If yes then, how? Else if not, then what would you recommend? I have tried setting the auth mechanism to anonymous without any joy. My password file is set with nopassword. All my certificates work well with the Secure Sockets Layer system. This is the configuration I am currently running: # 1.2.beta1: /opt/etc/dovecot/dovecot.conf # OS: Linux 2.6.12.6-arm1 armv5tejl log_path: /opt/var/log/dovecot.log info_log_path: /opt/var/log/dovecot-info.log protocols: imaps ssl_ca_file: /opt/etc/ssl.ca/cacrl.pem ssl_cert_file: /opt/etc/ssl.ca/newcerts/imap.cer ssl_key_file: /opt/etc/ssl.ca/private/imap.key ssl_parameters_regenerate: 24 ssl_cipher_list: ALL:!LOW:!SSLv2 ssl_verify_client_cert: yes disable_plaintext_auth: yes verbose_ssl: yes login_dir: /opt/var/run/dovecot/login login_executable: /opt/libexec/dovecot/imap-login login_user: guest login_processes_count: 2 login_max_processes_count: 4 mbox_write_locks: fcntl mail_process_size: 512 imap_client_workarounds: outlook-idle tb-negative-fetch auth default: user: admin verbose: yes debug: yes ssl_require_client_cert: yes ssl_username_from_cert: yes passdb: driver: passwd-file args: /opt/etc/dovecot/h.org/passwd userdb: driver: passwd This is a log of a login attempt: dovecot: May 25 11:55:58 Info: auth(default): new auth connection: pid=22556 dovecot: May 25 11:56:08 Info: imap-login: Valid certificate: /O=home.org/emailAddress=admin(a)nas2.h.org/L=W/ST=C/C=G/CN=h.org dovecot: May 25 11:56:08 Info: imap-login: Valid certificate: /C=G/ST=C/O=h.org/OU=K F/CN=k dovecot: May 25 11:56:10 Info: auth(default): new auth connection: pid=22585 dovecot: May 25 11:56:16 Info: auth(default): client in: AUTH 1 PLAIN service=imap secured valid-client-cert cert_username=k lip=10.1.1.245 rip=10.1.1.1 lport=993 rport=53430 dovecot: May 25 11:56:16 Info: auth(default): client out: CONT 1 dovecot: May 25 11:56:16 Info: auth(default): client in: CONT<hidden> dovecot: May 25 11:56:16 Info: auth(default): passwd-file(k,10.1.1.1): lookup: user=k file=/opt/etc/dovecot/h.org/passwd dovecot: May 25 11:56:16 Info: auth(default): passwd-file(k,10.1.1.1): No password dovecot: May 25 11:56:16 Info: auth(default): client out: OK 1 user=k dovecot: May 25 11:56:16 Info: auth(default): master in: REQUEST 6 22164 1 dovecot: May 25 11:56:16 Info: auth(default): passwd(k,10.1.1.1): lookup dovecot: May 25 11:56:16 Info: auth(default): master out: USER 6 k system_user=k uid=500 gid=100 home=/ dovecot: May 25 11:56:16 Info: imap-login: Login: user=<k>, method=PLAIN, rip=10.1.1.1, lip=10.1.1.245, TLS With this configuration the client will connect over ssl and identify itself with a certificate but a client password is still required. -- Regards Stephen.

3 8

Re: [Dovecot] pop3 gives a permission denied error on chdir
by Kenneth Gonsalves 26 May '09

26 May '09

On Thursday 21 May 2009 12:40:00 you wrote: > exec "strace -f -o /tmp/access.log -etrace=file -p <pid_of_dovecot>" > then try to access pop3 when fail occurs send us /tmp/access.log > (gzipped) attached -- regards Kenneth Gonsalves Associate NRC-FOSS http://nrcfosshelpline.in/web/

3 7

[Dovecot] status=bounced (Command died with signal 11: "/usr/lib/dovecot/deliver"
by Chantal Rosmuller 26 May '09

26 May '09

Hi list, I use dovecot 1.1.11 on ubuntu 9.04, when I want to send a message to an email adres on this mailserver I get this error: status=bounced (Command died with signal 11: "/usr/lib/dovecot/deliver". The folders where the email should be delivered are created so it does not look like a permission problem. I connect to a mysql database where the email accoutn info is stored, this works. I use the same setup on an ubuntu 8.04 server with dovecot 1 and I have no problems on that server. What am I overlooking here? Here is my configuration: dovecot -n: base_dir: /var/run/dovecot/ log_path: /var/log/mail.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap pop3 imaps pop3s ssl_cert_file: /etc/ssl/certs/dovecot-cert.pem ssl_key_file: /etc/ssl/private/dovecot.pem disable_plaintext_auth: no login_dir: /var/run/dovecot-login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login first_valid_uid: 150 last_valid_uid: 150 mail_privileged_group: mail mail_location: mbox:/var/vmail/%2d/%d/%n mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf userdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail postconf -n: append_dot_mydomain = no biff = no config_directory = /etc/postfix/ disable_vrfy_command = no home_mailbox = Maildir/ inet_interfaces = all mailbox_size_limit = 0 message_size_limit = 25000000 mydestination = $myhostname, localhost.$mydomain mydomain = domain.com myhostname = server.domain.com mynetworks = 127.0.0.0/24, 10.0.11.248, 10.0.11.249 myorigin = $mydomain recipient_delimiter = + setgid_group = postdrop smtpd_banner = $myhostname smtpd_client_restrictions = permit_sasl_authenticated permit_mynetworks reject smtpd_recipient_restrictions = permit_sasl_authenticated, permit_mynetworks, reject_unknown_recipient_domain, reject_unauth_destination smtpd_sasl_auth_enable = yes smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot virtual_alias_maps = mysql:$config_directory/mysql_catchall_workaround.cf mysql:$config_directory/mysql_virtual_alias_maps.cf mysql: $config_directory/mysql_domain_alias_maps2.cf mysql: $config_directory/mysql_domain_alias_maps.cf virtual_gid_maps = static:118 virtual_mailbox_base = /var/vmail virtual_mailbox_domains = mysql:$config_directory/mysql_virtual_domains_maps.cf virtual_mailbox_maps = mysql:$config_directory/mysql_virtual_mailbox_maps.cf virtual_minimum_uid = 150 virtual_transport = dovecot virtual_uid_maps = static:150

4 15

[Dovecot] "Panic: file client.c: line 354: unreached"
by Ralf Hildebrandt 26 May '09

26 May '09

>From my log today: May 22 07:38:48 postamt dovecot: imap-login: Disconnected (no auth attempts): rip=141.42.245.68, lip=141.42.4.250 May 22 07:39:29 postamt dovecot: imap-login: Disconnected (no auth attempts): rip=141.42.245.68, lip=141.42.4.250 May 22 07:39:50 postamt dovecot: imap-login: Disconnected (no auth attempts): rip=141.42.245.68, lip=141.42.4.250 May 22 07:39:50 postamt dovecot: imap-login: Disconnected (no auth attempts): rip=141.42.245.68, lip=141.42.4.250 May 22 07:39:50 postamt dovecot: imap-login: Disconnected (no auth attempts): rip=141.42.245.68, lip=141.42.4.250 May 22 07:39:50 postamt dovecot: imap-login: Disconnected (no auth attempts): rip=141.42.245.68, lip=141.42.4.250 May 22 07:45:29 postamt dovecot: imap-login: Disconnected (no auth attempts): rip=141.42.245.68, lip=141.42.4.250 May 22 07:45:29 postamt dovecot: imap-login: Disconnected (no auth attempts): rip=141.42.245.68, lip=141.42.4.250 May 22 07:45:29 postamt dovecot: imap-login: Disconnected (no auth attempts): rip=141.42.245.68, lip=141.42.4.250 May 22 07:45:29 postamt dovecot: imap-login: Disconnected (no auth attempts): rip=141.42.245.68, lip=141.42.4.250 May 22 07:45:37 postamt dovecot: imap-login: Disconnected (no auth attempts): rip=141.42.245.68, lip=141.42.4.250 May 22 07:45:37 postamt dovecot: imap-login: Disconnected (no auth attempts): rip=141.42.245.68, lip=141.42.4.250 and then: May 22 07:45:37 postamt dovecot: imap-login: Panic: file client.c: line 354: unreached May 22 07:45:37 postamt dovecot: dovecot: child 19726 (login) killed with signal 6 (core not dumped - add -D to login_executable) (latest ip=141.42.245.68) Using v1.2.rc4 -- Ralf Hildebrandt Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.computerbeschimpfung.de In our world, software has to be small, has to be debugged, has to ship as part of a major initiative, has to avoid compatibility problems, has to avoid end user calls. Bill Gates

2 3

[Dovecot] Dovecot 1.0.15, sieve fileinto subdirectory ?
by Karel Hendrych 26 May '09

26 May '09

Hi, does sieve plugin in 1.0.15 support fileinto subdirectory? There is a maildir .oss.dovecot and sieve rule: if envelope :contains "to" "k+dovecot" { fileinto "oss.dovecot"; } But I get LDA error: Couldn't open mailbox dovecot: Mailbox doesn't exist: dovecot Any suggestions? Delivery to non-subdirectories is working fine. Regards -- Karel

3 2

[Dovecot] libsieve problems / wishes
by Steffen Kaiser 26 May '09

26 May '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, I'm trying libsieve (853:42e154b8792e) to cope with our current installation, the following issues arise: 1) vacation addresses are compared case-sensitivly, e.g.: vacation :addresses [ "Steffen.Kaiser(a)example.com" ] ""; it won't match "steffen.kaiser@...". attached patch makes a first shot about that problem, leaving: 1a) maybe one should lower-case :addresses argument at compile time and my_address at run-time and then use strcmp() again. 1b) duplicate checks are case-sensitive, too. This is probably no big issue, because if the same person uses different variants of his/her mail address for sending, s/he does not deserve better. 1c) Suppression of replies to own mails are case-sensitive, too. Well, many people I know test that "it just works" by sending themselves a mail. I would disable this check. 2) we have about 157 ways to write the domain part. Not all accounts are available in all of them, but it's close to it. The old vacation program we used prior to "cmusieve" didn't care about the domain unless explicitly given. It was quite painful. Attached patch adds a "domainless" variant of :addresses arguments in such way, that vacation :addresses [ "Steffen.Kaiser" ] ""; matches any domain. Ideally, it would be better to specify all valid domains, but perhaps one can leave that for another approach with a different syntax, e.g. with "@*" as domain? Maybe, there is a better approach. Now there is possibility that common local parts are matched from alien domains easily. If to specify a set of "default" domains would be an option for libsieve, what is the suggested way: - - as user-option via dovecot.conf? - - as admin-enforced Sieve-script that sets some internal variables? aka using the multi-script capability - - ??? 3) Because I try to migrate from cmusieve v1.0, I have a name issue with "imapflags". README sec "* Supports all extensions provided by the original CMUSieve plugin:" and sec "Implementation Status" explains that "imapflags" is available. This is not true entirly: "imapflags" is not, lib-sieve uses the name "imap4flags" as defined by RFC. So, it leaves me with two options: 3a) convert all user scripts and hack Horde-Ingo, or 3b) have libsieve accept the alias "imapflags" for the extension "imap4flags". Would it be worhtwhile for libsieve to implement aliases for extensions, so that they are available in require by more than one name? About Horde-Ingo, maybe they have an update to use "imap4flags", too, but it looks like that I upgrade Dovecot before Horde. Bye, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iQEVAwUBSYccg3WSIuGy1ktrAQLlaQf+NHtyBxMb3aqnaw58zapo3/5kgqMM4GA+ 68el9d1CK4URjuk9io3MBsSzEJ4lRy6VFHNLw0jyNEnZp7l0vv5UoiK/+af7LCW5 H2T/qYL+lG/ul870t0/3q5wHmtrriAGQqE215C1u5/trJRX/sQLzDq1tbOtV4/vQ xUa8P0TXvCsgGSzCCmNiU0AenTIRGnxo+sCiyxnDKhgmWph/t06GYHX77CKwumK8 O57rh3RD9hA5yjicTbEZVLzeDDPEmCFliiSR6qMukfxOwX6LIxqhfw8n3cmSm8+X QyK6d/pBxy6EC14XhRQ7Jjtse+gWraiVJ/kcXKuW8sNPphtrGM1fdQ== =uuB6 -----END PGP SIGNATURE-----

5 11

[Dovecot] Maildir with LAYOUT=fs not working
by Rich Wales 26 May '09

26 May '09

I'm considering converting a Cyrus system (managing my family's e-mail) to Dovecot. I'm trying Dovecot 1.1.15 on an Ubuntu 9.04 (2.6.28-11-server) system. My production server is currently running Cyrus 2.3.14. Since I have a huge number of folders and subfolders, I need to use LAYOUT=fs. However, it's not working consistently. I tried setting up a test account in Thunderbird (2.0.0.21), and I was able to create folders under the Inbox, and they showed up as nested subdirectories under my ~/Maildir on my mail server. So far, so good. However, when I tried a home-grown Perl script (an archival scheme for my work e-mail), Dovecot wouldn't create subfolders properly; instead of nesting them (as I thought LAYOUT=fs would do), it used a flat layout. Here is a trace (generated by my Perl script) of an IMAP session. This was supposed to log in as the user "stanford" (the name of my archival account); create a folder named "2009" if not already present; create (again, if not already there) a "2009-05" folder inside the "2009" folder; and, finally, save a message (marked as seen) inside the "2009-05" folder. 1 LOGIN XXXXXXXX XXXXXXXX1 OK Logged in. 2 STATUS user.stanford.2009 (MESSAGES)* STATUS "user.stanford.2009" (MESSAGES 0) 2 OK Status completed. 3 STATUS user.stanford.2009.2009-05 (MESSAGES)* STATUS "user.stanford.2009.2009-05" (MESSAGES 3) 3 OK Status completed. 4 APPEND user.stanford.2009.2009-05 (\Seen) {4043} + OK (message text here . . .) 4 OK [APPENDUID 1243306507 4] Append completed. 5 LOGOUT* BYE Logging out The above works perfectly when I'm talking to my Cyrus server. However, when I tried the same thing with Dovecot, I got a folder named "user.stanford.2009" in the "stanford" account's Maildir, and then another folder named "user.stanford.2009.2009-05" (again, in the Maildir -- NOT nested in the "user.stanford.2009" folder) -- and the message was stored in the "user.stanford.2009.2009-05" folder. I tried changing my Perl script to use "INBOX" instead of "user.stanford" -- but the result was basically the same, except I got new folders named "INBOX.2009" and "INBOX.2009.2009-05" directly in my archival account's Maildir. Finally, I tried omitting any prefix at all on the folder names, and I got new folders named "2009" and "2009.2009-05" -- again, directly in Maildir -- no nesting of one folder within another. I suppose I actually have two issues here -- the lack of folder nesting (even with LAYOUT=fs), and also Dovecot's failure to recognize a "user.XXX." prefix on a mailbox name as designating user XXX's inbox (something that seems to work fine on Cyrus). My Cyrus server currently has over 1,600 folders and subfolders, so I absolutely can't / won't consider switching it to Dovecot unless I can get the nested filesystem layout working. Any thoughts? -- Rich Wales / richw(a)richw.org / richw(a)stanford.edu Wikipedia: http://en.wikipedia.org/wiki/User:Richwales Facebook: http://www.new.facebook.com/profile.php?id=206680

2 1

[Dovecot] compile errors on latest hg trunk
by reg9009 26 May '09

26 May '09

Hi, I think there are some files missing (regarding auth mech-external): compile error (did fresh autogen.sh): gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-auth -I../../src/lib-sql -I../../src/lib-settings -I../../src/lib-ntlm -I../../src/lib-otp -I../../src/lib-master -DAUTH_MODULE_DIR=\""/opt/dovecot-2.0/lib/dovecot/auth"\" -DPKG_LIBEXECDIR=\""/opt/dovecot-2.0/libexec/dovecot"\" -DPKG_RUNDIR=\""/opt/dovecot-2.0/var/run/dovecot"\" -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -MT mech-digest-md5.o -MD -MP -MF .deps/mech-digest-md5.Tpo -c -o mech-digest-md5.o mech-digest-md5.c mv -f .deps/mech-digest-md5.Tpo .deps/mech-digest-md5.Po make[3]: *** Keine Regel vorhanden, um das Target Â»mech-external.oÂ«, benÃ¶tigt von Â»dovecot-authÂ«, zu erstellen. Schluss. make[3]: Verlasse Verzeichnis '/home/inst/dovecot-2.0/dovecot-2-0-304238bbd36c/src/auth' make[2]: *** [all-recursive] Fehler 1 make[2]: Verlasse Verzeichnis '/home/inst/dovecot-2.0/dovecot-2-0-304238bbd36c/src' make[1]: *** [all-recursive] Fehler 1 make[1]: Verlasse Verzeichnis '/home/inst/dovecot-2.0/dovecot-2-0-304238bbd36c' make: *** [all] Fehler 2 (It's german environment, but means there is no rule to make target mech-external.o, needed by dovecot-auth). root@171:/home/inst/dovecot-2.0/dovecot-2-0-304238bbd36c/src# find . -name mech-dig* ../auth/.deps/mech-digest-md5.Po ../auth/mech-digest-md5.c ../auth/mech-digest-md5.o root@171:/home/inst/dovecot-2.0/dovecot-2-0-304238bbd36c/src# find . -name "*exte*" ../auth/.deps/mech-external.Po and compile error: gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-auth -I../../src/lib-sql -I../../src/lib-settings -I../../src/lib-ntlm -I../../src/lib-otp -I../../src/lib-master -DAUTH_MODULE_DIR=\""/opt/dovecot-2.0/lib/dovecot/auth"\" -DPKG_LIBEXECDIR=\""/opt/dovecot-2.0/libexec/dovecot"\" -DPKG_RUNDIR=\""/opt/dovecot-2.0/var/run/dovecot"\" -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -MT mech-digest-md5.o -MD -MP -MF .deps/mech-digest-md5.Tpo -c -o mech-digest-md5.o mech-digest-md5.c mv -f .deps/mech-digest-md5.Tpo .deps/mech-digest-md5.Po make[3]: *** Keine Regel vorhanden, um das Target »mech-external.o«, benÃ¶tigt von »dovecot-auth«, zu erstellen. Schluss. make[3]: Verlasse Verzeichnis '/home/inst/dovecot-2.0/dovecot-2-0-304238bbd36c/src/auth' make[2]: *** [all-recursive] Fehler 1 make[2]: Verlasse Verzeichnis '/home/inst/dovecot-2.0/dovecot-2-0-304238bbd36c/src' make[1]: *** [all-recursive] Fehler 1 make[1]: Verlasse Verzeichnis '/home/inst/dovecot-2.0/dovecot-2-0-304238bbd36c' make: *** [all] Fehler 2 (It's german environment, but means there is no rule to make target mech-external.o, needed by dovecot-auth). Regards, Sebastian

2 1

[Dovecot] Segfault with dovecot -n / dovecot 2.0
by ja nein 26 May '09

26 May '09

Hi all, and while trying to get some environmental stuff via dovecot -n, I got a segfault (dovecot is not in system path): /opt/dovecot-2.0/sbin/dovecot -c /etc/dovecot-2.0/sql/dovecot.conf -n # 2.0.UNSTABLE: /etc/dovecot-2.0/sql/dovecot.conf # OS: Linux 2.6.24-23-xen x86_64 Ubuntu 8.04.2 nfs Segmentation fault stat("/home/dovecot/mail/", {st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0 open("/etc/mtab", O_RDONLY) = 6 fstat(6, {st_mode=S_IFREG|0644, st_size=480, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff654983000 read(6, "/dev/sda2 / ext3 rw,noatime,nodi"..., 4096) = 480 stat("/", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0 stat("/proc", {st_mode=S_IFDIR|0555, st_size=0, ...}) = 0 stat("/sys", {st_mode=S_IFDIR|0755, st_size=0, ...}) = 0 stat("/var/run", {st_mode=S_IFDIR|0755, st_size=400, ...}) = 0 stat("/var/lock", {st_mode=S_IFDIR|S_ISVTX|0777, st_size=40, ...}) = 0 stat("/dev", {st_mode=S_IFDIR|0755, st_size=12820, ...}) = 0 stat("/dev/shm", {st_mode=S_IFDIR|S_ISVTX|0777, st_size=40, ...}) = 0 stat("/dev/pts", {st_mode=S_IFDIR|0755, st_size=0, ...}) = 0 stat("/home/dovecot", {st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0 close(6) = 0 munmap(0x7ff654983000, 4096) = 0 write(1, "# OS: Linux 2.6.24-23-xen x86_64"..., 51# OS: Linux 2.6.24-23-xen x86_64 Ubuntu 8.04.2 nfs ) = 51 lseek(1, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) getsockname(1, 0x7fff5c986f50, [18446744069414584348]) = -1 ENOTSOCK (Socket operation on non-socket) --- SIGSEGV (Segmentation fault) @ 0 (0) --- +++ killed by SIGSEGV +++ Process 30890 detached Version is still dovecot 2.0 hg latest. Regards, Sebastian

3 2

[Dovecot] Converting mbox files with dots in names to Maildir
by Kenneth Porter 26 May '09

26 May '09

I tried to run convert-tool from dovecot-1.2-0.rc2 on a tree of mbox files with some containing dots in the filenames and got this failure: # /usr/libexec/dovecot/convert-tool ken /home/ken mbox:/home/ken/mail maildir:/home/ken/Maildir Error: Mailbox conversion: Couldn't create mailbox Lists.WINE.patches: Mailbox already exists Error: Internal failure *** glibc detected *** /usr/libexec/dovecot/convert-tool: double free or corruption (fasttop): 0x08ce6cc8 *** The directory in question contains these files: # ls Lists/WINE/ announce bugs cvs devel patches patches.20050130 Will I need to go through the (large) file tree and rename all files with dots in the names? If so, anyone have a script that will do that? (Changing the dot to dash would be fine with me.)

2 5

[Dovecot] lda deliver per instance sieve configuration
by J.P. Trosclair 26 May '09

26 May '09

I'd like to override the sieve settings in dovecot.conf for a deliver instance that is being run from a custom archiving script. This is dovecot 1.0.15 on debian lenny. Is this possible? Doesn't appear to be looking through the WIKI. If it's not any suggestions? The problem is the user specific sieve scripts override where the archived mail is supposed to be stored (maildir:~/.Archives.YYYY-MM) so I'd like to disable their sieve scripts while the archived mail delivery via deliver is taking place. Thanks, J.P.

2 1

[Dovecot] Separate home and mail folders problem on delivery
by Николай Бочев 26 May '09

26 May '09

Hello, I am using dovecot 1.2rc series on my mail server combined with postfix ( virtual users with postgre ). I have setup separate home and mail locations. It works fine ( with sieve etc. ). The user home folders are in /home/vmail/%d/%n and mailboxes are in /srv/mail/%d/%n . The permissions are fine and everything is working except in the following case : If a user does not have a home dir already crated ( the home dirs get auto created when creating a sieve script through managesieve for example ), and he recieves a message with an attachment, the delivery fails with the following error : May 19 10:47:28 mail postfix/pipe[2759]: 969531007B: to=<office(a)grandstarco.com>, relay=dovecot, delay=2296, delays=2296/0.2/0/0.06, dsn=4.3.0, status=deferred (temporary failure) The Dovecot deliver log says : > 2009-05-19 10:47:28 deliver(office(a)grandstarco.com): Error: creat(/home/vmail/grandstarco.com/office/.temp.mail.dodo.bg.2760.1242719248… failed: No such file or directory > 2009-05-19 10:47:28 deliver(office(a)grandstarco.com): Error: copy: i_stream_read() failed: No such file or directory > 2009-05-19 10:47:28 deliver(office(a)grandstarco.com): Error: sieve: msgid=<1242716935.24056.6.camel(a)shiny.bgservice.local>: failed to store into mailbox 'INBOX': Internal error occurred. Refer to server log for more information. [2009-05-19 10:47:28] > 2009-05-19 10:47:28 deliver(office(a)grandstarco.com): Error: sieve: script /home/vmail/global.sieve failed with unsuccessful implicit keep Here's my dovecot -n dovecot -n # 1.2.rc4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.27-11-server x86_64 Ubuntu 8.10 ext3 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve ssl_ca_file: /etc/dovecot/certs/cacert.pem ssl_cert_file: /etc/dovecot/certs/cert.pem ssl_key_file: /etc/dovecot/certs/key.pem ssl_key_password: 1234 ssl_cipher_list: ALL:!LOW:+HIGH:+MEDIUM:+LOW:+SSLv2:+EXP login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_greeting: Dodo.bg IMAP Ready. mail_privileged_group: vmail mail_uid: 1001 mail_gid: 1001 mail_location: maildir:/var/mail/%d/%n mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): quota imap_quota fts fts_squat acl imap_acl expire mail_log autocreate mail_plugins(imap): quota imap_quota fts fts_squat acl imap_acl expire mail_log autocreate mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve mail_log_max_lines_per_sec: 0 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(managesieve): namespace: type: private separator: / location: maildir:/srv/mail/%Ld/%Ln/ inbox: yes list: yes subscriptions: yes namespace: type: shared separator: / prefix: shared/%%u/ location: maildir:/srv/mail/%%d/%%n/:INDEX=~/shared/%%u list: children auth default: mechanisms: plain login master_user_separator: * verbose: yes debug: yes passdb: driver: passwd-file args: /etc/dovecot/passwd.masterusers pass: yes master: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql-master.conf pass: yes master: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: convert_mail: maildir:/srv/mail/%d/%n fts: squat quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 quota_warning2: storage=80%% /usr/local/bin/quota-warning.sh 80 quota: dict:user::proxy::quota quota_rule: *:storage=1GB quota_rule2: Trash:storage=10%% quota_rule3: spam:storage=20%% acl: vfile acl_shared_dict: file:/srv/mail/%d/shared-mailboxes.db expire: Trash/* 7 Spam 30 spam 7 expire_dict: proxy::expire mail_log_events: delete undelete expunge copy mailbox_delete mailbox_rename append mail_log_fields: uid box msgid size from subject sieve: /home/vmail/%d/%n/.dovecot.sieve sieve_dir: ~/sieve sieve_before: /home/vmail/global.sieve autocreate: Trash autocreate2: spam autosubscribe: Trash autosubscribe2: spam dict: quota: pgsql:/etc/dovecot/dovecot-dict-sql-quota.conf expire: pgsql:/etc/dovecot/dovecot-dict-sql-expire.conf Any ideas on what am i doing wrong are welcome

2 1

[Dovecot] convert-tool skip_dotfiles is not the actual option
by Kenneth Porter 26 May '09

26 May '09

Looking at the source for convert-tool.c, I see this: "Usage: <username> <home dir> <source mail env> <dest mail env>\n" \ " [skip_broken_mailboxes] [skip_dotfiles] [alt_hierarchy_char=<c>]" else if (strcmp(argv[i], "skip_dotdirs") != 0) set.skip_dotdirs = TRUE; Looks like the usage line needs to be fixed (dovecot-1.2-0.rc2).

2 1

[Dovecot] maillog plugin issue
by Ibrahim Harrani 26 May '09

26 May '09

Hello, I just installed dovecot 1.2-rc4 on FreeBSD with qmail and vpopmail. I am using roundcube webmail to test(read,delete,move mails) I configured mail-log plugin according to http://wiki.dovecot.org/Plugins/MailLog log fields: mail_log_fields: uid box msgid size This but in the log file I only that something like that. May 23 15:37:14 IMAP(test(a)mydomain.com): 127.0.0.1 Info: copy: uids=7, box=Spam, dest=Spam, size=540 May 23 15:37:14 IMAP(test(a)mydomain.com): 127.0.0.1 Info: delete: uids=7 May 23 15:37:14 IMAP(test(a)mydomain.com): 127.0.0.1 Info: expunge: uids=7, size=540 May 23 15:37:14 IMAP(test(a)mydomain.com): 127.0.0.1 Info: Disconnected: Logged out bytes=205/1558 I don't see msgid etc? Also I added flag_change to mail_log_events and from, subject, flags to mail_log_fields. I don't see anything about from, subject, flags etc. I only see the following lines. May 23 15:05:49 mail dovecot: IMAP(test(a)mydomain.com): flag_change: uids=5 May 23 15:05:49 mail dovecot: IMAP(test(a)mydomain.com): Disconnected: Logged out bytes=168/1027 Here is my config. Did I miss something? dovecot -n # 1.2.rc4: /opt/mail/imap/etc/dovecot.conf # OS: FreeBSD 6.3-RELEASE-p9 amd64 log_path: /var/log/dovecot.log protocols: imap pop3 ssl: no disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /opt/mail/imap/libexec/dovecot/imap-login login_executable(imap): /opt/mail/imap/libexec/dovecot/imap-login login_executable(pop3): /opt/mail/imap/libexec/dovecot/pop3-login login_greeting: Welcome first_valid_uid: 89 mail_debug: yes mail_executable(default): /opt/mail/imap/libexec/dovecot/imap mail_executable(imap): /opt/mail/imap/libexec/dovecot/imap mail_executable(pop3): /opt/mail/imap/libexec/dovecot/pop3 mail_plugins(default): mail_log mail_plugins(imap): mail_log mail_plugins(pop3): quota mail_log mail_plugin_dir(default): /opt/mail/imap/lib/dovecot/imap mail_plugin_dir(imap): /opt/mail/imap/lib/dovecot/imap mail_plugin_dir(pop3): /opt/mail/imap/lib/dovecot/pop3 mail_log_prefix: %Us(%u): %r mail_log_max_lines_per_sec: 0 auth default: passdb: driver: vpopmail userdb: driver: passwd userdb: driver: vpopmail plugin: mail_log_events: delete undelete expunge copy mailbox_delete mailbox_rename mail_log_group_events: mail_log_fields: uid box msgid size quota: maildir

2 1

[Dovecot] little problem with lmtp and 8bitmime mail from:
by ja nein 26 May '09

26 May '09

Hi all, I'm very excited to see lmtp in dovecot now. Starting to play, I encountered following problem: With senders in normal mail address format, everything is delivered right, lmtp works as expected. But with 8bitmime senders, like kernel mailing list, lmtp returns a 5.5.4 not supported and mail is bounced. Is this expected, meaning just not implemented, or could it be a bug? E.g.: Problem: MAIL FROM:<linux-kernel-owner+info=40xxxx.com-S1753112AbZEYPtt(a)vger.kernel.org> BODY=8BITMIME RCPT TO:<info(a)xxxx.com> DATA vstream_fflush_some: fd 12 flush 130 vstream_buf_get_ready: fd 12 got 89 501 5.5.4 Unsupported options Ok: MAIL FROM:<some.address(a)somewhere.com> RCPT TO:<info(a)xxxx.com> DATA vstream_fflush_some: fd 12 flush 71 vstream_buf_get_ready: fd 12 got 36 250 2.1.0 OK 250 2.1.5 OK 354 OK Dovecot version is latest hg dovecot-2.0 trunk. Regards, Sebastian

2 1

[Dovecot] Deleting mail account?
by David Reid 25 May '09

25 May '09

This is likely a daft question, but how do I remove a mailbox from a dovecot server? I'd like to simply remove it from the disk as well, deleting any messages, indexes etc etc Is there a way? david !DSPAM:1715,4a1a817434922186719589!

2 6

[Dovecot] creating skeleton Maildir
by Giuliano Gavazzi 25 May '09

25 May '09

Dear all, when I had a courier installation still in place I used to create the Maildir tree for a new user using its maildirmake (IIRC) utility. Now that I had to rebuild a server from scratch, and using dovecot did not install courier, I have to create Maildirs without that utility. I seem to remember that libexec/imap could be called in a way to create the Maildir and its required subfolders (.Sent, .Drafts, etc). Do I remember correctly? If so what are the command line options? I cannot find pointers in the wiki or elsewhere. If not, I will just create a template and script the whole process. Thanks Giuliano

3 4

[Dovecot] Dovecot Max Connections & mbox vs. maildir format - Recommendations?
by V S Rao 24 May '09

24 May '09

>> I had big issues with timeouts until I realize the the imap and mbox format >> isnt a good choice if your users have huge naiboxes. >> At my server there were users with mailboxes arount 700MB to over 1GB. each >> time one of those users checked their email >> the imap server had to open this huge file and parse it, causing I/O issues. >> The only solution I found it was switch from mbox format to maildir format. I am changing the subject line to reflect the discussion. I too have a similar case with large mailboxes. My user mix is 70% POP3 vs. 30% IMAP. Would maildir still be the best recommended format? What is the opinion of the experts here? The reason I am asking is that I am preparing to upgrade my mail server to RHEL 5.3. That would mean my Dovecot will be atleast 1.0.7, which should not be bad. If the recommendation is that I go from mbox format to Maildir, I want to plan that as well. However I don't want to land up in a situation where, I have to move back from Maildir to mbox again. So please do advice me on the best. BTW one question: Assuming that my server has enough resources, ( 8 CPU @ 3.0GHz, 8GB RAM, 2Gbps FC Storage directly attached to the server & Gigabit NIC) what is the maximum number of concurrent connections that Dovecot can handle POP3 + IMAP combined? And I am asking for all the processes combined: POP3-login processes IMAP-login processes POP3 sessions IMAP sessions Any TCP/IP kernel parameters to be tuned? or maybe in dovecot.conf? Any advice will be immensely valuable to me while doing the migration. Thanks and Regards V S Rao

2 1

[Dovecot] How can I put a file back in Maildir folder?
by Allan Cassaro 23 May '09

23 May '09

Hi, I have a problem: today, when I ran "fsck" some file was linked to "lost+find" folder... After some hours I has all files mapped (File / User). So... how can I put this files back in Maildir folder of this users? I tried with: cat $file | deliver -d username but without success... Any help will be appreciated! Thanks!

2 2

[Dovecot] How to add new features to sieve?
by Ed W 23 May '09

23 May '09

Hi, I like the idea of switching from maildrop to dovecot deliver+sieve, however, we use a couple of features that I'm not sure how to migrate: - We query the userdb and make some user specific params available to the filtering script (invented example, but say number of days to not repeat for the vacation script) - We have a fairly advanced filter (perl) which mangles the email in very specific ways to support users over low bandwidth connections. The email is delivered twice, once to an "Archive" folder and again to the inbox after being mangled. How to integrate this "mangling" script? - We have some custom routes for certain types of SMS messages, ie we have a free email to SMS option for certain networks. Could this be integrated and caught in "alert" functionality (how is the sms backend actually configured anyway?) I think the answer is to write one or more new sieve functions to provide this functionality, but can you give me a quickstart guide on how to do this? Certainly the first requirement is quite an interesting and generic plugin "lookup_db" type function which must have wider utility. The second requirement is a bit more specific, kind of like an xfilter wrapper which could be setup by the administrator I guess? Thanks Ed W

1 0

Re: [Dovecot] How to run Dovecot as IMAP Proxy?
by V S Rao 22 May '09

22 May '09

> > You will not get any support for 0.99 here, unless Timo can provide it. > It is *that* old, and your decision to use it - regardless of your > claimed reason - is baffling. I admit I am running a pretty old version and frankly speaking I was not hoping for any support. Let RH earn their money we paid as support. As you would have noticed I was looking for help in running Dovecot as a IMAP Proxy without the need to setup SQL etc. I only went into details to give clarity. I really appreciate all the responses and suggestions. >> We use recent Dovecot from atrpms.net with RHEL 5.3. Userbase is 25.000. >> Dovecot runs on three machines - as master (proxy) and with two slaves. >> The system is stable. We hardly need to touch it. I would be very much interested in knowing the details of your setup as I am suffering here with only 6000+ users. And that too with a config, which I frankly think is an overkill for our requirement. However maybe I should start a separate thread for that? Thanks and Regards V S Rao.

1 0

Re: [Dovecot] How to run Dovecot as IMAP Proxy?
by V S Rao 22 May '09

22 May '09

So I guess I will take the problem to imapproxy group and find out if I can get a clue to the issue I am facing. BTW, just to confirm once again, are there any known issues with Dovecot & imapproxyd? Because I find it strange that there should be around 8000 established connections between Squirrelmail and imapproxyd & around 400 connections between imapproxyd and Dovecot while on the mail server I see only a couple of connections (typically around 40). Or is it some configuration in Dovecot which is causing this kind of behavior, as I did not notice this while running uw-imap. Regards V S Rao

4 3

[Dovecot] v1.2.rc4 released
by Timo Sirainen 22 May '09

22 May '09

http://dovecot.org/releases/1.2/rc/dovecot-1.2.rc4.tar.gz http://dovecot.org/releases/1.2/rc/dovecot-1.2.rc4.tar.gz.sig I'm pretty hopeful that virtual mailbox code is finally crash-free. If people don't find many problems from this release, I'm thinking that rc5 could come in a couple of weeks and that would be renamed to v1.2.0 after a week or so if no one has reported bugs. v1.2.rc4 2009-05-17 Timo Sirainen <tss(a)iki.fi> * If /dev/arandom exists, use it instead of /dev/urandom (OpenBSD). * When logging to a file, the lines now start with a timestamp instead of "dovecot: " prefix. + IMAP: When multiple commands are pipelined, try harder to combine their mailbox syncing together. For example with Maildir pipelining STORE 1:* +FLAGS \Deleted and EXPUNGE commands the files won't be unnecessarily rename()d before being unlink()ed. + imap-proxy: Send backend's CAPABILITY if it's different from what was sent to client before. + IMAP: struct mail now keeps track of all kinds of statistics, such as number of open()s, stat()s, bytes read, etc. These fields could be exported by some kind of a statistics plugin (not included yet). + IMAP: SEARCH command now dynamically figures out how to run about 0.20 .. 0.25 seconds before seeing if there's other work to do. This makes the SEARCH performance much better. - Fixes to shared mailbox handling. - Fixes to virtual mailboxes. - THREAD command could have crashed. - Fixes to expire-tool. - mbox: Don't break if From_-line is preceded by CRLF (instead of LF). - dict process wasn't restarted after SIGHUP was sent to master.

2 1

[Dovecot] v1.1.15 released
by Timo Sirainen 22 May '09

22 May '09

http://dovecot.org/releases/1.1/dovecot-1.1.15.tar.gz http://dovecot.org/releases/1.1/dovecot-1.1.15.tar.gz.sig The command pipelining fix is pretty interesting. Wonder how much it improves performance, especially when deleting lots of messages from a large mailbox. v1.1.15 2009-05-17 Timo Sirainen <tss(a)iki.fi> + IMAP: When multiple commands are pipelined, try harder to combine their mailbox syncing together. For example with Maildir pipelining STORE 1:* +FLAGS \Deleted and EXPUNGE commands the files won't be unnecessarily rename()d before being unlink()ed. - IMAP: SEARCH command was slower than necessary in a large mailbox. - deliver: When forwarding messages, if -f parameter was given, it should have been used as the Return-Path. - Maildir saving: Fixed race condition bugs in uidlist handling, causing files to be given new UIDs sometimes. - mbox: Don't crash when expunging all messages and file doesn't end with [CR]LF. - expire-tool: Use mail_uid and mail_gid settings if userdb doesn't return uid/gid. - Berkeley DB dict: Transaction rollbacking was implemented wrong. - zlib plugin: Some email / FETCH command combinations could have disconnected the client or sent compressed garbage.

2 1

Re: [Dovecot] Authenticating with /etc/passwd
by June Qiu 22 May '09

22 May '09

Apologies for the confusion.. But I finally got what you meant. Yes, the version exists, but was omitted in the extract of the email. --- On Thu, 5/21/09, Charles Marcus <CMarcus(a)Media-Brokers.com> wrote: > From: Charles Marcus <CMarcus(a)Media-Brokers.com> > Subject: Re: [Dovecot] Authenticating with /etc/passwd > To: dovecot(a)dovecot.org > Date: Thursday, May 21, 2009, 10:17 PM > On 5/21/2009 10:11 AM, June Qiu > wrote: > > it is as displayed > > So there's some weird dovecot -n bug that doesn't show the > dovecot > version if the 'Warning: fd limit...' warning is output? > > > --- On Thu, 5/21/09, Charles Marcus <CMarcus(a)Media-Brokers.com> > wrote: > > > >> From: Charles Marcus <CMarcus(a)Media-Brokers.com> > >> Subject: Re: [Dovecot] Authenticating with > /etc/passwd > >> To: "June Qiu" <qljune(a)yahoo.com> > >> Cc: dovecot(a)dovecot.org > >> Date: Thursday, May 21, 2009, 6:39 PM > >> On 5/20/2009, June Qiu (qljune(a)yahoo.com) > >> wrote: > >>> dovecot -n: > >>> > >>> Warning: fd limit 256 is lower than what > Dovecot can > >> use under full load (more than 768). Either grow > the limit > >> or change login_max_processes_count and > max_mail_processes > >> settings > >>> # OS: SunOS 5.10 sun4u > >>> info_log_path: /var/log/dovecot.log > >> Is the missing version line a copy/paste error? Or > did the > >> warning > >> obscure it somehow? > > > -- > > Best regards, > > Charles >

1 0

Re: [Dovecot] How to run Dovecot as IMAP Proxy?
by V S Rao 22 May '09

22 May '09

Thanks for the many responses and views. I have taken RH support for my mail server only and so have to ensure they support me. So am going with their recommended version which is 0.99.x. Now on the webmail I have migrated to RHEL 5.3 and the dovecot being used there is 1.0.7.x. So that should support proxying, right? BTW, originally I did not go to Redhat. I moved from uw-imap to Dovecot 1.1.14 on the mail server for POP3. The problem of POP3 timeouts continued and I could not find any reason why POP3 was timing out when 400+ concurrent IMAP sessions were working fine. Moreover other network services such as SMTP, Telnet, SSH etc were working fine. Had the box installed behind a IPS box to see if there were any DoS attacks, but had to rule that out. As a last resort, paid RH for support and they made me downgrade Dovecot from 1.1.14 to 0.99.x. Surprisingly the moment I downgraded dovecot, the problem shifted to IMAP & remained ever since. So naturally they told me uw-imap was the problem and made me move to Dovecot 0.99.x for IMAP as well, but no improvement. But the surprising thing, as I mentioned in my original post, IMAP works fine on command line, with clients such as Outlook, THunderbird etc., but Webmail is very slow that its almost not available. BTW webmail was also running on RHEL 4.0. Seeing that the problem existed in webmail alone I upgraded webmail to RHEL 5.3 with all the latest RH supported packages on a new hardware. Any ideas to help me debug this issue would be of great help as I am stuck on this issue for almost a month now. Oh, btw regarding stats, I don't have a measure, but when webmail was working the login was well within 5 seconds. Now it takes forever (more than a min) or timeouts most of the time. Even after login, any request such as opening a mail or changing to a mail folder was well within 5 seconds. Now again it takes forever or timeouts most of the time. Thanks and Regards V S Rao ----- Original Message ----- From: "Timo Sirainen" <tss(a)iki.fi> To: "Dovecot Mailing List" <dovecot(a)dovecot.org> Sent: Friday, May 22, 2009 12:32:24 AM GMT +05:30 Chennai, Kolkata, Mumbai, New Delhi Subject: Re: [Dovecot] How to run Dovecot as IMAP Proxy? On Thu, 2009-05-21 at 11:47 -0700, Seth Mattinen wrote: > Yes, that too. My point was not to judge Dovecot's performance based on > a 0.99 version. ;) I've successfully used several versions of dovecot > 1.1.x with imapproxyd and IMAP-only webmail clients. Do you have any numbers about how much faster it works with imapproxyd vs. without?

4 3

Re: [Dovecot] How to run Dovecot as IMAP Proxy?
by V S Rao 21 May '09

21 May '09

Hi Timo, Thanks for the response. Apologize, but my responses are going to be a bit lengthy. > I have migrated from uw-imap to Dovecot for POP3 & IMAP service. I run > webmail using squirrelmail. When running uw-imap I used to run > up.imapproxyd on the webmail server for faster responses. After > migrating to Dovecot, I find that up.imapproxyd does not work well > with dovecot. > Why not? Here are my observations. I have around 6000+ mailboxes and roughly the same number of users. Earlier the mail server (running sendmail + uw-imap for POP3 & IMAP) would have around 80 pop3 connections (peak) and around 300 IMAP connections, concurrent. (ps -aef | grep imap | wc -l or ps -aef | grep pop3 | wc -l). There have been cases where I have observed upto 500 concurrent IMAP sessions. The IMAP connections are from a webmail server running Apache with Squirrelmail. The observation was that response was slow & so based on the suggestion on Squirrelmail for performance improvement we have installed up-imapproxyd on the squirrelmail machine. There was a significant improvement in the response times for the users, because of caching. After that I encountered some strange problems of POP3 timing out for users (earlier I did post that problem in this forum). I opened a ticket with Redhat and naturally they refused to support me with uw-imap running. So switched to Dovecot 0.99.x (I run the server on RHEL 4.0 and that is the max version supported by Redhat for that version). Ever since I did that POP3 works fine but now webmail is almost not available to the users. People usually get "connection dropped by IMAP server". However the IMAP server seems to work fine. Checked through manual "telnet <ip.address.of.mailserver> 143 & also through other client such as outlook & Thunderbird. I noticed that while the number of established connections for the webmail to mail server was shown as around 40 to 50 on the mail server, the same is shown as around 700 on webmail server. { netstat -an | grep :143 | grep ESTABLISHED | wc -l }. imapproxyd is configured to listen on port 9143 on the localhost and communicates to the mail server on std port 143. What was really bizzare is that when I check for the number of connections on port 9143 it shows around 8000! netstat -an | grep :9143 | grep ESTABLISHED | wc -l So I disabled the imapproxyd on the webmail & now at least the 50 connections are consistent. However the response is extremely slow and so was contemplating on the idea of trying out using another IMAP Proxy server and hence the question. > I don't understand Databases and don't want to install mysql etc for a > simple thing like IMAP PRoxy. > Do you just want it to proxy everyone to a single destination or to > different servers based on username? If you want everyone to the same > destination, why do you even want to use a proxy? I want to proxy all user to the same server. The idea being as explained above benefit from caching. > My question is can Dovecot be run as a IMAP PRoxy without the hassle > of setting up mysql etc? I use /etc/passwd for auth on the actual > dovecot server running IMAP & POP3. > Using checkpassword or SQLite would probably be the easiest solution. Or > generation of a passwd-file, but you'd have to keep it updated if users > change. If I used a passwd file on the webmail machine, running dovecot as a Proxy how would I configure dovecot on the webmail server? It has to accept connections from the squirrelmail and talk to the mailserver. I can do a rsync of the passwd file from the mail server to the webmail server using a small script whenever the file changes on the mail server. Of course the fundamental question from your response, I guess is, without a proxy why is the webmail slow? If proxy is not my problem, can you pls throw some light on why I am facing performance issues on my webmail alone? Thanks and Regards V S Rao

4 6

[Dovecot] IMAP Get Savedate plugin
by Alaa Ibrahim 21 May '09

21 May '09

Hi, I want to add a feature to the fetch command in IMAP, by enabling it to return the save date, when I request the SAVEDATE parameter. I want to use this for my webmail application, so I can show the users the deleted date when they are viewing the Trash folder. I was able to put it directly into the code (patch attached), but I was wondering if there is a way to put it as a plugin instead. Can somebody guide me on how to do that. Thanks a lot. ------------------------- Play the best Flash Games on the web with Maktoob Shams Games. http://games.maktoob.com/

2 3

[Dovecot] How to run Dovecot as IMAP Proxy?
by V S Rao 21 May '09

21 May '09

Hi All, I have migrated from uw-imap to Dovecot for POP3 & IMAP service. I run webmail using squirrelmail. When running uw-imap I used to run up.imapproxyd on the webmail server for faster responses. After migrating to Dovecot, I find that up.imapproxyd does not work well with dovecot. I tried to use dovecot as IMAP PRoxy server as per the document http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy I don't understand Databases and don't want to install mysql etc for a simple thing like IMAP PRoxy. My question is can Dovecot be run as a IMAP PRoxy without the hassle of setting up mysql etc? I use /etc/passwd for auth on the actual dovecot server running IMAP & POP3. Thanks V S Rao

2 1

[Dovecot] crypt() failure is possible
by Arkadiusz Miskiewicz 21 May '09

21 May '09

dovecot 1.1.15 in src/auth/password-scheme.c contains: static bool crypt_verify(const char *plaintext, const char *user ATTR_UNUSED, const unsigned char *raw_password, size_t size) { const char *password; if (size == 0) { /* the default mycrypt() handler would return match */ return FALSE; } password = t_strndup(raw_password, size); return strcmp(mycrypt(plaintext, password), password) == 0; } but according to man page crypt() can fail and NULL is returned then. On other hand glibc info page is silent about such failure. The thing is that I'm seeing crypt() failure here with new glibc 2.10.1 built with nss backend for crypt(), so it would be good to handle such case. (crypt failure was due to improper nss packaging but it could also happen if somehow nss file becomes corrupted) -- Arkadiusz Miśkiewicz PLD/Linux Team arekm / maven.pl http://ftp.pld-linux.org/

2 1

Re: [Dovecot] Authenticating with /etc/passwd
by June Qiu 21 May '09

21 May '09

it is as displayed --- On Thu, 5/21/09, Charles Marcus <CMarcus(a)Media-Brokers.com> wrote: > From: Charles Marcus <CMarcus(a)Media-Brokers.com> > Subject: Re: [Dovecot] Authenticating with /etc/passwd > To: "June Qiu" <qljune(a)yahoo.com> > Cc: dovecot(a)dovecot.org > Date: Thursday, May 21, 2009, 6:39 PM > On 5/20/2009, June Qiu (qljune(a)yahoo.com) > wrote: > > dovecot -n: > > > > Warning: fd limit 256 is lower than what Dovecot can > use under full load (more than 768). Either grow the limit > or change login_max_processes_count and max_mail_processes > settings > > # OS: SunOS 5.10 sun4u > > info_log_path: /var/log/dovecot.log > > Is the missing version line a copy/paste error? Or did the > warning > obscure it somehow? > > > -- > > Best regards, > > Charles >

2 1

[Dovecot] Authenticating with /etc/passwd
by June Qiu 21 May '09

21 May '09

I am trying to do authentication with /etc/passwd and something is not working right for me. Pls help! When i try to authenticate via pop3, I get: -ERR Authentication failed. In the logs, I get: May 21 11:14:07 Info: auth(default): client in: AUTH 1 PLAIN service=pop3 secured lip=127.0.0.1 rip=127.0.0.1 lport=110 rport=32774 resp=AGp1bmUAU0lORzNlcnQ= May 21 11:14:07 Info: auth(default): passwd(test1,127.0.0.1): lookup May 21 11:14:07 Info: auth(default): passwd(test1,127.0.0.1): Password mismatch May 21 11:14:07 Info: auth(default): passwd(test1,127.0.0.1): CRYPT(password) != 'x' May 21 11:14:09 Info: auth(default): client out: FAIL 1 user=test1 May 21 11:14:17 Info: pop3-login: Disconnected (auth failed, 1 attempts): user=<test1>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured dovecot -n: Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 768). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: SunOS 5.10 sun4u info_log_path: /var/log/dovecot.log protocols: imap pop3 listen(default): 127.0.0.1:143 listen(imap): 127.0.0.1:143 listen(pop3): * ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: IMAP ready. login_processes_count: 2 mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: passwd userdb: driver: passwd args: blocking=yes

3 2

[Dovecot] mkdir no permission
by Anna Obertacke 21 May '09

21 May '09

Hallo list-member, Please ignore my bad english. I cant wright bad but i understand well. I reinstalled my server and have big problems with (V 1.1.11) dovecot now. I work with Ubuntu 9.04 Server and want to use pop and imap with easy configuration. I fetch all my Mails on the server and want to look them up by apple Mail. Until yesterday dovecot only worked after I logged in and did something on the server, for example call "mail" oder call "mail.log". After reinstall yesterday it works no more. The new entry in log is "Internal error". Anything else was before yesterday also. My Error Logs: mail.log: May 19 10:00:38 ubuntu dovecot: POP3(annalein): mkdir(/home/annalein/Maildir/cur) failed: Permission denied (euid=1000(annalein) egid=1000(annalein) missing +w perm: /home/ annalein) May 19 10:00:38 ubuntu dovecot: POP3(annalein): Couldn't open INBOX: Internal error occurred. Refer to server log for more information. [2009-05-19 10:00:38] May 19 10:00:38 ubuntu dovecot: POP3(annalein): Couldn't open INBOX top=0/0, retr=0/0, del=0/0, size=0 May 19 10:00:43 ubuntu dovecot: IMAP(annalein): mkdir(/home/annalein/Maildir/cur) failed: Permission denied (euid=1000(annalein) egid=1000(annalein) missing +w perm: /home/ annalein) syslog: May 19 10:22:34 ubuntu dovecot-auth: pam_sm_authenticate: Called May 19 10:22:34 ubuntu dovecot-auth: pam_sm_authenticate: username = [annalein] May 19 10:22:34 ubuntu dovecot-auth: Warning: Using default salt value (undefined in ~/.ecryptfsrc) May 19 10:22:36 ubuntu dovecot-auth: Passphrase key already in keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: ecryptfs_add_passphrase_key_to_keyring: Error adding auth tok with sig [e54db404244691b7] to the keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: Error attempting to add filename encryption key to user session keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: Passphrase key already in keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: ecryptfs_add_passphrase_key_to_keyring: Error adding auth tok with sig [d7f23dd0d7e04b51] to the keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: Error attempting to add passphrase key to user session keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: There is already a key in the user session keyring for the given passphrase. My configuration ist in dovecot-postfix.conf. I can't call it by dovecot -n. But i changed allmost nothing from default- disable_plaintext_auth=no Some points in the file: protocols = imap pop3 imaps pop3s managesieve mail_location = maildir:~/Maildir Please tell what i should show you. Thank you for help. Greetings, Anna Obertacke.

3 5

Re: [Dovecot] Migration questions...
by Richard Hobbs 21 May '09

21 May '09

Hello again, people, I have been reading all of the emails sent back and forth recently, and reading many web pages, and I have a new draft of my migration plan. If anyone has the time and generosity to read through this latest plan for me and let me know if you spot any potential problems with it, i'd really appreciate it. FYI, we're moving from a Debian 3.1/exim/uw-imapd/qpopper/mbox setup to a Debian 5.0/exim/dovecot/maildir setup, and the final version of this document can hopefully become a useful guide for lots of people in future too, if I get it right :-) Anyway... here's the plan... 1. Install Debian with exim, spamassassin, mysqld (for Horde/IMP) and mailman. Use ReiserFS for the indexes and data. XFS would be second choice for filesystem, and this is something of a religious argument, but Dovecot's own page states that ReiserFS is a better choice, and loads of pages on the Internet say that one or the other is better - there's no clear winner, really, so ReiserFS (the FS we already know and trust) wins the battle. 2. Run an online update. 3. Setup IPMI and monitor it from Nagios. 4. Install HotSaNIC to monitor historical system stats. 5. Install and configure Dell OpenManage Server Administrator (or whatever it's called) to monitor hardware, and make sure we will be emailed if a hard drive fails. 6. Rsync homedirs and inboxes onto new server, ready for initial exim configuration. 7. Configure exim as per existing mail server and test that mailing lists and normal email works. You should now have the existing mail delivery solution on the brand new hardware. 8. Configure Spamassassin as per current configuration and test. 9. Configure mailman as per current configuration and test. 10. Once mail delivery is sorted, add "deb http://www.backports.org/debian lenny-backports main contrib non-free" into "/etc/apt/sources.list" and run "aptitude update && aptitude install debian-backports-keyring && aptitude update". 11. Install dovecot (at the time of writing, this was version 1.1.13-2). 12. Run the conversion utility (use "mb2md.py" from http://wiki.dovecot.org/Migration/MailFormat because "convert-tool" doesn't preserve msg UIDs) to convert all existing "mbox" mailboxes into "maildir" mailboxes, for use with Dovecot. 13. Setup exim to use Dovecot's delivery agent ("deliver") so the indexes are updated on mail delivery instead of when the mailbox is requested and also to use the new maildir format. 14. Setup dovecot for IMAP and POP3 and test. *****THIS IS WHERE THE REPEATABLE SECTION BEGINS***** 15. Stop exim and dovecot services. 16. Rsync homedirs and inboxes onto new server again. 17. Run the conversion utility (use "mb2md.py" from http://wiki.dovecot.org/Migration/MailFormat because "convert-tool" doesn't preserve msg UIDs) to convert all existing "mbox" mailboxes into "maildir" mailboxes. 18. Start exim and dovecot services and test SMTP, Spamassassin, mailman, IMAP and POP3. *****THIS IS WHERE THE REPEATABLE SECTION ENDS***** 19. Once everything is working perfectly, send an email to the entire company instructing them what to do after the outage and arrange an outage and do the following steps as soon as the outage begins: a. Unplug DMZ switch from firewall to make delivered mail wait at the sender. b. Stop exim, IMAP, POP3 and dovecot services on both mail servers. c. Rsync homedirs and inboxes onto new server again. d. Run the conversion utility (use "mb2md.py" from http://wiki.dovecot.org/Migration/MailFormat because "convert-tool" doesn't preserve msg UIDs) to convert all existing "mbox" mailboxes into "maildir" mailboxes. e. Start exim and dovecot services and test SMTP, Spamassassin, mailman, IMAP and POP3. f. Reconfigure my own mail client to point to the new mail server (192.168.2.3). g. Reconfigure firewall to think the mail server is now on 192.168.2.3 instead of 192.168.2.2. h. Prepare an email in webmail somewhere in the world, ready to send to a user on our mail server. i. Plug DMZ switch back into firewall and begin monitoring exim logs to check that mail is being delivered. j. Send the email from webmail and check that is goes through exim perfectly and is sitting in the users Inbox. NOTE: We now have a working mail delivery solution! k. Start dovecot IMAP and POP3 and test both. l. Once exim and dovecot are both working against live mailboxes, tell everyone the outage is over. 20. Install and configure Horde & IMP to access email via IMAP. 21. Reconfigure backup script to make sure new server is backed up. 22. Modify Nagios config to monitor new server. 23. DONE! Thanks in advance, everyone! :-) Richard. Brandon Lamb wrote: > On Fri, May 15, 2009 at 5:02 AM, Richard Hobbs > <richard.hobbs(a)crl.toshiba.co.uk> wrote: >> Seth Mattinen wrote: >>> Richard Hobbs wrote: >>>> Seth Mattinen wrote: >>>>> Phillip Macey wrote: >>>>>> On 14/05/2009 5:11 PM, Steffen Kaiser wrote: >>>>>>> On Wed, 13 May 2009, Richard Hobbs wrote: >>>>>>>> The main complaint we have from users is that their IMAP Inbox, with >>>>>>>> 5000 emails in it takes ages to appear, and no amount of coaxing will >>>>>>>> convince them to split their inbox into multiple folders. >>>>>>> Oh, we serve Maildir via Dovecot IMAP and 5000 messages per folder are >>>>>>> a wimp. Problems start if the user: >>>>>> We are having some performancec issues on our server at the moment - all >>>>>> I can put it down to is the large size of some maildirs. Eg. `ls -ld >>>>>> Maildir/cur` might show a directory >20Mb in size for some of our users >>>>>> (20-30k emails). >>>>>> (Performance issues == everything is running ok then all of a sudden >>>>>> load avg goes through the roof, system cpu time goes crazy. Reading mail >>>>>> grinds to a halt. Then everything recovers just as suddenly and the load >>>>>> avg gradually returns to normal levels) >>>>> Are you using ext3 by chance? Vanilla ext3 without directory indexing >>>>> (or whatever it's called) *hates* directories with a lot of files - like >>>>> maildir. Personally, I use XFS, which doesn't suffer from this problem >>>>> since it uses b-trees instead of a table(!) like ext3 does. >>>> This raises another question for me actually... >>>> >>>> We will have one volume for indexes and another volume for data (using >>>> maildir). We will be using the latest stable Debian Linux distro. >>>> >>>> Any opinions on the best filesystem to use? We would normally go >>>> ReiserFS for large volumes, and ext3 for small volumes because of the >>>> unlimited inodes in reiserfs, but i understand that support for that is >>>> beginning to disappear given that Hans Reiser got into a bit of trouble >>>> a few years ago. >>>> >>>> Anyway... that would leave ext3, but is there a better choice i could >>>> make in this instance? We do want performance, of course, but also >>>> complete reliability and resilience when it comes to system crashes >>>> etc... we do *not* want data corruption, and ext3 we know has a very >>>> good journalling and data recovery methods. Well... they're very mature, >>>> anyway. >>>> >>> I used to use ext3, ran into its horrible performance even with >>> directory indexing enabled, went to XFS and never looked back. All of my >>> systems are Debian stable. Reiser3 is part of the kernel so I wouldn't >>> worry about that; Namesys considered it complete and stopped work on it >>> long before the whole murder thing. Both Reiser3 and XFS have worse >>> reputations than ext3, however, I've seen ext3 filesystems hosed beyond >>> repair, too. All my XFS filesystems have battery-backed cache >>> controllers, so it hasn't happened to me yet, hopefully never. ;) One >>> catch with XFS (such as with LVM) to keep in mind is you can't ever >>> shrink it, only grow. >> Trouble is... i've been googling this as well, just now, and loads of >> people say XFS has the better performance, but loads of other people say >> ReiserFS has the better performance. >> >> We have battery backed up RAID controllers too, in this new system, and >> the systems are UPSd, so on that basis i'm still none the wiser! lol >> >> I appreciate your experience with XFS is a positive one, but even the >> dovecot web site says XFS might now be a good choice... >> >> http://wiki.dovecot.org/MailboxFormat/Maildir >> >> What a tough decision! I know it probably won't make too much difference >> in my situation, but i want this to be a very long-term solution, so >> want to do it right first time! >> >> Any other opinions on XFS vs Reiserfs with Dovecot maildir? >> >> Thanks again! >> >> Richard. >> >> >>> ext3 is mature but IMHO completely unsuitable for a busy mail server or >>> any situation where you'll have a bajillion of files in one directory. >>> The exact point at which ext3 will screw you over obviously depends on >>> many factors. But when it happens it'll probably be painful to reformat >>> to something better. >>> >>> ~Seth >>> >>> ______________________________________________________________________ >>> This email has been scanned by the MessageLabs Email Security System. >>> For more information please visit http://www.messagelabs.com/email >>> ______________________________________________________________________ >>> >>> >> -- >> Richard Hobbs (IT Specialist) >> Toshiba Research Europe Ltd. - Cambridge Research Laboratory >> Email: richard.hobbs(a)crl.toshiba.co.uk >> Web: http://www.toshiba-europe.com/research/ >> Tel: +44 1223 436999 Mobile: +44 7811 803377 > > We have been using XFS on our raids for the last few years. We have > fairly new hardware, and using maildir. Delivering over nfs using > exim+dovecot deliver. pop3/imap is near instant load on our webmail. > We have about 16,000 email accounts with ~175 imap+pop3 connections > open all the time. 20 drive sata2 raid 10. amd quad core 9850 with 8 > gigs ram. load sits about 0.30 - 0.45 all day/night. Last I checked > backups were 30-45 minutes, 413 gigs. 6,403,942 files. > > ______________________________________________________________________ > This email has been scanned by the MessageLabs Email Security System. > For more information please visit http://www.messagelabs.com/email > ______________________________________________________________________ > > -- Richard Hobbs (IT Specialist) Toshiba Research Europe Ltd. - Cambridge Research Laboratory Email: richard.hobbs(a)crl.toshiba.co.uk Web: http://www.toshiba-europe.com/research/ Tel: +44 1223 436999 Mobile: +44 7811 803377

2 2

Re: [Dovecot] pop3 gives a permission denied error on chdir
by Kenneth Gonsalves 21 May '09

21 May '09

On Wednesday 20 May 2009 01:20:37 you wrote: > On Tue, 2009-05-19 at 13:35 +0530, Kenneth Gonsalves wrote: > > May 19 09:16:10 greenchilly dovecot: chdir(/home/vmail/example.com/john) > > failed with uid 5000: Permission denied > > .. > > > I have looked at the archives and see that the problem has been reported > > before, but cannot find any solution. Dovecot as LDA has no problem > > accessing and writing mails to the directory as UID 5000. I suspect that > > it is trying to access some other directory and the error message is > > misleading. The directory /home/vmail/example.com/john is owned by user > > vmail with UID 5000. Any clues? > > And all the directories before that are also available for that user? yes > Are you using NFS? Are you using SELinux or something? no > Anyway that > chdir() syscall really failed with that error message. The reason for > that is less clear then.. v1.1+ would give a much nicer error message > here telling exactly what is wrong.. I have installed version 1.1.13, here is the mail log: May 20 10:33:54 greenchilly dovecot: auth(default): new auth connection: pid=1181 May 20 10:34:07 greenchilly dovecot: auth(default): client in: AUTH^I1^IPLAIN^Iservice=pop3^Isecured^Ilip=127.0.0.1^Irip=127.0.0.1^Ilport=110^Irport=42418^Iresp=<hidden> May 20 10:34:07 greenchilly dovecot: auth-worker(default): pam(john(a)example.com,127.0.0.1): lookup service=dovecot May 20 10:34:07 greenchilly dovecot: auth-worker(default): pam(john(a)example.com,127.0.0.1): #1/1 style=1 msg=Password: May 20 10:34:10 greenchilly dovecot: auth-worker(default): pam(john(a)example.com,127.0.0.1): unknown user May 20 10:34:10 greenchilly dovecot: auth(default): sql(john(a)example.com,127.0.0.1): query: SELECT email as user, passwd as password FROM view_users WHERE email='john(a)example.com'; May 20 10:34:10 greenchilly dovecot: auth(default): client out: OK^I1^Iuser=john(a)example.com May 20 10:34:10 greenchilly dovecot: auth(default): master in: REQUEST^I3^I1166^I1 May 20 10:34:10 greenchilly dovecot: auth(default): passwd(john(a)example.com,127.0.0.1): lookup May 20 10:34:10 greenchilly dovecot: auth(default): passwd(john(a)example.com,127.0.0.1): unknown user May 20 10:34:10 greenchilly dovecot: auth(default): master out: USER^I3^Ijohn@example.com^Iuid=5000^Igid=5000^Ihome=/home/vmail/example.com/john May 20 10:34:10 greenchilly dovecot: Fatal: chdir(/home/vmail/example.com/john) failed with uid 5000: Permission denied May 20 10:34:10 greenchilly dovecot: child 1182 (pop3) returned error 89 (Fatal failure) May 20 10:34:10 greenchilly dovecot: pop3-login: Login: user=<john(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured and here is the session info: lawgon@greenchilly:~$ telnet localhost pop3 Trying 127.0.0.1... Connected to localhost.localdomain. Escape character is '^]'. +OK Dovecot ready. user john(a)example.com +OK pass summersun +OK Logged in. Connection closed by foreign host. -- regards Kenneth Gonsalves Associate NRC-FOSS http://nrcfosshelpline.in/web/

3 7

Re: [Dovecot] Authenticating with /etc/passwd
by June Qiu 21 May '09

21 May '09

Solved. Thanks, Timo! --- On Thu, 5/21/09, Timo Sirainen <tss(a)iki.fi> wrote: > From: Timo Sirainen <tss(a)iki.fi> > Subject: Re: [Dovecot] Authenticating with /etc/passwd > To: "June Qiu" <qljune(a)yahoo.com> > Cc: dovecot(a)dovecot.org > Date: Thursday, May 21, 2009, 11:31 AM > On Wed, 2009-05-20 at 20:16 -0700, > June Qiu wrote: > > I am trying to do authentication with /etc/passwd and > something is not working right for me. Pls help! > .. > > May 21 11:14:07 Info: auth(default): > passwd(test1,127.0.0.1): CRYPT(password) != 'x' > > /etc/passwd doesn't have passwords nowadays. They're in > /etc/shadow. > Either user passdb shadow or passdb pam. > >

1 0

[Dovecot] compile error with patched dovecot-1.2.rc4
by Carlos Xavier 21 May '09

21 May '09

Hi, I just downloaded the dovecot-1.2.rc4.tar.gz to do some tests. I coud compile it and generate the package with no trouble on my Slackware 12.2.0 Then as I wanted to try the patchs available at http://hg.dovecot.org/dovecot-1.2/# I downloaded them and applied at once. When I tried to compile once again I got this error: cmd-thread.o: In function `cmd_thread': cmd-thread.c:(.text+0x219): undefined reference to `mail_thread_type_parse' ../../src/lib-storage/libstorage.a(mail-search-build.o): In function `search_arg_build': mail-search-build.c:(.text+0x10b9): undefined reference to `mail_thread_type_parse' collect2: ld returned 1 exit status make[3]: *** [imap] Error 1 make[3]: Leaving directory `/usr/local/src/dovecot-1.2.rc4/src/imap' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/usr/local/src/dovecot-1.2.rc4/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/usr/local/src/dovecot-1.2.rc4' make: *** [all] Error 2 I removed the patched folder and untarred it again, but at this time I decided to apply one patch at time just to see witch one gave me the trouble. When the first set of patch ( http://hg.dovecot.org/dovecot-1.2/rev/d42a8623a008 ) was applied I got the same error. Just to confirm it was this set of patch, I applied all the other set of patchs leaving that one not applied and the compilation went out with no trouble. As im not a expert so I am sending this report to the list in order to get it fixed. Best Regards, Carlos Xavier.

2 2

[Dovecot] Problem with pam/krb5 auth on AIX 5.3
by Jonathan Siegle 20 May '09

20 May '09

I'm using pam to authenticate users against my krb5 realm. Here is the problem scenario: User test2 attempts to login and their password is not expired so dovecot says: 0 login test2 myfavoritepassword 0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH] Logged in 1 logout * BYE Logging out 1 OK Logout completed. User test1 attempts to login, but their password is expired. So dovecot says: 0 login test1 myfavoritepassword 0 NO d expired User test2 attempts to login and their password is not expired. But dovecot still says: 0 login test2 myfavoritepassword 0 NO d expired If I kill the pid with name "dovecot-auth -w", user test2 can login just fine unless I login with the user test1 before trying user test2. So it seems like something is getting cached. I'm running imap-login out of inetd, in case that matters. In my dovecot.conf, I don't have any caching/authentication variables activated. I don't see anything obvious to type in passdb pam{ } to type. For debug, I've enable pam for telnet and tested that without error. Also, the logs show that test2 This is dovecot revision 9062:694714d59cd9 . Looking at the logs, I see user test2 authenticate correctly in all instances. thanks, Jonathan

2 2

[Dovecot] %d does not expand to domain
by Giuliano Gavazzi 20 May '09

20 May '09

Hello, dovecot-1.1.7 on FreeBSD 7.1. Usernames have dot in them (like uname.example for a user in example.com) in dovecot.conf I have: mail_location: maildir:/userhomes/maildirs/%d/%n/Maildir and for authentication: username_format: %Ln In the client, tried with CONE and Mail.app, I put the username as: uname.example(a)example.com So, the authentication works fine, as it extracts the uname.example from the uname.example(a)example.com supplied. The mail_location does not: Apr 27 17:21:26 drum dovecot: imap-login: Login: user=<uname.example>, method=PLAIN, rip=88.149.183.86, lip=88.149.202.106, TLS Apr 27 17:21:26 drum dovecot: IMAP(name.example): Effective uid=1301, gid=1301, userhomes=/userhomes/example.com/uname Apr 27 17:21:26 drum dovecot: IMAP(uname.example): Namespace: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes Apr 27 17:21:26 drum dovecot: IMAP(uname.example): maildir: data=/ userhomes/maildirs//uname.example/Maildir Apr 27 17:21:26 drum dovecot: IMAP(uname.example): maildir++: root=/ userhomes/maildirs//uname.example/Maildir, index=, control=, inbox=/ userhomes/maildirs//uname.example/Maildir it looks like the %d expands to the empty string. Could this be due to the "." in the username? Thanks Giuliano

3 12

[Dovecot] maildir filename with eg. ,S=1000, omitted
by Joseph LP 20 May '09

20 May '09

Hello. I encountered the wiki entry on maildirs not long ago. In it, it is suggested that the use of ,S= and ,W= may improve performance as dovecot does not need to calculate size itself. While my maildir filenames have ,W=, they lack ,S=. I've grepped dovecot.conf, but I can find no option to address this. Regards, Joseph

2 1

[Dovecot] Deleting everything left from lazy expunge
by Romer Ventura 20 May '09

20 May '09

Hello, My storage is running low and i was wondering what would be the best and easy way of deleting everything within the "deleted" and "expunged" folders for every user...? My mail resides in: /srv/mail/vmail/MYDOMAIN.COM/<users>/Maildir/ Thanks..!

3 3

Re: [Dovecot] using postfix+dovecot+squirrell+amavisd and spam folder per user
by ESGLinux 20 May '09

20 May '09

HI again, I cant get this work. I have followed these instructions: http://wiki.dovecot.org/LDA/Postfix Now I have this in my configuratio files: main.cf: .... virtual_transport = dovecot ..... master.cf: .... dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${recipient} ... dovecot.conf: protocol lda { postmaster_address = postmaster(a)xeridia.com mail_plugins = quota cmusieve #sieve_global_dir = /etc/dovecot/sieve/ sieve = /etc/dovecot/sieve/dovecot.sieve log_path = /var/log/dovecot-deliver.log info_log_path = /var/log/dovecot-deliver.log } but when I send mails I don´t see that it uses dovecot lda at all: this is an extract of the log: ay 20 12:55:49 SBPRUEBAS postfix/cleanup[7049]: 9546769339: message-id=< 20090520105549.9546769339(a)SBPRUEBAS.dominio.com> May 20 12:55:49 SBPRUEBAS postfix/qmgr[7039]: 9546769339: from=< root(a)xerida.com>, size=314, nrcpt=1 (queue active) May 20 12:55:49 SBPRUEBAS amavis[6965]: (06965-01) (!!)WARN: all primary virus scanners failed, considering backups May 20 12:55:51 SBPRUEBAS postfix/smtpd[7056]: connect from unknown[127.0.0.1] May 20 10:55:51 SBPRUEBAS postfix/smtpd[7056]: 85D616933C: client=unknown[127.0.0.1] May 20 12:55:51 SBPRUEBAS postfix/cleanup[7049]: 85D616933C: message-id=< 20090520105549.9546769339(a)SBPRUEBAS.dominio.com> May 20 12:55:51 SBPRUEBAS postfix/qmgr[7039]: 85D616933C: from=< root(a)xerida.com>, size=760, nrcpt=1 (queue active) May 20 12:55:51 SBPRUEBAS amavis[6965]: (06965-01) Passed CLEAN, < root(a)xerida.com> -> <prueba(a)pruebax2.com>, Message-ID: < 20090520105549.9546769339(a)SBPRUEBAS.dominio.com>, mail_id: eaVsoxO6Fxg4, Hits: 1.374, size: 314, queued_as: 85D616933C, 1926 ms May 20 12:55:51 SBPRUEBAS postfix/smtp[7052]: 9546769339: to=< prueba(a)pruebax2.com>, relay=127.0.0.1[127.0.0.1]:10024, delay=2, delays=0.03/0.01/0.01/1.9, dsn=2.0.0, status=sent (250 2.0.0 Ok, id=06965-01, from MTA([127.0.0.1]:10025): 250 2.0.0 Ok: queued as 85D616933C) May 20 12:55:51 SBPRUEBAS postfix/qmgr[7039]: 9546769339: removed May 20 12:55:51 SBPRUEBAS postfix/virtual[7061]: 85D616933C: to=< prueba(a)pruebax2.com>, relay=virtual, delay=0.03, delays=0.01/0.01/0/0.01, dsn=2.0.0, status=sent (delivered to maildir) May 20 12:55:51 SBPRUEBAS postfix/qmgr[7039]: 85D616933C: removed I think I´m missing something, but I dont know what. thanks in advance for your answers ESG

2 2

[Dovecot] %d isn't expanded
by Roy Sigurd Karlsbakk 20 May '09

20 May '09

Hi all I have a box running Debian Lenny 5.0.1 and Dovecot 1.0.15. The user query given below does not expand %d, making logins fail. The password query seems to work well, according to the mysql query log. Any ideas why this happens? Best regards roy user_query = SELECT 'maildir:/var/spool/dovecot/%d/%n' as mail, uid, gid, domain FROM users WHERE username = '%n' and domain = '%d' # 1.0.15: /etc/dovecot/dovecot.conf log_path: /var/log/dovecot/dovecot.log log_timestamp: %Y-%m-%d %H:%M:%S disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login verbose_proctitle: yes mail_privileged_group: mail mail_location: maildir:/var/spool/dovecot/%d/%n auth default: default_realm: eventchief.com verbose: yes debug: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf -- Roy Sigurd Karlsbakk (+47) 97542685 / 98013356 roy(a)karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk.

1 0

[Dovecot] Dovecot is emptying Maildir folders
by Alexander Johannes 20 May '09

20 May '09

Hello, i have a annoying problem with dovecot after updating to 1.1.14. Dovecot seems to empty all cur/ and new/ Folders in the Maildir of a particular user several times a day (3 times so far). It leaves only unread messages in their place. All Index-Files are getting updated and reflect the "empty"-State of the Mailbox. A quick look over the logfiles reveals nothing which seems to be relevant to this malfunction. The error_log is empty for the relevant timeframe. There is no Expire/Expunge-Plugin running. Fortunately i have a hourly backup-snapshot to restore the Mailboxes, but this is obviously no solution. How can i debug this problem? Any advice is welcome. System: FreeBSD 7.1-RELEASE, dovecot-1.1.14, dovecot-managesieve-0.10.6, dovecot-sieve-1.1.6 (all installed via the ports-tree), exim-4.69_3 Clients: Thunderbird, Mail.app both IMAP only Regards, Alex

4 7

[Dovecot] using postfix+dovecot+squirrell+amavisd and spam folder per user
by ESGLinux 20 May '09

20 May '09

Hi All, As I say in the subject I use postfix, dovecot with squirrellmail as webmail and amavisd as spam control, My problem is that all the spam I catch is send to /var/lib/amavis/virus but I want to send this mails to the spam folder of each user. This way the user can see the mails and determine if they are really spam or false positive. I dont know exactly what element of the system is the responsible to do that (dovecot, amavis, posttix) any suggest? (although only be the initial point to look for it) Thanks in advance ESG

2 3

[Dovecot] expire-tool segmentation fault
by LEVAI Daniel 20 May '09

20 May '09

Hi! I'm using Dovecot 1.1.15 on OpenBSD 4.4. How can I debug this? # /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire- tool Segmentation fault (core dumped) # gdb /usr/local/sbin/dovecot (gdb) run --exec-mail ext /usr/local/libexec/dovecot/expire-tool Starting program: /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire-tool Program received signal SIGTRAP, Trace/breakpoint trap. Cannot remove breakpoints because program is no longer writable. It might be running in another process. Further execution is probably impossible. 0x044628c0 in ?? () (gdb) bt full #0 0x044628c0 in ?? () No symbol table info available. What else could I do? Thanks! Daniel -- LÉVAI Dániel PGP key ID = 0x4AC0A4B1 Key fingerprint = D037 03B9 C12D D338 4412 2D83 1373 917A 4AC0 A4B1

2 4

[Dovecot] National symbols imap search
by Max Ivanov 20 May '09

20 May '09

How does imap server should handle search requests with non latin symbols? Rightnow thunderbird 2.0.0.21 and dovecot1.2rc3 are unable to find any message if I try to search for cyrillic symbols. fts, and squat plugins are enabled

3 2

[Dovecot] POP3 with lot of messages
by Matt 20 May '09

20 May '09

Running Dovecot 1.1.8. Have several email accounts with thousands of messages in them that are left on server. Is there anyway to speed up POP3 access without switching to IMAP? Doubt it but thought I would ask. Matt

3 4

[Dovecot] pop3 gives a permission denied error on chdir
by Kenneth Gonsalves 19 May '09

19 May '09

hi, I am running debian lenny standard install and dovecot also as a standard install. I have a problem with POP3 access. The error message is: May 19 09:16:10 greenchilly dovecot: chdir(/home/vmail/example.com/john) failed with uid 5000: Permission denied May 19 09:16:10 greenchilly dovecot: child 26253 (pop3) returned error 89 May 19 09:16:10 greenchilly dovecot: pop3-login: Login: user=<john(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured I have looked at the archives and see that the problem has been reported before, but cannot find any solution. Dovecot as LDA has no problem accessing and writing mails to the directory as UID 5000. I suspect that it is trying to access some other directory and the error message is misleading. The directory /home/vmail/example.com/john is owned by user vmail with UID 5000. Any clues? my config: greenchilly:/etc/dovecot# dovecot -n # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_location: maildir:/home/vmail/%d/%n/Maildir mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: static args: uid=5000 gid=5000 home=/home/vmail/%d/%n allow_all_users=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail -- regards Kenneth Gonsalves Associate NRC-FOSS http://nrcfosshelpline.in/web/

2 1

[Dovecot] Virtual users, local delivery via LDA and LDAP troubles
by Konstantin Khomoutov 19 May '09

19 May '09

We're investigating the possibiliy to migrate our mail system from Sendmail+Cyrus to Sendmail+Dovecot. The system must use authentication against Windows AD (supposedly using LDAP) and must use virtual hosting. So far we managed to work around a bug reported in [1], and IMAP/POP3 authentication on LDAP works OK. LDAP auth is set up using binds (Cyrus and Ejabberd authenticate against the same LDAP server without problems). As we use virtual users, userdb is set to be "static" in a standard way: userdb static { args = uid=10513 gid=10513 home=/var/local/dovecot/%u } After verifying IMAP/POP3 authentication works, I've set up the Dovecot LDA to deliver mail for domain users. This exposed another problem which I don't understand: the delivery program tries to figure out whether the user exists (which is perfectly sensible), it talks to the "master" authentication process which seemingly uses passdb backend to search LDAP. But this fails with the message "passdb doesn't support lookups, can't verify user's existence". [2] suggests it's auth binds that prevent this scheme from functioning correctly, but we can't stop using auth binds as Windows AD doesn't store users' passwords in any way sensible for external consumption. This would also pose unnecessary security risk on the domain, as the account used for initial binding should have had rights to read passwords, and its credentials are placed in the Dovecot configuration file in clear text. I read about "allow_all_users" in [3], but our Sendmail doesn't check whether the target user exists and we don't want to implement this as it logically pertains to the program which actually manages users' mailboxes -- Dovecot in our case. Is there a way to solve the problem at hand within the specified constraints? 1. http://dovecot.org/pipermail/dovecot/2009-May/039540.html 2. http://www.mail-archive.com/dovecot@dovecot.org/msg09449.html 3. http://www.mail-archive.com/dovecot@dovecot.org/msg08848.html

2 1

[Dovecot] what is deliver(1.1.10) doing in /tmp
by Pawel Eljasz 19 May '09

19 May '09

dear all, first part of log snippet is to show a bit of contrast, to me it's peculiar situation it's about messages between local users, actually one user, when I use command line mailx or anther local account to send to A_local user - ok second part is this weir error, it's selinux which prevents deliver write to /tmp, I believe thsese messages are from A_local user cron jobs(to himself) why would dovecot act differently in these scenarios, why would it need /tmp one time and not need it another May 19 14:32:29 whale postfix/pickup[9588]: 725F08F95500: uid=0 from=<root> May 19 14:32:29 whale postfix/cleanup[10877]: 725F08F95500: message-id=<20090519133229.725F08F95500(a)whale.hindhead.local> May 19 14:32:29 whale postfix/qmgr[3083]: 725F08F95500: from=<root(a)hindhead.local>, size=445, nrcpt=1 (queue active) May 19 14:32:30 whale dovecot: auth(default): new auth connection: pid=10883 May 19 14:32:30 whale postfix/smtpd[10883]: connect from localhost.localdomain[127.0.0.1] May 19 14:32:30 whale postfix/smtpd[10883]: 1E96A8F95501: client=localhost.localdomain[127.0.0.1] May 19 14:32:30 whale postfix/cleanup[10877]: 1E96A8F95501: message-id=<20090519133229.725F08F95500(a)whale.hindhead.local> May 19 14:32:30 whale postfix/qmgr[3083]: 1E96A8F95501: from=<root(a)hindhead.local>, size=906, nrcpt=1 (queue active) May 19 14:32:30 whale postfix/smtpd[10883]: disconnect from localhost.localdomain[127.0.0.1] May 19 14:32:30 whale amavis[9369]: (09369-14) Passed CLEAN, <root(a)hindhead.local> -> <pawel(a)hindhead.local>, Message-ID: <20090519133229.725F08F95500(a)whale.hindhead.local>, mail_id: D3qbEK-TL0Hi, Hits: 0.028, size: 445, queued_as: 1E96A8F95501, 650 ms May 19 14:32:30 whale postfix/smtp[10880]: 725F08F95500: to=<pawel(a)hindhead.local>, relay=127.0.0.1[127.0.0.1]:10024, delay=0.67, delays=0.02/0.01/0/0.65, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as 1E96A8F95501) May 19 14:32:30 whale postfix/qmgr[3083]: 725F08F95500: removed May 19 14:32:30 whale deliver(pawel): Loading modules from directory: /usr/lib64/dovecot/lda May 19 14:32:30 whale deliver(pawel): Module loaded: /usr/lib64/dovecot/lda/lib90_cmusieve_plugin.so May 19 14:32:30 whale deliver(pawel): maildir: data=/home/pawel/Maildir May 19 14:32:30 whale deliver(pawel): maildir++: root=/home/pawel/Maildir, index=, control=, inbox=/home/pawel/Maildir _May 19 14:32:30 whale deliver(pawel): cmusieve: Using sieve path: /home/pawel/.dovecot.sieve May 19 14:32:30 whale deliver(pawel): cmusieve: Executing script /home/pawel/.dovecot.sievec_ May 19 14:32:30 whale deliver(pawel): msgid=<20090519133229.725F08F95500(a)whale.hindhead.local>: saved mail to INBOX May 19 14:32:30 whale postfix/local[10884]: 1E96A8F95501: to=<pawel(a)hindhead.local>, relay=local, delay=0.02, delays=0/0.01/0/0.01, dsn=2.0.0, status=sent (delivered to command: /usr/libexec/dovecot/deliver) May 19 14:32:30 whale postfix/qmgr[3083]: 1E96A8F95501: removed and right after above: May 19 14:33:05 whale postfix/pickup[9588]: 2607F8F95500: uid=501 from=<pawel> May 19 14:33:05 whale postfix/cleanup[10877]: 2607F8F95500: message-id=<20090519133305.2607F8F95500(a)whale.hindhead.local> May 19 14:33:05 whale postfix/qmgr[3083]: 2607F8F95500: from=<pawel(a)hindhead.local>, size=2892071, nrcpt=1 (queue active) May 19 14:33:05 whale postfix/smtpd[10883]: connect from localhost.localdomain[127.0.0.1] May 19 14:33:05 whale postfix/smtpd[10883]: 8DC458F95501: client=localhost.localdomain[127.0.0.1] May 19 14:33:05 whale postfix/cleanup[10877]: 8DC458F95501: message-id=<20090519133305.2607F8F95500(a)whale.hindhead.local> May 19 14:33:05 whale postfix/smtpd[10883]: disconnect from localhost.localdomain[127.0.0.1] May 19 14:33:05 whale postfix/qmgr[3083]: 8DC458F95501: from=<pawel(a)hindhead.local>, size=2899979, nrcpt=1 (queue active) May 19 14:33:05 whale deliver(pawel): Loading modules from directory: /usr/lib64/dovecot/lda May 19 14:33:05 whale deliver(pawel): Module loaded: /usr/lib64/dovecot/lda/lib90_cmusieve_plugin.so May 19 14:33:05 whale deliver(pawel): maildir: data=/home/pawel/Maildir May 19 14:33:05 whale deliver(pawel): maildir++: root=/home/pawel/Maildir, index=, control=, inbox=/home/pawel/Maildir May 19 14:33:05 whale deliver(pawel): maildir++: root=/home/pawel/Maildir, index=, control=, inbox=/home/pawel/Maildir _May 19 14:33:05 whale deliver(pawel): cmusieve: Using sieve path: /home/pawel/.dovecot.sieve May 19 14:33:05 whale deliver(pawel): cmusieve: Executing script /home/pawel/.dovecot.sievec_ *May 19 14:33:05 whale deliver(pawel): creat(/tmp/dovecot.deliver..1242739985.10903.8aa6fa47dffdc26d) failed: Permission denied May 19 14:33:05 whale deliver(pawel): copy: i_stream_read() failed: Permission denied* May 19 14:33:05 whale amavis[9395]: (09395-14) Passed CLEAN, <pawel(a)hindhead.local> -> <pawel(a)hindhead.local>, Message-ID: <20090519133305.2607F8F95500(a)whale.hindhead.local>, mail_id: QY0vutvX3AMN, Hits: -, size: 2896598, queued_as: 8DC458F95501, 449 ms May 19 14:33:05 whale postfix/smtp[10880]: 2607F8F95500: to=<pawel(a)hindhead.local>, orig_to=<pawel>, relay=127.0.0.1[127.0.0.1]:10024, delay=3, delays=2.5/0/0/0.45, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as 8DC458F95501) May 19 14:33:05 whale deliver(pawel): msgid=<20090519133305.2607F8F95500(a)whale.hindhead.local>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2009-05-19 14:33:05] *May 19 14:33:05 whale deliver(pawel): sieve runtime error: Keep: Generic Error May 19 14:33:05 whale deliver(pawel): sieve_execute_bytecode(/home/pawel/.dovecot.sievec) failed* May 19 14:33:05 whale postfix/local[10884]: 8DC458F95501: to=<pawel(a)hindhead.local>, relay=local, delay=0.07, delays=0.06/0/0/0.01, dsn=4.3.0, status=deferred (temporary failure) May 19 14:33:05 whale postfix/qmgr[3083]: 2607F8F95500: removed cheers

2 1

[Dovecot] ext3/ext4 performance issue
by Timo Sirainen 19 May '09

19 May '09

Wonder if anyone else has actually noticed this and has some kind of statistics? http://marc.info/?t=124234003300001&r=1&w=2

6 8

[Dovecot] Segfault in deliver server
by Sascha Wilde 19 May '09

19 May '09

Hi Timo, Hi list, I finally got along to test the current dovecot 1.2 with our Kolab Server. And I'm very excited to see all the cool ACL and shared name spaces stuff upstream, thanks a lot Timo! Anyway I just stumbled across a new bug using our metadata-plugin (which in turn uses the dict back end): Making a few annotations requests after another it stops working. dovecot.log sais something like: Feb 03 11:58:21 burlywood3 <info> dovecot[10486]: IMAP(4(a)burlywood3.rgb): metadata_get_metadata_entry: dict key=shared//kolab/var/dovecot/spool/4@burlywood3. rgb/home/maildir/.Calendar//vendor/kolab/folder-type Feb 03 11:58:21 burlywood3 <error> dovecot[10486]: child 10503 (dict) killed with signal 11 Feb 03 11:58:21 burlywood3 <error> dovecot[10486]: IMAP(4(a)burlywood3.rgb): read(/kolab/var/dovecot/run/dict-server) failed: Connection reset by peer Feb 03 11:58:21 burlywood3 <critical> dovecot[10520]: Fatal: dup2(3) failed: Bad file descriptor Feb 03 11:58:21 burlywood3 <error> dovecot[10486]: child 10520 (dict) returned error 89 (Fatal failure) Feb 03 11:58:21 burlywood3 <critical> dovecot[10486]: Panic: file ioloop.c: line 38 (io_add): assertion failed: (fd >= 0) (END) I attached gdb to dict and got this: Program received signal SIGSEGV, Segmentation fault. array_idx_modifiable_i (array=0x38, idx=0) at array.c:10 10 pos = idx * array->element_size; (gdb) bt #0 array_idx_modifiable_i (array=0x38, idx=0) at array.c:10 #1 0x0805e9a2 in sql_pool_unlink (ctx=0x80fb670) at sql-pool.c:64 #2 0x0805ea24 in sql_pool_new (pool=0x80f9470, db_driver=0x80dd498 "sqlite", connect_string=0x810ad78 "/kolab/var/dovecot/lib/metadata-dict.sqlite") at sql-pool.c:97 #3 0x0805bb3c in sql_dict_init (driver=0x80f9ae0, uri=0xbfce9f76 "/kolab/etc/dovecot/metadata-dict.conf", value_type=DICT_DATA_TYPE_STRING, username=0x80fb910 "4(a)burlywood3.rgb") at dict-sql.c:86 #4 0x0805c9ca in dict_init (uri=0xbfce9f6f "sqlite:/kolab/etc/dovecot/metadata-dict.conf", value_type=DICT_DATA_TYPE_STRING, username=0x80fb910 "4(a)burlywood3.rgb") at dict.c:87 #5 0x0805a1b1 in dict_client_connection_input (conn=0x80fb8d0) at dict-server.c:407 #6 0x0806637c in io_loop_handler_run (ioloop=0x80f8a80) at ioloop-epoll.c:202 #7 0x080652fd in io_loop_run (ioloop=0x80f8a80) at ioloop.c:338 #8 0x0805a42d in main () at main.c:122 (gdb) li 5 6 void *array_idx_modifiable_i(struct array *array, unsigned int idx) 7 { 8 size_t pos; 9 10 pos = idx * array->element_size; 11 if (pos >= array->buffer->used) { 12 /* index doesn't exist yet, initialize with zero */ 13 buffer_append_zero(array->buffer, pos + array->element_size - 14 array->buffer->used); (gdb) p array $1 = (struct array *) 0x38 (gdb) p *array Cannot access memory at address 0x38 (gdb) up #1 0x0805e9a2 in sql_pool_unlink (ctx=0x80fb670) at sql-pool.c:64 64 next_ctx = SQL_POOL_CONTEXT(ctx->prev); (gdb) p *ctx $2 = {module_ctx = {reg = 0x0}, prev = 0x0, next = 0x810d2b0, pool = 0x80f9470, refcount = 0, key = 0x80fb638 "sqlite\t/kolab/var/dovecot/lib/metadata-dict.sqlite", orig_deinit = 0x805f229 <driver_sqlite_deinit_v>} (gdb) li 59 prev_ctx->next = ctx->next; 60 } 61 if (ctx->next == NULL) 62 ctx->pool->unused_head = ctx->prev; 63 else { 64 next_ctx = SQL_POOL_CONTEXT(ctx->prev); 65 next_ctx->prev = ctx->prev; 66 } 67 ctx->pool->unused_count--; 68 } (gdb) c Continuing. Program terminated with signal SIGSEGV, Segmentation fault. The program no longer exists It's quite possible, that we got any details in the usage of the dict back end wrong, but I guess that in any case the dict server shouldn't segfault... cheers sascha -- Sascha Wilde OpenPGP key: 4BB86568 http://www.intevation.de/~wilde/ http://www.intevation.de/ Intevation GmbH, Neuer Graben 17, 49074 Osnabrück; AG Osnabrück, HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner

2 2

[Dovecot] Multiple dovecot versions side-by-side
by Max Ivanov 19 May '09

19 May '09

I'm current maintainer of dovecot packages in ALTLinux distro and I plan to make possible to install multiple dovecot versions side-by-side (1.0, 1.1, 1.2) to make upgrade process easier and more robust. Is there any consequences of doing that? I worry about locking maildirs and mboxes, does dovecot handle it correctly if another dovecot process tries to work on same mail location?

2 1

[Dovecot] LDA and postfix with recipient delimiter: documentation
by John Fawcett 18 May '09

18 May '09

Just a comment about the documentation for postfix integration when using receipient delimiter and delivery of user+foo(a)domain.ext to user@domain: http://wiki.dovecot.org/LDA/Postfix I had some issues to get this working, so thought I'd share my experience. Dovecot version 1.2.rc3. Postfix version postfix-2.7-20090511. I have no local (unix) mailboxes, everything is delivered to dovecot, so in postfix I have set mailbox_transport = dovecot. In this case the following syntax taken from the docs does not work: dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${user}@${nexthop} whereas the following does work: dovecot unix - n n - - pipe flags=DRhu user=vmail:mail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${user}@${domain} I think that ${domain} is always what is wanted and only when ${nexthop} happens to have the same value as ${domain} - for example when using a transport table entry like this: /etc/postfix/transport domain.ext dovecot: will the ${user}@${nexthop} form be deliverable. Can anyone see a reason for not using always ${user}@${domain} instead of ${user}@${nexthop}? John

5 6

[Dovecot] dovecot 2.0 (revision 9271:d467712aee77) compile problems on AIX 5.3
by Jonathan Siegle 18 May '09

18 May '09

Having some problems compiling on AIX 5.3 with IBM vac version 8. Programs that I had problems building: test-mail test-imap test-index To fix the undefined symbols problem: ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_end ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_begin ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8 ld: 0711-317 ERROR: Undefined symbol: .charset_is_utf8 ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_str ld: 0711-317 ERROR: Undefined symbol: .message_header_decode_utf8 ld: 0711-317 ERROR: Undefined symbol: .rfc822_parser_init ld: 0711-317 ERROR: Undefined symbol: .rfc822_skip_lwsp ld: 0711-317 ERROR: Undefined symbol: .rfc822_parse_content_type ld: 0711-317 ERROR: Undefined symbol: .rfc2231_parse ld: 0711-317 ERROR: Undefined symbol: .rfc822_parse_mime_token ld: 0711-317 ERROR: Undefined symbol: .rfc822_parse_atom ld: 0711-317 ERROR: Undefined symbol: .message_address_parse ld: 0711-317 ERROR: Undefined symbol: .iconv ld: 0711-317 ERROR: Undefined symbol: .iconv_open ld: 0711-317 ERROR: Undefined symbol: .iconv_close I add this ../lib-charset/.libs/libcharset.a -liconv to the Makefiles (./src/lib-imap/Makefile;./src/lib-index/Makefile;./src/lib-mail/ Makefile) below: $ find . -name Makefile -exec egrep -p libcharset.a {} \; -print clean-noinstPROGRAMS: @list='$(noinst_PROGRAMS)'; for p in $$list; do \ f=`echo $$p|sed 's/$(EXEEXT)$$//'`; \ echo " rm -f $$p $$f"; \ rm -f $$p $$f ; \ done test-imap$(EXEEXT): $(test_imap_OBJECTS) $(test_imap_DEPENDENCIES) @rm -f test-imap$(EXEEXT) $(LINK) $(test_imap_LDFLAGS) $(test_imap_OBJECTS) $ (test_imap_LDADD) $(LIBS) \ ../lib-mail/.libs/libmail.a ../lib-charset/.libs/libcharset.a -liconv ./src/lib-imap/Makefile clean-noinstPROGRAMS: @list='$(noinst_PROGRAMS)'; for p in $$list; do \ f=`echo $$p|sed 's/$(EXEEXT)$$//'`; \ echo " rm -f $$p $$f"; \ rm -f $$p $$f ; \ done test-index$(EXEEXT): $(test_index_OBJECTS) $(test_index_DEPENDENCIES) @rm -f test-index$(EXEEXT) $(LINK) $(test_index_LDFLAGS) $(test_index_OBJECTS) $ (test_index_LDADD) $(LIBS) ../lib-charset/.libs/libcharset.a -liconv ./src/lib-index/Makefile clean-noinstPROGRAMS: @list='$(noinst_PROGRAMS)'; for p in $$list; do \ f=`echo $$p|sed 's/$(EXEEXT)$$//'`; \ echo " rm -f $$p $$f"; \ rm -f $$p $$f ; \ done test-mail$(EXEEXT): $(test_mail_OBJECTS) $(test_mail_DEPENDENCIES) @rm -f test-mail$(EXEEXT) $(LINK) $(test_mail_LDFLAGS) $(test_mail_OBJECTS) $ (test_mail_LDADD) $(LIBS) ../lib-charset/.libs/libcharset.a -liconv ./src/lib-mail/Makefile Then compilation occurs fine. Thanks! Jonathan

2 4

[Dovecot] How to manage Seen flags via sieve?
by Max Ivanov 18 May '09

18 May '09

I use public namespace for group mailboxes. If someone sends email from this mailbox , MTA detects it and delivers copy of that message to mailbox/Sent folder, to keep history of all messages available for every group member. I'd like to set Seen flag on all messages that dovecots deliver puts into "Sent" folder. Is it posible somehow?

2 1

[Dovecot] 1.1.13 squat core dump
by David Halik 18 May '09

18 May '09

While using 1.1.13 and squat with local pine imap on Solaris 9 I had a random core dump today. I was doing a search in a maildir folder with about 2000 emails. Unfortunately, I haven't been able to reproduce it yet, but I wanted to send along the info anyways. Environment: # uname -a SunOS 5.9 Generic_122300-39 sun4u sparc SUNW,Sun-Blade-100 Backtrace: http://pastebin.com/f7aa8bb5 ~# dovecot -n # 1.1.13: /usr/local/etc/dovecot.conf # OS: SunOS 5.9 sun4u protocols: imap imaps pop3 pop3s ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no mail_location: maildir:~/Maildir:INDEX=/heroes/u1/dovecot-index/sparc/index/%u:CONTROL=/heroes/u1/dovecot-index/control/%u mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota fts fts_squat mail_plugins(imap): quota imap_quota fts fts_squat mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): UID%u-%v namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: passdb: driver: pam args: * userdb: driver: passwd plugin: quota: fs fts: squat fts_squat: partial=4 full=4 -- ================================ David Halik System Administrator OIT-CSS Rutgers University dhalik(a)jla.rutgers.edu ================================

5 14

Re: [Dovecot] LDA and postfix with recipient delimiter: documentation
by john.ml＠erba.tv 18 May '09

18 May '09

> Hi John, > no i didnt wrote that, i only have user(a)domain.ext > layout in use currently in my test servers > > -- > Best Regards > > MfG Robert Schetterer > > Germany/Munich/Bavaria > Hi Robert I probably didn't make it clear. The problem with the published syntax is that it does not work for receipient delimiter and delivery to mailbox, except as far as I can see when next_hop is the same as domain, which is not always the case. I think that the documentation should report the syntax with ${domain} instead of ${next_hop}, unless there's something I'm missing, since this should always work. thanks again John

2 1

[Dovecot] migration and conversion from courier
by Giuliano Gavazzi 18 May '09

18 May '09

Dear all, back in January I posted about migration from courier and in particular on the script courier-dovecot-migrate.pl. That script had a bug on BSD (or should I say not-Linux?) type systems*. On FreeBSD (6.1) and MacOSX (10.5) it appended a lot of binary garbage at the end of dovecot-keywords files. On a couple of systems I had not actually run the script with the -- convert option, as I had misunderstood the procedure, so those systems, ironically, are the ones that I migrated better... Now to the issue. My final question at the time was (http://dovecot.org/pipermail/dovecot/2009-January/036292.html) can one delete the dovecot-keywords and rerun the script (leaving alone the dovecot-uidlist)? There is a problem if this cannot be done, as those files have the following structure: 0 flag0 1 flag1 ... m binary garbage [optionally followed by more lines like the last] and if a new keyword is added, the file ends up like (this is copy and paste example): 0 JunkRecorded 1 $NotJunk 2 $Junk 3 Redirected 4 ^A<F0># 5 <B0><96># 6 $Forwarded It does not look like a nice thing to me. I doubt though that the script will cope with flags correctly, as in principle will get the flags from an out of date courierimapkeywords, thus missing any new ones. Perhaps the only solution is to have a new script that deletes the garbage lines and renumbers the following ones, so that the above example would become: 0 JunkRecorded 1 $NotJunk 2 $Junk 3 Redirected 4 $Forwarded and then renames all *g files to *e. Thoughts? Giuliano * This bug was fixed back then by Timo who replaced the script on the site http://www.dovecot.org/tools/courier-dovecot-migrate.pl. But there's no note of the change on the site nor was an announcement made to the list, AFAIK.

2 4

[Dovecot] Quota over NFS
by Flavio Costa 18 May '09

18 May '09

I have accidentaly reply only to Timo, so I'm forwarding to discussion back to the list. Sorry! ---------- Forwarded message ---------- From: Timo Sirainen <tss(a)iki.fi> Date: Mon, May 11, 2009 at 3:12 PM Subject: Re: [Dovecot] Quota over NFS To: Flavio Costa <flavio.cdc(a)gmail.com> On Mon, 2009-05-11 at 15:03 -0300, Flavio Costa wrote: > I get that the server doesn't reply correctly to Dovecot, but the > thing is: why does the LDA works properly? > > May 6 13:15:35 SERVER_NAME deliver(USER_TO): > msgid=<eb4d7eac0905060915y130b9af6i93567e198659d5f7(a)mail.gmail.com>: rejected: Not enough disk space Because it's the NFS server that enforces the quota here. You'd get this error even if you didn't load quota plugin at all. Also note that it's saying "Not enough disk space", not "Quota exceeded" which is the error message from Dovecot v1.0's quota plugin. > And yet, why does 'quota <user>' replies correctly and Dovecot > doesn't? Looking at quota-tools sources, it seemed to ignore the active-check entirely. So I don't know if Dovecot should ignore it too.. > They all obtain the info from the rpc.rquotad running on the > fileserver, right? Yeah. -- Flávio Coutinho da Costa

2 8

[Dovecot] expire plugin error
by Michael Lechtermann 18 May '09

18 May '09

Hi, I am using the db backend for the expire plugin and found the following error message in the logfile: dovecot: Jan 22 10:10:55 Error: dict: secondary db: unable to allocate space from the buffer cache dovecot: Jan 22 10:10:55 Error: dict: Failed to initialize dictionary 'expire' dovecot: Jan 22 10:10:55 Error: IMAP(xxxxxxxxxx): read(/var/dovecot/dict-server) failed: Remote disconnected Anyone know how to fix this? I do not want to use SQL as backend, that would be overkill. # ls -alFh /var/dovecot/dict-server srwxrwxrwx 1 root wheel - 0B Jan 22 10:08 /var/dovecot/dict-server= # dovecot -n # 1.1.8: /etc/dovecot.conf # OS: OpenBSD 4.4 sparc64 ffs base_dir: /var/dovecot/ log_path: /var/log/dovecot.log protocols: imaps pop3s listen: xxxxxxxxxxxx ssl_ca_file: /etc/ssl/xxxxxxxxxxxx.ca ssl_cert_file: /etc/ssl/xxxxxxxxxxxx.crt ssl_key_file: /etc/ssl/private/xxxxxxxxxxxx.key login_dir: /var/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_user: _dovecot mail_max_userip_connections(default): 25 mail_max_userip_connections(imap): 25 mail_max_userip_connections(pop3): 5 first_valid_uid: 10000 last_valid_uid: 19999 first_valid_gid: 100 last_valid_gid: 100 mail_gid: 100 mail_location: mbox:/var/data/mail/%u/mbox:INBOX=/var/data/mail/%u/mbox/inbox:INDEX=/var/dovecot/index/%u mbox_write_locks: fcntl mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): expire imap_quota quota trash zlib mail_plugins(imap): expire imap_quota quota trash zlib mail_plugins(pop3): expire quota zlib mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: passdb: driver: bsdauth userdb: driver: passwd socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: fs:user:noenforcing:mount=/var/data trash: /etc/dovecot-trash.conf expire: Trash 14 expire_dict: proxy:/var/dovecot/dict-server:expire dict: expire: db:/var/lib/dovecot/expire.db

3 5

[Dovecot] pine vs dovecot-zlib (mbox.gz)
by Darabos Edvárd Konrád 18 May '09

18 May '09

Hello! Always reproducible pine vs dovecot-imap-mbox.gz scene has weird errors. - Initial message is OK: [Folder "SAVE.gz" opened with 211 messages READONLY] - Some mails at the end are listed correctly, others are listed with empty sender/size/subject (just numbering). - All mails have no bodies. Full header command produces total blank screen. Even before any error message. Error messages appear during navigation: [{localhost/imap/user="nil"}SAVE.gz : Missing IMAP reply key: )] [MAIL FOLDER "SAVE.gz" CLOSED DUE TO ACCESS ERROR] Seamonkey works with both mbox-es and mbox.gz-s. Mbox-es are working with both SeaMonkey and pine. Technical environment description follows... Thanks, Nil. PS: Tried to gzip other folder, same results. -- 8< -- Dovecot version: 1.0.15 Linux version 2.6.26-1-amd64 (Debian 2.6.26-13) (waldi(a)debian.org) (gcc version 4.1.3 20080704 (prerelease) (Debian 4.1.2-24)) #1 SMP Sat Jan 10 17:57:00 UTC 2009 Debian GNU/Linux 5.0 (lenny) Filesystem: ext3 -- 8< -- ~/.pinerc (all other lines are comments or equal to nothing) smtp-server=localhost inbox-path={localhost}INBOX default-fcc={localhost}Sent feature-list=enable-full-header-and-text, enable-full-header-cmd, enable-8bit-esmtp-negotiation, enable-8bit-nntp-posting character-set=utf-8 folder-collections=IMAP {localhost}[] last-time-prune-questioned=109.2 last-version-used=5.10 ssh-path=/usr/local/bin/imapd.sh color-style=use-termdef current-indexline-style=flip-colors titlebar-color-style=default normal-foreground-color=255,255,255 normal-background-color=000,000,000 meta-message-foreground-color=255,255,255 meta-message-background-color=000,000,255 index-opening-foreground-color=000,000,000 index-opening-background-color=000,255,255 -- 8< -- /usr/local/bin/imapd.sh (just tried to redirect server stderr, did not helped): #!/bin/bash /usr/lib/dovecot/imap 2> /dev/null -- 8< -- # 1.0.15: /etc/dovecot/dovecot.conf Warning: mail_extra_groups setting was often used insecurely so it is now deprecated, use mail_access_groups or mail_privileged_group instead log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3s listen(default): localhost listen(imap): localhost listen(pop3): * ssl_listen: * login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_extra_groups: mail mail_access_groups: mail mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins: zlib mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: passdb: driver: pam userdb: driver: passwd -- 8< --

2 2

[Dovecot] expire plugin + dovecot 1.1.7
by Georg Käfer 18 May '09

18 May '09

Hi, testing expire plugin I get an error message "User lookup failed": /usr/sbin/dovecot --exec-mail ext /usr/libexec/dovecot/expire-tool -test Error: userdb(lukas(a)manual.at) didn't return uid Info: User lookup failed: lukas(a)manual.at Info: gkaefer2(a)manual.at/INBOX.Sent: stop, expire time in future: Wed Mar 31 14:38:33 2010 Reviewing the expires database I see simmilar entries like for gkaefer2(a)manual.at (which is working) lukas(a)manual.at/INBOX.Trash 1241181173 lukas(a)manual.at/INBOX 1270238935 lukas(a)manual.at/INBOX.Sent 1271417514 Dovecot -n # 1.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-gentoo-r3 i686 Gentoo Base System release 1.12.11.1 ext3 syslog_facility: local0 protocols: pop3 pop3s imap imaps ssl_cert_file: /etc/ssl/dovecot/xxx.pem ssl_key_file: /etc/ssl/dovecot/xxx.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_process_per_connection: no login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_process_size: 128 login_processes_count: 10 login_max_processes_count: 256 mail_max_userip_connections(default): 10 mail_max_userip_connections(imap): 10 mail_max_userip_connections(pop3): 30 first_valid_uid: 8 last_valid_uid: 8 first_valid_gid: 12 last_valid_gid: 12 mail_privileged_group: mail mail_uid: mail mail_gid: mail mail_location: maildir:/var/mail/%d/%n/Maildir/:INDEX=/var/mail/%d/%n/indexes mail_debug: yes mail_full_filesystem_access: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota trash expire mail_plugins(imap): quota imap_quota trash expire mail_plugins(pop3): quota expire mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: mail group: mail plugin: quota: maildir:User quota quota_rule: *:storage=500M quota_rule2: *:messages=5000 quota_rule3: Trash:storage=10%% quota_rule4: Spam:storage=20%% quota_warning: storage=90%% /usr/bin/quota-warning.sh 90 quota_warning2: storage=70%% /usr/bin/quota-warning.sh 70 quota_warning3: messages=70%% /usr/bin/quota-warning.sh 70 trash: /etc/dovecot/dovecot-trash.conf expire: Trash 30 Trash/* 30 INBOX.Trash 30 Spam 30 Junk-E-Mail 30 INBOX.Sent 365 Sent 365 INBOX 365 expire_dict: proxy::expire dict: expire: mysql:/etc/dovecot/dovecot-dict-expire.conf dovecot-dict-expire.conf: connect = host=localhost dbname=postfixadmin user=postfixadmin password=xxx # dovecot v1.1 only: table = expires select_field = expire_stamp where_field = mailbox username_field = not_used and users home (lukas@] ls -ltra shows: -rw------- 1 mail mail 0 Mar 31 10:25 dovecot-uidvalidity.49d1d387 drwx------ 4 mail mail 4096 Mar 31 10:25 .. -rw------- 1 mail mail 36 Mar 31 11:53 subscriptions -rw------- 1 mail mail 8 Mar 31 14:31 dovecot-uidvalidity drwx------ 5 mail mail 4096 Apr 1 14:33 .INBOX.Trash drwx------ 2 mail mail 4096 Apr 2 22:09 tmp -rw------- 1 mail mail 161 Apr 2 22:09 dovecot-uidlist drwx------ 2 mail mail 4096 Apr 3 13:42 new drwx------ 2 mail mail 4096 Apr 3 13:42 cur drwx------ 8 mail mail 4096 Apr 16 11:32 . drwx------ 5 mail mail 4096 Apr 16 11:35 .INBOX.Drafts -rw------- 1 mail mail 64 Apr 16 13:31 maildirsize drwx------ 5 mail mail 4096 Apr 22 12:44 .INBOX.Sent any idea what is causing the "didn't return uid" / "User lookup failed:" ? many thanks, Liebe Gruesse Georg Kaefer

2 1

[Dovecot] dovecot 1.2 plugin virtual and shared namespace with thunderbird
by Robert Schetterer 18 May '09

18 May '09

Hi Timo, using latest dovecot 1.2 and latest thunderbird i noticed if using virtual plugin like here with mysql http://wiki.dovecot.org/Plugins/Virtual everthing works like expected until i add a shared namespace Tb then looses its subscriptions under imap to the private namespace only the shared namespace gets shown up , any idea? I dont see something special in the logs why this happens -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 16

[Dovecot] latest update dovecot 1.2 breaks Error: imap dump-capability
by Robert Schetterer 18 May '09

18 May '09

Hi Timo, lates update 1.2 seems to break something it gives me Fio_loop_handle_add: epoll_ctl(1, 0): Operation not permitted Error: imap dump-capability: Couldn't read capability (got 0 bytes) Fatal: Invalid configuration in /etc/dovecot/dovecot.conf at restart, nothing in the conf changed Any Idea? Regards

2 4

[Dovecot] Problem with domain part in user_query in dovecot 1.1.14
by Konstantin 18 May '09

18 May '09

Hi. I'm using dovecot 1.1.14 with pgsql. I tried to configure dovecot to get the domain part in user_query by specifying different variants of auth_username_format variable such as %Lu, %Lu@%Ld, %Lu-at-%Ld and so on... So dovecot gets domain part in password_query, but not in user_query. I noticed the username is changed like this: kostas(a)mgupb.net->kostas in log. For some reason it happens before user_query so there is no domain part already. So one thing that had worked out for me was commenting the below code in src/auth/auth-request.c: if (strcmp(request->user, value) != 0) { /* remember the original username for cache */ if (request->original_username == NULL) { request->original_username = p_strdup(request->pool, request->user); } auth_request_log_debug(request, "auth", "username changed %s -> %s", request->user, value); request->user = p_strdup(request->pool, value); } I know that it is not so good, but it is working for me, now everything is fine, but I want it working without code deformations. What should I do? Thanks. P.S. Such things were in 1.1.11 from which I upgraded to 1.1.14 last night. Dovecot config: # 1.1.14: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.0-RELEASE amd64 protocols: imap imaps pop3 pop3s ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 0 mail_privileged_group: mail maildir_copy_preserve_filename: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_enable_last(default): no pop3_enable_last(imap): no pop3_enable_last(pop3): yes pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login digest-md5 user: vmail username_format: %Lu verbose: yes debug: yes passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix dovecot-sql.conf: driver = pgsql connect = host=localhost dbname=hosting_db user=hosting_db password=adsfweae password_query = SELECT NULL AS password, 'Y' as nopassword, userid AS user FROM main.mail_base WHERE userid = '%n' AND password = '%w' and domain='%d' #password_query = SELECT password, userid AS user FROM main.mail_base WHERE user id = '%n' and domain='%d' #user_query = SELECT '/var/mail/vhosts/' || domain || '/' || userid as mail, '/v ar/mail/vhosts/' || domain || '/' || userid as home, uid, gid FROM main.mail_bas e WHERE userid = '%n' and domain='%d' user_query = SELECT '/var/mail/vhosts/' || domain || '/' || userid as mail, '/va r/mail/vhosts/' || domain || '/' || userid as home, uid, gid FROM main.mail_base WHERE userid = '%n' and domain='%d' default_pass_scheme = PLAIN -- Konstantin <kostas(a)mgupb.net>

2 2

[Dovecot] "Broken mailbox list" with virtual plugin
by Matthijs Kooijman 18 May '09

18 May '09

Hi, I'm using the virtual plugin for a virtual inbox (with dovecot 1.2, r8980), whose dovecot-virtual file looks as follows: INBOX INBOX/Lists INBOX/Bulk INBOX/MaybeSpam Folders/TODO all Everything seems to work fine, but I get the following error in my logfiles: IMAP(matthijs): virtual /home/matthijs/Mail/virtual/INBOX: Broken mailbox list Some investigation of the source code tells me that this error means that there was corrupt data in the index. In particular, the ext_data read from the index was not long enough to contain all mailbox names. Adding some debug code confirms this: ext_size: 187 ext_data: \b0\5\0\0\5\0\0\0E\0\0\0\17\20w\9c\1\0\0\0\5\0\0\0\e9\af\e4I\92\1\0 \0\e7\2\0\0\0\0\0\0\7\0\0\0\b\0\0\0\e8\af\e4IO\3\0\0\5c\5\0\0\0\0\0 \0\8\0\0\0\a\0\0\0\ed\af\e4I\e6\0\0\0j\1\0\0\0\0\0\0\9\0\0\0\f\0\0 \0\3a\b0\e4I1\0\0\0e\0\0\0\0\0\0\0E\0\0\0\c\0\0\0\eb\af\e4I\c8\0\0 \0e\0\0\0\0\0\0\0INBOXINBOX/ListsINBOX/BulkINBOX/MaybeSpamFolders/TO ext_hdr: change_counter=1456 mailbox_count=5 highest_mailbox_id=69 search_args_crc32=2625052695 mailbox: id=1 name_len=5 uid_validity=1239724009 next_uid=402 higest_modseq=743 mailbox name: INBOX mailbox: id=7 name_len=11 uid_validity=1239724008 next_uid=847 higest_modseq=1372 mailbox name: INBOX/Lists mailbox: id=8 name_len=10 uid_validity=1239724013 next_uid=230 higest_modseq=362 mailbox name: INBOX/Bulk mailbox: id=9 name_len=15 uid_validity=1239724090 next_uid=49 higest_modseq=101 mailbox name: INBOX/MaybeSpam mailbox: id=69 name_len=12 uid_validity=1239724011 next_uid=200 higest_modseq=101 virtual /home/matthijs/Mail/virtual/INBOX: Broken mailbox list As you can see in the ext_data dump, the last mailbox name (Folders/TODO) is cut short. I'm not so sure what caused this error. I've just tried removing the index files, which seems to fix the error message. The index file gets recreated and my debug statements show proper output. Another solution is adding an extra file to the folder list, in which case the index will get fixed as well. Perhaps it would be good to recreate the index file when this error is found, instead of complaining? Also, from the code (virtual_sync_ext_header_read in src/virtual/virtual-sync.c) it seems that the last mailbox should be skipped because of this error, but the mailbox works fine. I'm probably not looking closely enough :-) I haven't been able to reliably break the index file with some quick testing (reconnecting, restarting and modifying the mailbox list), but I did manage to break it once (by removing a mailbox from halfway the list, and then adding it again). I couldn't reproduce that, though, since removing a mailbox doesn't always seem to recreate the index for some reason... I've also just upgraded to the latest version, so if this is a bug fixed between r8980 and r9018, then you'll probably not hear from me again :-) I hope all this info helps a bit, I'm available for further debugging and testing (also on IRC, nick is blathijs). Gr. Matthijs

2 2

Re: [Dovecot] Fail2Ban and the Dovecot log
by Lou Duchez 17 May '09

17 May '09

Re: the "dovecot: " at the beginning of the line in the log. I should mention that other applications encounter a similar issue with Fail2Ban -- for example, if you're running Asterisk, you have to alter the log format such that the timestamp is at the beginning of the line: http://www.voip-info.org/wiki/view/Fail2Ban+(with+iptables)+And+Asterisk

5 16

[Dovecot] Virtual mailbox plugin, crashing?
by Brandon Lamb 17 May '09

17 May '09

Hello, Using virtual mailbox plugin and all of a sudden started getting these. Deleted the indexes from ~/Maildir/virtual/Inboxmail and all was good again. dovecot: 2009-05-10 10:05:44 Error: child 26607 (imap) killed with signal 11 (core dumps disabled) Inboxmail/dovecot-virtual: virtual/All inthread refs x-mailbox INBOX All/dovecot-virtual: * -Archive/ -Drafts/ -Trash/ -Trash/* -Deleted* -Junk* -Spam/ -Sent* all I have had this happen 2 or 3 times now, I thought maybe the first couple were flukes from messing with the dovecot-virtual files, then sometime between last night and now this started to give those errors. I am taking a guess that is it is some kind of indexing issue since just deleting those seems to fix it. Not sure what other info I could send, turning mail_debug = yes didnt give any useful info in dovecot.log

2 2

[Dovecot] Backtrace error
by Brandon Lamb 17 May '09

17 May '09

I noticed i had mail_location wrong, i was specifying INDEX=/dovecot-index instead of INDEX=~/dovecot-index so i modifed and restarted dovecot, one of my techs that happens to have thousands of emails reopened her mail and this showed up in the log. Not sure if this is critical or if more info/dovecot -n is needed dovecot: 2009-05-05 14:06:38 Panic: imap <REMOVED>: file mail-search.c: line 712 (mail_search_args_equal): assertion failed: (args1->simplified == args2->simplified) dovecot: 2009-05-05 14:06:38 Error: imap <REMOVED>: Raw backtrace: imap [0x4a3042] -> imap [0x4a30c3] -> imap [0x4a2796] -> imap [0x467ffa] -> imap(mail_thread_init+0xaa) [0x463a5a] -> imap(index_storage_search_init+0x132) [0x45e222] -> /usr/local/lib/dovecot/imap/lib20_virtual_plugin.so(virtual_search_init+0x13) [0x7fedbd5d1d73] -> imap(index_search_result_update_appends+0xac) [0x4660ec] -> /usr/local/lib/dovecot/imap/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1383) [0x7fedbd5d5123] -> imap(mailbox_sync+0x30) [0x46a7c0] -> imap(cmd_select_full+0x383) [0x420613] -> imap [0x422d8c] -> imap [0x422e4a] -> imap(client_handle_input+0x35) [0x4234b5] -> imap(client_input+0x63) [0x423963] -> imap(io_loop_handler_run+0xcb) [0x4aae9b] -> imap(io_loop_run+0x18) [0x4aa328] -> imap(main+0x52b) [0x42b7fb] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x7fedbde095a6] -> imap [0x41bcf9] dovecot: 2009-05-05 14:06:38 Error: child 18843 (imap) killed with signal 6 (core dumps disabled)

2 1

[Dovecot] Deliver hangs after reloading the Dovecot configuration
by Pascal Volk 17 May '09

17 May '09

Hello Timo, deliver hangs after reloading the Dovecot configuration. How to reproduce: 1. start dovecot 2. deliver a message via deliver 3. modify dovecot.conf:plugin {quota_rule} 4. kill -HUP $PID_of_dovecot 5. deliver the next message via deliver Dovecot v1.2.beta2 died in this case with a panic: file dict-process.c: line 152 (dict_listener_input): assertion failed: (listener->processes == NULL) Raw backtrace: /usr/local/dovecot12/sbin/dovecot [0x411832] -> /usr/local/dovecot12/sbin/dovecot [0x411944] -> /usr/local/dovecot12/sbin/dovecot [0x40acce] -> /usr/local/dovecot12/sbin/dovecot [0x410fc6] -> /usr/local/dovecot12/sbin/dovecot [0x40576a] -> /usr/local/dovecot12/sbin/dovecot [0x414e6b] -> /usr/local/dovecot12/sbin/dovecot [0x414308] -> /usr/local/dovecot12/sbin/dovecot [0x40b29d] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x7f5e508cd5a6] -> /usr/local/dovecot12/sbin/dovecot [0x4032f9] deliver(j.doe(a)example.com): May 11 23:30:45 Error: Internal quota calculation error deliver(j.doe(a)example.com): May 11 23:30:45 Error: sieve: msgid=<000@nobody>: failed to store into mailbox 'INBOX': Internal error occurred. Refer to server log for more information. [2009-05-11 23:30:45] After the panic I have compiled the latest sources from the Mercurial repository (changeset: 9021:e36a9edb5fb0). A full backtrace is attached to this message. # 1.2.rc3: /usr/local/dovecot12/etc/dovecot.conf # OS: Linux 2.6.29.2-1 x86_64 Debian squeeze/sid log_path: /usr/local/dovecot12/var/log/dovecot.log protocols: imap listen: 192.168.111.222:10143 ssl: no disable_plaintext_auth: no login_dir: /usr/local/dovecot12/var/run/dovecot/login login_executable: /usr/local/dovecot12/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 70000 first_valid_gid: 70000 mail_privileged_group: mail mail_location: maildir:~/Maildir mail_debug: yes mail_plugins: quota imap_quota auth default: mechanisms: digest-md5 cram-md5 login plain user: nobody verbose: yes debug: yes passdb: driver: sql args: /usr/local/dovecot12/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/dovecot12/etc/dovecot-sql.conf socket: type: listen master: path: /usr/local/dovecot12/var/run/dovecot/auth-master mode: 384 plugin: quota: dict:user::proxy::quotadict quota_rule: *:storage=10M:messages=111 quota_rule2: Trash:storage=50%% dict: quotadict: pgsql:/usr/local/dovecot12/etc/dovecot-dict-quota.conf /usr/local/dovecot12/etc/dovecot-dict-quota.conf: connect = host=/var/run/postgresql dbname=db user=user password=password map { pattern = priv/quota/storage table = quota12 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota12 username_field = username value_field = messages } Regards, Pascal -- The trapper recommends today: beeffeed.0913222(a)localdomain.org .

2 2

[Dovecot] procmail & formail
by Mohsen Pahlevanzadeh 17 May '09

17 May '09

Dear all, i have a mail server & vpopmail. Now, i want to copy from each message to a directory.i find a way to do it. i put following line in .qmail-default : |formail -X "" > ~/text.txt Of course above line is test.Given line doesn't retrieves Return* header field. My question: How i retrieve entire email same itslef? Yours, Mohsen

1 0

[Dovecot] Unable to subscribe to newly created subfolders under public mailboxes with acl plugin enabled
by Max Ivanov 17 May '09

17 May '09

I've "group" namespace and b2b mailbox under it. I'm unable to subscribe to it and deliver emails there. Here is my problem: if I create subfolder (lets name it "subf") under b2b mailbox I'm unable to subscribe to it until acl plugin is enabled. Even if I put dovecot-acl file in .b2b.subf folder with anyone full rights dovecot-acl-list doesn't get populated with new subfoler. If I put it there manually I'm able to see subf folder in subscribe dialog in TB, but dovecot-acl-list is regulary updated, isn't it? Updated file is missing subf entry again. If I disable acl plugin everything works fine, but I'd like to keep it enabled. Is it a bug or misconfiguration? My dovecot version is 1.2 rc3 here is dovecot -n authput protocols: imap managesieve ssl: yes ssl_ca_file: /usr/share/ca-certificates/floristCA-cacert.pem ssl_cert_file: /var/lib/ssl/certs/imap.florist.my-cert.pem ssl_key_file: /var/lib/ssl/private/imap.florist.my-key.pem ssl_cipher_list: ALL:!LOW:!SSLv2 disable_plaintext_auth: yes verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login login_processes_count: 5 verbose_proctitle: yes first_valid_uid: 1000 mail_privileged_group: mail mail_location: maildir:/var/spool/mail/dovecot/%n:INBOX=/var/spool/mail/dovecot/%n/INBOX mail_debug: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_plugins(default): acl fts fts_squat mail_plugins(imap): acl fts fts_squat mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: group/ location: maildir:/var/spool/mail/groupmail list: yes subscriptions: yes auth default: verbose: yes passdb: driver: pam args: session=yes userdb: driver: passwd args: blocking=yes socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 438 plugin: acl: vfile lazy_expunge: .EXPUNGED/ .DELETED/ .DELETED/.EXPUNGED/ sieve: ~/.dovecot.sieve sieve_storage: ~/sieve fts: squat fts_squat: partial=4 full=4

3 2

[Dovecot] Unable to delete folder in public namespace
by Max Ivanov 17 May '09

17 May '09

I use public namespace for group mailboxes. Users are able to create subfolders , but its impossible to delete them. thunderbird 2.0.0.21 complains: "Cant' rename mailbox to another storage type", both namespaces (private and public) use same storage type, so I believe that it's a namespace problem. Is there any way to move folders between namespaces? Or maybe sieve script or plugin which intercept move command and do the move to some unsibscribible folder in public namespace.

2 1

[Dovecot] namespace list not working in dovecot 1.2 revision 9027:421393827a81
by Jonathan Siegle 17 May '09

17 May '09

In my config that has worked for some time I have: namespace private { separator = / prefix = ~/ hidden = yes list = no # for v1.1+ } 1 list "~/" * 1 OK List completed. 2 list "~/" % 2 OK List completed. I _think_ that the last time I tested this was 2 weeks ago but it might have been 1 week ago. Thanks, Jonathan

2 1

[Dovecot] Question about IMAP
by Charles Marcus 17 May '09

17 May '09

Hi Timo, I have a question that you can maybe answer off the top of your head, considering your vast knowledge of the IMAP protocol... There is a Thunderbird bug that is near and dear to my heart, that is trying to address how Thunderbird deals with large messages (ie, messages with large attachments). Current behavior sucks... it downloads the entire message every time the message is clicked on. My question is: Using the IMAP protocol, is there a way, *without* downloading the entire message (specifically, binary attachments), that an IMAP client can do the following: 1. Download *only* the message headers and the text/html/body contents of the body of the message but *not* any binary attachments, 2. Detect that a message *has* one or more binary attachments, *without* downloading them, 3. Grab the names of all of the attachments, 4. Display for the user the email/email headers and text/html body parts, 5. Display the existence of the attachments in whatever manner the client normally shows them (in TBird, they show at the bottom of the message just above the status bar), 6. Download the actual attachment on demand - ie, if/when it is dbl-click > opened, right-click > saved, or the message is forwarded? Pointers to appropriate IMAP protocol docs would be happily passed on to them the Mozilla dev guys. Thanks! -- Best regards, Charles

2 5

[Dovecot] LDAP auth_bind fails to process certain LDAP server responses (Windows AD)
by Konstantin Khomoutov 15 May '09

15 May '09

LDAP auth backend in Dovecot 1.1.5 seemingly fails to handle certain paths of interaction with LDAP server, which is Windows AD running Windows 2003 server machine in my case. The symptoms I observe look exactly as were already reported in [1]: authentication backend "hangs" after logging the fact it has sent the search request, then after a while the IMAP/POP3 connection is teared down by the server due to idle condition. In the mentioned mail thread, it was proposed that if Dovecot doesn't log any LDAP server response, there is no such response, so I dumped the TCP traffic going between the backend and the server, and studied what happens with different settings. The result is that it seems LDAP auth backend doesn't understand the case when the server offerrs one or more "referrals" which the client might want to check. It seems that the backend tries to do something else after it gets such a result from the LDAP server even if the server returned an entry matching the search request. The described behaviour manifests itself with Windows AD only if I specify the domain name alone as the search base, e.g. "dc=mydomain,dc=com". If I also include at least one OU, the server doesn't return its list of referrals and Dovecot LDAP auth backend works OK. I attached two files produced by tcpdump -- one with "hung" search request, and another with successful one. They are: 1) ldap-hung.pcap.gz Captured with /etc/dovecot/dovecot-ldap.conf settings: hosts = domain007.com dn = saslauthd(a)domain007.com dnpass = "secret" auth_bind = yes base = dc=domain007, dc=com pass_filter = (&(objectClass=person)(sAMAccountName=%u)) Packet #8 is of interest in this dump. 2) ldap-ok.pcap.gz Captured with /etc/dovecot/dovecot-ldap.conf settings: hosts = domain007.com dn = saslauthd(a)domain007.com dnpass = "secret" auth_bind = yes base = cn=Users, dc=domain007, dc=com pass_filter = (&(objectClass=person)(sAMAccountName=%u)) The only difference compared to the first case is the "cn=Users" prepended to the base DN, which prevents the server from attaching a list of referrals. In both cases "search result done" is present in the server response. 3) ldap-ldapsearch.pcap.gz This dump captures the conversation of the ldapsearch utility with the same server using the same parameters Dovecot LDAP auth backend uses in the first case. ldapsearch invocation was like this: $ ldapsearch -h domain007.com -x -D saslauthd(a)domain007.com -w secret -a always -b dc=domain007,dc=com '(&(objectClass=person)(sAMAccountName=kostix))' General configuration info (package from Debian stable): # dovecot --version 1.0.15 # dovecot -n # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: verbose: yes debug: yes passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: passwd 1. http://www.mail-archive.com/dovecot@dovecot.org/msg09174.html

1 0

[Dovecot] Possibly dumb questions about DC and user/system limits
by Stewart Dean 15 May '09

15 May '09

Because of user access growth, the number of processes associated with IMAP has increased and I thought to change some of the configured parms. dovecot -n yields: # 1.1.14: /usr/local/etc/dovecot.conf # OS: AIX 1 005A928C4C00 listen: *:143 ssl_listen: *:993 disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_processes_count: 12 login_max_processes_count: 774 max_mail_processes: 1280 mail_max_userip_connections: 12 verbose_proctitle: yes first_valid_uid: 200 mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=/var/dcindx/%u mbox_write_locks: fcntl mbox_dirty_syncs: no auth default: passdb: driver: pam userdb: driver: passwd The only changes was that max_mail_processes went from 1024 to 1280. Now I get a error message when I start DC: Warning: fd limit 2000 is lower than what Dovecot can use under full load (more than 2054). Either grow the limit or change login_max_processes_count and max_mail_processes settings So I changed the no_size and no_size_hard to 3500 and 4000 respectively in both dovecot and root AIX defines nosize:* *Sets the soft limit for the number of file descriptors a user process may have open at one time. an lsuser dovecot returns: dovecot id=417 pgrp=dovecot groups=dovecot shell=/bin/false daemon=true admin=false ... fsize=2097151 cpu=-1 data=262144 stack=65536 core=2097151 rss=65536 nofiles=3500 nofiles_hard=4000 I kill dovecot and all children and restart it....same error message What am I missing? Does the machine have to be rebooted for the no_size to be updated? -- ==== Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows.... ==== Stewart Dean, Unix System Admin, Bard College, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

3 4

[Dovecot] cmd_append_continue_parsing assertion failure
by Mike Abbott 15 May '09

15 May '09

Dovecot-1.1.14 on Mac OS X. Panic: IMAP(user): file cmd-append.c: line 266 (cmd_append_continue_parsing): assertion failed: (ctx->count == uid2 - uid1 + 1) Trivially reproducible: $ telnet mailserver 143 a login user password b append inbox Backtrace: 0 libSystem.B.dylib 0x00007fff8458aa92 __kill + 10 1 libSystem.B.dylib 0x00007fff84606a1c abort + 83 2 imap 0x0000000100069f3e default_fatal_finish + 70 3 imap 0x0000000100069f8c i_syslog_fatal_handler + 0 4 imap 0x00000001000696eb i_info + 0 5 imap 0x0000000100001406 cmd_append_continue_parsing + 434 6 imap 0x00000001000017a3 cmd_append + 407 7 imap 0x000000010000677e client_command_input + 33 8 imap 0x000000010000693f client_command_input + 482 9 imap 0x0000000100006a3e client_handle_input + 239 10 imap 0x0000000100006bc2 client_input + 148 11 imap 0x0000000100070f83 io_loop_handler_run + 272 12 imap 0x0000000100070348 io_loop_run + 55 13 imap 0x000000010000db95 main + 1635 14 imap 0x0000000100001010 start + 52

2 1

[Dovecot] Filesystems (was Re: Migration questions...)
by Seth Mattinen 15 May '09

15 May '09

Richard Hobbs wrote: > > Trouble is... i've been googling this as well, just now, and loads of > people say XFS has the better performance, but loads of other people say > ReiserFS has the better performance. It starts to become a religious argument at some point. > We have battery backed up RAID controllers too, in this new system, and > the systems are UPSd, so on that basis i'm still none the wiser! lol > > I appreciate your experience with XFS is a positive one, but even the > dovecot web site says XFS might now be a good choice... > > http://wiki.dovecot.org/MailboxFormat/Maildir > > What a tough decision! I know it probably won't make too much difference > in my situation, but i want this to be a very long-term solution, so > want to do it right first time! > > Any other opinions on XFS vs Reiserfs with Dovecot maildir? > > Thanks again! > > Richard. > If you have time to play "tweak the filesystem": http://everything2.com/index.pl?node_id=1479435 It's a good comparison of etx3, xfs, and reiser from a performance standpoint. Also try this if you want to pull the plug or randomly reboot and see what happens: http://brad.livejournal.com/2116715.html ~Seth

1 0

[Dovecot] Filesystem experience question was Migration questions
by Stewart Dean 15 May '09

15 May '09

Doing a cursory Google scan on journaled Linux filesystems, it seems that the three ground-up journaled FSes: XFS, reiser and JFS all have their separate strong points but all compare favorably. Reiser does a better job with many small files...which would seem to be the reality of maildir formatted inboxes. Any comments on that? Any war stories, that is, any comments on reliability, availability and recoverability of them. Support issues? Possible down the road orphaning? Is FS quotaing support and does it work well with a lot (for me that means 4000) users? Anybody using IBM's open source JFS? I currently use AIX and it's been as dependable as a hammer there. In some 20 years with AIX, I can count on the fingers of one hand the number of times that I've had to use fsck. We had one set of machines that would drop hard 2-3x a week due to a bad main electrical trunk splice....2 or 3 years of that and the worst I ever saw was having to BRS once every two months or so. OTOH, I distrust IBM's commitment to the little shop and affordable entry machines: this is fast vanishing in the pSeries/AIX world...or else we wouldn't be moving towards Linux. Thanks! Feel free to contact me offline if you deem this marginally related to DC. -- ==== Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows.... ==== Stewart Dean, Unix System Admin, Bard College, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

2 1

[Dovecot] Migration questions...
by Richard Hobbs 15 May '09

15 May '09

Hi All, We are soon to migrate our mail server from one piece of hardware to another and we would like to take this opportunity to optimize things. As a result, we would like to replace "uw-imapd" and "qpopper" with "dovecot". The version we will be installing is 1.1.13-2, as this is what is available through the latest Debian stable backports. We will also be using exim to deliver mail (through dovecot's deliver mechanism, of course). So... We are currently using the mbox format with uw-imapd, and would like to migrate to the fastest solution possible with dovecot on the new hardware. My understanding is that "multi-dbox" is not an option in this version anyway, maildir is OK, but not great, and "single-dbox" is therefore going to be the highest performing solution. Is single-dbox the fastest way to go, considering we're going to be using email in the following ways: - IMAP connections with all email in the Inbox (Gmail-style). - IMAP connections with email split into many IMAP folders. - POP3 connections with no email left on the server. - POP3 connections with *all* email left on the server. All connections check for new mail every 5 minutes (on average) and there are 50-60 users). Also, we are not able to change user behaviour in this instance, unfortunately. Can anyone see any problems with the above proposal? Hopefully not... One problem that may arise is the fact that when we migrate, all msg UIDs will be lost. If i'm not mistaken, this means that all emails will be treated by the mail client as brand new, and if through IMAP, will all go bold, and if through POP3, will all be downloaded again (if still on the server) and therefore duplicated in the mail client. If this is the case, is there anything we can do to stop this happening? Does the "Convert" plugin does this job well? Finally, I have a rough draft of our migration plan - is there anything horribly wrong in it that's going to cause lots of problems, that anyone can spot by any chance? 1. Install Debian with exim, mysqld (for Horde/IMP) and mailman. 2. Run an online update. 3. Rsync homedirs and inboxes onto new server, ready for initial exim configuration. 4. Configure exim as per existing mail server and test that mailing lists and normal email works. You should now have the existing mail delivery solution on the brand new hardware. 5. Once mail delivery is sorted, add "deb http://www.backports.org/debian lenny-backports main contrib non-free" into "/etc/apt/sources.list" and run "aptitude update && aptitude install debian-backports-keyring && aptitude update". 6. Install dovecot (at the time of writing, this was version 1.1.13-2) and configure to use existing mbox files (inboxes in /var/spool/mail/ and IMAP folders in /home/user/mail/) 7. Setup exim to use dovecot's "deliver" mechanism for interacting with the inboxes (which are still in mbox format). 8. Configure the "convert" plugin to begin converting the mail to dbox format. 9. Run something manually (if possible) to convert mailboxes before people connect, so the task is already done by the time the outage is over. 10. Give staff access to new speedy mail server! Thanks in advance, people - any help is greatly appreciated! :-) Richard. -- Richard Hobbs (IT Specialist) Toshiba Research Europe Ltd. - Cambridge Research Laboratory Email: richard.hobbs(a)crl.toshiba.co.uk Web: http://www.toshiba-europe.com/research/ Tel: +44 1223 436999 Mobile: +44 7811 803377

14 37

[Dovecot] IMAP subfolders and MBOX format
by Frank Bonnet 14 May '09

14 May '09

Hello folks I have a problem related to the mbox format I think First we use MBOX format with Dovecot 1.14 A user's here need to create some subfolders in his Imap space. Due to the use of MBOX format this is impossible from thunderbird as you cannot creat a directory in a file :-) So to help him I created manually on the mail server some directories into his imap space, Doing so we are able to see the folder and subfolders but it is not possible to move some other folders into the subfolder via the thunderdird client. Anyone to help me a bit ? Note : on another machine which use the Maildir format I can do whatever I want without problem. Thanks a lot.

2 1

[Dovecot] id:N13388 Disable storage of messages on server when read (pop3)
by Dimitrios Karapiperis 14 May '09

14 May '09

Hi there Is there any way in dovecot to disable the storage of messages on server when they are read/downloaded by the users (POP3). The server keeps the e-mail when users tick the option on their MUA to keep (leave) messages on server. dovecot 1.0.7 POP3 / maildir Thanks in advance Dimitrios Karapiperis postmaster [at] thessaloniki [dot] gr

3 3

[Dovecot] What's faster for getting mails into Rails: Dbmail & direct MySQL or net/pop with maildir
by Olaf Spaarmann 14 May '09

14 May '09

Hi, it's my first message in this list, so please excuse any mistakes! I have a quite specific problem and nobody in the Ruby on Rails lists could help me, because it is actually more a question for mail- experts. So I hope you can help me. I'm planning to set up a mailserver using dovecot. Users of my Rails App can forward their emails (john(a)doe.com) to an personal address (john.doe(a)myapp.com ). These emails will be received by my mailserver. So far so good, the tricky part is to get the mails into my Rails App for processing them. After that they will be deleted (so I'll never accumulate a big ammount of mails on the mailserver). I thought of 2 different approaches. 1) Just use a normal Dovecot setup, using maildir and get the mails with a mailpoller script, connecting to the server via Pop3 2) Use Dbmail for storing the emails, don't use Pop3 but let the mailpoller script connect to the database directly I understand that Dbmail seems to be slower than maildir (in terms of processing many incoming mails) but I'm not sure if a connection via net/pop (of the mailpoller script) is maybe that much slower than mysql that it wouldn't matter at all. What's your opinion? I'm gratefull for every hint. Thanks

2 1

[Dovecot] X-UIDL Ignored?
by Benjamin Wakefield 14 May '09

14 May '09

Hello! I am trying to migrate from Teapop to Dovecot. I'm using Dovecot 1.1.14. I need to make use of the X-UIDL header so clients don't download messages they've already received. I have the X-UIDL head in the message. I have pop3_reuse_xuidl(pop3): yes My problem is the X-UIDL in the message is being ignored and Dovecot is still generating it's own. The INBOX is an mbx file not Maildir. Should this work? Have I missed something? Thanks! Ben ==== BEGIN dovecot -n ==== # 1.1.14: /usr/local/dovecot-1.1.14/etc/dovecot.conf # OS: Linux 2.6.24.3-smp i686 Slackware 12.0.0 log_path: /usr/local/dovecot-1.1.13/var/log/dovecot.log protocols: imap imaps pop3 listen(default): * listen(imap): * listen(pop3): *:10100 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/dovecot-1.1.14/var/run/dovecot/login login_executable(default): /usr/local/dovecot-1.1.14/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot-1.1.14/libexec/dovecot/imap-login login_executable(pop3): /usr/local/dovecot-1.1.14/libexec/dovecot/pop3-login login_greeting: grape.dcsi.net.au dovecot pop3/imap server, go ahead. mail_location: mbox:~/mail:INBOX=/var/mail/%1u/%u mail_executable(default): /usr/local/dovecot-1.1.14/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot-1.1.14/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot-1.1.14/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/dovecot-1.1.14/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot-1.1.14/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot-1.1.14/lib/dovecot/pop3 pop3_reuse_xuidl(default): no pop3_reuse_xuidl(imap): no pop3_reuse_xuidl(pop3): yes pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %v.%u auth default: passdb: driver: shadow args: /etc/shadow passdb: driver: passwd-file args: /etc/passwd userdb: driver: passwd ==== END ====

2 2

[Dovecot] virtual mailbox users users can send, but can't read e-mail
by Ioan Nemes 13 May '09

13 May '09

Greetings, I am trying to add the second virtual mailbox domain (transco.org.au) to an existing Postfix/Dovecot/MySQL mail server. Users of the first virtual mailbox domain (transylvania.org.au) have no problems sending and receiving mail. Users belonging to the second virtual mailbox domain can successfully send mail to outside, however they won't receive the mail, though Postfix delivers the mail to the mail directories. The configuration: --------------------------------------------------------------------------------------- # dovecot --version 1.0.2 --------------------------------------------------------------------------------------- # dovecot -n # 1.0.2: /etc/dovecot.conf base_dir: /var/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/dovecotcert.pem disable_plaintext_auth: no login_dir: /var/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_user: _dovecot first_valid_uid: 5000 last_valid_uid: 5000 mail_location: maildir:/var/spool/vmboxbase/%d/%u mbox_write_locks: fcntl mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: bsdauth passdb: driver: sql args: /etc/dovecot-mysql.conf userdb: driver: passwd userdb: driver: sql args: /etc/dovecot-mysql.conf ---------------------------------------------------------------------------------------------------- password_query = SELECT password FROM users WHERE login = '%u' and active = 'Y' ----------------------------------------------------------------------------------------------------- SELECT password FROM users WHERE login = 'dummy(a)transco.org.au' and active = 'Y'; mysql> SELECT password FROM users WHERE login = 'dummy(a)transco.org.au' and active = 'Y'; +---------------+ | password | +---------------+ | Wdrbd5SLusraw | +---------------+ 1 row in set (0.00 sec) ------------------------------------------------------------------------------------------------------ user_query = SELECT home, maildir, uid, gid FROM users WHERE login = 'dummy' AND active = 'Y' ------------------------------------------------------------------------------------------------------ mysql> SELECT home, maildir, uid, gid FROM users WHERE login = 'dummy(a)transco.org.au'; +----------------------+-----------------------+------+------+ | home | maildir | uid | gid | +----------------------+-----------------------+------+------+ | /var/spool/vmboxbase | transco.org.au/dummy/ | 5000 | 5000 | +----------------------+-----------------------+------+------+ 1 row in set (0.00 sec) # more /etc/dovecot-mysql.conf # This file is opened as root, so it should be owned by root and mode 0600. # # http://wiki.dovecot.org/AuthDatabase/SQL # # For the sql passdb module, you'll need a database with a table that # contains fields for at least the userid and password. If you want to # use the user@domain syntax, you might want to have a separate domain # field as well. # # If your users all have the same uig/gid, and have predictable home # directories, you can use the static userdb module to generate the home # dir based on the userid and domain. In this case, you won't need fields # for home, uid, or gid in the database. # # If you prefer to use the sql userdb module, you'll want to add fields # for home, uid, and gid. Here is an example table: # # CREATE TABLE users ( # userid VARCHAR(128) NOT NULL, # password VARCHAR(64) NOT NULL, # home VARCHAR(255) NOT NULL, # uid INTEGER NOT NULL, # gid INTEGER NOT NULL, # active CHAR(1) DEFAULT 'Y' NOT NULL # ); # Database driver: mysql, pgsql, sqlite #driver = driver = mysql # Database connection string. This is driver-specific setting. # # pgsql: # For available options, see the PostgreSQL documention for the # PQconnectdb function of libpq. # # mysql: # Basic options emulate PostgreSQL option names: # host, port, user, password, dbname # # But also adds some new settings: # client_flags - See MySQL manual # ssl_ca, ssl_ca_path - Set either one or both to enable SSL # ssl_cert, ssl_key - For sending client-side certificates to server # ssl_cipher - Set minimum allowed cipher security (default: HIGH) # # You can connect to UNIX sockets by using host: host=/var/run/mysql.sock # Note that currently you can't use spaces in parameters. # # sqlite: # The path to the database file. # # Examples: # connect = host=192.168.1.1 dbname=users # connect = host=sql.example.com dbname=virtual user=virtual password=blarg # connect = /etc/dovecot/authdb.sqlite # #connect = dbname=virtual user=virtual connect = host=localhost dbname=mail user=dovecot password=dovecot # Default password scheme. # # List of supported schemes is in # http://wiki.dovecot.org/Authentication/PasswordSchemes # #default_pass_scheme = PLAIN-MD5 default_pass_scheme = CRYPT # Query to retrieve the password. # # This query must return only one row with "user" and "password" columns. # The query can also return other fields which have a special meaning, see # http://wiki.dovecot.org/PasswordDatabase/ExtraFields # # The "user" column is needed to make sure the username gets used with exactly # the same casing as it's in the database. Note that if you store username and # domain in separate fields, you most likely want to return a combination of # them as the "user" column, otherwise the domain gets stripped. # # Commonly used available substitutions (see # http://wiki.dovecot.org/Variables for full list): # %u = entire userid # %n = user part of user@domain # %d = domain part of user@domain # # Note that these can be used only as input to SQL query. If the query outputs # any of these substitutions, they're not touched. Otherwise it would be # difficult to have eg. usernames containing '%' characters. # # Example: # password_query = SELECT concat(userid, '@', domain) AS user, password FROM users WHERE userid = '%n' AND domain = '% d' # password_query = SELECT pw AS password FROM users WHERE userid = '%u' AND active = 'Y' # password_query = SELECT password FROM users WHERE login = '%u' and active = 'Y' # Query to retrieve the user information. # # The query must return only one row. Commonly returned columns are: # uid - System UID # gid - System GID # home - Home directory # mail - Mail location # # Either home or mail is required. uid and gid are required. If more than one # row is returned or there are missing fields, the login will fail. For a list # of all fields that can be returned, see # http://wiki.dovecot.org/UserDatabase/ExtraFields # # Examples # user_query = SELECT home, uid, gid FROM users WHERE userid = '%n' AND domain = '%d' # user_query = SELECT dir AS home, user AS uid, group AS gid FROM users where userid = '%u' # user_query = SELECT home, 501 AS uid, 501 AS gid FROM users WHERE userid = '%u' # #user_query = SELECT home, uid, gid FROM users WHERE userid = '%u' user_query = SELECT home, maildir, uid, gid FROM users WHERE login = '%u' AND active = 'Y' # If you wish to avoid two SQL lookups (passdb + userdb), you can use # userdb prefetch instead of userdb sql in dovecot.conf. In that case you'll # also have to return userdb fields in password_query prefixed with "userdb_" # string. For example: #password_query = SELECT userid as user, password, home as userdb_home, uid as userdb_uid, gid as userdb_gid FROM users WHERE userid = '%u' --------------------------------------------------------------------------------------- # ps -aux | grep dovecot root 13442 0.0 0.2 676 952 ?? Ss 4:27AM 0:00.04 /usr/local/sbin/dovecot root 10354 0.0 0.4 816 1920 ?? S 4:27AM 0:00.03 dovecot-auth root 8330 0.0 0.4 708 2080 ?? S 4:27AM 0:00.03 dovecot-auth -w _dovecot 29456 0.0 0.4 664 1876 ?? S 4:27AM 0:00.04 pop3-login _dovecot 12636 0.0 0.4 716 1868 ?? S 4:27AM 0:00.04 pop3-login _dovecot 26625 0.0 0.4 696 1896 ?? S 4:27AM 0:00.04 imap-login _dovecot 4709 0.0 0.4 556 1892 ?? S 4:27AM 0:00.04 imap-login _dovecot 10294 0.0 0.4 760 1888 ?? S 4:27AM 0:00.04 imap-login _dovecot 13526 0.0 0.4 596 1888 ?? S 4:59AM 0:00.01 pop3-login root 20523 0.0 0.1 472 748 p1 S+ 5:01AM 0:00.00 grep dovecot ----------------------------------------------------------------------------------------- # ls -ltr /var/spool/vmboxbase/transco.org.au/dummy/new total 40 -rw------- 1 vmail vmail 462 May 3 11:06 1241312770.V8I6be62M630453.vega.transylvania.org.au -rw------- 1 vmail vmail 708 May 3 11:15 1241313359.V8I6be6bM976701.vega.transylvania.org.au -rw------- 1 vmail vmail 658 May 3 11:21 1241313700.V8I6bd8aM30789.vega.transylvania.org.au -rw------- 1 vmail vmail 672 May 4 02:18 1241367523.V8I6be75M268056.vega.transylvania.org.au -rw------- 1 vmail vmail 706 May 4 02:31 1241368314.V8I6be7cM742941.vega.transylvania.org.au -rw------- 1 vmail vmail 658 May 4 02:54 1241369661.V8I6bd9bM991186.vega.transylvania.org.au -rw------- 1 vmail vmail 690 May 4 03:02 1241370177.V8I6bd98M300668.vega.transylvania.org.au -rw------- 1 vmail vmail 672 May 4 03:54 1241373297.V8I6bda1M149877.vega.transylvania.org.au -rw------- 1 vmail vmail 837 May 4 04:35 1241375739.V8I6bdaeM905070.vega.transylvania.org.au -rw------- 1 vmail vmail 842 May 4 04:36 1241375767.V8I6bdb4M496268.vega.transylvania.org.au ------------------------------------------------------------------------------------------------------------- When I try to retreive mail for user dummy(a)tarnsco.org.au, the folovig entry is created in /var/log/maillog, but no mail is retrived. The mail client agent is Thunderbird 2.0.22 ------------------------------------------------------------------------------------------------------------- May 4 06:04:51 vega dovecot: auth(default): client in: AUTH 1 PLAIN service=POP3 lip=192.168.1.212 rip=192.168.1.101 resp= May 4 06:04:51 vega dovecot: auth(default): client out: CONT 1 May 4 06:04:51 vega dovecot: auth(default): client in: CONT 1 AGR1bW15QHRyYW5zY28ub3JnLmF1AGR1bW15 May 4 06:04:51 vega dovecot: auth(default): bsdauth(dummy(a)transco.org.au,192.168.1.101): lookup May 4 06:04:51 vega dovecot: auth(default): bsdauth(dummy(a)transco.org.au,192.168.1.101): unknown user May 4 06:04:51 vega dovecot: auth-worker(default): sql(dummy(a)transco.org.au,192.168.1.101): query: SELECT password FROM users WHERE login = 'dummy(a)transco.org.au' and active = 'Y' May 4 06:04:51 vega dovecot: auth(default): client out: OK 1 user=dummy(a)transco.org.au May 4 06:04:51 vega dovecot: auth(default): master in: REQUEST 31 29200 1 May 4 06:04:51 vega dovecot: auth(default): passwd(dummy(a)transco.org.au,192.168.1.101): lookup May 4 06:04:51 vega dovecot: auth(default): passwd(dummy(a)transco.org.au,192.168.1.101): unknown user May 4 06:04:51 vega dovecot: auth-worker(default): sql(dummy(a)transco.org.au,192.168.1.101): SELECT home, maildir, uid, gid FROM users WHERE login = 'dummy(a)transco.org.au' AND active = 'Y' May 4 06:04:51 vega dovecot: auth(default): master out: USER 31 dummy(a)transco.org.au home=/var/spool/vmboxbase maildir=transco.org.au/dummy/ uid=5000 gid=5000 May 4 06:04:51 vega dovecot: pop3-login: Login: user=<dummy(a)transco.org.au>, method=PLAIN, rip=192.168.1.101, lip=192.168.1.212 May 4 06:04:51 vega dovecot: POP3(dummy(a)transco.org.au): Disconnected: Logged out top=0/0, retr=0/0, del=0/0, size=0 Any suggestion? Regards, Ioan

2 1

[Dovecot] Only specifying lda in protocols?
by Brandon Lamb 13 May '09

13 May '09

protocols = lda Should this give me fatal errors when trying to do a dovecot -n I get # 1.2.rc3: /etc/dovecot/dovecot.conf Error: Invalid protocols given in configuration file Fatal: Invalid configuration in /etc/dovecot/dovecot.conf Dovecot starts and functions fine though

2 1

[Dovecot] Dovecot 1.0.7 domain variable
by elliott＠n.localhost 13 May '09

13 May '09

Hi all, Thanks in advance for any help! I'm trying to configure Dovecot to pull emails from Postfix virtual mailbox domain Maildirs under /var/mail/vhosts/<domain>/<username>. I've set mail_location as such in dovecot.conf: mail_location = maildir:/var/mail/vhosts/%d/%n but from debug output I see the domain is blank: dovecot: May 10 20:49:25 Info: IMAP(elliott): maildir: data=/var/mail/vhosts//elliott I've set elliott(a)n.0o0.bz as my username in Outlook so it is sending the domain (and changed auth_username_format to "auth_username_format = %n" so authentication works fine) Why is %d blank here? Anything else to check?? I'm at a loss. Thanks! -elliott-

5 5

[Dovecot] New messages notification - (IMAP PUSH?)
by Proskurin Kirill 13 May '09

13 May '09

Hello all. I have strange problem. As I understand IMAP use server2client command to tell what new email is arrived. So - all was good, but few weeks ago I notice what my thunderbird not show new messages. I think it was local problem(I switch distro what day) but soon my email clients what uses mostly Outlook-2007-SP1 start to confirm this problem. What can it be and how can I fix it? I use Dovecot on FreeBSD-7.1 #pkg_info | grep dovecot dovecot-1.1.11 dovecot-managesieve-0.10.5 dovecot-sieve-1.1.6 #dovecot -n # 1.1.11: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.1-RELEASE-p3 i386 ufs base_dir: /var/run/dovecot/ log_path: /var/log/dovecot/dovecot.log info_log_path: /var/log/dovecot/dovecot-debug.log protocols: imap imaps pop3 pop3s managesieve listen(default): * listen(imap): * listen(pop3): * listen(managesieve): *:2000 ssl_ca_file: /usr/local/etc/certs/GlobalSignCA.crt ssl_cert_file: /usr/local/etc/certs/fxclub_org.crt ssl_key_file: /usr/local/etc/certs/fxclub_org.key ssl_cipher_list: ALL:!LOW:!SSLv2 login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_executable(managesieve): /usr/local/libexec/dovecot/managesieve-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_greeting_capability(managesieve): no login_process_size: 128 login_processes_count: 20 login_max_processes_count: 512 mail_max_userip_connections(default): 256 mail_max_userip_connections(imap): 256 mail_max_userip_connections(pop3): 20 mail_max_userip_connections(managesieve): 10 verbose_proctitle: yes first_valid_gid: 0 mail_privileged_group: mail mail_uid: dmail mail_gid: dmail mail_location(default): maildir:/var/spool/dovecot/domains/%d/%n/ mail_location(imap): maildir:/var/spool/dovecot/domains/%d/%n/ mail_location(pop3): maildir:/var/spool/dovecot/domains/%d/%n/ mail_location(managesieve): mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_executable(managesieve): /usr/local/libexec/dovecot/managesieve mail_process_size: 512 mail_plugins(default): quota imap_quota autocreate mail_plugins(imap): quota imap_quota autocreate mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 mail_plugin_dir(managesieve): /usr/local/lib/dovecot/managesieve imap_client_workarounds(default): delay-newmail tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail tb-extra-mailbox-sep imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): sieve_storage(default): sieve_storage(imap): sieve_storage(pop3): sieve_storage(managesieve): % sieve(default): sieve(imap): sieve(pop3): sieve(managesieve): ~/.dovecot.sieve auth default: mechanisms: plain login user: dovecot-auth username_format: %Lu verbose: yes worker_max_count: 100 passdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf userdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 user: exim master: path: /var/run/dovecot/auth-master mode: 384 user: dmail plugin: quota: maildir quota_rule: *:storage=1024M quota_rule2: Trash:storage=1256M quota_rule3: SPAM:ignore quota_warning: storage=80%% /usr/local/bin/quota-warning.sh 80 quota_warning2: storage=95%% /usr/local/bin/quota-warning.sh 95 autocreate: Trash autocreate2: Sent autocreate3: Spam autosubscribe: Trash autosubscribe2: Sent autosubscribe3: Spam -- Best regards, Proskurin Kirill

6 15

[Dovecot] Dovecot shared quota with Maildir
by Jorgen Lundman 13 May '09

13 May '09

Hello list, We are in the process of exploring the idea of moving from UFS with fs-quota to using softquotas in Dovecot (probably Maildir type, stored in LDAP, all ontop of NFS). I have it setup, and it works rather well so far. But there is one situation we can currently support, which I can not see a solution for with soft-quotas. Generally customers get 1 email, with 1 quota. But it is also possible for customers to get 1 quota, but create multiple mail accounts, all sharing the same quota. This is done by using the same UID for each account when using fs-quota. (It is not that each account gets a fraction of the quota, but that all accounts add up to the one quota). Is this still possible to do with soft-quotas. To share one set. Dovecot would have to go count files in multiple mail-directories so I would guess no. Lund -- Jorgen Lundman | <lundman(a)lundman.net> Unix Administrator | +81 (0)3 -5456-2687 ext 1017 (work) Shibuya-ku, Tokyo | +81 (0)90-5578-8500 (cell) Japan | +81 (0)3 -3375-1767 (home)

2 4