- dovecot - dovecot.org

[Dovecot] convert-tool skip_dotfiles is not the actual option
by Kenneth Porter 26 May '09

26 May '09

Looking at the source for convert-tool.c, I see this: "Usage: <username> <home dir> <source mail env> <dest mail env>\n" \ " [skip_broken_mailboxes] [skip_dotfiles] [alt_hierarchy_char=<c>]" else if (strcmp(argv[i], "skip_dotdirs") != 0) set.skip_dotdirs = TRUE; Looks like the usage line needs to be fixed (dovecot-1.2-0.rc2).

2 1

[Dovecot] maillog plugin issue
by Ibrahim Harrani 26 May '09

26 May '09

Hello, I just installed dovecot 1.2-rc4 on FreeBSD with qmail and vpopmail. I am using roundcube webmail to test(read,delete,move mails) I configured mail-log plugin according to http://wiki.dovecot.org/Plugins/MailLog log fields: mail_log_fields: uid box msgid size This but in the log file I only that something like that. May 23 15:37:14 IMAP(test(a)mydomain.com): 127.0.0.1 Info: copy: uids=7, box=Spam, dest=Spam, size=540 May 23 15:37:14 IMAP(test(a)mydomain.com): 127.0.0.1 Info: delete: uids=7 May 23 15:37:14 IMAP(test(a)mydomain.com): 127.0.0.1 Info: expunge: uids=7, size=540 May 23 15:37:14 IMAP(test(a)mydomain.com): 127.0.0.1 Info: Disconnected: Logged out bytes=205/1558 I don't see msgid etc? Also I added flag_change to mail_log_events and from, subject, flags to mail_log_fields. I don't see anything about from, subject, flags etc. I only see the following lines. May 23 15:05:49 mail dovecot: IMAP(test(a)mydomain.com): flag_change: uids=5 May 23 15:05:49 mail dovecot: IMAP(test(a)mydomain.com): Disconnected: Logged out bytes=168/1027 Here is my config. Did I miss something? dovecot -n # 1.2.rc4: /opt/mail/imap/etc/dovecot.conf # OS: FreeBSD 6.3-RELEASE-p9 amd64 log_path: /var/log/dovecot.log protocols: imap pop3 ssl: no disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /opt/mail/imap/libexec/dovecot/imap-login login_executable(imap): /opt/mail/imap/libexec/dovecot/imap-login login_executable(pop3): /opt/mail/imap/libexec/dovecot/pop3-login login_greeting: Welcome first_valid_uid: 89 mail_debug: yes mail_executable(default): /opt/mail/imap/libexec/dovecot/imap mail_executable(imap): /opt/mail/imap/libexec/dovecot/imap mail_executable(pop3): /opt/mail/imap/libexec/dovecot/pop3 mail_plugins(default): mail_log mail_plugins(imap): mail_log mail_plugins(pop3): quota mail_log mail_plugin_dir(default): /opt/mail/imap/lib/dovecot/imap mail_plugin_dir(imap): /opt/mail/imap/lib/dovecot/imap mail_plugin_dir(pop3): /opt/mail/imap/lib/dovecot/pop3 mail_log_prefix: %Us(%u): %r mail_log_max_lines_per_sec: 0 auth default: passdb: driver: vpopmail userdb: driver: passwd userdb: driver: vpopmail plugin: mail_log_events: delete undelete expunge copy mailbox_delete mailbox_rename mail_log_group_events: mail_log_fields: uid box msgid size quota: maildir

2 1

[Dovecot] little problem with lmtp and 8bitmime mail from:
by ja nein 26 May '09

26 May '09

Hi all, I'm very excited to see lmtp in dovecot now. Starting to play, I encountered following problem: With senders in normal mail address format, everything is delivered right, lmtp works as expected. But with 8bitmime senders, like kernel mailing list, lmtp returns a 5.5.4 not supported and mail is bounced. Is this expected, meaning just not implemented, or could it be a bug? E.g.: Problem: MAIL FROM:<linux-kernel-owner+info=40xxxx.com-S1753112AbZEYPtt(a)vger.kernel.org> BODY=8BITMIME RCPT TO:<info(a)xxxx.com> DATA vstream_fflush_some: fd 12 flush 130 vstream_buf_get_ready: fd 12 got 89 501 5.5.4 Unsupported options Ok: MAIL FROM:<some.address(a)somewhere.com> RCPT TO:<info(a)xxxx.com> DATA vstream_fflush_some: fd 12 flush 71 vstream_buf_get_ready: fd 12 got 36 250 2.1.0 OK 250 2.1.5 OK 354 OK Dovecot version is latest hg dovecot-2.0 trunk. Regards, Sebastian

2 1

[Dovecot] Deleting mail account?
by David Reid 25 May '09

25 May '09

This is likely a daft question, but how do I remove a mailbox from a dovecot server? I'd like to simply remove it from the disk as well, deleting any messages, indexes etc etc Is there a way? david !DSPAM:1715,4a1a817434922186719589!

2 6

[Dovecot] creating skeleton Maildir
by Giuliano Gavazzi 25 May '09

25 May '09

Dear all, when I had a courier installation still in place I used to create the Maildir tree for a new user using its maildirmake (IIRC) utility. Now that I had to rebuild a server from scratch, and using dovecot did not install courier, I have to create Maildirs without that utility. I seem to remember that libexec/imap could be called in a way to create the Maildir and its required subfolders (.Sent, .Drafts, etc). Do I remember correctly? If so what are the command line options? I cannot find pointers in the wiki or elsewhere. If not, I will just create a template and script the whole process. Thanks Giuliano

3 4

[Dovecot] Dovecot Max Connections & mbox vs. maildir format - Recommendations?
by V S Rao 24 May '09

24 May '09

>> I had big issues with timeouts until I realize the the imap and mbox format >> isnt a good choice if your users have huge naiboxes. >> At my server there were users with mailboxes arount 700MB to over 1GB. each >> time one of those users checked their email >> the imap server had to open this huge file and parse it, causing I/O issues. >> The only solution I found it was switch from mbox format to maildir format. I am changing the subject line to reflect the discussion. I too have a similar case with large mailboxes. My user mix is 70% POP3 vs. 30% IMAP. Would maildir still be the best recommended format? What is the opinion of the experts here? The reason I am asking is that I am preparing to upgrade my mail server to RHEL 5.3. That would mean my Dovecot will be atleast 1.0.7, which should not be bad. If the recommendation is that I go from mbox format to Maildir, I want to plan that as well. However I don't want to land up in a situation where, I have to move back from Maildir to mbox again. So please do advice me on the best. BTW one question: Assuming that my server has enough resources, ( 8 CPU @ 3.0GHz, 8GB RAM, 2Gbps FC Storage directly attached to the server & Gigabit NIC) what is the maximum number of concurrent connections that Dovecot can handle POP3 + IMAP combined? And I am asking for all the processes combined: POP3-login processes IMAP-login processes POP3 sessions IMAP sessions Any TCP/IP kernel parameters to be tuned? or maybe in dovecot.conf? Any advice will be immensely valuable to me while doing the migration. Thanks and Regards V S Rao

2 1

[Dovecot] How can I put a file back in Maildir folder?
by Allan Cassaro 23 May '09

23 May '09

Hi, I have a problem: today, when I ran "fsck" some file was linked to "lost+find" folder... After some hours I has all files mapped (File / User). So... how can I put this files back in Maildir folder of this users? I tried with: cat $file | deliver -d username but without success... Any help will be appreciated! Thanks!

2 2

[Dovecot] How to add new features to sieve?
by Ed W 23 May '09

23 May '09

Hi, I like the idea of switching from maildrop to dovecot deliver+sieve, however, we use a couple of features that I'm not sure how to migrate: - We query the userdb and make some user specific params available to the filtering script (invented example, but say number of days to not repeat for the vacation script) - We have a fairly advanced filter (perl) which mangles the email in very specific ways to support users over low bandwidth connections. The email is delivered twice, once to an "Archive" folder and again to the inbox after being mangled. How to integrate this "mangling" script? - We have some custom routes for certain types of SMS messages, ie we have a free email to SMS option for certain networks. Could this be integrated and caught in "alert" functionality (how is the sms backend actually configured anyway?) I think the answer is to write one or more new sieve functions to provide this functionality, but can you give me a quickstart guide on how to do this? Certainly the first requirement is quite an interesting and generic plugin "lookup_db" type function which must have wider utility. The second requirement is a bit more specific, kind of like an xfilter wrapper which could be setup by the administrator I guess? Thanks Ed W

1 0

Re: [Dovecot] How to run Dovecot as IMAP Proxy?
by V S Rao 22 May '09

22 May '09

> > You will not get any support for 0.99 here, unless Timo can provide it. > It is *that* old, and your decision to use it - regardless of your > claimed reason - is baffling. I admit I am running a pretty old version and frankly speaking I was not hoping for any support. Let RH earn their money we paid as support. As you would have noticed I was looking for help in running Dovecot as a IMAP Proxy without the need to setup SQL etc. I only went into details to give clarity. I really appreciate all the responses and suggestions. >> We use recent Dovecot from atrpms.net with RHEL 5.3. Userbase is 25.000. >> Dovecot runs on three machines - as master (proxy) and with two slaves. >> The system is stable. We hardly need to touch it. I would be very much interested in knowing the details of your setup as I am suffering here with only 6000+ users. And that too with a config, which I frankly think is an overkill for our requirement. However maybe I should start a separate thread for that? Thanks and Regards V S Rao.

1 0

Re: [Dovecot] How to run Dovecot as IMAP Proxy?
by V S Rao 22 May '09

22 May '09

So I guess I will take the problem to imapproxy group and find out if I can get a clue to the issue I am facing. BTW, just to confirm once again, are there any known issues with Dovecot & imapproxyd? Because I find it strange that there should be around 8000 established connections between Squirrelmail and imapproxyd & around 400 connections between imapproxyd and Dovecot while on the mail server I see only a couple of connections (typically around 40). Or is it some configuration in Dovecot which is causing this kind of behavior, as I did not notice this while running uw-imap. Regards V S Rao

4 3

[Dovecot] v1.2.rc4 released
by Timo Sirainen 22 May '09

22 May '09

http://dovecot.org/releases/1.2/rc/dovecot-1.2.rc4.tar.gz http://dovecot.org/releases/1.2/rc/dovecot-1.2.rc4.tar.gz.sig I'm pretty hopeful that virtual mailbox code is finally crash-free. If people don't find many problems from this release, I'm thinking that rc5 could come in a couple of weeks and that would be renamed to v1.2.0 after a week or so if no one has reported bugs. v1.2.rc4 2009-05-17 Timo Sirainen <tss(a)iki.fi> * If /dev/arandom exists, use it instead of /dev/urandom (OpenBSD). * When logging to a file, the lines now start with a timestamp instead of "dovecot: " prefix. + IMAP: When multiple commands are pipelined, try harder to combine their mailbox syncing together. For example with Maildir pipelining STORE 1:* +FLAGS \Deleted and EXPUNGE commands the files won't be unnecessarily rename()d before being unlink()ed. + imap-proxy: Send backend's CAPABILITY if it's different from what was sent to client before. + IMAP: struct mail now keeps track of all kinds of statistics, such as number of open()s, stat()s, bytes read, etc. These fields could be exported by some kind of a statistics plugin (not included yet). + IMAP: SEARCH command now dynamically figures out how to run about 0.20 .. 0.25 seconds before seeing if there's other work to do. This makes the SEARCH performance much better. - Fixes to shared mailbox handling. - Fixes to virtual mailboxes. - THREAD command could have crashed. - Fixes to expire-tool. - mbox: Don't break if From_-line is preceded by CRLF (instead of LF). - dict process wasn't restarted after SIGHUP was sent to master.

2 1

[Dovecot] v1.1.15 released
by Timo Sirainen 22 May '09

22 May '09

http://dovecot.org/releases/1.1/dovecot-1.1.15.tar.gz http://dovecot.org/releases/1.1/dovecot-1.1.15.tar.gz.sig The command pipelining fix is pretty interesting. Wonder how much it improves performance, especially when deleting lots of messages from a large mailbox. v1.1.15 2009-05-17 Timo Sirainen <tss(a)iki.fi> + IMAP: When multiple commands are pipelined, try harder to combine their mailbox syncing together. For example with Maildir pipelining STORE 1:* +FLAGS \Deleted and EXPUNGE commands the files won't be unnecessarily rename()d before being unlink()ed. - IMAP: SEARCH command was slower than necessary in a large mailbox. - deliver: When forwarding messages, if -f parameter was given, it should have been used as the Return-Path. - Maildir saving: Fixed race condition bugs in uidlist handling, causing files to be given new UIDs sometimes. - mbox: Don't crash when expunging all messages and file doesn't end with [CR]LF. - expire-tool: Use mail_uid and mail_gid settings if userdb doesn't return uid/gid. - Berkeley DB dict: Transaction rollbacking was implemented wrong. - zlib plugin: Some email / FETCH command combinations could have disconnected the client or sent compressed garbage.

2 1

Re: [Dovecot] Authenticating with /etc/passwd
by June Qiu 22 May '09

22 May '09

Apologies for the confusion.. But I finally got what you meant. Yes, the version exists, but was omitted in the extract of the email. --- On Thu, 5/21/09, Charles Marcus <CMarcus(a)Media-Brokers.com> wrote: > From: Charles Marcus <CMarcus(a)Media-Brokers.com> > Subject: Re: [Dovecot] Authenticating with /etc/passwd > To: dovecot(a)dovecot.org > Date: Thursday, May 21, 2009, 10:17 PM > On 5/21/2009 10:11 AM, June Qiu > wrote: > > it is as displayed > > So there's some weird dovecot -n bug that doesn't show the > dovecot > version if the 'Warning: fd limit...' warning is output? > > > --- On Thu, 5/21/09, Charles Marcus <CMarcus(a)Media-Brokers.com> > wrote: > > > >> From: Charles Marcus <CMarcus(a)Media-Brokers.com> > >> Subject: Re: [Dovecot] Authenticating with > /etc/passwd > >> To: "June Qiu" <qljune(a)yahoo.com> > >> Cc: dovecot(a)dovecot.org > >> Date: Thursday, May 21, 2009, 6:39 PM > >> On 5/20/2009, June Qiu (qljune(a)yahoo.com) > >> wrote: > >>> dovecot -n: > >>> > >>> Warning: fd limit 256 is lower than what > Dovecot can > >> use under full load (more than 768). Either grow > the limit > >> or change login_max_processes_count and > max_mail_processes > >> settings > >>> # OS: SunOS 5.10 sun4u > >>> info_log_path: /var/log/dovecot.log > >> Is the missing version line a copy/paste error? Or > did the > >> warning > >> obscure it somehow? > > > -- > > Best regards, > > Charles >

1 0

Re: [Dovecot] How to run Dovecot as IMAP Proxy?
by V S Rao 22 May '09

22 May '09

Thanks for the many responses and views. I have taken RH support for my mail server only and so have to ensure they support me. So am going with their recommended version which is 0.99.x. Now on the webmail I have migrated to RHEL 5.3 and the dovecot being used there is 1.0.7.x. So that should support proxying, right? BTW, originally I did not go to Redhat. I moved from uw-imap to Dovecot 1.1.14 on the mail server for POP3. The problem of POP3 timeouts continued and I could not find any reason why POP3 was timing out when 400+ concurrent IMAP sessions were working fine. Moreover other network services such as SMTP, Telnet, SSH etc were working fine. Had the box installed behind a IPS box to see if there were any DoS attacks, but had to rule that out. As a last resort, paid RH for support and they made me downgrade Dovecot from 1.1.14 to 0.99.x. Surprisingly the moment I downgraded dovecot, the problem shifted to IMAP & remained ever since. So naturally they told me uw-imap was the problem and made me move to Dovecot 0.99.x for IMAP as well, but no improvement. But the surprising thing, as I mentioned in my original post, IMAP works fine on command line, with clients such as Outlook, THunderbird etc., but Webmail is very slow that its almost not available. BTW webmail was also running on RHEL 4.0. Seeing that the problem existed in webmail alone I upgraded webmail to RHEL 5.3 with all the latest RH supported packages on a new hardware. Any ideas to help me debug this issue would be of great help as I am stuck on this issue for almost a month now. Oh, btw regarding stats, I don't have a measure, but when webmail was working the login was well within 5 seconds. Now it takes forever (more than a min) or timeouts most of the time. Even after login, any request such as opening a mail or changing to a mail folder was well within 5 seconds. Now again it takes forever or timeouts most of the time. Thanks and Regards V S Rao ----- Original Message ----- From: "Timo Sirainen" <tss(a)iki.fi> To: "Dovecot Mailing List" <dovecot(a)dovecot.org> Sent: Friday, May 22, 2009 12:32:24 AM GMT +05:30 Chennai, Kolkata, Mumbai, New Delhi Subject: Re: [Dovecot] How to run Dovecot as IMAP Proxy? On Thu, 2009-05-21 at 11:47 -0700, Seth Mattinen wrote: > Yes, that too. My point was not to judge Dovecot's performance based on > a 0.99 version. ;) I've successfully used several versions of dovecot > 1.1.x with imapproxyd and IMAP-only webmail clients. Do you have any numbers about how much faster it works with imapproxyd vs. without?

4 3

Re: [Dovecot] How to run Dovecot as IMAP Proxy?
by V S Rao 21 May '09

21 May '09

Hi Timo, Thanks for the response. Apologize, but my responses are going to be a bit lengthy. > I have migrated from uw-imap to Dovecot for POP3 & IMAP service. I run > webmail using squirrelmail. When running uw-imap I used to run > up.imapproxyd on the webmail server for faster responses. After > migrating to Dovecot, I find that up.imapproxyd does not work well > with dovecot. > Why not? Here are my observations. I have around 6000+ mailboxes and roughly the same number of users. Earlier the mail server (running sendmail + uw-imap for POP3 & IMAP) would have around 80 pop3 connections (peak) and around 300 IMAP connections, concurrent. (ps -aef | grep imap | wc -l or ps -aef | grep pop3 | wc -l). There have been cases where I have observed upto 500 concurrent IMAP sessions. The IMAP connections are from a webmail server running Apache with Squirrelmail. The observation was that response was slow & so based on the suggestion on Squirrelmail for performance improvement we have installed up-imapproxyd on the squirrelmail machine. There was a significant improvement in the response times for the users, because of caching. After that I encountered some strange problems of POP3 timing out for users (earlier I did post that problem in this forum). I opened a ticket with Redhat and naturally they refused to support me with uw-imap running. So switched to Dovecot 0.99.x (I run the server on RHEL 4.0 and that is the max version supported by Redhat for that version). Ever since I did that POP3 works fine but now webmail is almost not available to the users. People usually get "connection dropped by IMAP server". However the IMAP server seems to work fine. Checked through manual "telnet <ip.address.of.mailserver> 143 & also through other client such as outlook & Thunderbird. I noticed that while the number of established connections for the webmail to mail server was shown as around 40 to 50 on the mail server, the same is shown as around 700 on webmail server. { netstat -an | grep :143 | grep ESTABLISHED | wc -l }. imapproxyd is configured to listen on port 9143 on the localhost and communicates to the mail server on std port 143. What was really bizzare is that when I check for the number of connections on port 9143 it shows around 8000! netstat -an | grep :9143 | grep ESTABLISHED | wc -l So I disabled the imapproxyd on the webmail & now at least the 50 connections are consistent. However the response is extremely slow and so was contemplating on the idea of trying out using another IMAP Proxy server and hence the question. > I don't understand Databases and don't want to install mysql etc for a > simple thing like IMAP PRoxy. > Do you just want it to proxy everyone to a single destination or to > different servers based on username? If you want everyone to the same > destination, why do you even want to use a proxy? I want to proxy all user to the same server. The idea being as explained above benefit from caching. > My question is can Dovecot be run as a IMAP PRoxy without the hassle > of setting up mysql etc? I use /etc/passwd for auth on the actual > dovecot server running IMAP & POP3. > Using checkpassword or SQLite would probably be the easiest solution. Or > generation of a passwd-file, but you'd have to keep it updated if users > change. If I used a passwd file on the webmail machine, running dovecot as a Proxy how would I configure dovecot on the webmail server? It has to accept connections from the squirrelmail and talk to the mailserver. I can do a rsync of the passwd file from the mail server to the webmail server using a small script whenever the file changes on the mail server. Of course the fundamental question from your response, I guess is, without a proxy why is the webmail slow? If proxy is not my problem, can you pls throw some light on why I am facing performance issues on my webmail alone? Thanks and Regards V S Rao

4 6

[Dovecot] IMAP Get Savedate plugin
by Alaa Ibrahim 21 May '09

21 May '09

Hi, I want to add a feature to the fetch command in IMAP, by enabling it to return the save date, when I request the SAVEDATE parameter. I want to use this for my webmail application, so I can show the users the deleted date when they are viewing the Trash folder. I was able to put it directly into the code (patch attached), but I was wondering if there is a way to put it as a plugin instead. Can somebody guide me on how to do that. Thanks a lot. ------------------------- Play the best Flash Games on the web with Maktoob Shams Games. http://games.maktoob.com/

2 3

[Dovecot] How to run Dovecot as IMAP Proxy?
by V S Rao 21 May '09

21 May '09

Hi All, I have migrated from uw-imap to Dovecot for POP3 & IMAP service. I run webmail using squirrelmail. When running uw-imap I used to run up.imapproxyd on the webmail server for faster responses. After migrating to Dovecot, I find that up.imapproxyd does not work well with dovecot. I tried to use dovecot as IMAP PRoxy server as per the document http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy I don't understand Databases and don't want to install mysql etc for a simple thing like IMAP PRoxy. My question is can Dovecot be run as a IMAP PRoxy without the hassle of setting up mysql etc? I use /etc/passwd for auth on the actual dovecot server running IMAP & POP3. Thanks V S Rao

2 1

[Dovecot] crypt() failure is possible
by Arkadiusz Miskiewicz 21 May '09

21 May '09

dovecot 1.1.15 in src/auth/password-scheme.c contains: static bool crypt_verify(const char *plaintext, const char *user ATTR_UNUSED, const unsigned char *raw_password, size_t size) { const char *password; if (size == 0) { /* the default mycrypt() handler would return match */ return FALSE; } password = t_strndup(raw_password, size); return strcmp(mycrypt(plaintext, password), password) == 0; } but according to man page crypt() can fail and NULL is returned then. On other hand glibc info page is silent about such failure. The thing is that I'm seeing crypt() failure here with new glibc 2.10.1 built with nss backend for crypt(), so it would be good to handle such case. (crypt failure was due to improper nss packaging but it could also happen if somehow nss file becomes corrupted) -- Arkadiusz Miśkiewicz PLD/Linux Team arekm / maven.pl http://ftp.pld-linux.org/

2 1

Re: [Dovecot] Authenticating with /etc/passwd
by June Qiu 21 May '09

21 May '09

it is as displayed --- On Thu, 5/21/09, Charles Marcus <CMarcus(a)Media-Brokers.com> wrote: > From: Charles Marcus <CMarcus(a)Media-Brokers.com> > Subject: Re: [Dovecot] Authenticating with /etc/passwd > To: "June Qiu" <qljune(a)yahoo.com> > Cc: dovecot(a)dovecot.org > Date: Thursday, May 21, 2009, 6:39 PM > On 5/20/2009, June Qiu (qljune(a)yahoo.com) > wrote: > > dovecot -n: > > > > Warning: fd limit 256 is lower than what Dovecot can > use under full load (more than 768). Either grow the limit > or change login_max_processes_count and max_mail_processes > settings > > # OS: SunOS 5.10 sun4u > > info_log_path: /var/log/dovecot.log > > Is the missing version line a copy/paste error? Or did the > warning > obscure it somehow? > > > -- > > Best regards, > > Charles >

2 1

[Dovecot] Authenticating with /etc/passwd
by June Qiu 21 May '09

21 May '09

I am trying to do authentication with /etc/passwd and something is not working right for me. Pls help! When i try to authenticate via pop3, I get: -ERR Authentication failed. In the logs, I get: May 21 11:14:07 Info: auth(default): client in: AUTH 1 PLAIN service=pop3 secured lip=127.0.0.1 rip=127.0.0.1 lport=110 rport=32774 resp=AGp1bmUAU0lORzNlcnQ= May 21 11:14:07 Info: auth(default): passwd(test1,127.0.0.1): lookup May 21 11:14:07 Info: auth(default): passwd(test1,127.0.0.1): Password mismatch May 21 11:14:07 Info: auth(default): passwd(test1,127.0.0.1): CRYPT(password) != 'x' May 21 11:14:09 Info: auth(default): client out: FAIL 1 user=test1 May 21 11:14:17 Info: pop3-login: Disconnected (auth failed, 1 attempts): user=<test1>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured dovecot -n: Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 768). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: SunOS 5.10 sun4u info_log_path: /var/log/dovecot.log protocols: imap pop3 listen(default): 127.0.0.1:143 listen(imap): 127.0.0.1:143 listen(pop3): * ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: IMAP ready. login_processes_count: 2 mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: passwd userdb: driver: passwd args: blocking=yes

3 2

[Dovecot] mkdir no permission
by Anna Obertacke 21 May '09

21 May '09

Hallo list-member, Please ignore my bad english. I cant wright bad but i understand well. I reinstalled my server and have big problems with (V 1.1.11) dovecot now. I work with Ubuntu 9.04 Server and want to use pop and imap with easy configuration. I fetch all my Mails on the server and want to look them up by apple Mail. Until yesterday dovecot only worked after I logged in and did something on the server, for example call "mail" oder call "mail.log". After reinstall yesterday it works no more. The new entry in log is "Internal error". Anything else was before yesterday also. My Error Logs: mail.log: May 19 10:00:38 ubuntu dovecot: POP3(annalein): mkdir(/home/annalein/Maildir/cur) failed: Permission denied (euid=1000(annalein) egid=1000(annalein) missing +w perm: /home/ annalein) May 19 10:00:38 ubuntu dovecot: POP3(annalein): Couldn't open INBOX: Internal error occurred. Refer to server log for more information. [2009-05-19 10:00:38] May 19 10:00:38 ubuntu dovecot: POP3(annalein): Couldn't open INBOX top=0/0, retr=0/0, del=0/0, size=0 May 19 10:00:43 ubuntu dovecot: IMAP(annalein): mkdir(/home/annalein/Maildir/cur) failed: Permission denied (euid=1000(annalein) egid=1000(annalein) missing +w perm: /home/ annalein) syslog: May 19 10:22:34 ubuntu dovecot-auth: pam_sm_authenticate: Called May 19 10:22:34 ubuntu dovecot-auth: pam_sm_authenticate: username = [annalein] May 19 10:22:34 ubuntu dovecot-auth: Warning: Using default salt value (undefined in ~/.ecryptfsrc) May 19 10:22:36 ubuntu dovecot-auth: Passphrase key already in keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: ecryptfs_add_passphrase_key_to_keyring: Error adding auth tok with sig [e54db404244691b7] to the keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: Error attempting to add filename encryption key to user session keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: Passphrase key already in keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: ecryptfs_add_passphrase_key_to_keyring: Error adding auth tok with sig [d7f23dd0d7e04b51] to the keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: Error attempting to add passphrase key to user session keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: There is already a key in the user session keyring for the given passphrase. My configuration ist in dovecot-postfix.conf. I can't call it by dovecot -n. But i changed allmost nothing from default- disable_plaintext_auth=no Some points in the file: protocols = imap pop3 imaps pop3s managesieve mail_location = maildir:~/Maildir Please tell what i should show you. Thank you for help. Greetings, Anna Obertacke.

3 5

Re: [Dovecot] Migration questions...
by Richard Hobbs 21 May '09

21 May '09

Hello again, people, I have been reading all of the emails sent back and forth recently, and reading many web pages, and I have a new draft of my migration plan. If anyone has the time and generosity to read through this latest plan for me and let me know if you spot any potential problems with it, i'd really appreciate it. FYI, we're moving from a Debian 3.1/exim/uw-imapd/qpopper/mbox setup to a Debian 5.0/exim/dovecot/maildir setup, and the final version of this document can hopefully become a useful guide for lots of people in future too, if I get it right :-) Anyway... here's the plan... 1. Install Debian with exim, spamassassin, mysqld (for Horde/IMP) and mailman. Use ReiserFS for the indexes and data. XFS would be second choice for filesystem, and this is something of a religious argument, but Dovecot's own page states that ReiserFS is a better choice, and loads of pages on the Internet say that one or the other is better - there's no clear winner, really, so ReiserFS (the FS we already know and trust) wins the battle. 2. Run an online update. 3. Setup IPMI and monitor it from Nagios. 4. Install HotSaNIC to monitor historical system stats. 5. Install and configure Dell OpenManage Server Administrator (or whatever it's called) to monitor hardware, and make sure we will be emailed if a hard drive fails. 6. Rsync homedirs and inboxes onto new server, ready for initial exim configuration. 7. Configure exim as per existing mail server and test that mailing lists and normal email works. You should now have the existing mail delivery solution on the brand new hardware. 8. Configure Spamassassin as per current configuration and test. 9. Configure mailman as per current configuration and test. 10. Once mail delivery is sorted, add "deb http://www.backports.org/debian lenny-backports main contrib non-free" into "/etc/apt/sources.list" and run "aptitude update && aptitude install debian-backports-keyring && aptitude update". 11. Install dovecot (at the time of writing, this was version 1.1.13-2). 12. Run the conversion utility (use "mb2md.py" from http://wiki.dovecot.org/Migration/MailFormat because "convert-tool" doesn't preserve msg UIDs) to convert all existing "mbox" mailboxes into "maildir" mailboxes, for use with Dovecot. 13. Setup exim to use Dovecot's delivery agent ("deliver") so the indexes are updated on mail delivery instead of when the mailbox is requested and also to use the new maildir format. 14. Setup dovecot for IMAP and POP3 and test. *****THIS IS WHERE THE REPEATABLE SECTION BEGINS***** 15. Stop exim and dovecot services. 16. Rsync homedirs and inboxes onto new server again. 17. Run the conversion utility (use "mb2md.py" from http://wiki.dovecot.org/Migration/MailFormat because "convert-tool" doesn't preserve msg UIDs) to convert all existing "mbox" mailboxes into "maildir" mailboxes. 18. Start exim and dovecot services and test SMTP, Spamassassin, mailman, IMAP and POP3. *****THIS IS WHERE THE REPEATABLE SECTION ENDS***** 19. Once everything is working perfectly, send an email to the entire company instructing them what to do after the outage and arrange an outage and do the following steps as soon as the outage begins: a. Unplug DMZ switch from firewall to make delivered mail wait at the sender. b. Stop exim, IMAP, POP3 and dovecot services on both mail servers. c. Rsync homedirs and inboxes onto new server again. d. Run the conversion utility (use "mb2md.py" from http://wiki.dovecot.org/Migration/MailFormat because "convert-tool" doesn't preserve msg UIDs) to convert all existing "mbox" mailboxes into "maildir" mailboxes. e. Start exim and dovecot services and test SMTP, Spamassassin, mailman, IMAP and POP3. f. Reconfigure my own mail client to point to the new mail server (192.168.2.3). g. Reconfigure firewall to think the mail server is now on 192.168.2.3 instead of 192.168.2.2. h. Prepare an email in webmail somewhere in the world, ready to send to a user on our mail server. i. Plug DMZ switch back into firewall and begin monitoring exim logs to check that mail is being delivered. j. Send the email from webmail and check that is goes through exim perfectly and is sitting in the users Inbox. NOTE: We now have a working mail delivery solution! k. Start dovecot IMAP and POP3 and test both. l. Once exim and dovecot are both working against live mailboxes, tell everyone the outage is over. 20. Install and configure Horde & IMP to access email via IMAP. 21. Reconfigure backup script to make sure new server is backed up. 22. Modify Nagios config to monitor new server. 23. DONE! Thanks in advance, everyone! :-) Richard. Brandon Lamb wrote: > On Fri, May 15, 2009 at 5:02 AM, Richard Hobbs > <richard.hobbs(a)crl.toshiba.co.uk> wrote: >> Seth Mattinen wrote: >>> Richard Hobbs wrote: >>>> Seth Mattinen wrote: >>>>> Phillip Macey wrote: >>>>>> On 14/05/2009 5:11 PM, Steffen Kaiser wrote: >>>>>>> On Wed, 13 May 2009, Richard Hobbs wrote: >>>>>>>> The main complaint we have from users is that their IMAP Inbox, with >>>>>>>> 5000 emails in it takes ages to appear, and no amount of coaxing will >>>>>>>> convince them to split their inbox into multiple folders. >>>>>>> Oh, we serve Maildir via Dovecot IMAP and 5000 messages per folder are >>>>>>> a wimp. Problems start if the user: >>>>>> We are having some performancec issues on our server at the moment - all >>>>>> I can put it down to is the large size of some maildirs. Eg. `ls -ld >>>>>> Maildir/cur` might show a directory >20Mb in size for some of our users >>>>>> (20-30k emails). >>>>>> (Performance issues == everything is running ok then all of a sudden >>>>>> load avg goes through the roof, system cpu time goes crazy. Reading mail >>>>>> grinds to a halt. Then everything recovers just as suddenly and the load >>>>>> avg gradually returns to normal levels) >>>>> Are you using ext3 by chance? Vanilla ext3 without directory indexing >>>>> (or whatever it's called) *hates* directories with a lot of files - like >>>>> maildir. Personally, I use XFS, which doesn't suffer from this problem >>>>> since it uses b-trees instead of a table(!) like ext3 does. >>>> This raises another question for me actually... >>>> >>>> We will have one volume for indexes and another volume for data (using >>>> maildir). We will be using the latest stable Debian Linux distro. >>>> >>>> Any opinions on the best filesystem to use? We would normally go >>>> ReiserFS for large volumes, and ext3 for small volumes because of the >>>> unlimited inodes in reiserfs, but i understand that support for that is >>>> beginning to disappear given that Hans Reiser got into a bit of trouble >>>> a few years ago. >>>> >>>> Anyway... that would leave ext3, but is there a better choice i could >>>> make in this instance? We do want performance, of course, but also >>>> complete reliability and resilience when it comes to system crashes >>>> etc... we do *not* want data corruption, and ext3 we know has a very >>>> good journalling and data recovery methods. Well... they're very mature, >>>> anyway. >>>> >>> I used to use ext3, ran into its horrible performance even with >>> directory indexing enabled, went to XFS and never looked back. All of my >>> systems are Debian stable. Reiser3 is part of the kernel so I wouldn't >>> worry about that; Namesys considered it complete and stopped work on it >>> long before the whole murder thing. Both Reiser3 and XFS have worse >>> reputations than ext3, however, I've seen ext3 filesystems hosed beyond >>> repair, too. All my XFS filesystems have battery-backed cache >>> controllers, so it hasn't happened to me yet, hopefully never. ;) One >>> catch with XFS (such as with LVM) to keep in mind is you can't ever >>> shrink it, only grow. >> Trouble is... i've been googling this as well, just now, and loads of >> people say XFS has the better performance, but loads of other people say >> ReiserFS has the better performance. >> >> We have battery backed up RAID controllers too, in this new system, and >> the systems are UPSd, so on that basis i'm still none the wiser! lol >> >> I appreciate your experience with XFS is a positive one, but even the >> dovecot web site says XFS might now be a good choice... >> >> http://wiki.dovecot.org/MailboxFormat/Maildir >> >> What a tough decision! I know it probably won't make too much difference >> in my situation, but i want this to be a very long-term solution, so >> want to do it right first time! >> >> Any other opinions on XFS vs Reiserfs with Dovecot maildir? >> >> Thanks again! >> >> Richard. >> >> >>> ext3 is mature but IMHO completely unsuitable for a busy mail server or >>> any situation where you'll have a bajillion of files in one directory. >>> The exact point at which ext3 will screw you over obviously depends on >>> many factors. But when it happens it'll probably be painful to reformat >>> to something better. >>> >>> ~Seth >>> >>> ______________________________________________________________________ >>> This email has been scanned by the MessageLabs Email Security System. >>> For more information please visit http://www.messagelabs.com/email >>> ______________________________________________________________________ >>> >>> >> -- >> Richard Hobbs (IT Specialist) >> Toshiba Research Europe Ltd. - Cambridge Research Laboratory >> Email: richard.hobbs(a)crl.toshiba.co.uk >> Web: http://www.toshiba-europe.com/research/ >> Tel: +44 1223 436999 Mobile: +44 7811 803377 > > We have been using XFS on our raids for the last few years. We have > fairly new hardware, and using maildir. Delivering over nfs using > exim+dovecot deliver. pop3/imap is near instant load on our webmail. > We have about 16,000 email accounts with ~175 imap+pop3 connections > open all the time. 20 drive sata2 raid 10. amd quad core 9850 with 8 > gigs ram. load sits about 0.30 - 0.45 all day/night. Last I checked > backups were 30-45 minutes, 413 gigs. 6,403,942 files. > > ______________________________________________________________________ > This email has been scanned by the MessageLabs Email Security System. > For more information please visit http://www.messagelabs.com/email > ______________________________________________________________________ > > -- Richard Hobbs (IT Specialist) Toshiba Research Europe Ltd. - Cambridge Research Laboratory Email: richard.hobbs(a)crl.toshiba.co.uk Web: http://www.toshiba-europe.com/research/ Tel: +44 1223 436999 Mobile: +44 7811 803377

2 2

Re: [Dovecot] pop3 gives a permission denied error on chdir
by Kenneth Gonsalves 21 May '09

21 May '09

On Wednesday 20 May 2009 01:20:37 you wrote: > On Tue, 2009-05-19 at 13:35 +0530, Kenneth Gonsalves wrote: > > May 19 09:16:10 greenchilly dovecot: chdir(/home/vmail/example.com/john) > > failed with uid 5000: Permission denied > > .. > > > I have looked at the archives and see that the problem has been reported > > before, but cannot find any solution. Dovecot as LDA has no problem > > accessing and writing mails to the directory as UID 5000. I suspect that > > it is trying to access some other directory and the error message is > > misleading. The directory /home/vmail/example.com/john is owned by user > > vmail with UID 5000. Any clues? > > And all the directories before that are also available for that user? yes > Are you using NFS? Are you using SELinux or something? no > Anyway that > chdir() syscall really failed with that error message. The reason for > that is less clear then.. v1.1+ would give a much nicer error message > here telling exactly what is wrong.. I have installed version 1.1.13, here is the mail log: May 20 10:33:54 greenchilly dovecot: auth(default): new auth connection: pid=1181 May 20 10:34:07 greenchilly dovecot: auth(default): client in: AUTH^I1^IPLAIN^Iservice=pop3^Isecured^Ilip=127.0.0.1^Irip=127.0.0.1^Ilport=110^Irport=42418^Iresp=<hidden> May 20 10:34:07 greenchilly dovecot: auth-worker(default): pam(john(a)example.com,127.0.0.1): lookup service=dovecot May 20 10:34:07 greenchilly dovecot: auth-worker(default): pam(john(a)example.com,127.0.0.1): #1/1 style=1 msg=Password: May 20 10:34:10 greenchilly dovecot: auth-worker(default): pam(john(a)example.com,127.0.0.1): unknown user May 20 10:34:10 greenchilly dovecot: auth(default): sql(john(a)example.com,127.0.0.1): query: SELECT email as user, passwd as password FROM view_users WHERE email='john(a)example.com'; May 20 10:34:10 greenchilly dovecot: auth(default): client out: OK^I1^Iuser=john(a)example.com May 20 10:34:10 greenchilly dovecot: auth(default): master in: REQUEST^I3^I1166^I1 May 20 10:34:10 greenchilly dovecot: auth(default): passwd(john(a)example.com,127.0.0.1): lookup May 20 10:34:10 greenchilly dovecot: auth(default): passwd(john(a)example.com,127.0.0.1): unknown user May 20 10:34:10 greenchilly dovecot: auth(default): master out: USER^I3^Ijohn@example.com^Iuid=5000^Igid=5000^Ihome=/home/vmail/example.com/john May 20 10:34:10 greenchilly dovecot: Fatal: chdir(/home/vmail/example.com/john) failed with uid 5000: Permission denied May 20 10:34:10 greenchilly dovecot: child 1182 (pop3) returned error 89 (Fatal failure) May 20 10:34:10 greenchilly dovecot: pop3-login: Login: user=<john(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured and here is the session info: lawgon@greenchilly:~$ telnet localhost pop3 Trying 127.0.0.1... Connected to localhost.localdomain. Escape character is '^]'. +OK Dovecot ready. user john(a)example.com +OK pass summersun +OK Logged in. Connection closed by foreign host. -- regards Kenneth Gonsalves Associate NRC-FOSS http://nrcfosshelpline.in/web/

3 7

Re: [Dovecot] Authenticating with /etc/passwd
by June Qiu 21 May '09

21 May '09

Solved. Thanks, Timo! --- On Thu, 5/21/09, Timo Sirainen <tss(a)iki.fi> wrote: > From: Timo Sirainen <tss(a)iki.fi> > Subject: Re: [Dovecot] Authenticating with /etc/passwd > To: "June Qiu" <qljune(a)yahoo.com> > Cc: dovecot(a)dovecot.org > Date: Thursday, May 21, 2009, 11:31 AM > On Wed, 2009-05-20 at 20:16 -0700, > June Qiu wrote: > > I am trying to do authentication with /etc/passwd and > something is not working right for me. Pls help! > .. > > May 21 11:14:07 Info: auth(default): > passwd(test1,127.0.0.1): CRYPT(password) != 'x' > > /etc/passwd doesn't have passwords nowadays. They're in > /etc/shadow. > Either user passdb shadow or passdb pam. > >

1 0

[Dovecot] compile error with patched dovecot-1.2.rc4
by Carlos Xavier 21 May '09

21 May '09

Hi, I just downloaded the dovecot-1.2.rc4.tar.gz to do some tests. I coud compile it and generate the package with no trouble on my Slackware 12.2.0 Then as I wanted to try the patchs available at http://hg.dovecot.org/dovecot-1.2/# I downloaded them and applied at once. When I tried to compile once again I got this error: cmd-thread.o: In function `cmd_thread': cmd-thread.c:(.text+0x219): undefined reference to `mail_thread_type_parse' ../../src/lib-storage/libstorage.a(mail-search-build.o): In function `search_arg_build': mail-search-build.c:(.text+0x10b9): undefined reference to `mail_thread_type_parse' collect2: ld returned 1 exit status make[3]: *** [imap] Error 1 make[3]: Leaving directory `/usr/local/src/dovecot-1.2.rc4/src/imap' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/usr/local/src/dovecot-1.2.rc4/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/usr/local/src/dovecot-1.2.rc4' make: *** [all] Error 2 I removed the patched folder and untarred it again, but at this time I decided to apply one patch at time just to see witch one gave me the trouble. When the first set of patch ( http://hg.dovecot.org/dovecot-1.2/rev/d42a8623a008 ) was applied I got the same error. Just to confirm it was this set of patch, I applied all the other set of patchs leaving that one not applied and the compilation went out with no trouble. As im not a expert so I am sending this report to the list in order to get it fixed. Best Regards, Carlos Xavier.

2 2

[Dovecot] Problem with pam/krb5 auth on AIX 5.3
by Jonathan Siegle 20 May '09

20 May '09

I'm using pam to authenticate users against my krb5 realm. Here is the problem scenario: User test2 attempts to login and their password is not expired so dovecot says: 0 login test2 myfavoritepassword 0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH] Logged in 1 logout * BYE Logging out 1 OK Logout completed. User test1 attempts to login, but their password is expired. So dovecot says: 0 login test1 myfavoritepassword 0 NO d expired User test2 attempts to login and their password is not expired. But dovecot still says: 0 login test2 myfavoritepassword 0 NO d expired If I kill the pid with name "dovecot-auth -w", user test2 can login just fine unless I login with the user test1 before trying user test2. So it seems like something is getting cached. I'm running imap-login out of inetd, in case that matters. In my dovecot.conf, I don't have any caching/authentication variables activated. I don't see anything obvious to type in passdb pam{ } to type. For debug, I've enable pam for telnet and tested that without error. Also, the logs show that test2 This is dovecot revision 9062:694714d59cd9 . Looking at the logs, I see user test2 authenticate correctly in all instances. thanks, Jonathan

2 2

[Dovecot] %d does not expand to domain
by Giuliano Gavazzi 20 May '09

20 May '09

Hello, dovecot-1.1.7 on FreeBSD 7.1. Usernames have dot in them (like uname.example for a user in example.com) in dovecot.conf I have: mail_location: maildir:/userhomes/maildirs/%d/%n/Maildir and for authentication: username_format: %Ln In the client, tried with CONE and Mail.app, I put the username as: uname.example(a)example.com So, the authentication works fine, as it extracts the uname.example from the uname.example(a)example.com supplied. The mail_location does not: Apr 27 17:21:26 drum dovecot: imap-login: Login: user=<uname.example>, method=PLAIN, rip=88.149.183.86, lip=88.149.202.106, TLS Apr 27 17:21:26 drum dovecot: IMAP(name.example): Effective uid=1301, gid=1301, userhomes=/userhomes/example.com/uname Apr 27 17:21:26 drum dovecot: IMAP(uname.example): Namespace: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes Apr 27 17:21:26 drum dovecot: IMAP(uname.example): maildir: data=/ userhomes/maildirs//uname.example/Maildir Apr 27 17:21:26 drum dovecot: IMAP(uname.example): maildir++: root=/ userhomes/maildirs//uname.example/Maildir, index=, control=, inbox=/ userhomes/maildirs//uname.example/Maildir it looks like the %d expands to the empty string. Could this be due to the "." in the username? Thanks Giuliano

3 12

[Dovecot] maildir filename with eg. ,S=1000, omitted
by Joseph LP 20 May '09

20 May '09

Hello. I encountered the wiki entry on maildirs not long ago. In it, it is suggested that the use of ,S= and ,W= may improve performance as dovecot does not need to calculate size itself. While my maildir filenames have ,W=, they lack ,S=. I've grepped dovecot.conf, but I can find no option to address this. Regards, Joseph

2 1

[Dovecot] Deleting everything left from lazy expunge
by Romer Ventura 20 May '09

20 May '09

Hello, My storage is running low and i was wondering what would be the best and easy way of deleting everything within the "deleted" and "expunged" folders for every user...? My mail resides in: /srv/mail/vmail/MYDOMAIN.COM/<users>/Maildir/ Thanks..!

3 3

Re: [Dovecot] using postfix+dovecot+squirrell+amavisd and spam folder per user
by ESGLinux 20 May '09

20 May '09

HI again, I cant get this work. I have followed these instructions: http://wiki.dovecot.org/LDA/Postfix Now I have this in my configuratio files: main.cf: .... virtual_transport = dovecot ..... master.cf: .... dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${recipient} ... dovecot.conf: protocol lda { postmaster_address = postmaster(a)xeridia.com mail_plugins = quota cmusieve #sieve_global_dir = /etc/dovecot/sieve/ sieve = /etc/dovecot/sieve/dovecot.sieve log_path = /var/log/dovecot-deliver.log info_log_path = /var/log/dovecot-deliver.log } but when I send mails I don´t see that it uses dovecot lda at all: this is an extract of the log: ay 20 12:55:49 SBPRUEBAS postfix/cleanup[7049]: 9546769339: message-id=< 20090520105549.9546769339(a)SBPRUEBAS.dominio.com> May 20 12:55:49 SBPRUEBAS postfix/qmgr[7039]: 9546769339: from=< root(a)xerida.com>, size=314, nrcpt=1 (queue active) May 20 12:55:49 SBPRUEBAS amavis[6965]: (06965-01) (!!)WARN: all primary virus scanners failed, considering backups May 20 12:55:51 SBPRUEBAS postfix/smtpd[7056]: connect from unknown[127.0.0.1] May 20 10:55:51 SBPRUEBAS postfix/smtpd[7056]: 85D616933C: client=unknown[127.0.0.1] May 20 12:55:51 SBPRUEBAS postfix/cleanup[7049]: 85D616933C: message-id=< 20090520105549.9546769339(a)SBPRUEBAS.dominio.com> May 20 12:55:51 SBPRUEBAS postfix/qmgr[7039]: 85D616933C: from=< root(a)xerida.com>, size=760, nrcpt=1 (queue active) May 20 12:55:51 SBPRUEBAS amavis[6965]: (06965-01) Passed CLEAN, < root(a)xerida.com> -> <prueba(a)pruebax2.com>, Message-ID: < 20090520105549.9546769339(a)SBPRUEBAS.dominio.com>, mail_id: eaVsoxO6Fxg4, Hits: 1.374, size: 314, queued_as: 85D616933C, 1926 ms May 20 12:55:51 SBPRUEBAS postfix/smtp[7052]: 9546769339: to=< prueba(a)pruebax2.com>, relay=127.0.0.1[127.0.0.1]:10024, delay=2, delays=0.03/0.01/0.01/1.9, dsn=2.0.0, status=sent (250 2.0.0 Ok, id=06965-01, from MTA([127.0.0.1]:10025): 250 2.0.0 Ok: queued as 85D616933C) May 20 12:55:51 SBPRUEBAS postfix/qmgr[7039]: 9546769339: removed May 20 12:55:51 SBPRUEBAS postfix/virtual[7061]: 85D616933C: to=< prueba(a)pruebax2.com>, relay=virtual, delay=0.03, delays=0.01/0.01/0/0.01, dsn=2.0.0, status=sent (delivered to maildir) May 20 12:55:51 SBPRUEBAS postfix/qmgr[7039]: 85D616933C: removed I think I´m missing something, but I dont know what. thanks in advance for your answers ESG

2 2

[Dovecot] %d isn't expanded
by Roy Sigurd Karlsbakk 20 May '09

20 May '09

Hi all I have a box running Debian Lenny 5.0.1 and Dovecot 1.0.15. The user query given below does not expand %d, making logins fail. The password query seems to work well, according to the mysql query log. Any ideas why this happens? Best regards roy user_query = SELECT 'maildir:/var/spool/dovecot/%d/%n' as mail, uid, gid, domain FROM users WHERE username = '%n' and domain = '%d' # 1.0.15: /etc/dovecot/dovecot.conf log_path: /var/log/dovecot/dovecot.log log_timestamp: %Y-%m-%d %H:%M:%S disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login verbose_proctitle: yes mail_privileged_group: mail mail_location: maildir:/var/spool/dovecot/%d/%n auth default: default_realm: eventchief.com verbose: yes debug: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf -- Roy Sigurd Karlsbakk (+47) 97542685 / 98013356 roy(a)karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk.

1 0

[Dovecot] Dovecot is emptying Maildir folders
by Alexander Johannes 20 May '09

20 May '09

Hello, i have a annoying problem with dovecot after updating to 1.1.14. Dovecot seems to empty all cur/ and new/ Folders in the Maildir of a particular user several times a day (3 times so far). It leaves only unread messages in their place. All Index-Files are getting updated and reflect the "empty"-State of the Mailbox. A quick look over the logfiles reveals nothing which seems to be relevant to this malfunction. The error_log is empty for the relevant timeframe. There is no Expire/Expunge-Plugin running. Fortunately i have a hourly backup-snapshot to restore the Mailboxes, but this is obviously no solution. How can i debug this problem? Any advice is welcome. System: FreeBSD 7.1-RELEASE, dovecot-1.1.14, dovecot-managesieve-0.10.6, dovecot-sieve-1.1.6 (all installed via the ports-tree), exim-4.69_3 Clients: Thunderbird, Mail.app both IMAP only Regards, Alex

4 7

[Dovecot] using postfix+dovecot+squirrell+amavisd and spam folder per user
by ESGLinux 20 May '09

20 May '09

Hi All, As I say in the subject I use postfix, dovecot with squirrellmail as webmail and amavisd as spam control, My problem is that all the spam I catch is send to /var/lib/amavis/virus but I want to send this mails to the spam folder of each user. This way the user can see the mails and determine if they are really spam or false positive. I dont know exactly what element of the system is the responsible to do that (dovecot, amavis, posttix) any suggest? (although only be the initial point to look for it) Thanks in advance ESG

2 3

[Dovecot] expire-tool segmentation fault
by LEVAI Daniel 20 May '09

20 May '09

Hi! I'm using Dovecot 1.1.15 on OpenBSD 4.4. How can I debug this? # /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire- tool Segmentation fault (core dumped) # gdb /usr/local/sbin/dovecot (gdb) run --exec-mail ext /usr/local/libexec/dovecot/expire-tool Starting program: /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire-tool Program received signal SIGTRAP, Trace/breakpoint trap. Cannot remove breakpoints because program is no longer writable. It might be running in another process. Further execution is probably impossible. 0x044628c0 in ?? () (gdb) bt full #0 0x044628c0 in ?? () No symbol table info available. What else could I do? Thanks! Daniel -- LÉVAI Dániel PGP key ID = 0x4AC0A4B1 Key fingerprint = D037 03B9 C12D D338 4412 2D83 1373 917A 4AC0 A4B1

2 4

[Dovecot] National symbols imap search
by Max Ivanov 20 May '09

20 May '09

How does imap server should handle search requests with non latin symbols? Rightnow thunderbird 2.0.0.21 and dovecot1.2rc3 are unable to find any message if I try to search for cyrillic symbols. fts, and squat plugins are enabled

3 2

[Dovecot] POP3 with lot of messages
by Matt 20 May '09

20 May '09

Running Dovecot 1.1.8. Have several email accounts with thousands of messages in them that are left on server. Is there anyway to speed up POP3 access without switching to IMAP? Doubt it but thought I would ask. Matt

3 4

[Dovecot] pop3 gives a permission denied error on chdir
by Kenneth Gonsalves 19 May '09

19 May '09

hi, I am running debian lenny standard install and dovecot also as a standard install. I have a problem with POP3 access. The error message is: May 19 09:16:10 greenchilly dovecot: chdir(/home/vmail/example.com/john) failed with uid 5000: Permission denied May 19 09:16:10 greenchilly dovecot: child 26253 (pop3) returned error 89 May 19 09:16:10 greenchilly dovecot: pop3-login: Login: user=<john(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured I have looked at the archives and see that the problem has been reported before, but cannot find any solution. Dovecot as LDA has no problem accessing and writing mails to the directory as UID 5000. I suspect that it is trying to access some other directory and the error message is misleading. The directory /home/vmail/example.com/john is owned by user vmail with UID 5000. Any clues? my config: greenchilly:/etc/dovecot# dovecot -n # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_location: maildir:/home/vmail/%d/%n/Maildir mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: static args: uid=5000 gid=5000 home=/home/vmail/%d/%n allow_all_users=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail -- regards Kenneth Gonsalves Associate NRC-FOSS http://nrcfosshelpline.in/web/

2 1

[Dovecot] Virtual users, local delivery via LDA and LDAP troubles
by Konstantin Khomoutov 19 May '09

19 May '09

We're investigating the possibiliy to migrate our mail system from Sendmail+Cyrus to Sendmail+Dovecot. The system must use authentication against Windows AD (supposedly using LDAP) and must use virtual hosting. So far we managed to work around a bug reported in [1], and IMAP/POP3 authentication on LDAP works OK. LDAP auth is set up using binds (Cyrus and Ejabberd authenticate against the same LDAP server without problems). As we use virtual users, userdb is set to be "static" in a standard way: userdb static { args = uid=10513 gid=10513 home=/var/local/dovecot/%u } After verifying IMAP/POP3 authentication works, I've set up the Dovecot LDA to deliver mail for domain users. This exposed another problem which I don't understand: the delivery program tries to figure out whether the user exists (which is perfectly sensible), it talks to the "master" authentication process which seemingly uses passdb backend to search LDAP. But this fails with the message "passdb doesn't support lookups, can't verify user's existence". [2] suggests it's auth binds that prevent this scheme from functioning correctly, but we can't stop using auth binds as Windows AD doesn't store users' passwords in any way sensible for external consumption. This would also pose unnecessary security risk on the domain, as the account used for initial binding should have had rights to read passwords, and its credentials are placed in the Dovecot configuration file in clear text. I read about "allow_all_users" in [3], but our Sendmail doesn't check whether the target user exists and we don't want to implement this as it logically pertains to the program which actually manages users' mailboxes -- Dovecot in our case. Is there a way to solve the problem at hand within the specified constraints? 1. http://dovecot.org/pipermail/dovecot/2009-May/039540.html 2. http://www.mail-archive.com/dovecot@dovecot.org/msg09449.html 3. http://www.mail-archive.com/dovecot@dovecot.org/msg08848.html

2 1

[Dovecot] what is deliver(1.1.10) doing in /tmp
by Pawel Eljasz 19 May '09

19 May '09

dear all, first part of log snippet is to show a bit of contrast, to me it's peculiar situation it's about messages between local users, actually one user, when I use command line mailx or anther local account to send to A_local user - ok second part is this weir error, it's selinux which prevents deliver write to /tmp, I believe thsese messages are from A_local user cron jobs(to himself) why would dovecot act differently in these scenarios, why would it need /tmp one time and not need it another May 19 14:32:29 whale postfix/pickup[9588]: 725F08F95500: uid=0 from=<root> May 19 14:32:29 whale postfix/cleanup[10877]: 725F08F95500: message-id=<20090519133229.725F08F95500(a)whale.hindhead.local> May 19 14:32:29 whale postfix/qmgr[3083]: 725F08F95500: from=<root(a)hindhead.local>, size=445, nrcpt=1 (queue active) May 19 14:32:30 whale dovecot: auth(default): new auth connection: pid=10883 May 19 14:32:30 whale postfix/smtpd[10883]: connect from localhost.localdomain[127.0.0.1] May 19 14:32:30 whale postfix/smtpd[10883]: 1E96A8F95501: client=localhost.localdomain[127.0.0.1] May 19 14:32:30 whale postfix/cleanup[10877]: 1E96A8F95501: message-id=<20090519133229.725F08F95500(a)whale.hindhead.local> May 19 14:32:30 whale postfix/qmgr[3083]: 1E96A8F95501: from=<root(a)hindhead.local>, size=906, nrcpt=1 (queue active) May 19 14:32:30 whale postfix/smtpd[10883]: disconnect from localhost.localdomain[127.0.0.1] May 19 14:32:30 whale amavis[9369]: (09369-14) Passed CLEAN, <root(a)hindhead.local> -> <pawel(a)hindhead.local>, Message-ID: <20090519133229.725F08F95500(a)whale.hindhead.local>, mail_id: D3qbEK-TL0Hi, Hits: 0.028, size: 445, queued_as: 1E96A8F95501, 650 ms May 19 14:32:30 whale postfix/smtp[10880]: 725F08F95500: to=<pawel(a)hindhead.local>, relay=127.0.0.1[127.0.0.1]:10024, delay=0.67, delays=0.02/0.01/0/0.65, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as 1E96A8F95501) May 19 14:32:30 whale postfix/qmgr[3083]: 725F08F95500: removed May 19 14:32:30 whale deliver(pawel): Loading modules from directory: /usr/lib64/dovecot/lda May 19 14:32:30 whale deliver(pawel): Module loaded: /usr/lib64/dovecot/lda/lib90_cmusieve_plugin.so May 19 14:32:30 whale deliver(pawel): maildir: data=/home/pawel/Maildir May 19 14:32:30 whale deliver(pawel): maildir++: root=/home/pawel/Maildir, index=, control=, inbox=/home/pawel/Maildir _May 19 14:32:30 whale deliver(pawel): cmusieve: Using sieve path: /home/pawel/.dovecot.sieve May 19 14:32:30 whale deliver(pawel): cmusieve: Executing script /home/pawel/.dovecot.sievec_ May 19 14:32:30 whale deliver(pawel): msgid=<20090519133229.725F08F95500(a)whale.hindhead.local>: saved mail to INBOX May 19 14:32:30 whale postfix/local[10884]: 1E96A8F95501: to=<pawel(a)hindhead.local>, relay=local, delay=0.02, delays=0/0.01/0/0.01, dsn=2.0.0, status=sent (delivered to command: /usr/libexec/dovecot/deliver) May 19 14:32:30 whale postfix/qmgr[3083]: 1E96A8F95501: removed and right after above: May 19 14:33:05 whale postfix/pickup[9588]: 2607F8F95500: uid=501 from=<pawel> May 19 14:33:05 whale postfix/cleanup[10877]: 2607F8F95500: message-id=<20090519133305.2607F8F95500(a)whale.hindhead.local> May 19 14:33:05 whale postfix/qmgr[3083]: 2607F8F95500: from=<pawel(a)hindhead.local>, size=2892071, nrcpt=1 (queue active) May 19 14:33:05 whale postfix/smtpd[10883]: connect from localhost.localdomain[127.0.0.1] May 19 14:33:05 whale postfix/smtpd[10883]: 8DC458F95501: client=localhost.localdomain[127.0.0.1] May 19 14:33:05 whale postfix/cleanup[10877]: 8DC458F95501: message-id=<20090519133305.2607F8F95500(a)whale.hindhead.local> May 19 14:33:05 whale postfix/smtpd[10883]: disconnect from localhost.localdomain[127.0.0.1] May 19 14:33:05 whale postfix/qmgr[3083]: 8DC458F95501: from=<pawel(a)hindhead.local>, size=2899979, nrcpt=1 (queue active) May 19 14:33:05 whale deliver(pawel): Loading modules from directory: /usr/lib64/dovecot/lda May 19 14:33:05 whale deliver(pawel): Module loaded: /usr/lib64/dovecot/lda/lib90_cmusieve_plugin.so May 19 14:33:05 whale deliver(pawel): maildir: data=/home/pawel/Maildir May 19 14:33:05 whale deliver(pawel): maildir++: root=/home/pawel/Maildir, index=, control=, inbox=/home/pawel/Maildir May 19 14:33:05 whale deliver(pawel): maildir++: root=/home/pawel/Maildir, index=, control=, inbox=/home/pawel/Maildir _May 19 14:33:05 whale deliver(pawel): cmusieve: Using sieve path: /home/pawel/.dovecot.sieve May 19 14:33:05 whale deliver(pawel): cmusieve: Executing script /home/pawel/.dovecot.sievec_ *May 19 14:33:05 whale deliver(pawel): creat(/tmp/dovecot.deliver..1242739985.10903.8aa6fa47dffdc26d) failed: Permission denied May 19 14:33:05 whale deliver(pawel): copy: i_stream_read() failed: Permission denied* May 19 14:33:05 whale amavis[9395]: (09395-14) Passed CLEAN, <pawel(a)hindhead.local> -> <pawel(a)hindhead.local>, Message-ID: <20090519133305.2607F8F95500(a)whale.hindhead.local>, mail_id: QY0vutvX3AMN, Hits: -, size: 2896598, queued_as: 8DC458F95501, 449 ms May 19 14:33:05 whale postfix/smtp[10880]: 2607F8F95500: to=<pawel(a)hindhead.local>, orig_to=<pawel>, relay=127.0.0.1[127.0.0.1]:10024, delay=3, delays=2.5/0/0/0.45, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as 8DC458F95501) May 19 14:33:05 whale deliver(pawel): msgid=<20090519133305.2607F8F95500(a)whale.hindhead.local>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2009-05-19 14:33:05] *May 19 14:33:05 whale deliver(pawel): sieve runtime error: Keep: Generic Error May 19 14:33:05 whale deliver(pawel): sieve_execute_bytecode(/home/pawel/.dovecot.sievec) failed* May 19 14:33:05 whale postfix/local[10884]: 8DC458F95501: to=<pawel(a)hindhead.local>, relay=local, delay=0.07, delays=0.06/0/0/0.01, dsn=4.3.0, status=deferred (temporary failure) May 19 14:33:05 whale postfix/qmgr[3083]: 2607F8F95500: removed cheers

2 1

[Dovecot] ext3/ext4 performance issue
by Timo Sirainen 19 May '09

19 May '09

Wonder if anyone else has actually noticed this and has some kind of statistics? http://marc.info/?t=124234003300001&r=1&w=2

6 8

[Dovecot] Segfault in deliver server
by Sascha Wilde 19 May '09

19 May '09

Hi Timo, Hi list, I finally got along to test the current dovecot 1.2 with our Kolab Server. And I'm very excited to see all the cool ACL and shared name spaces stuff upstream, thanks a lot Timo! Anyway I just stumbled across a new bug using our metadata-plugin (which in turn uses the dict back end): Making a few annotations requests after another it stops working. dovecot.log sais something like: Feb 03 11:58:21 burlywood3 <info> dovecot[10486]: IMAP(4(a)burlywood3.rgb): metadata_get_metadata_entry: dict key=shared//kolab/var/dovecot/spool/4@burlywood3. rgb/home/maildir/.Calendar//vendor/kolab/folder-type Feb 03 11:58:21 burlywood3 <error> dovecot[10486]: child 10503 (dict) killed with signal 11 Feb 03 11:58:21 burlywood3 <error> dovecot[10486]: IMAP(4(a)burlywood3.rgb): read(/kolab/var/dovecot/run/dict-server) failed: Connection reset by peer Feb 03 11:58:21 burlywood3 <critical> dovecot[10520]: Fatal: dup2(3) failed: Bad file descriptor Feb 03 11:58:21 burlywood3 <error> dovecot[10486]: child 10520 (dict) returned error 89 (Fatal failure) Feb 03 11:58:21 burlywood3 <critical> dovecot[10486]: Panic: file ioloop.c: line 38 (io_add): assertion failed: (fd >= 0) (END) I attached gdb to dict and got this: Program received signal SIGSEGV, Segmentation fault. array_idx_modifiable_i (array=0x38, idx=0) at array.c:10 10 pos = idx * array->element_size; (gdb) bt #0 array_idx_modifiable_i (array=0x38, idx=0) at array.c:10 #1 0x0805e9a2 in sql_pool_unlink (ctx=0x80fb670) at sql-pool.c:64 #2 0x0805ea24 in sql_pool_new (pool=0x80f9470, db_driver=0x80dd498 "sqlite", connect_string=0x810ad78 "/kolab/var/dovecot/lib/metadata-dict.sqlite") at sql-pool.c:97 #3 0x0805bb3c in sql_dict_init (driver=0x80f9ae0, uri=0xbfce9f76 "/kolab/etc/dovecot/metadata-dict.conf", value_type=DICT_DATA_TYPE_STRING, username=0x80fb910 "4(a)burlywood3.rgb") at dict-sql.c:86 #4 0x0805c9ca in dict_init (uri=0xbfce9f6f "sqlite:/kolab/etc/dovecot/metadata-dict.conf", value_type=DICT_DATA_TYPE_STRING, username=0x80fb910 "4(a)burlywood3.rgb") at dict.c:87 #5 0x0805a1b1 in dict_client_connection_input (conn=0x80fb8d0) at dict-server.c:407 #6 0x0806637c in io_loop_handler_run (ioloop=0x80f8a80) at ioloop-epoll.c:202 #7 0x080652fd in io_loop_run (ioloop=0x80f8a80) at ioloop.c:338 #8 0x0805a42d in main () at main.c:122 (gdb) li 5 6 void *array_idx_modifiable_i(struct array *array, unsigned int idx) 7 { 8 size_t pos; 9 10 pos = idx * array->element_size; 11 if (pos >= array->buffer->used) { 12 /* index doesn't exist yet, initialize with zero */ 13 buffer_append_zero(array->buffer, pos + array->element_size - 14 array->buffer->used); (gdb) p array $1 = (struct array *) 0x38 (gdb) p *array Cannot access memory at address 0x38 (gdb) up #1 0x0805e9a2 in sql_pool_unlink (ctx=0x80fb670) at sql-pool.c:64 64 next_ctx = SQL_POOL_CONTEXT(ctx->prev); (gdb) p *ctx $2 = {module_ctx = {reg = 0x0}, prev = 0x0, next = 0x810d2b0, pool = 0x80f9470, refcount = 0, key = 0x80fb638 "sqlite\t/kolab/var/dovecot/lib/metadata-dict.sqlite", orig_deinit = 0x805f229 <driver_sqlite_deinit_v>} (gdb) li 59 prev_ctx->next = ctx->next; 60 } 61 if (ctx->next == NULL) 62 ctx->pool->unused_head = ctx->prev; 63 else { 64 next_ctx = SQL_POOL_CONTEXT(ctx->prev); 65 next_ctx->prev = ctx->prev; 66 } 67 ctx->pool->unused_count--; 68 } (gdb) c Continuing. Program terminated with signal SIGSEGV, Segmentation fault. The program no longer exists It's quite possible, that we got any details in the usage of the dict back end wrong, but I guess that in any case the dict server shouldn't segfault... cheers sascha -- Sascha Wilde OpenPGP key: 4BB86568 http://www.intevation.de/~wilde/ http://www.intevation.de/ Intevation GmbH, Neuer Graben 17, 49074 Osnabrück; AG Osnabrück, HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner

2 2

[Dovecot] Multiple dovecot versions side-by-side
by Max Ivanov 19 May '09

19 May '09

I'm current maintainer of dovecot packages in ALTLinux distro and I plan to make possible to install multiple dovecot versions side-by-side (1.0, 1.1, 1.2) to make upgrade process easier and more robust. Is there any consequences of doing that? I worry about locking maildirs and mboxes, does dovecot handle it correctly if another dovecot process tries to work on same mail location?

2 1

[Dovecot] LDA and postfix with recipient delimiter: documentation
by John Fawcett 18 May '09

18 May '09

Just a comment about the documentation for postfix integration when using receipient delimiter and delivery of user+foo(a)domain.ext to user@domain: http://wiki.dovecot.org/LDA/Postfix I had some issues to get this working, so thought I'd share my experience. Dovecot version 1.2.rc3. Postfix version postfix-2.7-20090511. I have no local (unix) mailboxes, everything is delivered to dovecot, so in postfix I have set mailbox_transport = dovecot. In this case the following syntax taken from the docs does not work: dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${user}@${nexthop} whereas the following does work: dovecot unix - n n - - pipe flags=DRhu user=vmail:mail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${user}@${domain} I think that ${domain} is always what is wanted and only when ${nexthop} happens to have the same value as ${domain} - for example when using a transport table entry like this: /etc/postfix/transport domain.ext dovecot: will the ${user}@${nexthop} form be deliverable. Can anyone see a reason for not using always ${user}@${domain} instead of ${user}@${nexthop}? John

5 6

[Dovecot] dovecot 2.0 (revision 9271:d467712aee77) compile problems on AIX 5.3
by Jonathan Siegle 18 May '09

18 May '09

Having some problems compiling on AIX 5.3 with IBM vac version 8. Programs that I had problems building: test-mail test-imap test-index To fix the undefined symbols problem: ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_end ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_begin ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8 ld: 0711-317 ERROR: Undefined symbol: .charset_is_utf8 ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_str ld: 0711-317 ERROR: Undefined symbol: .message_header_decode_utf8 ld: 0711-317 ERROR: Undefined symbol: .rfc822_parser_init ld: 0711-317 ERROR: Undefined symbol: .rfc822_skip_lwsp ld: 0711-317 ERROR: Undefined symbol: .rfc822_parse_content_type ld: 0711-317 ERROR: Undefined symbol: .rfc2231_parse ld: 0711-317 ERROR: Undefined symbol: .rfc822_parse_mime_token ld: 0711-317 ERROR: Undefined symbol: .rfc822_parse_atom ld: 0711-317 ERROR: Undefined symbol: .message_address_parse ld: 0711-317 ERROR: Undefined symbol: .iconv ld: 0711-317 ERROR: Undefined symbol: .iconv_open ld: 0711-317 ERROR: Undefined symbol: .iconv_close I add this ../lib-charset/.libs/libcharset.a -liconv to the Makefiles (./src/lib-imap/Makefile;./src/lib-index/Makefile;./src/lib-mail/ Makefile) below: $ find . -name Makefile -exec egrep -p libcharset.a {} \; -print clean-noinstPROGRAMS: @list='$(noinst_PROGRAMS)'; for p in $$list; do \ f=`echo $$p|sed 's/$(EXEEXT)$$//'`; \ echo " rm -f $$p $$f"; \ rm -f $$p $$f ; \ done test-imap$(EXEEXT): $(test_imap_OBJECTS) $(test_imap_DEPENDENCIES) @rm -f test-imap$(EXEEXT) $(LINK) $(test_imap_LDFLAGS) $(test_imap_OBJECTS) $ (test_imap_LDADD) $(LIBS) \ ../lib-mail/.libs/libmail.a ../lib-charset/.libs/libcharset.a -liconv ./src/lib-imap/Makefile clean-noinstPROGRAMS: @list='$(noinst_PROGRAMS)'; for p in $$list; do \ f=`echo $$p|sed 's/$(EXEEXT)$$//'`; \ echo " rm -f $$p $$f"; \ rm -f $$p $$f ; \ done test-index$(EXEEXT): $(test_index_OBJECTS) $(test_index_DEPENDENCIES) @rm -f test-index$(EXEEXT) $(LINK) $(test_index_LDFLAGS) $(test_index_OBJECTS) $ (test_index_LDADD) $(LIBS) ../lib-charset/.libs/libcharset.a -liconv ./src/lib-index/Makefile clean-noinstPROGRAMS: @list='$(noinst_PROGRAMS)'; for p in $$list; do \ f=`echo $$p|sed 's/$(EXEEXT)$$//'`; \ echo " rm -f $$p $$f"; \ rm -f $$p $$f ; \ done test-mail$(EXEEXT): $(test_mail_OBJECTS) $(test_mail_DEPENDENCIES) @rm -f test-mail$(EXEEXT) $(LINK) $(test_mail_LDFLAGS) $(test_mail_OBJECTS) $ (test_mail_LDADD) $(LIBS) ../lib-charset/.libs/libcharset.a -liconv ./src/lib-mail/Makefile Then compilation occurs fine. Thanks! Jonathan

2 4

[Dovecot] How to manage Seen flags via sieve?
by Max Ivanov 18 May '09

18 May '09

I use public namespace for group mailboxes. If someone sends email from this mailbox , MTA detects it and delivers copy of that message to mailbox/Sent folder, to keep history of all messages available for every group member. I'd like to set Seen flag on all messages that dovecots deliver puts into "Sent" folder. Is it posible somehow?

2 1

[Dovecot] 1.1.13 squat core dump
by David Halik 18 May '09

18 May '09

While using 1.1.13 and squat with local pine imap on Solaris 9 I had a random core dump today. I was doing a search in a maildir folder with about 2000 emails. Unfortunately, I haven't been able to reproduce it yet, but I wanted to send along the info anyways. Environment: # uname -a SunOS 5.9 Generic_122300-39 sun4u sparc SUNW,Sun-Blade-100 Backtrace: http://pastebin.com/f7aa8bb5 ~# dovecot -n # 1.1.13: /usr/local/etc/dovecot.conf # OS: SunOS 5.9 sun4u protocols: imap imaps pop3 pop3s ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no mail_location: maildir:~/Maildir:INDEX=/heroes/u1/dovecot-index/sparc/index/%u:CONTROL=/heroes/u1/dovecot-index/control/%u mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota fts fts_squat mail_plugins(imap): quota imap_quota fts fts_squat mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): UID%u-%v namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: passdb: driver: pam args: * userdb: driver: passwd plugin: quota: fs fts: squat fts_squat: partial=4 full=4 -- ================================ David Halik System Administrator OIT-CSS Rutgers University dhalik(a)jla.rutgers.edu ================================

5 14

Re: [Dovecot] LDA and postfix with recipient delimiter: documentation
by john.ml＠erba.tv 18 May '09

18 May '09

> Hi John, > no i didnt wrote that, i only have user(a)domain.ext > layout in use currently in my test servers > > -- > Best Regards > > MfG Robert Schetterer > > Germany/Munich/Bavaria > Hi Robert I probably didn't make it clear. The problem with the published syntax is that it does not work for receipient delimiter and delivery to mailbox, except as far as I can see when next_hop is the same as domain, which is not always the case. I think that the documentation should report the syntax with ${domain} instead of ${next_hop}, unless there's something I'm missing, since this should always work. thanks again John

2 1

[Dovecot] migration and conversion from courier
by Giuliano Gavazzi 18 May '09

18 May '09

Dear all, back in January I posted about migration from courier and in particular on the script courier-dovecot-migrate.pl. That script had a bug on BSD (or should I say not-Linux?) type systems*. On FreeBSD (6.1) and MacOSX (10.5) it appended a lot of binary garbage at the end of dovecot-keywords files. On a couple of systems I had not actually run the script with the -- convert option, as I had misunderstood the procedure, so those systems, ironically, are the ones that I migrated better... Now to the issue. My final question at the time was (http://dovecot.org/pipermail/dovecot/2009-January/036292.html) can one delete the dovecot-keywords and rerun the script (leaving alone the dovecot-uidlist)? There is a problem if this cannot be done, as those files have the following structure: 0 flag0 1 flag1 ... m binary garbage [optionally followed by more lines like the last] and if a new keyword is added, the file ends up like (this is copy and paste example): 0 JunkRecorded 1 $NotJunk 2 $Junk 3 Redirected 4 ^A<F0># 5 <B0><96># 6 $Forwarded It does not look like a nice thing to me. I doubt though that the script will cope with flags correctly, as in principle will get the flags from an out of date courierimapkeywords, thus missing any new ones. Perhaps the only solution is to have a new script that deletes the garbage lines and renumbers the following ones, so that the above example would become: 0 JunkRecorded 1 $NotJunk 2 $Junk 3 Redirected 4 $Forwarded and then renames all *g files to *e. Thoughts? Giuliano * This bug was fixed back then by Timo who replaced the script on the site http://www.dovecot.org/tools/courier-dovecot-migrate.pl. But there's no note of the change on the site nor was an announcement made to the list, AFAIK.

2 4

[Dovecot] Quota over NFS
by Flavio Costa 18 May '09

18 May '09

I have accidentaly reply only to Timo, so I'm forwarding to discussion back to the list. Sorry! ---------- Forwarded message ---------- From: Timo Sirainen <tss(a)iki.fi> Date: Mon, May 11, 2009 at 3:12 PM Subject: Re: [Dovecot] Quota over NFS To: Flavio Costa <flavio.cdc(a)gmail.com> On Mon, 2009-05-11 at 15:03 -0300, Flavio Costa wrote: > I get that the server doesn't reply correctly to Dovecot, but the > thing is: why does the LDA works properly? > > May 6 13:15:35 SERVER_NAME deliver(USER_TO): > msgid=<eb4d7eac0905060915y130b9af6i93567e198659d5f7(a)mail.gmail.com>: rejected: Not enough disk space Because it's the NFS server that enforces the quota here. You'd get this error even if you didn't load quota plugin at all. Also note that it's saying "Not enough disk space", not "Quota exceeded" which is the error message from Dovecot v1.0's quota plugin. > And yet, why does 'quota <user>' replies correctly and Dovecot > doesn't? Looking at quota-tools sources, it seemed to ignore the active-check entirely. So I don't know if Dovecot should ignore it too.. > They all obtain the info from the rpc.rquotad running on the > fileserver, right? Yeah. -- Flávio Coutinho da Costa

2 8

[Dovecot] expire plugin error
by Michael Lechtermann 18 May '09

18 May '09

Hi, I am using the db backend for the expire plugin and found the following error message in the logfile: dovecot: Jan 22 10:10:55 Error: dict: secondary db: unable to allocate space from the buffer cache dovecot: Jan 22 10:10:55 Error: dict: Failed to initialize dictionary 'expire' dovecot: Jan 22 10:10:55 Error: IMAP(xxxxxxxxxx): read(/var/dovecot/dict-server) failed: Remote disconnected Anyone know how to fix this? I do not want to use SQL as backend, that would be overkill. # ls -alFh /var/dovecot/dict-server srwxrwxrwx 1 root wheel - 0B Jan 22 10:08 /var/dovecot/dict-server= # dovecot -n # 1.1.8: /etc/dovecot.conf # OS: OpenBSD 4.4 sparc64 ffs base_dir: /var/dovecot/ log_path: /var/log/dovecot.log protocols: imaps pop3s listen: xxxxxxxxxxxx ssl_ca_file: /etc/ssl/xxxxxxxxxxxx.ca ssl_cert_file: /etc/ssl/xxxxxxxxxxxx.crt ssl_key_file: /etc/ssl/private/xxxxxxxxxxxx.key login_dir: /var/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_user: _dovecot mail_max_userip_connections(default): 25 mail_max_userip_connections(imap): 25 mail_max_userip_connections(pop3): 5 first_valid_uid: 10000 last_valid_uid: 19999 first_valid_gid: 100 last_valid_gid: 100 mail_gid: 100 mail_location: mbox:/var/data/mail/%u/mbox:INBOX=/var/data/mail/%u/mbox/inbox:INDEX=/var/dovecot/index/%u mbox_write_locks: fcntl mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): expire imap_quota quota trash zlib mail_plugins(imap): expire imap_quota quota trash zlib mail_plugins(pop3): expire quota zlib mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: passdb: driver: bsdauth userdb: driver: passwd socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: fs:user:noenforcing:mount=/var/data trash: /etc/dovecot-trash.conf expire: Trash 14 expire_dict: proxy:/var/dovecot/dict-server:expire dict: expire: db:/var/lib/dovecot/expire.db

3 5

[Dovecot] pine vs dovecot-zlib (mbox.gz)
by Darabos Edvárd Konrád 18 May '09

18 May '09

Hello! Always reproducible pine vs dovecot-imap-mbox.gz scene has weird errors. - Initial message is OK: [Folder "SAVE.gz" opened with 211 messages READONLY] - Some mails at the end are listed correctly, others are listed with empty sender/size/subject (just numbering). - All mails have no bodies. Full header command produces total blank screen. Even before any error message. Error messages appear during navigation: [{localhost/imap/user="nil"}SAVE.gz : Missing IMAP reply key: )] [MAIL FOLDER "SAVE.gz" CLOSED DUE TO ACCESS ERROR] Seamonkey works with both mbox-es and mbox.gz-s. Mbox-es are working with both SeaMonkey and pine. Technical environment description follows... Thanks, Nil. PS: Tried to gzip other folder, same results. -- 8< -- Dovecot version: 1.0.15 Linux version 2.6.26-1-amd64 (Debian 2.6.26-13) (waldi(a)debian.org) (gcc version 4.1.3 20080704 (prerelease) (Debian 4.1.2-24)) #1 SMP Sat Jan 10 17:57:00 UTC 2009 Debian GNU/Linux 5.0 (lenny) Filesystem: ext3 -- 8< -- ~/.pinerc (all other lines are comments or equal to nothing) smtp-server=localhost inbox-path={localhost}INBOX default-fcc={localhost}Sent feature-list=enable-full-header-and-text, enable-full-header-cmd, enable-8bit-esmtp-negotiation, enable-8bit-nntp-posting character-set=utf-8 folder-collections=IMAP {localhost}[] last-time-prune-questioned=109.2 last-version-used=5.10 ssh-path=/usr/local/bin/imapd.sh color-style=use-termdef current-indexline-style=flip-colors titlebar-color-style=default normal-foreground-color=255,255,255 normal-background-color=000,000,000 meta-message-foreground-color=255,255,255 meta-message-background-color=000,000,255 index-opening-foreground-color=000,000,000 index-opening-background-color=000,255,255 -- 8< -- /usr/local/bin/imapd.sh (just tried to redirect server stderr, did not helped): #!/bin/bash /usr/lib/dovecot/imap 2> /dev/null -- 8< -- # 1.0.15: /etc/dovecot/dovecot.conf Warning: mail_extra_groups setting was often used insecurely so it is now deprecated, use mail_access_groups or mail_privileged_group instead log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3s listen(default): localhost listen(imap): localhost listen(pop3): * ssl_listen: * login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_extra_groups: mail mail_access_groups: mail mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins: zlib mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: passdb: driver: pam userdb: driver: passwd -- 8< --

2 2

[Dovecot] expire plugin + dovecot 1.1.7
by Georg Käfer 18 May '09

18 May '09

Hi, testing expire plugin I get an error message "User lookup failed": /usr/sbin/dovecot --exec-mail ext /usr/libexec/dovecot/expire-tool -test Error: userdb(lukas(a)manual.at) didn't return uid Info: User lookup failed: lukas(a)manual.at Info: gkaefer2(a)manual.at/INBOX.Sent: stop, expire time in future: Wed Mar 31 14:38:33 2010 Reviewing the expires database I see simmilar entries like for gkaefer2(a)manual.at (which is working) lukas(a)manual.at/INBOX.Trash 1241181173 lukas(a)manual.at/INBOX 1270238935 lukas(a)manual.at/INBOX.Sent 1271417514 Dovecot -n # 1.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-gentoo-r3 i686 Gentoo Base System release 1.12.11.1 ext3 syslog_facility: local0 protocols: pop3 pop3s imap imaps ssl_cert_file: /etc/ssl/dovecot/xxx.pem ssl_key_file: /etc/ssl/dovecot/xxx.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_process_per_connection: no login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_process_size: 128 login_processes_count: 10 login_max_processes_count: 256 mail_max_userip_connections(default): 10 mail_max_userip_connections(imap): 10 mail_max_userip_connections(pop3): 30 first_valid_uid: 8 last_valid_uid: 8 first_valid_gid: 12 last_valid_gid: 12 mail_privileged_group: mail mail_uid: mail mail_gid: mail mail_location: maildir:/var/mail/%d/%n/Maildir/:INDEX=/var/mail/%d/%n/indexes mail_debug: yes mail_full_filesystem_access: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota trash expire mail_plugins(imap): quota imap_quota trash expire mail_plugins(pop3): quota expire mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: mail group: mail plugin: quota: maildir:User quota quota_rule: *:storage=500M quota_rule2: *:messages=5000 quota_rule3: Trash:storage=10%% quota_rule4: Spam:storage=20%% quota_warning: storage=90%% /usr/bin/quota-warning.sh 90 quota_warning2: storage=70%% /usr/bin/quota-warning.sh 70 quota_warning3: messages=70%% /usr/bin/quota-warning.sh 70 trash: /etc/dovecot/dovecot-trash.conf expire: Trash 30 Trash/* 30 INBOX.Trash 30 Spam 30 Junk-E-Mail 30 INBOX.Sent 365 Sent 365 INBOX 365 expire_dict: proxy::expire dict: expire: mysql:/etc/dovecot/dovecot-dict-expire.conf dovecot-dict-expire.conf: connect = host=localhost dbname=postfixadmin user=postfixadmin password=xxx # dovecot v1.1 only: table = expires select_field = expire_stamp where_field = mailbox username_field = not_used and users home (lukas@] ls -ltra shows: -rw------- 1 mail mail 0 Mar 31 10:25 dovecot-uidvalidity.49d1d387 drwx------ 4 mail mail 4096 Mar 31 10:25 .. -rw------- 1 mail mail 36 Mar 31 11:53 subscriptions -rw------- 1 mail mail 8 Mar 31 14:31 dovecot-uidvalidity drwx------ 5 mail mail 4096 Apr 1 14:33 .INBOX.Trash drwx------ 2 mail mail 4096 Apr 2 22:09 tmp -rw------- 1 mail mail 161 Apr 2 22:09 dovecot-uidlist drwx------ 2 mail mail 4096 Apr 3 13:42 new drwx------ 2 mail mail 4096 Apr 3 13:42 cur drwx------ 8 mail mail 4096 Apr 16 11:32 . drwx------ 5 mail mail 4096 Apr 16 11:35 .INBOX.Drafts -rw------- 1 mail mail 64 Apr 16 13:31 maildirsize drwx------ 5 mail mail 4096 Apr 22 12:44 .INBOX.Sent any idea what is causing the "didn't return uid" / "User lookup failed:" ? many thanks, Liebe Gruesse Georg Kaefer

2 1

[Dovecot] dovecot 1.2 plugin virtual and shared namespace with thunderbird
by Robert Schetterer 18 May '09

18 May '09

Hi Timo, using latest dovecot 1.2 and latest thunderbird i noticed if using virtual plugin like here with mysql http://wiki.dovecot.org/Plugins/Virtual everthing works like expected until i add a shared namespace Tb then looses its subscriptions under imap to the private namespace only the shared namespace gets shown up , any idea? I dont see something special in the logs why this happens -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 16

[Dovecot] latest update dovecot 1.2 breaks Error: imap dump-capability
by Robert Schetterer 18 May '09

18 May '09

Hi Timo, lates update 1.2 seems to break something it gives me Fio_loop_handle_add: epoll_ctl(1, 0): Operation not permitted Error: imap dump-capability: Couldn't read capability (got 0 bytes) Fatal: Invalid configuration in /etc/dovecot/dovecot.conf at restart, nothing in the conf changed Any Idea? Regards

2 4

[Dovecot] Problem with domain part in user_query in dovecot 1.1.14
by Konstantin 18 May '09

18 May '09

Hi. I'm using dovecot 1.1.14 with pgsql. I tried to configure dovecot to get the domain part in user_query by specifying different variants of auth_username_format variable such as %Lu, %Lu@%Ld, %Lu-at-%Ld and so on... So dovecot gets domain part in password_query, but not in user_query. I noticed the username is changed like this: kostas(a)mgupb.net->kostas in log. For some reason it happens before user_query so there is no domain part already. So one thing that had worked out for me was commenting the below code in src/auth/auth-request.c: if (strcmp(request->user, value) != 0) { /* remember the original username for cache */ if (request->original_username == NULL) { request->original_username = p_strdup(request->pool, request->user); } auth_request_log_debug(request, "auth", "username changed %s -> %s", request->user, value); request->user = p_strdup(request->pool, value); } I know that it is not so good, but it is working for me, now everything is fine, but I want it working without code deformations. What should I do? Thanks. P.S. Such things were in 1.1.11 from which I upgraded to 1.1.14 last night. Dovecot config: # 1.1.14: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.0-RELEASE amd64 protocols: imap imaps pop3 pop3s ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 0 mail_privileged_group: mail maildir_copy_preserve_filename: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_enable_last(default): no pop3_enable_last(imap): no pop3_enable_last(pop3): yes pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login digest-md5 user: vmail username_format: %Lu verbose: yes debug: yes passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix dovecot-sql.conf: driver = pgsql connect = host=localhost dbname=hosting_db user=hosting_db password=adsfweae password_query = SELECT NULL AS password, 'Y' as nopassword, userid AS user FROM main.mail_base WHERE userid = '%n' AND password = '%w' and domain='%d' #password_query = SELECT password, userid AS user FROM main.mail_base WHERE user id = '%n' and domain='%d' #user_query = SELECT '/var/mail/vhosts/' || domain || '/' || userid as mail, '/v ar/mail/vhosts/' || domain || '/' || userid as home, uid, gid FROM main.mail_bas e WHERE userid = '%n' and domain='%d' user_query = SELECT '/var/mail/vhosts/' || domain || '/' || userid as mail, '/va r/mail/vhosts/' || domain || '/' || userid as home, uid, gid FROM main.mail_base WHERE userid = '%n' and domain='%d' default_pass_scheme = PLAIN -- Konstantin <kostas(a)mgupb.net>

2 2

[Dovecot] "Broken mailbox list" with virtual plugin
by Matthijs Kooijman 18 May '09

18 May '09

Hi, I'm using the virtual plugin for a virtual inbox (with dovecot 1.2, r8980), whose dovecot-virtual file looks as follows: INBOX INBOX/Lists INBOX/Bulk INBOX/MaybeSpam Folders/TODO all Everything seems to work fine, but I get the following error in my logfiles: IMAP(matthijs): virtual /home/matthijs/Mail/virtual/INBOX: Broken mailbox list Some investigation of the source code tells me that this error means that there was corrupt data in the index. In particular, the ext_data read from the index was not long enough to contain all mailbox names. Adding some debug code confirms this: ext_size: 187 ext_data: \b0\5\0\0\5\0\0\0E\0\0\0\17\20w\9c\1\0\0\0\5\0\0\0\e9\af\e4I\92\1\0 \0\e7\2\0\0\0\0\0\0\7\0\0\0\b\0\0\0\e8\af\e4IO\3\0\0\5c\5\0\0\0\0\0 \0\8\0\0\0\a\0\0\0\ed\af\e4I\e6\0\0\0j\1\0\0\0\0\0\0\9\0\0\0\f\0\0 \0\3a\b0\e4I1\0\0\0e\0\0\0\0\0\0\0E\0\0\0\c\0\0\0\eb\af\e4I\c8\0\0 \0e\0\0\0\0\0\0\0INBOXINBOX/ListsINBOX/BulkINBOX/MaybeSpamFolders/TO ext_hdr: change_counter=1456 mailbox_count=5 highest_mailbox_id=69 search_args_crc32=2625052695 mailbox: id=1 name_len=5 uid_validity=1239724009 next_uid=402 higest_modseq=743 mailbox name: INBOX mailbox: id=7 name_len=11 uid_validity=1239724008 next_uid=847 higest_modseq=1372 mailbox name: INBOX/Lists mailbox: id=8 name_len=10 uid_validity=1239724013 next_uid=230 higest_modseq=362 mailbox name: INBOX/Bulk mailbox: id=9 name_len=15 uid_validity=1239724090 next_uid=49 higest_modseq=101 mailbox name: INBOX/MaybeSpam mailbox: id=69 name_len=12 uid_validity=1239724011 next_uid=200 higest_modseq=101 virtual /home/matthijs/Mail/virtual/INBOX: Broken mailbox list As you can see in the ext_data dump, the last mailbox name (Folders/TODO) is cut short. I'm not so sure what caused this error. I've just tried removing the index files, which seems to fix the error message. The index file gets recreated and my debug statements show proper output. Another solution is adding an extra file to the folder list, in which case the index will get fixed as well. Perhaps it would be good to recreate the index file when this error is found, instead of complaining? Also, from the code (virtual_sync_ext_header_read in src/virtual/virtual-sync.c) it seems that the last mailbox should be skipped because of this error, but the mailbox works fine. I'm probably not looking closely enough :-) I haven't been able to reliably break the index file with some quick testing (reconnecting, restarting and modifying the mailbox list), but I did manage to break it once (by removing a mailbox from halfway the list, and then adding it again). I couldn't reproduce that, though, since removing a mailbox doesn't always seem to recreate the index for some reason... I've also just upgraded to the latest version, so if this is a bug fixed between r8980 and r9018, then you'll probably not hear from me again :-) I hope all this info helps a bit, I'm available for further debugging and testing (also on IRC, nick is blathijs). Gr. Matthijs

2 2

Re: [Dovecot] Fail2Ban and the Dovecot log
by Lou Duchez 18 May '09

18 May '09

Re: the "dovecot: " at the beginning of the line in the log. I should mention that other applications encounter a similar issue with Fail2Ban -- for example, if you're running Asterisk, you have to alter the log format such that the timestamp is at the beginning of the line: http://www.voip-info.org/wiki/view/Fail2Ban+(with+iptables)+And+Asterisk

5 16

[Dovecot] Virtual mailbox plugin, crashing?
by Brandon Lamb 18 May '09

18 May '09

Hello, Using virtual mailbox plugin and all of a sudden started getting these. Deleted the indexes from ~/Maildir/virtual/Inboxmail and all was good again. dovecot: 2009-05-10 10:05:44 Error: child 26607 (imap) killed with signal 11 (core dumps disabled) Inboxmail/dovecot-virtual: virtual/All inthread refs x-mailbox INBOX All/dovecot-virtual: * -Archive/ -Drafts/ -Trash/ -Trash/* -Deleted* -Junk* -Spam/ -Sent* all I have had this happen 2 or 3 times now, I thought maybe the first couple were flukes from messing with the dovecot-virtual files, then sometime between last night and now this started to give those errors. I am taking a guess that is it is some kind of indexing issue since just deleting those seems to fix it. Not sure what other info I could send, turning mail_debug = yes didnt give any useful info in dovecot.log

2 2

[Dovecot] Backtrace error
by Brandon Lamb 18 May '09

18 May '09

I noticed i had mail_location wrong, i was specifying INDEX=/dovecot-index instead of INDEX=~/dovecot-index so i modifed and restarted dovecot, one of my techs that happens to have thousands of emails reopened her mail and this showed up in the log. Not sure if this is critical or if more info/dovecot -n is needed dovecot: 2009-05-05 14:06:38 Panic: imap <REMOVED>: file mail-search.c: line 712 (mail_search_args_equal): assertion failed: (args1->simplified == args2->simplified) dovecot: 2009-05-05 14:06:38 Error: imap <REMOVED>: Raw backtrace: imap [0x4a3042] -> imap [0x4a30c3] -> imap [0x4a2796] -> imap [0x467ffa] -> imap(mail_thread_init+0xaa) [0x463a5a] -> imap(index_storage_search_init+0x132) [0x45e222] -> /usr/local/lib/dovecot/imap/lib20_virtual_plugin.so(virtual_search_init+0x13) [0x7fedbd5d1d73] -> imap(index_search_result_update_appends+0xac) [0x4660ec] -> /usr/local/lib/dovecot/imap/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1383) [0x7fedbd5d5123] -> imap(mailbox_sync+0x30) [0x46a7c0] -> imap(cmd_select_full+0x383) [0x420613] -> imap [0x422d8c] -> imap [0x422e4a] -> imap(client_handle_input+0x35) [0x4234b5] -> imap(client_input+0x63) [0x423963] -> imap(io_loop_handler_run+0xcb) [0x4aae9b] -> imap(io_loop_run+0x18) [0x4aa328] -> imap(main+0x52b) [0x42b7fb] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x7fedbde095a6] -> imap [0x41bcf9] dovecot: 2009-05-05 14:06:38 Error: child 18843 (imap) killed with signal 6 (core dumps disabled)

2 1

[Dovecot] Deliver hangs after reloading the Dovecot configuration
by Pascal Volk 17 May '09

17 May '09

Hello Timo, deliver hangs after reloading the Dovecot configuration. How to reproduce: 1. start dovecot 2. deliver a message via deliver 3. modify dovecot.conf:plugin {quota_rule} 4. kill -HUP $PID_of_dovecot 5. deliver the next message via deliver Dovecot v1.2.beta2 died in this case with a panic: file dict-process.c: line 152 (dict_listener_input): assertion failed: (listener->processes == NULL) Raw backtrace: /usr/local/dovecot12/sbin/dovecot [0x411832] -> /usr/local/dovecot12/sbin/dovecot [0x411944] -> /usr/local/dovecot12/sbin/dovecot [0x40acce] -> /usr/local/dovecot12/sbin/dovecot [0x410fc6] -> /usr/local/dovecot12/sbin/dovecot [0x40576a] -> /usr/local/dovecot12/sbin/dovecot [0x414e6b] -> /usr/local/dovecot12/sbin/dovecot [0x414308] -> /usr/local/dovecot12/sbin/dovecot [0x40b29d] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x7f5e508cd5a6] -> /usr/local/dovecot12/sbin/dovecot [0x4032f9] deliver(j.doe(a)example.com): May 11 23:30:45 Error: Internal quota calculation error deliver(j.doe(a)example.com): May 11 23:30:45 Error: sieve: msgid=<000@nobody>: failed to store into mailbox 'INBOX': Internal error occurred. Refer to server log for more information. [2009-05-11 23:30:45] After the panic I have compiled the latest sources from the Mercurial repository (changeset: 9021:e36a9edb5fb0). A full backtrace is attached to this message. # 1.2.rc3: /usr/local/dovecot12/etc/dovecot.conf # OS: Linux 2.6.29.2-1 x86_64 Debian squeeze/sid log_path: /usr/local/dovecot12/var/log/dovecot.log protocols: imap listen: 192.168.111.222:10143 ssl: no disable_plaintext_auth: no login_dir: /usr/local/dovecot12/var/run/dovecot/login login_executable: /usr/local/dovecot12/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 70000 first_valid_gid: 70000 mail_privileged_group: mail mail_location: maildir:~/Maildir mail_debug: yes mail_plugins: quota imap_quota auth default: mechanisms: digest-md5 cram-md5 login plain user: nobody verbose: yes debug: yes passdb: driver: sql args: /usr/local/dovecot12/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/dovecot12/etc/dovecot-sql.conf socket: type: listen master: path: /usr/local/dovecot12/var/run/dovecot/auth-master mode: 384 plugin: quota: dict:user::proxy::quotadict quota_rule: *:storage=10M:messages=111 quota_rule2: Trash:storage=50%% dict: quotadict: pgsql:/usr/local/dovecot12/etc/dovecot-dict-quota.conf /usr/local/dovecot12/etc/dovecot-dict-quota.conf: connect = host=/var/run/postgresql dbname=db user=user password=password map { pattern = priv/quota/storage table = quota12 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota12 username_field = username value_field = messages } Regards, Pascal -- The trapper recommends today: beeffeed.0913222(a)localdomain.org .

2 2

[Dovecot] procmail & formail
by Mohsen Pahlevanzadeh 17 May '09

17 May '09

Dear all, i have a mail server & vpopmail. Now, i want to copy from each message to a directory.i find a way to do it. i put following line in .qmail-default : |formail -X "" > ~/text.txt Of course above line is test.Given line doesn't retrieves Return* header field. My question: How i retrieve entire email same itslef? Yours, Mohsen

1 0

[Dovecot] Unable to subscribe to newly created subfolders under public mailboxes with acl plugin enabled
by Max Ivanov 17 May '09

17 May '09

I've "group" namespace and b2b mailbox under it. I'm unable to subscribe to it and deliver emails there. Here is my problem: if I create subfolder (lets name it "subf") under b2b mailbox I'm unable to subscribe to it until acl plugin is enabled. Even if I put dovecot-acl file in .b2b.subf folder with anyone full rights dovecot-acl-list doesn't get populated with new subfoler. If I put it there manually I'm able to see subf folder in subscribe dialog in TB, but dovecot-acl-list is regulary updated, isn't it? Updated file is missing subf entry again. If I disable acl plugin everything works fine, but I'd like to keep it enabled. Is it a bug or misconfiguration? My dovecot version is 1.2 rc3 here is dovecot -n authput protocols: imap managesieve ssl: yes ssl_ca_file: /usr/share/ca-certificates/floristCA-cacert.pem ssl_cert_file: /var/lib/ssl/certs/imap.florist.my-cert.pem ssl_key_file: /var/lib/ssl/private/imap.florist.my-key.pem ssl_cipher_list: ALL:!LOW:!SSLv2 disable_plaintext_auth: yes verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login login_processes_count: 5 verbose_proctitle: yes first_valid_uid: 1000 mail_privileged_group: mail mail_location: maildir:/var/spool/mail/dovecot/%n:INBOX=/var/spool/mail/dovecot/%n/INBOX mail_debug: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_plugins(default): acl fts fts_squat mail_plugins(imap): acl fts fts_squat mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: group/ location: maildir:/var/spool/mail/groupmail list: yes subscriptions: yes auth default: verbose: yes passdb: driver: pam args: session=yes userdb: driver: passwd args: blocking=yes socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 438 plugin: acl: vfile lazy_expunge: .EXPUNGED/ .DELETED/ .DELETED/.EXPUNGED/ sieve: ~/.dovecot.sieve sieve_storage: ~/sieve fts: squat fts_squat: partial=4 full=4

3 2

[Dovecot] Unable to delete folder in public namespace
by Max Ivanov 17 May '09

17 May '09

I use public namespace for group mailboxes. Users are able to create subfolders , but its impossible to delete them. thunderbird 2.0.0.21 complains: "Cant' rename mailbox to another storage type", both namespaces (private and public) use same storage type, so I believe that it's a namespace problem. Is there any way to move folders between namespaces? Or maybe sieve script or plugin which intercept move command and do the move to some unsibscribible folder in public namespace.

2 1

[Dovecot] namespace list not working in dovecot 1.2 revision 9027:421393827a81
by Jonathan Siegle 17 May '09

17 May '09

In my config that has worked for some time I have: namespace private { separator = / prefix = ~/ hidden = yes list = no # for v1.1+ } 1 list "~/" * 1 OK List completed. 2 list "~/" % 2 OK List completed. I _think_ that the last time I tested this was 2 weeks ago but it might have been 1 week ago. Thanks, Jonathan

2 1

[Dovecot] Question about IMAP
by Charles Marcus 17 May '09

17 May '09

Hi Timo, I have a question that you can maybe answer off the top of your head, considering your vast knowledge of the IMAP protocol... There is a Thunderbird bug that is near and dear to my heart, that is trying to address how Thunderbird deals with large messages (ie, messages with large attachments). Current behavior sucks... it downloads the entire message every time the message is clicked on. My question is: Using the IMAP protocol, is there a way, *without* downloading the entire message (specifically, binary attachments), that an IMAP client can do the following: 1. Download *only* the message headers and the text/html/body contents of the body of the message but *not* any binary attachments, 2. Detect that a message *has* one or more binary attachments, *without* downloading them, 3. Grab the names of all of the attachments, 4. Display for the user the email/email headers and text/html body parts, 5. Display the existence of the attachments in whatever manner the client normally shows them (in TBird, they show at the bottom of the message just above the status bar), 6. Download the actual attachment on demand - ie, if/when it is dbl-click > opened, right-click > saved, or the message is forwarded? Pointers to appropriate IMAP protocol docs would be happily passed on to them the Mozilla dev guys. Thanks! -- Best regards, Charles

2 5

[Dovecot] LDAP auth_bind fails to process certain LDAP server responses (Windows AD)
by Konstantin Khomoutov 15 May '09

15 May '09

LDAP auth backend in Dovecot 1.1.5 seemingly fails to handle certain paths of interaction with LDAP server, which is Windows AD running Windows 2003 server machine in my case. The symptoms I observe look exactly as were already reported in [1]: authentication backend "hangs" after logging the fact it has sent the search request, then after a while the IMAP/POP3 connection is teared down by the server due to idle condition. In the mentioned mail thread, it was proposed that if Dovecot doesn't log any LDAP server response, there is no such response, so I dumped the TCP traffic going between the backend and the server, and studied what happens with different settings. The result is that it seems LDAP auth backend doesn't understand the case when the server offerrs one or more "referrals" which the client might want to check. It seems that the backend tries to do something else after it gets such a result from the LDAP server even if the server returned an entry matching the search request. The described behaviour manifests itself with Windows AD only if I specify the domain name alone as the search base, e.g. "dc=mydomain,dc=com". If I also include at least one OU, the server doesn't return its list of referrals and Dovecot LDAP auth backend works OK. I attached two files produced by tcpdump -- one with "hung" search request, and another with successful one. They are: 1) ldap-hung.pcap.gz Captured with /etc/dovecot/dovecot-ldap.conf settings: hosts = domain007.com dn = saslauthd(a)domain007.com dnpass = "secret" auth_bind = yes base = dc=domain007, dc=com pass_filter = (&(objectClass=person)(sAMAccountName=%u)) Packet #8 is of interest in this dump. 2) ldap-ok.pcap.gz Captured with /etc/dovecot/dovecot-ldap.conf settings: hosts = domain007.com dn = saslauthd(a)domain007.com dnpass = "secret" auth_bind = yes base = cn=Users, dc=domain007, dc=com pass_filter = (&(objectClass=person)(sAMAccountName=%u)) The only difference compared to the first case is the "cn=Users" prepended to the base DN, which prevents the server from attaching a list of referrals. In both cases "search result done" is present in the server response. 3) ldap-ldapsearch.pcap.gz This dump captures the conversation of the ldapsearch utility with the same server using the same parameters Dovecot LDAP auth backend uses in the first case. ldapsearch invocation was like this: $ ldapsearch -h domain007.com -x -D saslauthd(a)domain007.com -w secret -a always -b dc=domain007,dc=com '(&(objectClass=person)(sAMAccountName=kostix))' General configuration info (package from Debian stable): # dovecot --version 1.0.15 # dovecot -n # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: verbose: yes debug: yes passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: passwd 1. http://www.mail-archive.com/dovecot@dovecot.org/msg09174.html

1 0

[Dovecot] Possibly dumb questions about DC and user/system limits
by Stewart Dean 15 May '09

15 May '09

Because of user access growth, the number of processes associated with IMAP has increased and I thought to change some of the configured parms. dovecot -n yields: # 1.1.14: /usr/local/etc/dovecot.conf # OS: AIX 1 005A928C4C00 listen: *:143 ssl_listen: *:993 disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_processes_count: 12 login_max_processes_count: 774 max_mail_processes: 1280 mail_max_userip_connections: 12 verbose_proctitle: yes first_valid_uid: 200 mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=/var/dcindx/%u mbox_write_locks: fcntl mbox_dirty_syncs: no auth default: passdb: driver: pam userdb: driver: passwd The only changes was that max_mail_processes went from 1024 to 1280. Now I get a error message when I start DC: Warning: fd limit 2000 is lower than what Dovecot can use under full load (more than 2054). Either grow the limit or change login_max_processes_count and max_mail_processes settings So I changed the no_size and no_size_hard to 3500 and 4000 respectively in both dovecot and root AIX defines nosize:* *Sets the soft limit for the number of file descriptors a user process may have open at one time. an lsuser dovecot returns: dovecot id=417 pgrp=dovecot groups=dovecot shell=/bin/false daemon=true admin=false ... fsize=2097151 cpu=-1 data=262144 stack=65536 core=2097151 rss=65536 nofiles=3500 nofiles_hard=4000 I kill dovecot and all children and restart it....same error message What am I missing? Does the machine have to be rebooted for the no_size to be updated? -- ==== Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows.... ==== Stewart Dean, Unix System Admin, Bard College, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

3 4

[Dovecot] cmd_append_continue_parsing assertion failure
by Mike Abbott 15 May '09

15 May '09

Dovecot-1.1.14 on Mac OS X. Panic: IMAP(user): file cmd-append.c: line 266 (cmd_append_continue_parsing): assertion failed: (ctx->count == uid2 - uid1 + 1) Trivially reproducible: $ telnet mailserver 143 a login user password b append inbox Backtrace: 0 libSystem.B.dylib 0x00007fff8458aa92 __kill + 10 1 libSystem.B.dylib 0x00007fff84606a1c abort + 83 2 imap 0x0000000100069f3e default_fatal_finish + 70 3 imap 0x0000000100069f8c i_syslog_fatal_handler + 0 4 imap 0x00000001000696eb i_info + 0 5 imap 0x0000000100001406 cmd_append_continue_parsing + 434 6 imap 0x00000001000017a3 cmd_append + 407 7 imap 0x000000010000677e client_command_input + 33 8 imap 0x000000010000693f client_command_input + 482 9 imap 0x0000000100006a3e client_handle_input + 239 10 imap 0x0000000100006bc2 client_input + 148 11 imap 0x0000000100070f83 io_loop_handler_run + 272 12 imap 0x0000000100070348 io_loop_run + 55 13 imap 0x000000010000db95 main + 1635 14 imap 0x0000000100001010 start + 52

2 1

[Dovecot] Filesystems (was Re: Migration questions...)
by Seth Mattinen 15 May '09

15 May '09

Richard Hobbs wrote: > > Trouble is... i've been googling this as well, just now, and loads of > people say XFS has the better performance, but loads of other people say > ReiserFS has the better performance. It starts to become a religious argument at some point. > We have battery backed up RAID controllers too, in this new system, and > the systems are UPSd, so on that basis i'm still none the wiser! lol > > I appreciate your experience with XFS is a positive one, but even the > dovecot web site says XFS might now be a good choice... > > http://wiki.dovecot.org/MailboxFormat/Maildir > > What a tough decision! I know it probably won't make too much difference > in my situation, but i want this to be a very long-term solution, so > want to do it right first time! > > Any other opinions on XFS vs Reiserfs with Dovecot maildir? > > Thanks again! > > Richard. > If you have time to play "tweak the filesystem": http://everything2.com/index.pl?node_id=1479435 It's a good comparison of etx3, xfs, and reiser from a performance standpoint. Also try this if you want to pull the plug or randomly reboot and see what happens: http://brad.livejournal.com/2116715.html ~Seth

1 0

[Dovecot] Filesystem experience question was Migration questions
by Stewart Dean 15 May '09

15 May '09

Doing a cursory Google scan on journaled Linux filesystems, it seems that the three ground-up journaled FSes: XFS, reiser and JFS all have their separate strong points but all compare favorably. Reiser does a better job with many small files...which would seem to be the reality of maildir formatted inboxes. Any comments on that? Any war stories, that is, any comments on reliability, availability and recoverability of them. Support issues? Possible down the road orphaning? Is FS quotaing support and does it work well with a lot (for me that means 4000) users? Anybody using IBM's open source JFS? I currently use AIX and it's been as dependable as a hammer there. In some 20 years with AIX, I can count on the fingers of one hand the number of times that I've had to use fsck. We had one set of machines that would drop hard 2-3x a week due to a bad main electrical trunk splice....2 or 3 years of that and the worst I ever saw was having to BRS once every two months or so. OTOH, I distrust IBM's commitment to the little shop and affordable entry machines: this is fast vanishing in the pSeries/AIX world...or else we wouldn't be moving towards Linux. Thanks! Feel free to contact me offline if you deem this marginally related to DC. -- ==== Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows.... ==== Stewart Dean, Unix System Admin, Bard College, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

2 1

[Dovecot] Migration questions...
by Richard Hobbs 15 May '09

15 May '09

Hi All, We are soon to migrate our mail server from one piece of hardware to another and we would like to take this opportunity to optimize things. As a result, we would like to replace "uw-imapd" and "qpopper" with "dovecot". The version we will be installing is 1.1.13-2, as this is what is available through the latest Debian stable backports. We will also be using exim to deliver mail (through dovecot's deliver mechanism, of course). So... We are currently using the mbox format with uw-imapd, and would like to migrate to the fastest solution possible with dovecot on the new hardware. My understanding is that "multi-dbox" is not an option in this version anyway, maildir is OK, but not great, and "single-dbox" is therefore going to be the highest performing solution. Is single-dbox the fastest way to go, considering we're going to be using email in the following ways: - IMAP connections with all email in the Inbox (Gmail-style). - IMAP connections with email split into many IMAP folders. - POP3 connections with no email left on the server. - POP3 connections with *all* email left on the server. All connections check for new mail every 5 minutes (on average) and there are 50-60 users). Also, we are not able to change user behaviour in this instance, unfortunately. Can anyone see any problems with the above proposal? Hopefully not... One problem that may arise is the fact that when we migrate, all msg UIDs will be lost. If i'm not mistaken, this means that all emails will be treated by the mail client as brand new, and if through IMAP, will all go bold, and if through POP3, will all be downloaded again (if still on the server) and therefore duplicated in the mail client. If this is the case, is there anything we can do to stop this happening? Does the "Convert" plugin does this job well? Finally, I have a rough draft of our migration plan - is there anything horribly wrong in it that's going to cause lots of problems, that anyone can spot by any chance? 1. Install Debian with exim, mysqld (for Horde/IMP) and mailman. 2. Run an online update. 3. Rsync homedirs and inboxes onto new server, ready for initial exim configuration. 4. Configure exim as per existing mail server and test that mailing lists and normal email works. You should now have the existing mail delivery solution on the brand new hardware. 5. Once mail delivery is sorted, add "deb http://www.backports.org/debian lenny-backports main contrib non-free" into "/etc/apt/sources.list" and run "aptitude update && aptitude install debian-backports-keyring && aptitude update". 6. Install dovecot (at the time of writing, this was version 1.1.13-2) and configure to use existing mbox files (inboxes in /var/spool/mail/ and IMAP folders in /home/user/mail/) 7. Setup exim to use dovecot's "deliver" mechanism for interacting with the inboxes (which are still in mbox format). 8. Configure the "convert" plugin to begin converting the mail to dbox format. 9. Run something manually (if possible) to convert mailboxes before people connect, so the task is already done by the time the outage is over. 10. Give staff access to new speedy mail server! Thanks in advance, people - any help is greatly appreciated! :-) Richard. -- Richard Hobbs (IT Specialist) Toshiba Research Europe Ltd. - Cambridge Research Laboratory Email: richard.hobbs(a)crl.toshiba.co.uk Web: http://www.toshiba-europe.com/research/ Tel: +44 1223 436999 Mobile: +44 7811 803377

14 37

[Dovecot] IMAP subfolders and MBOX format
by Frank Bonnet 14 May '09

14 May '09

Hello folks I have a problem related to the mbox format I think First we use MBOX format with Dovecot 1.14 A user's here need to create some subfolders in his Imap space. Due to the use of MBOX format this is impossible from thunderbird as you cannot creat a directory in a file :-) So to help him I created manually on the mail server some directories into his imap space, Doing so we are able to see the folder and subfolders but it is not possible to move some other folders into the subfolder via the thunderdird client. Anyone to help me a bit ? Note : on another machine which use the Maildir format I can do whatever I want without problem. Thanks a lot.

2 1

[Dovecot] id:N13388 Disable storage of messages on server when read (pop3)
by Dimitrios Karapiperis 14 May '09

14 May '09

Hi there Is there any way in dovecot to disable the storage of messages on server when they are read/downloaded by the users (POP3). The server keeps the e-mail when users tick the option on their MUA to keep (leave) messages on server. dovecot 1.0.7 POP3 / maildir Thanks in advance Dimitrios Karapiperis postmaster [at] thessaloniki [dot] gr

3 3

[Dovecot] What's faster for getting mails into Rails: Dbmail & direct MySQL or net/pop with maildir
by Olaf Spaarmann 14 May '09

14 May '09

Hi, it's my first message in this list, so please excuse any mistakes! I have a quite specific problem and nobody in the Ruby on Rails lists could help me, because it is actually more a question for mail- experts. So I hope you can help me. I'm planning to set up a mailserver using dovecot. Users of my Rails App can forward their emails (john(a)doe.com) to an personal address (john.doe(a)myapp.com ). These emails will be received by my mailserver. So far so good, the tricky part is to get the mails into my Rails App for processing them. After that they will be deleted (so I'll never accumulate a big ammount of mails on the mailserver). I thought of 2 different approaches. 1) Just use a normal Dovecot setup, using maildir and get the mails with a mailpoller script, connecting to the server via Pop3 2) Use Dbmail for storing the emails, don't use Pop3 but let the mailpoller script connect to the database directly I understand that Dbmail seems to be slower than maildir (in terms of processing many incoming mails) but I'm not sure if a connection via net/pop (of the mailpoller script) is maybe that much slower than mysql that it wouldn't matter at all. What's your opinion? I'm gratefull for every hint. Thanks

2 1

[Dovecot] X-UIDL Ignored?
by Benjamin Wakefield 14 May '09

14 May '09

Hello! I am trying to migrate from Teapop to Dovecot. I'm using Dovecot 1.1.14. I need to make use of the X-UIDL header so clients don't download messages they've already received. I have the X-UIDL head in the message. I have pop3_reuse_xuidl(pop3): yes My problem is the X-UIDL in the message is being ignored and Dovecot is still generating it's own. The INBOX is an mbx file not Maildir. Should this work? Have I missed something? Thanks! Ben ==== BEGIN dovecot -n ==== # 1.1.14: /usr/local/dovecot-1.1.14/etc/dovecot.conf # OS: Linux 2.6.24.3-smp i686 Slackware 12.0.0 log_path: /usr/local/dovecot-1.1.13/var/log/dovecot.log protocols: imap imaps pop3 listen(default): * listen(imap): * listen(pop3): *:10100 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/dovecot-1.1.14/var/run/dovecot/login login_executable(default): /usr/local/dovecot-1.1.14/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot-1.1.14/libexec/dovecot/imap-login login_executable(pop3): /usr/local/dovecot-1.1.14/libexec/dovecot/pop3-login login_greeting: grape.dcsi.net.au dovecot pop3/imap server, go ahead. mail_location: mbox:~/mail:INBOX=/var/mail/%1u/%u mail_executable(default): /usr/local/dovecot-1.1.14/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot-1.1.14/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot-1.1.14/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/dovecot-1.1.14/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot-1.1.14/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot-1.1.14/lib/dovecot/pop3 pop3_reuse_xuidl(default): no pop3_reuse_xuidl(imap): no pop3_reuse_xuidl(pop3): yes pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %v.%u auth default: passdb: driver: shadow args: /etc/shadow passdb: driver: passwd-file args: /etc/passwd userdb: driver: passwd ==== END ====

2 2

[Dovecot] virtual mailbox users users can send, but can't read e-mail
by Ioan Nemes 13 May '09

13 May '09

Greetings, I am trying to add the second virtual mailbox domain (transco.org.au) to an existing Postfix/Dovecot/MySQL mail server. Users of the first virtual mailbox domain (transylvania.org.au) have no problems sending and receiving mail. Users belonging to the second virtual mailbox domain can successfully send mail to outside, however they won't receive the mail, though Postfix delivers the mail to the mail directories. The configuration: --------------------------------------------------------------------------------------- # dovecot --version 1.0.2 --------------------------------------------------------------------------------------- # dovecot -n # 1.0.2: /etc/dovecot.conf base_dir: /var/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/dovecotcert.pem disable_plaintext_auth: no login_dir: /var/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_user: _dovecot first_valid_uid: 5000 last_valid_uid: 5000 mail_location: maildir:/var/spool/vmboxbase/%d/%u mbox_write_locks: fcntl mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: bsdauth passdb: driver: sql args: /etc/dovecot-mysql.conf userdb: driver: passwd userdb: driver: sql args: /etc/dovecot-mysql.conf ---------------------------------------------------------------------------------------------------- password_query = SELECT password FROM users WHERE login = '%u' and active = 'Y' ----------------------------------------------------------------------------------------------------- SELECT password FROM users WHERE login = 'dummy(a)transco.org.au' and active = 'Y'; mysql> SELECT password FROM users WHERE login = 'dummy(a)transco.org.au' and active = 'Y'; +---------------+ | password | +---------------+ | Wdrbd5SLusraw | +---------------+ 1 row in set (0.00 sec) ------------------------------------------------------------------------------------------------------ user_query = SELECT home, maildir, uid, gid FROM users WHERE login = 'dummy' AND active = 'Y' ------------------------------------------------------------------------------------------------------ mysql> SELECT home, maildir, uid, gid FROM users WHERE login = 'dummy(a)transco.org.au'; +----------------------+-----------------------+------+------+ | home | maildir | uid | gid | +----------------------+-----------------------+------+------+ | /var/spool/vmboxbase | transco.org.au/dummy/ | 5000 | 5000 | +----------------------+-----------------------+------+------+ 1 row in set (0.00 sec) # more /etc/dovecot-mysql.conf # This file is opened as root, so it should be owned by root and mode 0600. # # http://wiki.dovecot.org/AuthDatabase/SQL # # For the sql passdb module, you'll need a database with a table that # contains fields for at least the userid and password. If you want to # use the user@domain syntax, you might want to have a separate domain # field as well. # # If your users all have the same uig/gid, and have predictable home # directories, you can use the static userdb module to generate the home # dir based on the userid and domain. In this case, you won't need fields # for home, uid, or gid in the database. # # If you prefer to use the sql userdb module, you'll want to add fields # for home, uid, and gid. Here is an example table: # # CREATE TABLE users ( # userid VARCHAR(128) NOT NULL, # password VARCHAR(64) NOT NULL, # home VARCHAR(255) NOT NULL, # uid INTEGER NOT NULL, # gid INTEGER NOT NULL, # active CHAR(1) DEFAULT 'Y' NOT NULL # ); # Database driver: mysql, pgsql, sqlite #driver = driver = mysql # Database connection string. This is driver-specific setting. # # pgsql: # For available options, see the PostgreSQL documention for the # PQconnectdb function of libpq. # # mysql: # Basic options emulate PostgreSQL option names: # host, port, user, password, dbname # # But also adds some new settings: # client_flags - See MySQL manual # ssl_ca, ssl_ca_path - Set either one or both to enable SSL # ssl_cert, ssl_key - For sending client-side certificates to server # ssl_cipher - Set minimum allowed cipher security (default: HIGH) # # You can connect to UNIX sockets by using host: host=/var/run/mysql.sock # Note that currently you can't use spaces in parameters. # # sqlite: # The path to the database file. # # Examples: # connect = host=192.168.1.1 dbname=users # connect = host=sql.example.com dbname=virtual user=virtual password=blarg # connect = /etc/dovecot/authdb.sqlite # #connect = dbname=virtual user=virtual connect = host=localhost dbname=mail user=dovecot password=dovecot # Default password scheme. # # List of supported schemes is in # http://wiki.dovecot.org/Authentication/PasswordSchemes # #default_pass_scheme = PLAIN-MD5 default_pass_scheme = CRYPT # Query to retrieve the password. # # This query must return only one row with "user" and "password" columns. # The query can also return other fields which have a special meaning, see # http://wiki.dovecot.org/PasswordDatabase/ExtraFields # # The "user" column is needed to make sure the username gets used with exactly # the same casing as it's in the database. Note that if you store username and # domain in separate fields, you most likely want to return a combination of # them as the "user" column, otherwise the domain gets stripped. # # Commonly used available substitutions (see # http://wiki.dovecot.org/Variables for full list): # %u = entire userid # %n = user part of user@domain # %d = domain part of user@domain # # Note that these can be used only as input to SQL query. If the query outputs # any of these substitutions, they're not touched. Otherwise it would be # difficult to have eg. usernames containing '%' characters. # # Example: # password_query = SELECT concat(userid, '@', domain) AS user, password FROM users WHERE userid = '%n' AND domain = '% d' # password_query = SELECT pw AS password FROM users WHERE userid = '%u' AND active = 'Y' # password_query = SELECT password FROM users WHERE login = '%u' and active = 'Y' # Query to retrieve the user information. # # The query must return only one row. Commonly returned columns are: # uid - System UID # gid - System GID # home - Home directory # mail - Mail location # # Either home or mail is required. uid and gid are required. If more than one # row is returned or there are missing fields, the login will fail. For a list # of all fields that can be returned, see # http://wiki.dovecot.org/UserDatabase/ExtraFields # # Examples # user_query = SELECT home, uid, gid FROM users WHERE userid = '%n' AND domain = '%d' # user_query = SELECT dir AS home, user AS uid, group AS gid FROM users where userid = '%u' # user_query = SELECT home, 501 AS uid, 501 AS gid FROM users WHERE userid = '%u' # #user_query = SELECT home, uid, gid FROM users WHERE userid = '%u' user_query = SELECT home, maildir, uid, gid FROM users WHERE login = '%u' AND active = 'Y' # If you wish to avoid two SQL lookups (passdb + userdb), you can use # userdb prefetch instead of userdb sql in dovecot.conf. In that case you'll # also have to return userdb fields in password_query prefixed with "userdb_" # string. For example: #password_query = SELECT userid as user, password, home as userdb_home, uid as userdb_uid, gid as userdb_gid FROM users WHERE userid = '%u' --------------------------------------------------------------------------------------- # ps -aux | grep dovecot root 13442 0.0 0.2 676 952 ?? Ss 4:27AM 0:00.04 /usr/local/sbin/dovecot root 10354 0.0 0.4 816 1920 ?? S 4:27AM 0:00.03 dovecot-auth root 8330 0.0 0.4 708 2080 ?? S 4:27AM 0:00.03 dovecot-auth -w _dovecot 29456 0.0 0.4 664 1876 ?? S 4:27AM 0:00.04 pop3-login _dovecot 12636 0.0 0.4 716 1868 ?? S 4:27AM 0:00.04 pop3-login _dovecot 26625 0.0 0.4 696 1896 ?? S 4:27AM 0:00.04 imap-login _dovecot 4709 0.0 0.4 556 1892 ?? S 4:27AM 0:00.04 imap-login _dovecot 10294 0.0 0.4 760 1888 ?? S 4:27AM 0:00.04 imap-login _dovecot 13526 0.0 0.4 596 1888 ?? S 4:59AM 0:00.01 pop3-login root 20523 0.0 0.1 472 748 p1 S+ 5:01AM 0:00.00 grep dovecot ----------------------------------------------------------------------------------------- # ls -ltr /var/spool/vmboxbase/transco.org.au/dummy/new total 40 -rw------- 1 vmail vmail 462 May 3 11:06 1241312770.V8I6be62M630453.vega.transylvania.org.au -rw------- 1 vmail vmail 708 May 3 11:15 1241313359.V8I6be6bM976701.vega.transylvania.org.au -rw------- 1 vmail vmail 658 May 3 11:21 1241313700.V8I6bd8aM30789.vega.transylvania.org.au -rw------- 1 vmail vmail 672 May 4 02:18 1241367523.V8I6be75M268056.vega.transylvania.org.au -rw------- 1 vmail vmail 706 May 4 02:31 1241368314.V8I6be7cM742941.vega.transylvania.org.au -rw------- 1 vmail vmail 658 May 4 02:54 1241369661.V8I6bd9bM991186.vega.transylvania.org.au -rw------- 1 vmail vmail 690 May 4 03:02 1241370177.V8I6bd98M300668.vega.transylvania.org.au -rw------- 1 vmail vmail 672 May 4 03:54 1241373297.V8I6bda1M149877.vega.transylvania.org.au -rw------- 1 vmail vmail 837 May 4 04:35 1241375739.V8I6bdaeM905070.vega.transylvania.org.au -rw------- 1 vmail vmail 842 May 4 04:36 1241375767.V8I6bdb4M496268.vega.transylvania.org.au ------------------------------------------------------------------------------------------------------------- When I try to retreive mail for user dummy(a)tarnsco.org.au, the folovig entry is created in /var/log/maillog, but no mail is retrived. The mail client agent is Thunderbird 2.0.22 ------------------------------------------------------------------------------------------------------------- May 4 06:04:51 vega dovecot: auth(default): client in: AUTH 1 PLAIN service=POP3 lip=192.168.1.212 rip=192.168.1.101 resp= May 4 06:04:51 vega dovecot: auth(default): client out: CONT 1 May 4 06:04:51 vega dovecot: auth(default): client in: CONT 1 AGR1bW15QHRyYW5zY28ub3JnLmF1AGR1bW15 May 4 06:04:51 vega dovecot: auth(default): bsdauth(dummy(a)transco.org.au,192.168.1.101): lookup May 4 06:04:51 vega dovecot: auth(default): bsdauth(dummy(a)transco.org.au,192.168.1.101): unknown user May 4 06:04:51 vega dovecot: auth-worker(default): sql(dummy(a)transco.org.au,192.168.1.101): query: SELECT password FROM users WHERE login = 'dummy(a)transco.org.au' and active = 'Y' May 4 06:04:51 vega dovecot: auth(default): client out: OK 1 user=dummy(a)transco.org.au May 4 06:04:51 vega dovecot: auth(default): master in: REQUEST 31 29200 1 May 4 06:04:51 vega dovecot: auth(default): passwd(dummy(a)transco.org.au,192.168.1.101): lookup May 4 06:04:51 vega dovecot: auth(default): passwd(dummy(a)transco.org.au,192.168.1.101): unknown user May 4 06:04:51 vega dovecot: auth-worker(default): sql(dummy(a)transco.org.au,192.168.1.101): SELECT home, maildir, uid, gid FROM users WHERE login = 'dummy(a)transco.org.au' AND active = 'Y' May 4 06:04:51 vega dovecot: auth(default): master out: USER 31 dummy(a)transco.org.au home=/var/spool/vmboxbase maildir=transco.org.au/dummy/ uid=5000 gid=5000 May 4 06:04:51 vega dovecot: pop3-login: Login: user=<dummy(a)transco.org.au>, method=PLAIN, rip=192.168.1.101, lip=192.168.1.212 May 4 06:04:51 vega dovecot: POP3(dummy(a)transco.org.au): Disconnected: Logged out top=0/0, retr=0/0, del=0/0, size=0 Any suggestion? Regards, Ioan

2 1

[Dovecot] Only specifying lda in protocols?
by Brandon Lamb 13 May '09

13 May '09

protocols = lda Should this give me fatal errors when trying to do a dovecot -n I get # 1.2.rc3: /etc/dovecot/dovecot.conf Error: Invalid protocols given in configuration file Fatal: Invalid configuration in /etc/dovecot/dovecot.conf Dovecot starts and functions fine though

2 1

[Dovecot] Dovecot 1.0.7 domain variable
by elliott＠n.localhost 13 May '09

13 May '09

Hi all, Thanks in advance for any help! I'm trying to configure Dovecot to pull emails from Postfix virtual mailbox domain Maildirs under /var/mail/vhosts/<domain>/<username>. I've set mail_location as such in dovecot.conf: mail_location = maildir:/var/mail/vhosts/%d/%n but from debug output I see the domain is blank: dovecot: May 10 20:49:25 Info: IMAP(elliott): maildir: data=/var/mail/vhosts//elliott I've set elliott(a)n.0o0.bz as my username in Outlook so it is sending the domain (and changed auth_username_format to "auth_username_format = %n" so authentication works fine) Why is %d blank here? Anything else to check?? I'm at a loss. Thanks! -elliott-

5 5

[Dovecot] New messages notification - (IMAP PUSH?)
by Proskurin Kirill 13 May '09

13 May '09

Hello all. I have strange problem. As I understand IMAP use server2client command to tell what new email is arrived. So - all was good, but few weeks ago I notice what my thunderbird not show new messages. I think it was local problem(I switch distro what day) but soon my email clients what uses mostly Outlook-2007-SP1 start to confirm this problem. What can it be and how can I fix it? I use Dovecot on FreeBSD-7.1 #pkg_info | grep dovecot dovecot-1.1.11 dovecot-managesieve-0.10.5 dovecot-sieve-1.1.6 #dovecot -n # 1.1.11: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.1-RELEASE-p3 i386 ufs base_dir: /var/run/dovecot/ log_path: /var/log/dovecot/dovecot.log info_log_path: /var/log/dovecot/dovecot-debug.log protocols: imap imaps pop3 pop3s managesieve listen(default): * listen(imap): * listen(pop3): * listen(managesieve): *:2000 ssl_ca_file: /usr/local/etc/certs/GlobalSignCA.crt ssl_cert_file: /usr/local/etc/certs/fxclub_org.crt ssl_key_file: /usr/local/etc/certs/fxclub_org.key ssl_cipher_list: ALL:!LOW:!SSLv2 login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_executable(managesieve): /usr/local/libexec/dovecot/managesieve-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_greeting_capability(managesieve): no login_process_size: 128 login_processes_count: 20 login_max_processes_count: 512 mail_max_userip_connections(default): 256 mail_max_userip_connections(imap): 256 mail_max_userip_connections(pop3): 20 mail_max_userip_connections(managesieve): 10 verbose_proctitle: yes first_valid_gid: 0 mail_privileged_group: mail mail_uid: dmail mail_gid: dmail mail_location(default): maildir:/var/spool/dovecot/domains/%d/%n/ mail_location(imap): maildir:/var/spool/dovecot/domains/%d/%n/ mail_location(pop3): maildir:/var/spool/dovecot/domains/%d/%n/ mail_location(managesieve): mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_executable(managesieve): /usr/local/libexec/dovecot/managesieve mail_process_size: 512 mail_plugins(default): quota imap_quota autocreate mail_plugins(imap): quota imap_quota autocreate mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 mail_plugin_dir(managesieve): /usr/local/lib/dovecot/managesieve imap_client_workarounds(default): delay-newmail tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail tb-extra-mailbox-sep imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): sieve_storage(default): sieve_storage(imap): sieve_storage(pop3): sieve_storage(managesieve): % sieve(default): sieve(imap): sieve(pop3): sieve(managesieve): ~/.dovecot.sieve auth default: mechanisms: plain login user: dovecot-auth username_format: %Lu verbose: yes worker_max_count: 100 passdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf userdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 user: exim master: path: /var/run/dovecot/auth-master mode: 384 user: dmail plugin: quota: maildir quota_rule: *:storage=1024M quota_rule2: Trash:storage=1256M quota_rule3: SPAM:ignore quota_warning: storage=80%% /usr/local/bin/quota-warning.sh 80 quota_warning2: storage=95%% /usr/local/bin/quota-warning.sh 95 autocreate: Trash autocreate2: Sent autocreate3: Spam autosubscribe: Trash autosubscribe2: Sent autosubscribe3: Spam -- Best regards, Proskurin Kirill

6 15

[Dovecot] Dovecot shared quota with Maildir
by Jorgen Lundman 13 May '09

13 May '09

Hello list, We are in the process of exploring the idea of moving from UFS with fs-quota to using softquotas in Dovecot (probably Maildir type, stored in LDAP, all ontop of NFS). I have it setup, and it works rather well so far. But there is one situation we can currently support, which I can not see a solution for with soft-quotas. Generally customers get 1 email, with 1 quota. But it is also possible for customers to get 1 quota, but create multiple mail accounts, all sharing the same quota. This is done by using the same UID for each account when using fs-quota. (It is not that each account gets a fraction of the quota, but that all accounts add up to the one quota). Is this still possible to do with soft-quotas. To share one set. Dovecot would have to go count files in multiple mail-directories so I would guess no. Lund -- Jorgen Lundman | <lundman(a)lundman.net> Unix Administrator | +81 (0)3 -5456-2687 ext 1017 (work) Shibuya-ku, Tokyo | +81 (0)90-5578-8500 (cell) Japan | +81 (0)3 -3375-1767 (home)

2 4

[Dovecot] dovecot bug (maybe)
by Fernando Bertasso 13 May '09

13 May '09

I believe that dovecot is doing something strange, when it founds a 'corrupted' multipart and using fetch body. Look what I figured out: 1) Sent a message from squirrelmail (it wrongly drop the last \n from epilogue): ------=_20090512171902_78105 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit n ------=_20090512171902_78105 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: 8bit n <--------(squirrelmail didn´t insert an additional \n). ------=_20090512171902_78105-- 2) Sent a correct message, inserting the last '\n': ------=_20090512171902_78105 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit n ------=_20090512171902_78105 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: 8bit n ------=_20090512171902_78105-- 3) Compress both messages 4) Request the messages using: A004 UID FETCH 1 (FLAGS BODYSTRUCTURE) (the correct message): 127.000.000.001.00143-127.000.000.001.35604: * 1 FETCH (UID 1 FLAGS (\Seen) BODYSTRUCTURE (("text" "plain" ("charset" "iso-8859-1") NIL NIL "8bit" 7 3 NIL NIL NIL NIL)("text" "html" ("charset" "iso-8859-1") NIL NIL "8bit" *3 1*NIL NIL NIL NIL) "alternative" ("boundary" "----=_20090512171853_50085") NIL NIL NIL)) A004 OK Fetch completed. 5) Request the broken message: 127.000.000.001.00143-127.000.000.001.43679: * 2 FETCH (UID 2 FLAGS (\Seen) BODYSTRUCTURE (("text" "plain" ("charset" "iso-8859-1") NIL NIL "8bit" 7 3 NIL NIL NIL NIL)("text" "html" ("charset" "iso-8859-1") NIL NIL "8bit" *1 0*NIL NIL NIL NIL) "alternative" ("boundary" "----=_20090512171902_78105") NIL NIL NIL)) A004 OK Fetch completed. >From RFC the red numbers mean: size body, number of line for the body. This makes sense, because stripping the 'control' chars from first message, size and number of lines match. But in the second message, the line number is 0 - this does not make sense. You need to test this using telnet, because outlook and thunderbird did not follow this way, they use body.peek. What do you think? Fernando

1 0

[Dovecot] user_attrs seems not to set 'mail'.
by ian＠comtek.co.uk 12 May '09

12 May '09

Hi, I am using Dovecot 1.1.13 (from a Debian package). I was having problems using user_attrs to set 'mail' and 'home'. Initially I tried: user_attrs = uid=mail=maildir:/var/mail/virtual/users/%$/Maildir/,uid=home=/var/mail/virtual/users/%$/ This appeared to set 'home' but not 'mail'. In the debug lot I see: May 12 15:24:40 alpha dovecot: auth(default): ldap(X(a)Y,10.4.4.113): user search: base=ou=users,dc=Y scope=subtree filter=(& (mail=X@Y) (|(accountStatus=active) (accountStatus=migrate)) ) fields=uid,uid May 12 15:24:40 alpha dovecot: auth(default): ldap(X(a)Y,1.1.1.1): result: uid(home=/var/mail/virtual/users/%$/)=/var/mail/virtual/users/uid/ May 12 15:24:40 alpha dovecot: auth(default): master out: USER 30688 X@Y home=/var/mail/virtual/users/uid/ Note that 'home' seems to be set on the last line, but not 'mail'. I was hoping to see 'mail=/var/mail/virtual/users/uid/Maildir/'. Next I tried: user_attrs = =mail=maildir:~/Maildir/,uid=home=/var/mail/virtual/users/%$/ Now I see: May 12 15:31:28 alpha dovecot: auth(default): ldap(X(a)Y,1.1.1.1): user search: base=ou=users,dc=Y scope=subtree filter=(& (mail=X@Y) (|(accountStatus=active) (accountStatus=migrate)) ) fields=uid May 12 15:31:28 alpha dovecot: auth(default): ldap(X(a)Y,1.1.1.1): result: uid(home=/var/mail/virtual/users/%$/)=/var/mail/virtual/users/uid/ May 12 15:31:28 alpha dovecot: auth(default): master out: USER 30712 X@Y home=/var/mail/virtual/users/uid/ mail=maildir:~/Maildir/ Now both 'home' and 'mail' are set, which is what I want. This means the following lines are not synonymous: user_attrs = uid=mail=maildir:/var/mail/virtual/users/%$/Maildir/,uid=home=/var/mail/virtual/users/%$/ user_attrs = =mail=maildir:~/Maildir/,uid=home=/var/mail/virtual/users/%$/ Either I misunderstand the documentation for user_attrs or there is a bug. Assuming the former, can somebody please explain what I am doing wrong? Thanks, Ian

2 2

[Dovecot] Dovecot auth user lookup patch updated for maildrop 2.1.0
by mr.maX 12 May '09

12 May '09

Hi, an updated version of my patch for maildrop that extends it with the ability to perform user lookups against Dovecot's database made against the latest version of maildrop 2.1.0 can be downloaded from the following location: http://www.max.rs/ozone/maildrop-2.1.0-dovecotauth.patch.txt The patch has just been redone in order to apply cleanly without fuzz and to apply properly against one file that was changed in the latest version of maildrop. There have been no other changes compared to the initial version of the patch. For more information, take a look at my previous post to the Dovecot's mailing list at: http://www.dovecot.org/list/dovecot/2009-April/039121.html -- Best Regards, Marko Njezic - mr.maX @ MAX Interactive corp. Personal: http://www.markonjezic.com/ MAX's Empire: http://www.maxempire.com/ MAX's HTML Beauty++ 2004: http://www.htmlbeauty.com/

1 0

[Dovecot] Fail2Ban and the Dovecot log
by Lou Duchez 12 May '09

12 May '09

Hi, Is there any way to disable the "dovecot: " at the beginning of each line of the log? Fail2Ban responds poorly to it. I know there are a number of sites with "failregex" strings for Fail2Ban and Dovecot, but I've tried them all, and they don't work, at least with the latest Fail2ban and the latest Dovecot. The Fail2Ban wiki is pretty clear about why there will be a problem: "In order for a log line to match your failregex, it actually has to match in two parts: the beginning of the line has to match a timestamp pattern or regex, and the remainder of the line has to match your failregex.". So in other words, Fail2Ban expects that each line of the log will start with a timestamp. Thanks all! Dovecot rocks.

4 4

[Dovecot] Sieve & Regex
by Peregrino "Pipino" Tuc 12 May '09

12 May '09

Hi all I'm trying to create a new sieve rule. What I would like to do is catch "From" addresses that are equal to the rightpart (hostname) of a message-id. For example: Message-ID: <000d01c9d23a$941a7db0$6400a8c0@upwabm> From: "Leanne Crabtree" <upwabm(a)blomberg-co.com> I would like to catch this mail, because it has "upwabm" on the right part of the message-id and "upwabm" on the left part of the sender address. I've done this, but with no success. The error reported is: "Invalid preceding regular expression" on line with the second regex with ${1} More over I would like to add an header with the result of regex, an header like this: "X-MyHeader" "${1}" but it does not work. This is an extract of our sieve: --- require ["regex"]; if header :regex "Message-ID" "^.*(a)(.*)>$" { if header :regex "From" ".*<${1}@.*>$" { addheader "X-MyHeader" "${1}" } } ---

1 1

[Dovecot] Overwriting user Quota
by Thomas Krause 11 May '09

11 May '09

Dear List, I cannot overwrite the default quota. In dovecot.conf I have plugin { quota = maildir:User quota quota = dict:user::proxy::quotadict quota_rule = *:storage=380M:messages=10000 quota_rule2 = Trash:storage=100M } To overwrite, I put in dovecot-sql.conf user_query = SELECT CONCAT('/vmail/', maildir) AS home, \ CONCAT('maildir:/vmail/', maildir) as mail, \ CONCAT('*:bytes=', quota) AS quota_rule \ FROM mailbox WHERE username = '%u' AND active = '1' Debugging dovecot: imap-login: Login: user=<x(a)y.z>, method=PLAIN, rip=a.b.c.d, lip=e.f.g.h IMAP(x(a)y.z): Loading modules from directory: /usr/local/lib/dovecot/imap IMAP(x(a)y.z): Module loaded: /usr/local/lib/dovecot/imap/lib10_quota_plugin.so IMAP(x(a)y.z): Module loaded: /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so IMAP(x(a)y.z): Effective uid=101, gid=6, home=/vmail/x.z/x/ IMAP(x(a)y.z): Quota root: name=user backend=dict args=:proxy::quotadict IMAP(x(a)y.z): dict quota: user=x(a)y.z, uri=proxy::quotadict, noenforcing=0 IMAP(x(a)y.z): Quota rule: root=user mailbox=* bytes=398458880 messages=10000 IMAP(x(a)y.z): Quota rule: root=user mailbox=Trash bytes=104857600 messages=0 IMAP(x(a)y.z): Namespace: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes , subscriptions=yes mysql> select CONCAT('*:bytes=', quota) AS quota_rule FROM mailbox where username="x(a)y.z" and active=1; +-------------------+ | quota_rule | +-------------------+ | *:bytes=800000000 | +-------------------+ 1 row in set (0.00 sec) What is my mistake? I'm using dovecot 1.1.11 Best regards, Thomas.

2 1

[Dovecot] Quota over NFS
by Flavio Costa 11 May '09

11 May '09

Hey, I've been strugling to get quota working on my enviroment. I have one storage server that exports the 'home' dir. My mail server mounts the exported 'home' server at '/home' # dovecot --version > 1.1.14 I'm also running Postfix and using Dovecot/LDA as MDA so that we can use the Dovecot's Quota plugin. The thing is that if the user has exceeded it's quota the LDA detects it and I get a response from postmaster warning me that the INBOX is full. But through IMAP, if I issue : > C: 1 GETQUOTAROOT INBOX > S: * QUOTAROOT INBOX "" > S: 1 OK Getquota complete > > There's no: > * QUOTA "" (STORAGE 10 512) > > I've tried using this plugin for Thunderbird: https://addons.mozilla.org/pt-BR/thunderbird/addon/881 And also tested issuing commands by hand. Running 'quota' on the console works just fine, that means that rpc.rquotad is running smoothly. # quota USER > Disk quotas for user coutinho (uid 1191): > Filesystem blocks quota limit grace files quota limit > grace > home.mail:/home > 166264* 102400 153600 3013 0 > 0 > Thanks in advance for you help. -- Flávio Coutinho da Costa

4 7

[Dovecot] dovecot weird bug
by Fernando Bertasso 11 May '09

11 May '09

Hi, We have a weird bug happening in our dovecot installation. When I send html emails from many clients and compress them, there are no problem. They are opened and correctly formated. When I send an email from Squirrelmail and compress it, dovecot exits with no errors (there are no coredumps or seg fault - dovecot just exits). But the weird is, it just happens when squirrelmail opens an email (compressed) that was sent by squirrelmail (all other clients can open it and squirrel can open all other emails sent by other clients). (Try with this message - compressing too - it occurs with me). Best Regards, Fernando Dovecot version: 1.2.rc3 Dovecot Details: # 1.2.rc3: /usr/local/dovecot/etc/dovecot.conf # OS: Linux 2.6.18-128.el5 i686 Red Hat Enterprise Linux Server release 5.3 (Tikanga) base_dir: /usr/local/dovecot/var/run/dovecot/ protocols: imap pop3 ssl: no disable_plaintext_auth: no login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable(default): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3-login login_greeting: Server ready. login_process_per_connection: no login_processes_count: 1 mail_max_userip_connections: 1024 first_valid_gid: 500 mail_uid: 505 mail_gid: 506 mail_location: maildir:~/Maildir mail_debug: yes mail_max_keyword_length: 128 fsync_disable: yes maildir_copy_preserve_filename: yes mail_drop_priv_before_exec: yes mail_executable(default): /usr/local/dovecot/libexec/dovecot/gdbhelper /usr/local/dovecot/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot/libexec/dovecot/gdbhelper /usr/local/dovecot/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3 mail_process_size: 512 mail_plugins(default): quota imap_quota zlib mail_plugins(imap): quota imap_quota zlib mail_plugins(pop3): quota zlib mail_plugin_dir(default): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot/lib/dovecot/pop3 pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: mechanisms: login plain cache_size: 1024 cache_negative_ttl: 0 worker_max_count: 100 passdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf userdb: driver: prefetch plugin: quota: maildir Imap commands: 127.000.000.001.54022-127.000.000.001.00143: A009 UID FETCH 1 (FLAGS UID RFC822.SIZE INTERNALDATE BODY.PEEK[HEADER.FIELDS (Date To Cc From Subject X-Priority Importance Priority Content-Type X-UOLHost-Filter)]) 127.000.000.001.00143-127.000.000.001.54022: * 1 FETCH (UID 1 FLAGS (\Seen) RFC822.SIZE 1241 INTERNALDATE "10-May-2009 16:37:39 -0300" BODY[HEADER.FIELDS (DAT E TO CC FROM SUBJECT X-PRIORITY IMPORTANCE PRIORITY CONTENT-TYPE X-UOLHOST-FILTER)] {264} Date: Sun, 10 May 2009 16:37:38 -0300 (BRT) Subject: a From: namba234(a)emailnovocluster.com To: "Namba 234" <namba234(a)emailnovocluster.com> Content-Type: multipart/alternative;boundary="----=_20090510163738_24160" X-Priority: 3 (Normal) Importance: Normal ) A009 OK Fetch completed. 127.000.000.001.54026-127.000.000.001.00143: A002 SELECT "INBOX" 127.000.000.001.00143-127.000.000.001.54026: * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 1 EXISTS * 0 RECENT * OK [UIDVALIDITY 1241984317] UIDs valid * OK [UIDNEXT 2] Predicted next UID * OK [HIGHESTMODSEQ 1] A002 OK [READ-WRITE] Select completed. 127.000.000.001.54026-127.000.000.001.00143: A003 EXPUNGE 127.000.000.001.00143-127.000.000.001.54026: A003 OK Expunge completed. 127.000.000.001.54026-127.000.000.001.00143: A004 UID FETCH 1 BODY[2] 127.000.000.001.00143-127.000.000.001.54026: * 1 FETCH (UID 1 BODY[2] {7} 127.000.000.001.54026-127.000.000.001.00143: A005 UID FETCH 1 BODY[] (dovecot finish the process). Here is a copy of the message (uncompressed - opens / compressed - hangs). Return-Path: <namba234(a)emailnovocluster.com> X-Original-To: namba234(a)emailnovocluster.com Delivered-To: namba234(a)emailnovocluster.com Received: from webmail.emailnovocluster.com (localhost.localdomain [127.0.0.1]) by maildev.localdomain (Postfix) with ESMTP id B45ACFE146 for <namba234(a)emailnovocluster.com>; Sun, 10 May 2009 16:37:38 -0300 (BRT) Received: from 189.62.202.143 (SquirrelMail authenticated user namba234(a)emailnovocluster.com) by webmail.emailnovocluster.com with HTTP; Sun, 10 May 2009 16:37:38 -0300 (BRT) Message-ID: < c0b80d709ef3dc829fc06395baca944d.squirrel(a)webmail.emailnovocluster.com> Date: Sun, 10 May 2009 16:37:38 -0300 (BRT) Subject: a From: namba234(a)emailnovocluster.com To: "Namba 234" <namba234(a)emailnovocluster.com> User-Agent: SquirrelMail/1.4.17 MIME-Version: 1.0 Content-Type: multipart/alternative;boundary="----=_20090510163738_24160" X-Priority: 3 (Normal) Importance: Normal ------=_20090510163738_24160 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit a ------=_20090510163738_24160 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: 8bit a<br /> ------=_20090510163738_24160--

2 1

[Dovecot] NTLM configuration
by Cédric Laruelle 11 May '09

11 May '09

Hi again everybody ! Im still stuck with the dovecot ntlm authentication I configured dovecot to use winbind, and I would like winbind to authenticate against samba (samba, winbind and dovecot are running on the same box). Here is the log I have (192.168.0.1 is the server box, 192.168.0.254 the client box) dovecot: May 06 14:52:37 Info: auth(default): new auth connection: pid=25828 dovecot: May 06 14:52:38 Info: auth(default): client in: AUTH 1 NTLM service=imap secured lip=192.168.0.1 rip=192.168.0.254 lport=143 rport=1084 dovecot: May 06 14:52:38 Info: auth(default): client out: CONT 1 dovecot: May 06 14:52:38 Info: auth(default): client in: CONT 1 TlRMTVNTUAABAAAAB4IIogAAAAAAAAAAAAAAAAAAAAAFASgKAAAADw== dovecot: May 06 14:52:38 Info: auth(default): client out: CONT 1 TlRMTVNTUAACAAAADgAOADAAAAAFgomizPYc4ALWKQgAAAAAAAAAAIAAgAA+AAAAQQBMAFYA TlRMTVNTUAACAAAADgAOADAAAAAFgomizPYc4ALWKQgAAAAAAAAAAIAAgAA+QQBS AFUATQACAA4AQQBMAFYAQQBSAFUATQABABAASQBOAFQARQBSAE4AQQBMAAQAHgBhAGkAZABlAHIA ZABvAG4AbgBlAHIALgBjAG8AbQADADAAaQBuAHQAZQByAG4AYQBsAC4AYQBpAGQAZQByAGQAbwBu AG4AZQByAC4AYwBvAG0AAAAAAA== dovecot: May 06 14:52:38 Info: auth(default): client in: CONT 1 TlRMTVNTUAADAAAAGAAYAF4AAAAYABgAdgAAAAAAAABIAAAABgAGAEgAAAAQABAATgAAAAAAAACO AAAABYKIogUBKAoAAAAPZgBmAHMAQQBMAFYAQQBSAFUATQAzABXRN5WNNwAgAAAAAAAAAAAAAAAA AAAAALm1ePVxjdOF1UPe8A/e1D6H0+jlJYQPUA== dovecot: May 06 14:52:38 Info: auth(default): winbind(?,192.168.0.254): user not authenticated: NT_STATUS_NO_LOGON_SERVERS dovecot: May 06 14:52:40 Info: auth(default): client out: FAIL 1 Please help, I really need to set this up and it begins to drive me really crazy Cédric Laruelle

3 5

[Dovecot] dovecot weird bug
by Fernando Bertasso 11 May '09

11 May '09

I found the bug, there are two errors: 1) Squirrelmail is wrongly formating multipart/alternative messages. Look here: ------=_20090510163738_24160 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: 8bit a<br /> *<------ HERE* ------=_20090510163738_24160-- All other clients insert an '\n' here, but squirrelmail. 2) When this king of message (above) is compressed (in order to use zlib plugin), dovecot dies. Best Regards, Fernando

1 0

[Dovecot] Dovecot not accepting connections
by Jim 11 May '09

11 May '09

Hi, new user here, trying to track down an issue. Sometimes, after starting dovecot, I'll attempt to check mail and will not be able to get a connection to my server. I'll kill dovecot, restart it, and usually it will begin working. When I first ran into this, I first tried auth_debug=yes, restarted dovecot, and had no problems. I'd turn set auth_debug=no, restart dovecot, and would be unable to check mail. After a time I determined that setting the debug wasn't really effecting anything, it was just hit or miss if I'd be able to get a connection. Once I was able to get a connection, things were fine until dovecot started again. Nothing unusual in the logs, if it works or not, I'll just see this at startup: Mar 25 21:34:48 mail-web-server dovecot[664]: dovecot v1.1.13 starting up (core dumps disabled) Mar 25 21:34:48 mail-web-server dovecot[664]: auth-worker(default): mysql: Connected to localhost (postfix) If debug is on and connections aren't being accepted, I never see anything in the logs. Below is my config. Running on OS X 10.5.6. Any info on troubleshooting would be appreciated. mail-web-server:~ wright$ sudo /usr/local/sbin/dovecot -n Password: # 1.1.13: /usr/local/etc/dovecot.conf # OS: Darwin 9.6.0 i386 hfs protocols: imap imaps pop3 pop3s ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_user: _dovecot login_max_processes_count: 64 max_mail_processes: 128 first_valid_uid: 27 last_valid_uid: 27 first_valid_gid: 27 last_valid_gid: 27 mail_privileged_group: postfix mail_uid: 27 mail_gid: 27 mail_location: maildir:/var/mail/vhosts/%d/%n mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 namespace: type: private inbox: yes list: yes subscriptions: yes auth default: mechanisms: plain login cram-md5 passdb: driver: sql args: /usr/local/etc/dovecot-mysql.conf userdb: driver: sql args: /usr/local/etc/dovecot-mysql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix

3 11

[Dovecot] Degeneration of CPU Performance
by Thiago Monaco Papageorgiou 11 May '09

11 May '09

Hello everybody! We have a interesting issue about dovecot behavior here. First, the scenario: We have 2 server running with the same load, one with our old pop3 solution (out of date) and other with Dovecot. We realized that dovecot are comsuming more CPU, and this consumption is growing day by day. When we starts dovecot, it runs between 40%-45% of CPU consumption and our old solution runs on 30-35%. This is quite acceptable, so no problem here. The problem is one day after it jumps to 45%-55% of cpu comsunption while the old pop3 solution runs on the same CPU consumption of one day before (30%-35). I attached a graph with this information. In this graph the green line is dovecot CPU consumption and the blue line is the old solution. In this graph we restart dovecot at monday morning. This restart is noticed as a big fall of CPU consumption(green line) in the graph. After that, it stay between 40%-45%, one day after it runs on 45%-55% and next day, it reaches 50%-60%! You can notice that the blue line (old pop3 solution) runs with the same behavior, so we have the same load. We have other monitoring informations that confirm it. I looked for some bugs about this, but I didn't find anything. The question is: Is there any dovecot problem or wrong configuration that could cause this degeneration of CPU performance? Any sugestion about what can be the cause of this? I attached dovecot -n output. Two important information: we store the mailboxes in NFS and we are only using pop3 protocol. Thanks in advance! -- Thiago Monaco Papageorgiou <thiago.monaco(a)corp.terra.com.br> ________________________ Terra Networks Brasil S/A Tel: +55 (51) 3284-4274 # 1.1.6: /usr/local/dovecot/etc/dovecot.conf # OS: Linux 2.6.9-78.0.1.ELsmp i686 CentOS release 4.7 (Final) syslog_facility: local2 protocols: pop3 listen: *:1110 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable: /usr/local/dovecot/libexec/dovecot/pop3-login login_user: nobody login_log_format_elements: user=<%u> idperm=<%i> command=%t method=%m rip=%r lip=%l %c login_process_per_connection: no login_process_size: 32 login_processes_count: 100 login_max_processes_count: 500 login_max_connections: 100 mail_uid: popmgr mail_gid: popmgr mail_cache_min_mail_count: 100 mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock maildir_copy_preserve_filename: yes mail_executable: /usr/local/dovecot/libexec/dovecot/pop3 mail_plugins: hashdir mail_plugin_dir: /usr/local/dovecot/lib/dovecot/pop3 mail_log_prefix: %Us: user %u (%e): pop3_uidl_format: %f pop3_client_workarounds: outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain trrproxy_v1 worker_max_count: 64 passdb: driver: trrpam args: extra_fields=short_name,quota_caixa,mail_folders_limit,id_perm,mail_imap %s_dovecot userdb: driver: prefetch plugin: quota: trrquota uidlist_create_form: 1

6 8

[Dovecot] Unit testing
by Timo Sirainen 10 May '09

10 May '09

Unit testing is slowly going forward in Dovecot. In v2.0 tree all the unit tests are now run when you do "make check". They're also run on "make distcheck", which is what I use when building releases or nightly snapshots. So as soon as I start building nightly v2.0 snapshots I should start getting mails every night if the unit tests fail. And I can no longer make a release if a unit test fails. (Unit tests never get run manually - I once fixed a unit test that had been failing for months.) Besides that, I started trying to add unit tests to lib-index. After some hours of refactoring the code I finally managed to get mail-transaction-log-view and mail-index-transaction to a condition where unit tests could be added to them without too much pain. I didn't really add that many unit tests there yet though. I'll probably slowly continue adding more tests and refactoring the code more to allow more unit tests, but if anyone else finds they have nothing better to do, now's a good time to add more tests :) Especially lib/, lib-mail/ and lib-imap/ should already be easily testable and they're missing a lot of tests.

1 0

[Dovecot] dovecot slowing down
by P.A 08 May '09

08 May '09

Hi, not really a dovecot issue but, im running dovecot 1.0.10 with no issues for awhile now J. However I ran into an issue today where postfix didn't have enough processes to handle incoming smtp connections. This for whatever reason was causing pop/imap (dovecot) to take a long time to respond on the appropriate port. After looking at server and finding nothing wrong I stopped postfix which got rid of the delay on port 110/143. I then turned on postfix again and saw the delay for port 25/110/143. What I then did was adjust/increase the default_process_limit in postfix which took care of the problem. Question is why would not enough processes in postfix slow other services down like dovecot 110/143? There was plenty of bandwith/mem/cpu left.

1 0

[Dovecot] Problem with IMAP (rename and delete non existent folder).
by Lenthir 08 May '09

08 May '09

I don't know if this problem exists only in my version of dovecot, or in all... To reproduce BUG do this (use gdb): telnet localhost 143 o login addr(a)email.sth verystrong_pass o delete "kj-test-folder" o rename "kj-test-folder" o rename "kj-test-folder" "other-folder" SIGABRT Of course kj-test-folder is not exist. BT: #31 0xb7da0022 in free () from /lib/tls/libc.so.6 #32 0x0813313a in pool_system_free (pool=0x8169060, mem=0x8146161) at mempool-system.c:92 #33 0x080de02f in mailbox_list_clear_error (list=0x81885e8) at mailbox-list.c:762 #34 0x080dd5ae in mailbox_list_get_mailbox_name_status (list=0x81885e8, name=0x81a4258 "other-folder", status=0xbfe9cae0) at mailbox-list.c:394 My version of Dovecot is 1.2beta1. Do you know anything about this bug? Please help. -- Konrad

2 5

[Dovecot] Problem with IMAP (rename and delete non existent folder).
by Lenthir 08 May '09

08 May '09

I don't know if this problem exists only in my version of dovecot, or in all... To reproduce BUG do this (use gdb): telnet localhost 143 o login addr(a)email.sth verystrong_pass o delete "kj-test-folder" o rename "kj-test-folder" o rename "kj-test-folder" "other-folder" SIGABRT Of course kj-test-folder is not exist. BT: #31 0xb7da0022 in free () from /lib/tls/libc.so.6 #32 0x0813313a in pool_system_free (pool=0x8169060, mem=0x8146161) at mempool-system.c:92 #33 0x080de02f in mailbox_list_clear_error (list=0x81885e8) at mailbox-list.c:762 #34 0x080dd5ae in mailbox_list_get_mailbox_name_status (list=0x81885e8, name=0x81a4258 "other-folder", status=0xbfe9cae0) at mailbox-list.c:394 My version of Dovecot is 1.2beta1. Do you know anything about this bug? Please help. -- Konrad

3 6

[Dovecot] mailutil?
by Timo Sirainen 08 May '09

08 May '09

dbox format needs at least two tools: 1. Expunging only marks the message having refcount=0. The actual disk space is freed only after calling a tool pointing to the user's dbox dir. 2. Ability to force index resync/rebuild in case it doesn't figure out itself that there's something wrong. I'm starting to think about building a more generic mailutil tool, maybe something similar to what UW-IMAP has. So two questions: - What should the tool be called? Probably not mailutil to avoid confusion. doveutil? dovemail? dovetool? mailtool? - Is there any functionality you'd like it to do?

10 15

[Dovecot] Imap notifications in IDLE
by Jarosław Przybyłowicz 07 May '09

07 May '09

Hi, could you please tell me if there is a way, to make dovecot notify my mail client of new messages in inbox subfolders? I'm using fdm to fetch mails into maildir and proper subfolders. So far, when idleing mozilla gets a notification when new message arrives in INBOX, but if mail is fetched into other folder I have to click on it to see if there is a new message. I've checked thunderbird imap log to check if this is dovecot or TB issue. Is there any way to force dovecot to monitor other folders? Regards, V

5 6

Re: [Dovecot] authentication to IMAP
by punit_j 07 May '09

07 May '09

Hi Daniel, What version of dovecot supports this feature ? I am using dovecot-0.99.11-8.EL4 and gives error : - Starting Dovecot Imap: Fatal: Error in configuration file /etc/dovecot.conf line 495: Unknown setting: master_user_separator Here is what i added : auth_master_user_separator = * auth default { passdb passwd-file { args = /root/passwd.masterusers master = yes } passdb shadow { } userdb passwd { } } Regards, Punit

3 2

[Dovecot] Exim And Dovecot SASL
by Andrew Holway 07 May '09

07 May '09

Hi all, I have been trying to get this to work a couple of ways, please take a look at the links below.http://wiki.dovecot.org/HowTo/EximAndDovecotSASLhttp://rafb.net/p/ipH… rejects every time but if I uncomment;auth_executable = /usr/lib/dovecot/dovecot-auth then thunderbird will ask me for a password but does not agree with me on it.I have dovecot set up to use the unix usernames and passwordsThanks,Andrew  

2 2