- dovecot - dovecot.org

[Dovecot] creating skeleton Maildir
by Giuliano Gavazzi 25 May '09

25 May '09

Dear all, when I had a courier installation still in place I used to create the Maildir tree for a new user using its maildirmake (IIRC) utility. Now that I had to rebuild a server from scratch, and using dovecot did not install courier, I have to create Maildirs without that utility. I seem to remember that libexec/imap could be called in a way to create the Maildir and its required subfolders (.Sent, .Drafts, etc). Do I remember correctly? If so what are the command line options? I cannot find pointers in the wiki or elsewhere. If not, I will just create a template and script the whole process. Thanks Giuliano

3 4

[Dovecot] Dovecot Max Connections & mbox vs. maildir format - Recommendations?
by V S Rao 24 May '09

24 May '09

>> I had big issues with timeouts until I realize the the imap and mbox format >> isnt a good choice if your users have huge naiboxes. >> At my server there were users with mailboxes arount 700MB to over 1GB. each >> time one of those users checked their email >> the imap server had to open this huge file and parse it, causing I/O issues. >> The only solution I found it was switch from mbox format to maildir format. I am changing the subject line to reflect the discussion. I too have a similar case with large mailboxes. My user mix is 70% POP3 vs. 30% IMAP. Would maildir still be the best recommended format? What is the opinion of the experts here? The reason I am asking is that I am preparing to upgrade my mail server to RHEL 5.3. That would mean my Dovecot will be atleast 1.0.7, which should not be bad. If the recommendation is that I go from mbox format to Maildir, I want to plan that as well. However I don't want to land up in a situation where, I have to move back from Maildir to mbox again. So please do advice me on the best. BTW one question: Assuming that my server has enough resources, ( 8 CPU @ 3.0GHz, 8GB RAM, 2Gbps FC Storage directly attached to the server & Gigabit NIC) what is the maximum number of concurrent connections that Dovecot can handle POP3 + IMAP combined? And I am asking for all the processes combined: POP3-login processes IMAP-login processes POP3 sessions IMAP sessions Any TCP/IP kernel parameters to be tuned? or maybe in dovecot.conf? Any advice will be immensely valuable to me while doing the migration. Thanks and Regards V S Rao

2 1

[Dovecot] How can I put a file back in Maildir folder?
by Allan Cassaro 23 May '09

23 May '09

Hi, I have a problem: today, when I ran "fsck" some file was linked to "lost+find" folder... After some hours I has all files mapped (File / User). So... how can I put this files back in Maildir folder of this users? I tried with: cat $file | deliver -d username but without success... Any help will be appreciated! Thanks!

2 2

[Dovecot] How to add new features to sieve?
by Ed W 23 May '09

23 May '09

Hi, I like the idea of switching from maildrop to dovecot deliver+sieve, however, we use a couple of features that I'm not sure how to migrate: - We query the userdb and make some user specific params available to the filtering script (invented example, but say number of days to not repeat for the vacation script) - We have a fairly advanced filter (perl) which mangles the email in very specific ways to support users over low bandwidth connections. The email is delivered twice, once to an "Archive" folder and again to the inbox after being mangled. How to integrate this "mangling" script? - We have some custom routes for certain types of SMS messages, ie we have a free email to SMS option for certain networks. Could this be integrated and caught in "alert" functionality (how is the sms backend actually configured anyway?) I think the answer is to write one or more new sieve functions to provide this functionality, but can you give me a quickstart guide on how to do this? Certainly the first requirement is quite an interesting and generic plugin "lookup_db" type function which must have wider utility. The second requirement is a bit more specific, kind of like an xfilter wrapper which could be setup by the administrator I guess? Thanks Ed W

1 0

Re: [Dovecot] How to run Dovecot as IMAP Proxy?
by V S Rao 22 May '09

22 May '09

> > You will not get any support for 0.99 here, unless Timo can provide it. > It is *that* old, and your decision to use it - regardless of your > claimed reason - is baffling. I admit I am running a pretty old version and frankly speaking I was not hoping for any support. Let RH earn their money we paid as support. As you would have noticed I was looking for help in running Dovecot as a IMAP Proxy without the need to setup SQL etc. I only went into details to give clarity. I really appreciate all the responses and suggestions. >> We use recent Dovecot from atrpms.net with RHEL 5.3. Userbase is 25.000. >> Dovecot runs on three machines - as master (proxy) and with two slaves. >> The system is stable. We hardly need to touch it. I would be very much interested in knowing the details of your setup as I am suffering here with only 6000+ users. And that too with a config, which I frankly think is an overkill for our requirement. However maybe I should start a separate thread for that? Thanks and Regards V S Rao.

1 0

Re: [Dovecot] How to run Dovecot as IMAP Proxy?
by V S Rao 22 May '09

22 May '09

So I guess I will take the problem to imapproxy group and find out if I can get a clue to the issue I am facing. BTW, just to confirm once again, are there any known issues with Dovecot & imapproxyd? Because I find it strange that there should be around 8000 established connections between Squirrelmail and imapproxyd & around 400 connections between imapproxyd and Dovecot while on the mail server I see only a couple of connections (typically around 40). Or is it some configuration in Dovecot which is causing this kind of behavior, as I did not notice this while running uw-imap. Regards V S Rao

4 3

[Dovecot] v1.2.rc4 released
by Timo Sirainen 22 May '09

22 May '09

http://dovecot.org/releases/1.2/rc/dovecot-1.2.rc4.tar.gz http://dovecot.org/releases/1.2/rc/dovecot-1.2.rc4.tar.gz.sig I'm pretty hopeful that virtual mailbox code is finally crash-free. If people don't find many problems from this release, I'm thinking that rc5 could come in a couple of weeks and that would be renamed to v1.2.0 after a week or so if no one has reported bugs. v1.2.rc4 2009-05-17 Timo Sirainen <tss(a)iki.fi> * If /dev/arandom exists, use it instead of /dev/urandom (OpenBSD). * When logging to a file, the lines now start with a timestamp instead of "dovecot: " prefix. + IMAP: When multiple commands are pipelined, try harder to combine their mailbox syncing together. For example with Maildir pipelining STORE 1:* +FLAGS \Deleted and EXPUNGE commands the files won't be unnecessarily rename()d before being unlink()ed. + imap-proxy: Send backend's CAPABILITY if it's different from what was sent to client before. + IMAP: struct mail now keeps track of all kinds of statistics, such as number of open()s, stat()s, bytes read, etc. These fields could be exported by some kind of a statistics plugin (not included yet). + IMAP: SEARCH command now dynamically figures out how to run about 0.20 .. 0.25 seconds before seeing if there's other work to do. This makes the SEARCH performance much better. - Fixes to shared mailbox handling. - Fixes to virtual mailboxes. - THREAD command could have crashed. - Fixes to expire-tool. - mbox: Don't break if From_-line is preceded by CRLF (instead of LF). - dict process wasn't restarted after SIGHUP was sent to master.

2 1

[Dovecot] v1.1.15 released
by Timo Sirainen 22 May '09

22 May '09

http://dovecot.org/releases/1.1/dovecot-1.1.15.tar.gz http://dovecot.org/releases/1.1/dovecot-1.1.15.tar.gz.sig The command pipelining fix is pretty interesting. Wonder how much it improves performance, especially when deleting lots of messages from a large mailbox. v1.1.15 2009-05-17 Timo Sirainen <tss(a)iki.fi> + IMAP: When multiple commands are pipelined, try harder to combine their mailbox syncing together. For example with Maildir pipelining STORE 1:* +FLAGS \Deleted and EXPUNGE commands the files won't be unnecessarily rename()d before being unlink()ed. - IMAP: SEARCH command was slower than necessary in a large mailbox. - deliver: When forwarding messages, if -f parameter was given, it should have been used as the Return-Path. - Maildir saving: Fixed race condition bugs in uidlist handling, causing files to be given new UIDs sometimes. - mbox: Don't crash when expunging all messages and file doesn't end with [CR]LF. - expire-tool: Use mail_uid and mail_gid settings if userdb doesn't return uid/gid. - Berkeley DB dict: Transaction rollbacking was implemented wrong. - zlib plugin: Some email / FETCH command combinations could have disconnected the client or sent compressed garbage.

2 1

Re: [Dovecot] Authenticating with /etc/passwd
by June Qiu 22 May '09

22 May '09

Apologies for the confusion.. But I finally got what you meant. Yes, the version exists, but was omitted in the extract of the email. --- On Thu, 5/21/09, Charles Marcus <CMarcus(a)Media-Brokers.com> wrote: > From: Charles Marcus <CMarcus(a)Media-Brokers.com> > Subject: Re: [Dovecot] Authenticating with /etc/passwd > To: dovecot(a)dovecot.org > Date: Thursday, May 21, 2009, 10:17 PM > On 5/21/2009 10:11 AM, June Qiu > wrote: > > it is as displayed > > So there's some weird dovecot -n bug that doesn't show the > dovecot > version if the 'Warning: fd limit...' warning is output? > > > --- On Thu, 5/21/09, Charles Marcus <CMarcus(a)Media-Brokers.com> > wrote: > > > >> From: Charles Marcus <CMarcus(a)Media-Brokers.com> > >> Subject: Re: [Dovecot] Authenticating with > /etc/passwd > >> To: "June Qiu" <qljune(a)yahoo.com> > >> Cc: dovecot(a)dovecot.org > >> Date: Thursday, May 21, 2009, 6:39 PM > >> On 5/20/2009, June Qiu (qljune(a)yahoo.com) > >> wrote: > >>> dovecot -n: > >>> > >>> Warning: fd limit 256 is lower than what > Dovecot can > >> use under full load (more than 768). Either grow > the limit > >> or change login_max_processes_count and > max_mail_processes > >> settings > >>> # OS: SunOS 5.10 sun4u > >>> info_log_path: /var/log/dovecot.log > >> Is the missing version line a copy/paste error? Or > did the > >> warning > >> obscure it somehow? > > > -- > > Best regards, > > Charles >

1 0

Re: [Dovecot] How to run Dovecot as IMAP Proxy?
by V S Rao 22 May '09

22 May '09

Thanks for the many responses and views. I have taken RH support for my mail server only and so have to ensure they support me. So am going with their recommended version which is 0.99.x. Now on the webmail I have migrated to RHEL 5.3 and the dovecot being used there is 1.0.7.x. So that should support proxying, right? BTW, originally I did not go to Redhat. I moved from uw-imap to Dovecot 1.1.14 on the mail server for POP3. The problem of POP3 timeouts continued and I could not find any reason why POP3 was timing out when 400+ concurrent IMAP sessions were working fine. Moreover other network services such as SMTP, Telnet, SSH etc were working fine. Had the box installed behind a IPS box to see if there were any DoS attacks, but had to rule that out. As a last resort, paid RH for support and they made me downgrade Dovecot from 1.1.14 to 0.99.x. Surprisingly the moment I downgraded dovecot, the problem shifted to IMAP & remained ever since. So naturally they told me uw-imap was the problem and made me move to Dovecot 0.99.x for IMAP as well, but no improvement. But the surprising thing, as I mentioned in my original post, IMAP works fine on command line, with clients such as Outlook, THunderbird etc., but Webmail is very slow that its almost not available. BTW webmail was also running on RHEL 4.0. Seeing that the problem existed in webmail alone I upgraded webmail to RHEL 5.3 with all the latest RH supported packages on a new hardware. Any ideas to help me debug this issue would be of great help as I am stuck on this issue for almost a month now. Oh, btw regarding stats, I don't have a measure, but when webmail was working the login was well within 5 seconds. Now it takes forever (more than a min) or timeouts most of the time. Even after login, any request such as opening a mail or changing to a mail folder was well within 5 seconds. Now again it takes forever or timeouts most of the time. Thanks and Regards V S Rao ----- Original Message ----- From: "Timo Sirainen" <tss(a)iki.fi> To: "Dovecot Mailing List" <dovecot(a)dovecot.org> Sent: Friday, May 22, 2009 12:32:24 AM GMT +05:30 Chennai, Kolkata, Mumbai, New Delhi Subject: Re: [Dovecot] How to run Dovecot as IMAP Proxy? On Thu, 2009-05-21 at 11:47 -0700, Seth Mattinen wrote: > Yes, that too. My point was not to judge Dovecot's performance based on > a 0.99 version. ;) I've successfully used several versions of dovecot > 1.1.x with imapproxyd and IMAP-only webmail clients. Do you have any numbers about how much faster it works with imapproxyd vs. without?

4 3

Re: [Dovecot] How to run Dovecot as IMAP Proxy?
by V S Rao 21 May '09

21 May '09

Hi Timo, Thanks for the response. Apologize, but my responses are going to be a bit lengthy. > I have migrated from uw-imap to Dovecot for POP3 & IMAP service. I run > webmail using squirrelmail. When running uw-imap I used to run > up.imapproxyd on the webmail server for faster responses. After > migrating to Dovecot, I find that up.imapproxyd does not work well > with dovecot. > Why not? Here are my observations. I have around 6000+ mailboxes and roughly the same number of users. Earlier the mail server (running sendmail + uw-imap for POP3 & IMAP) would have around 80 pop3 connections (peak) and around 300 IMAP connections, concurrent. (ps -aef | grep imap | wc -l or ps -aef | grep pop3 | wc -l). There have been cases where I have observed upto 500 concurrent IMAP sessions. The IMAP connections are from a webmail server running Apache with Squirrelmail. The observation was that response was slow & so based on the suggestion on Squirrelmail for performance improvement we have installed up-imapproxyd on the squirrelmail machine. There was a significant improvement in the response times for the users, because of caching. After that I encountered some strange problems of POP3 timing out for users (earlier I did post that problem in this forum). I opened a ticket with Redhat and naturally they refused to support me with uw-imap running. So switched to Dovecot 0.99.x (I run the server on RHEL 4.0 and that is the max version supported by Redhat for that version). Ever since I did that POP3 works fine but now webmail is almost not available to the users. People usually get "connection dropped by IMAP server". However the IMAP server seems to work fine. Checked through manual "telnet <ip.address.of.mailserver> 143 & also through other client such as outlook & Thunderbird. I noticed that while the number of established connections for the webmail to mail server was shown as around 40 to 50 on the mail server, the same is shown as around 700 on webmail server. { netstat -an | grep :143 | grep ESTABLISHED | wc -l }. imapproxyd is configured to listen on port 9143 on the localhost and communicates to the mail server on std port 143. What was really bizzare is that when I check for the number of connections on port 9143 it shows around 8000! netstat -an | grep :9143 | grep ESTABLISHED | wc -l So I disabled the imapproxyd on the webmail & now at least the 50 connections are consistent. However the response is extremely slow and so was contemplating on the idea of trying out using another IMAP Proxy server and hence the question. > I don't understand Databases and don't want to install mysql etc for a > simple thing like IMAP PRoxy. > Do you just want it to proxy everyone to a single destination or to > different servers based on username? If you want everyone to the same > destination, why do you even want to use a proxy? I want to proxy all user to the same server. The idea being as explained above benefit from caching. > My question is can Dovecot be run as a IMAP PRoxy without the hassle > of setting up mysql etc? I use /etc/passwd for auth on the actual > dovecot server running IMAP & POP3. > Using checkpassword or SQLite would probably be the easiest solution. Or > generation of a passwd-file, but you'd have to keep it updated if users > change. If I used a passwd file on the webmail machine, running dovecot as a Proxy how would I configure dovecot on the webmail server? It has to accept connections from the squirrelmail and talk to the mailserver. I can do a rsync of the passwd file from the mail server to the webmail server using a small script whenever the file changes on the mail server. Of course the fundamental question from your response, I guess is, without a proxy why is the webmail slow? If proxy is not my problem, can you pls throw some light on why I am facing performance issues on my webmail alone? Thanks and Regards V S Rao

4 6

[Dovecot] IMAP Get Savedate plugin
by Alaa Ibrahim 21 May '09

21 May '09

Hi, I want to add a feature to the fetch command in IMAP, by enabling it to return the save date, when I request the SAVEDATE parameter. I want to use this for my webmail application, so I can show the users the deleted date when they are viewing the Trash folder. I was able to put it directly into the code (patch attached), but I was wondering if there is a way to put it as a plugin instead. Can somebody guide me on how to do that. Thanks a lot. ------------------------- Play the best Flash Games on the web with Maktoob Shams Games. http://games.maktoob.com/

2 3

[Dovecot] How to run Dovecot as IMAP Proxy?
by V S Rao 21 May '09

21 May '09

Hi All, I have migrated from uw-imap to Dovecot for POP3 & IMAP service. I run webmail using squirrelmail. When running uw-imap I used to run up.imapproxyd on the webmail server for faster responses. After migrating to Dovecot, I find that up.imapproxyd does not work well with dovecot. I tried to use dovecot as IMAP PRoxy server as per the document http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy I don't understand Databases and don't want to install mysql etc for a simple thing like IMAP PRoxy. My question is can Dovecot be run as a IMAP PRoxy without the hassle of setting up mysql etc? I use /etc/passwd for auth on the actual dovecot server running IMAP & POP3. Thanks V S Rao

2 1

[Dovecot] crypt() failure is possible
by Arkadiusz Miskiewicz 21 May '09

21 May '09

dovecot 1.1.15 in src/auth/password-scheme.c contains: static bool crypt_verify(const char *plaintext, const char *user ATTR_UNUSED, const unsigned char *raw_password, size_t size) { const char *password; if (size == 0) { /* the default mycrypt() handler would return match */ return FALSE; } password = t_strndup(raw_password, size); return strcmp(mycrypt(plaintext, password), password) == 0; } but according to man page crypt() can fail and NULL is returned then. On other hand glibc info page is silent about such failure. The thing is that I'm seeing crypt() failure here with new glibc 2.10.1 built with nss backend for crypt(), so it would be good to handle such case. (crypt failure was due to improper nss packaging but it could also happen if somehow nss file becomes corrupted) -- Arkadiusz Miśkiewicz PLD/Linux Team arekm / maven.pl http://ftp.pld-linux.org/

2 1

Re: [Dovecot] Authenticating with /etc/passwd
by June Qiu 21 May '09

21 May '09

it is as displayed --- On Thu, 5/21/09, Charles Marcus <CMarcus(a)Media-Brokers.com> wrote: > From: Charles Marcus <CMarcus(a)Media-Brokers.com> > Subject: Re: [Dovecot] Authenticating with /etc/passwd > To: "June Qiu" <qljune(a)yahoo.com> > Cc: dovecot(a)dovecot.org > Date: Thursday, May 21, 2009, 6:39 PM > On 5/20/2009, June Qiu (qljune(a)yahoo.com) > wrote: > > dovecot -n: > > > > Warning: fd limit 256 is lower than what Dovecot can > use under full load (more than 768). Either grow the limit > or change login_max_processes_count and max_mail_processes > settings > > # OS: SunOS 5.10 sun4u > > info_log_path: /var/log/dovecot.log > > Is the missing version line a copy/paste error? Or did the > warning > obscure it somehow? > > > -- > > Best regards, > > Charles >

2 1

[Dovecot] Authenticating with /etc/passwd
by June Qiu 21 May '09

21 May '09

I am trying to do authentication with /etc/passwd and something is not working right for me. Pls help! When i try to authenticate via pop3, I get: -ERR Authentication failed. In the logs, I get: May 21 11:14:07 Info: auth(default): client in: AUTH 1 PLAIN service=pop3 secured lip=127.0.0.1 rip=127.0.0.1 lport=110 rport=32774 resp=AGp1bmUAU0lORzNlcnQ= May 21 11:14:07 Info: auth(default): passwd(test1,127.0.0.1): lookup May 21 11:14:07 Info: auth(default): passwd(test1,127.0.0.1): Password mismatch May 21 11:14:07 Info: auth(default): passwd(test1,127.0.0.1): CRYPT(password) != 'x' May 21 11:14:09 Info: auth(default): client out: FAIL 1 user=test1 May 21 11:14:17 Info: pop3-login: Disconnected (auth failed, 1 attempts): user=<test1>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured dovecot -n: Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 768). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: SunOS 5.10 sun4u info_log_path: /var/log/dovecot.log protocols: imap pop3 listen(default): 127.0.0.1:143 listen(imap): 127.0.0.1:143 listen(pop3): * ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: IMAP ready. login_processes_count: 2 mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: passwd userdb: driver: passwd args: blocking=yes

3 2

[Dovecot] mkdir no permission
by Anna Obertacke 21 May '09

21 May '09

Hallo list-member, Please ignore my bad english. I cant wright bad but i understand well. I reinstalled my server and have big problems with (V 1.1.11) dovecot now. I work with Ubuntu 9.04 Server and want to use pop and imap with easy configuration. I fetch all my Mails on the server and want to look them up by apple Mail. Until yesterday dovecot only worked after I logged in and did something on the server, for example call "mail" oder call "mail.log". After reinstall yesterday it works no more. The new entry in log is "Internal error". Anything else was before yesterday also. My Error Logs: mail.log: May 19 10:00:38 ubuntu dovecot: POP3(annalein): mkdir(/home/annalein/Maildir/cur) failed: Permission denied (euid=1000(annalein) egid=1000(annalein) missing +w perm: /home/ annalein) May 19 10:00:38 ubuntu dovecot: POP3(annalein): Couldn't open INBOX: Internal error occurred. Refer to server log for more information. [2009-05-19 10:00:38] May 19 10:00:38 ubuntu dovecot: POP3(annalein): Couldn't open INBOX top=0/0, retr=0/0, del=0/0, size=0 May 19 10:00:43 ubuntu dovecot: IMAP(annalein): mkdir(/home/annalein/Maildir/cur) failed: Permission denied (euid=1000(annalein) egid=1000(annalein) missing +w perm: /home/ annalein) syslog: May 19 10:22:34 ubuntu dovecot-auth: pam_sm_authenticate: Called May 19 10:22:34 ubuntu dovecot-auth: pam_sm_authenticate: username = [annalein] May 19 10:22:34 ubuntu dovecot-auth: Warning: Using default salt value (undefined in ~/.ecryptfsrc) May 19 10:22:36 ubuntu dovecot-auth: Passphrase key already in keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: ecryptfs_add_passphrase_key_to_keyring: Error adding auth tok with sig [e54db404244691b7] to the keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: Error attempting to add filename encryption key to user session keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: Passphrase key already in keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: ecryptfs_add_passphrase_key_to_keyring: Error adding auth tok with sig [d7f23dd0d7e04b51] to the keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: Error attempting to add passphrase key to user session keyring; rc = [1] May 19 10:22:36 ubuntu dovecot-auth: There is already a key in the user session keyring for the given passphrase. My configuration ist in dovecot-postfix.conf. I can't call it by dovecot -n. But i changed allmost nothing from default- disable_plaintext_auth=no Some points in the file: protocols = imap pop3 imaps pop3s managesieve mail_location = maildir:~/Maildir Please tell what i should show you. Thank you for help. Greetings, Anna Obertacke.

3 5

Re: [Dovecot] Migration questions...
by Richard Hobbs 21 May '09

21 May '09

Hello again, people, I have been reading all of the emails sent back and forth recently, and reading many web pages, and I have a new draft of my migration plan. If anyone has the time and generosity to read through this latest plan for me and let me know if you spot any potential problems with it, i'd really appreciate it. FYI, we're moving from a Debian 3.1/exim/uw-imapd/qpopper/mbox setup to a Debian 5.0/exim/dovecot/maildir setup, and the final version of this document can hopefully become a useful guide for lots of people in future too, if I get it right :-) Anyway... here's the plan... 1. Install Debian with exim, spamassassin, mysqld (for Horde/IMP) and mailman. Use ReiserFS for the indexes and data. XFS would be second choice for filesystem, and this is something of a religious argument, but Dovecot's own page states that ReiserFS is a better choice, and loads of pages on the Internet say that one or the other is better - there's no clear winner, really, so ReiserFS (the FS we already know and trust) wins the battle. 2. Run an online update. 3. Setup IPMI and monitor it from Nagios. 4. Install HotSaNIC to monitor historical system stats. 5. Install and configure Dell OpenManage Server Administrator (or whatever it's called) to monitor hardware, and make sure we will be emailed if a hard drive fails. 6. Rsync homedirs and inboxes onto new server, ready for initial exim configuration. 7. Configure exim as per existing mail server and test that mailing lists and normal email works. You should now have the existing mail delivery solution on the brand new hardware. 8. Configure Spamassassin as per current configuration and test. 9. Configure mailman as per current configuration and test. 10. Once mail delivery is sorted, add "deb http://www.backports.org/debian lenny-backports main contrib non-free" into "/etc/apt/sources.list" and run "aptitude update && aptitude install debian-backports-keyring && aptitude update". 11. Install dovecot (at the time of writing, this was version 1.1.13-2). 12. Run the conversion utility (use "mb2md.py" from http://wiki.dovecot.org/Migration/MailFormat because "convert-tool" doesn't preserve msg UIDs) to convert all existing "mbox" mailboxes into "maildir" mailboxes, for use with Dovecot. 13. Setup exim to use Dovecot's delivery agent ("deliver") so the indexes are updated on mail delivery instead of when the mailbox is requested and also to use the new maildir format. 14. Setup dovecot for IMAP and POP3 and test. *****THIS IS WHERE THE REPEATABLE SECTION BEGINS***** 15. Stop exim and dovecot services. 16. Rsync homedirs and inboxes onto new server again. 17. Run the conversion utility (use "mb2md.py" from http://wiki.dovecot.org/Migration/MailFormat because "convert-tool" doesn't preserve msg UIDs) to convert all existing "mbox" mailboxes into "maildir" mailboxes. 18. Start exim and dovecot services and test SMTP, Spamassassin, mailman, IMAP and POP3. *****THIS IS WHERE THE REPEATABLE SECTION ENDS***** 19. Once everything is working perfectly, send an email to the entire company instructing them what to do after the outage and arrange an outage and do the following steps as soon as the outage begins: a. Unplug DMZ switch from firewall to make delivered mail wait at the sender. b. Stop exim, IMAP, POP3 and dovecot services on both mail servers. c. Rsync homedirs and inboxes onto new server again. d. Run the conversion utility (use "mb2md.py" from http://wiki.dovecot.org/Migration/MailFormat because "convert-tool" doesn't preserve msg UIDs) to convert all existing "mbox" mailboxes into "maildir" mailboxes. e. Start exim and dovecot services and test SMTP, Spamassassin, mailman, IMAP and POP3. f. Reconfigure my own mail client to point to the new mail server (192.168.2.3). g. Reconfigure firewall to think the mail server is now on 192.168.2.3 instead of 192.168.2.2. h. Prepare an email in webmail somewhere in the world, ready to send to a user on our mail server. i. Plug DMZ switch back into firewall and begin monitoring exim logs to check that mail is being delivered. j. Send the email from webmail and check that is goes through exim perfectly and is sitting in the users Inbox. NOTE: We now have a working mail delivery solution! k. Start dovecot IMAP and POP3 and test both. l. Once exim and dovecot are both working against live mailboxes, tell everyone the outage is over. 20. Install and configure Horde & IMP to access email via IMAP. 21. Reconfigure backup script to make sure new server is backed up. 22. Modify Nagios config to monitor new server. 23. DONE! Thanks in advance, everyone! :-) Richard. Brandon Lamb wrote: > On Fri, May 15, 2009 at 5:02 AM, Richard Hobbs > <richard.hobbs(a)crl.toshiba.co.uk> wrote: >> Seth Mattinen wrote: >>> Richard Hobbs wrote: >>>> Seth Mattinen wrote: >>>>> Phillip Macey wrote: >>>>>> On 14/05/2009 5:11 PM, Steffen Kaiser wrote: >>>>>>> On Wed, 13 May 2009, Richard Hobbs wrote: >>>>>>>> The main complaint we have from users is that their IMAP Inbox, with >>>>>>>> 5000 emails in it takes ages to appear, and no amount of coaxing will >>>>>>>> convince them to split their inbox into multiple folders. >>>>>>> Oh, we serve Maildir via Dovecot IMAP and 5000 messages per folder are >>>>>>> a wimp. Problems start if the user: >>>>>> We are having some performancec issues on our server at the moment - all >>>>>> I can put it down to is the large size of some maildirs. Eg. `ls -ld >>>>>> Maildir/cur` might show a directory >20Mb in size for some of our users >>>>>> (20-30k emails). >>>>>> (Performance issues == everything is running ok then all of a sudden >>>>>> load avg goes through the roof, system cpu time goes crazy. Reading mail >>>>>> grinds to a halt. Then everything recovers just as suddenly and the load >>>>>> avg gradually returns to normal levels) >>>>> Are you using ext3 by chance? Vanilla ext3 without directory indexing >>>>> (or whatever it's called) *hates* directories with a lot of files - like >>>>> maildir. Personally, I use XFS, which doesn't suffer from this problem >>>>> since it uses b-trees instead of a table(!) like ext3 does. >>>> This raises another question for me actually... >>>> >>>> We will have one volume for indexes and another volume for data (using >>>> maildir). We will be using the latest stable Debian Linux distro. >>>> >>>> Any opinions on the best filesystem to use? We would normally go >>>> ReiserFS for large volumes, and ext3 for small volumes because of the >>>> unlimited inodes in reiserfs, but i understand that support for that is >>>> beginning to disappear given that Hans Reiser got into a bit of trouble >>>> a few years ago. >>>> >>>> Anyway... that would leave ext3, but is there a better choice i could >>>> make in this instance? We do want performance, of course, but also >>>> complete reliability and resilience when it comes to system crashes >>>> etc... we do *not* want data corruption, and ext3 we know has a very >>>> good journalling and data recovery methods. Well... they're very mature, >>>> anyway. >>>> >>> I used to use ext3, ran into its horrible performance even with >>> directory indexing enabled, went to XFS and never looked back. All of my >>> systems are Debian stable. Reiser3 is part of the kernel so I wouldn't >>> worry about that; Namesys considered it complete and stopped work on it >>> long before the whole murder thing. Both Reiser3 and XFS have worse >>> reputations than ext3, however, I've seen ext3 filesystems hosed beyond >>> repair, too. All my XFS filesystems have battery-backed cache >>> controllers, so it hasn't happened to me yet, hopefully never. ;) One >>> catch with XFS (such as with LVM) to keep in mind is you can't ever >>> shrink it, only grow. >> Trouble is... i've been googling this as well, just now, and loads of >> people say XFS has the better performance, but loads of other people say >> ReiserFS has the better performance. >> >> We have battery backed up RAID controllers too, in this new system, and >> the systems are UPSd, so on that basis i'm still none the wiser! lol >> >> I appreciate your experience with XFS is a positive one, but even the >> dovecot web site says XFS might now be a good choice... >> >> http://wiki.dovecot.org/MailboxFormat/Maildir >> >> What a tough decision! I know it probably won't make too much difference >> in my situation, but i want this to be a very long-term solution, so >> want to do it right first time! >> >> Any other opinions on XFS vs Reiserfs with Dovecot maildir? >> >> Thanks again! >> >> Richard. >> >> >>> ext3 is mature but IMHO completely unsuitable for a busy mail server or >>> any situation where you'll have a bajillion of files in one directory. >>> The exact point at which ext3 will screw you over obviously depends on >>> many factors. But when it happens it'll probably be painful to reformat >>> to something better. >>> >>> ~Seth >>> >>> ______________________________________________________________________ >>> This email has been scanned by the MessageLabs Email Security System. >>> For more information please visit http://www.messagelabs.com/email >>> ______________________________________________________________________ >>> >>> >> -- >> Richard Hobbs (IT Specialist) >> Toshiba Research Europe Ltd. - Cambridge Research Laboratory >> Email: richard.hobbs(a)crl.toshiba.co.uk >> Web: http://www.toshiba-europe.com/research/ >> Tel: +44 1223 436999 Mobile: +44 7811 803377 > > We have been using XFS on our raids for the last few years. We have > fairly new hardware, and using maildir. Delivering over nfs using > exim+dovecot deliver. pop3/imap is near instant load on our webmail. > We have about 16,000 email accounts with ~175 imap+pop3 connections > open all the time. 20 drive sata2 raid 10. amd quad core 9850 with 8 > gigs ram. load sits about 0.30 - 0.45 all day/night. Last I checked > backups were 30-45 minutes, 413 gigs. 6,403,942 files. > > ______________________________________________________________________ > This email has been scanned by the MessageLabs Email Security System. > For more information please visit http://www.messagelabs.com/email > ______________________________________________________________________ > > -- Richard Hobbs (IT Specialist) Toshiba Research Europe Ltd. - Cambridge Research Laboratory Email: richard.hobbs(a)crl.toshiba.co.uk Web: http://www.toshiba-europe.com/research/ Tel: +44 1223 436999 Mobile: +44 7811 803377

2 2

Re: [Dovecot] pop3 gives a permission denied error on chdir
by Kenneth Gonsalves 21 May '09

21 May '09

On Wednesday 20 May 2009 01:20:37 you wrote: > On Tue, 2009-05-19 at 13:35 +0530, Kenneth Gonsalves wrote: > > May 19 09:16:10 greenchilly dovecot: chdir(/home/vmail/example.com/john) > > failed with uid 5000: Permission denied > > .. > > > I have looked at the archives and see that the problem has been reported > > before, but cannot find any solution. Dovecot as LDA has no problem > > accessing and writing mails to the directory as UID 5000. I suspect that > > it is trying to access some other directory and the error message is > > misleading. The directory /home/vmail/example.com/john is owned by user > > vmail with UID 5000. Any clues? > > And all the directories before that are also available for that user? yes > Are you using NFS? Are you using SELinux or something? no > Anyway that > chdir() syscall really failed with that error message. The reason for > that is less clear then.. v1.1+ would give a much nicer error message > here telling exactly what is wrong.. I have installed version 1.1.13, here is the mail log: May 20 10:33:54 greenchilly dovecot: auth(default): new auth connection: pid=1181 May 20 10:34:07 greenchilly dovecot: auth(default): client in: AUTH^I1^IPLAIN^Iservice=pop3^Isecured^Ilip=127.0.0.1^Irip=127.0.0.1^Ilport=110^Irport=42418^Iresp=<hidden> May 20 10:34:07 greenchilly dovecot: auth-worker(default): pam(john(a)example.com,127.0.0.1): lookup service=dovecot May 20 10:34:07 greenchilly dovecot: auth-worker(default): pam(john(a)example.com,127.0.0.1): #1/1 style=1 msg=Password: May 20 10:34:10 greenchilly dovecot: auth-worker(default): pam(john(a)example.com,127.0.0.1): unknown user May 20 10:34:10 greenchilly dovecot: auth(default): sql(john(a)example.com,127.0.0.1): query: SELECT email as user, passwd as password FROM view_users WHERE email='john(a)example.com'; May 20 10:34:10 greenchilly dovecot: auth(default): client out: OK^I1^Iuser=john(a)example.com May 20 10:34:10 greenchilly dovecot: auth(default): master in: REQUEST^I3^I1166^I1 May 20 10:34:10 greenchilly dovecot: auth(default): passwd(john(a)example.com,127.0.0.1): lookup May 20 10:34:10 greenchilly dovecot: auth(default): passwd(john(a)example.com,127.0.0.1): unknown user May 20 10:34:10 greenchilly dovecot: auth(default): master out: USER^I3^Ijohn@example.com^Iuid=5000^Igid=5000^Ihome=/home/vmail/example.com/john May 20 10:34:10 greenchilly dovecot: Fatal: chdir(/home/vmail/example.com/john) failed with uid 5000: Permission denied May 20 10:34:10 greenchilly dovecot: child 1182 (pop3) returned error 89 (Fatal failure) May 20 10:34:10 greenchilly dovecot: pop3-login: Login: user=<john(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured and here is the session info: lawgon@greenchilly:~$ telnet localhost pop3 Trying 127.0.0.1... Connected to localhost.localdomain. Escape character is '^]'. +OK Dovecot ready. user john(a)example.com +OK pass summersun +OK Logged in. Connection closed by foreign host. -- regards Kenneth Gonsalves Associate NRC-FOSS http://nrcfosshelpline.in/web/

3 7

Re: [Dovecot] Authenticating with /etc/passwd
by June Qiu 21 May '09

21 May '09

Solved. Thanks, Timo! --- On Thu, 5/21/09, Timo Sirainen <tss(a)iki.fi> wrote: > From: Timo Sirainen <tss(a)iki.fi> > Subject: Re: [Dovecot] Authenticating with /etc/passwd > To: "June Qiu" <qljune(a)yahoo.com> > Cc: dovecot(a)dovecot.org > Date: Thursday, May 21, 2009, 11:31 AM > On Wed, 2009-05-20 at 20:16 -0700, > June Qiu wrote: > > I am trying to do authentication with /etc/passwd and > something is not working right for me. Pls help! > .. > > May 21 11:14:07 Info: auth(default): > passwd(test1,127.0.0.1): CRYPT(password) != 'x' > > /etc/passwd doesn't have passwords nowadays. They're in > /etc/shadow. > Either user passdb shadow or passdb pam. > >

1 0

[Dovecot] compile error with patched dovecot-1.2.rc4
by Carlos Xavier 21 May '09

21 May '09

Hi, I just downloaded the dovecot-1.2.rc4.tar.gz to do some tests. I coud compile it and generate the package with no trouble on my Slackware 12.2.0 Then as I wanted to try the patchs available at http://hg.dovecot.org/dovecot-1.2/# I downloaded them and applied at once. When I tried to compile once again I got this error: cmd-thread.o: In function `cmd_thread': cmd-thread.c:(.text+0x219): undefined reference to `mail_thread_type_parse' ../../src/lib-storage/libstorage.a(mail-search-build.o): In function `search_arg_build': mail-search-build.c:(.text+0x10b9): undefined reference to `mail_thread_type_parse' collect2: ld returned 1 exit status make[3]: *** [imap] Error 1 make[3]: Leaving directory `/usr/local/src/dovecot-1.2.rc4/src/imap' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/usr/local/src/dovecot-1.2.rc4/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/usr/local/src/dovecot-1.2.rc4' make: *** [all] Error 2 I removed the patched folder and untarred it again, but at this time I decided to apply one patch at time just to see witch one gave me the trouble. When the first set of patch ( http://hg.dovecot.org/dovecot-1.2/rev/d42a8623a008 ) was applied I got the same error. Just to confirm it was this set of patch, I applied all the other set of patchs leaving that one not applied and the compilation went out with no trouble. As im not a expert so I am sending this report to the list in order to get it fixed. Best Regards, Carlos Xavier.

2 2

[Dovecot] Problem with pam/krb5 auth on AIX 5.3
by Jonathan Siegle 20 May '09

20 May '09

I'm using pam to authenticate users against my krb5 realm. Here is the problem scenario: User test2 attempts to login and their password is not expired so dovecot says: 0 login test2 myfavoritepassword 0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH] Logged in 1 logout * BYE Logging out 1 OK Logout completed. User test1 attempts to login, but their password is expired. So dovecot says: 0 login test1 myfavoritepassword 0 NO d expired User test2 attempts to login and their password is not expired. But dovecot still says: 0 login test2 myfavoritepassword 0 NO d expired If I kill the pid with name "dovecot-auth -w", user test2 can login just fine unless I login with the user test1 before trying user test2. So it seems like something is getting cached. I'm running imap-login out of inetd, in case that matters. In my dovecot.conf, I don't have any caching/authentication variables activated. I don't see anything obvious to type in passdb pam{ } to type. For debug, I've enable pam for telnet and tested that without error. Also, the logs show that test2 This is dovecot revision 9062:694714d59cd9 . Looking at the logs, I see user test2 authenticate correctly in all instances. thanks, Jonathan

2 2

[Dovecot] %d does not expand to domain
by Giuliano Gavazzi 20 May '09

20 May '09

Hello, dovecot-1.1.7 on FreeBSD 7.1. Usernames have dot in them (like uname.example for a user in example.com) in dovecot.conf I have: mail_location: maildir:/userhomes/maildirs/%d/%n/Maildir and for authentication: username_format: %Ln In the client, tried with CONE and Mail.app, I put the username as: uname.example(a)example.com So, the authentication works fine, as it extracts the uname.example from the uname.example(a)example.com supplied. The mail_location does not: Apr 27 17:21:26 drum dovecot: imap-login: Login: user=<uname.example>, method=PLAIN, rip=88.149.183.86, lip=88.149.202.106, TLS Apr 27 17:21:26 drum dovecot: IMAP(name.example): Effective uid=1301, gid=1301, userhomes=/userhomes/example.com/uname Apr 27 17:21:26 drum dovecot: IMAP(uname.example): Namespace: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes Apr 27 17:21:26 drum dovecot: IMAP(uname.example): maildir: data=/ userhomes/maildirs//uname.example/Maildir Apr 27 17:21:26 drum dovecot: IMAP(uname.example): maildir++: root=/ userhomes/maildirs//uname.example/Maildir, index=, control=, inbox=/ userhomes/maildirs//uname.example/Maildir it looks like the %d expands to the empty string. Could this be due to the "." in the username? Thanks Giuliano

3 12

[Dovecot] maildir filename with eg. ,S=1000, omitted
by Joseph LP 20 May '09

20 May '09

Hello. I encountered the wiki entry on maildirs not long ago. In it, it is suggested that the use of ,S= and ,W= may improve performance as dovecot does not need to calculate size itself. While my maildir filenames have ,W=, they lack ,S=. I've grepped dovecot.conf, but I can find no option to address this. Regards, Joseph

2 1

[Dovecot] Deleting everything left from lazy expunge
by Romer Ventura 20 May '09

20 May '09

Hello, My storage is running low and i was wondering what would be the best and easy way of deleting everything within the "deleted" and "expunged" folders for every user...? My mail resides in: /srv/mail/vmail/MYDOMAIN.COM/<users>/Maildir/ Thanks..!

3 3

Re: [Dovecot] using postfix+dovecot+squirrell+amavisd and spam folder per user
by ESGLinux 20 May '09

20 May '09

HI again, I cant get this work. I have followed these instructions: http://wiki.dovecot.org/LDA/Postfix Now I have this in my configuratio files: main.cf: .... virtual_transport = dovecot ..... master.cf: .... dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${recipient} ... dovecot.conf: protocol lda { postmaster_address = postmaster(a)xeridia.com mail_plugins = quota cmusieve #sieve_global_dir = /etc/dovecot/sieve/ sieve = /etc/dovecot/sieve/dovecot.sieve log_path = /var/log/dovecot-deliver.log info_log_path = /var/log/dovecot-deliver.log } but when I send mails I don´t see that it uses dovecot lda at all: this is an extract of the log: ay 20 12:55:49 SBPRUEBAS postfix/cleanup[7049]: 9546769339: message-id=< 20090520105549.9546769339(a)SBPRUEBAS.dominio.com> May 20 12:55:49 SBPRUEBAS postfix/qmgr[7039]: 9546769339: from=< root(a)xerida.com>, size=314, nrcpt=1 (queue active) May 20 12:55:49 SBPRUEBAS amavis[6965]: (06965-01) (!!)WARN: all primary virus scanners failed, considering backups May 20 12:55:51 SBPRUEBAS postfix/smtpd[7056]: connect from unknown[127.0.0.1] May 20 10:55:51 SBPRUEBAS postfix/smtpd[7056]: 85D616933C: client=unknown[127.0.0.1] May 20 12:55:51 SBPRUEBAS postfix/cleanup[7049]: 85D616933C: message-id=< 20090520105549.9546769339(a)SBPRUEBAS.dominio.com> May 20 12:55:51 SBPRUEBAS postfix/qmgr[7039]: 85D616933C: from=< root(a)xerida.com>, size=760, nrcpt=1 (queue active) May 20 12:55:51 SBPRUEBAS amavis[6965]: (06965-01) Passed CLEAN, < root(a)xerida.com> -> <prueba(a)pruebax2.com>, Message-ID: < 20090520105549.9546769339(a)SBPRUEBAS.dominio.com>, mail_id: eaVsoxO6Fxg4, Hits: 1.374, size: 314, queued_as: 85D616933C, 1926 ms May 20 12:55:51 SBPRUEBAS postfix/smtp[7052]: 9546769339: to=< prueba(a)pruebax2.com>, relay=127.0.0.1[127.0.0.1]:10024, delay=2, delays=0.03/0.01/0.01/1.9, dsn=2.0.0, status=sent (250 2.0.0 Ok, id=06965-01, from MTA([127.0.0.1]:10025): 250 2.0.0 Ok: queued as 85D616933C) May 20 12:55:51 SBPRUEBAS postfix/qmgr[7039]: 9546769339: removed May 20 12:55:51 SBPRUEBAS postfix/virtual[7061]: 85D616933C: to=< prueba(a)pruebax2.com>, relay=virtual, delay=0.03, delays=0.01/0.01/0/0.01, dsn=2.0.0, status=sent (delivered to maildir) May 20 12:55:51 SBPRUEBAS postfix/qmgr[7039]: 85D616933C: removed I think I´m missing something, but I dont know what. thanks in advance for your answers ESG

2 2

[Dovecot] %d isn't expanded
by Roy Sigurd Karlsbakk 20 May '09

20 May '09

Hi all I have a box running Debian Lenny 5.0.1 and Dovecot 1.0.15. The user query given below does not expand %d, making logins fail. The password query seems to work well, according to the mysql query log. Any ideas why this happens? Best regards roy user_query = SELECT 'maildir:/var/spool/dovecot/%d/%n' as mail, uid, gid, domain FROM users WHERE username = '%n' and domain = '%d' # 1.0.15: /etc/dovecot/dovecot.conf log_path: /var/log/dovecot/dovecot.log log_timestamp: %Y-%m-%d %H:%M:%S disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login verbose_proctitle: yes mail_privileged_group: mail mail_location: maildir:/var/spool/dovecot/%d/%n auth default: default_realm: eventchief.com verbose: yes debug: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf -- Roy Sigurd Karlsbakk (+47) 97542685 / 98013356 roy(a)karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk.

1 0

[Dovecot] Dovecot is emptying Maildir folders
by Alexander Johannes 20 May '09

20 May '09

Hello, i have a annoying problem with dovecot after updating to 1.1.14. Dovecot seems to empty all cur/ and new/ Folders in the Maildir of a particular user several times a day (3 times so far). It leaves only unread messages in their place. All Index-Files are getting updated and reflect the "empty"-State of the Mailbox. A quick look over the logfiles reveals nothing which seems to be relevant to this malfunction. The error_log is empty for the relevant timeframe. There is no Expire/Expunge-Plugin running. Fortunately i have a hourly backup-snapshot to restore the Mailboxes, but this is obviously no solution. How can i debug this problem? Any advice is welcome. System: FreeBSD 7.1-RELEASE, dovecot-1.1.14, dovecot-managesieve-0.10.6, dovecot-sieve-1.1.6 (all installed via the ports-tree), exim-4.69_3 Clients: Thunderbird, Mail.app both IMAP only Regards, Alex

4 7

[Dovecot] using postfix+dovecot+squirrell+amavisd and spam folder per user
by ESGLinux 20 May '09

20 May '09

Hi All, As I say in the subject I use postfix, dovecot with squirrellmail as webmail and amavisd as spam control, My problem is that all the spam I catch is send to /var/lib/amavis/virus but I want to send this mails to the spam folder of each user. This way the user can see the mails and determine if they are really spam or false positive. I dont know exactly what element of the system is the responsible to do that (dovecot, amavis, posttix) any suggest? (although only be the initial point to look for it) Thanks in advance ESG

2 3

[Dovecot] expire-tool segmentation fault
by LEVAI Daniel 20 May '09

20 May '09

Hi! I'm using Dovecot 1.1.15 on OpenBSD 4.4. How can I debug this? # /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire- tool Segmentation fault (core dumped) # gdb /usr/local/sbin/dovecot (gdb) run --exec-mail ext /usr/local/libexec/dovecot/expire-tool Starting program: /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire-tool Program received signal SIGTRAP, Trace/breakpoint trap. Cannot remove breakpoints because program is no longer writable. It might be running in another process. Further execution is probably impossible. 0x044628c0 in ?? () (gdb) bt full #0 0x044628c0 in ?? () No symbol table info available. What else could I do? Thanks! Daniel -- LÉVAI Dániel PGP key ID = 0x4AC0A4B1 Key fingerprint = D037 03B9 C12D D338 4412 2D83 1373 917A 4AC0 A4B1

2 4

[Dovecot] National symbols imap search
by Max Ivanov 20 May '09

20 May '09

How does imap server should handle search requests with non latin symbols? Rightnow thunderbird 2.0.0.21 and dovecot1.2rc3 are unable to find any message if I try to search for cyrillic symbols. fts, and squat plugins are enabled

3 2

[Dovecot] POP3 with lot of messages
by Matt 20 May '09

20 May '09

Running Dovecot 1.1.8. Have several email accounts with thousands of messages in them that are left on server. Is there anyway to speed up POP3 access without switching to IMAP? Doubt it but thought I would ask. Matt

3 4

[Dovecot] pop3 gives a permission denied error on chdir
by Kenneth Gonsalves 19 May '09

19 May '09

hi, I am running debian lenny standard install and dovecot also as a standard install. I have a problem with POP3 access. The error message is: May 19 09:16:10 greenchilly dovecot: chdir(/home/vmail/example.com/john) failed with uid 5000: Permission denied May 19 09:16:10 greenchilly dovecot: child 26253 (pop3) returned error 89 May 19 09:16:10 greenchilly dovecot: pop3-login: Login: user=<john(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured I have looked at the archives and see that the problem has been reported before, but cannot find any solution. Dovecot as LDA has no problem accessing and writing mails to the directory as UID 5000. I suspect that it is trying to access some other directory and the error message is misleading. The directory /home/vmail/example.com/john is owned by user vmail with UID 5000. Any clues? my config: greenchilly:/etc/dovecot# dovecot -n # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_location: maildir:/home/vmail/%d/%n/Maildir mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: static args: uid=5000 gid=5000 home=/home/vmail/%d/%n allow_all_users=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail -- regards Kenneth Gonsalves Associate NRC-FOSS http://nrcfosshelpline.in/web/

2 1

[Dovecot] Virtual users, local delivery via LDA and LDAP troubles
by Konstantin Khomoutov 19 May '09

19 May '09

We're investigating the possibiliy to migrate our mail system from Sendmail+Cyrus to Sendmail+Dovecot. The system must use authentication against Windows AD (supposedly using LDAP) and must use virtual hosting. So far we managed to work around a bug reported in [1], and IMAP/POP3 authentication on LDAP works OK. LDAP auth is set up using binds (Cyrus and Ejabberd authenticate against the same LDAP server without problems). As we use virtual users, userdb is set to be "static" in a standard way: userdb static { args = uid=10513 gid=10513 home=/var/local/dovecot/%u } After verifying IMAP/POP3 authentication works, I've set up the Dovecot LDA to deliver mail for domain users. This exposed another problem which I don't understand: the delivery program tries to figure out whether the user exists (which is perfectly sensible), it talks to the "master" authentication process which seemingly uses passdb backend to search LDAP. But this fails with the message "passdb doesn't support lookups, can't verify user's existence". [2] suggests it's auth binds that prevent this scheme from functioning correctly, but we can't stop using auth binds as Windows AD doesn't store users' passwords in any way sensible for external consumption. This would also pose unnecessary security risk on the domain, as the account used for initial binding should have had rights to read passwords, and its credentials are placed in the Dovecot configuration file in clear text. I read about "allow_all_users" in [3], but our Sendmail doesn't check whether the target user exists and we don't want to implement this as it logically pertains to the program which actually manages users' mailboxes -- Dovecot in our case. Is there a way to solve the problem at hand within the specified constraints? 1. http://dovecot.org/pipermail/dovecot/2009-May/039540.html 2. http://www.mail-archive.com/dovecot@dovecot.org/msg09449.html 3. http://www.mail-archive.com/dovecot@dovecot.org/msg08848.html

2 1

[Dovecot] what is deliver(1.1.10) doing in /tmp
by Pawel Eljasz 19 May '09

19 May '09

dear all, first part of log snippet is to show a bit of contrast, to me it's peculiar situation it's about messages between local users, actually one user, when I use command line mailx or anther local account to send to A_local user - ok second part is this weir error, it's selinux which prevents deliver write to /tmp, I believe thsese messages are from A_local user cron jobs(to himself) why would dovecot act differently in these scenarios, why would it need /tmp one time and not need it another May 19 14:32:29 whale postfix/pickup[9588]: 725F08F95500: uid=0 from=<root> May 19 14:32:29 whale postfix/cleanup[10877]: 725F08F95500: message-id=<20090519133229.725F08F95500(a)whale.hindhead.local> May 19 14:32:29 whale postfix/qmgr[3083]: 725F08F95500: from=<root(a)hindhead.local>, size=445, nrcpt=1 (queue active) May 19 14:32:30 whale dovecot: auth(default): new auth connection: pid=10883 May 19 14:32:30 whale postfix/smtpd[10883]: connect from localhost.localdomain[127.0.0.1] May 19 14:32:30 whale postfix/smtpd[10883]: 1E96A8F95501: client=localhost.localdomain[127.0.0.1] May 19 14:32:30 whale postfix/cleanup[10877]: 1E96A8F95501: message-id=<20090519133229.725F08F95500(a)whale.hindhead.local> May 19 14:32:30 whale postfix/qmgr[3083]: 1E96A8F95501: from=<root(a)hindhead.local>, size=906, nrcpt=1 (queue active) May 19 14:32:30 whale postfix/smtpd[10883]: disconnect from localhost.localdomain[127.0.0.1] May 19 14:32:30 whale amavis[9369]: (09369-14) Passed CLEAN, <root(a)hindhead.local> -> <pawel(a)hindhead.local>, Message-ID: <20090519133229.725F08F95500(a)whale.hindhead.local>, mail_id: D3qbEK-TL0Hi, Hits: 0.028, size: 445, queued_as: 1E96A8F95501, 650 ms May 19 14:32:30 whale postfix/smtp[10880]: 725F08F95500: to=<pawel(a)hindhead.local>, relay=127.0.0.1[127.0.0.1]:10024, delay=0.67, delays=0.02/0.01/0/0.65, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as 1E96A8F95501) May 19 14:32:30 whale postfix/qmgr[3083]: 725F08F95500: removed May 19 14:32:30 whale deliver(pawel): Loading modules from directory: /usr/lib64/dovecot/lda May 19 14:32:30 whale deliver(pawel): Module loaded: /usr/lib64/dovecot/lda/lib90_cmusieve_plugin.so May 19 14:32:30 whale deliver(pawel): maildir: data=/home/pawel/Maildir May 19 14:32:30 whale deliver(pawel): maildir++: root=/home/pawel/Maildir, index=, control=, inbox=/home/pawel/Maildir _May 19 14:32:30 whale deliver(pawel): cmusieve: Using sieve path: /home/pawel/.dovecot.sieve May 19 14:32:30 whale deliver(pawel): cmusieve: Executing script /home/pawel/.dovecot.sievec_ May 19 14:32:30 whale deliver(pawel): msgid=<20090519133229.725F08F95500(a)whale.hindhead.local>: saved mail to INBOX May 19 14:32:30 whale postfix/local[10884]: 1E96A8F95501: to=<pawel(a)hindhead.local>, relay=local, delay=0.02, delays=0/0.01/0/0.01, dsn=2.0.0, status=sent (delivered to command: /usr/libexec/dovecot/deliver) May 19 14:32:30 whale postfix/qmgr[3083]: 1E96A8F95501: removed and right after above: May 19 14:33:05 whale postfix/pickup[9588]: 2607F8F95500: uid=501 from=<pawel> May 19 14:33:05 whale postfix/cleanup[10877]: 2607F8F95500: message-id=<20090519133305.2607F8F95500(a)whale.hindhead.local> May 19 14:33:05 whale postfix/qmgr[3083]: 2607F8F95500: from=<pawel(a)hindhead.local>, size=2892071, nrcpt=1 (queue active) May 19 14:33:05 whale postfix/smtpd[10883]: connect from localhost.localdomain[127.0.0.1] May 19 14:33:05 whale postfix/smtpd[10883]: 8DC458F95501: client=localhost.localdomain[127.0.0.1] May 19 14:33:05 whale postfix/cleanup[10877]: 8DC458F95501: message-id=<20090519133305.2607F8F95500(a)whale.hindhead.local> May 19 14:33:05 whale postfix/smtpd[10883]: disconnect from localhost.localdomain[127.0.0.1] May 19 14:33:05 whale postfix/qmgr[3083]: 8DC458F95501: from=<pawel(a)hindhead.local>, size=2899979, nrcpt=1 (queue active) May 19 14:33:05 whale deliver(pawel): Loading modules from directory: /usr/lib64/dovecot/lda May 19 14:33:05 whale deliver(pawel): Module loaded: /usr/lib64/dovecot/lda/lib90_cmusieve_plugin.so May 19 14:33:05 whale deliver(pawel): maildir: data=/home/pawel/Maildir May 19 14:33:05 whale deliver(pawel): maildir++: root=/home/pawel/Maildir, index=, control=, inbox=/home/pawel/Maildir May 19 14:33:05 whale deliver(pawel): maildir++: root=/home/pawel/Maildir, index=, control=, inbox=/home/pawel/Maildir _May 19 14:33:05 whale deliver(pawel): cmusieve: Using sieve path: /home/pawel/.dovecot.sieve May 19 14:33:05 whale deliver(pawel): cmusieve: Executing script /home/pawel/.dovecot.sievec_ *May 19 14:33:05 whale deliver(pawel): creat(/tmp/dovecot.deliver..1242739985.10903.8aa6fa47dffdc26d) failed: Permission denied May 19 14:33:05 whale deliver(pawel): copy: i_stream_read() failed: Permission denied* May 19 14:33:05 whale amavis[9395]: (09395-14) Passed CLEAN, <pawel(a)hindhead.local> -> <pawel(a)hindhead.local>, Message-ID: <20090519133305.2607F8F95500(a)whale.hindhead.local>, mail_id: QY0vutvX3AMN, Hits: -, size: 2896598, queued_as: 8DC458F95501, 449 ms May 19 14:33:05 whale postfix/smtp[10880]: 2607F8F95500: to=<pawel(a)hindhead.local>, orig_to=<pawel>, relay=127.0.0.1[127.0.0.1]:10024, delay=3, delays=2.5/0/0/0.45, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as 8DC458F95501) May 19 14:33:05 whale deliver(pawel): msgid=<20090519133305.2607F8F95500(a)whale.hindhead.local>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2009-05-19 14:33:05] *May 19 14:33:05 whale deliver(pawel): sieve runtime error: Keep: Generic Error May 19 14:33:05 whale deliver(pawel): sieve_execute_bytecode(/home/pawel/.dovecot.sievec) failed* May 19 14:33:05 whale postfix/local[10884]: 8DC458F95501: to=<pawel(a)hindhead.local>, relay=local, delay=0.07, delays=0.06/0/0/0.01, dsn=4.3.0, status=deferred (temporary failure) May 19 14:33:05 whale postfix/qmgr[3083]: 2607F8F95500: removed cheers

2 1

[Dovecot] ext3/ext4 performance issue
by Timo Sirainen 19 May '09

19 May '09

Wonder if anyone else has actually noticed this and has some kind of statistics? http://marc.info/?t=124234003300001&r=1&w=2

6 8

[Dovecot] Segfault in deliver server
by Sascha Wilde 19 May '09

19 May '09

Hi Timo, Hi list, I finally got along to test the current dovecot 1.2 with our Kolab Server. And I'm very excited to see all the cool ACL and shared name spaces stuff upstream, thanks a lot Timo! Anyway I just stumbled across a new bug using our metadata-plugin (which in turn uses the dict back end): Making a few annotations requests after another it stops working. dovecot.log sais something like: Feb 03 11:58:21 burlywood3 <info> dovecot[10486]: IMAP(4(a)burlywood3.rgb): metadata_get_metadata_entry: dict key=shared//kolab/var/dovecot/spool/4@burlywood3. rgb/home/maildir/.Calendar//vendor/kolab/folder-type Feb 03 11:58:21 burlywood3 <error> dovecot[10486]: child 10503 (dict) killed with signal 11 Feb 03 11:58:21 burlywood3 <error> dovecot[10486]: IMAP(4(a)burlywood3.rgb): read(/kolab/var/dovecot/run/dict-server) failed: Connection reset by peer Feb 03 11:58:21 burlywood3 <critical> dovecot[10520]: Fatal: dup2(3) failed: Bad file descriptor Feb 03 11:58:21 burlywood3 <error> dovecot[10486]: child 10520 (dict) returned error 89 (Fatal failure) Feb 03 11:58:21 burlywood3 <critical> dovecot[10486]: Panic: file ioloop.c: line 38 (io_add): assertion failed: (fd >= 0) (END) I attached gdb to dict and got this: Program received signal SIGSEGV, Segmentation fault. array_idx_modifiable_i (array=0x38, idx=0) at array.c:10 10 pos = idx * array->element_size; (gdb) bt #0 array_idx_modifiable_i (array=0x38, idx=0) at array.c:10 #1 0x0805e9a2 in sql_pool_unlink (ctx=0x80fb670) at sql-pool.c:64 #2 0x0805ea24 in sql_pool_new (pool=0x80f9470, db_driver=0x80dd498 "sqlite", connect_string=0x810ad78 "/kolab/var/dovecot/lib/metadata-dict.sqlite") at sql-pool.c:97 #3 0x0805bb3c in sql_dict_init (driver=0x80f9ae0, uri=0xbfce9f76 "/kolab/etc/dovecot/metadata-dict.conf", value_type=DICT_DATA_TYPE_STRING, username=0x80fb910 "4(a)burlywood3.rgb") at dict-sql.c:86 #4 0x0805c9ca in dict_init (uri=0xbfce9f6f "sqlite:/kolab/etc/dovecot/metadata-dict.conf", value_type=DICT_DATA_TYPE_STRING, username=0x80fb910 "4(a)burlywood3.rgb") at dict.c:87 #5 0x0805a1b1 in dict_client_connection_input (conn=0x80fb8d0) at dict-server.c:407 #6 0x0806637c in io_loop_handler_run (ioloop=0x80f8a80) at ioloop-epoll.c:202 #7 0x080652fd in io_loop_run (ioloop=0x80f8a80) at ioloop.c:338 #8 0x0805a42d in main () at main.c:122 (gdb) li 5 6 void *array_idx_modifiable_i(struct array *array, unsigned int idx) 7 { 8 size_t pos; 9 10 pos = idx * array->element_size; 11 if (pos >= array->buffer->used) { 12 /* index doesn't exist yet, initialize with zero */ 13 buffer_append_zero(array->buffer, pos + array->element_size - 14 array->buffer->used); (gdb) p array $1 = (struct array *) 0x38 (gdb) p *array Cannot access memory at address 0x38 (gdb) up #1 0x0805e9a2 in sql_pool_unlink (ctx=0x80fb670) at sql-pool.c:64 64 next_ctx = SQL_POOL_CONTEXT(ctx->prev); (gdb) p *ctx $2 = {module_ctx = {reg = 0x0}, prev = 0x0, next = 0x810d2b0, pool = 0x80f9470, refcount = 0, key = 0x80fb638 "sqlite\t/kolab/var/dovecot/lib/metadata-dict.sqlite", orig_deinit = 0x805f229 <driver_sqlite_deinit_v>} (gdb) li 59 prev_ctx->next = ctx->next; 60 } 61 if (ctx->next == NULL) 62 ctx->pool->unused_head = ctx->prev; 63 else { 64 next_ctx = SQL_POOL_CONTEXT(ctx->prev); 65 next_ctx->prev = ctx->prev; 66 } 67 ctx->pool->unused_count--; 68 } (gdb) c Continuing. Program terminated with signal SIGSEGV, Segmentation fault. The program no longer exists It's quite possible, that we got any details in the usage of the dict back end wrong, but I guess that in any case the dict server shouldn't segfault... cheers sascha -- Sascha Wilde OpenPGP key: 4BB86568 http://www.intevation.de/~wilde/ http://www.intevation.de/ Intevation GmbH, Neuer Graben 17, 49074 Osnabrück; AG Osnabrück, HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner

2 2

[Dovecot] Multiple dovecot versions side-by-side
by Max Ivanov 19 May '09

19 May '09

I'm current maintainer of dovecot packages in ALTLinux distro and I plan to make possible to install multiple dovecot versions side-by-side (1.0, 1.1, 1.2) to make upgrade process easier and more robust. Is there any consequences of doing that? I worry about locking maildirs and mboxes, does dovecot handle it correctly if another dovecot process tries to work on same mail location?

2 1

[Dovecot] LDA and postfix with recipient delimiter: documentation
by John Fawcett 18 May '09

18 May '09

Just a comment about the documentation for postfix integration when using receipient delimiter and delivery of user+foo(a)domain.ext to user@domain: http://wiki.dovecot.org/LDA/Postfix I had some issues to get this working, so thought I'd share my experience. Dovecot version 1.2.rc3. Postfix version postfix-2.7-20090511. I have no local (unix) mailboxes, everything is delivered to dovecot, so in postfix I have set mailbox_transport = dovecot. In this case the following syntax taken from the docs does not work: dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${user}@${nexthop} whereas the following does work: dovecot unix - n n - - pipe flags=DRhu user=vmail:mail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${user}@${domain} I think that ${domain} is always what is wanted and only when ${nexthop} happens to have the same value as ${domain} - for example when using a transport table entry like this: /etc/postfix/transport domain.ext dovecot: will the ${user}@${nexthop} form be deliverable. Can anyone see a reason for not using always ${user}@${domain} instead of ${user}@${nexthop}? John

5 6

[Dovecot] dovecot 2.0 (revision 9271:d467712aee77) compile problems on AIX 5.3
by Jonathan Siegle 18 May '09

18 May '09

Having some problems compiling on AIX 5.3 with IBM vac version 8. Programs that I had problems building: test-mail test-imap test-index To fix the undefined symbols problem: ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_end ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_begin ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8 ld: 0711-317 ERROR: Undefined symbol: .charset_is_utf8 ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_str ld: 0711-317 ERROR: Undefined symbol: .message_header_decode_utf8 ld: 0711-317 ERROR: Undefined symbol: .rfc822_parser_init ld: 0711-317 ERROR: Undefined symbol: .rfc822_skip_lwsp ld: 0711-317 ERROR: Undefined symbol: .rfc822_parse_content_type ld: 0711-317 ERROR: Undefined symbol: .rfc2231_parse ld: 0711-317 ERROR: Undefined symbol: .rfc822_parse_mime_token ld: 0711-317 ERROR: Undefined symbol: .rfc822_parse_atom ld: 0711-317 ERROR: Undefined symbol: .message_address_parse ld: 0711-317 ERROR: Undefined symbol: .iconv ld: 0711-317 ERROR: Undefined symbol: .iconv_open ld: 0711-317 ERROR: Undefined symbol: .iconv_close I add this ../lib-charset/.libs/libcharset.a -liconv to the Makefiles (./src/lib-imap/Makefile;./src/lib-index/Makefile;./src/lib-mail/ Makefile) below: $ find . -name Makefile -exec egrep -p libcharset.a {} \; -print clean-noinstPROGRAMS: @list='$(noinst_PROGRAMS)'; for p in $$list; do \ f=`echo $$p|sed 's/$(EXEEXT)$$//'`; \ echo " rm -f $$p $$f"; \ rm -f $$p $$f ; \ done test-imap$(EXEEXT): $(test_imap_OBJECTS) $(test_imap_DEPENDENCIES) @rm -f test-imap$(EXEEXT) $(LINK) $(test_imap_LDFLAGS) $(test_imap_OBJECTS) $ (test_imap_LDADD) $(LIBS) \ ../lib-mail/.libs/libmail.a ../lib-charset/.libs/libcharset.a -liconv ./src/lib-imap/Makefile clean-noinstPROGRAMS: @list='$(noinst_PROGRAMS)'; for p in $$list; do \ f=`echo $$p|sed 's/$(EXEEXT)$$//'`; \ echo " rm -f $$p $$f"; \ rm -f $$p $$f ; \ done test-index$(EXEEXT): $(test_index_OBJECTS) $(test_index_DEPENDENCIES) @rm -f test-index$(EXEEXT) $(LINK) $(test_index_LDFLAGS) $(test_index_OBJECTS) $ (test_index_LDADD) $(LIBS) ../lib-charset/.libs/libcharset.a -liconv ./src/lib-index/Makefile clean-noinstPROGRAMS: @list='$(noinst_PROGRAMS)'; for p in $$list; do \ f=`echo $$p|sed 's/$(EXEEXT)$$//'`; \ echo " rm -f $$p $$f"; \ rm -f $$p $$f ; \ done test-mail$(EXEEXT): $(test_mail_OBJECTS) $(test_mail_DEPENDENCIES) @rm -f test-mail$(EXEEXT) $(LINK) $(test_mail_LDFLAGS) $(test_mail_OBJECTS) $ (test_mail_LDADD) $(LIBS) ../lib-charset/.libs/libcharset.a -liconv ./src/lib-mail/Makefile Then compilation occurs fine. Thanks! Jonathan

2 4

[Dovecot] How to manage Seen flags via sieve?
by Max Ivanov 18 May '09

18 May '09

I use public namespace for group mailboxes. If someone sends email from this mailbox , MTA detects it and delivers copy of that message to mailbox/Sent folder, to keep history of all messages available for every group member. I'd like to set Seen flag on all messages that dovecots deliver puts into "Sent" folder. Is it posible somehow?

2 1

[Dovecot] 1.1.13 squat core dump
by David Halik 18 May '09

18 May '09

While using 1.1.13 and squat with local pine imap on Solaris 9 I had a random core dump today. I was doing a search in a maildir folder with about 2000 emails. Unfortunately, I haven't been able to reproduce it yet, but I wanted to send along the info anyways. Environment: # uname -a SunOS 5.9 Generic_122300-39 sun4u sparc SUNW,Sun-Blade-100 Backtrace: http://pastebin.com/f7aa8bb5 ~# dovecot -n # 1.1.13: /usr/local/etc/dovecot.conf # OS: SunOS 5.9 sun4u protocols: imap imaps pop3 pop3s ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no mail_location: maildir:~/Maildir:INDEX=/heroes/u1/dovecot-index/sparc/index/%u:CONTROL=/heroes/u1/dovecot-index/control/%u mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota fts fts_squat mail_plugins(imap): quota imap_quota fts fts_squat mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): UID%u-%v namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: passdb: driver: pam args: * userdb: driver: passwd plugin: quota: fs fts: squat fts_squat: partial=4 full=4 -- ================================ David Halik System Administrator OIT-CSS Rutgers University dhalik(a)jla.rutgers.edu ================================

5 14

Re: [Dovecot] LDA and postfix with recipient delimiter: documentation
by john.ml＠erba.tv 18 May '09

18 May '09

> Hi John, > no i didnt wrote that, i only have user(a)domain.ext > layout in use currently in my test servers > > -- > Best Regards > > MfG Robert Schetterer > > Germany/Munich/Bavaria > Hi Robert I probably didn't make it clear. The problem with the published syntax is that it does not work for receipient delimiter and delivery to mailbox, except as far as I can see when next_hop is the same as domain, which is not always the case. I think that the documentation should report the syntax with ${domain} instead of ${next_hop}, unless there's something I'm missing, since this should always work. thanks again John

2 1

[Dovecot] migration and conversion from courier
by Giuliano Gavazzi 18 May '09

18 May '09

Dear all, back in January I posted about migration from courier and in particular on the script courier-dovecot-migrate.pl. That script had a bug on BSD (or should I say not-Linux?) type systems*. On FreeBSD (6.1) and MacOSX (10.5) it appended a lot of binary garbage at the end of dovecot-keywords files. On a couple of systems I had not actually run the script with the -- convert option, as I had misunderstood the procedure, so those systems, ironically, are the ones that I migrated better... Now to the issue. My final question at the time was (http://dovecot.org/pipermail/dovecot/2009-January/036292.html) can one delete the dovecot-keywords and rerun the script (leaving alone the dovecot-uidlist)? There is a problem if this cannot be done, as those files have the following structure: 0 flag0 1 flag1 ... m binary garbage [optionally followed by more lines like the last] and if a new keyword is added, the file ends up like (this is copy and paste example): 0 JunkRecorded 1 $NotJunk 2 $Junk 3 Redirected 4 ^A<F0># 5 <B0><96># 6 $Forwarded It does not look like a nice thing to me. I doubt though that the script will cope with flags correctly, as in principle will get the flags from an out of date courierimapkeywords, thus missing any new ones. Perhaps the only solution is to have a new script that deletes the garbage lines and renumbers the following ones, so that the above example would become: 0 JunkRecorded 1 $NotJunk 2 $Junk 3 Redirected 4 $Forwarded and then renames all *g files to *e. Thoughts? Giuliano * This bug was fixed back then by Timo who replaced the script on the site http://www.dovecot.org/tools/courier-dovecot-migrate.pl. But there's no note of the change on the site nor was an announcement made to the list, AFAIK.

2 4

[Dovecot] Quota over NFS
by Flavio Costa 18 May '09

18 May '09

I have accidentaly reply only to Timo, so I'm forwarding to discussion back to the list. Sorry! ---------- Forwarded message ---------- From: Timo Sirainen <tss(a)iki.fi> Date: Mon, May 11, 2009 at 3:12 PM Subject: Re: [Dovecot] Quota over NFS To: Flavio Costa <flavio.cdc(a)gmail.com> On Mon, 2009-05-11 at 15:03 -0300, Flavio Costa wrote: > I get that the server doesn't reply correctly to Dovecot, but the > thing is: why does the LDA works properly? > > May 6 13:15:35 SERVER_NAME deliver(USER_TO): > msgid=<eb4d7eac0905060915y130b9af6i93567e198659d5f7(a)mail.gmail.com>: rejected: Not enough disk space Because it's the NFS server that enforces the quota here. You'd get this error even if you didn't load quota plugin at all. Also note that it's saying "Not enough disk space", not "Quota exceeded" which is the error message from Dovecot v1.0's quota plugin. > And yet, why does 'quota <user>' replies correctly and Dovecot > doesn't? Looking at quota-tools sources, it seemed to ignore the active-check entirely. So I don't know if Dovecot should ignore it too.. > They all obtain the info from the rpc.rquotad running on the > fileserver, right? Yeah. -- Flávio Coutinho da Costa

2 8

[Dovecot] expire plugin error
by Michael Lechtermann 18 May '09

18 May '09

Hi, I am using the db backend for the expire plugin and found the following error message in the logfile: dovecot: Jan 22 10:10:55 Error: dict: secondary db: unable to allocate space from the buffer cache dovecot: Jan 22 10:10:55 Error: dict: Failed to initialize dictionary 'expire' dovecot: Jan 22 10:10:55 Error: IMAP(xxxxxxxxxx): read(/var/dovecot/dict-server) failed: Remote disconnected Anyone know how to fix this? I do not want to use SQL as backend, that would be overkill. # ls -alFh /var/dovecot/dict-server srwxrwxrwx 1 root wheel - 0B Jan 22 10:08 /var/dovecot/dict-server= # dovecot -n # 1.1.8: /etc/dovecot.conf # OS: OpenBSD 4.4 sparc64 ffs base_dir: /var/dovecot/ log_path: /var/log/dovecot.log protocols: imaps pop3s listen: xxxxxxxxxxxx ssl_ca_file: /etc/ssl/xxxxxxxxxxxx.ca ssl_cert_file: /etc/ssl/xxxxxxxxxxxx.crt ssl_key_file: /etc/ssl/private/xxxxxxxxxxxx.key login_dir: /var/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_user: _dovecot mail_max_userip_connections(default): 25 mail_max_userip_connections(imap): 25 mail_max_userip_connections(pop3): 5 first_valid_uid: 10000 last_valid_uid: 19999 first_valid_gid: 100 last_valid_gid: 100 mail_gid: 100 mail_location: mbox:/var/data/mail/%u/mbox:INBOX=/var/data/mail/%u/mbox/inbox:INDEX=/var/dovecot/index/%u mbox_write_locks: fcntl mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): expire imap_quota quota trash zlib mail_plugins(imap): expire imap_quota quota trash zlib mail_plugins(pop3): expire quota zlib mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: passdb: driver: bsdauth userdb: driver: passwd socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: fs:user:noenforcing:mount=/var/data trash: /etc/dovecot-trash.conf expire: Trash 14 expire_dict: proxy:/var/dovecot/dict-server:expire dict: expire: db:/var/lib/dovecot/expire.db

3 5

[Dovecot] pine vs dovecot-zlib (mbox.gz)
by Darabos Edvárd Konrád 18 May '09

18 May '09

Hello! Always reproducible pine vs dovecot-imap-mbox.gz scene has weird errors. - Initial message is OK: [Folder "SAVE.gz" opened with 211 messages READONLY] - Some mails at the end are listed correctly, others are listed with empty sender/size/subject (just numbering). - All mails have no bodies. Full header command produces total blank screen. Even before any error message. Error messages appear during navigation: [{localhost/imap/user="nil"}SAVE.gz : Missing IMAP reply key: )] [MAIL FOLDER "SAVE.gz" CLOSED DUE TO ACCESS ERROR] Seamonkey works with both mbox-es and mbox.gz-s. Mbox-es are working with both SeaMonkey and pine. Technical environment description follows... Thanks, Nil. PS: Tried to gzip other folder, same results. -- 8< -- Dovecot version: 1.0.15 Linux version 2.6.26-1-amd64 (Debian 2.6.26-13) (waldi(a)debian.org) (gcc version 4.1.3 20080704 (prerelease) (Debian 4.1.2-24)) #1 SMP Sat Jan 10 17:57:00 UTC 2009 Debian GNU/Linux 5.0 (lenny) Filesystem: ext3 -- 8< -- ~/.pinerc (all other lines are comments or equal to nothing) smtp-server=localhost inbox-path={localhost}INBOX default-fcc={localhost}Sent feature-list=enable-full-header-and-text, enable-full-header-cmd, enable-8bit-esmtp-negotiation, enable-8bit-nntp-posting character-set=utf-8 folder-collections=IMAP {localhost}[] last-time-prune-questioned=109.2 last-version-used=5.10 ssh-path=/usr/local/bin/imapd.sh color-style=use-termdef current-indexline-style=flip-colors titlebar-color-style=default normal-foreground-color=255,255,255 normal-background-color=000,000,000 meta-message-foreground-color=255,255,255 meta-message-background-color=000,000,255 index-opening-foreground-color=000,000,000 index-opening-background-color=000,255,255 -- 8< -- /usr/local/bin/imapd.sh (just tried to redirect server stderr, did not helped): #!/bin/bash /usr/lib/dovecot/imap 2> /dev/null -- 8< -- # 1.0.15: /etc/dovecot/dovecot.conf Warning: mail_extra_groups setting was often used insecurely so it is now deprecated, use mail_access_groups or mail_privileged_group instead log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3s listen(default): localhost listen(imap): localhost listen(pop3): * ssl_listen: * login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_extra_groups: mail mail_access_groups: mail mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins: zlib mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: passdb: driver: pam userdb: driver: passwd -- 8< --

2 2

[Dovecot] expire plugin + dovecot 1.1.7
by Georg Käfer 18 May '09

18 May '09

Hi, testing expire plugin I get an error message "User lookup failed": /usr/sbin/dovecot --exec-mail ext /usr/libexec/dovecot/expire-tool -test Error: userdb(lukas(a)manual.at) didn't return uid Info: User lookup failed: lukas(a)manual.at Info: gkaefer2(a)manual.at/INBOX.Sent: stop, expire time in future: Wed Mar 31 14:38:33 2010 Reviewing the expires database I see simmilar entries like for gkaefer2(a)manual.at (which is working) lukas(a)manual.at/INBOX.Trash 1241181173 lukas(a)manual.at/INBOX 1270238935 lukas(a)manual.at/INBOX.Sent 1271417514 Dovecot -n # 1.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-gentoo-r3 i686 Gentoo Base System release 1.12.11.1 ext3 syslog_facility: local0 protocols: pop3 pop3s imap imaps ssl_cert_file: /etc/ssl/dovecot/xxx.pem ssl_key_file: /etc/ssl/dovecot/xxx.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_process_per_connection: no login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_process_size: 128 login_processes_count: 10 login_max_processes_count: 256 mail_max_userip_connections(default): 10 mail_max_userip_connections(imap): 10 mail_max_userip_connections(pop3): 30 first_valid_uid: 8 last_valid_uid: 8 first_valid_gid: 12 last_valid_gid: 12 mail_privileged_group: mail mail_uid: mail mail_gid: mail mail_location: maildir:/var/mail/%d/%n/Maildir/:INDEX=/var/mail/%d/%n/indexes mail_debug: yes mail_full_filesystem_access: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota trash expire mail_plugins(imap): quota imap_quota trash expire mail_plugins(pop3): quota expire mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: mail group: mail plugin: quota: maildir:User quota quota_rule: *:storage=500M quota_rule2: *:messages=5000 quota_rule3: Trash:storage=10%% quota_rule4: Spam:storage=20%% quota_warning: storage=90%% /usr/bin/quota-warning.sh 90 quota_warning2: storage=70%% /usr/bin/quota-warning.sh 70 quota_warning3: messages=70%% /usr/bin/quota-warning.sh 70 trash: /etc/dovecot/dovecot-trash.conf expire: Trash 30 Trash/* 30 INBOX.Trash 30 Spam 30 Junk-E-Mail 30 INBOX.Sent 365 Sent 365 INBOX 365 expire_dict: proxy::expire dict: expire: mysql:/etc/dovecot/dovecot-dict-expire.conf dovecot-dict-expire.conf: connect = host=localhost dbname=postfixadmin user=postfixadmin password=xxx # dovecot v1.1 only: table = expires select_field = expire_stamp where_field = mailbox username_field = not_used and users home (lukas@] ls -ltra shows: -rw------- 1 mail mail 0 Mar 31 10:25 dovecot-uidvalidity.49d1d387 drwx------ 4 mail mail 4096 Mar 31 10:25 .. -rw------- 1 mail mail 36 Mar 31 11:53 subscriptions -rw------- 1 mail mail 8 Mar 31 14:31 dovecot-uidvalidity drwx------ 5 mail mail 4096 Apr 1 14:33 .INBOX.Trash drwx------ 2 mail mail 4096 Apr 2 22:09 tmp -rw------- 1 mail mail 161 Apr 2 22:09 dovecot-uidlist drwx------ 2 mail mail 4096 Apr 3 13:42 new drwx------ 2 mail mail 4096 Apr 3 13:42 cur drwx------ 8 mail mail 4096 Apr 16 11:32 . drwx------ 5 mail mail 4096 Apr 16 11:35 .INBOX.Drafts -rw------- 1 mail mail 64 Apr 16 13:31 maildirsize drwx------ 5 mail mail 4096 Apr 22 12:44 .INBOX.Sent any idea what is causing the "didn't return uid" / "User lookup failed:" ? many thanks, Liebe Gruesse Georg Kaefer

2 1

[Dovecot] dovecot 1.2 plugin virtual and shared namespace with thunderbird
by Robert Schetterer 18 May '09

18 May '09

Hi Timo, using latest dovecot 1.2 and latest thunderbird i noticed if using virtual plugin like here with mysql http://wiki.dovecot.org/Plugins/Virtual everthing works like expected until i add a shared namespace Tb then looses its subscriptions under imap to the private namespace only the shared namespace gets shown up , any idea? I dont see something special in the logs why this happens -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 16

[Dovecot] latest update dovecot 1.2 breaks Error: imap dump-capability
by Robert Schetterer 18 May '09

18 May '09

Hi Timo, lates update 1.2 seems to break something it gives me Fio_loop_handle_add: epoll_ctl(1, 0): Operation not permitted Error: imap dump-capability: Couldn't read capability (got 0 bytes) Fatal: Invalid configuration in /etc/dovecot/dovecot.conf at restart, nothing in the conf changed Any Idea? Regards

2 4