- dovecot - dovecot.org

[Dovecot] Dovecot and POP3
by DJ GRP 13 May '10

13 May '10

Hi all, I run Dovecot 1.2.9, for both IMAP and POP3 access. I was wondering if there is a way to force messages be deleted from server when the user uses POP3, even if she has selected a 'Leave messages on server' option. I was able to do it in the past using Qpopper (--enable-auto-delete option). Thanks

1 0

[Dovecot] auth: Error: PLAIN(user): Request 27511.1 timeouted after 150 secs, state=3
by Mark Sapiro 13 May '10

13 May '10

Since upgrading from Dovecot 2.0.beta4 + patches http://hg.dovecot.org/dovecot-2.0/rev/96496e1d3d12 and http://hg.dovecot.org/dovecot-2.0/rev/aefa279e2c70 to Dovecot 2.0.beta 5, I have started to see the subject error from Dovecot for SASL authentications. It doesn't happen every time, but it happens more often than not. It doesn't seem to affect Postfix's acceptance of the message. One other change made about the same time as the dovecot upgrade that may be involved is the addition of smtpd_sasl_authenticated_header = yes in Postfix. Here is a sequence of relevant log messages for one incoming message. May 12 10:59:59 sbh16 postfix/smtpd[27511]: connect from msapiro.net[68.183.193.239] May 12 11:00:00 sbh16 postfix/smtpd[27511]: 076A36900A9: client=msapiro.net[68.183.193.239], sasl_method=PLAIN, sasl_username=mark May 12 11:00:00 sbh16 postfix/smtpd[27511]: disconnect from msapiro.net[68.183.193.239] May 12 11:00:00 sbh16 postfix/cleanup[27513]: 076A36900A9: hold: header Received: from [192.168.0.4] (msapiro.net [68.183.193.239])??(using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))??(No client certificate requested)??(Authenticated sender: mark)??by sbh16.song from msapiro.net[68.183.193.239]; from=<mark(a)msapiro.net> to=<xxx(a)example.com> proto=ESMTP helo=<[192.168.0.4]> May 12 11:00:00 sbh16 postfix/cleanup[27513]: 076A36900A9: message-id=<4BEAECA2.7060300(a)msapiro.net> May 12 11:00:12 sbh16 MailScanner[25960]: Requeue: 076A36900A9.A66FD to B52366900BA May 12 11:02:29 sbh16 dovecot: auth: Error: PLAIN(mark): Request 27511.1 timeouted after 150 secs, state=3 Note that the timeout occurs, about 149 seconds after Postfix has accepted and queued the message. [root@sbh16 ~]# dovecot -n # 2.0.beta5: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.18-8.1.14.el5 i686 CentOS release 5 (Final) auth_mechanisms = plain apop login auth_worker_max_count = 5 mail_location = mbox:~/Mail:INBOX=/var/spool/mail/%u mail_privileged_group = mail mbox_write_locks = fcntl dotlock passdb { args = /usr/local/etc/dovecot.passwd driver = passwd-file } passdb { driver = pam } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } ssl_cert = </etc/postfix/sbh16-cert.pem ssl_key = </etc/postfix/sbh16-key.pem userdb { driver = passwd } [root@sbh16 ~]# Excerpt from postconf -n smtpd_sasl_auth_enable = yes smtpd_sasl_authenticated_header = yes smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 2

[Dovecot] ot: problem with .de root servers
by Robert Schetterer 12 May '10

12 May '10

Hi, there was/is a Problem with the denic .de root servers this might give you some Problems with mail it looks like that it is recent partly working again -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 1

[Dovecot] dovecot-2.0 hg and pigeonhole hg
by Vasiliy G Tolstov 12 May '10

12 May '10

Hello. I'm found the solution to my problem, described in previous mails (sorry i'm delete old mail and unable to reply to thread) i'm use dovecot and pigeonhole from hg repo , after clean and anble sieve plugin i'm get this error May 12 11:01:18 selfip dovecot: imap: Error: dlopen(/usr/lib/dovecot/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_get_log_var_expand_table May 12 11:01:18 selfip dovecot: imap: Error: dlopen(/usr/lib/dovecot/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_get_log_var_expand_table May 12 11:01:18 selfip dovecot: imap: Error: dlopen(/usr/lib/dovecot/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_get_log_var_expand_table This errors dissapeared, when i'm recompile libdovecot-sieve.so and link it with libdovecot-lda.so lib. Pigeonhole patch: --- src/lib-sieve/Makefile.am.orig 2010-05-12 12:14:16.000000000 +0400 +++ src/lib-sieve/Makefile.am 2010-05-12 12:14:22.000000000 +0400 @@ -64,8 +64,8 @@ ./plugins/spamvirustest/libsieve_ext_spamvirustest.la \ $(unfinished_plugins) -libdovecot_sieve_la_DEPENDENCIES = $(plugins) -libdovecot_sieve_la_LIBADD = $(plugins) +libdovecot_sieve_la_DEPENDENCIES = $(plugins) $(LIBDOVECOT_LDA_DEPS) +libdovecot_sieve_la_LIBADD = $(plugins) $(LIBDOVECOT_LDA) libdovecot_sieve_la_SOURCES = \ rfc2822.c \ -- Vasiliy G Tolstov <v.tolstov(a)selfip.ru> Selfip.Ru

2 1

[Dovecot] looking for feedbacks on courier to dovecot
by Mihamina Rakotomandimby 12 May '10

12 May '10

Manao ahoana, Hello, Bonjour, We currently run courier POP . We would like to switch to Dovecot. I encounter problems when migrating the UIDL because we have big Maildirs and POP re-downlading the data is not possible for most of the users. I tried the http://www.dovecot.org/tools/courier-dovecot-migrate.pl script but I still have the re-downloading event. What are your stories and advices about courier-to-dovecot move? Misaotra, Thanks, Merci. -- Architecte Informatique chez Blueline/Gulfsat: Administration Systeme, Recherche & Developpement +261 34 29 155 34 / +261 33 11 207 36

4 8

Re: [Dovecot] antispam plugin problem
by Danila 11 May '10

11 May '10

With it I have already understood having added the user vmail in mail group, but all the same mutt produces an error "Failed to call dspam" and does not wish to move the letter to a directory a spam. In log now here so: May 11 14:51:50 evil imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 May 11 14:51:50 evil imap: antispam: /usr/local/bin/dspam --source=error --class=spam --signature=4be87a9f953248352114216 --deliver= --user vmail May 11 14:51:50 evil imap: antispam: plugin initialising (1.2-notgit) On 12:31 Tue 11 May , Philipp wrote: > Try to add a --debug to dspam, and if that doesn't produce any > additional output try to start dspam not with init.d (I assume you do?) > but run it manually on the command line as 'sudo dspam --debug > --daemon', that should give you a better idea of what's going on. > To change the gid just add -g \#1010 to sudo. Maybe also try to add > --stdout or leave away the --client in your call to dspam, might make it > easier to pin down the error. > I'm also experiencing quite a bit of trouble with dspam, memory leaks > and stuff but I haven't been able to get in contact with their mailing > list (the address I found was deemed non-existent..) > > > Danila a ?crit : > > Nothing happens > > #> su vmail -c "/usr/local/bin/dspam --source=error --class=spam > --signature=4be87a9f953248352114216 --client --user vmail" > > #> > > > > On 10:05 Tue 11 May , Steffen Kaiser wrote: > > On Tue, 11 May 2010, Danila wrote: > > > > >>> On 01:18 Tue 11 May , Trever L. Adams wrote: > > >>>> On 05/11/2010 12:02 AM, Danila wrote: > > >>>>> May 11 10:54:09 evil imap: antispam: mail copy: src spam: 0, dst > > spam: 1, src unsure: 0 > > >>>>> May 11 10:54:09 evil imap: antispam: /usr/local/bin/dspam > > --source=error --class=spam --signature=4be87a9f953248352114216 > > --client --user vmail > > >>>>> May 11 10:54:09 evil imap: antispam: executing > > /usr/local/bin/dspam failed: 13 (uid=1009, gid=1010) > > >>>>> > > >>>>> uid=1009, gid=1010 is vmail user > > What happens, if you run the command from the shell as user vmail? E.g.: > > > > sudo -u \#1009 /usr/local/bin/dspam --source=error --class=spam \ > > --signature=4be87a9f953248352114216 --client --user vmail > > > > Hmm, I don't know if you can also assign the gid... > > > > Regards, > > > >> > >

4 4

[Dovecot] Help with acl_shared_dict
by Marcio Merlone 11 May '10

11 May '10

Hi all, I am trying to set up shared folders with dovecot 1.2.10-0xk1 on a ubuntu 8.04 server and so far so good. I managed to share a folder using GOSa GUI, but I cannot list it on Thunderbird yet, because of acl_shared_dict param (I guess). I tried BDB as per the wiki: plugin { acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes.db } I gave shared-mailboxes.db 0666 perms but it keeps resetting permissions to 0600, which gives me "open(/var/lib/dovecot/shared-mailboxes.db) failed: Permission denied" errors. So I went to try sql dict, but could not find where to put sql server connection details like user, host, password. dovecot -n (with sql dict): # 1.2.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.24-27-server i686 Ubuntu 8.04.4 LTS log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve ssl_cert_file: /etc/ssl/certs/dovecot.pem ssl_key_file: /etc/ssl/private/dovecot.pem disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_privileged_group: mail mail_location: maildir:~/Maildir mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): quota imap_quota acl imap_acl mail_plugins(imap): quota imap_quota acl imap_acl mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: shared separator: / prefix: shared/%%u/ location: maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u list: children lda: postmaster_address: postmaster(a)a1.ind.br hostname: a1.ind.br mail_plugins: quota sieve acl auth default: mechanisms: plain login passdb: driver: pam args: session=yes blocking=yes dovecot userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/dovecot mode: 436 user: postfix group: postfix plugin: quota: maildir:storage=10485760 acl: vfile acl_anyone: allow acl_shared_dict: proxy::acl dict: acl: mysql:/etc/dovecot-dict-sql.conf (/etc/dovecot-dict-sql.conf is a copy from the wiki) Have I missed something? Thanks and best regards. -- Marcio Merlone

1 1

[Dovecot] Best location for indexes?
by Brandon Lamb 11 May '10

11 May '10

I cant seem to find anything via a google search, so if this has been answered I apologize. I am wondering if INDEX=MEMORY is going to give the best performance versus files? I have a server with directly attached storage, 8 gigs of ram, about 500 gigs of data. I am ok with losing and having to rebuild the indexes on a reboot as the last uptime was over 200 days

3 3

[Dovecot] Client cant see emails
by Romer Ventura 11 May '10

11 May '10

Hello, Last Saturday i scp the vmail folder from server1 running SLES to server2 running Debian. Everything went ok and only have a few small problems, but the one to bring up is that some users cant see their new emails. The server receives the emails and puts them in their folder, but the client cant see them. One user's inbox shows last email was received on Friday, however, the Maildir/cur/ shows: -rw------- 1 vmail vmail 42K 2010-05-10 08:40 1273498807.M796425P7283.housigma22,S=42341,W=43018:2, -rw------- 1 vmail vmail 324K 2010-05-10 09:13 1273500815.M763640P10054.housigma22,S=331257,W=335660:2, -rw------- 1 vmail vmail 20K 2010-05-10 09:34 1273502066.M777253P11943.housigma22,S=19857,W=20357:2, -rw------- 1 vmail vmail 8.9K 2010-05-10 09:44 1273502685.M898747P12796.housigma22,S=9035,W=9324:2, -rw------- 1 vmail vmail 7.3K 2010-05-10 09:46 1273502798.M419897P12975.housigma22,S=7386,W=7659:2, -rw------- 1 vmail vmail 9.1K 2010-05-10 09:48 1273502934.M480959P13148.housigma22,S=9228,W=9521:2, -rw------- 1 vmail vmail 74K 2010-05-10 10:02 1273503774.M524188P14327.housigma22,S=75769,W=78183:2, -rw------- 1 vmail vmail 8.6K 2010-05-10 10:08 1273504123.M573796P14820.housigma22,S=8790,W=9032:2, -rw------- 1 vmail vmail 158K 2010-05-10 10:21 1273504907.M531961P15897.housigma22,S=161359,W=166243:2, -rw------- 1 vmail vmail 59K 2010-05-10 10:22 1273504953.M794482P15971.housigma22,S=59529,W=60838:2, -rw------- 1 vmail vmail 301K 2010-05-10 11:03 1273507382.M33967P19462.housigma22,S=307286,W=311302:2, -rw------- 1 vmail vmail 306K 2010-05-10 11:03 1273507387.M136374P19464.housigma22,S=313035,W=317125:2, -rw------- 1 vmail vmail 5.4K 2010-05-10 11:08 1273507736.M805483P19953.housigma22,S=5432,W=5539:2, -rw------- 1 vmail vmail 6.6K 2010-05-10 11:10 1273507842.M113988P20125.housigma22,S=6718,W=6921:2, -rw------- 1 vmail vmail 3.3K 2010-05-10 11:20 1273508415.M94558P20879.housigma22,S=3308,W=3419:2, Any ideas...? # 1.2.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.29-xs5.5.0.15 i686 Debian 5.0.4 ext3 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps imap ssl_cert_file: /etc/ssl/certs/smtpd.crt ssl_key_file: /etc/ssl/private/smtpd.key login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_user: postfix mail_privileged_group: mail mail_uid: vmail mail_gid: vmail mail_location: maildir:/srv/mail/vmail/%Ud/%Ln/Maildir mbox_write_locks: fcntl dotlock imap_client_workarounds: delay-newmail outlook-idle netscape-eoh lda: postmaster_address: postmaster(a)somedomain.com auth_socket_path: /var/run/dovecot/auth-master log_path: /var/log/dovecot-deliver.log info_log_path: /var/log/dovecot-deliver-info.log auth default: mechanisms: plain login passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen client: path: /var/spool/postfix/private/auth-client mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail Thanks ------ Romer Ventura

2 1

[Dovecot] Reading emails, vmail user mail access problems.
by David Haggard 11 May '10

11 May '10

Hello, I have a new installation of Ubuntu 10.04 64bit and all packages are from the Ubuntu repos. dovecot version 1.2.9 My goal is to have a basic email server setup with imap and pop support so imap users can send and receive email for the company. Setup: I have a few users that will be using this mail server so I do not need anything advanced and I am ok with creating a user account with a password and managing email addresses manually. I currently have system accounts for a test user and I have setup virtual mailbox as this mail server will host 2+ domains. Postfix is installed and running, I also confirmed mail flow to this box and from this box is working to the test user created. I can log in with the test username of the system and this is the point at which I have some issues as I am having a permission problem which I think is related to dovecot. What I am not able to do is download emails via imap client, but I can send emails just fine. If I change the permissions of the virtual mailbox to the test user that is logged in to chmod 777 I can download emails, but I can't do this for each new email to that users mailbox. /var/vmail/DOMAIN/USER1/cur/ and anything listed here will be owned by vmail so no other user can read it. (can't download emails) as dovecot seems to be trying to use USER1 as a user to read the files. How can I have dovecot read emails as vmail no matter what user logs in? I have tried many config changes using vmail but its failed so I need some advise. Here is my config: I edited the DOMAIN to hide the real domain used. # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-21-server x86_64 Ubuntu 10.04 LTS ext4 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_location: maildir:/var/vmail/DOMAIN/%n/ mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 auth default: passdb: driver: pam userdb: driver: passwd userdb: driver: static args: uid=vmail gid=vmail home=/var/vmail/DOMAIN/%n/ Thank you

2 1

[Dovecot] wrong config file?
by Phil Howard 10 May '10

10 May '10

The sample provided config file (the one I started with by editing it) included the following text: # ------------------------------ WARNING ------------------------------- > > # If there's a file /etc/dovecot/dovecot-postfix.conf, which is part of > # dovecot-postfix package, it will be used instead of dovecot.conf. > > # Keep in mind that, if that file exist, none of the changes in > # /etc/dovecot/dovecot.conf will have effect on dovecot's configuration. > # In that case you should customize /etc/dovecot/dovecot-postfix.conf. > > # ------------------------------ WARNING ------------------------------- > So I expected it would use that by default. It seems to not be doing so. Does this mean I have to modify the startup scripts to add the -c option to force the use of this config file? Or should I just put all my configs in the default "/etc/dovecot/dovecot.conf" file? When doing "dovecot -n" it became apparent that my configs were not being used. But "dovecot -c /etc/dovecot/dovecot-postfix.conf -n" was doing it. Any idea why it's not behaving as those comments described?

2 7

[Dovecot] configuration user= or auth_user=
by Phil Howard 10 May '10

10 May '10

The sample config file has: # User to use for the process. This user needs access to only user and # password databases, nothing else. Only shadow and pam authentication # requires roots, so use something else if possible. Note that passwd # authentication with BSDs internally accesses shadow files, which also # requires roots. Note that this user is NOT used to access mails. # That user is specified by userdb above. user = root # Directory where to chroot the process. Most authentication backends don't # work if this is set, and there's no point chrooting if auth_user is root. # Note that valid_chroot_dirs isn't needed to use this setting. #chroot = So is the variable for the authentication process user supposed to be "user" or "auth_user"? It would make more sense to be "auth_user". Is it just "user" for legacy reasons, and the reference to "auth_user" is in error? Or can either name be used? Also, those of you who change this, do you change it to something existing like "dovecot" or "vmail" or "nobody" or do you make a whole new user for it?

1 0

[Dovecot] lmtp_generic_maps with postfix
by derwyn 10 May '10

10 May '10

Hi All, I am new to dovecot so this may be a very easy thing to do. I need to setup a postfix+dovecot server for a multilocation setup The rules are very simple mails to *(a)local.example.com send to dovecot mails to *(a)otherlocation.example.com send to smtp:[otherlocation] But the users are created on dovecot as user(a)example.com. How can I configure dovecot to accept mails for *(a)local.example.com and deliver to *(a)example.com I use lmtp_generic_maps for a similar thing in postfix+cyrus Thanks Derwyn.

1 0

[Dovecot] problems implementing dovecot LDA with Postfix
by Stan Hoeppner 09 May '10

09 May '10

Per the instructions here http://wiki.dovecot.org/LDA and here http://wiki.dovecot.org/LDA/Postfix I set postmaster_address = postmaster(a)hardwarefreak.com in /etc/dovecot/dovecot.conf and mailbox_command = /usr/lib/dovecot/deliver in /etc/postfix/main.cf When I restart dovecot I get this: [07:17:00][root@greer]/etc/dovecot$ /etc/init.d/dovecot restart Restarting IMAP/POP3 mail server: dovecotError: Error in configuration file /etc/dovecot/dovecot.conf line 754: Unknown setting: postmaster_address Fatal: Invalid configuration in /etc/dovecot/dovecot.conf failed! And after restarting Postfix and sending a test message from a gmail account I get this in the mail log: May 9 07:26:09 greer postfix/qmgr[13384]: AEE976C32C: from=<snugmonster(a)gmail.com>, size=1628, nrcpt=1 (queue active) May 9 07:26:09 greer dovecot: deliver(stan): Fatal: postmaster_address setting not given May 9 07:26:09 greer postfix/local[13392]: AEE976C32C: to=<stan(a)hardwarefreak.com>, relay=local, delay=1.4, delays=1.3/0.03/0/0.04, dsn=4.3.0, status=deferred (temporary failure) The server is Debian Lenny 5.0.4 with Postfix 2.5.5 and Dovecot 1.2.11 from Lenny backports. Any ideas? Everything I've found via Google relating to this Dovecot startup error has to do with people converting old dovecot.conf files to a new dovecot version. -- Stan

3 4

[Dovecot] CRYPT scheme and 8 character limit
by Phil Howard 09 May '10

09 May '10

I've decided that having users supply cleartext passwords for me to encrypt and encode is a bad idea, anyway. So maybe I won't need dovecotpw. The idea is that users supply an already-encrypted password. Most of the users can fetch their login password from /etc/shadow on their own computer. Wiki page http://wiki.dovecot.org/Authentication/PasswordSchemes indicates that scheme name CRYPT is the one that uses the libc crypt() function. But it also says it uses no more than 8 characters. Then there is MD5-CRYPT. But that doesn't call crypt(), I presume. No limit on password size is indicated. But this at least looks like SOME of the encrypted passwords I have. Other passwords I have have ids indicating SHA-256 and SHA-512. Here is an example from /etc/shadow that encrypted the clear password "dovecotandpostfix" (in case it is necessary to test it): $6$IwZzpjjj$p1VrkxQmgmTED8iQnQrV3sVEZpBmw2N8oD1ykOguXB5tf8aahICesX0TF6.VMThIW2QFs1buHjT3eDtnaAFhF1 The big question is, what scheme name should I use for these passwords? I can, of course, consider the id (6 in the above example, suggesting SHA-512) if there is one (so far all are like this). But the other consideration is most of the passwords are longer than 8, some longer than 12, characters. So apparently CRYPT can't be used in those cases (so I can't have the automatic identification of crypt() to detect the scheme). What scheme would I use for the various passwords? What scheme would be used for the above example for starters? What if the id is 5 or 1 (the ones documented for the crypt() call)?

3 4

[Dovecot] looking for feedbacks on courier to dovecot
by Mihamina Rakotomandimby 08 May '10

08 May '10

Manao ahoana, Hello, Bonjour, We currently run courier POP . We would like to switch to Dovecot. I encounter problems when migrating the UIDL because we have big Maildirs and POP re-downlading the data is not possible for most of the users. I tried the http://www.dovecot.org/tools/courier-dovecot-migrate.pl script but I still have the re-downloading event. What are your stories and advices about courier-to-dovecot move? Misaotra, Thanks, Merci. -- Architecte Informatique chez Blueline/Gulfsat: Administration Systeme, Recherche & Developpement +261 34 29 155 34 / +261 33 11 207 36

1 1

[Dovecot] v2.0.beta4: Couldn't drop privileges: Unknown mail_privileged_group
by Thomas Leuxner 08 May '10

08 May '10

Hi, latest HG throws this error: May 8 06:42:33 spectre dovecot: master: Dovecot v2.0.beta4 (0a35407e6ff4) starting up May 8 06:48:01 spectre dovecot: imap(alias(a)domain.tld): Error: user alias(a)domain.tld: Couldn't drop privileges: Unknown mail_privileged_group: 5000 May 8 06:48:01 spectre dovecot: imap(alias(a)domain.tld): Error: Internal error occurred. Refer to server log for more information. Regards Thomas

1 0

[Dovecot] Questions, Issues with 2.0
by Kelsey Cummings 08 May '10

08 May '10

I'm trying to use an external program to set the location of user's maildirs to match an existing hashing schema but the docs for how to do this in 1.x do not seem to apply to 2.0 or I'm misinterpreting them. protocol imap { mail_executable = /opt/dovecot-test/sonic-imap ... This correctly executes the and attempts to sets the MAIL variable but it appears that mail_executable is run before the user is logged in so the $USER variable isn't set and the process' uid is still 0. We also need to have dovecot include an additional maildir for each user that is currently stored outside of the user's main maildir directory into the same namespace as a specific folder name. Is there a way to do this in dovecot directly or will it need to be hacked (as it is currently with courier) or could it be done with a plugin? I've also noticed that while doveconf complains about mail_executable: May 3 13:44:10 a dovecot: config: Obsolete setting in /opt/dovecot-test/etc/dovecot/conf.d/imap.conf:7: mail_executable has been replaced by service { executable } However, when replaced as suggested by doveconf: protocol_imap { executable = /opt/dovecot-test/sonic-imap ... It fails altogether: doveconf: Fatal: Error in configuration file /opt/dovecot-test/etc/dovecot/conf.d/imap.conf line 7: Unknown setting: executable Similarly, it also suggests 'drop_priv_before_exec = no' which doesn't appear to be valid either. -- Kelsey Cummings - kgc(a)corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407

2 4

[Dovecot] Dovecot version mismatch - after restart
by edeis 07 May '10

07 May '10

Getting the followng error when managesieve is enabled. Any other post I've read says this problem is because the service hasn't restarted after upgrade. I've restarted dovecot & postfix many times, reboot machine too. Still get the error. Racking my brains on this!! May 7 13:21:19 drizzle dovecot: dovecot: Created login processes successfully, unstalling May 7 13:21:20 drizzle dovecot: managesieve-login: Fatal: Dovecot version mismatch: Master is v1.2.11, login is v1.2.10 (if you don't care, set version_ignore=yes) May 7 13:21:20 drizzle dovecot: dovecot: Temporary failure in creating login processes, slowing down for now May 7 13:21:20 drizzle dovecot: managesieve-login: Fatal: Dovecot version mismatch: Master is v1.2.11, login is v1.2.10 (if you don't care, set version_ignore=yes) Running CentOS5.4. Installed Packages from atrpms dovecot.x86_64 1:1.2.11-3_108.el5 installed dovecot-managesieve.x86_64 0.11.11-0_4.el5 installed dovecot-sieve.x86_64 1:0.1.15-4.el5 installed Here's my dovecot settings: [root@drizzle /]# dovecot -n # 1.2.11: /etc/dovecot.conf # OS: Linux 2.6.18-164.15.1.el5.028stab068.9 x86_64 CentOS release 5.4 (Final) protocols: imap imaps pop3 pop3s managesieve ssl_cert_file: /etc/ssl/certs/mydomain.com.crt ssl_key_file: /etc/ssl/certs/mydomain.com.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login mail_privileged_group: mail mail_location: maildir:%h mail_debug: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 mail_plugin_dir(managesieve): /usr/lib64/dovecot/managesieve namespace: type: private prefix: INBOX. inbox: yes list: yes subscriptions: yes lda: postmaster_address: me(a)mydomain.com auth default: mechanisms: plain login passdb: driver: checkpassword args: /var/www/ispcp/engine/ispcp-dovecot-mngr userdb: driver: sql args: /etc/dovecot/dovecot-sql-domain.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql-aliasdomain.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql-subdomain.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: mail plugin: sieve: /etc/dovecot/sieve/dovecot.sieve [root@drizzle /]# -- View this message in context: http://old.nabble.com/Dovecot-version-mismatch---after-restart-tp28491245p2… Sent from the Dovecot mailing list archive at Nabble.com.

1 0

[Dovecot] Requiring STARTTLS only on some networks
by Thomas Hummel 07 May '10

07 May '10

Hello Timo, is there a way, either in 1.2.x or in 2.x to activate disable_plaintext_auth=yes only for some address or network ? The idea would be to enable clients from the internal networks to keep making clear text connections while forbidding it to the rest of the world. Thanks. -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

3 6

[Dovecot] Tracing sieve execution
by Jerry 07 May '10

07 May '10

I have just recently begun learning how to use sieve. For the most part, it works fine. The problem is that I have created some rather complicated rules. Occasionally, an e-mail will get sorted incorrectly and I am not able to easily determine what rule caused it to occur. Is there any way or utility that I could use to actually see what rule or line in the sieve file caused the action? -- Jerry Dovecot.user(a)seibercom.net Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ I hate it when my foot falls asleep during the day cause that means it's going to be up all night. Steven Wright

2 1

[Dovecot] dovecotpw documentation
by Phil Howard 07 May '10

07 May '10

Where can I find documentation on how to use the "dovecotpw" program that I was referred to? No man page. No wiki. Very little from "dovecotpw -h". What I need to do is generate the "passwd-file" contents with an MD5 scheme (the one equivalent to /etc/shadow is preferred).

1 0

[Dovecot] Iphone and Dovecot - 2-way sync
by Lucio Godoy 07 May '10

07 May '10

Hi All; Does the Iphone and Dovecot works well? Do you get full IMAP sync with IPHONE <=> DOVECOT <=> Outlook, pls? thanks Lucio =========================================================== The Home CCTV Security System made easy! http://www.kaduco.com/our-list-products-services/cctv-security-camera-syste… _________________________________________________________________ http://clk.atdmt.com/UKM/go/197222280/direct/01/ We want to hear all your funny, exciting and crazy Hotmail stories. Tell us now

5 9

[Dovecot] ACLs and public folders
by hyperbatus＠gmx.de 07 May '10

07 May '10

Dear list, I am using dovecot 1.0.15 on Debian Lenny. I have a public folder, I use ACL / vfile (without public ACL), and I use maildir / vmail. Now I have two questions: 1) http://wiki.dovecot.org/ACL states: "Mailboxes in public namespaces don't have owners, so by default no-one can access them." The same document, when explaining the meaning of the k flag in the ACLs, states: "Mailboxes can be created (or renamed) under this mailbox (there is no recursion, so creating a mailbox under this mailbox's child uses only the child's ACLs)" I have placed an ACL (dovecot-ACL) at the root of the public namespace (all rights to anyone). The public namespace was appearing correctly in my IMAP client. Then I have copied a large folder with hundreds of nested subfolders (nesting level > 3) from another account to the root of the public namespace. According to the documentation mentioned above, this should not have been possible (if I got the docs right): The first nesting level of folder should have been created, but not the messages in them and for sure not the deeper nested folders. There is no dovecot-acl within a single of the first level folders (I have verified this), so no one should have access to them. Nevertheless, in addition to the succesful copy, I can see every folder and every message in my IMAP client, I can delete and so on. Could some please explain if I got the docs wrong? 2) If there really is no ACL recursion, how are we supposed to copy large folder structures (perhaps thousands of folders, nested to 5 levels deep) to a public namespace? Do we need to create all folders by hand, then place the dovecot-acl in each folder, and then copy the messages to each folder by hand? Do we need to switch to global ACLs so that we can establish a master user for doing the act of filling the public space? Or is there a dovecot module which, immediately after creating a folder, looks into the parent folder of the new folder and copies the dovecot-acl from the parent folder to the new folder? Currently, I am very happy that dovecot didn't what it should do according to my understanding of the documentation (since I really needed to copy this folder structure to the public namespace), but on the other hand, I am a bit puzzled now not knowing if the documentation is wrong, my understanding of it is wrong or the source code is wrong :-) Thanks you very much for any help, Peter Here is the output of dovecot -n: # 1.0.15: /etc/dovecot/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot-info.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps listen: 192.168.20.23 ssl_cert_file: /etc/dovecot/imap-ssl.home.omeganet.de.crt ssl_key_file: /etc/dovecot/imap-ssl.home.omeganet.de.key ssl_parameters_regenerate: 24 ssl_cipher_list: ALL:!LOW login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_processes_count: 1 login_max_processes_count: 32 max_mail_processes: 32 mail_privileged_group: mail mail_location: maildir:~/Maildir mail_cache_fields: mail_never_cache_fields: mail_plugins: acl namespace: type: private inbox: yes namespace: type: public prefix: Archive. location: maildir:/home/vmail/archive:INDEX=~/Maildir/archive auth default: cache_size: 1 cache_ttl: 600 worker_max_count: 4 passdb: driver: passwd-file args: /etc/dovecot/passdb userdb: driver: static args: uid=vmail gid=vmail home=/home/vmail/%u socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: root plugin: acl: vfile -- GMX DSL: Internet, Telefon und Entertainment für nur 19,99 EUR/mtl.! http://portal.gmx.net/de/go/dsl02

2 2

[Dovecot] during change sql password on squirrelmail
by Yavuz Maşlak 07 May '10

07 May '10

Hello I use squirrelmail1.4.20, compatible2, change_sql plugin, dovecot, postfix, mysql,virtualuser. I can change my email password successfully on squirrelmail. When I change my password the squirrelmail throw me a page which contains an error as followings; "This page request could not be verified and appears to have expired." how can I correct this issue?

2 1

[Dovecot] log_path and info_log_path - ownership of parent directory
by Phil Howard 07 May '10

07 May '10

The Ubuntu package didn't create the directory for these. What ownership/permissions are needed for it? Does it need to be owned by the dovecot user?

2 1

[Dovecot] disable plaintext auth ... only for some addresses
by Phil Howard 06 May '10

06 May '10

I'd like to disable plaintext authentication (e.g. only allow authentication that does STARTTLS or connects on SSL/TLS only ports) only for certain (most) IP addresses. I want to exempt a few addresses (users coming over known VPNs). Fortunately, all this is coming in over a firewall (Sonicwall) in which I can NAT traffic by IP address to go to specific port numbers. So, if I can establish a different disable_plaintext_auth policy by port number (for extra port numbers I'll choose later), that would let me accomplish this. If I cannot do this, then my only alternative is making the SSL/TLS only ports the only ones open to the internet, and use the non-SSL/TLS ports only for the VPNs (with disable_plaintext_auth = no). But I read somewhere that this is discouraged. What say ye?

1 0

[Dovecot] adding users to passwd-file
by Phil Howard 06 May '10

06 May '10

Is there a tool equivalent to the system "passwd" command (or maybe "adduser" or "useradd") that can support a passwd-file by setting a password, encrypting it with the salted MD5 scheme? The system "passwd" command doesn't have an option to "do it to this alternate file instead of /etc/shadow".

4 5

[Dovecot] dovecot and pigeonhole
by Vasiliy G Tolstov 06 May '10

06 May '10

Hello. Today i'm compile dovecot and pigeonhole from hg repo. After start dovecot i get errors in log like this: May 6 12:04:15 selfip dovecot: imap: Error: dlopen(/usr/lib/dovecot/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_get_log_var_expand_table Google sasys, that this functions added in dovecto 2010-04-26, why a get this error when load sieve plugin? Thnak You. -- Vasiliy G Tolstov <v.tolstov(a)selfip.ru> Selfip.Ru

2 2

[Dovecot] !include
by Andre Hübner 06 May '10

06 May '10

dovecot 1.2.11 Hello, i do some tests with: !include /etc/dovecot/conf.d/*.conf dovecot fails to start if /etc/dovecot/conf.d/ is empty. Is this a expected behaviour? !include_try works without error but seems to me to be more usual when explicit, complete filename is given. is a little bit strange in contrast to behaviour of other servertypes which support a include-directive. Thanks, Andre

1 0

Re: [Dovecot] Dovecot Won't start on SLITAZ Linux
by Ludovic LEMARINEL 06 May '10

06 May '10

2010/5/6 Ludovic LEMARINEL <l.lemarinel(a)gmail.com> > 2010/5/6 Tom Hendrikx <tom(a)whyscream.net> > > On 06/05/10 13:40, Ludovic LEMARINEL wrote: >> > 2010/5/6 Charles Marcus <CMarcus(a)media-brokers.com> >> > >> >> On 2010-05-06 4:51 AM, Ludovic LEMARINEL wrote: >> >>> I've just compiled dovecot under Slitaz, but I can't get it to >> >>> run... >> >>> >> >>> It always die with this message in log : >> >>> >> >>> 2010-05-06 12:35:12 dovecot: Info: Dovecot v1.2.11 starting up >> >>> 2010-05-06 12:35:12 dovecot: Fatal: setrlimit(RLIMIT_DATA, 256): >> >>> Operation not permitted >> >> >> >> Google is your friend. Simply highlighting the above error: >> >> >> >> Fatal: setrlimit(RLIMIT_DATA, 256): Operation not permitted >> >> >> >> Provides the answer: >> >> >> >> http://tinyurl.com/25rmjod >> >> >> >> > >> > Thanks for your answer, but no, this page does not provide the answer. >> > The error message this guy gets is not the same as me >> >> Your original post says it does. If you receive another error message, >> please add it to your problem report. Also, please try to start dovecot >> from the commandline (as suggested in the url from Charles), and tell us >> about its behaviour, output and logging. >> >> > , and I don't have any >> > "/etc/security/limits.conf" file, so I can't change this setting . >> >> Dovecot tells you only what setting to to adjust. Where you put your >> settings is largely dependant on your OS or distro implementation. >> >> >> Ow, and please do not top-post. >> >> Regards, >> Tom >> > > > I've tried to run dovecot from the command line : it says what was the last > error (see my first post), and then nothing more. > When I do "ps", I can't see any process running, and the log says dovecot > finished... > > No more message than this :( > I'm going to try with 2.0 beta, and if no luck, I'll try to go down to 1.1. > Some news from my problem : I've tried 2.0 beta, 1.1, and both didn't worked. I went down to v1.0.15, and it works... Still haven't found what's wrong with newer versions...

1 0

[Dovecot] 2.0 beta4 (5d76f5b13883): Home directory not recognized
by Thomas Leuxner 06 May '10

06 May '10

Hi, latest Mercurial seems to have problems with the Config Module unloads: May 5 19:18:16 spectre dovecot: master: Dovecot v2.0.beta4 (5d76f5b13883) starting up May 5 19:18:34 spectre dovecot: managesieve: Error: fd_read() partial input (54/88) May 5 19:18:34 spectre dovecot: imap-login: Fatal: Error reading configuration: read(/var/run/dovecot/config) failed: EOF May 5 19:18:34 spectre dovecot: master: Error: service(imap-login): command startup failed, throttling Restarting IMAP/POP3 mail server: dovecotError: user root: Initialization failed: userdb didn't return a home directory, but plugin setting quota used it (%h): dict:user::file:%h/mdbox/dovecot-quota Fatal: Invalid user settings. Refer to server log for more information. $ tail /etc/dovecot/conf.d/90-plugin.conf quota = dict:user::file:%h/mdbox/dovecot-quota quota_rule = *:storage=1GB quota_rule2 = Trash:storage=10%% acl = vfile:/var/vmail/conf.d/%d/acls:cache_secs=300 } Regards Thomas

2 2

[Dovecot] migrating maildir from 1.1.7 to 1.2.11
by Romer Ventura 05 May '10

05 May '10

Hello, I have a SLES server running dovecot 1.1.7 and postfix which happens to be the production server. We are dumping all of the paid OSes so i have configured a Debian Lenny server to run the new mail server. The debian server has everything installed and it seems to be working fine. However, i need to get all the mailboxes from the SLES server, will there be any problem if i just copy the "vmail" folder to the new server...? Thanks ------ Romer Ventura

2 1

[Dovecot] Expire plugin
by Thomas M Goerger 05 May '10

05 May '10

Hi, I'm testing out the dovecot expire plugin, and not seeing anything go into the database I've got set up. It's a mysql db. I've gone in and verified that the db is set up correctly. The socket is set up so that deliver should be able to talk to the db, but I'm not seeing anything in the expires table when I look. Is there anywhere that expire can log to so I can see what might be happening? It doesn't look like it logs to the dovecot log. Thanks! ************************************************************************* * Tom Goerger - Email/Unix System Administrator * * * * University of Minnesota Email: tmg(a)umn.edu * * Operations, Infrastructure and Architecture Phone: 4-5804 * * Internet Services Office: 626J WBOB * * * *************************************************************************

2 6

[Dovecot] Plugin to handle message saved and handle move from tmp to cur/new
by Alex Baule 05 May '10

05 May '10

Hello everyone.... I need to finish my plugin, but i depends from some stuffs in the save/move process that i can't find how its work. In new zlib plugin (2.0) , the message is saved compressed now, but i dont find how is done the process to write the file to tmp, and move it to the cur or new directory (inside .Sent). I need to hook this function, to get access to some variables, like Flags and filename. There is a way to do this ? Tks.

1 0

[Dovecot] [Bug] Case sensitive usernames and variables
by Неворотин Вадим 05 May '10

05 May '10

Today I've found a very irritating bug: I use mail_location = maildir:/var/mail/%u/ in my dovecot.conf. And if user type Username, username, USERname etc at login dovecot create a different Maildir's for one real user. But LDA works corretly and save all messages to lowercase username mailbox. No problem, add L: mail_location = maildir:/var/mail/%Lu/ Then all works good. But I has also such namespace configuration: namespace shared { separator = / prefix = &BCAEMARBBEEESwQ7BDoEOA-/%%u/ location = maildir:/var/mail/%%u:INDEX=/var/mail/%u/shared/%%u subscriptions = no list = children } And here I can't replace %u with %Lu, because dovecot write to dovecot.log: IMAP(malamut): Error: Namespace '&BCAEMARBBEEESwQ7BDoEOA-/%Lu/': shared: Shared namespace prefix contains unknown variables So user has only one mailbox (with lovercase name), but a lot of different indexes for shared mailboxes, eg /var/mail/username/shared, /var/mail/USERname/shared etc. How can I tune dovecot to use always lowercase username? Dovecot 1.2.10

2 2

[Dovecot] 2.0 FTBFS since sqlpool changes when --with-sql=plugin is used
by Michal Hlavinka 05 May '10

05 May '10

Hi, yesterday lib-sql got driver-sqlpool with some changes in Makefile.am, but these changes in makefile works only for --with-sql=yes. When --with-sql=plugin is used build fails with: libtool --tag=CC --mode=link gcc -std=gnu99 -O2 -g -pipe -Wall -Wp,- D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 - m64 -mtune=generic -Wall -W -Wmissing-prototypes -Wmissing-declarations - Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict- aliasing=2 -o checkpassword-reply checkpassword-reply.o ../../src/lib- dovecot/libdovecot.la -lrt libtool: link: gcc -std=gnu99 -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 - fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic - Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -o .libs/auth auth.o auth-cache.o auth-client-connection.o auth-master-connection.o mech- otp-skey-common.o mech-plain-common.o auth-penalty.o auth-request.o auth- request-handler.o auth-settings.o auth-stream.o auth-worker-client.o auth- worker-server.o db-checkpassword.o db-sql.o db-passwd-file.o main.o mech.o mech-anonymous.o mech-plain.o mech-login.o mech-cram-md5.o mech-digest-md5.o mech-external.o mech-gssapi.o mech-ntlm.o mech-otp.o mech-skey.o mech-rpa.o mech-apop.o mech-winbind.o passdb.o passdb-blocking.o passdb-bsdauth.o passdb- cache.o passdb-checkpassword.o passdb-passwd.o passdb-passwd-file.o passdb- pam.o passdb-shadow.o passdb-sia.o passdb-vpopmail.o passdb-sql.o userdb.o userdb-blocking.o userdb-checkpassword.o userdb-nss.o userdb-passwd.o userdb- passwd-file.o userdb-prefetch.o userdb-static.o userdb-vpopmail.o userdb-sql.o db-ldap.o passdb-ldap.o userdb-ldap.o -Wl,--export-dynamic libpassword.a ../lib-ntlm/libntlm.a ../lib-otp/libotp.a ../../src/lib-sql/.libs/libsql.a ../../src/lib-dovecot/.libs/libdovecot.so -lcrypt -lpam -ldl -lrt -Wl,-rpath - Wl,/usr/lib64/dovecot libtool: link: gcc -std=gnu99 -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 - fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic - Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -o .libs/checkpassword-reply checkpassword-reply.o ../../src/lib- dovecot/.libs/libdovecot.so -ldl -lrt -Wl,-rpath -Wl,/usr/lib64/dovecot ../../src/lib-sql/.libs/libsql.a(sql-api.o): In function `sql_init': /home/mhlavink/cvsf/dovecot/devel/dovecot-2.0.beta4/src/lib-sql/sql-api.c:70: undefined reference to `driver_sqlpool_init' Regards, Michal Hlavinka

1 1

[Dovecot] Access filesystem (NFS) as some user
by Mihamina Rakotomandimby 05 May '10

05 May '10

Manao ahoana, Hello, Bonjour, My Dovecot server has to access the users Maildirs. Maildirs are on a NFS mount that only a user (vmail/500) may read and write. No one else. How to configure Dovecot so that at least disk read-write are performed as a "vmail" user (that I have created with the right attributes)? Is the workaround of changing dovecot's system UID/GID a not-so-bad one? (I am trying to see if it works, at least...) Misaotra, Thanks, Merci. -- Architecte Informatique chez Blueline/Gulfsat: Administration Systeme, Recherche & Developpement +261 34 29 155 34 / +261 33 11 207 36

2 3

Re: [Dovecot] Dovecot deliver LDA problem
by Noel Butler 05 May '10

05 May '10

bugger sent that direct, please send that output to the list :) On Wed, 2010-05-05 at 09:04 +1000, Noel Butler wrote: > Alex, > > Please show the output of dovecot -n > > > On Tue, 2010-05-04 at 15:23 -0700, Alex wrote: > > > Thanks for the hint. > > > > I enabled 'socket listen' it in dovecot.conf as you pointed it out. > > > > Now dovecot.err log has these error messages: > > > > May 04 14:57:19 deliver(user1(a)some_domain.com): Error: User > > user1(a)some_domain.com is missing UID (set mail_uid) > > May 04 14:57:19 deliver(user2(a)some_domain.com): Error: User > > user2(a)some_domain.com is missing UID (set mail_uid) > > May 04 14:57:25 deliver(user3(a)some_domain.com): Error: User > > user3(a)some_domain.com is missing UID (set mail_uid) > > > > > > I tried to set necessary mail_uid in dovecot-sql.conf in user_query: > > > > user_query = SELECT maildir as mail, 51 as userdb_uid, 51 as > > userdb_gid, > > 51 as mail_uid FROM dovecot_email_maps WHERE email = '%u' > > > >

2 2

[Dovecot] Dovecot deliver LDA problem
by Alex 05 May '10

05 May '10

Hello folks, I was trying to set up Dovecot deliver LDA instead of Postfix default virtual LDA In Postfix main.cf I specified: virtual_transport = dovecot dovecot_destination_recipient_limit = 1 In Postfix master.cf I entered: dovecot unix - n n - - pipe user=mailer flags=DRhu argv=/usr/local/mail/libexec/dovecot/deliver -f ${sender} -d ${recipient} In Dovecot dovecot.conf I have the following entries: passdb sql { args = /etc/dovecot/dovecot-sql.conf } userdb prefetch { } userdb sql { args = /etc/dovecot/dovecot-sql.conf } In Dovecot dovecot-sql.conf I have this: user_query = SELECT maildir as mail FROM dovecot_email_maps WHERE email = '%u' password_query = SELECT user, password, userdb_uid, userdb_gid, userdb_home, userdb_mail FROM dovecot_user_maps WHERE user = '%n' After reloading postfix and restarting dovecot I'm getting this type of warnings in dovecot.err log: May 04 10:43:10 deliver(some_address(a)some_domain.com): Error: userdb lookup: connect(/var/run/dovecot//auth-master) failed: No such file or directory Could somebody please help me to resolve this mistery. What am I missing ether in configuration file or somewhere else? Many thanks in advance, Alex

2 2

[Dovecot] CDB Authentication database
by Luca Corti 04 May '10

04 May '10

Hello, I'd be interested in seeing a CDB based backend for the userdb/passdb lookups. Is anyone working on this? Is there any documentation (other than the wiki Design section and the code itself) on implementing database backends? thanks Luca

5 5

[Dovecot] Dovecot antispam plugin with virtual users
by Philipp 04 May '10

04 May '10

Hi, I'm running dovecot 1.2.11 with the antispam plugin 1.2+20090702-1+b1 installed from the debian repos (squeeze) and dspam 3.9.0+git20100416-1. Unfortunately this doesn't seem to work well with my virtual users, stored on a local openldap server: While sending mail manually to dspam does work, there's some trouble when trying to use the antispam plugin. I tried using both sendmail (exim4 in my case) and configuring antispam_mail_sendmail = /usr/bin/dspam to point to dspam, with similar results: exim: [15042] Failed to get user name for uid 5001 dspam: dspam[18961]: Unable to determine the runtime user both errors are reproducible by running exim/dspam with sudo -u \#5001 with 5001 being the virtual uid used of the user that is logged in through imap. Of course the uid 5001 is invalid for the rest of the system, so it can't run anything, but as far as I can tell the plugin uses this uid to call the respective programs :\ Now I was wondering if it was possible to keep the plugin from using the imap-uid and instead specifying one elsewhere? I guess this would be of fairly great interest for everyone using virtual users, be it ldap or anything else. Or is there a different way to do this? Do I maybe just miss setting a variable somewhere? Philipp

2 1

[Dovecot] dovecot user
by Timo Sirainen 04 May '10

04 May '10

Any thoughts on this: The primary use for "dovecot" user has been for login processes. But people keep misunderstanding this and try to use dovecot for accessing mails. For years I've been wondering about renaming this user to something else like dovelogin, but it never really seemed practical. So now with v2.0 there are a bunch of new processes, and for example anvil and dict are now run as dovecot user by default. But it's not really good that login processes can just go and kill those processes. And even worse, if drop_priv_before_exec=yes they could ptrace these processes. So I think we need two Dovecot users for v2.0: 1. Completely untrusted user for login processes. 2. Slightly more trusted internal Dovecot user. So "dovecot" could be reused for 2. And it would no longer be a mortal sin to use dovecot user for owning mail files. For 1. there would be a new user. I'd use "dovelogin", but apparently tools still don't much like usernames that are longer than 8 characters. Like ps could show numeric uid instead of 9 character long username. So .. any suggestions? "dovlogin" could be one possibility I guess. It would be nice if the name somehow reminded of login processes, but maybe something else could be used too, like: dovenil, dovenull, dovezero, dovenone, dovevoid, doveint, dovedown, dovein, dove0

17 33

[Dovecot] Dovecot SQL user_query
by Alex 04 May '10

04 May '10

Hello folkz, Is it possible to setup in dovecot-sql.conf file to run user_query twice if its first run didn't yield any values. And likewise don't proceed with the second run if the first user_query execution produced the result. I have to query two tables which specify there email messages shall be delivered via Dovecot deliver LDA depending on the incoming email addresses. Please don't question me about this setup. I inherited this mess from the previous Network Admin. First query should be ran like this: user_query = SELECT concat('maildir:/data/mail/',maildir) as mail FROM folders WHERE email = '%u' If the first query doesn't yield any result the second shall be ran like this: user_query = SELECT maildir as home FROM users WHERE email = '%u' Please advise if such user_query setup is possible at all. Thanks in advance, Alex

5 4

[Dovecot] exit codes for 'sievec'
by Jerry 03 May '10

03 May '10

As far as I can tell, 'sievec' always exits with '0' whether there is an error or not. If that is correct, I believe it should be modified to exit with some other code if the conversion and writing of the new file are not completed successfully. I have written a few script files and a 'make' file specifically for sievec. The inability to get an accurate exit code is problematic for me. -- Jerry Dovecot.user(a)seibercom.net Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ Fortune's Fictitious Country Song Title of the Week: "How Can I Miss You if You Won't Go Away?"

2 2

[Dovecot] zlib Plugin Dovecot 2.0 - ostream
by Alex Baule 03 May '10

03 May '10

Hello Everyone... In zlib save mail have it: struct ostream *output; There is a way to get the file descriptor from output used in ostream zlib plugin ? to get in istream is i_stream_get_fd, but don't have o_stream_get_fd......

2 6

[Dovecot] Dovecot Vs Procmail LDA
by Wilberth Pérez 03 May '10

03 May '10

Hi everyone: Anyone knows what are the differences (or advantages and disadvantages) between Dovecot LDA with postfix Vs. Procmail LDA with postfix ? -- -------------------------------------------------------- LCC Wilberth de Jesús Pérez Segura CCSA- Administración de Servicios y Seguridad de las TI Correo: wilberth.perez(a)uady.mx Universidad Autónoma de Yucatán Secretaría General Coordinación Administrativa de Tecnologías de Información RIUADY C-59 x Av. Itzáes (999)923-74-28 Ext. 1117 Mérida, Yucatán, México 2010 --------------------------------------------------------

1 0

[Dovecot] [SUGGESTION] Managesieve: Transparent home dir creation
by Felix Leimbach 03 May '10

03 May '10

Hi all, I'm using dovecot 2.0-beta4's sieve plugin and it works great but here is an idea for improvement: When creating the first sieve script for an account whose home dir does not yet exist then dovecot *does* create that homedir but the sieve client times out. Tried Thunderbird's sieve addon as well as horde's ingo. The log says: dovecot: managesieve-login: Login: user=<me(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured dovecot: managesieve(me(a)example.com): sieve-storage: sieve_storage_verify_dir(/mnt/data/vmail/dovecot-homedirs/example.com/me//s… failed: File exists dovecot: managesieve(me(a)example.com): Fatal: Failed to open Sieve storage. Because the homedir was created (great!) when I retry the same action then all works perfectly well. So why not make that homedir creation transparent so that the clients' first try succeeds instead of the second try? Cheers, Felix

3 3

[Dovecot] Migrating domain with diferent default_pass_scheme
by emiliojoel 03 May '10

03 May '10

Hi I have now my main mail server using dovecot with diferents domains and for user auth using mysql with default_pass_scheme = PLAIN, Now I am migrating a new domain from other server with dovecot using mysql with default_pass_scheme = MD5. My question is: Is possible have a different default_pass_scheme depending of the domain? could I use dovecot with domains using mysql auth with default_pass_scheme = PLAIN and other with default_pass_scheme = MD5? any sugestion? thanks Emilio -- View this message in context: http://old.nabble.com/Migrating-domain-with-diferent-default_pass_scheme-tp… Sent from the Dovecot mailing list archive at Nabble.com.

2 1

[Dovecot] dovecot server down, dovecot deliver keeps mail?
by mimosinnet＠gmail.com 03 May '10

03 May '10

My dovecot server was down las friday, and it seems that mails have been lost. This is what I have got in my logs since the server has been down: May 3 03:35:34 generatech dovecot: deliver(mail(a)domain.org): userdb lookup: connect(/var/run/dovecot/auth-master) failed: No such file or directory I guess that because the server was down dovecot transport could not deliver the mail. Nevertheless, I am wondering if dovecot deliver agent keeps undelivered mail somewhere. Thanks! I have been using this howto for the configuration: http://en.gentoo-wiki.com/wiki/Mail_server_using_Postfix_and_Dovecot This is dovecot 1.2.6, and my configuration: # dovecot -n # 1.2.6: /etc/dovecot/dovecot.conf # OS: Linux 2.6.28-hardened-r9 x86_64 Gentoo Base System release 2.0.1 rootfs listen: *:143 ssl_listen: *:52003 ssl_cert_file: /etc/ssl/dovecot/dovecot.pem ssl_key_file: /etc/ssl/dovecot/dovecot.key login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login first_valid_uid: 8 last_valid_uid: 8 first_valid_gid: 12 last_valid_gid: 12 mail_uid: 8 mail_gid: 12 mail_location: maildir:/var/mail/%d/%n/Maildir/:INDEX=/var/mail/%d/%n/indexes mail_plugins: quota imap_quota lda: postmaster_address: postmaster(a)generatech.org mail_plugins: quota sieve auth default: mechanisms: plain login user: nobody passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: mail group: mail plugin: sieve: /var/mail/%d/%n/.dovecot.sieve sieve_dir: ~/var/mail/%d/%n/sieve -- Ningún Lugar Activisme Cultural per a la Transformació Social Cultural Activism for Social Transformation ningun_lugar(a)riereta.net http://ningunlugar.org/ http://generatech.ningunlugar.org/ http://video.ningunlugar.org

2 1

[Dovecot] courier-imap and dovecot in migration process
by No body ist Perfect 02 May '10

02 May '10

Hello! I plan a migration from courier-imap to dovecot. at now run courier-imap as imaps server only and with perdition as redirector. can i run courier-imap and dovecot at same time on the same server(listing on diferent ports of course), i mean with shared home directory tree (Mailbox dir) ? Maybe access conflict or some problems ? Thanks a lot

1 0

[Dovecot] What causes dovecot to rebuild dovecot-uidlist?
by Pat 02 May '10

02 May '10

Hello, In what situations will Dovecot 1.2.11 rebuild its uidlist? I am using the maildir storage format, and I am also modifying the uidlist manually (so it's possible I could jack* things up). I have found some related code in maildir-uidlist.c: maildir_uidlist_next. 1) Blank filename or UID 0 2) Any UID not being greater than the proceeding UID 3) Any UID being greater than ~4 billion. 4) Any UID being greater than the suggested next uid. 6) If a filename contains a / 7) General header line sanity checking. Are there any other sections of the code that do sanity checks on dovecot-uidlist (for Maildir type storage)? And optionally do you agree that maildir_uidlist_set_corrupted is the best place to watch to see if I have mangled the uidlist? Thanks in advance, Pat * I insert into dovecot-uidlist manually when I deliver new messages, or discover a message that is not in uidlist for some reason. For compatability reasons I maintain a completely separate cache. If there is a better way to keep the uidlist up to date when the user isn't necessarily accessing the account via dovecot imap, I'm open to suggestions. However my situation is fairly unique I think.

2 2

[Dovecot] My dovecot does not store Thunderbird flags
by Julien Buratto 01 May '10

01 May '10

Hi all, my Dovecot 1.1.20 does not store flags (I mean, Thunderbird Labels like ToDo, Important and so on..) When logging in via telnet, I get: . examine INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk $MDNSent Junk $Forwarded NotJunk receipt-handled $Label7 $label1 $label2 $label3 $label4 $label5 expired_2w expired_2m delete rimandata forwarded) * OK [PERMANENTFLAGS ()] Read-only mailbox. As per Thunderbird mozillazine page about tags (http://kb.mozillazine.org/Tags#IMAP) that's what the issue is. PERMANENTFLAGS should allow /* while in my server it's empty. Could someone point me how can I change this behaviour or some hints ? Thank you -- Julien Buratto PS: In case someone asks for it > dovecot -n # 1.1.20: /usr/local/etc/dovecot.conf # OS: Linux 2.6.9-67.0.4.EL i686 CentOS release 4.7 (Final) log_path: /var/log/maillog info_log_path: /var/log/maillog protocols: imaps imap pop3 pop3s disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_location: mbox:~/mail/:INBOX=mbox mbox_lazy_writes: no mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes lda: postmaster_address: postmaster(a)example.com auth default: cache_size: 1024 verbose: yes passdb: driver: pam args: session=yes cache_key=%u%s dovecot userdb: driver: passwd plugin: acl: vfile:/etc/dovecot-acls

1 2

[Dovecot] UK Blackberry BIS and Dovecot - 2-way sync
by Lucio Godoy 01 May '10

01 May '10

Hi All; I have search the net and i cannot find any answers or fixes for this issue. I have a RHEL5 server running Dovecot Version 1.2.11 all worked well until i have diceded to subscribe to Vodafone's BIS service (BB Bold 9700). Internally I use outlook, and it does 2-way sync without any issues, but the blackberry only syncs new email and it does not sync deleted emails when I delete them in Outlook. Is there any special setting to allow such synchronisation? My server is secured by a pix firewall with ports 993, and 995 open for email sync (Secure IMAP and Secure Pop), i have setup the blackberry to use port 993. Many thanks for your help. Lucio =========================================================== The Home CCTV Security System made easy! http://www.kaduco.com/our-list-products-services/cctv-security-camera-syste… _________________________________________________________________ http://clk.atdmt.com/UKM/go/197222280/direct/01/ We want to hear all your funny, exciting and crazy Hotmail stories. Tell us now

1 0

[Dovecot] zlib Plugin Dovecot 2.0 - ostream
by Alex Baule 30 Apr '10

30 Apr '10

Hello Everyone. There is possible to rename the email saved by a plugin, like zlib ? i explain.... i need to add 1 line in email header, because of that, i want to rewrite the filename to update the S and W flag. Tks !

1 0

[Dovecot] 1.0.15 --> 1.2.11 --> got too little data
by Andre Hübner 30 Apr '10

30 Apr '10

Hello, did updates from 1.0.15 to 1.2.11 and is in most cases succesful. Sometimes dovecot leaves errormessage in Log: IMAP(username): FETCH [HEADER] for mailbox INBOX UID 5106 got too little data (copying): 516 vs 528 Until now only Inbox was effected and no other folders. I delete cachesfiles in ~mail/.imap to solve this but is there a way to do this automatical (self healing)? Dovecot could recreate complete caches if there was a difference in calculation. Thanks, Andre

2 6

[Dovecot] convert old configuration file with doveconf : Unknown setting
by de Lafond Guillaume 30 Apr '10

30 Apr '10

Hi, It happens when I try to convert this config (with the dovecot 2.0 beta4 release) : test-mail:/tmp# dovecot -n -c ./dovecot.old.conf # 1.2.11: ./dovecot.old.conf # OS: Linux 2.6.26-2-686-bigmem i686 Debian 5.0.4 log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot_info.log protocols: imap listen: 127.0.0.1:30143 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_user: aquaray login_greeting: Mail - test v2 login_process_per_connection: no login_process_size: 96 login_processes_count: 20 login_max_processes_count: 196 max_mail_processes: 10024 mail_max_userip_connections: 10000 verbose_proctitle: yes first_valid_uid: 89 mail_location: maildir:~/:INDEX=/var/mail/dovecot_indexes/%1d/%d/%n fsync_disable: yes maildir_very_dirty_syncs: yes mbox_write_locks: fcntl dotlock mail_drop_priv_before_exec: yes mail_plugins: quota imap_quota imap_client_workarounds: outlook-idle delay-newmail namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: INBOX/ hidden: yes list: no subscriptions: yes lda: postmaster_address: postmaster(a)test-dovecotv2.aquaray.com hostname: test-dovecotv2.aquaray.com log_path: /var/log/dovecot-deliver.log info_log_path: /var/log/dovecot-deliver.log auth_socket_path: /var/run/dovecot-socket-auth/auth-master auth default-auth-master: mechanisms: plain login apop cram-md5 master_user_separator: * passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen master: path: /var/run/dovecot-socket-auth/auth-master mode: 384 user: aquaray auth default: mechanisms: plain login apop cram-md5 cache_size: 2048 cache_ttl: 2000 master_user_separator: * count: 10 passdb: driver: sql args: /etc/dovecot/dovecot-sql-master.conf pass: yes master: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf plugin: quota: maildir:User quota test-mail:/tmp# /usr/local/dovecot2/bin/doveconf -n -c ./ dovecot.old.conf # 2.0.beta4 (6891d20929ca): ./dovecot.old.conf doveconf: Warning: Obsolete setting in ./dovecot.old.conf:26: login_dir has been removed doveconf: Warning: Obsolete setting in ./dovecot.old.conf:29: login_chroot has been replaced by service { chroot } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 29: Unknown setting: chroot doveconf: Warning: Obsolete setting in ./dovecot.old.conf:32: login_user has been replaced by service { user } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 32: Unknown setting: user doveconf: Warning: Obsolete setting in ./dovecot.old.conf:36: login_process_size has been replaced by service { vsz_limit } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 36: Unknown setting: vsz_limit doveconf: Warning: Obsolete setting in ./dovecot.old.conf:39: login_process_per_connection has been replaced by service { service_count } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 39: Unknown setting: service_count doveconf: Warning: Obsolete setting in ./dovecot.old.conf:42: login_processes_count has been replaced by service { process_min_avail } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 42: Unknown setting: process_min_avail doveconf: Warning: Obsolete setting in ./dovecot.old.conf:45: login_max_processes_count has been replaced by service { process_limit } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 45: Unknown setting: process_limit doveconf: Warning: Obsolete setting in ./dovecot.old.conf:48: login_max_connections has been replaced by service { client_limit } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 48: Unknown setting: client_limit doveconf: Warning: Obsolete setting in ./dovecot.old.conf:75: mail_drop_priv_before_exec has been replaced by service { drop_priv_before_exec } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 75: Unknown setting: drop_priv_before_exec doveconf: Warning: Obsolete setting in ./dovecot.old.conf:88: max_mail_processes has been replaced by service { process_limit } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 88: Unknown setting: process_limit doveconf: Warning: Obsolete setting in ./dovecot.old.conf:91: mail_process_size has been replaced by service { vsz_limit } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 91: Unknown setting: vsz_limit It does not understand the old 1.1 setting "ssl_disable". test-mail:/tmp# /usr/local/dovecot2/bin/doveconf -n -c ./ dovecot.old.conf # 2.0.beta4 (6891d20929ca): ./dovecot.old.conf doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 21: Unknown setting: ssl_disable ----------------------------------------------------------- After removing all fatal error (comment all settings that are not understood), it works. If needed, I could test against the another other version (latest hg ?). Regards, -- Guillaume de Lafond Aqua Ray SARL

2 3

[Dovecot] Quota maildirsize and dbox
by luben karavelov 30 Apr '10

30 Apr '10

Hello, Is there any reason that maildirsize Quota store should not work in dbox folders or any other folder based mailbox stores? I have patched a test version here and it seems to work (added "dbox" check in src/plugins/quota/quota-maildir.c line 785). If there could be any complications or unexpected consequences of this setup? Thanks in advance luben

3 2

[Dovecot] Expire plugin / expire-tool redesign for doveadm
by Timo Sirainen 30 Apr '10

30 Apr '10

Expire plugin / expire-tool seems annoyingly inflexible currently, so I was thinking about a more generic redesign: The expire plugin keeps track of the oldest message in configured mailboxes. Its only configuration is the list of tracked mailboxes. There's no configuration like what the expire timeouts are or anything. There will be a new doveadm command: doveadm expunge [-u user | -A] <mailbox> <search query> So when you want to expunge all mails from Trash older than 1 week for all users, you say: doveadm expunge -A Trash savedbefore 1w This command works even without expire plugin. To optimize it to avoid looking into all users' Trash mailbox, there's a new expire doveadm plugin, which can use the expire dict to filter out users who don't have anything to expunge. This also supports another feature that the plugin can optimize: doveadm move -A INBOX Archive/2009/INBOX since 2009-01-01 before 2010-01-01 And since people have had problems waiting for expire dict to fill, there could be also a new parameter that does the filling immediately. TODO: - dbox altmove feature will be removed from expire plugin. it may need another plugin, or some other way to configure expire plugin for it. it's anyway a special case. - When using multiple mailboxes it would be more optimal to handle all mailboxes for a user at once, rather than using separate doveadm commands. Maybe the command syntax needs some more thinking to support this. Different mailboxes could have different rules though..

3 6

[Dovecot] Released Pigeonhole Sieve v0.1.16 for Dovecot v1.2.11
by Stephan Bosch 30 Apr '10

30 Apr '10

Hello Dovecot users, Pigeonhole development has slowed down significantly in the last few months due to the fact that I got swamped in work. The plan is now to move active development of Pigeonhole to Dovecot v2.0, meaning that this will be the last release for v1.2 that contains significant development changes and new features. However, if a certain new feature is simple enough and there is a demand for it, I may backport it from v2.0 and release it along with any bugfixes that may still arise. The main thing that this new release adds is full support for the spamtest, spamtestplus and virustest extensions. These extensions implement a uniform means of testing the content spam/virus status headers in mail messages: http://ietfreport.isoc.org/idref/rfc5235/ Not many people have tested these new features yet and therefore these are currently considered experimental. Test these thoroughly before you start using them! Documentation is available in doc/spamtest-virustest.txt Changelog Sieve v0.1.16: * Finished implementation of spamtest, spamtestplus and virustest extensions. These are not enabled by default and need to be activated with the sieve_extensions setting. Documentation available in doc/spamtest-virustest.txt + Vacation extension: the from address of the generated reply is now by default equal to whatever known recipient alias matched the headers of the message. If it is one of the aliases specified with :addresses, it is used in stead of the envelope recipient address that was used before. + Restructured and optimized the lexical scanner. + Added --with-docs configure option to allow disabling installation of documentation. - Accidentally omitted 'extern' in two declarations of global variables in header files, causing compile failures on certain systems. - Deprecated imapflags extension: fixed implicit assignment of flags. Turns out this never really worked, but the effect of this bug was obscured by the removeflag bug fixed in the previous release. - Fixed various memset argument mixups in enotify extension. This caused warnings on certain systems, but luckily no adverse effects at runtime. The releases are available as follows: Sieve: http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-sieve-0.1.16.tar.gz http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-sieve-0.1.16.tar.gz.sig Refer to http://pigeonhole.dovecot.org for more information. Have fun testing the new releases and don't hesitate to notify me when there are problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

3 6

[Dovecot] Again: Occasional problem with POP3-Download
by Andre Tann 30 Apr '10

30 Apr '10

Hello everyone, in february I posted the mail below[1]. I can now reproduce the problem. When filling up a mailbox with postfix' smtp-source with dozens of identical mails, then it is never possible for me to fetch one single mail out of the mailbox. The process of fetching mail via POP3 always fails. It makes no difference which mail client I use. I have tested KMail, Outlook and Thunderbird. Can anyone confirm this? Is dovecot for some reason unable to deliver such identical mails? Can it be the case that this is a problem with too similar message ids? ~/Maildir/cur$ cat * | grep -i message-id Message-Id: <1024.0003.0008@alphamobil> Message-Id: <1024.0003.0009@alphamobil> Message-Id: <1024.0003.0006@alphamobil> Message-Id: <1024.0003.0007@alphamobil> Message-Id: <1024.0003.0005@alphamobil> Message-Id: <1024.0003.0004@alphamobil> Message-Id: <1024.0003.0003@alphamobil> Message-Id: <1024.0003.0002@alphamobil> Message-Id: <1024.0003.0001@alphamobil> Message-Id: <1024.0003.0000@alphamobil> Thanks and greetings from Munich! AT [1] Hello everyone, I have two mailservers [1] running dovecot. Mail store format is maildir. Every once in a while I have the following problem: When a User downloads his mail via POP3, the client says something like "the server has closed the connection unexpectedly, and gives this reason: [...blahblah...]". One can now cancel the download, and restart it, and the problem shows up again and again. The first few mails get downloaded, and then the process stops. Strange to say the "blahblah"-portion is a piece of text out of the email that doesn't want to get downloaded. Then I remove this single message out of the Maildir/cur-directory, and everything is fine again. It is easy to figure out which mail to delete because it's the first one that is not market as seen [...] filename...:2,S otherfilename...;2, <= this file must be deleted [...] For me it looks as if dovecot had a problem with some byte sequence in this mail, and for some reason it gives an error message to the client which is taken out of the mail. On the SuSE-Machine, before dovecot there was a courier-imapd running, which never showed this kind of problem, so it should not be a client problem. Hopefully my description is clear enough. Does anyone have an idea what's going on here? Thanks. Andre [1] One machine is a openSuSE 11.2 with # rpm -qa | grep dovecot dovecot12-backend-sqlite-1.2.9-0.1.1.i586 dovecot12-backend-mysql-1.2.9-0.1.1.i586 dovecot12-backend-pgsql-1.2.9-0.1.1.i586 dovecot12-1.2.9-0.1.1.i586 The other machine is a Debian Lenny with # dpkg -l | grep dovecot dovecot-common 1:1.0.15-2.3+lenny1 dovecot-imapd 1:1.0.15-2.3+lenny1 dovecot-pop3d 1:1.0.15-2.3+lenny1 -- Andre Tann

3 3

[Dovecot] Right way to Dovecot Load Balance
by Proskurin Kirill 30 Apr '10

30 Apr '10

Hello. I building LB&HA Email cluster based on Exim+Dovecot+LDAP. Now I thinking what the most right way to LB Dovecot(2 nodes with shared storage). HA-Proxy? Dovecot Proxy? Nginx? Else? -- Best regards, Proskurin Kirill

2 1

[Dovecot] Question about auth multiple configuration
by Fabrice MATHIEU 30 Apr '10

30 Apr '10

Hello, My mail system is build with postfix, dovecot and roundcube. In first time users can view and "manage" their mail only on the webmail. So this one (webmail) use IMAP (no tls/ssl at all) authentication to give access to users maildir. This connection is made on the 'loopback' interface and use PLAIN method. This works fine (configuration below without ssl parameters). Now I want to see and send my mail with a MUA (thunderbird). As my system is on an Internet provider I want to add more security "solutions". I use smtps with postfix and SASL/auth by dovecot socket mechanism to send mail. I use imaps with dovecot for managing my maildir. I have added ssl parameters to the configuration file (see below) and I required certificate from the client (to avoid man in the middle attack and to get access only for client with user certificate). To get this "ssl_require_client_cert" is set to yes. Ok, now imaps works perfectly. But since a certificate is required webmail authentication (localhost) and SASL (postfix auth trough dovecot socket mechanism) don't work. Webmail => dovecot: imap-login: Disconnected (cert required, client didn't start TLS): method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Postfix => postfix/smtpd[71640]: warning: TOTO[X.A.B.C]: SASL PLAIN authentication failed: Client didn't present valid SSL certificate That's normal. But 127.0.0.1 client(network) is considered by dovecot as secure, so won't the auth possible without certificate ? Can't we make two auth policy to make secure (client crt require) for public IP/client and less "secure" (without crt client) for local process (postfix) and local newtwork(127.0.0.1) for roundcube ? I see section "auth default { ... }" and is used by ... default ! But can we make an other one to make this two particular authentication on the same "instance" ? Thank you. And then my configuration : operating system => FreeBSD 7.1 dovecot --version => 1.2.8 dovecot -n => # 1.2.8: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.1-RELEASE i386 ufs protocols: imap listen: 127.0.0.1 ssl_listen: X.Y.Z.T ssl: yes ssl_ca_file: /usr/local/etc/dovecot/CAclient.pem ssl_cert_file: /usr/local/etc/dovecot/imaps.pem ssl_key_file: /usr/local/etc/dovecot/imaps.key ssl_verify_client_cert: yes login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_privileged_group: mail mail_location: maildir:/jails/mails/%d/%n imap_client_workarounds: delay-newmail netscape-eoh tb-extra-mailbox-sep lda: postmaster_address: postmaster@SOMETHING hostname: SOMETHING_ELSE sendmail_path: /usr/sbin/sendmail auth default: mechanisms: plain login username_format: %Lu passdb: driver: passwd-file args: username_format=%n /jails/mails/dov_pass/%d/usr_pas userdb: driver: passwd-file args: username_format=%n /jails/mails/dov_pass/%d/usr_pas ssl_require_client_cert = yes ssl_username_from_cert = no socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: wheel master: path: /var/run/dovecot/auth-master mode: 384 Best regards, _________________________________________________________________ Consultez gratuitement vos emails Orange, Gmail, Free, ... directement dans HOTMAIL ! http://www.windowslive.fr/hotmail/agregation/

3 8

[Dovecot] Question about dovecot imap proxy
by Monika Janek 29 Apr '10

29 Apr '10

Hi everyone! I have dovecot (1.2.11) on one our external mail servers acting as a proxy. The client (ifor now, my iphone) connects fine via ssl to the external mailserver but I can't seem to get a secure connection now to the internal destination imap server (between external mail server and internal imap server, it's going through port 143). Running tcpdump, I can clearly see my password being transmitted on our internal network. I read the addition to the documentation about dovecot proxy but I'm not sure where to add these variables: In v1.2.rc4+ the connections to destination server can be TLS/SSL encrypted by returning: * ssl=yes: Use SSL and require a valid verified remote certificate. *WARNING: Unless used carefully, this is an insecure setting!* Currently host must be an IP address, so this setting accepts any certificate signed by a trusted CA. The host name isn't checked in any way against the certificate's CN. The only way to use this securely is to only use and allow your own private CA's certs, anything else is exploitable by a man-in-the-middle attack. * ssl=any-cert: Use SSL, but don't require a valid remote certificate. * starttls: Use STARTTLS command instead of doing SSL handshake immediately after connected. Can anyone point me in the right direction? Thanks so much! :) -- Monika Janek Systems Administrator, Side Effects Software Toronto, Ontario Canada 416-504-9876 x207 www.sidefx.com

2 8

[Dovecot] Assertion failed in mail-search-build.c
by Mark Moseley 29 Apr '10

29 Apr '10

With Friday's and today's mercurial repo, I'm getting this: Apr 26 12:55:31 master: Info: Dovecot v2.0.beta4 starting up (core dumps disabled) Apr 26 12:58:34 imap-login: Info: Login: user=<mail@box>, method=PLAIN, rip=10.1.1.206, lip=192.168.152.1 Apr 26 12:58:34 imap(mail@box): Panic: file mail-search-build.c: line 59 (mail_search_build_key_int): assertion failed: (sarg->value.subargs != NULL) Apr 26 12:58:34 imap(mail@box): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0xb76a3ad1] -> /usr/lib/dovecot/libdovecot.so.0 [0xb76a3b4f] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0xb76a3e08] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0xb76f859e] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0xb76f860f] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_search_build+0x82) [0xb76f86f2] -> dovecot/imap [mail@box 10.1.1.206 SEARCH](imap_search_args_build+0x48) [0x805d8a8] -> dovecot/imap [mail@box 10.1.1.206 SEARCH](cmd_search+0xbb) [0x805342b] -> dovecot/imap [mail@box 10.1.1.206 SEARCH] [0x80564dc] -> dovecot/imap [mail@box 10.1.1.206 SEARCH] [0x8056579] -> dovecot/imap [mail@box 10.1.1.206 SEARCH](client_handle_input+0x2d) [0x80566ed] -> dovecot/imap [mail@box 10.1.1.206 SEARCH](client_input+0x5f) [0x805710f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xf5) [0xb76b0115] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x30) [0xb76af160] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x2a) [0xb769ca5a] -> dovecot/imap [mail@box 10.1.1.206 SEARCH](main+0x2b5) [0x805fb95] -> /lib/libc.so.6(__libc_start_main+0xe5) [0xb752e455] -> dovecot/imap [mail@box 10.1.1.206 SEARCH] [0x804e951] Apr 26 12:58:34 master: Error: service(imap): child 13220 killed with signal 6 (core dumps disabled) Login is working fine, just blowing up on that assert by doing a search. The search is pretty basic, in python: server.search( None, "(ALL)" ) Testing with a previous version (from a couple of days earlier -- I don't have the intervening), I don't hit that assertion. The last changeset on mail-search-build.c in the working copy is 11146:3649ad8c9f9a. Let me know if there's anything you'd like me to try.

2 1

[Dovecot] pop3-login: auth failure -- due to number as first character in login name
by dovecot mail list account 29 Apr '10

29 Apr '10

Seem to have found a error in version 1.2.6 regarding usernames having a number as the first character. Customers with a number as the first character in thier user name can not login via pop3 clients. However they can login through our webmail interface. If we remove the number from the username then the customer can login. # 1.2.6: /etc/dovecot.conf # OS: Linux 2.6.31.12-desktop-3mnb x86_64 Mandriva Linux 2010.0 protocols: pop3 ssl_listen: * ssl_cert_file: /etc/pki/tls/certs/dovecot.pem ssl_key_file: /etc/pki/tls/private/dovecot.pem disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib64/dovecot/pop3-login mail_privileged_group: mail mail_location: mbox:~/mail:INBOX=/home/mail/%u mail_executable: /usr/lib64/dovecot/pop3 mail_plugin_dir: /usr/lib64/dovecot/modules/pop3 pop3_uidl_format: %08Xv%08Xu lda: postmaster_address: postmaster(a)example.com auth default: mechanisms: plain login verbose: yes passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix plugin: quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 quota_warning2: storage=80%% /usr/local/bin/quota-warning.sh 80

2 1

[Dovecot] Problems with Mailbox is in inconsistent state, please relogin.
by Daniel Machado Grilo 29 Apr '10

29 Apr '10

Dear Dovecot users, I'm a sysadmin in a company that recently migrated the IMAP from courier-imap to dovecot :-) *urray* Everything with the perl migrating scripts (version 1.0) went with OKs and it was a lot of fun (and pray) to move 400Gb of mails and migrate.. and everything is working even better :-) The problem is for some outside users that use webmails, like: - Squirrel - Roundcube - Horde They claim that the connection is constantly dropping.. You might say now: "Webmail's fault!!!" as I said in the beginning :) But the IMAP logs shows SEVERAL times (almost every 10mins ?!): Apr 28 21:10:48 olive dovecot: IMAP(rcoelho): Maildir /cluster/mail/mailboxes/rcoelho sync: UID inserted in the middle of mailbox (192736 > 192720, file = msg.LDW0C) Apr 28 21:10:48 olive dovecot: IMAP(rcoelho): Disconnected: Mailbox is in inconsistent state, please relogin. Apr 28 19:14:11 olive dovecot: IMAP(pcorreia): Maildir /cluster/mail/mailboxes/pcorreia sync: UID < next_uid (7874 < 7875, file = msg.5BNVC) Apr 28 19:14:12 olive dovecot: IMAP(pcorreia): Disconnected: Mailbox is in inconsistent state, please relogin. and so on. I read somewhere on the web that configuring the mbox_lazy_write=no should work .. it did not :-) I have CentOS 5.4 in our mailserver, so the version of dovecot is not the latest (it is 1.0.7).. But of course, this is production environment and I don't want to update if its not needed :-) So my questions are: - Is this a known bug for this version and I have to upgrade ? - Is this a problem in my configs for dovecot ? - Can this be other problem than dovecot ? -- so probably i should be able to add more debug anoying messages to our logs ? - Probably something went wrong in the migration for these maildirs? So now what can we do to fix this ? Our mail is working and, at the moment, I found 3 users with this error.. They have about 10Gb of mail each, I don't think this is a problem for dovecot.. only for our storages.. :-) Tks for your patience, Best Regards!

4 3

[Dovecot] Maildircrypt
by brainstorm 29 Apr '10

29 Apr '10

Hi guys, I was just wondering if this idea makes sense overall or if there are major impediments (indexing performance ?): http://blogs.nopcode.org/brainstorm/2010/04/28/maildircrypt/ Thanks ! Roman

2 1

[Dovecot] Dovecot headers at start of text returned to KMail
by Barry Scott 29 Apr '10

29 Apr '10

The attachment show Kmail (kdepim-4.4.2-1.fc12.x86_64) accessing an email from dovecot over imap. From the wireshark-imap-trace.txt you can see at line 77 that the headers do not end cleanly "X-)". And at line 84 there is text from the headers that is not part of the body "-Spambayes-Trained: ham". The email being access by dovecot is in: 1272011889.M384349P30156.f12barry.office.onelan.co.uk,S=6494,W=6606:2,S Because of this bug kmail fails to show the message cleanly on screen. # 1.2.11: /etc/dovecot.conf # OS: Linux 2.6.32.11-99.fc12.x86_64 x86_64 Fedora release 12 (Constantine) login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd Barry

2 4

[Dovecot] How can I add change_password
by Yavuz Maşlak 29 Apr '10

29 Apr '10

Hello I use dovecot, postfix, mysql and squirrelmail as a mail server. it works well. Meanwhile I am novice at postfix. As you know, there is a change_password plugin on squirrelmail. I wish to add change_password plugin on squirrelmail. I couldn't find how to integrate postfix and change_password. How can I add it ?

2 1

[Dovecot] How can I integrate change_password plugin, dovecot and postfix
by Yavuz Maşlak 29 Apr '10

29 Apr '10

Hello I use dovecot, postfix, mysql and squirrelmail as a mail server. it works well. Meanwhile I am novice at postfix. As you know, there is a change_password plugin on squirrelmail. I wish to add change_password plugin on squirrelmail. I couldn't find how to integrate postfix and change_password. How can I add it ?

3 3

Re: [Dovecot] returned error 83 (Out of memory)
by J Contad 28 Apr '10

28 Apr '10

FYI, sorted out this issue by taking out a specific email manually. Not sure if it helps, but the email had these attributes: - X-Mailer is PHPMailer [version 1.73] - References: header is quite large, and contains email addresses external to the sender and I's conversation. Removing the email fixed the issue. -- John

3 3

Re: [Dovecot] returned error 83 (Out of memory)
by J Contad 28 Apr '10

28 Apr '10

I tried deleting the file, but got pretty much the same issues. Any other hints on how else to go about it? Cheers! John On Thu, 22 Apr 2010, J Contad wrote: > The folder (which is shared) has about 8 thousand emails in it. I'm not sure > if it's pertinent, but the dovecot.index.cache file is about 8MB. Did you tried to delete the dovecot.index.cache file, maybe it has been corrupted? Regards, - -- Steffen Kaiser -- John

1 0

[Dovecot] somebody using Net::Sieve (Perl) with dovecot 1.2.11?
by Heiko Schlittermann 27 Apr '10

27 Apr '10

Hello, I've just (hopefully) fixed some issue with Net::Sieve (0.05) to cooperate with a current (1.2.11) dovecot managesieve server and STARTTLS. Does somebody use this Perl library? If yes, did it work for you (STARTTLS triggers the problem)? If not, which other (Perl) library do you use? Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann HS12-RIPE ----------------------------------------- gnupg encrypted messages are welcome - key ID: 48D0359B --------------- gnupg fingerprint: 3061 CFBF 2D88 F034 E8D2 7E92 EE4E AC98 48D0 359B -

2 1

[Dovecot] zlib plugin dovecot 2.0 - write email
by Alex Baule 26 Apr '10

26 Apr '10

Hello Everyone. There is possible to rename the email writed by a plugin, like zlib ? i explain.... i need to add 1 line in email header, because of that, i want to rewrite the filename to update the S and W flag. Tks !

1 0

[Dovecot] Anyone successfully using expire plugin?
by Thomas M Goerger 23 Apr '10

23 Apr '10

Anyone out there using expire? At this point, I'm not sure that it's even running. It was touching the plugin libraries yesterday, but doesn't appear to be doing so today. The plugin directory wasn't explictly set, so I've done so now, but it's still not touching these. Anyone have a cf file I could take a look at, or any ideas as to what might be happening? Thanks! ************************************************************************* * Tom Goerger - Email/Unix System Administrator * * * * University of Minnesota Email: tmg(a)umn.edu * * Operations, Infrastructure and Architecture Phone: 4-5804 * * Internet Services Office: 626J WBOB * * * *************************************************************************

2 1

[Dovecot] How can I make dovecot aware of user's email aliases?
by Ian P. Christian 23 Apr '10

23 Apr '10

Sieve will not reply to mail it doesn't think was sent directly to a user. I use an SQL auth backend, and a user might login as user1(a)domain.com. What method can I use to inform dovecot that user2(a)domain.com is a forward to user1(a)domain.com, such that the vacation auto response will fire when user2(a)domain.com is emailed (therefore, the mail ends up in user1(a)domain.com's mailbox). -- Blog: http://pookey.co.uk/blog Follow me on twitter: http://twitter.com/ipchristian

1 0

[Dovecot] best choice of user database file to work with postfix?
by Phil Howard 23 Apr '10

23 Apr '10

I'm setting up a Postfix and Dovecot combination. What I want to do is have a user database that (1) is not running from some engine (so not LDAP or SQL or such) ... and (2) is completely disassociated from system users (e.g. most email users are not in /etc/passwd and most /etc/passwd users are not email users). Ideal would be a one-file solution, which can be managed by text editing or simple command line tools. But what I want is ONE file that both Postfix (for valid recipients) and Dovecot (for user login authentication) can use together. An alternative is some way to get Postfix to go through Dovecot to query for users (at the time of mail arriving on SMTP so it doesn't queue anything that would later be rejected). This is a smallish setup on one server, with probably a max of 50 to 100 users and 50 or so role account mailboxes over the next year or two. Any recommendations?

18 50

[Dovecot] have I been added to the mailing list
by ttplayer 23 Apr '10

23 Apr '10

Hi, have I been added to the mailing list? Thank you.

1 0

[Dovecot] Quota monitoring
by Vlamsdoem 23 Apr '10

23 Apr '10

Hello, I would like to monitor users quotas in Dovecot but I don't find a way to do it for every user. Acutally I can log in with user & password to get the users quota but wat I need is a way to monitor the quota of every user with e.g an admin user which would have an acces to the quota of each mailbox. Is there a way to this? Thanks for your help.

6 11

[Dovecot] message to imap users when connecting ?
by Frank Bonnet 22 Apr '10

22 Apr '10

Hello Is it possible that a IMAP client (thunderbirs in my case) popup a message box containing a short message when a user connect to the server ? Is there such feature in Dovecot ? Thanks

3 2

[Dovecot] imap-zlib patch to fix runaway imap process
by Mike Abbott 22 Apr '10

22 Apr '10

Here is a patch to fix the problem where an imap process runs away when imap-zlib is in use. The backtrace showed: io_loop_handler_run -> stream_send_io -> client_output -> o_stream_flush -> o_stream_zlib_flush -> o_stream_zlib_send_flush When o_stream_zlib_flush returns 0, stream_send_io reinstates the IO_WRITE event, causing the infinite loop. diff -ur dovecot-2.0.beta4/src/plugins/zlib/ostream-bzlib.c dovecot-2.0.beta4+fix/src/plugins/zlib/ostream-bzlib.c --- dovecot-2.0.beta4/src/plugins/zlib/ostream-bzlib.c 2010-02-12 20:22:07.000000000 -0600 +++ dovecot-2.0.beta4+fix/src/plugins/zlib/ostream-bzlib.c 2010-04-20 19:15:29.000000000 -0500 @@ -122,15 +122,15 @@ static int o_stream_bzlib_flush(struct ostream_private *stream) { struct bzlib_ostream *zstream = (struct bzlib_ostream *)stream; + int ret; if (o_stream_bzlib_send_flush(zstream) < 0) return -1; - if (o_stream_flush(zstream->output) < 0) { + ret = o_stream_flush(zstream->output); + if (ret < 0) zstream_copy_error(zstream); - return -1; - } - return 0; + return ret; } static ssize_t diff -ur dovecot-2.0.beta4/src/plugins/zlib/ostream-zlib.c dovecot-2.0.beta4+fix/src/plugins/zlib/ostream-zlib.c --- dovecot-2.0.beta4/src/plugins/zlib/ostream-zlib.c 2010-02-18 22:01:56.000000000 -0600 +++ dovecot-2.0.beta4+fix/src/plugins/zlib/ostream-zlib.c 2010-04-20 19:15:29.000000000 -0500 @@ -184,15 +184,15 @@ static int o_stream_zlib_flush(struct ostream_private *stream) { struct zlib_ostream *zstream = (struct zlib_ostream *)stream; + int ret; if (o_stream_zlib_send_flush(zstream) < 0) return -1; - if (o_stream_flush(zstream->output) < 0) { + ret = o_stream_flush(zstream->output); + if (ret < 0) zstream_copy_error(zstream); - return -1; - } - return 0; + return ret; } static ssize_t

2 1

[Dovecot] Quota Issue
by Peter Fraser 21 Apr '10

21 Apr '10

Hi All I'm using dovecot version 1.2.4_1 and I noticed something strange. I checked the list but so far I haven't found anything that exactly fits my setup. I'm using maildirs and ldap as a backend to authenticate. A user went over quota, realized it and proceeded to delete a lot of email. Even now, after about 15 minutes, the quota indicator is still showing that he is over quota even though the users mailbox size is down by over 200MB. Why isn't Dovecot showing the change, and is there a way around this? Thanks for any help.

2 3

[Dovecot] corrupted index cache file, physcial size, in migration to snow leopard
by Norman Packard 21 Apr '10

21 Apr '10

Hi, I am in the middle of migrating a server from Apple's leopard to snow leopard. Having big problems with migrating mail to dovecot. The version is: # dovecotd --version 1.1.17apple0.5 and I use the migration script provide by Apple, /usr/libexec/dovecot/migrate_mail_data.pl The current problems concern migrating imap accounts. The old data typically shows up to mail clients as only partially migrated, with some issues there, like folders change from being listed on the server to being listed locally, but the biggest problem is that many many messages and folders have disappeared from view. But on the server, they seem to be there, in their correctly migrated place. The log files are full of messages like the ones below, which I'm guessing has something to do with the problem. The number of files with this problem is huge. Are there any scripts to rebuild the index cache files with correct physical sizes? Thanks in advance for any help! Best, Norman Apr 21 08:05:47 newhot dovecot[31163]: IMAP(*): Corrupted index cache file /Volumes/xserveHD2/var/spool/imap/dovecot/mail/A1F36563-F978-4F99- A1FF-EC5D223F18D6/dovecot.index.cache: Corrupted physical size for uid=8142: 4325 != 4214 Apr 21 08:05:50 newhot dovecot[31163]: IMAP(*): Corrupted index cache file /Volumes/xserveHD2/var/spool/imap/dovecot/mail/A1F36563-F978-4F99- A1FF-EC5D223F18D6/dovecot.index.cache: Corrupted physical size for uid=8145: 4625 != 4510 Apr 21 08:05:53 newhot dovecot[31163]: IMAP(*): Corrupted index cache file /Volumes/xserveHD2/var/spool/imap/dovecot/mail/A1F36563-F978-4F99- A1FF-EC5D223F18D6/dovecot.index.cache: Corrupted physical size for uid=8148: 4037 != 3956 Apr 21 08:06:04 newhot dovecot[31163]: IMAP(*): Corrupted index cache file /Volumes/xserveHD2/var/spool/imap/dovecot/mail/A1F36563-F978-4F99- A1FF-EC5D223F18D6/dovecot.index.cache: Corrupted physical size for uid=8158: 4673 != 4571

1 0

[Dovecot] Question about listescape plugin
by Luca Di Vizio 21 Apr '10

21 Apr '10

Hi all, with the listescape plugin enabled we a stange result. ** listescape enabled ** 2 list "" % * LIST (\HasChildren) "/" "INBOX" * LIST (\HasChildren) "/" "INBOX/" ** listescape disabled ** 2 list "" % * LIST (\HasChildren) "/" "INBOX" The prefix for this namespace is "INBOX/". Is correct to have "INBOX/" as result of LIST? Info about the system: - Centos 5.3/x86_64. - Dovecot 1.2.11 (I tried also with 2.0.beta4, same results). mail_nfs_storage: yes mail_nfs_index: yes mail_plugins(imap): listescape quota imap_quota namespace: type: private separator: / inbox: yes list: yes subscriptions: yes plugin: quota: maildir Thanks, Luca

1 0

[Dovecot] POP3: Restrict Connections per timeframe
by Michael Kliewe 21 Apr '10

21 Apr '10

Hi everybody, is it possible to limit the amount of POP3 connections/logins per 15 minutes? Many hoster do that, but I cannot find a configuration setting for that. I can only limit the amount of concurrent connections per IP, but not connections per time. Michael

1 0

[Dovecot] dovecot2 beta and gcc3(?) - compile problem
by Andre Hübner 21 Apr '10

21 Apr '10

Hello, try to compile current dovecot2 beta on older machine with gcc 3.3 Compiling results in error: libtool: link: gcc -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -o .libs/imap-login client.o client-authenticate.o imap-login-settings.o imap-proxy.o ../../src/login-common/.libs/libdovecot-login.so ../../src/lib-dovecot/.libs/libdovecot.so -lrt -Wl,-rpath -Wl,/usr/lib/dovecot ../../src/login-common/.libs/libdovecot-login.so: undefined reference to `ERR_peek_last_error' collect2: ld returned 1 exit status make[3]: *** [imap-login] Error 1 make[3]: Leaving directory `/usr/src/dovecot-1.1.rc12/dovecot-2.0.beta4/src/imap-login' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/usr/src/dovecot-1.1.rc12/dovecot-2.0.beta4/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/usr/src/dovecot-1.1.rc12/dovecot-2.0.beta4' make: *** [all] Error 2 Is there something missed on my side or problem with older gcc? dovecot 1.2.11 compiles just fine with same configure-line also there are some warnings like this: libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../../.. -I../../../../src/lib -I../../../../src/lib-settings -I../../../../src/lib-mail -I../../../../src/lib-imap -I../../../../src/lib-index -I../../../../src/lib-storage -I../../../../src/lib-storage/index -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -MT dbox-sync-rebuild.lo -MD -MP -MF .deps/dbox-sync-rebuild.Tpo -c dbox-sync-rebuild.c -fPIC -DPIC -o .libs/dbox-sync-rebuild.o In file included from dbox-sync-rebuild.c:5: ../../../../src/lib-index/mail-index-modseq.h:34: warning: parameter has incomplete type ../../../../src/lib-index/mail-index-modseq.h:52: warning: parameter has incomplete type or libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../../.. -I../../../../src/lib -I../../../../src/lib-settings -I../../../../src/lib-mail -I../../../../src/lib-imap -I../../../../src/lib-index -I../../../../src/lib-storage -I../../../../src/lib-storage/index -I../../../../src/lib-storage/index/dbox-common -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -MT mdbox-file.lo -MD -MP -MF .deps/mdbox-file.Tpo -c mdbox-file.c -fPIC -DPIC -o .libs/mdbox-file.o In file included from mdbox-storage.h:5, from mdbox-file.c:16: ../../../../src/lib-storage/mailbox-list-private.h:158: warning: parameter has incomplete type Thanks, Andre

2 3

[Dovecot] Question about listescape
by Luca Di Vizio 21 Apr '10

21 Apr '10

Hi all, with the listescape plugin enabled we a stange result. ** listescape enabled ** 2 list "" % * LIST (\HasChildren) "/" "INBOX" * LIST (\HasChildren) "/" "INBOX/" ** listescape disabled ** 2 list "" % * LIST (\HasChildren) "/" "INBOX" The prefix for this namespace is "INBOX/". Is correct to have "INBOX/" as result of LIST? Info about the system: - Centos 5.3/x86_64. - Dovecot 1.2.11 (I tried also with 2.0.beta4, same results). mail_nfs_storage: yes mail_nfs_index: yes mail_plugins(imap): listescape quota imap_quota namespace: type: private separator: / inbox: yes list: yes subscriptions: yes plugin: quota: maildir Thanks, Luca

1 0

[Dovecot] Checkpassword/prefetch/master_user and problems
by Emerson Pinter 20 Apr '10

20 Apr '10

Hi. I'm trying to use checkpassword for simple auth and masteruser auth. I have two programs, one called checkpassword-master (for masteruser lookup) and another called checkpassword for normal passdb and userdb lookup). All works fine for non-masteruser authentication (in this case dovecot makes a single call to checkpassword binary). But if a master-user authenticates, dovecot execute checkpassword-master binary, and then executes checkpassword binary. Checkpassword binary receive the MASTER_USER env and do all the checks correctly, when checkpassword finish, dovecot logs this message "auth(default): checkpassword: sighandler called for unknown child" and authentication fails... I'm trying checkpassword-reply and fd4 too, on 1.2.11 and 2.0b4, no success. Below is my config: auth default { mechanisms = plain passdb checkpassword { args = /srv/dovecot/checkpassword } passdb checkpassword { args = /srv/dovecot/checkpassword-master master=yes pass=yes } userdb prefetch { } } Anybody can help me ? Tks. -- Emerson Pinter Esta mensagem pode conter informações confidenciais, privilegiadas ou privadas. Caso não seja o destinatário, favor apagá-la e notificar o remetente. Saiba que o uso impróprio das informações existentes é estritamente proibido, sendo tratado conforme as normas da empresa e a legislação em vigor.

1 1

Re: [Dovecot] setgid failed - Not owner
by Zilon X 20 Apr '10

20 Apr '10

Changed home dir of users, in my configuration they are /var/postfix/spool and /var/postfix/dovecot/run, but with no effect. I still got the "fatal setgid failed: Not owner" ( Fatal: setgid(12345(postfix)) failed with euid=12346(dovecot), gid=54322(dovecot), egid=54322(dovecot): Not owner ) 2010/4/20 Andreas Schulze <andreas.schulze(a)datev.de>: > Am 19.04.2010 16:49 schrieb Zilon X: >> postfix:x:12345:12345::/dev/null:/bin/false >> dovecot:x:12346:54322::/dev/null:/bin/false > > I would never use /dev/null as homedir. > postfix home is /var/spool/postfix, dovecot likes /var/run/dovecot. > > -- > Andreas Schulze > Internetdienste | P532 > > DATEV eG > 90329 Nürnberg | Telefon +49 911 319-0 | Telefax +49 911 319-3196 > E-Mail info @datev.de | Internet www.datev.de > Sitz: 90429 Nürnberg, Paumgartnerstr. 6-14 | Registergericht Nürnberg, GenReg Nr.70 > Vorstand > Prof. Dieter Kempf (Vorsitzender) > Dipl.-Kfm. Wolfgang Stegmann (stellvertretender Vorsitzender) > Dipl.-Kfm. Michael Leistenschneider > Jörg Rabe v. Pappenheim > Dipl.-Vw. Eckhard Schwarzer > Vorsitzender des Aufsichtsrates: Reinhard Verholen > >

2 1

[Dovecot] zero sized messages in Maildir, corrupt filenames ?
by Rodolphe Buret 20 Apr '10

20 Apr '10

Hi, I'm starting to see more and more duplicates in my cur directory. they seem to be a copy of an incoming mail (messages share the same date) but they appears in the client as a message without subject and without sender or body. Their filename starts with an underscore and the 4th letter is a %. The rest of the filename is random (but it also includes my hostname). Which program could create such a filename ? If it's in the cur directory, it can only be dovecot, right ? Example of 2 probably related messages in the cur folder: 1785 Apr 20 09:18 msg.zMeU:2,d 0 Apr 20 09:18 _J9C%jVVzLB.{myhostname}:2, In addition, it seems that since we have started to use thunderbird 3, indexes are often corrupt, mailboxes needs reconstruction and so on. Could it be an incompatibility with my version of dovecot ? I've disabled my thunderbird filters that were moving the incoming mail automatically, no difference. I use no antivirus (linux imap client mainly). I can (probably) upgrade to dovecot-1.2.11-3_108 but I'd like to be sure that I won't create more problems before doing it. The homedirs are NFS mounted. dovecot 1.1.7-0_84 squirrelmail 1.4.19 postfix 2.6.5-1 Here is my dovecot -n # 1.1.7: /etc/dovecot.conf # OS: Linux 2.6.18-128.1.1.el5xen x86_64 Red Hat Enterprise Linux Server release 5.3 (Tikanga) log_path: /var/log/dovecot.log protocols: imap imaps listen: * login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: maildir:~/Maildir mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock auth default: passdb: driver: pam userdb: driver: passwd plugin: quota: Thanks for your time, -- Rodolphe Buret Ecole Polytechnique Fédérale de Lausanne System Administrator EPFL STI-IEL-ESL Tel: +41-21-693-0922 ELG 136 (bâtiment ELG) Fax: +41-21-693-0909 Station 11 Email: rodolphe.buret(a)epfl.ch CH-1015 Lausanne Switzerland

2 1

[Dovecot] Dovecot-sieve vacation proposal, use address in addresses as recipient
by David Berard 20 Apr '10

20 Apr '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi Dovecot list, In my setup I have several email addresses that uses same account. When I set a vacation the answer is not necessarily send from the destination address. I propose to use the addresses found in addresses (if one match) as From address in vacation reply. I've made a little patch who do that [1]. Best regards. [1] http://polymorf.fr/files/nfrance/cmd-vacation.patch - -- David BERARD - ------------------------------------------------- contact(at)davidberard.fr GPG|PGP KeyId 0xC8533354 GPG|PGP Key http://davidberard.fr/C8533354.gpgkey - ------------------------------------------------- * No electrons were harmed in * * the transmission of this email * -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAku+fUoACgkQOL7fhchTM1TJmACfdQcfgrSqNbjvWTEXrTc7Twly M70An2Nzb2MFby9ARHM1Ys93wGzuRYHy =yaLh -----END PGP SIGNATURE-----

4 4

[Dovecot] setgid failed - Not owner
by Zilon X 19 Apr '10

19 Apr '10

Hello ALL, I got errors on a new installation, maybe I forgot something. The system is Solaris, Dovecot 1.2.10, Postfix 2.7.0, MySQL 5.1.25. Can send mail with dovecot imap, but can`t retrieve the messages. Strange, I can save and retrieve draft messages ok, files are always with postfix:postfix ownership. Sorry if this is newbie question, but can`t find a solution. Syslog info: Apr 19 10:10:17 server postfix/qmgr[10654]: [ID 197553 mail.info] B66EF3FEE7: from=<user@domain>, size=547, nrcpt=1 (queue active) Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] auth(default): master in: USER 1 user@domain service=deliver Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] auth-worker(default): sql(user@domain): SELECT '/var/postfix/domains/domain/user' as home, 'maildir:/var/postfix/domains/domain/user' as mail, 12345 AS uid, 12345 AS gid, concat('dirsize:storage=', quota) AS quota FROM mailbox WHERE username = 'user@domain' AND active = '1' Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] auth(default): master out: USER 1 user@domain home=/var/postfix/domains/domain/user mail=maildir:/var/postfix/domains/domain/user uid=12345 gid=12345 quota=dirsize:storage=10240000 Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] deliver(user@domain): auth input: home=/var/postfix/domains/domain/user Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] deliver(user@domain): auth input: mail=maildir:/var/postfix/domains/domain/user Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] deliver(user@domain): auth input: uid=12345 Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] deliver(user@domain): auth input: gid=12345 Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] deliver(user@domain): auth input: quota=dirsize:storage=10240000 >> Apr 19 10:10:17 server dovecot: [ID 583609 mail.crit] deliver(user@domain): Fatal: setgid(12345(postfix)) failed with euid=12346(dovecot), gid=54322(dovecot), egid=54322(dovecot): Not owner Apr 19 10:10:17 server postfix/pipe[23327]: [ID 197553 mail.info] B66EF3FEE7: to=<user@domain>, relay=dovecot, delay=582, delays=582/0.18/0/0.11, dsn=4.3.0, status=deferred (temporary failure) _____________________________________________________ Configuration at dovecot.conf: login_dir = /var/postfix/dovecot/run/login login_chroot = yes login_user = dovecot mail_privileged_group = postfix mail_full_filesystem_access = yes passdb sql { args = /var/postfix/dovecot/etc/dovecot-sql.conf } userdb sql { args = /var/postfix/dovecot/etc/dovecot-sql.conf } user = nobody socket listen { master { path = /var/postfix/dovecot/run/auth-master mode = 0660 user = postfix group = postfix } client { path = /var/postfix/spool/private/auth mode = 0660 user = postfix group = postfix } } _____________________________________________________ Configuration at main.cf: mail_owner = postfix default_privs = nobody virtual_transport = dovecot dovecot_destination_recipient_limit = 1 smtpd_sasl_type = dovecot _____________________________________________________ Configuration at master.cf: dovecot unix - n n - - pipe flags=DRhu user=dovecot:dovecot argv=/var/postfix/dovecot/libexec/dovecot/deliver -d $(recipient) _____________________________________________________ Entries at passwd: postfix:x:12345:12345::/dev/null:/bin/false dovecot:x:12346:54322::/dev/null:/bin/false Entries at group: postfix::12345: postdrop::54321: dovecot::54322: _____________________________________________________ Thank you for any help!

1 0

[Dovecot] permission denied, no logs
by Shane Brooks 19 Apr '10

19 Apr '10

Hi, We have a sendmail/dovecot/squirrelmail installation that was working ok except for deleted files showing in the list with a [d] beside it. In trying to fix that issue, I apparently made a new error appear in the left navigation area: ERROR: Could not complete request. Query: CREATE "mail/Sent" Reason Given: [NOPERM] Permission denied There are no errors in dovecot, but from what i've read squirrelmail passes these folder requests to the imap server for processing. Can anyone help me verify what my permissions should be? Here is my config: # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.24-19-xen x86_64 CentOS release 5.3 (Final) log_path: /var/log/dovecot/runtime.log protocols: imap imaps pop3 pop3s disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_privileged_group: mail mail_uid: mail mail_gid: mail mail_location: mbox:~:INBOX=/var/mail/%u mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 lda: postmaster_address: postmaster(a)example.com auth default: cache_size: 10 debug: yes passdb: driver: pam args: cache_key=%u dovecot userdb: driver: passwd Thank you very much! Shane brooks IT Manager 940 West Oakland Avenue Suite A8 Oakland, Florida 34787 407-654-6076 Office 407-654-6063 Fax

2 1

[Dovecot] sieve rule problem after upgrade
by Benny Pedersen 19 Apr '10

19 Apr '10

after i updated from 1.2.6 to 1.2.11 in gentoo this sieve rule stopped working :( # X-Cron-Env if exists "X-Cron-Env" { addflag "\\Seen"; fileinto "Trash"; removeflag "\\Seen"; stop; } any hints why ?, this rule is generated with horde ingo so it might be problem in ingo ? -- xpoint

2 2

[Dovecot] dovecot-1.2-sieve sending vacation replies regardless of recipient (patch)
by Mark Washenberger 19 Apr '10

19 Apr '10

I want a way to send VAR messages without having to specify up front all of the addresses for which such VARs should be sent. I realize this goes against rfc 3834, but it seemed reasonable to add a tag to the vacation command to skip the [to, cc, bcc, ...] recipients check. The patch I made is attached. The new usage with this patch is: vacation [":days" number] [":subject" string] [":x_any_address"] [":from" string] [":addresses" string-list] [":mime"] [":handle" string] <reason: string> What do you think of this patch? Is there a better way to accomplish the same thing without writing a patch? Is there a better way to write this patch to make it a cleaner feature or easier to maintain? Could this ever be part of the mainline? Mark Washenberger Rackspace Hosting Software Developer, Email & Apps mark.washenberger(a)rackspace.com

2 2

[Dovecot] sieve plugin - reject sends MDN. Can it 550 reject ?
by Ken A 19 Apr '10

19 Apr '10

I'm using dovecot-1.2-sieve-0.1.15 with dovecot-1.2.11. I have a reject test filter that looks like this: require "reject"; if header :contains "subject" "reject" { reject "bye"; } Is there any way to get a "reject" filter to send back a 550 reject as detailed in http://ietfreport.isoc.org/idref/rfc5429/#section-2.5 rather than a MDN? The MDN can result in blowback spam. :-( Thanks, Ken -- Ken Anderson Pacific Internet - http://www.pacific.net

3 3

[Dovecot] siever_dir default
by Antonio Casado Rodríguez 19 Apr '10

19 Apr '10

Hi all I have this: # The path to the directory where the personal Sieve scripts are stored. For # ManageSieve this is where the uploaded scripts are stored. #sieve_dir=~/sieve but the correct is # The path to the directory where the personal Sieve scripts are stored. For # ManageSieve this is where the uploaded scripts are stored. # Default value: {mail_location}/sieve #sieve_dir=~/sieve

2 1

[Dovecot] PostgreSQL driver supporting [round-robin] load balancing and redundancy [LONG]
by Rainer Weikusat 18 Apr '10

18 Apr '10

One of the things my employer uses dovecot for is as mail download server for an 'e-mail purification service' (AV/ anti-spam) for smartphones. The service itself presently runs on a rented server somewhere in the UK and the corresponding 'web service' front-end and user account/ mail account database resides on a server in Germany. The UK dovecot server uses the PostgreSQL server on the German machine for user authentication. The latter is reachable using two entirely different 'internet paths' and there was an outage of several hours on one of them a couple of weeks ago. This prompted some frantic network reconfiguration efforts in order to get the abovementioned service going again and resulted in the conviction that - ideally - the dovecot server should be capable of using connections to multiple PostgreSQL servers (or a single server reachable via several IPs) simultaneoulsy, distributing requests among them, and should be capable of detecting a possible problem on one of the db server connections and use the still functioning ones to continue operations. After having spent about eight hours reading through the code of existing pgsql driver, I concluded that modifying that in order to achieve the goals outlined above would require some major brain surgery with a high chance of causing a lot of collateral damage in the course of that and that writing a new driver providing the sought-after feature set was the better idea. Which is the point of this e-mail. Example Usage ------------- Multiple connections can be specified in an ordinary connect-string by separating the necessary parameters with a ;;;-sequence. For the server I was writing about above, this looks like: connect = host=1.1.1.1 dbname=mailgate user=mailgate_user password=secret sslmode=require ;;; \ host=2.2.2.2 dbname=mailgate user=mailgate_user password=secret sslmode=require Leading and trailing whitespace in a connect sub-string is ignored. Basic Operation --------------- After having split the connect string, the driver creates a connection structure (struct multi_pgsql_pgc) for each connection specification contained in that and initiates an asynchronous connect for each. As the actual connections become ready, they are put onto a (linked list) (FIFO) queue of 'connections which are ready'. When a query is submitted to the driver, the first connection structure is removed from the ready list and used to execute the query. After this has finished, the connection is added to the end of the 'connections which are ready' list. If no connection is ready at the time a query was submitted, the query is put on a FIFO queue of queries which will be executed as the resources to actually do so become availabe. Each query has a lifetime of 60 seconds (arbitrary). A query which couldn't be started before his lifetime was over will be aborted with a timeout error. A connection which is currently being used to execute a query will be considered dead if no forward progress of any kind has happened for 20 seconds (also arbitrary). If this happens (or if some kind of I/O error occurs), the existing connection will be closed and an asychronous connect on a newly created one will be started. Assuming the lifetime of the query isn't yet over, it will either be started again on another available connection or pushed back onto the front of the query queue, causing it to be started as soon as a connection becomes available. Attemtps to reestablish the failed connection will continue (with 5 seconds of delay between each) in the background until success. Design Overview --------------- struct multi_pgsql_pgdb & routines working on that provide both the 'simple' query interface and transaction support. struct multi_pgsql_pgc represents a database connection. The result interface is implemented as struct multi_pgsql_result & assorted subroutines. Transactions are provided by a struct multi_pgsql_transaction_context which contains a linked-list of transaction subqueries (struct multi_pgsql_transaction_subquery). A 'class hierarchy' of 'query classes' is used to provide the different kinds of 'queries' supported by the driver (simple queries, simple synchronous queries, transaction queries, synchronous transaction queries). The complete hierarchy itself looks like this: multi_pgsql_query / \ / \ multi_pgsql_simple_query multi_pgsql_transaction_query / \ / \ / \ / \ multi_pgsql_user_query multi_pgsql_sync_query \ / \ / \ multi_pgsql_async_transaction_query multi_pgsql_sync_transaction_query Notable Difference to the pgsql Driver -------------------------------------- sql_exec This interface is not implemented. It is (as far as I can tell) not used anywhere except inside the sqllite driver. It cannot be used for queries which return information because there is no way to access this information and it can neither generally be used for queries which cause side effects since it cannot be determined if execution was successful (the only possible use I can think of is actually a rollback after a failed transaction). sql_result_get_field_value_binary Not implemented. Appears to be unused and the way I understand the libpq programming documentation, the only way to retrieve a binary result to some query is to use PQsendQueryParams or PQsendQueryPrepare and request that some columns are returned in binary. Nothing like this is supported in the present, abstract SQL database interface. synchronous query execution Because background connection reestablishment might still be going on after a synchronous query has been executed, it is necessary to switch any timeouts/ io operations registered to the ioloop used for synchronous query execution back to the main ioloop. The code implements this by using io_loop_set_current to temporarily restore the original ioloop, unregistering and registering any timeouts/ io-requests possibly associated with one of the existing database connections, switching back to the synchronous execution ioloop afterwards and then destroying that via io_loop_destroy. This works but is probably not exactly how the existing interfaces were supposed to be used. error messages for synchronously committed transaction These are put onto the data stack by the commit_s subroutine which will hopefully (judging from the dict-code, this should work, too) be sufficient to enable them to survive until someone higher up in the callchain wants to look at them. Remarks on the Patch -------------------- Created against dovecot-1-2-cf3fe573a560. Applies cleanly to 1.2.11. Applies to 2.0.beta4 with a rejection because of a feature which doesn't exist anymore. The result can be compiled but it hasn't been tested. ---- Index: dovecot/configure.in =================================================================== RCS file: /sysdata/cvs/dovecot/configure.in,v retrieving revision 1.1.1.2 retrieving revision 1.1.1.2.6.9 diff -u -r1.1.1.2 -r1.1.1.2.6.9 --- dovecot/configure.in 15 Mar 2010 18:18:14 -0000 1.1.1.2 +++ dovecot/configure.in 5 Apr 2010 16:16:03 -0000 1.1.1.2.6.9 @@ -159,6 +159,11 @@ [ --with-sqlite Build with SQLite3 driver support], TEST_WITH(sqlite, $withval), want_sqlite=no) + +AC_ARG_WITH(multi-pgsql, +[ --with-multi-pgsql Build with PostgreSQL driver supporting multiple connections], + TEST_WITH(multi-pgsql, $withval), + want_multi_pgsql=no) AC_ARG_WITH(lucene, [ --with-lucene Build with CLucene full text search support], @@ -1969,7 +1974,12 @@ LIBS=$old_LIBS fi -if test $want_pgsql != no; then +want_pgsql_driver=no +test "$want_pgsql" != no && want_pgsql_driver=yes +test "$want_multi_pgsql" != no && want_pgsql_driver=yes + + +if test $want_pgsql_driver != no; then AC_CHECK_PROG(PG_CONFIG, pg_config, YES, NO) if test $PG_CONFIG = NO; then # based on code from PHP @@ -2014,19 +2024,20 @@ fi PGSQL_LIBS="$PGSQL_LIBS -lpq" AC_DEFINE(HAVE_PGSQL,, Build with PostgreSQL support) - found_sql_drivers="$found_sql_drivers pgsql" + test "$want_pgsql" != no && found_sql_drivers="$found_sql_drivers pgsql" + test "$want_multi_pgsql" != no && found_sql_drivers="$found_sql_drivers multi_pgsql" if test "$all_sql_drivers" = "yes"; then - sql_drivers="$sql_drivers pgsql" + sql_drivers="$sql_drivers pgsql pgsql_timeout" fi ], [ - if test $want_pgsql = yes; then + if test $want_pgsql_driver = yes; then AC_ERROR([Can't build with PostgreSQL support: libpq-fe.h not found]) fi ]) CPPFLAGS=$old_CPPFLAGS ], [ - if test $want_pgsql = yes; then + if test $want_pgsql_driver = yes; then AC_ERROR([Can't build with PostgreSQL support: libpq not found]) fi ]) @@ -2323,6 +2334,7 @@ build_pgsql=no build_mysql=no build_sqlite=no +build_multi_pgsql=no for driver in $sql_drivers; do if test "$driver" = "pgsql"; then AC_DEFINE(BUILD_PGSQL,, Built-in PostgreSQL support) @@ -2333,7 +2345,10 @@ elif test "$driver" = "sqlite"; then AC_DEFINE(BUILD_SQLITE,, Built-in SQLite support) build_sqlite=yes - fi + elif test "$driver" = "multi_pgsql"; then + AC_DEFINE(BUILD_MULTI_PGSQL,, Built-in PostgreSQL support with multiple connection support) + build_multi_pgsql=yes + fi done if test $build_pgsql = no; then not_sql_drivers="$not_sql_drivers pgsql" @@ -2344,11 +2359,15 @@ if test $build_sqlite = no; then not_sql_drivers="$not_sql_drivers sqlite" fi +if test $build_multi_pgsql = no; then + not_sql_drivers="$not_sql_drivers multi_pgsql" +fi AC_SUBST(sql_drivers) AM_CONDITIONAL(BUILD_PGSQL, test "$build_pgsql" = "yes") AM_CONDITIONAL(BUILD_MYSQL, test "$build_mysql" = "yes") AM_CONDITIONAL(BUILD_SQLITE, test "$build_sqlite" = "yes") +AM_CONDITIONAL(BUILD_MULTI_PGSQL, test "$build_multi_pgsql" = "yes") AM_CONDITIONAL(SQL_PLUGINS, test "$want_sql" = "plugin") dnl ** Index: dovecot/src/lib-sql/Makefile.am =================================================================== RCS file: /sysdata/cvs/dovecot/src/lib-sql/Makefile.am,v retrieving revision 1.1.1.1 retrieving revision 1.1.1.1.6.3 diff -u -r1.1.1.1 -r1.1.1.1.6.3 --- dovecot/src/lib-sql/Makefile.am 28 Dec 2009 13:52:04 -0000 1.1.1.1 +++ dovecot/src/lib-sql/Makefile.am 5 Apr 2010 15:05:54 -0000 1.1.1.1.6.3 @@ -15,11 +15,16 @@ SQLITE_LIB = libdriver_sqlite.la SQL_DRIVER_PLUGINS += sqlite endif +if BUILD_MULTI_PGSQL +MULTI_PGSQL_LIB = libdriver_multi_pgsql.la +SQL_DRIVER_PLUGINS += multi_pgsql +endif sql_module_LTLIBRARIES = \ $(MYSQL_LIB) \ $(PGSQL_LIB) \ - $(SQLITE_LIB) + $(SQLITE_LIB) \ + $(MULTI_PGSQL_LIB) sql_moduledir = $(moduledir)/sql endif @@ -39,7 +44,8 @@ driver_sources = \ driver-mysql.c \ driver-pgsql.c \ - driver-sqlite.c + driver-sqlite.c \ + driver-multi-pgsql.c endif libsql_a_SOURCES = \ @@ -62,6 +68,11 @@ libdriver_sqlite_la_LIBADD = $(SQLITE_LIBS) libdriver_sqlite_la_CPPFLAGS = -I$(top_srcdir)/src/lib $(SQLITE_CFLAGS) libdriver_sqlite_la_SOURCES = driver-sqlite.c + +libdriver_multi_pgsql_la_LDFLAGS = -module -avoid-version +libdriver_multi_pgsql_la_LIBADD = $(MULTI_PGSQL_LIBS) +libdriver_multi_pgsql_la_CPPFLAGS = -I$(top_srcdir)/src/lib $(MULTI_PGSQL_CFLAGS) +libdriver_multi_pgsql_la_SOURCES = driver-multi-pgsql.c endif headers = \ Index: dovecot/src/lib-sql/driver-multi-pgsql.c =================================================================== RCS file: dovecot/src/lib-sql/driver-multi-pgsql.c diff -N dovecot/src/lib-sql/driver-multi-pgsql.c --- /dev/null 1 Jan 1970 00:00:00 -0000 +++ dovecot/src/lib-sql/driver-multi-pgsql.c 14 Apr 2010 15:31:48 -0000 1.1.2.134 @@ -0,0 +1,1763 @@ +/* + Copyright (c) MAD Partners, Ltd 2010 (rweikusat(a)madpartnerltd.com) + Portions Copyright (c) 2004-2010 Dovecot authors, see the included COPYING file +*/ + +/* includes */ +#include "lib.h" +#include "array.h" +#include "ioloop.h" +#include "ioloop-internal.h" /* kind of dirty, but it should be fine.. */ +#include "sql-api-private.h" + +#ifdef BUILD_MULTI_PGSQL +#include <ctype.h> +#include <stdlib.h> +#include <time.h> +#include <libpq-fe.h> + +/* macros */ +/* #define DEBUG */ +#ifdef DEBUG +# define dprintf(args) i_info args +#else +# define dprintf(args) +#endif + +#define DEINIT_ERROR "db driver deinit" +#define TIMEOUT_ERROR "query timed out" + +/* constants */ +enum { + MULTI_PGSQL_POOL = 512, + MULTI_PGSQL_XACT_POOL = 1024, + + TIMEOUT_UNIT = 1000, + + RECONNECT_DELAY = 5 * TIMEOUT_UNIT, + USER_QUERY_LIFETIME = 60, + + PGC_IO_TIMEOUT = 20, + MIN_QUERY_TIMEOUT = 10 +}; + +/** general helper routines */ +static char *kill_pg_errmsg_newline(char *s) +{ + char *r; + unsigned c; + + r = s; + while ((c = *r) && c != '\n') ++r; + if (c) *r = 0; + + return s; +} + +/** error result */ +struct multi_pgsql_error_result { + struct sql_result api; + char *msg; +}; + +static void error_result_free(struct sql_result *r) +{ + struct multi_pgsql_error_result *result; + + result = (void *)r; + dprintf(("%s: %p", __func__, result)); + + i_free(result->msg); + i_free(result); +} + +static void error_result_nop(struct sql_result *r) +{ + dprintf(("%s: %p", __func__, r)); +} + +static int error_result_next_row(struct sql_result *r) +{ + dprintf(("%s: %p", __func__, r)); + return -1; +} + +static char const *error_result_get_error(struct sql_result *r) +{ + struct multi_pgsql_error_result *result; + + result = (void *)r; + dprintf(("%s: %p", __func__, result)); + + return result->msg; +} + +static void init_error_result(struct multi_pgsql_error_result *result, + char const *msg) +{ + struct sql_result_vfuncs *v; + + memset(&result->api, 0, sizeof(result->api)); + + v = &result->api.v; + v->free = error_result_nop; + v->next_row = error_result_next_row; + v->get_error = error_result_get_error; + + result->msg = (char *)msg; + + dprintf(("%s: %p", __func__, result)); +} + +/** multi_pgsql_result */ +struct multi_pgsql_result { + struct sql_result api; + struct multi_pgsql_pgc *pgc; + + PGresult *pgr; + unsigned row, n_rows; + char const **values, *errmsg; +}; + +/*** methods/ subroutines */ +static void multi_pgsql_result_free(struct sql_result *r) +{ + struct multi_pgsql_result *result; + + result = (void *)r; + + PQclear(result->pgr); + if (result->values) i_free(result->values); + i_free(result); +} + +static void multi_pgsql_result_nop(struct sql_result *r) +{ + (void)r; +} + + +static int multi_pgsql_result_next_row(struct sql_result *r) +{ + struct multi_pgsql_result *result; + unsigned row; + + dprintf(("%s: %p", __func__, r)); + + result = (void *)r; + row = result->row; + if (++row < result->n_rows) return result->row = row; + return 0; +} + +static int multi_pgsql_result_first_row(struct sql_result *r) +{ + struct multi_pgsql_result *result; + PGresult *pgr; + ExecStatusType status; + unsigned n_rows; + + result = (void *)r; + pgr = result->pgr; + + status = PQresultStatus(pgr); + dprintf(("%s: %p: result status %s(%d)", + __func__, r, PQresStatus(status), status)); + + switch (status) { + case PGRES_COMMAND_OK: + case PGRES_COPY_OUT: + case PGRES_COPY_IN: + n_rows = 0; + break; + + case PGRES_TUPLES_OK: + n_rows = PQntuples(pgr); + + dprintf(("%s: %p: %u rows", __func__, result, n_rows)); + break; + + default: + return -1; + } + + result->n_rows = n_rows; + result->api.v.next_row = multi_pgsql_result_next_row; + return n_rows; +} + +static unsigned multi_pgsql_result_get_fields_count(struct sql_result *r) +{ + struct multi_pgsql_result *result; + unsigned count; + + result = (void *)r; + count = PQnfields(result->pgr); + + dprintf(("%s: %p: %u", __func__, result, count)); + return count; +} + +static char const *multi_pgsql_result_get_field_name(struct sql_result *r, + unsigned i) +{ + struct multi_pgsql_result *result; + char const *name; + + result = (void *)r; + name = PQfname(result->pgr, i); + + dprintf(("%s: %p: %u: '%s'", __func__, result, i, name)); + return name; +} + +static int multi_pgsql_result_find_field(struct sql_result *r, + char const *fname) +{ + struct multi_pgsql_result *result; + int i; + + result = (void *)r; + i = PQfnumber(result->pgr, fname); + + if (i == -1) { + i_info("%s: %p: no field named '%s'", + __func__, result, fname); + return -1; + } + + dprintf(("%s: %p: '%s' <-> %d", + __func__, result, fname, i)); + return i; +} + +static char const *multi_pgsql_result_get_field_value(struct sql_result *r, + unsigned i) +{ + struct multi_pgsql_result *result; + char const *value; + unsigned row; + + result = (void *)r; + row = result->row; + value = PQgetvalue(result->pgr, row, i); + if (!*value && PQgetisnull(result->pgr, row, i)) value = NULL; + + dprintf(("%s: %p: %u,%u: '%s'", + __func__, result, row, i, value ? value : "NULL")); + return value; +} + +static unsigned char const * +multi_pgsql_result_get_field_value_binary(struct sql_result *r, + unsigned i, size_t *size) +{ + (void)i; + i_info("%s: %p: not implemented", __func__, r); + + *size = 0; + return NULL; +} + +static char const *multi_pgsql_result_find_field_value(struct sql_result *r, + char const *fname) +{ + int i; + + dprintf(("%s: %p", __func__, r)); + + i = r->v.find_field(r, fname); + return i != -1 ? r->v.get_field_value(r, i) : NULL; +} + +static char const * const *multi_pgsql_result_get_values(struct sql_result *r) +{ + struct multi_pgsql_result *result; + char const **values; + unsigned n; + + dprintf(("%s: %p", __func__, r)); + result = (void *)r; + + values = result->values; + if (values) return values; + + n = r->v.get_fields_count(r); + values = result->values = i_new(char const *, n); + do { + --n; + values[n] = r->v.get_field_value(r, n); + } while (n); + + return values; +} + +static char const * +multi_pgsql_result_get_error(struct sql_result *r) +{ + struct multi_pgsql_result *result; + char const *errmsg; + + result = (void *)r; + + errmsg = result->errmsg; + if (errmsg) return errmsg; + + errmsg = result->errmsg = + kill_pg_errmsg_newline(PQresultErrorMessage(result->pgr)); + return errmsg; +} + +/*** vtable/ init */ +static struct sql_result multi_pgsql_result = { + MEMBER(v) { + multi_pgsql_result_nop, + multi_pgsql_result_first_row, + multi_pgsql_result_get_fields_count, + multi_pgsql_result_get_field_name, + multi_pgsql_result_find_field, + multi_pgsql_result_get_field_value, + multi_pgsql_result_get_field_value_binary, + multi_pgsql_result_find_field_value, + multi_pgsql_result_get_values, + multi_pgsql_result_get_error + } +}; + +static void init_multi_pgsql_result(struct multi_pgsql_result *result, + PGresult *pgr) +{ + result->api = multi_pgsql_result; + result->pgr = pgr; + result->row = 0; + result->values = NULL; +} + +/** query classes */ +struct multi_pgsql_query { + struct multi_pgsql_query *p; + struct multi_pgsql_query_vtable *vtable; +}; + +struct multi_pgsql_query_vtable { + void (*start)(struct multi_pgsql_query *, struct multi_pgsql_pgc *); + void (*result)(struct multi_pgsql_query *, struct multi_pgsql_pgc *, + PGresult **); + void (*abort)(struct multi_pgsql_query *, struct sql_result *); + void (*dtor)(struct multi_pgsql_query *); + time_t (*eol)(struct multi_pgsql_query *); + void (*set_sync_ioloop)(struct multi_pgsql_query *, struct ioloop *); + char const *(*get_query)(struct multi_pgsql_query *); +}; + +static void start_new_query_on_pgc(struct multi_pgsql_query *, struct multi_pgsql_pgc *); +static void start_query_on_pgc(struct multi_pgsql_pgc *); +static void done_with_query(struct multi_pgsql_pgc *); + +/*** method invocation wrappers */ +#define the_qry(q) ((struct multi_pgsql_query *)q) + +static inline void start_query(void *q, struct multi_pgsql_pgc *pgc) +{ + dprintf(("%s: %p", __func__, q)); + the_qry(q)->vtable->start(the_qry(q), pgc); +} + +static inline void query_result(void *q, struct multi_pgsql_pgc *pgc, + PGresult **pgr) +{ + dprintf(("%s: %p", __func__, q)); + the_qry(q)->vtable->result(the_qry(q), pgc, pgr); +} + +static inline void abort_query(void *q, struct sql_result *r) +{ + dprintf(("%s: %p", __func__, q)); + + the_qry(q)->vtable->abort(the_qry(q), r); + the_qry(q)->vtable->dtor(the_qry(q)); +} + +static inline void destroy_query(void *q) +{ + dprintf(("%s: %p", __func__, q)); + the_qry(q)->vtable->dtor(the_qry(q)); +} + +static inline time_t query_eol(void *q) +{ + dprintf(("%s: %p", __func__, q)); + return the_qry(q)->vtable->eol(the_qry(q)); +} + +static inline void set_query_sync_ioloop(void *q, struct ioloop *ioloop) +{ + dprintf(("%s: %p", __func__, q)); + the_qry(q)->vtable->set_sync_ioloop(the_qry(q), ioloop); +} + +static inline char const *get_query(void *q) +{ + return + the_qry(q)->vtable->get_query(the_qry(q)); +} + +#undef the_qry + +/*** query */ +static void init_multi_pgsql_query(struct multi_pgsql_query *qry, + struct multi_pgsql_query_vtable *vtable) +{ + qry->p = NULL; + qry->vtable = vtable; +} + +/*** simple_query */ +struct multi_pgsql_simple_query { + struct multi_pgsql_query super; + + time_t eol_at; + char *query; +}; + +static void start_simple_query(struct multi_pgsql_query *q, + struct multi_pgsql_pgc *pgc) +{ + start_new_query_on_pgc(q, pgc); +} + +static time_t simple_query_eol(struct multi_pgsql_query *q) +{ + struct multi_pgsql_simple_query *qry; + + qry = (void *)q; + dprintf(("%s: %p", __func__, qry)); + return qry->eol_at; +} + +static char const *simple_query_get_query(struct multi_pgsql_query *q) +{ + return ((struct multi_pgsql_simple_query *)q)->query; +} + +static void init_simple_query(struct multi_pgsql_simple_query *qry, + struct multi_pgsql_query_vtable *vtable, + unsigned query_lifetime, char const *query) +{ + init_multi_pgsql_query(&qry->super, vtable); + + qry->query = (void *)query; + qry->eol_at = time(NULL) + query_lifetime; +} + +/*** user_query */ +struct multi_pgsql_user_query { + struct multi_pgsql_simple_query super; + + sql_query_callback_t *cb; + void *ctx; +}; + +static void abort_user_query(struct multi_pgsql_query *q, + struct sql_result *r) +{ + struct multi_pgsql_user_query *qry; + + qry = (void *)q; + + T_BEGIN { + qry->cb(r, qry->ctx); + } T_END; +} + +static void user_query_result(struct multi_pgsql_query *q, + struct multi_pgsql_pgc *pgc, + PGresult **pgr) +{ + struct multi_pgsql_result result; + struct multi_pgsql_user_query *qry; + + qry = (void *)q; + init_multi_pgsql_result(&result, *pgr); + + T_BEGIN { + qry->cb(&result.api, qry->ctx); + } T_END; + + if (result.values) i_free(result.values); + + done_with_query(pgc); +} + +static void user_query_dtor(struct multi_pgsql_query *q) +{ + struct multi_pgsql_user_query *qry; + + qry = (void *)q; + + i_free(qry->super.query); + i_free(qry); +} + +/**** vtable/ init */ +static struct multi_pgsql_query_vtable user_query_vtable = { + start_simple_query, + user_query_result, + abort_user_query, + user_query_dtor, + simple_query_eol, + NULL, + simple_query_get_query +}; + +static struct multi_pgsql_query *create_user_query(char const *query, + sql_query_callback_t *cb, void *ctx) +{ + struct multi_pgsql_user_query *qry; + + qry = i_new(struct multi_pgsql_user_query, 1); + + init_simple_query(&qry->super, &user_query_vtable, + USER_QUERY_LIFETIME, i_strdup(query)); + + qry->cb = cb; + qry->ctx = ctx; + return (void *)qry; +} + +/*** sync_query */ +struct multi_pgsql_sync_query { + struct multi_pgsql_simple_query super; + + struct ioloop *ioloop; + PGresult *pgr; + char *errmsg; +}; + +static void sync_query_result(struct multi_pgsql_query *q, + struct multi_pgsql_pgc *pgc, + PGresult **pgr) +{ + struct multi_pgsql_sync_query *qry; + + qry = (void *)q; + + qry->errmsg = NULL; + qry->pgr = *pgr; + *pgr = NULL; + + done_with_query(pgc); +} + +static void abort_sync_query(struct multi_pgsql_query *q, + struct sql_result *r) +{ + struct multi_pgsql_sync_query *qry; + + qry = (void *)q; + + qry->pgr = NULL; + qry->errmsg = i_strdup(r->v.get_error(r)); +} + +static void sync_query_dtor(struct multi_pgsql_query *q) +{ + struct multi_pgsql_sync_query *qry; + + qry = (void *)q; + io_loop_stop(qry->ioloop); +} + +static void set_sync_query_sync_ioloop(struct multi_pgsql_query *q, + struct ioloop *ioloop) +{ + struct multi_pgsql_sync_query *qry; + + qry = (void *)q; + qry->ioloop = ioloop; +} + +static struct sql_result * +result_from_sync_query(struct multi_pgsql_sync_query *qry) +{ + struct sql_result *result; + PGresult *pgr; + + pgr = qry->pgr; + + if (!pgr) { + result = (void *)i_new(struct multi_pgsql_error_result, 1); + init_error_result((void *)result, qry->errmsg); + result->v.free = error_result_free; + + return result; + } + + result = (void *)i_new(struct multi_pgsql_result, 1); + init_multi_pgsql_result((void *)result, pgr); + result->v.free = multi_pgsql_result_free; + + return result; +} + +/**** vtable/ init */ +static struct multi_pgsql_query_vtable sync_query_vtable = { + start_simple_query, + sync_query_result, + abort_sync_query, + sync_query_dtor, + simple_query_eol, + set_sync_query_sync_ioloop, + simple_query_get_query +}; + +static inline void init_sync_query(struct multi_pgsql_sync_query *qry, + char const *query) +{ + init_simple_query(&qry->super, &sync_query_vtable, + USER_QUERY_LIFETIME, query); +} + +/*** transaction query */ +struct multi_pgsql_transaction_subquery { + struct multi_pgsql_transaction_subquery *p; + + char *query; + unsigned *affected_rows; +}; + +struct multi_pgsql_transaction_context { + struct sql_transaction_context super; + struct multi_pgsql_transaction_subquery *first, **link_to; + pool_t pool; +}; + +struct multi_pgsql_transaction_query { + struct multi_pgsql_query super; + struct multi_pgsql_transaction_context *x_ctx; + + struct multi_pgsql_transaction_subquery *sub; + time_t cur_eol; + + /* + If set, points to the PGresult corresponding + with the subquery which caused the transaction + to fail. + */ + PGresult *pgr; +}; + +struct multi_pgsql_transaction_query_vtable { + struct multi_pgsql_query_vtable super; + void (*xact_done)(struct multi_pgsql_transaction_query *, char const *); +}; + +static inline void transaction_query_xact_done(void *q, char const *errmsg) +{ + struct multi_pgsql_transaction_query *qry; + struct multi_pgsql_transaction_query_vtable *vtable; + + dprintf(("%s: %p", __func__, q)); + + qry = q; + vtable = (void *)qry->super.vtable; + vtable->xact_done(q, errmsg); +} + + +static void start_transaction_query(struct multi_pgsql_query *q, + struct multi_pgsql_pgc *pgc) +{ + struct multi_pgsql_transaction_query *qry; + + qry = (void *)q; + qry->sub = qry->x_ctx->first; + start_new_query_on_pgc(q, pgc); +} + +static void transaction_query_result(struct multi_pgsql_query *q, + struct multi_pgsql_pgc *pgc, + PGresult **ppgr) +{ + struct multi_pgsql_transaction_query *qry; + struct multi_pgsql_transaction_subquery *sub; + PGresult *pgr; + char const *errmsg; + ExecStatusType status; + + qry = (void *)q; + + pgr = qry->pgr; + if (pgr) { + errmsg = kill_pg_errmsg_newline(PQresultErrorMessage(pgr)); + + query_done: + transaction_query_xact_done(qry, errmsg); + done_with_query(pgc); + return; + } + + sub = qry->sub; + + pgr = *ppgr; + status = PQresultStatus(pgr); + dprintf(("%s: %p: status %s(%d)", + __func__, qry, PQresStatus(status), status)); + + switch (status) { + case PGRES_COMMAND_OK: + case PGRES_TUPLES_OK: + case PGRES_COPY_OUT: + case PGRES_COPY_IN: + if (sub->affected_rows) + *sub->affected_rows = atoi(PQcmdTuples(pgr)); + + sub = sub->p; + if (!sub) { + errmsg = NULL; + goto query_done; + } + + qry->sub = sub; + qry->cur_eol = time(NULL) + USER_QUERY_LIFETIME; + break; + + default: + qry->pgr = pgr; + *ppgr = NULL; + + qry->cur_eol = 0; /* don't restart failed transactions */ + sub->query = "rollback"; + } + + start_query_on_pgc(pgc); +} + +static void abort_transaction_query(struct multi_pgsql_query *q, + struct sql_result *r) +{ + char const *errmsg; + PGresult *pgr; + + pgr = ((struct multi_pgsql_transaction_query *)q)->pgr; + errmsg = pgr ? + kill_pg_errmsg_newline(PQresultErrorMessage(pgr)) : r->v.get_error(r); + transaction_query_xact_done(q, errmsg); +} + +static time_t transaction_query_eol(struct multi_pgsql_query *q) +{ + return ((struct multi_pgsql_transaction_query *)q)->cur_eol; +} + +static void transaction_query_dtor(struct multi_pgsql_query *q) +{ + struct multi_pgsql_transaction_query *qry; + PGresult *pgr; + pool_t pool; + + qry = (void *)q; + + pgr = qry->pgr; + if (pgr) PQclear(pgr); + + pool = qry->x_ctx->pool; + pool_unref(&pool); +} + +static char const *transaction_query_get_query(struct multi_pgsql_query *q) +{ + struct multi_pgsql_transaction_query *qry; + + qry = (void *)q; + return qry->sub->query; +} + +static void init_transaction_query(struct multi_pgsql_transaction_query *qry, + struct multi_pgsql_transaction_query_vtable *vtable, + struct multi_pgsql_transaction_context *x_ctx) +{ + init_multi_pgsql_query(&qry->super, &vtable->super); + + qry->x_ctx = x_ctx; + qry->cur_eol = time(NULL) + USER_QUERY_LIFETIME; + qry->pgr = NULL; +} + +/*** async transaction query */ +struct multi_pgsql_async_transaction_query { + struct multi_pgsql_transaction_query super; + + sql_commit_callback_t *cb; + void *ctx; +}; + +static void async_transaction_query_xact_done(struct multi_pgsql_transaction_query *q, + char const *errmsg) +{ + struct multi_pgsql_async_transaction_query *qry; + + qry = (void *)q; + qry->cb(errmsg, qry->ctx); +} + +/**** vtable/ init */ +static struct multi_pgsql_transaction_query_vtable async_transaction_query_vtable = { + { + start_transaction_query, + transaction_query_result, + abort_transaction_query, + transaction_query_dtor, + transaction_query_eol, + NULL, + transaction_query_get_query }, + + async_transaction_query_xact_done +}; + +static void +init_async_transaction_query(struct multi_pgsql_async_transaction_query *qry, + struct multi_pgsql_transaction_context *x_ctx, + sql_commit_callback_t *cb, void *cb_ctx) +{ + init_transaction_query(&qry->super, + &async_transaction_query_vtable, x_ctx); + + qry->cb = cb; + qry->ctx = cb_ctx; +} + +/*** sync transaction query */ +struct multi_pgsql_sync_transaction_query { + struct multi_pgsql_transaction_query super; + + struct ioloop *ioloop; + char const *errmsg; +}; + +static void sync_transaction_query_dtor(struct multi_pgsql_query *q) +{ + struct multi_pgsql_sync_transaction_query *qry; + + qry = (void *)q; + io_loop_stop(qry->ioloop); + transaction_query_dtor(q); +} + +static void set_sync_transaction_query_sync_ioloop(struct multi_pgsql_query *q, + struct ioloop *ioloop) +{ + struct multi_pgsql_sync_transaction_query *qry; + + qry = (void *)q; + qry->ioloop = ioloop; +} + +static void sync_transaction_query_xact_done(struct multi_pgsql_transaction_query *q, + char const *errmsg) +{ + struct multi_pgsql_sync_transaction_query *qry; + + qry = (void *)q; + qry->errmsg = i_strdup(errmsg); +} + +/**** vtable/ init */ +static struct multi_pgsql_transaction_query_vtable sync_transaction_query_vtable = { + { + start_transaction_query, + transaction_query_result, + abort_transaction_query, + sync_transaction_query_dtor, + transaction_query_eol, + set_sync_transaction_query_sync_ioloop, + transaction_query_get_query }, + + sync_transaction_query_xact_done +}; + +static void init_sync_transaction_query(struct multi_pgsql_sync_transaction_query *qry, + struct multi_pgsql_transaction_context *x_ctx) +{ + init_transaction_query(&qry->super, + &sync_transaction_query_vtable, x_ctx); +} + +/** pgc (connection) code */ +struct multi_pgsql_pgc { + struct multi_pgsql_pgc *p; + + char *connect_string; + PGconn *pgc; + PGresult *pgr; + struct multi_pgsql_db *pgdb; + struct multi_pgsql_query *qry; + struct io *io; + struct timeout *timeout; +}; + +/*** misc */ +static void start_pgc_connect(struct multi_pgsql_pgc *); + +static void init_pgc(struct multi_pgsql_pgc *pgc, + struct multi_pgsql_db *pgdb, char *connect_string) +{ + pgc->connect_string = connect_string; + pgc->pgdb = pgdb; + + dprintf(("%s: pgc %p, '%s'", __func__, pgc, connect_string)); + + start_pgc_connect(pgc); +} + +static void reset_pgc(struct multi_pgsql_pgc *pgc) +{ + dprintf(("%s: %p", __func__, pgc)); + + if (pgc->io) io_remove(&pgc->io); + if (pgc->timeout) timeout_remove(&pgc->timeout); + + if (pgc->pgr) { + PQclear(pgc->pgr); + pgc->pgr = NULL; + } + + if (pgc->pgc) { + PQfinish(pgc->pgc); + pgc->pgc = NULL; + } +} + +static void pgc_ioloop_switch(struct multi_pgsql_pgc *pgc) +{ + union { + struct io io; + struct timeout timeout; + } old; + + if (pgc->io) { + old.io = *pgc->io; + io_remove(&pgc->io); + + pgc->io = io_add(PQsocket(pgc->pgc), + old.io.condition, old.io.callback, old.io.context); + } + + if (pgc->timeout) { + old.timeout = *pgc->timeout; + timeout_remove(&pgc->timeout); + + pgc->timeout = timeout_add(old.timeout.msecs, + old.timeout.callback, old.timeout.context); + } +} + +static void log_pg_error(struct multi_pgsql_pgc *pgc, char const *fnc, char const *pg_call) +{ + i_error("%s: %p: %s: %s", + fnc, pgc, pg_call, kill_pg_errmsg_newline(PQerrorMessage(pgc->pgc))); +} + +/*** connection establishment */ +static void add_ready_pgc(struct multi_pgsql_db *, struct multi_pgsql_pgc *); + +static void restart_pgc_connect(struct multi_pgsql_pgc *pgc) +{ + timeout_remove(&pgc->timeout); + start_pgc_connect(pgc); +} + +static void continue_pgc_connect(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + char const *pg_call; + PostgresPollingStatusType status; + int io_dir, rc; + + io_remove(&pgc->io); + the_pgc = pgc->pgc; + + status = PQconnectPoll(the_pgc); + dprintf(("%s: %p: PQconnectPoll returned %d", + __func__, pgc, status)); + + switch (status) { + /* + According to the PostgreSQL source, this is an + unused legacy constant. Here to prevent gcc from + complaining about it. + */ + case PGRES_POLLING_ACTIVE: + case PGRES_POLLING_OK: + rc = PQsetnonblocking(the_pgc, 1); + if (rc == -1) { + pg_call = "PQsetnonblocking"; + goto error; + } + + i_info("%s: %p: connected", __func__, pgc); + add_ready_pgc(pgc->pgdb, pgc); + return; + + case PGRES_POLLING_FAILED: + pg_call = "PQconnectPoll"; + goto error; + + case PGRES_POLLING_READING: + io_dir = IO_READ; + break; + + case PGRES_POLLING_WRITING: + io_dir = IO_WRITE; + } + + pgc->io = io_add(PQsocket(the_pgc), io_dir, continue_pgc_connect, pgc); + return; + +error: + log_pg_error(pgc, __func__, pg_call); + + PQfinish(the_pgc); + pgc->pgc = NULL; + + pgc->timeout = timeout_add(RECONNECT_DELAY, + restart_pgc_connect, pgc); +} + +static void start_pgc_connect(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + + dprintf(("%s: %p", __func__, pgc)); + + pgc->pgc = the_pgc = PQconnectStart(pgc->connect_string); + if (!the_pgc) + i_fatal("%s: %p: out of memory", + __func__, pgc); + + if (PQstatus(the_pgc) == CONNECTION_BAD) { + log_pg_error(pgc, __func__, "PQconnectStart"); + pgc->timeout = timeout_add(RECONNECT_DELAY, + restart_pgc_connect, pgc); + return; + } + + pgc->io = io_add(PQsocket(the_pgc), IO_WRITE, + continue_pgc_connect, pgc); +} + +/*** query processing */ +/**** error handling */ +static void requeue_query_to_pgdb(struct multi_pgsql_query *, struct multi_pgsql_db *); + +static void pgc_query_io_timeout(struct multi_pgsql_pgc *pgc) +{ + i_info("%s: %p", __func__, pgc); + + requeue_query_to_pgdb(pgc->qry, pgc->pgdb); + pgc->qry = NULL; + + reset_pgc(pgc); + start_pgc_connect(pgc); +} + +static void pgc_query_processing_failure(struct multi_pgsql_pgc *pgc, + char const *fnc, + char const *pg_call) +{ + log_pg_error(pgc, fnc, pg_call); + + requeue_query_to_pgdb(pgc->qry, pgc->pgdb); + pgc->qry = NULL; + + reset_pgc(pgc); + start_pgc_connect(pgc); +} + +/**** result processing */ +static void done_with_query(struct multi_pgsql_pgc *pgc) +{ + struct multi_pgsql_query *qry; + + qry = pgc->qry; + pgc->qry = NULL; + + destroy_query(qry); +} + +static inline int got_result(PGconn *pgc) +{ + PGresult *pgr; + + pgr = PQgetResult(pgc); + if (!pgr) return 0; + + PQclear(pgr); + return 1; +} + +static void eat_results(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + PGresult *pgr; + int rc; + + dprintf(("%s: %p", __func__, pgc)); + + the_pgc = pgc->pgc; + do { + rc = PQconsumeInput(the_pgc); + if (rc == 0) { + pgc_query_processing_failure(pgc, __func__, + "PQconsumeInput"); + return; + } + + if (PQisBusy(the_pgc)) { + timeout_reset(pgc->timeout); + return; + } + } while (got_result(the_pgc)); + + io_remove(&pgc->io); + timeout_remove(&pgc->timeout); + + pgr = pgc->pgr; + pgc->pgr = NULL; + query_result(pgc->qry, pgc, &pgr); + if (pgr) PQclear(pgr); + + if (!pgc->qry) add_ready_pgc(pgc->pgdb, pgc); +} + +static void get_first_result(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + PGresult *pgr; + int rc; + + dprintf(("%s: %p", __func__, pgc)); + the_pgc = pgc->pgc; + + rc = PQconsumeInput(the_pgc); + if (rc == 0) { + pgc_query_processing_failure(pgc, __func__, + "PQconsumeInput"); + return; + } + + if (PQisBusy(the_pgc)) { + dprintf(("%s: %p: still busy", __func__, pgc)); + + timeout_reset(pgc->timeout); + return; + } + + io_remove(&pgc->io); + + pgr = pgc->pgr = PQgetResult(the_pgc); + if (pgr) { + pgc->io = io_add(PQsocket(the_pgc), IO_READ, eat_results, pgc); + timeout_reset(pgc->timeout); + + eat_results(pgc); + return; + } else + timeout_remove(&pgc->timeout); + + + query_result(pgc->qry, pgc, NULL); + if (!pgc->qry) add_ready_pgc(pgc->pgdb, pgc); +} + +/**** query transmission */ +static void flush_query(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + int rc; + + dprintf(("%s: %p", __func__, pgc)); + the_pgc = pgc->pgc; + + rc = PQflush(the_pgc); + switch (rc) { + case -1: + pgc_query_processing_failure(pgc, __func__, + "PQflush"); + return; + + case 0: + dprintf(("%s: %p: query sent", __func__, pgc)); + + io_remove(&pgc->io); + pgc->io = io_add(PQsocket(the_pgc), IO_READ, get_first_result, pgc); + } + + timeout_reset(pgc->timeout); +} + +static void start_query_on_pgc(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + char const *pg_call, *query; + void (*io_cb)(struct multi_pgsql_pgc *); + int rc, io_dir; + + query = get_query(pgc->qry); + dprintf(("%s: %p: %s", __func__, pgc, query)); + + the_pgc = pgc->pgc; + + rc = PQsendQuery(the_pgc, query); + if (rc == 0) { + pg_call = "PQsendQuery"; + goto error; + } + + rc = PQflush(the_pgc); + switch (rc) { + case -1: + pg_call = "PQflush"; + goto error; + + case 0: + io_cb = get_first_result; + io_dir = IO_READ; + break; + + default: + io_cb = flush_query; + io_dir = IO_WRITE; + } + + pgc->io = io_add(PQsocket(the_pgc), io_dir, io_cb, pgc); + pgc->timeout = timeout_add(PGC_IO_TIMEOUT * TIMEOUT_UNIT, + pgc_query_io_timeout, pgc); + return; + +error: + pgc_query_processing_failure(pgc, __func__, "PQflush"); +} + +static void start_new_query_on_pgc(struct multi_pgsql_query *qry, + struct multi_pgsql_pgc *pgc) +{ + dprintf(("%s: %p -> %p", __func__, qry, pgc)); + + pgc->qry = qry; + start_query_on_pgc(pgc); +} + +/** pgdb */ +struct multi_pgsql_db { + struct sql_db api; + + unsigned n_pgcs; + struct multi_pgsql_pgc *pgcs; + + struct { + struct multi_pgsql_pgc *first, **link_to; + } pgc_q; + + struct { + struct timeout *timeout; + struct multi_pgsql_query *first, **link_to; + } query_q; + + pool_t pool; +}; + +static struct multi_pgsql_query *dequeue_query_from_pgdb(struct multi_pgsql_db *); + +/*** pgc support code */ +static void do_init_pgcs(struct multi_pgsql_db *pgdb, char const *s, unsigned ofs) +{ + char const *r, *lws_start; + unsigned c, semi_count; + + while ((c = *s) && isspace(c)) ++s; + + if (!c) { + if (!ofs) i_fatal("%s: empty connect string", __func__); + + dprintf(("%s: end of connect_string, %u pgcs", + __func__, ofs)); + + pgdb->n_pgcs = ofs; + pgdb->pgcs = p_new(pgdb->pool, struct multi_pgsql_pgc, ofs); + return; + } + + semi_count = 0; + lws_start = NULL; + r = s; + do { + if (c == ';') { + if (++semi_count == 3) break; + continue; + } + + semi_count = 0; + + if (isspace(c)) { + if (!lws_start) lws_start = r; + continue; + } + + lws_start = NULL; + } while ((c = *++r)); + + do_init_pgcs(pgdb, c ? r + 1 : r, ofs + 1); + + if (lws_start) r = lws_start; + else if (c) r -= 2; + + init_pgc(pgdb->pgcs + ofs, pgdb, p_strndup(pgdb->pool, s, r - s)); +} + +static inline void init_pgcs(struct multi_pgsql_db *pgdb, char const *connect_string) +{ + do_init_pgcs(pgdb, connect_string, 0); +} + +static void add_ready_pgc(struct multi_pgsql_db *pgdb, struct multi_pgsql_pgc *pgc) +{ + struct multi_pgsql_query *qry; + + if (!pgdb->pgc_q.first) { + qry = dequeue_query_from_pgdb(pgdb); + + if (qry) { + start_query(qry, pgc); + return; + } + } + + *pgdb->pgc_q.link_to = pgc; + pgdb->pgc_q.link_to = &pgc->p; + + dprintf(("%s: %p -> %p", __func__, pgc, pgdb)); +} + +static struct multi_pgsql_pgc *get_ready_pgc(struct multi_pgsql_db *pgdb) +{ + struct multi_pgsql_pgc *pgc, *next_pgc; + + pgc = pgdb->pgc_q.first; + if (!pgc) return NULL; + + next_pgc = pgc->p; + if (next_pgc) pgc->p = NULL; + else pgdb->pgc_q.link_to = &pgdb->pgc_q.first; + pgdb->pgc_q.first = next_pgc; + + dprintf(("%s: %p -> %p", __func__, pgdb, pgc)); + return pgc; +} + +static void switch_pgdb_pgcs(struct multi_pgsql_db *pgdb) +{ + struct multi_pgsql_pgc *pgcs; + unsigned n; + + pgcs = pgdb->pgcs; + n = pgdb->n_pgcs; + do pgc_ioloop_switch(pgcs + --n); while (n); +} + +/*** query timeout */ +static void start_pgdb_query_timeout(struct multi_pgsql_db *, + struct multi_pgsql_query *); + +static void pgdb_query_timeout(struct multi_pgsql_db *pgdb) +{ + struct multi_pgsql_query *qry, *next_qry; + struct multi_pgsql_error_result timeout; + time_t now; + + dprintf(("%s: %p", __func__, pgdb)); + + timeout_remove(&pgdb->query_q.timeout); + qry = pgdb->query_q.first; + now = time(NULL); + init_error_result(&timeout, TIMEOUT_ERROR); + do { + next_qry = qry->p; + abort_query(qry, &timeout.api); + } while (next_qry && now > query_eol(next_qry)); + + pgdb->query_q.first = next_qry; + + if (next_qry) { + start_pgdb_query_timeout(pgdb, next_qry); + return; + } + + pgdb->query_q.link_to = &pgdb->query_q.first; +} + +static void start_pgdb_query_timeout(struct multi_pgsql_db *pgdb, + struct multi_pgsql_query *qry) +{ + time_t now, timeout, eol; + + now = time(NULL); + eol = query_eol(qry); + timeout = now < eol ? eol - now : 0; + if (timeout < MIN_QUERY_TIMEOUT) timeout = MIN_QUERY_TIMEOUT; + + pgdb->query_q.timeout = timeout_add(timeout * TIMEOUT_UNIT, + pgdb_query_timeout, pgdb); + dprintf(("%s: %p: timeout in %us", __func__, pgdb, (unsigned)timeout)); +} + +/*** query queueing */ +static void queue_query_to_pgdb(struct multi_pgsql_query *qry, struct multi_pgsql_db *pgdb) +{ + if (!pgdb->query_q.first) start_pgdb_query_timeout(pgdb, qry); + + *pgdb->query_q.link_to = qry; + pgdb->query_q.link_to = &qry->p; +} + +static struct multi_pgsql_query *dequeue_query_from_pgdb(struct multi_pgsql_db *pgdb) +{ + struct multi_pgsql_query *qry, *next_qry; + + qry = pgdb->query_q.first; + if (!qry) return NULL; + + timeout_remove(&pgdb->query_q.timeout); + + next_qry = qry->p; + if (next_qry) start_pgdb_query_timeout(pgdb, next_qry); + else pgdb->query_q.link_to = &pgdb->query_q.first; + pgdb->query_q.first = next_qry; + + qry->p = NULL; + return qry; +} + +static void requeue_query_to_pgdb(struct multi_pgsql_query *qry, + struct multi_pgsql_db *pgdb) +{ + struct multi_pgsql_error_result timeout; + struct multi_pgsql_pgc *pgc; + + if (time(NULL) >= query_eol(qry)) { + init_error_result(&timeout, TIMEOUT_ERROR); + abort_query(qry, &timeout.api); + return; + } + + pgc = get_ready_pgc(pgdb); + if (pgc) { + start_query(qry, pgc); + return; + } + + if (pgdb->query_q.timeout) { + timeout_remove(&pgdb->query_q.timeout); + qry->p = pgdb->query_q.first; + } else + pgdb->query_q.link_to = &qry->p; + + pgdb->query_q.first = qry; + start_pgdb_query_timeout(pgdb, qry); +} + + +/*** query submission */ +static void pgdb_async_query(struct multi_pgsql_db *pgdb, + struct multi_pgsql_query *qry) +{ + struct multi_pgsql_pgc *pgc; + + dprintf(("%s: %p: %p", __func__, pgdb, qry)); + + pgc = get_ready_pgc(pgdb); + if (pgc) { + start_query(qry, pgc); + return; + } + + dprintf(("%s: %p: no pgcs ready, queueing", __func__, pgdb)); + queue_query_to_pgdb(qry, pgdb); +} + + +static void pgdb_sync_query(struct multi_pgsql_db *pgdb, + struct multi_pgsql_query *qry) +{ + struct ioloop *old_ioloop, *sync_ioloop; + + dprintf(("%s: %p: %p", __func__, pgdb, qry)); + + old_ioloop = current_ioloop; + sync_ioloop = io_loop_create(); + switch_pgdb_pgcs(pgdb); + + set_query_sync_ioloop(qry, sync_ioloop); + pgdb_async_query(pgdb, qry); + + io_loop_run(sync_ioloop); + + io_loop_set_current(old_ioloop); + switch_pgdb_pgcs(pgdb); + io_loop_set_current(sync_ioloop); + io_loop_destroy(&sync_ioloop); +} + +/*** non-transaction SQL driver methods */ +extern struct sql_db driver_multi_pgsql_db; + +static struct sql_db *multi_pgsql_init_v(char const *connect_string) +{ + struct multi_pgsql_db *pgdb; + pool_t pool; + + dprintf(("%s: %s", __func__, connect_string)); + + pool = pool_alloconly_create("multi_pgsql_pool", MULTI_PGSQL_POOL); + + pgdb = p_new(pool, struct multi_pgsql_db, 1); + pgdb->api = driver_multi_pgsql_db; + pgdb->pool = pool; + + pgdb->query_q.link_to = &pgdb->query_q.first; + pgdb->pgc_q.link_to = &pgdb->pgc_q.first; + + init_pgcs(pgdb, connect_string); + return (void *)pgdb; +} + +static void multi_pgsql_deinit_v(struct sql_db *db) +{ + struct multi_pgsql_error_result deinit; + struct multi_pgsql_db *pgdb; + struct multi_pgsql_pgc *pgc; + struct multi_pgsql_query *qry, *next_qry; + pool_t pool; + unsigned n; + + dprintf(("%s: %p", __func__, db)); + + array_free(&db->module_contexts); + + pgdb = (void *)db; + init_error_result(&deinit, DEINIT_ERROR); + + n = pgdb->n_pgcs; + do { + pgc = pgdb->pgcs + --n; + + qry = pgc->qry; + if (qry) abort_query(qry, &deinit.api); + + reset_pgc(pgc); + + } while (n); + + qry = pgdb->query_q.first; + if (qry) { + timeout_remove(&pgdb->query_q.timeout); + + do { + next_qry = qry->p; + abort_query(qry, &deinit.api); + } while ((qry = next_qry)); + } + + pool = pgdb->pool; + pool_unref(&pool); +} + +static int multi_pgsql_connect(struct sql_db *db) +{ + dprintf(("%s: %p", __func__, db)); + return 1; +} + +static enum sql_db_flags +multi_pgsql_get_flags(struct sql_db *db) +{ + dprintf(("%s: %p", __func__, db)); + return 0; +} + +static const char * +multi_pgsql_escape_string(struct sql_db *db, const char *in) +{ + struct multi_pgsql_db *pgdb; + char *out; + size_t len; + + pgdb = (void *)db; + len = strlen(in); + out = t_buffer_get(len * 2 + 1); + len = PQescapeStringConn(pgdb->pgcs->pgc, out, in, len, + NULL); + t_buffer_alloc(len + 1); + + dprintf(("%s: %p: '%s' -> '%s'", + __func__, pgdb, in, out)); + return out; +} + +static void multi_pgsql_query(struct sql_db *db, const char *query, + sql_query_callback_t *cb, void *ctx) +{ + struct multi_pgsql_query *qry; + + dprintf(("%s: %p: %s", __func__, db, query)); + + qry = create_user_query(query, cb, ctx); + pgdb_async_query((void *)db, qry); +} + +static void multi_pgsql_exec(struct sql_db *db, const char *query) +{ + i_info("%s: %p: %s", __func__, db, query); + i_info("%s: not implemented", __func__); +} + +static struct sql_result * +multi_pgsql_query_s(struct sql_db *db, const char *query) +{ + struct multi_pgsql_db *pgdb; + struct multi_pgsql_sync_query sync_qry; + + pgdb = (void *)db; + dprintf(("%s: %p: %s", __func__, pgdb, query)); + + init_sync_query(&sync_qry, query); + pgdb_sync_query(pgdb, (void *)&sync_qry); + return result_from_sync_query(&sync_qry); +} + +/*** transaction support code */ +static void add_subquery_to(struct multi_pgsql_transaction_context *x_ctx, + char const *query, unsigned *affected_rows) + +{ + struct multi_pgsql_transaction_subquery *sub; + pool_t pool; + + pool = x_ctx->pool; + + sub = p_new(pool, struct multi_pgsql_transaction_subquery, 1); + sub->query = p_strdup(pool, query); + sub->affected_rows = affected_rows; + + *x_ctx->link_to = sub; + x_ctx->link_to = &sub->p; + + dprintf(("%s: %p: '%s'", __func__, x_ctx, query)); +} + +static struct sql_transaction_context * +multi_pgsql_transaction_begin(struct sql_db *db) +{ + struct multi_pgsql_transaction_context *x_ctx; + pool_t pool; + + pool = pool_alloconly_create("multi_pgsql_xact_pool", + MULTI_PGSQL_XACT_POOL); + x_ctx = p_new(pool, struct multi_pgsql_transaction_context, 1); + x_ctx->super.db = db; + x_ctx->link_to = &x_ctx->first; + x_ctx->pool = pool; + + add_subquery_to(x_ctx, "begin", NULL); + + dprintf(("%s: db %p: %p", __func__, db, x_ctx)); + return (void *)x_ctx; +} + +static void +multi_pgsql_transaction_commit(struct sql_transaction_context *ctx, + sql_commit_callback_t *cb, void *cb_ctx) +{ + struct multi_pgsql_transaction_context *x_ctx; + struct multi_pgsql_async_transaction_query *qry; + + x_ctx = (void *)ctx; + dprintf(("%s: %p", __func__, x_ctx)); + + add_subquery_to(x_ctx, "commit", NULL); + + qry = p_new(x_ctx->pool, struct multi_pgsql_async_transaction_query, 1); + init_async_transaction_query(qry, x_ctx, cb, cb_ctx); + pgdb_async_query((void *)ctx->db, (void *)qry); +} + +static int +multi_pgsql_transaction_commit_s(struct sql_transaction_context *ctx, + const char **error_r) +{ + struct multi_pgsql_transaction_context *x_ctx; + struct multi_pgsql_sync_transaction_query sync_qry; + char *errmsg; + + x_ctx = (void *)ctx; + dprintf(("%s: %p", __func__, x_ctx)); + + add_subquery_to(x_ctx, "commit", NULL); + + init_sync_transaction_query(&sync_qry, x_ctx); + pgdb_sync_query((void *)x_ctx->super.db, &sync_qry.super.super); + + errmsg = (char *)sync_qry.errmsg; + if (errmsg) { + *error_r = t_strdup(errmsg); + i_free(errmsg); + + return -1; + } + + return 0; +} + +static void +multi_pgsql_transaction_rollback(struct sql_transaction_context *ctx) +{ + struct multi_pgsql_transaction_context *x_ctx; + + x_ctx = (void *)ctx; + dprintf(("%s: %p", __func__, x_ctx)); + + pool_unref(&x_ctx->pool); +} + +static void +multi_pgsql_transaction_update(struct sql_transaction_context *ctx, const char *query, + unsigned int *affected_rows) +{ + struct multi_pgsql_transaction_context *x_ctx; + + x_ctx = (void *)ctx; + add_subquery_to(x_ctx, query, affected_rows); +} + +/*** db driver vtable */ +struct sql_db driver_multi_pgsql_db = { + "multi-pgsql", + + MEMBER(v) { + multi_pgsql_init_v, + multi_pgsql_deinit_v, + multi_pgsql_get_flags, + multi_pgsql_connect, + multi_pgsql_escape_string, + multi_pgsql_exec, + multi_pgsql_query, + multi_pgsql_query_s, + + multi_pgsql_transaction_begin, + multi_pgsql_transaction_commit, + multi_pgsql_transaction_commit_s, + multi_pgsql_transaction_rollback, + multi_pgsql_transaction_update + } +}; +#endif

3 4

[Dovecot] windows live mail + dovecot and nfs
by Anes Muhametov 17 Apr '10

17 Apr '10

Hi all. My clients have got problem accessing dovecot by "Windows live mail (Windows 7)" client. The problem is that users can't delete two or more folders one-by-one. There is no errors deleting first folder (new dir /storage/vol1/mail/domain/user/Maildir/..DOVECOT-TRASHED appeared and wasn't deleted). If I try to delete second one, error occurs (user, domain, IP address changed): dovecot: IMAP(user@domain): unlink_directory(/storage/vol1/mail/domain/user/Maildir/..DOVECOT-TRASHED) failed: Directory not empty I'm using dovecot 1.2.10 @FreeBSD 7.2-RELEASE-p1 amd64 and NFS storage backend. dovecot -n # 1.2.10: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.2-RELEASE-p1 amd64 syslog_facility: local7 protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/1.crt ssl_key_file: /etc/ssl/1.key.unsec disable_plaintext_auth: no verbose_ssl: yes shutdown_clients: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: mail server ready. login_process_per_connection: no login_process_size: 512 login_processes_count: 60 login_max_processes_count: 256 login_max_connections: 100 max_mail_processes: 4096 mail_max_userip_connections(default): 50 mail_max_userip_connections(imap): 50 mail_max_userip_connections(pop3): 30 verbose_proctitle: yes first_valid_uid: 90 last_valid_uid: 90 first_valid_gid: 90 last_valid_gid: 90 mail_privileged_group: mail mail_location: maildir:%h/Maildir mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock maildir_copy_preserve_filename: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_process_size: 128 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh lda: postmaster_address: postmaster(a)domain.ru mail_plugins: quota sendmail_path: /usr/sbin/sendmail log_path: /var/log/dovecot/deliver.log info_log_path: /var/log/dovecot/deliver.log auth default: mechanisms: plain login cram-md5 cache_size: 262144 cache_ttl: 180 cache_negative_ttl: 60 failure_delay: 1 worker_max_count: 2000 process_size: 512 passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: user group: domain plugin: quota: maildir:Quota Here is listing of ..DOVECOT-TRASHED: ls -la /storage/vol1/mail/domain/user/Maildir/..DOVECOT-TRASHED: total 16 drwx------ 2 user user 4096 Apr 9 11:32 . drwx------ 27 user user 8192 Apr 9 11:41 .. -rw------- 1 user user 156 Apr 9 11:32 .nfs.014cd02e.ffffd11b4.4 -rw------- 1 user user 17 Apr 9 11:32 .nfs.014cd031.ffffd11b4.4 fstat output: [root@ /storage/vol1/mail/domain/user/Maildir/..DOVECOT-TRASHED]# fstat .* USER CMD PID FD MOUNT INUM MODE SZ|DV R/W NAME root fstat 82081 wd /storage/vol1 32454159 drwx------ 4096 r . user imap 53042 7 /storage/vol1 40573622 -rw------- 156 rw .nfs.014cd02e.ffffd11b4.4 user imap 53042 9 /storage/vol1 40573631 -rw------- 17 rw .nfs.014cd031.ffffd11b4.4 root bash 22223 wd /storage/vol1 32454159 drwx------ 4096 r . # ps uxwa|grep user user 53042 0.0 0.1 9812 2400 ?? S 11:31AM 0:00.02 imap [user@domain 1.1.1.1] user 53650 0.0 0.1 10836 2908 ?? S 11:32AM 0:00.05 imap [user@domain 1.1.1.1] It seems like first imap process locked ..DOVECOT-TRASHED. Best regards Anes Muhametoc.

2 2