- dovecot - dovecot.org

[Dovecot] mail location filesystem noatime, nodiratime?
by Stan Hoeppner 19 May '10

19 May '10

Will Dovecot be negatively impacted if I change my XFS mount options to noatime,nodiratime? Thanks. -- Stan

4 4

[Dovecot] problem compiling pigeonhole + my fix
by Andreas Schulze 19 May '10

19 May '10

hello, yesterday I tried to package dovecot-2.0beta5 + pigeonhole from Mercurial repository. I put pigeonhole as a subdir in the dovecot sourcetree. Following http://hg.rename-it.nl/dovecot-2.0-pigeonhole/raw-file/tip/INSTALL I called ./autogen.sh; ./configure --with-dovecot=..; make In the buildprocess I saw this output ( from autogen.sh ): Putting files in AC_CONFIG_AUX_DIR, `..'. libtoolize: `config.guess' exists: use `--force' to overwrite libtoolize: `config.sub' exists: use `--force' to overwrite libtoolize: `ltmain.sh' exists: use `--force' to overwrite I dont know *why* AC_CONFIG_AUX_DIR is .. but in .. there are the mentioned files (from dovecot) already present. The following make failed with less helpfull errors. -> my fix is to call "autoreconf -i -f" again after autogen.sh should -f be added to autogen.sh ? -- Andreas Schulze Internetdienste | P532 DATEV eG 90329 Nürnberg | Telefon +49 911 319-0 | Telefax +49 911 319-3196 E-Mail info @datev.de | Internet www.datev.de Sitz: 90429 Nürnberg, Paumgartnerstr. 6-14 | Registergericht Nürnberg, GenReg Nr.70 Vorstand Prof. Dieter Kempf (Vorsitzender) Dipl.-Kfm. Wolfgang Stegmann (stellvertretender Vorsitzender) Dipl.-Kfm. Michael Leistenschneider Jörg Rabe v. Pappenheim Dipl.-Vw. Eckhard Schwarzer Vorsitzender des Aufsichtsrates: Reinhard Verholen

2 1

Re: [Dovecot] A new director service in v2.0 for NFS installations
by Timo Sirainen 19 May '10

19 May '10

On 19.5.2010, at 13.09, Cor Bosman wrote: > I guess one of my first questions is, not just how to handle failure of proxies, but also failure of whatever server the proxy sends you to. We've talked about that before, that the proxy could for instance fall back to itself as the 'final server'. The people in here want to use their existing monitoring script that would do "ssh host doveadm director remove 1.2.3.4". But on top of that, yeah, maybe proxy itself could tell director that some host is down and retry the lookup. Although determining when it's down might not be fully reliable always, so I'm a bit worried that proxy could sometimes fail to connect to a mail server even if it's up (but e.g. with high load, temporary small network problem, etc).

1 0

[Dovecot] how to configure my scripts sieves for the home root
by fakessh 19 May '10

19 May '10

hello list hello all reader of this list how to configure my scripts sieves for the home root I encounter these errors in the logs 2010-05-19 14:14:03 deliver(root): Info: sieve runtime error: Not a bytecode file 2010-05-19 14:14:03 deliver(root): Error: sieve_execute_bytecode(/root/.dovecot.sievec) failed thanks for your advice thanks

3 3

[Dovecot] Make dovecot.index and dovecot.index.cache
by Kenji Iuchi 19 May '10

19 May '10

Hi, I would like to make dovecot.index and dovecot.index.cache manually. But that file is made on connecting IMAP Session. That file contribute to performance improvement, so I want to register myself with crontab. Please teach how to make dovecot.index and dovecot.index.cache manyually. Note. Dovecot LDA is not use. -- /*/*/*/*/*/*/*/*/*/*/*/*/*/*/*/*/*/*/*/*/*/*/*/* Kenji Iuchi

2 3

[Dovecot] double write-locking dovecot.index.log
by Mike Abbott 19 May '10

19 May '10

Dovecot's transactions often write-lock dovecot.index.log twice (without unlocking in between), and then unlock it twice. Is that intended, or is that a bug? If I read the man pages correctly, double write-locking is pointless but safe. But double unlocking could cause data corruption during the period between the first and second unlocks, because the locks don't nest (are not refcounted). The first unlock leaves the file totally unlocked. Could this be the source of some index corruption errors? For example: 1. Process A acquires a F_WRLCK on a file. 2. Through a different code path, process A again acquires a F_WRLCK on the same file. Since these locks don't nest this is essentially a no-op. 3. Process A modifies the file. 4. Process A unlocks the file to undo the lock in step 2. Now the file has no lock on it at all. 5a. Process B locks, modifies, and unlocks the file. 5b. Process A also modifies the file, thinking that it still has a write lock. 6. Process A unlocks the file to undo the lock in step 1, but this is another no-op. Data corruption is possible if steps 5a and 5b conflict, or if 5b uses stale data. Here is a code path in dovecot-1.2.11 which exhibits the above behavior. "Outer" write lock: maildir_transaction_save_commit_pre -> maildir_transaction_save_commit_pre_sync -> maildir_sync_index_begin -> mail_index_sync_begin -> mail_index_sync_begin_to -> mail_index_sync_begin_init -> mail_transaction_log_sync_lock -> mail_transaction_log_lock_head -> mail_transaction_log_file_lock -> mail_index_lock_fd -> file_wait_lock -> file_lock_do "Inner" write lock: maildir_transaction_save_commit_pre -> maildir_sync_index_finish -> mail_index_sync_commit -> mail_index_write -> mail_transaction_log_rotate -> mail_transaction_log_file_create -> mail_transaction_log_file_create2 -> mail_transaction_log_file_lock -> mail_index_lock_fd -> file_wait_lock -> file_lock_do The file being locked is the same, dovecot.index.log. In another case, maildir_sync_index_begin is reached this way (outer lock): mailbox_sync -> mailbox_sync_init -> maildir_storage_sync_init -> maildir_sync_context -> maildir_sync_index_begin -> mail_index_sync_begin -> etc. And maildir_sync_index_finish is reached this way (inner lock): mailbox_sync -> mailbox_sync_init -> maildir_storage_sync_init -> maildir_sync_context -> maildir_sync_index_finish -> etc. Could these lead to data corruption? Please let me know if you need any more information. Thanks.

1 1

[Dovecot] problem trying out dovecot hg
by joakim＠verona.se 18 May '10

18 May '10

I get: May 18 14:56:16 exodia dovecot: master: Dovecot v2.0.beta5 (4ba05c3702be) starting up (core dumps disabled) May 18 14:56:16 exodia dovecot: master: Error: service(pop3-login): safe_mkstemp(/tmp/dovecot-master) failed: Permission denied May 18 14:56:16 exodia dovecot: master: Error: service(imap-login): safe_mkstemp(/tmp/dovecot-master) failed: Permission denied "nc localhost 143" never connects listeners seem to be running at port 143 -- Joakim Verona

3 2

[Dovecot] Shared mailboxes
by spamvoll＠googlemail.com 18 May '10

18 May '10

Hi.. can anyone give me a hind how to setup shared mailboxes. I've already created the shared and private namespace. But ive no idea how to share a mailbox. Thunderbird and most other Clients seem not to support the setacl command. so do i have to create a plaintext file with "user=theldapuseriwanttosharemybox rw" ? thx Hans

5 4

[Dovecot] how authentication works?
by Mihamina Rakotomandimby 18 May '10

18 May '10

Manao ahoana, Hello, Bonjour, I've read: http://wiki.dovecot.org/Authentication/PasswordSchemes I have a users database with clear plain passwords. Dovecot authenticates users without problems against it. Now, it's time to move to CRYPT scheme. Before that, I would like to know how things happen. He have: - the user, (entering his password in the MUA) - the user's MUA (Thunderbird, Outlook, Squirrelmail,...) - the POP or IMAP server - the users database (mySQL) with username and crypt()'d password How I think the process is: - the user enters his password in a clear way. - the MUA sends the password as the user entered it to the POP or IMAP server - the POP or IMAP server fetches the password from the database - the POP or IMAP server crypt()'s the user entered password - the POP or IMAP server compares crypt()'d ones and gives his response Am I close enough to reality? Too far? Misaotra, Thanks, Merci. -- Architecte Informatique chez Blueline/Gulfsat: Administration Systeme, Recherche & Developpement +261 3456 000 19

1 1

[Dovecot] Configuring Dovecot SASL
by BABEDH-DHRA 18 May '10

18 May '10

Dovecot ver = 1.1.11 Dovecot -n = mail:~# dovecot -n # 1.1.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-amd64 x86_64 Debian 5.0.4 ext3 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login first_valid_uid: 6060 mail_privileged_group: mail mail_location: maildir:/var/vmail/%d/%n mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): autocreate quota imap_quota mail_plugins(imap): autocreate quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 auth default: mechanisms: plain login cram-md5 passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf passdb: driver: sql args: /etc/dovecot/dovecot-crammd5.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: quota: maildir:User quota quota_warning: storage=90%% /usr/sbin/quota-warning.sh 90 quota_warning2: storage=70%% /usr/sbin/quota-warning.sh 70 autocreate: Spam autosubscribe: Spam I am trying to get this to work. I am running a mailserver in Debian Lenny AMD-64 that uses Postfix driven virtual mailbox domains stored in a MySQL database, managed by PostfixAdmin and phpMyAdmin. I must send my mail through DYNDNS through port 2525 the username and password for that service does not appear at all in any of my user names. I have added / merged the data in the Configuring Dovecot SASL but when testing we see nothing about AUTH when testing it. Please let me know if I have left something out I am not a complete NUBE but I am still a bit green. Thanks.

2 1

[Dovecot] %d is empty in mail_location
by Phil Howard 17 May '10

17 May '10

I have this in dovecot-postfix.conf: mail_location = maildir:/home/mail/dnamesum=%12MLd/dname=%Ld/unamesum=%12MLn/uname=%Ln/mail Yes, it is excessive, but that's just for testing. The pattern I really want is less clear for debugging. In postfix/main.cf I have: mailbox_command = /usr/lib/dovecot/deliver -c /etc/dovecot/dovecot-postfix.conf -a "${RECIPIENT}" I verified through strace that -a "${RECIPIENT}" is in fact getting a full user@domain address. The problem is that %d and %Ld are coming up as empty, and %12MLd is giving me the first 12 hex characters of an md5 of an empty content. It's losing the domain name somewhere. It's in the mail headers and in the -a option. So what else is needed?

7 25

[Dovecot] imap_acl for CentOS
by Andrés Gattinoni 17 May '10

17 May '10

Hi, I sent an email a couple of days ago asking about a problem with ACL. The bottom line was, I think, that I'm missing imap_acl plugin. I installed Dovecot 1.0.7 using yum in CentOS 5.4. Do you know where can I get the imap_acl plugin lib? Thanks A

3 2

Re: [Dovecot] Dovecot 2.0beta5 Quota/Dict
by e-frog 17 May '10

17 May '10

On 14.05.2010 22:54, wrote Andrey Melnikoff: > In article <4BEDB367.8030004(a)gmx.de> you wrote: >> On 14.05.2010 22:12, wrote Henrique Fernandes: > >>>> May 14 17:03:40 dict: Panic: file driver-mysql.c: line 482 >>>> (transaction_send_query): assertion failed: (rows != (my_ulonglong)-1) > >> The patch in >> http://www.dovecot.org/list/dovecot/2010-May/048705.html >> fixed this for me. > > For 2.0.b5 need slightly other patch: > --- dovecot-2.0.beta5/src/lib-sql/driver-mysql.c~ 2010-05-05 21:20:17.000000000 +0400 > +++ dovecot-2.0.beta5/src/lib-sql/driver-mysql.c 2010-05-05 21:20:17.000000000 +0400 > @@ -479,7 +479,9 @@ > struct mysql_db *db = (struct mysql_db *)result->db; > > rows = mysql_affected_rows(db->mysql); > - i_assert(rows != (my_ulonglong)-1); > + if (mysql_errno(db->mysql)) > + i_assert(rows != (my_ulonglong)-1); > + else rows = 0; > *ctx->ctx.head->affected_rows = rows; > } > sql_result_unref(result); > Oh, yes correct. Thanks!

3 13

[Dovecot] Setting up a 'rootless' server - user and auth_user cannot be the same
by Jason Ahrens 17 May '10

17 May '10

I am trying to follow http://wiki.dovecot.org/HowTo/Rootless to set up a personal dovecot server that does not use 'root' and does not need to change uids/gids. I'm trying to set it up on a Cygwin personal system. The problem I'm running into though, the directions say to set "user" and "auth_user" to be the same in this setup. However when you do this, Dovecot compains and will refuse to start up. Did I miss something? $ ./dovecot --version 1.2.11 $ ./dovecot -n # 1.2.11: /usr/local/etc/dovecot.conf Error: login_user cyg_server (uid 1005) must not be same as auth_user Fatal: Invalid configuration in /usr/local/etc/dovecot.conf Config trying to use: protocols = imap disable_plaintext_auth = no ssl = no login_chroot = no login_user = cyg_server login_process_size = 0 login_max_processes_count = 5 mail_location = maildir:~/Maildir max_mail_processes = 5 mail_process_size = 0 auth_process_size = 0 auth default { mechanisms = plain passdb passwd-file { args = /usr/local/etc/dovecot.users } userdb passwd { } user = cyg_server }

4 4

[Dovecot] sieve spamtest extension
by Nikita Koshikov 16 May '10

16 May '10

Hello Stephan, First of all, thanks for time you spent implementing this useful extension. I have found some ugly behavior with such config: sieve_extensions = +notify +spamtest sieve_spamtest_status_type = score sieve_spamtest_status_header = X-Spam-Scan-Score: (-?[[:digit:]]+\.[[:digit:]]) sieve_spamtest_max_value = 10 Sieve: require ["fileinto","envelope","imap4flags","spamtest","relational","comparator-i;ascii-numeric"]; # rule:[spam] if anyof (spamtest :value "ge" :comparator "i;ascii-numeric" "6") { fileinto "Spam"; } If X-Spam-Scan-Score have 6-9 digit after dot - the first one ignored, thus X-Spam-Scan-Score: 3.6 -> "ge" skips. #right X-Spam-Scan-Score: 3.8 -> "ge" works. #wrong X-Spam-Scan-Score: 5.9 -> "ge" works. #wrong X-Spam-Scan-Score: 6.0 -> "ge" works. #right X-Spam-Scan-Score: 6.9 -> "ge" works. #right X-Spam-Scan-Score: 7.3 -> "ge" works. #right If the rule modified to (spamtest :value "ge" :comparator "i;ascii-numeric" "6.0") everything works as expected. One more thing - sieve-test. I couldn't test my scripts with it: # sieve-test -x +spamtest -t sieve spam.txt 00000007: SPAMTEST test 00000007: spamtest: extension not configured 00000013: JMPFALSE (false) Performed actions: (none) Implicit keep: * store message in folder: INBOX Info: final result: success

2 2

Re: [Dovecot] Multiple hosts for pgsql backend?
by Thomas Leuxner 15 May '10

15 May '10

Am 15.05.2010 um 16:14 schrieb Westenberg + Küppers GbR | Patrick Westenberg: > that´s nice. > > "PostgreSQL supports now multiple connections to backend. Also supports load-balancing / HA by specifying multiple host parameters." > > Will dovecot automatically load-balance it´s queries through the given > host parameters? > > Regards > Patrick This is best answered by Timo, but this code excerpt should help finding details: http://hg.dovecot.org/dovecot-2.0/rev/1c8cc349ef55 Please post to the ML rather than to individuals in order to get a broader feedback. Regards Thomas

1 0

[Dovecot] Email jam problem
by Lam Ho Yin Bosco 15 May '10

15 May '10

Dear All: I have facing big problem at user email jam (outlook and thunderbird) how can I check the problem?(like the mail client got email very slow). email dovecot --version 1.0.7 dovecot -n # 1.0.7: /etc/dovecot.conf info_log_path: /var/log/dovecot.log protocols: pop3 listen: [0.0.0.0] login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/pop3-login login_process_per_connection: no login_process_size: 512 login_processes_count: 10 login_max_processes_count: 512 login_max_connections: 100 maildir_copy_with_hardlinks: yes mbox_very_dirty_syncs: yes mail_executable: /usr/libexec/dovecot/pop3 mail_plugin_dir: /usr/lib/dovecot/pop3 pop3_client_workarounds: outlook-no-nuls oe-ns-eoh auth default: passdb: driver: pam userdb: driver: passwd

3 2

[Dovecot] Multiple hosts for pgsql backend?
by Westenberg + Küppers GbR | Patrick Westenb erg 15 May '10

15 May '10

Hi Guys, is it possible to use more than one host with the pgsql backend? Like this: connect = host=10.5.29.77 host=10.5.29.210 dbname=postfix [...] I read that this is possible with mysql but I want to use pgsql. Regards Patrick

2 1

[Dovecot] dovecot from debian lenny-backports does not accept connections
by Joelly Alexander 15 May '10

15 May '10

hi, dovecot from the debian lenny backports does not successfully accept incomming imap or imaps connections; when the client connect i can see the clients ip address in an imap-process but the client cannot succesfully connect and retries this several times where an new imap-process is bound until the maximum connections per client is reached; when the client is closed the imap-processes on the server stay opened, even when dovecot will be restarted or stopped - the processes needs to killed manually; --- snip --- 2010-05-14 02:24:42 auth(default): Info: client in: AUTH 1 PLAIN service=imap secured lip=y.y.y.y rip=x.x.x.x lport=993 rport=1411 2010-05-14 02:24:42 auth(default): Info: client out: CONT 1 2010-05-14 02:24:42 auth(default): Info: client in: CONT 1 AGFsZXhAdXZzdCrhdAB5YWxpbWVybw== 2010-05-14 02:24:42 auth-worker(default): Info: sql(alex(a)domain.tld,x.x.x.x): query: SELECT username AS user, password, '/var/vmail/domain.tld/alex' AS userdb_home, 'maildir:/var/vmail/domain.tld/alex' AS userdb_mail, 150 AS userdb_uid, 8 AS userdb_gid FROM mailbox WHERE username = 'alex(a)domain.tld' AND active = '1' 2010-05-14 02:24:42 auth(default): Info: client out: OK 1 user=alex(a)domain.tld 2010-05-14 02:24:42 auth(default): Info: master in: REQUEST 2 2177 1 2010-05-14 02:24:42 auth(default): Info: prefetch(alex(a)domain.tld,x.x.x.x): success 2010-05-14 02:24:42 auth(default): Info: master out: USER 2 alex(a)domain.tld home=/var/vmail/domain.tld/alex mail=maildir:/var/vmail/domain.tld/alex uid=150 gid=8 2010-05-14 02:24:42 imap-login: Info: Login: user=<alex(a)domain.tld>, method=PLAIN, rip=x.x.x.x, lip=y.y.y.y, TLS 2010-05-14 02:24:42 IMAP(alex(a)domain.tld): Info: Loading modules from directory: /usr/lib/dovecot/modules/imap 2010-05-14 02:24:42 IMAP(alex(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so 2010-05-14 02:24:42 IMAP(alex(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so 2010-05-14 02:24:42 IMAP(alex(a)domain.tld): Info: Effective uid=150, gid=8, home=/var/vmail/domain.tld/alex 2010-05-14 02:24:42 IMAP(alex(a)domain.tld): Info: Quota root: name=storage=102400 backend=maildir args= 2010-05-14 02:24:42 IMAP(alex(a)domain.tld): Info: maildir: data=/var/vmail/domain.tld/alex 2010-05-14 02:24:42 IMAP(alex(a)domain.tld): Info: maildir++: root=/var/vmail/domain.tld/alex, index=, control=, inbox=/var/vmail/domain.tld/alex 2010-05-14 02:24:42 auth(default): Info: new auth connection: pid=2186 2010-05-14 02:24:45 auth(default): Info: client in: AUTH 1 PLAIN service=imap secured lip=y.y.y.y rip=x.x.x.x lport=993 rport=1412 2010-05-14 02:24:45 auth(default): Info: client out: CONT 1 2010-05-14 02:24:45 auth(default): Info: client in: CONT 1 AGFsZXhAdXZzdCrhdAB5YWxpbWVybw== 2010-05-14 02:24:45 auth-worker(default): Info: sql(alex(a)domain.tld,x.x.x.x): query: SELECT username AS user, password, '/var/vmail/domain.tld/alex' AS userdb_home, 'maildir:/var/vmail/domain.tld/alex' AS userdb_mail, 150 AS userdb_uid, 8 AS userdb_gid FROM mailbox WHERE username = 'alex(a)domain.tld' AND active = '1' 2010-05-14 02:24:45 auth(default): Info: client out: OK 1 user=alex(a)domain.tld 2010-05-14 02:24:45 auth(default): Info: master in: REQUEST 3 2075 1 2010-05-14 02:24:45 auth(default): Info: prefetch(alex(a)domain.tld,x.x.x.x): success 2010-05-14 02:24:45 auth(default): Info: master out: USER 3 alex(a)domain.tld home=/var/vmail/domain.tld/alex mail=maildir:/var/vmail/domain.tld/alex uid=150 gid=8 2010-05-14 02:24:45 imap-login: Info: Login: user=<alex(a)domain.tld>, method=PLAIN, rip=x.x.x.x, lip=y.y.y.y, TLS 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: Loading modules from directory: /usr/lib/dovecot/modules/imap 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: Effective uid=150, gid=8, home=/var/vmail/domain.tld/alex 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: Quota root: name=storage=102400 backend=maildir args= 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: maildir: data=/var/vmail/domain.tld/alex 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: maildir++: root=/var/vmail/domain.tld/alex, index=, control=, inbox=/var/vmail/domain.tld/alex 2010-05-14 02:24:45 auth(default): Info: new auth connection: pid=2189 2010-05-14 02:24:45 auth(default): Info: new auth connection: pid=2188 2010-05-14 02:24:45 auth(default): Info: client in: AUTH 1 PLAIN service=imap secured lip=y.y.y.y rip=x.x.x.x lport=993 rport=1413 2010-05-14 02:24:45 auth(default): Info: client out: CONT 1 2010-05-14 02:24:45 auth(default): Info: client in: CONT 1 AGFsZXhAdXZzdC5hdABrYWxpbWVybw== 2010-05-14 02:24:45 auth-worker(default): Info: sql(alex(a)domain.tld,x.x.x.x): query: SELECT username AS user, password, '/var/vmail/domain.tld/alex' AS userdb_home, 'maildir:/var/vmail/domain.tld/alex' AS userdb_mail, 150 AS userdb_uid, 8 AS userdb_gid FROM mailbox WHERE username = 'alex(a)domain.tld' AND active = '1' 2010-05-14 02:24:45 auth(default): Info: client out: OK 1 user=alex(a)domain.tld 2010-05-14 02:24:45 auth(default): Info: master in: REQUEST 4 2186 1 2010-05-14 02:24:45 auth(default): Info: prefetch(alex(a)domain.tld,x.x.x.x): success 2010-05-14 02:24:45 auth(default): Info: master out: USER 4 alex(a)domain.tld home=/var/vmail/domain.tld/alex mail=maildir:/var/vmail/domain.tld/alex uid=150 gid=8 2010-05-14 02:24:45 imap-login: Info: Login: user=<alex(a)domain.tld>, method=PLAIN, rip=x.x.x.x, lip=y.y.y.y, TLS 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: Loading modules from directory: /usr/lib/dovecot/modules/imap 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: Effective uid=150, gid=8, home=/var/vmail/domain.tld/alex 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: Quota root: name=storage=102400 backend=maildir args= 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: maildir: data=/var/vmail/domain.tld/alex 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: maildir++: root=/var/vmail/domain.tld/alex, index=, control=, inbox=/var/vmail/domain.tld/alex 2010-05-14 02:24:45 auth(default): Info: client in: AUTH 1 PLAIN service=imap secured lip=y.y.y.y rip=x.x.x.x lport=993 rport=1414 2010-05-14 02:24:45 auth(default): Info: client out: CONT 1 2010-05-14 02:24:45 auth(default): Info: client in: CONT 1 AGFsZXhAdXZzdC5hdABrYWxpbWVybw== 2010-05-14 02:24:45 auth-worker(default): Info: sql(alex(a)domain.tld,x.x.x.x): query: SELECT username AS user, password, '/var/vmail/domain.tld/alex' AS userdb_home, 'maildir:/var/vmail/domain.tld/alex' AS userdb_mail, 150 AS userdb_uid, 8 AS userdb_gid FROM mailbox WHERE username = 'alex(a)domain.tld' AND active = '1' 2010-05-14 02:24:45 auth(default): Info: client out: OK 1 user=alex(a)domain.tld 2010-05-14 02:24:45 auth(default): Info: master in: REQUEST 5 2188 1 2010-05-14 02:24:45 auth(default): Info: prefetch(alex(a)domain.tld,x.x.x.x): success 2010-05-14 02:24:45 auth(default): Info: master out: USER 5 alex(a)domain.tld home=/var/vmail/domain.tld/alex mail=maildir:/var/vmail/domain.tld/alex uid=150 gid=8 2010-05-14 02:24:45 imap-login: Info: Login: user=<alex(a)domain.tld>, method=PLAIN, rip=x.x.x.x, lip=y.y.y.y, TLS 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: Loading modules from directory: /usr/lib/dovecot/modules/imap 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: Effective uid=150, gid=8, home=/var/vmail/domain.tld/alex 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: Quota root: name=storage=102400 backend=maildir args= 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: maildir: data=/var/vmail/domain.tld/alex 2010-05-14 02:24:45 IMAP(alex(a)domain.tld): Info: maildir++: root=/var/vmail/domain.tld/alex, index=, control=, inbox=/var/vmail/domain.tld/alex 2010-05-14 02:24:46 auth(default): Info: new auth connection: pid=2192 --- snip --- i have a working installation from the stable repository with the same settings - but i need the newer dovecot for the nfs feature; i know there was a kernel bug prior 2.6.27 which also causes such a problem, but i have now the 2.6.32 running and still having this problem - no client connection could be established.... has anyone a idea or a solution for me? thx, alex

2 1

[Dovecot] Dovecot 2.0beta5 Quota/Dict
by Henrique Fernandes 14 May '10

14 May '10

I can not use quota/dict when i configure it come outs this error. If the configuration gos wrong it just do not happen anything, but if the filds and name are ok, happen this.. > May 14 17:03:40 auth: Debug: Loading modules from directory: > /usr/lib/dovecot/auth > May 14 17:03:40 auth: Debug: master in: USER 1 sfrique(a)nti.uff.br > service=lda > May 14 17:03:40 auth: Debug: Loading modules from directory: > /usr/lib/dovecot/auth > May 14 17:03:40 auth: Info: mysql: Connected to 10.0.0.100 (postfix) > May 14 17:03:40 auth: Debug: sql(sfrique(a)nti.uff.br): SELECT 5000 AS uid, > 12 AS gid, mailbox, concat('*:bytes=', quota) AS quota_rule FROM vmailbox > WHERE address = 'sfrique(a)nti.uff.br'; > May 14 17:03:40 auth: Debug: master out: USER 1 sfrique(a)nti.uff.br > uid=5000 gid=12 mailbox=nti.uff.br/var/spool/mail/sfrique > quota_rule=*:bytes=209715200 > May 14 17:03:40 lda(sfrique(a)nti.uff.br): Debug: Effective uid=5000, > gid=12, home= > May 14 17:03:40 lda(sfrique(a)nti.uff.br): Debug: Quota root: name=user > backend=dict args=:proxy:/var/run/dovecot/dict:quota > May 14 17:03:40 lda(sfrique(a)nti.uff.br): Debug: Quota rule: root=user > mailbox=* bytes=209715200 messages=0 > May 14 17:03:40 lda(sfrique(a)nti.uff.br): Debug: dict quota: user= > sfrique(a)nti.uff.br, uri=proxy:/var/run/dovecot/dict:quota, noenforcing=0 > May 14 17:03:40 lda(sfrique(a)nti.uff.br): Debug: fs: root=/vdomains/ > nti.uff.br/home/sfrique/mail, index=/tmp/imap-index/nti.uff.br-sfrique, > control=, inbox=/vdomains/nti.uff.br/var/spool/mail/sfrique > May 14 17:03:40 lda(sfrique(a)nti.uff.br): Debug: Quota root: name=user > backend=dict args=:proxy:/var/run/dovecot/dict:quota > May 14 17:03:40 lda(sfrique(a)nti.uff.br): Debug: Quota rule: root=user > mailbox=* bytes=262144000 messages=0 > May 14 17:03:40 lda(sfrique(a)nti.uff.br): Debug: dict quota: user= > sfrique(a)nti.uff.br, uri=proxy:/var/run/dovecot/dict:quota, noenforcing=0 > May 14 17:03:40 lda(sfrique(a)nti.uff.br): Debug: none: root=, index=, > control=, inbox= > May 14 17:03:40 dict: Info: mysql: Connected to 10.0.0.100 (postfix) > May 14 17:03:40 lda(sfrique(a)nti.uff.br): Info: msgid=unspecified: saved > mail to INBOX > May 14 17:03:40 dict: Panic: file driver-mysql.c: line 482 > (transaction_send_query): assertion failed: (rows != (my_ulonglong)-1) > May 14 17:03:40 dict: Error: Raw backtrace: > /usr/lib/dovecot/libdovecot.so.0 [0x7f3ff91aade2] -> > /usr/lib/dovecot/libdovecot.so.0 [0x7f3ff91aae4a] -> > /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f3ff91ab1f3] -> dovecot/dict > [0x409d07] -> dovecot/dict [0x409d43] -> dovecot/dict [0x4090b1] -> > dovecot/dict [0x40675e] -> dovecot/dict [0x404c81] -> dovecot/dict > [0x40469d] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xcb) > [0x7f3ff91b5b1b] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x18) > [0x7f3ff91b4c98] -> > /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f3ff91a4813] > -> dovecot/dict(main+0x16b) [0x4052bb] -> > /lib64/libc.so.6(__libc_start_main+0xe6) [0x7f3ff77fd526] -> dovecot/dict > [0x404349] > May 14 17:03:40 lda(sfrique(a)nti.uff.br): Error: > read(/var/run/dovecot/dict) failed: Remote disconnected > May 14 17:03:40 master: Error: service(dict): child 1837 killed with signal > 6 (core dumps disabled) > and my doveconf -n auth_debug = yes > auth_default_realm = vm.uff.br > auth_socket_path = /var/run/dovecot/auth-userdb > auth_verbose = yes > base_dir = /var/run/dovecot/ > default_login_user = dovecot > dict { > quota = mysql:/etc/dovecot/dovecot-dict-quota.conf > } > disable_plaintext_auth = no > first_valid_uid = 1000 > fsync_disable = yes > hostname = mail1.uff.br > lda_mailbox_autocreate = yes > listen = * > log_path = /var/log/dovecot.log > mail_access_groups = mail > mail_debug = yes > mail_location = > mbox:/vdomains/%d/home/%n/mail:INBOX=/vdomains/%d/var/spool/mail/%n:INDEX=/tmp/imap-index/%d-%n > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > plugin { > quota = dict:user::proxy:/var/run/dovecot/dict:quota > quota_rule = *:storage=250M > sieve = /var/spool/sieve-scripts/%d/%n/.sieve > sieve_global_path = /etc/dovecot/default.sieve > } > postmaster_address = sfrique(a)nti.uff.br > protocols = imap pop3 > service auth { > user = root > } > service imap-postlogin { > executable = script /usr/local/bin/dovecot-imap > } > service imap { > executable = imap imap-postlogin > } > service pop3-postlogin { > executable = script /usr/local/bin/dovecot-pop3 > } > service pop3 { > executable = pop3 pop3-postlogin > } > ssl = no > userdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > protocol imap { > mail_plugins = quota imap_quota > } > protocol lda { > mail_plugins = $mail_plugins quota > } > > Does anyone have any idea ? []'sf.rique

2 1

[Dovecot] Wiki page(s) to document executable tools?
by William Blunn 14 May '10

14 May '10

Motivated by a desire to know what "doveadm" does: Do we want to be having a page or pages in the Dovecot Wiki which document the executable tools? It might be an idea for each one to say: * What the tool does * How it normally gets invoked (e.g. manually by the administrator, automatically by some other part of Dovecot, automatically by something else) * What parameters it could take and what they would do List of executable tools: (found in Debian dovecot 1.0.15) lib/dovecot/ checkpassword-reply deliver dict dovecot-auth dovecot-config gdbhelper idxview imap imap-login logview managesieve managesieve-login modules pop3 pop3-login rawlog sievec sieved ssl-build-param (found in dovecot 2.0beta5) bin/ doveadm doveconf dsync libexec/dovecot/ anvil auth config dns-client dovecot-lda expire-tool imap-utf7 listview lmtp log maildirlock script ssl-params Regards, Bill

2 1

[Dovecot] Debian package for 2.0beta5 (was: Re: %d is empty in mail_location)
by William Blunn 14 May '10

14 May '10

Thomas Leuxner wrote: > Am 14.05.2010 um 20:03 schrieb Phil Howard: > > >> I've been thinking that as soon as I get this working, I will plan a transition over to a newer server with Slackware instead of Ubuntu. Slackware is easier about letting you run packages you build from source. >> > > Probably OT, but did you consider using Stephan Bosch's builds for that? > > http://xi.rename-it.nl/debian/pool/testing-auto/dovecot-1.2/ That's interesting. I can also see Dovecot 2.0 builds in there. But they appear to be being made every couple hours, so presumably based on the bleeding edge of the Mercurial repository. It would be kind of handy to have a Debian package of the original 2.0 beta 5 build. Is that lying around anywhere? Regards, Bill

1 0

[Dovecot] dovecot 2.0 vs. SELinux
by Michal Hlavinka 14 May '10

14 May '10

Hi, we were modifying old SELinux rules for dovecot 2.0. Everything seems ok, only one report seems odd: "SELinux is preventing /usr/sbin/dovecot "write" access on dovecot.conf." Looking at strace output, dovecot tries to use socket on /etc/dovecot/dovecot.conf which is regular file and no socket: ... geteuid() = 0 getegid() = 0 open("/dev/null", O_WRONLY) = 3 fcntl(3, F_GETFD) = 0 fcntl(3, F_SETFD, FD_CLOEXEC) = 0 socket(PF_FILE, SOCK_STREAM, 0) = 4 fcntl(4, F_GETFL) = 0x2 (flags O_RDWR) fcntl(4, F_SETFL, O_RDWR|O_NONBLOCK) = 0 connect(4, {sa_family=AF_FILE, path="/var/run/dovecot/config"}, 110) = -1 ECONNREFUSED (Connection refused) close(4) = 0 socket(PF_FILE, SOCK_STREAM, 0) = 4 fcntl(4, F_GETFL) = 0x2 (flags O_RDWR) fcntl(4, F_SETFL, O_RDWR|O_NONBLOCK) = 0 connect(4, {sa_family=AF_FILE, path="/etc/dovecot/dovecot.conf"}, 110) = -1 ECONNREFUSED (Connection refused) close(4) = 0 nanosleep({0, 70000000}, NULL) = 0 socket(PF_FILE, SOCK_STREAM, 0) = 4 fcntl(4, F_GETFL) = 0x2 (flags O_RDWR) fcntl(4, F_SETFL, O_RDWR|O_NONBLOCK) = 0 connect(4, {sa_family=AF_FILE, path="/etc/dovecot/dovecot.conf"}, 110) = -1 ECONNREFUSED (Connection refused) close(4) = 0 nanosleep({0, 90000000}, NULL) = 0 socket(PF_FILE, SOCK_STREAM, 0) = 4 fcntl(4, F_GETFL) = 0x2 (flags O_RDWR) fcntl(4, F_SETFL, O_RDWR|O_NONBLOCK) = 0 connect(4, {sa_family=AF_FILE, path="/etc/dovecot/dovecot.conf"}, 110) = -1 ECONNREFUSED (Connection refused) close(4) = 0 nanosleep({0, 80000000}, NULL) = 0 ... (tries to connect 14x) traceback for connect causing this selinux denial is: connect net_connect_unix : lib/network.c #246 net_connect_unix_with_retries : lib/network.c : #255 master_service_open_config : lib-master/master-service-settings.c #157 master_service_settings_read : lib-master/master-service-settings.c #302 master_settings_read : master/main.c main : master/main.c Does anyone know what happens here? Why dovecot tries to use regular file dovecot.conf as socket? There is probably some magic in it (from my pov) which I don't understand. Regards, Michal Hlavinka

3 3

[Dovecot] mdbox: Is there a tool to recover space used by refcount=0 messages in mdbox storage files?
by William Blunn 14 May '10

14 May '10

Is there a tool to recover space used by refcount=0 messages in mdbox storage files? The wiki talks about it but it isn't clear where the tool is. Regards, Bill

2 2

[Dovecot] big mail Single-instance storage
by 范宜坚 14 May '10

14 May '10

hi, I am currently experiencing a problem: there is a group of 200 people to this group when a user send a large message (50MB), can easily lead to congestion. Is there a good way to handle such a situation, like the hard link cyrus?

2 1

[Dovecot] Compressed mail archives
by Will Palmer 14 May '10

14 May '10

Hello, I have recently begun using IMAP to access my mails, and have found that the size of my maildir is quickly getting larger than I had anticipated. Googling around, I've seen a lot of messages related to compressing individual messages in a maildir. However, what I'm really looking for is a solution which will allow multiple messages to be compressed into a single compressed file, while still allowing those messages to be accessed via IMAP. The reasoning behind this is that most of my incoming mail consists of many very-similar messages (for example, it is not unheard of for me to receive 10,000 emails detailing the same error report over a weekend, with the actual "needs to be processed" parts stuck on the end of each message) I'm expecting a simple "no, there's no way to do that", but I wouldn't mind being pleasantly surprised. My question again: Is there any way to keep a bundle of older mails compressed, so that they can enjoy the high compression of being very similar to each-other, while still allowing access via imap? A solution may involve (just throwing out ideas here, which I have no idea how to implement) putting messages older than N days into an MBox file, and either somehow linking my account to that file (so that my account consists of [compressed readonly Mbox]+[live uncompressed Maildir]), or perhaps the first half of that, but accessing archived messages through a separate account. (Not the preferred way, but if it's the only way, I'll do it) But really I don't even know if it's possible to have dovecot support MBox and Maildir simultaneously, nor do I know enough about the MBox format to even know if the IMAP-style "multiple mailboxes" thing is possible in MBox. Please excuse my no-doubt confused terminology and general air of doesn't-know-what-he's-talking-about. The internals of e-mail are generally not my thing, so I'd appreciate any pointing in the right direction which anyone may have to offer. Any ideas?

4 7

[Dovecot] Can't get Thunderbird 2 to delete a folder under mdbox (Dovecot 2.0beta5)
by William Blunn 13 May '10

13 May '10

Can't get Thunderbird 2 to delete a folder under mdbox (Dovecot 2.0beta5) I have built Dovecot 2.0 and installed it under "/opt/dovecot2". I have done the minimum configurations necesary to get it to work with SSL, systems users but with a secondary password database, and set up mail location as "mdbox:~/dbox". I had to create the directory "dbox" in the user's home directory to get things working. Using Thunderbird 2, I can happily copy messages into this system and read them out again, and that all works. In the user's "~/dbox" directory, I get a "storage" directory and a file "m.1". I can also create folders, and nested folders, and put messages into those and read them out again, and that all works. If I try to delete a folder through Thunderbird 2, what happen is that the folder gets moved to be under a folder "Trash" (which Thunderbird calls "Deleted"). So if I had a folder "foo" and deleted it, I end up with a folder "Trash/foo" (which Thunderbird calls "Deleted/foo"). Fair enough: Thunderbird is doing a trash can model on folders. I then go to remove the folder foo from "Trash". Thunderbird doesn't complain, and the folder disappears from the folder list. But upon re-starting Thunderbird, we see that the folder "foo" is still there under "Trash". So it seems the folder was never properly deleted. Perhaps this is a bug in Thunderbird 2, but since this is a beta Dovecot with a new storage subsystem, I thought I would suggest that it might be an issue with Dovecot 2.0beta5. Regards, Bill

3 7

[Dovecot] antispam plugin problem
by Danila 13 May '10

13 May '10

Hi I have installed a plug-in an antispam and when I try to move the message to a folder a spam mutt produces an error "Failed to call dspam." Here's my configuration(all built from ports): dovecot 1.2.11 dovecot-antispam 1.2_4,1 dspam 3.9.0_1 FreeBSD 8.0 Relevant sections from dovecot.conf: protocol imap { mail_plugins = antispam ... } plugin { antispam_signature = X-DSPAM-Signature antispam_dspam_result_header = X-DSPAM-Result antispam_signature_missing = error antispam_spam = SPAM;spam;JUNK antispam_dspam_binary = /usr/local/bin/dspam antispam_dspam_args = --client;--user vmail antispam_crm_args = --config=/home/vmail } .config used by dovecot-antispam: BACKEND=dspam-exec PLUGINNAME=antispam DEBUG=syslog DEBUG_VERBOSE=1 May 11 10:54:09 evil imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 May 11 10:54:09 evil imap: antispam: /usr/local/bin/dspam --source=error --class=spam --signature=4be87a9f953248352114216 --client --user vmail May 11 10:54:09 evil imap: antispam: executing /usr/local/bin/dspam failed: 13 (uid=1009, gid=1010) uid=1009, gid=1010 is vmail user %> grep vmail /usr/local/etc/dspam.conf Trust vmail Thanks

4 5

[Dovecot] Dovecot and POP3
by DJ GRP 13 May '10

13 May '10

Hi all, I run Dovecot 1.2.9, for both IMAP and POP3 access. I was wondering if there is a way to force messages be deleted from server when the user uses POP3, even if she has selected a 'Leave messages on server' option. I was able to do it in the past using Qpopper (--enable-auto-delete option). Thanks

1 0

[Dovecot] auth: Error: PLAIN(user): Request 27511.1 timeouted after 150 secs, state=3
by Mark Sapiro 13 May '10

13 May '10

Since upgrading from Dovecot 2.0.beta4 + patches http://hg.dovecot.org/dovecot-2.0/rev/96496e1d3d12 and http://hg.dovecot.org/dovecot-2.0/rev/aefa279e2c70 to Dovecot 2.0.beta 5, I have started to see the subject error from Dovecot for SASL authentications. It doesn't happen every time, but it happens more often than not. It doesn't seem to affect Postfix's acceptance of the message. One other change made about the same time as the dovecot upgrade that may be involved is the addition of smtpd_sasl_authenticated_header = yes in Postfix. Here is a sequence of relevant log messages for one incoming message. May 12 10:59:59 sbh16 postfix/smtpd[27511]: connect from msapiro.net[68.183.193.239] May 12 11:00:00 sbh16 postfix/smtpd[27511]: 076A36900A9: client=msapiro.net[68.183.193.239], sasl_method=PLAIN, sasl_username=mark May 12 11:00:00 sbh16 postfix/smtpd[27511]: disconnect from msapiro.net[68.183.193.239] May 12 11:00:00 sbh16 postfix/cleanup[27513]: 076A36900A9: hold: header Received: from [192.168.0.4] (msapiro.net [68.183.193.239])??(using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))??(No client certificate requested)??(Authenticated sender: mark)??by sbh16.song from msapiro.net[68.183.193.239]; from=<mark(a)msapiro.net> to=<xxx(a)example.com> proto=ESMTP helo=<[192.168.0.4]> May 12 11:00:00 sbh16 postfix/cleanup[27513]: 076A36900A9: message-id=<4BEAECA2.7060300(a)msapiro.net> May 12 11:00:12 sbh16 MailScanner[25960]: Requeue: 076A36900A9.A66FD to B52366900BA May 12 11:02:29 sbh16 dovecot: auth: Error: PLAIN(mark): Request 27511.1 timeouted after 150 secs, state=3 Note that the timeout occurs, about 149 seconds after Postfix has accepted and queued the message. [root@sbh16 ~]# dovecot -n # 2.0.beta5: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.18-8.1.14.el5 i686 CentOS release 5 (Final) auth_mechanisms = plain apop login auth_worker_max_count = 5 mail_location = mbox:~/Mail:INBOX=/var/spool/mail/%u mail_privileged_group = mail mbox_write_locks = fcntl dotlock passdb { args = /usr/local/etc/dovecot.passwd driver = passwd-file } passdb { driver = pam } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } ssl_cert = </etc/postfix/sbh16-cert.pem ssl_key = </etc/postfix/sbh16-key.pem userdb { driver = passwd } [root@sbh16 ~]# Excerpt from postconf -n smtpd_sasl_auth_enable = yes smtpd_sasl_authenticated_header = yes smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 2

[Dovecot] ot: problem with .de root servers
by Robert Schetterer 12 May '10

12 May '10

Hi, there was/is a Problem with the denic .de root servers this might give you some Problems with mail it looks like that it is recent partly working again -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 1

[Dovecot] dovecot-2.0 hg and pigeonhole hg
by Vasiliy G Tolstov 12 May '10

12 May '10

Hello. I'm found the solution to my problem, described in previous mails (sorry i'm delete old mail and unable to reply to thread) i'm use dovecot and pigeonhole from hg repo , after clean and anble sieve plugin i'm get this error May 12 11:01:18 selfip dovecot: imap: Error: dlopen(/usr/lib/dovecot/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_get_log_var_expand_table May 12 11:01:18 selfip dovecot: imap: Error: dlopen(/usr/lib/dovecot/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_get_log_var_expand_table May 12 11:01:18 selfip dovecot: imap: Error: dlopen(/usr/lib/dovecot/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_get_log_var_expand_table This errors dissapeared, when i'm recompile libdovecot-sieve.so and link it with libdovecot-lda.so lib. Pigeonhole patch: --- src/lib-sieve/Makefile.am.orig 2010-05-12 12:14:16.000000000 +0400 +++ src/lib-sieve/Makefile.am 2010-05-12 12:14:22.000000000 +0400 @@ -64,8 +64,8 @@ ./plugins/spamvirustest/libsieve_ext_spamvirustest.la \ $(unfinished_plugins) -libdovecot_sieve_la_DEPENDENCIES = $(plugins) -libdovecot_sieve_la_LIBADD = $(plugins) +libdovecot_sieve_la_DEPENDENCIES = $(plugins) $(LIBDOVECOT_LDA_DEPS) +libdovecot_sieve_la_LIBADD = $(plugins) $(LIBDOVECOT_LDA) libdovecot_sieve_la_SOURCES = \ rfc2822.c \ -- Vasiliy G Tolstov <v.tolstov(a)selfip.ru> Selfip.Ru

2 1

[Dovecot] looking for feedbacks on courier to dovecot
by Mihamina Rakotomandimby 12 May '10

12 May '10

Manao ahoana, Hello, Bonjour, We currently run courier POP . We would like to switch to Dovecot. I encounter problems when migrating the UIDL because we have big Maildirs and POP re-downlading the data is not possible for most of the users. I tried the http://www.dovecot.org/tools/courier-dovecot-migrate.pl script but I still have the re-downloading event. What are your stories and advices about courier-to-dovecot move? Misaotra, Thanks, Merci. -- Architecte Informatique chez Blueline/Gulfsat: Administration Systeme, Recherche & Developpement +261 34 29 155 34 / +261 33 11 207 36

4 8

Re: [Dovecot] antispam plugin problem
by Danila 11 May '10

11 May '10

With it I have already understood having added the user vmail in mail group, but all the same mutt produces an error "Failed to call dspam" and does not wish to move the letter to a directory a spam. In log now here so: May 11 14:51:50 evil imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 May 11 14:51:50 evil imap: antispam: /usr/local/bin/dspam --source=error --class=spam --signature=4be87a9f953248352114216 --deliver= --user vmail May 11 14:51:50 evil imap: antispam: plugin initialising (1.2-notgit) On 12:31 Tue 11 May , Philipp wrote: > Try to add a --debug to dspam, and if that doesn't produce any > additional output try to start dspam not with init.d (I assume you do?) > but run it manually on the command line as 'sudo dspam --debug > --daemon', that should give you a better idea of what's going on. > To change the gid just add -g \#1010 to sudo. Maybe also try to add > --stdout or leave away the --client in your call to dspam, might make it > easier to pin down the error. > I'm also experiencing quite a bit of trouble with dspam, memory leaks > and stuff but I haven't been able to get in contact with their mailing > list (the address I found was deemed non-existent..) > > > Danila a ?crit : > > Nothing happens > > #> su vmail -c "/usr/local/bin/dspam --source=error --class=spam > --signature=4be87a9f953248352114216 --client --user vmail" > > #> > > > > On 10:05 Tue 11 May , Steffen Kaiser wrote: > > On Tue, 11 May 2010, Danila wrote: > > > > >>> On 01:18 Tue 11 May , Trever L. Adams wrote: > > >>>> On 05/11/2010 12:02 AM, Danila wrote: > > >>>>> May 11 10:54:09 evil imap: antispam: mail copy: src spam: 0, dst > > spam: 1, src unsure: 0 > > >>>>> May 11 10:54:09 evil imap: antispam: /usr/local/bin/dspam > > --source=error --class=spam --signature=4be87a9f953248352114216 > > --client --user vmail > > >>>>> May 11 10:54:09 evil imap: antispam: executing > > /usr/local/bin/dspam failed: 13 (uid=1009, gid=1010) > > >>>>> > > >>>>> uid=1009, gid=1010 is vmail user > > What happens, if you run the command from the shell as user vmail? E.g.: > > > > sudo -u \#1009 /usr/local/bin/dspam --source=error --class=spam \ > > --signature=4be87a9f953248352114216 --client --user vmail > > > > Hmm, I don't know if you can also assign the gid... > > > > Regards, > > > >> > >

4 4

[Dovecot] Help with acl_shared_dict
by Marcio Merlone 11 May '10

11 May '10

Hi all, I am trying to set up shared folders with dovecot 1.2.10-0xk1 on a ubuntu 8.04 server and so far so good. I managed to share a folder using GOSa GUI, but I cannot list it on Thunderbird yet, because of acl_shared_dict param (I guess). I tried BDB as per the wiki: plugin { acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes.db } I gave shared-mailboxes.db 0666 perms but it keeps resetting permissions to 0600, which gives me "open(/var/lib/dovecot/shared-mailboxes.db) failed: Permission denied" errors. So I went to try sql dict, but could not find where to put sql server connection details like user, host, password. dovecot -n (with sql dict): # 1.2.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.24-27-server i686 Ubuntu 8.04.4 LTS log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve ssl_cert_file: /etc/ssl/certs/dovecot.pem ssl_key_file: /etc/ssl/private/dovecot.pem disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_privileged_group: mail mail_location: maildir:~/Maildir mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): quota imap_quota acl imap_acl mail_plugins(imap): quota imap_quota acl imap_acl mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: shared separator: / prefix: shared/%%u/ location: maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u list: children lda: postmaster_address: postmaster(a)a1.ind.br hostname: a1.ind.br mail_plugins: quota sieve acl auth default: mechanisms: plain login passdb: driver: pam args: session=yes blocking=yes dovecot userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/dovecot mode: 436 user: postfix group: postfix plugin: quota: maildir:storage=10485760 acl: vfile acl_anyone: allow acl_shared_dict: proxy::acl dict: acl: mysql:/etc/dovecot-dict-sql.conf (/etc/dovecot-dict-sql.conf is a copy from the wiki) Have I missed something? Thanks and best regards. -- Marcio Merlone

1 1

[Dovecot] Best location for indexes?
by Brandon Lamb 11 May '10

11 May '10

I cant seem to find anything via a google search, so if this has been answered I apologize. I am wondering if INDEX=MEMORY is going to give the best performance versus files? I have a server with directly attached storage, 8 gigs of ram, about 500 gigs of data. I am ok with losing and having to rebuild the indexes on a reboot as the last uptime was over 200 days

3 3

[Dovecot] Client cant see emails
by Romer Ventura 11 May '10

11 May '10

Hello, Last Saturday i scp the vmail folder from server1 running SLES to server2 running Debian. Everything went ok and only have a few small problems, but the one to bring up is that some users cant see their new emails. The server receives the emails and puts them in their folder, but the client cant see them. One user's inbox shows last email was received on Friday, however, the Maildir/cur/ shows: -rw------- 1 vmail vmail 42K 2010-05-10 08:40 1273498807.M796425P7283.housigma22,S=42341,W=43018:2, -rw------- 1 vmail vmail 324K 2010-05-10 09:13 1273500815.M763640P10054.housigma22,S=331257,W=335660:2, -rw------- 1 vmail vmail 20K 2010-05-10 09:34 1273502066.M777253P11943.housigma22,S=19857,W=20357:2, -rw------- 1 vmail vmail 8.9K 2010-05-10 09:44 1273502685.M898747P12796.housigma22,S=9035,W=9324:2, -rw------- 1 vmail vmail 7.3K 2010-05-10 09:46 1273502798.M419897P12975.housigma22,S=7386,W=7659:2, -rw------- 1 vmail vmail 9.1K 2010-05-10 09:48 1273502934.M480959P13148.housigma22,S=9228,W=9521:2, -rw------- 1 vmail vmail 74K 2010-05-10 10:02 1273503774.M524188P14327.housigma22,S=75769,W=78183:2, -rw------- 1 vmail vmail 8.6K 2010-05-10 10:08 1273504123.M573796P14820.housigma22,S=8790,W=9032:2, -rw------- 1 vmail vmail 158K 2010-05-10 10:21 1273504907.M531961P15897.housigma22,S=161359,W=166243:2, -rw------- 1 vmail vmail 59K 2010-05-10 10:22 1273504953.M794482P15971.housigma22,S=59529,W=60838:2, -rw------- 1 vmail vmail 301K 2010-05-10 11:03 1273507382.M33967P19462.housigma22,S=307286,W=311302:2, -rw------- 1 vmail vmail 306K 2010-05-10 11:03 1273507387.M136374P19464.housigma22,S=313035,W=317125:2, -rw------- 1 vmail vmail 5.4K 2010-05-10 11:08 1273507736.M805483P19953.housigma22,S=5432,W=5539:2, -rw------- 1 vmail vmail 6.6K 2010-05-10 11:10 1273507842.M113988P20125.housigma22,S=6718,W=6921:2, -rw------- 1 vmail vmail 3.3K 2010-05-10 11:20 1273508415.M94558P20879.housigma22,S=3308,W=3419:2, Any ideas...? # 1.2.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.29-xs5.5.0.15 i686 Debian 5.0.4 ext3 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps imap ssl_cert_file: /etc/ssl/certs/smtpd.crt ssl_key_file: /etc/ssl/private/smtpd.key login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_user: postfix mail_privileged_group: mail mail_uid: vmail mail_gid: vmail mail_location: maildir:/srv/mail/vmail/%Ud/%Ln/Maildir mbox_write_locks: fcntl dotlock imap_client_workarounds: delay-newmail outlook-idle netscape-eoh lda: postmaster_address: postmaster(a)somedomain.com auth_socket_path: /var/run/dovecot/auth-master log_path: /var/log/dovecot-deliver.log info_log_path: /var/log/dovecot-deliver-info.log auth default: mechanisms: plain login passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen client: path: /var/spool/postfix/private/auth-client mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail Thanks ------ Romer Ventura

2 1

[Dovecot] Reading emails, vmail user mail access problems.
by David Haggard 11 May '10

11 May '10

Hello, I have a new installation of Ubuntu 10.04 64bit and all packages are from the Ubuntu repos. dovecot version 1.2.9 My goal is to have a basic email server setup with imap and pop support so imap users can send and receive email for the company. Setup: I have a few users that will be using this mail server so I do not need anything advanced and I am ok with creating a user account with a password and managing email addresses manually. I currently have system accounts for a test user and I have setup virtual mailbox as this mail server will host 2+ domains. Postfix is installed and running, I also confirmed mail flow to this box and from this box is working to the test user created. I can log in with the test username of the system and this is the point at which I have some issues as I am having a permission problem which I think is related to dovecot. What I am not able to do is download emails via imap client, but I can send emails just fine. If I change the permissions of the virtual mailbox to the test user that is logged in to chmod 777 I can download emails, but I can't do this for each new email to that users mailbox. /var/vmail/DOMAIN/USER1/cur/ and anything listed here will be owned by vmail so no other user can read it. (can't download emails) as dovecot seems to be trying to use USER1 as a user to read the files. How can I have dovecot read emails as vmail no matter what user logs in? I have tried many config changes using vmail but its failed so I need some advise. Here is my config: I edited the DOMAIN to hide the real domain used. # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-21-server x86_64 Ubuntu 10.04 LTS ext4 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_location: maildir:/var/vmail/DOMAIN/%n/ mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 auth default: passdb: driver: pam userdb: driver: passwd userdb: driver: static args: uid=vmail gid=vmail home=/var/vmail/DOMAIN/%n/ Thank you

2 1

[Dovecot] wrong config file?
by Phil Howard 10 May '10

10 May '10

The sample provided config file (the one I started with by editing it) included the following text: # ------------------------------ WARNING ------------------------------- > > # If there's a file /etc/dovecot/dovecot-postfix.conf, which is part of > # dovecot-postfix package, it will be used instead of dovecot.conf. > > # Keep in mind that, if that file exist, none of the changes in > # /etc/dovecot/dovecot.conf will have effect on dovecot's configuration. > # In that case you should customize /etc/dovecot/dovecot-postfix.conf. > > # ------------------------------ WARNING ------------------------------- > So I expected it would use that by default. It seems to not be doing so. Does this mean I have to modify the startup scripts to add the -c option to force the use of this config file? Or should I just put all my configs in the default "/etc/dovecot/dovecot.conf" file? When doing "dovecot -n" it became apparent that my configs were not being used. But "dovecot -c /etc/dovecot/dovecot-postfix.conf -n" was doing it. Any idea why it's not behaving as those comments described?

2 7

[Dovecot] configuration user= or auth_user=
by Phil Howard 10 May '10

10 May '10

The sample config file has: # User to use for the process. This user needs access to only user and # password databases, nothing else. Only shadow and pam authentication # requires roots, so use something else if possible. Note that passwd # authentication with BSDs internally accesses shadow files, which also # requires roots. Note that this user is NOT used to access mails. # That user is specified by userdb above. user = root # Directory where to chroot the process. Most authentication backends don't # work if this is set, and there's no point chrooting if auth_user is root. # Note that valid_chroot_dirs isn't needed to use this setting. #chroot = So is the variable for the authentication process user supposed to be "user" or "auth_user"? It would make more sense to be "auth_user". Is it just "user" for legacy reasons, and the reference to "auth_user" is in error? Or can either name be used? Also, those of you who change this, do you change it to something existing like "dovecot" or "vmail" or "nobody" or do you make a whole new user for it?

1 0

[Dovecot] lmtp_generic_maps with postfix
by derwyn 10 May '10

10 May '10

Hi All, I am new to dovecot so this may be a very easy thing to do. I need to setup a postfix+dovecot server for a multilocation setup The rules are very simple mails to *(a)local.example.com send to dovecot mails to *(a)otherlocation.example.com send to smtp:[otherlocation] But the users are created on dovecot as user(a)example.com. How can I configure dovecot to accept mails for *(a)local.example.com and deliver to *(a)example.com I use lmtp_generic_maps for a similar thing in postfix+cyrus Thanks Derwyn.

1 0

[Dovecot] problems implementing dovecot LDA with Postfix
by Stan Hoeppner 09 May '10

09 May '10

Per the instructions here http://wiki.dovecot.org/LDA and here http://wiki.dovecot.org/LDA/Postfix I set postmaster_address = postmaster(a)hardwarefreak.com in /etc/dovecot/dovecot.conf and mailbox_command = /usr/lib/dovecot/deliver in /etc/postfix/main.cf When I restart dovecot I get this: [07:17:00][root@greer]/etc/dovecot$ /etc/init.d/dovecot restart Restarting IMAP/POP3 mail server: dovecotError: Error in configuration file /etc/dovecot/dovecot.conf line 754: Unknown setting: postmaster_address Fatal: Invalid configuration in /etc/dovecot/dovecot.conf failed! And after restarting Postfix and sending a test message from a gmail account I get this in the mail log: May 9 07:26:09 greer postfix/qmgr[13384]: AEE976C32C: from=<snugmonster(a)gmail.com>, size=1628, nrcpt=1 (queue active) May 9 07:26:09 greer dovecot: deliver(stan): Fatal: postmaster_address setting not given May 9 07:26:09 greer postfix/local[13392]: AEE976C32C: to=<stan(a)hardwarefreak.com>, relay=local, delay=1.4, delays=1.3/0.03/0/0.04, dsn=4.3.0, status=deferred (temporary failure) The server is Debian Lenny 5.0.4 with Postfix 2.5.5 and Dovecot 1.2.11 from Lenny backports. Any ideas? Everything I've found via Google relating to this Dovecot startup error has to do with people converting old dovecot.conf files to a new dovecot version. -- Stan

3 4

[Dovecot] CRYPT scheme and 8 character limit
by Phil Howard 09 May '10

09 May '10

I've decided that having users supply cleartext passwords for me to encrypt and encode is a bad idea, anyway. So maybe I won't need dovecotpw. The idea is that users supply an already-encrypted password. Most of the users can fetch their login password from /etc/shadow on their own computer. Wiki page http://wiki.dovecot.org/Authentication/PasswordSchemes indicates that scheme name CRYPT is the one that uses the libc crypt() function. But it also says it uses no more than 8 characters. Then there is MD5-CRYPT. But that doesn't call crypt(), I presume. No limit on password size is indicated. But this at least looks like SOME of the encrypted passwords I have. Other passwords I have have ids indicating SHA-256 and SHA-512. Here is an example from /etc/shadow that encrypted the clear password "dovecotandpostfix" (in case it is necessary to test it): $6$IwZzpjjj$p1VrkxQmgmTED8iQnQrV3sVEZpBmw2N8oD1ykOguXB5tf8aahICesX0TF6.VMThIW2QFs1buHjT3eDtnaAFhF1 The big question is, what scheme name should I use for these passwords? I can, of course, consider the id (6 in the above example, suggesting SHA-512) if there is one (so far all are like this). But the other consideration is most of the passwords are longer than 8, some longer than 12, characters. So apparently CRYPT can't be used in those cases (so I can't have the automatic identification of crypt() to detect the scheme). What scheme would I use for the various passwords? What scheme would be used for the above example for starters? What if the id is 5 or 1 (the ones documented for the crypt() call)?

3 4

[Dovecot] looking for feedbacks on courier to dovecot
by Mihamina Rakotomandimby 08 May '10

08 May '10

Manao ahoana, Hello, Bonjour, We currently run courier POP . We would like to switch to Dovecot. I encounter problems when migrating the UIDL because we have big Maildirs and POP re-downlading the data is not possible for most of the users. I tried the http://www.dovecot.org/tools/courier-dovecot-migrate.pl script but I still have the re-downloading event. What are your stories and advices about courier-to-dovecot move? Misaotra, Thanks, Merci. -- Architecte Informatique chez Blueline/Gulfsat: Administration Systeme, Recherche & Developpement +261 34 29 155 34 / +261 33 11 207 36

1 1

[Dovecot] v2.0.beta4: Couldn't drop privileges: Unknown mail_privileged_group
by Thomas Leuxner 08 May '10

08 May '10

Hi, latest HG throws this error: May 8 06:42:33 spectre dovecot: master: Dovecot v2.0.beta4 (0a35407e6ff4) starting up May 8 06:48:01 spectre dovecot: imap(alias(a)domain.tld): Error: user alias(a)domain.tld: Couldn't drop privileges: Unknown mail_privileged_group: 5000 May 8 06:48:01 spectre dovecot: imap(alias(a)domain.tld): Error: Internal error occurred. Refer to server log for more information. Regards Thomas

1 0

[Dovecot] Questions, Issues with 2.0
by Kelsey Cummings 08 May '10

08 May '10

I'm trying to use an external program to set the location of user's maildirs to match an existing hashing schema but the docs for how to do this in 1.x do not seem to apply to 2.0 or I'm misinterpreting them. protocol imap { mail_executable = /opt/dovecot-test/sonic-imap ... This correctly executes the and attempts to sets the MAIL variable but it appears that mail_executable is run before the user is logged in so the $USER variable isn't set and the process' uid is still 0. We also need to have dovecot include an additional maildir for each user that is currently stored outside of the user's main maildir directory into the same namespace as a specific folder name. Is there a way to do this in dovecot directly or will it need to be hacked (as it is currently with courier) or could it be done with a plugin? I've also noticed that while doveconf complains about mail_executable: May 3 13:44:10 a dovecot: config: Obsolete setting in /opt/dovecot-test/etc/dovecot/conf.d/imap.conf:7: mail_executable has been replaced by service { executable } However, when replaced as suggested by doveconf: protocol_imap { executable = /opt/dovecot-test/sonic-imap ... It fails altogether: doveconf: Fatal: Error in configuration file /opt/dovecot-test/etc/dovecot/conf.d/imap.conf line 7: Unknown setting: executable Similarly, it also suggests 'drop_priv_before_exec = no' which doesn't appear to be valid either. -- Kelsey Cummings - kgc(a)corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407

2 4

[Dovecot] Dovecot version mismatch - after restart
by edeis 07 May '10

07 May '10

Getting the followng error when managesieve is enabled. Any other post I've read says this problem is because the service hasn't restarted after upgrade. I've restarted dovecot & postfix many times, reboot machine too. Still get the error. Racking my brains on this!! May 7 13:21:19 drizzle dovecot: dovecot: Created login processes successfully, unstalling May 7 13:21:20 drizzle dovecot: managesieve-login: Fatal: Dovecot version mismatch: Master is v1.2.11, login is v1.2.10 (if you don't care, set version_ignore=yes) May 7 13:21:20 drizzle dovecot: dovecot: Temporary failure in creating login processes, slowing down for now May 7 13:21:20 drizzle dovecot: managesieve-login: Fatal: Dovecot version mismatch: Master is v1.2.11, login is v1.2.10 (if you don't care, set version_ignore=yes) Running CentOS5.4. Installed Packages from atrpms dovecot.x86_64 1:1.2.11-3_108.el5 installed dovecot-managesieve.x86_64 0.11.11-0_4.el5 installed dovecot-sieve.x86_64 1:0.1.15-4.el5 installed Here's my dovecot settings: [root@drizzle /]# dovecot -n # 1.2.11: /etc/dovecot.conf # OS: Linux 2.6.18-164.15.1.el5.028stab068.9 x86_64 CentOS release 5.4 (Final) protocols: imap imaps pop3 pop3s managesieve ssl_cert_file: /etc/ssl/certs/mydomain.com.crt ssl_key_file: /etc/ssl/certs/mydomain.com.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login mail_privileged_group: mail mail_location: maildir:%h mail_debug: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 mail_plugin_dir(managesieve): /usr/lib64/dovecot/managesieve namespace: type: private prefix: INBOX. inbox: yes list: yes subscriptions: yes lda: postmaster_address: me(a)mydomain.com auth default: mechanisms: plain login passdb: driver: checkpassword args: /var/www/ispcp/engine/ispcp-dovecot-mngr userdb: driver: sql args: /etc/dovecot/dovecot-sql-domain.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql-aliasdomain.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql-subdomain.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: mail plugin: sieve: /etc/dovecot/sieve/dovecot.sieve [root@drizzle /]# -- View this message in context: http://old.nabble.com/Dovecot-version-mismatch---after-restart-tp28491245p2… Sent from the Dovecot mailing list archive at Nabble.com.

1 0

[Dovecot] Requiring STARTTLS only on some networks
by Thomas Hummel 07 May '10

07 May '10

Hello Timo, is there a way, either in 1.2.x or in 2.x to activate disable_plaintext_auth=yes only for some address or network ? The idea would be to enable clients from the internal networks to keep making clear text connections while forbidding it to the rest of the world. Thanks. -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

3 6

[Dovecot] Tracing sieve execution
by Jerry 07 May '10

07 May '10

I have just recently begun learning how to use sieve. For the most part, it works fine. The problem is that I have created some rather complicated rules. Occasionally, an e-mail will get sorted incorrectly and I am not able to easily determine what rule caused it to occur. Is there any way or utility that I could use to actually see what rule or line in the sieve file caused the action? -- Jerry Dovecot.user(a)seibercom.net Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ I hate it when my foot falls asleep during the day cause that means it's going to be up all night. Steven Wright

2 1

[Dovecot] dovecotpw documentation
by Phil Howard 07 May '10

07 May '10

Where can I find documentation on how to use the "dovecotpw" program that I was referred to? No man page. No wiki. Very little from "dovecotpw -h". What I need to do is generate the "passwd-file" contents with an MD5 scheme (the one equivalent to /etc/shadow is preferred).

1 0

[Dovecot] Iphone and Dovecot - 2-way sync
by Lucio Godoy 07 May '10

07 May '10

Hi All; Does the Iphone and Dovecot works well? Do you get full IMAP sync with IPHONE <=> DOVECOT <=> Outlook, pls? thanks Lucio =========================================================== The Home CCTV Security System made easy! http://www.kaduco.com/our-list-products-services/cctv-security-camera-syste… _________________________________________________________________ http://clk.atdmt.com/UKM/go/197222280/direct/01/ We want to hear all your funny, exciting and crazy Hotmail stories. Tell us now

5 9

[Dovecot] ACLs and public folders
by hyperbatus＠gmx.de 07 May '10

07 May '10

Dear list, I am using dovecot 1.0.15 on Debian Lenny. I have a public folder, I use ACL / vfile (without public ACL), and I use maildir / vmail. Now I have two questions: 1) http://wiki.dovecot.org/ACL states: "Mailboxes in public namespaces don't have owners, so by default no-one can access them." The same document, when explaining the meaning of the k flag in the ACLs, states: "Mailboxes can be created (or renamed) under this mailbox (there is no recursion, so creating a mailbox under this mailbox's child uses only the child's ACLs)" I have placed an ACL (dovecot-ACL) at the root of the public namespace (all rights to anyone). The public namespace was appearing correctly in my IMAP client. Then I have copied a large folder with hundreds of nested subfolders (nesting level > 3) from another account to the root of the public namespace. According to the documentation mentioned above, this should not have been possible (if I got the docs right): The first nesting level of folder should have been created, but not the messages in them and for sure not the deeper nested folders. There is no dovecot-acl within a single of the first level folders (I have verified this), so no one should have access to them. Nevertheless, in addition to the succesful copy, I can see every folder and every message in my IMAP client, I can delete and so on. Could some please explain if I got the docs wrong? 2) If there really is no ACL recursion, how are we supposed to copy large folder structures (perhaps thousands of folders, nested to 5 levels deep) to a public namespace? Do we need to create all folders by hand, then place the dovecot-acl in each folder, and then copy the messages to each folder by hand? Do we need to switch to global ACLs so that we can establish a master user for doing the act of filling the public space? Or is there a dovecot module which, immediately after creating a folder, looks into the parent folder of the new folder and copies the dovecot-acl from the parent folder to the new folder? Currently, I am very happy that dovecot didn't what it should do according to my understanding of the documentation (since I really needed to copy this folder structure to the public namespace), but on the other hand, I am a bit puzzled now not knowing if the documentation is wrong, my understanding of it is wrong or the source code is wrong :-) Thanks you very much for any help, Peter Here is the output of dovecot -n: # 1.0.15: /etc/dovecot/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot-info.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps listen: 192.168.20.23 ssl_cert_file: /etc/dovecot/imap-ssl.home.omeganet.de.crt ssl_key_file: /etc/dovecot/imap-ssl.home.omeganet.de.key ssl_parameters_regenerate: 24 ssl_cipher_list: ALL:!LOW login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_processes_count: 1 login_max_processes_count: 32 max_mail_processes: 32 mail_privileged_group: mail mail_location: maildir:~/Maildir mail_cache_fields: mail_never_cache_fields: mail_plugins: acl namespace: type: private inbox: yes namespace: type: public prefix: Archive. location: maildir:/home/vmail/archive:INDEX=~/Maildir/archive auth default: cache_size: 1 cache_ttl: 600 worker_max_count: 4 passdb: driver: passwd-file args: /etc/dovecot/passdb userdb: driver: static args: uid=vmail gid=vmail home=/home/vmail/%u socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: root plugin: acl: vfile -- GMX DSL: Internet, Telefon und Entertainment für nur 19,99 EUR/mtl.! http://portal.gmx.net/de/go/dsl02

2 2

[Dovecot] during change sql password on squirrelmail
by Yavuz Maşlak 07 May '10

07 May '10

Hello I use squirrelmail1.4.20, compatible2, change_sql plugin, dovecot, postfix, mysql,virtualuser. I can change my email password successfully on squirrelmail. When I change my password the squirrelmail throw me a page which contains an error as followings; "This page request could not be verified and appears to have expired." how can I correct this issue?

2 1

[Dovecot] log_path and info_log_path - ownership of parent directory
by Phil Howard 07 May '10

07 May '10

The Ubuntu package didn't create the directory for these. What ownership/permissions are needed for it? Does it need to be owned by the dovecot user?

2 1

[Dovecot] disable plaintext auth ... only for some addresses
by Phil Howard 06 May '10

06 May '10

I'd like to disable plaintext authentication (e.g. only allow authentication that does STARTTLS or connects on SSL/TLS only ports) only for certain (most) IP addresses. I want to exempt a few addresses (users coming over known VPNs). Fortunately, all this is coming in over a firewall (Sonicwall) in which I can NAT traffic by IP address to go to specific port numbers. So, if I can establish a different disable_plaintext_auth policy by port number (for extra port numbers I'll choose later), that would let me accomplish this. If I cannot do this, then my only alternative is making the SSL/TLS only ports the only ones open to the internet, and use the non-SSL/TLS ports only for the VPNs (with disable_plaintext_auth = no). But I read somewhere that this is discouraged. What say ye?

1 0

[Dovecot] adding users to passwd-file
by Phil Howard 06 May '10

06 May '10

Is there a tool equivalent to the system "passwd" command (or maybe "adduser" or "useradd") that can support a passwd-file by setting a password, encrypting it with the salted MD5 scheme? The system "passwd" command doesn't have an option to "do it to this alternate file instead of /etc/shadow".

4 5

[Dovecot] dovecot and pigeonhole
by Vasiliy G Tolstov 06 May '10

06 May '10

Hello. Today i'm compile dovecot and pigeonhole from hg repo. After start dovecot i get errors in log like this: May 6 12:04:15 selfip dovecot: imap: Error: dlopen(/usr/lib/dovecot/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_get_log_var_expand_table Google sasys, that this functions added in dovecto 2010-04-26, why a get this error when load sieve plugin? Thnak You. -- Vasiliy G Tolstov <v.tolstov(a)selfip.ru> Selfip.Ru

2 2

[Dovecot] !include
by Andre Hübner 06 May '10

06 May '10

dovecot 1.2.11 Hello, i do some tests with: !include /etc/dovecot/conf.d/*.conf dovecot fails to start if /etc/dovecot/conf.d/ is empty. Is this a expected behaviour? !include_try works without error but seems to me to be more usual when explicit, complete filename is given. is a little bit strange in contrast to behaviour of other servertypes which support a include-directive. Thanks, Andre

1 0

Re: [Dovecot] Dovecot Won't start on SLITAZ Linux
by Ludovic LEMARINEL 06 May '10

06 May '10

2010/5/6 Ludovic LEMARINEL <l.lemarinel(a)gmail.com> > 2010/5/6 Tom Hendrikx <tom(a)whyscream.net> > > On 06/05/10 13:40, Ludovic LEMARINEL wrote: >> > 2010/5/6 Charles Marcus <CMarcus(a)media-brokers.com> >> > >> >> On 2010-05-06 4:51 AM, Ludovic LEMARINEL wrote: >> >>> I've just compiled dovecot under Slitaz, but I can't get it to >> >>> run... >> >>> >> >>> It always die with this message in log : >> >>> >> >>> 2010-05-06 12:35:12 dovecot: Info: Dovecot v1.2.11 starting up >> >>> 2010-05-06 12:35:12 dovecot: Fatal: setrlimit(RLIMIT_DATA, 256): >> >>> Operation not permitted >> >> >> >> Google is your friend. Simply highlighting the above error: >> >> >> >> Fatal: setrlimit(RLIMIT_DATA, 256): Operation not permitted >> >> >> >> Provides the answer: >> >> >> >> http://tinyurl.com/25rmjod >> >> >> >> > >> > Thanks for your answer, but no, this page does not provide the answer. >> > The error message this guy gets is not the same as me >> >> Your original post says it does. If you receive another error message, >> please add it to your problem report. Also, please try to start dovecot >> from the commandline (as suggested in the url from Charles), and tell us >> about its behaviour, output and logging. >> >> > , and I don't have any >> > "/etc/security/limits.conf" file, so I can't change this setting . >> >> Dovecot tells you only what setting to to adjust. Where you put your >> settings is largely dependant on your OS or distro implementation. >> >> >> Ow, and please do not top-post. >> >> Regards, >> Tom >> > > > I've tried to run dovecot from the command line : it says what was the last > error (see my first post), and then nothing more. > When I do "ps", I can't see any process running, and the log says dovecot > finished... > > No more message than this :( > I'm going to try with 2.0 beta, and if no luck, I'll try to go down to 1.1. > Some news from my problem : I've tried 2.0 beta, 1.1, and both didn't worked. I went down to v1.0.15, and it works... Still haven't found what's wrong with newer versions...

1 0

[Dovecot] 2.0 beta4 (5d76f5b13883): Home directory not recognized
by Thomas Leuxner 06 May '10

06 May '10

Hi, latest Mercurial seems to have problems with the Config Module unloads: May 5 19:18:16 spectre dovecot: master: Dovecot v2.0.beta4 (5d76f5b13883) starting up May 5 19:18:34 spectre dovecot: managesieve: Error: fd_read() partial input (54/88) May 5 19:18:34 spectre dovecot: imap-login: Fatal: Error reading configuration: read(/var/run/dovecot/config) failed: EOF May 5 19:18:34 spectre dovecot: master: Error: service(imap-login): command startup failed, throttling Restarting IMAP/POP3 mail server: dovecotError: user root: Initialization failed: userdb didn't return a home directory, but plugin setting quota used it (%h): dict:user::file:%h/mdbox/dovecot-quota Fatal: Invalid user settings. Refer to server log for more information. $ tail /etc/dovecot/conf.d/90-plugin.conf quota = dict:user::file:%h/mdbox/dovecot-quota quota_rule = *:storage=1GB quota_rule2 = Trash:storage=10%% acl = vfile:/var/vmail/conf.d/%d/acls:cache_secs=300 } Regards Thomas

2 2

[Dovecot] migrating maildir from 1.1.7 to 1.2.11
by Romer Ventura 05 May '10

05 May '10

Hello, I have a SLES server running dovecot 1.1.7 and postfix which happens to be the production server. We are dumping all of the paid OSes so i have configured a Debian Lenny server to run the new mail server. The debian server has everything installed and it seems to be working fine. However, i need to get all the mailboxes from the SLES server, will there be any problem if i just copy the "vmail" folder to the new server...? Thanks ------ Romer Ventura

2 1

[Dovecot] Expire plugin
by Thomas M Goerger 05 May '10

05 May '10

Hi, I'm testing out the dovecot expire plugin, and not seeing anything go into the database I've got set up. It's a mysql db. I've gone in and verified that the db is set up correctly. The socket is set up so that deliver should be able to talk to the db, but I'm not seeing anything in the expires table when I look. Is there anywhere that expire can log to so I can see what might be happening? It doesn't look like it logs to the dovecot log. Thanks! ************************************************************************* * Tom Goerger - Email/Unix System Administrator * * * * University of Minnesota Email: tmg(a)umn.edu * * Operations, Infrastructure and Architecture Phone: 4-5804 * * Internet Services Office: 626J WBOB * * * *************************************************************************

2 6

[Dovecot] Plugin to handle message saved and handle move from tmp to cur/new
by Alex Baule 05 May '10

05 May '10

Hello everyone.... I need to finish my plugin, but i depends from some stuffs in the save/move process that i can't find how its work. In new zlib plugin (2.0) , the message is saved compressed now, but i dont find how is done the process to write the file to tmp, and move it to the cur or new directory (inside .Sent). I need to hook this function, to get access to some variables, like Flags and filename. There is a way to do this ? Tks.

1 0

[Dovecot] [Bug] Case sensitive usernames and variables
by Неворотин Вадим 05 May '10

05 May '10

Today I've found a very irritating bug: I use mail_location = maildir:/var/mail/%u/ in my dovecot.conf. And if user type Username, username, USERname etc at login dovecot create a different Maildir's for one real user. But LDA works corretly and save all messages to lowercase username mailbox. No problem, add L: mail_location = maildir:/var/mail/%Lu/ Then all works good. But I has also such namespace configuration: namespace shared { separator = / prefix = &BCAEMARBBEEESwQ7BDoEOA-/%%u/ location = maildir:/var/mail/%%u:INDEX=/var/mail/%u/shared/%%u subscriptions = no list = children } And here I can't replace %u with %Lu, because dovecot write to dovecot.log: IMAP(malamut): Error: Namespace '&BCAEMARBBEEESwQ7BDoEOA-/%Lu/': shared: Shared namespace prefix contains unknown variables So user has only one mailbox (with lovercase name), but a lot of different indexes for shared mailboxes, eg /var/mail/username/shared, /var/mail/USERname/shared etc. How can I tune dovecot to use always lowercase username? Dovecot 1.2.10

2 2

[Dovecot] 2.0 FTBFS since sqlpool changes when --with-sql=plugin is used
by Michal Hlavinka 05 May '10

05 May '10

Hi, yesterday lib-sql got driver-sqlpool with some changes in Makefile.am, but these changes in makefile works only for --with-sql=yes. When --with-sql=plugin is used build fails with: libtool --tag=CC --mode=link gcc -std=gnu99 -O2 -g -pipe -Wall -Wp,- D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 - m64 -mtune=generic -Wall -W -Wmissing-prototypes -Wmissing-declarations - Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict- aliasing=2 -o checkpassword-reply checkpassword-reply.o ../../src/lib- dovecot/libdovecot.la -lrt libtool: link: gcc -std=gnu99 -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 - fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic - Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -o .libs/auth auth.o auth-cache.o auth-client-connection.o auth-master-connection.o mech- otp-skey-common.o mech-plain-common.o auth-penalty.o auth-request.o auth- request-handler.o auth-settings.o auth-stream.o auth-worker-client.o auth- worker-server.o db-checkpassword.o db-sql.o db-passwd-file.o main.o mech.o mech-anonymous.o mech-plain.o mech-login.o mech-cram-md5.o mech-digest-md5.o mech-external.o mech-gssapi.o mech-ntlm.o mech-otp.o mech-skey.o mech-rpa.o mech-apop.o mech-winbind.o passdb.o passdb-blocking.o passdb-bsdauth.o passdb- cache.o passdb-checkpassword.o passdb-passwd.o passdb-passwd-file.o passdb- pam.o passdb-shadow.o passdb-sia.o passdb-vpopmail.o passdb-sql.o userdb.o userdb-blocking.o userdb-checkpassword.o userdb-nss.o userdb-passwd.o userdb- passwd-file.o userdb-prefetch.o userdb-static.o userdb-vpopmail.o userdb-sql.o db-ldap.o passdb-ldap.o userdb-ldap.o -Wl,--export-dynamic libpassword.a ../lib-ntlm/libntlm.a ../lib-otp/libotp.a ../../src/lib-sql/.libs/libsql.a ../../src/lib-dovecot/.libs/libdovecot.so -lcrypt -lpam -ldl -lrt -Wl,-rpath - Wl,/usr/lib64/dovecot libtool: link: gcc -std=gnu99 -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 - fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic - Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -o .libs/checkpassword-reply checkpassword-reply.o ../../src/lib- dovecot/.libs/libdovecot.so -ldl -lrt -Wl,-rpath -Wl,/usr/lib64/dovecot ../../src/lib-sql/.libs/libsql.a(sql-api.o): In function `sql_init': /home/mhlavink/cvsf/dovecot/devel/dovecot-2.0.beta4/src/lib-sql/sql-api.c:70: undefined reference to `driver_sqlpool_init' Regards, Michal Hlavinka

1 1

[Dovecot] Access filesystem (NFS) as some user
by Mihamina Rakotomandimby 05 May '10

05 May '10

Manao ahoana, Hello, Bonjour, My Dovecot server has to access the users Maildirs. Maildirs are on a NFS mount that only a user (vmail/500) may read and write. No one else. How to configure Dovecot so that at least disk read-write are performed as a "vmail" user (that I have created with the right attributes)? Is the workaround of changing dovecot's system UID/GID a not-so-bad one? (I am trying to see if it works, at least...) Misaotra, Thanks, Merci. -- Architecte Informatique chez Blueline/Gulfsat: Administration Systeme, Recherche & Developpement +261 34 29 155 34 / +261 33 11 207 36

2 3

Re: [Dovecot] Dovecot deliver LDA problem
by Noel Butler 05 May '10

05 May '10

bugger sent that direct, please send that output to the list :) On Wed, 2010-05-05 at 09:04 +1000, Noel Butler wrote: > Alex, > > Please show the output of dovecot -n > > > On Tue, 2010-05-04 at 15:23 -0700, Alex wrote: > > > Thanks for the hint. > > > > I enabled 'socket listen' it in dovecot.conf as you pointed it out. > > > > Now dovecot.err log has these error messages: > > > > May 04 14:57:19 deliver(user1(a)some_domain.com): Error: User > > user1(a)some_domain.com is missing UID (set mail_uid) > > May 04 14:57:19 deliver(user2(a)some_domain.com): Error: User > > user2(a)some_domain.com is missing UID (set mail_uid) > > May 04 14:57:25 deliver(user3(a)some_domain.com): Error: User > > user3(a)some_domain.com is missing UID (set mail_uid) > > > > > > I tried to set necessary mail_uid in dovecot-sql.conf in user_query: > > > > user_query = SELECT maildir as mail, 51 as userdb_uid, 51 as > > userdb_gid, > > 51 as mail_uid FROM dovecot_email_maps WHERE email = '%u' > > > >

2 2

[Dovecot] Dovecot deliver LDA problem
by Alex 05 May '10

05 May '10

Hello folks, I was trying to set up Dovecot deliver LDA instead of Postfix default virtual LDA In Postfix main.cf I specified: virtual_transport = dovecot dovecot_destination_recipient_limit = 1 In Postfix master.cf I entered: dovecot unix - n n - - pipe user=mailer flags=DRhu argv=/usr/local/mail/libexec/dovecot/deliver -f ${sender} -d ${recipient} In Dovecot dovecot.conf I have the following entries: passdb sql { args = /etc/dovecot/dovecot-sql.conf } userdb prefetch { } userdb sql { args = /etc/dovecot/dovecot-sql.conf } In Dovecot dovecot-sql.conf I have this: user_query = SELECT maildir as mail FROM dovecot_email_maps WHERE email = '%u' password_query = SELECT user, password, userdb_uid, userdb_gid, userdb_home, userdb_mail FROM dovecot_user_maps WHERE user = '%n' After reloading postfix and restarting dovecot I'm getting this type of warnings in dovecot.err log: May 04 10:43:10 deliver(some_address(a)some_domain.com): Error: userdb lookup: connect(/var/run/dovecot//auth-master) failed: No such file or directory Could somebody please help me to resolve this mistery. What am I missing ether in configuration file or somewhere else? Many thanks in advance, Alex

2 2

[Dovecot] CDB Authentication database
by Luca Corti 04 May '10

04 May '10

Hello, I'd be interested in seeing a CDB based backend for the userdb/passdb lookups. Is anyone working on this? Is there any documentation (other than the wiki Design section and the code itself) on implementing database backends? thanks Luca

5 5

[Dovecot] Dovecot antispam plugin with virtual users
by Philipp 04 May '10

04 May '10

Hi, I'm running dovecot 1.2.11 with the antispam plugin 1.2+20090702-1+b1 installed from the debian repos (squeeze) and dspam 3.9.0+git20100416-1. Unfortunately this doesn't seem to work well with my virtual users, stored on a local openldap server: While sending mail manually to dspam does work, there's some trouble when trying to use the antispam plugin. I tried using both sendmail (exim4 in my case) and configuring antispam_mail_sendmail = /usr/bin/dspam to point to dspam, with similar results: exim: [15042] Failed to get user name for uid 5001 dspam: dspam[18961]: Unable to determine the runtime user both errors are reproducible by running exim/dspam with sudo -u \#5001 with 5001 being the virtual uid used of the user that is logged in through imap. Of course the uid 5001 is invalid for the rest of the system, so it can't run anything, but as far as I can tell the plugin uses this uid to call the respective programs :\ Now I was wondering if it was possible to keep the plugin from using the imap-uid and instead specifying one elsewhere? I guess this would be of fairly great interest for everyone using virtual users, be it ldap or anything else. Or is there a different way to do this? Do I maybe just miss setting a variable somewhere? Philipp

2 1

[Dovecot] dovecot user
by Timo Sirainen 04 May '10

04 May '10

Any thoughts on this: The primary use for "dovecot" user has been for login processes. But people keep misunderstanding this and try to use dovecot for accessing mails. For years I've been wondering about renaming this user to something else like dovelogin, but it never really seemed practical. So now with v2.0 there are a bunch of new processes, and for example anvil and dict are now run as dovecot user by default. But it's not really good that login processes can just go and kill those processes. And even worse, if drop_priv_before_exec=yes they could ptrace these processes. So I think we need two Dovecot users for v2.0: 1. Completely untrusted user for login processes. 2. Slightly more trusted internal Dovecot user. So "dovecot" could be reused for 2. And it would no longer be a mortal sin to use dovecot user for owning mail files. For 1. there would be a new user. I'd use "dovelogin", but apparently tools still don't much like usernames that are longer than 8 characters. Like ps could show numeric uid instead of 9 character long username. So .. any suggestions? "dovlogin" could be one possibility I guess. It would be nice if the name somehow reminded of login processes, but maybe something else could be used too, like: dovenil, dovenull, dovezero, dovenone, dovevoid, doveint, dovedown, dovein, dove0

17 33

[Dovecot] Dovecot SQL user_query
by Alex 04 May '10

04 May '10

Hello folkz, Is it possible to setup in dovecot-sql.conf file to run user_query twice if its first run didn't yield any values. And likewise don't proceed with the second run if the first user_query execution produced the result. I have to query two tables which specify there email messages shall be delivered via Dovecot deliver LDA depending on the incoming email addresses. Please don't question me about this setup. I inherited this mess from the previous Network Admin. First query should be ran like this: user_query = SELECT concat('maildir:/data/mail/',maildir) as mail FROM folders WHERE email = '%u' If the first query doesn't yield any result the second shall be ran like this: user_query = SELECT maildir as home FROM users WHERE email = '%u' Please advise if such user_query setup is possible at all. Thanks in advance, Alex

5 4

[Dovecot] exit codes for 'sievec'
by Jerry 04 May '10

04 May '10

As far as I can tell, 'sievec' always exits with '0' whether there is an error or not. If that is correct, I believe it should be modified to exit with some other code if the conversion and writing of the new file are not completed successfully. I have written a few script files and a 'make' file specifically for sievec. The inability to get an accurate exit code is problematic for me. -- Jerry Dovecot.user(a)seibercom.net Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ Fortune's Fictitious Country Song Title of the Week: "How Can I Miss You if You Won't Go Away?"

2 2

[Dovecot] zlib Plugin Dovecot 2.0 - ostream
by Alex Baule 03 May '10

03 May '10

Hello Everyone... In zlib save mail have it: struct ostream *output; There is a way to get the file descriptor from output used in ostream zlib plugin ? to get in istream is i_stream_get_fd, but don't have o_stream_get_fd......

2 6

[Dovecot] Dovecot Vs Procmail LDA
by Wilberth Pérez 03 May '10

03 May '10

Hi everyone: Anyone knows what are the differences (or advantages and disadvantages) between Dovecot LDA with postfix Vs. Procmail LDA with postfix ? -- -------------------------------------------------------- LCC Wilberth de Jesús Pérez Segura CCSA- Administración de Servicios y Seguridad de las TI Correo: wilberth.perez(a)uady.mx Universidad Autónoma de Yucatán Secretaría General Coordinación Administrativa de Tecnologías de Información RIUADY C-59 x Av. Itzáes (999)923-74-28 Ext. 1117 Mérida, Yucatán, México 2010 --------------------------------------------------------

1 0

[Dovecot] [SUGGESTION] Managesieve: Transparent home dir creation
by Felix Leimbach 03 May '10

03 May '10

Hi all, I'm using dovecot 2.0-beta4's sieve plugin and it works great but here is an idea for improvement: When creating the first sieve script for an account whose home dir does not yet exist then dovecot *does* create that homedir but the sieve client times out. Tried Thunderbird's sieve addon as well as horde's ingo. The log says: dovecot: managesieve-login: Login: user=<me(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured dovecot: managesieve(me(a)example.com): sieve-storage: sieve_storage_verify_dir(/mnt/data/vmail/dovecot-homedirs/example.com/me//s… failed: File exists dovecot: managesieve(me(a)example.com): Fatal: Failed to open Sieve storage. Because the homedir was created (great!) when I retry the same action then all works perfectly well. So why not make that homedir creation transparent so that the clients' first try succeeds instead of the second try? Cheers, Felix

3 3

[Dovecot] Migrating domain with diferent default_pass_scheme
by emiliojoel 03 May '10

03 May '10

Hi I have now my main mail server using dovecot with diferents domains and for user auth using mysql with default_pass_scheme = PLAIN, Now I am migrating a new domain from other server with dovecot using mysql with default_pass_scheme = MD5. My question is: Is possible have a different default_pass_scheme depending of the domain? could I use dovecot with domains using mysql auth with default_pass_scheme = PLAIN and other with default_pass_scheme = MD5? any sugestion? thanks Emilio -- View this message in context: http://old.nabble.com/Migrating-domain-with-diferent-default_pass_scheme-tp… Sent from the Dovecot mailing list archive at Nabble.com.

2 1

[Dovecot] dovecot server down, dovecot deliver keeps mail?
by mimosinnet＠gmail.com 03 May '10

03 May '10

My dovecot server was down las friday, and it seems that mails have been lost. This is what I have got in my logs since the server has been down: May 3 03:35:34 generatech dovecot: deliver(mail(a)domain.org): userdb lookup: connect(/var/run/dovecot/auth-master) failed: No such file or directory I guess that because the server was down dovecot transport could not deliver the mail. Nevertheless, I am wondering if dovecot deliver agent keeps undelivered mail somewhere. Thanks! I have been using this howto for the configuration: http://en.gentoo-wiki.com/wiki/Mail_server_using_Postfix_and_Dovecot This is dovecot 1.2.6, and my configuration: # dovecot -n # 1.2.6: /etc/dovecot/dovecot.conf # OS: Linux 2.6.28-hardened-r9 x86_64 Gentoo Base System release 2.0.1 rootfs listen: *:143 ssl_listen: *:52003 ssl_cert_file: /etc/ssl/dovecot/dovecot.pem ssl_key_file: /etc/ssl/dovecot/dovecot.key login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login first_valid_uid: 8 last_valid_uid: 8 first_valid_gid: 12 last_valid_gid: 12 mail_uid: 8 mail_gid: 12 mail_location: maildir:/var/mail/%d/%n/Maildir/:INDEX=/var/mail/%d/%n/indexes mail_plugins: quota imap_quota lda: postmaster_address: postmaster(a)generatech.org mail_plugins: quota sieve auth default: mechanisms: plain login user: nobody passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: mail group: mail plugin: sieve: /var/mail/%d/%n/.dovecot.sieve sieve_dir: ~/var/mail/%d/%n/sieve -- Ningún Lugar Activisme Cultural per a la Transformació Social Cultural Activism for Social Transformation ningun_lugar(a)riereta.net http://ningunlugar.org/ http://generatech.ningunlugar.org/ http://video.ningunlugar.org

2 1

[Dovecot] courier-imap and dovecot in migration process
by No body ist Perfect 02 May '10

02 May '10

Hello! I plan a migration from courier-imap to dovecot. at now run courier-imap as imaps server only and with perdition as redirector. can i run courier-imap and dovecot at same time on the same server(listing on diferent ports of course), i mean with shared home directory tree (Mailbox dir) ? Maybe access conflict or some problems ? Thanks a lot

1 0

[Dovecot] What causes dovecot to rebuild dovecot-uidlist?
by Pat 02 May '10

02 May '10

Hello, In what situations will Dovecot 1.2.11 rebuild its uidlist? I am using the maildir storage format, and I am also modifying the uidlist manually (so it's possible I could jack* things up). I have found some related code in maildir-uidlist.c: maildir_uidlist_next. 1) Blank filename or UID 0 2) Any UID not being greater than the proceeding UID 3) Any UID being greater than ~4 billion. 4) Any UID being greater than the suggested next uid. 6) If a filename contains a / 7) General header line sanity checking. Are there any other sections of the code that do sanity checks on dovecot-uidlist (for Maildir type storage)? And optionally do you agree that maildir_uidlist_set_corrupted is the best place to watch to see if I have mangled the uidlist? Thanks in advance, Pat * I insert into dovecot-uidlist manually when I deliver new messages, or discover a message that is not in uidlist for some reason. For compatability reasons I maintain a completely separate cache. If there is a better way to keep the uidlist up to date when the user isn't necessarily accessing the account via dovecot imap, I'm open to suggestions. However my situation is fairly unique I think.

2 2

[Dovecot] My dovecot does not store Thunderbird flags
by Julien Buratto 01 May '10

01 May '10

Hi all, my Dovecot 1.1.20 does not store flags (I mean, Thunderbird Labels like ToDo, Important and so on..) When logging in via telnet, I get: . examine INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk $MDNSent Junk $Forwarded NotJunk receipt-handled $Label7 $label1 $label2 $label3 $label4 $label5 expired_2w expired_2m delete rimandata forwarded) * OK [PERMANENTFLAGS ()] Read-only mailbox. As per Thunderbird mozillazine page about tags (http://kb.mozillazine.org/Tags#IMAP) that's what the issue is. PERMANENTFLAGS should allow /* while in my server it's empty. Could someone point me how can I change this behaviour or some hints ? Thank you -- Julien Buratto PS: In case someone asks for it > dovecot -n # 1.1.20: /usr/local/etc/dovecot.conf # OS: Linux 2.6.9-67.0.4.EL i686 CentOS release 4.7 (Final) log_path: /var/log/maillog info_log_path: /var/log/maillog protocols: imaps imap pop3 pop3s disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_location: mbox:~/mail/:INBOX=mbox mbox_lazy_writes: no mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes lda: postmaster_address: postmaster(a)example.com auth default: cache_size: 1024 verbose: yes passdb: driver: pam args: session=yes cache_key=%u%s dovecot userdb: driver: passwd plugin: acl: vfile:/etc/dovecot-acls

1 2

[Dovecot] UK Blackberry BIS and Dovecot - 2-way sync
by Lucio Godoy 01 May '10

01 May '10

Hi All; I have search the net and i cannot find any answers or fixes for this issue. I have a RHEL5 server running Dovecot Version 1.2.11 all worked well until i have diceded to subscribe to Vodafone's BIS service (BB Bold 9700). Internally I use outlook, and it does 2-way sync without any issues, but the blackberry only syncs new email and it does not sync deleted emails when I delete them in Outlook. Is there any special setting to allow such synchronisation? My server is secured by a pix firewall with ports 993, and 995 open for email sync (Secure IMAP and Secure Pop), i have setup the blackberry to use port 993. Many thanks for your help. Lucio =========================================================== The Home CCTV Security System made easy! http://www.kaduco.com/our-list-products-services/cctv-security-camera-syste… _________________________________________________________________ http://clk.atdmt.com/UKM/go/197222280/direct/01/ We want to hear all your funny, exciting and crazy Hotmail stories. Tell us now

1 0

[Dovecot] zlib Plugin Dovecot 2.0 - ostream
by Alex Baule 30 Apr '10

30 Apr '10

Hello Everyone. There is possible to rename the email saved by a plugin, like zlib ? i explain.... i need to add 1 line in email header, because of that, i want to rewrite the filename to update the S and W flag. Tks !

1 0

[Dovecot] 1.0.15 --> 1.2.11 --> got too little data
by Andre Hübner 30 Apr '10

30 Apr '10

Hello, did updates from 1.0.15 to 1.2.11 and is in most cases succesful. Sometimes dovecot leaves errormessage in Log: IMAP(username): FETCH [HEADER] for mailbox INBOX UID 5106 got too little data (copying): 516 vs 528 Until now only Inbox was effected and no other folders. I delete cachesfiles in ~mail/.imap to solve this but is there a way to do this automatical (self healing)? Dovecot could recreate complete caches if there was a difference in calculation. Thanks, Andre

2 6

[Dovecot] convert old configuration file with doveconf : Unknown setting
by de Lafond Guillaume 30 Apr '10

30 Apr '10

Hi, It happens when I try to convert this config (with the dovecot 2.0 beta4 release) : test-mail:/tmp# dovecot -n -c ./dovecot.old.conf # 1.2.11: ./dovecot.old.conf # OS: Linux 2.6.26-2-686-bigmem i686 Debian 5.0.4 log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot_info.log protocols: imap listen: 127.0.0.1:30143 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_user: aquaray login_greeting: Mail - test v2 login_process_per_connection: no login_process_size: 96 login_processes_count: 20 login_max_processes_count: 196 max_mail_processes: 10024 mail_max_userip_connections: 10000 verbose_proctitle: yes first_valid_uid: 89 mail_location: maildir:~/:INDEX=/var/mail/dovecot_indexes/%1d/%d/%n fsync_disable: yes maildir_very_dirty_syncs: yes mbox_write_locks: fcntl dotlock mail_drop_priv_before_exec: yes mail_plugins: quota imap_quota imap_client_workarounds: outlook-idle delay-newmail namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: INBOX/ hidden: yes list: no subscriptions: yes lda: postmaster_address: postmaster(a)test-dovecotv2.aquaray.com hostname: test-dovecotv2.aquaray.com log_path: /var/log/dovecot-deliver.log info_log_path: /var/log/dovecot-deliver.log auth_socket_path: /var/run/dovecot-socket-auth/auth-master auth default-auth-master: mechanisms: plain login apop cram-md5 master_user_separator: * passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen master: path: /var/run/dovecot-socket-auth/auth-master mode: 384 user: aquaray auth default: mechanisms: plain login apop cram-md5 cache_size: 2048 cache_ttl: 2000 master_user_separator: * count: 10 passdb: driver: sql args: /etc/dovecot/dovecot-sql-master.conf pass: yes master: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf plugin: quota: maildir:User quota test-mail:/tmp# /usr/local/dovecot2/bin/doveconf -n -c ./ dovecot.old.conf # 2.0.beta4 (6891d20929ca): ./dovecot.old.conf doveconf: Warning: Obsolete setting in ./dovecot.old.conf:26: login_dir has been removed doveconf: Warning: Obsolete setting in ./dovecot.old.conf:29: login_chroot has been replaced by service { chroot } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 29: Unknown setting: chroot doveconf: Warning: Obsolete setting in ./dovecot.old.conf:32: login_user has been replaced by service { user } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 32: Unknown setting: user doveconf: Warning: Obsolete setting in ./dovecot.old.conf:36: login_process_size has been replaced by service { vsz_limit } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 36: Unknown setting: vsz_limit doveconf: Warning: Obsolete setting in ./dovecot.old.conf:39: login_process_per_connection has been replaced by service { service_count } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 39: Unknown setting: service_count doveconf: Warning: Obsolete setting in ./dovecot.old.conf:42: login_processes_count has been replaced by service { process_min_avail } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 42: Unknown setting: process_min_avail doveconf: Warning: Obsolete setting in ./dovecot.old.conf:45: login_max_processes_count has been replaced by service { process_limit } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 45: Unknown setting: process_limit doveconf: Warning: Obsolete setting in ./dovecot.old.conf:48: login_max_connections has been replaced by service { client_limit } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 48: Unknown setting: client_limit doveconf: Warning: Obsolete setting in ./dovecot.old.conf:75: mail_drop_priv_before_exec has been replaced by service { drop_priv_before_exec } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 75: Unknown setting: drop_priv_before_exec doveconf: Warning: Obsolete setting in ./dovecot.old.conf:88: max_mail_processes has been replaced by service { process_limit } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 88: Unknown setting: process_limit doveconf: Warning: Obsolete setting in ./dovecot.old.conf:91: mail_process_size has been replaced by service { vsz_limit } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 91: Unknown setting: vsz_limit It does not understand the old 1.1 setting "ssl_disable". test-mail:/tmp# /usr/local/dovecot2/bin/doveconf -n -c ./ dovecot.old.conf # 2.0.beta4 (6891d20929ca): ./dovecot.old.conf doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 21: Unknown setting: ssl_disable ----------------------------------------------------------- After removing all fatal error (comment all settings that are not understood), it works. If needed, I could test against the another other version (latest hg ?). Regards, -- Guillaume de Lafond Aqua Ray SARL

2 3

[Dovecot] Quota maildirsize and dbox
by luben karavelov 30 Apr '10

30 Apr '10

Hello, Is there any reason that maildirsize Quota store should not work in dbox folders or any other folder based mailbox stores? I have patched a test version here and it seems to work (added "dbox" check in src/plugins/quota/quota-maildir.c line 785). If there could be any complications or unexpected consequences of this setup? Thanks in advance luben

3 2

[Dovecot] Expire plugin / expire-tool redesign for doveadm
by Timo Sirainen 30 Apr '10

30 Apr '10

Expire plugin / expire-tool seems annoyingly inflexible currently, so I was thinking about a more generic redesign: The expire plugin keeps track of the oldest message in configured mailboxes. Its only configuration is the list of tracked mailboxes. There's no configuration like what the expire timeouts are or anything. There will be a new doveadm command: doveadm expunge [-u user | -A] <mailbox> <search query> So when you want to expunge all mails from Trash older than 1 week for all users, you say: doveadm expunge -A Trash savedbefore 1w This command works even without expire plugin. To optimize it to avoid looking into all users' Trash mailbox, there's a new expire doveadm plugin, which can use the expire dict to filter out users who don't have anything to expunge. This also supports another feature that the plugin can optimize: doveadm move -A INBOX Archive/2009/INBOX since 2009-01-01 before 2010-01-01 And since people have had problems waiting for expire dict to fill, there could be also a new parameter that does the filling immediately. TODO: - dbox altmove feature will be removed from expire plugin. it may need another plugin, or some other way to configure expire plugin for it. it's anyway a special case. - When using multiple mailboxes it would be more optimal to handle all mailboxes for a user at once, rather than using separate doveadm commands. Maybe the command syntax needs some more thinking to support this. Different mailboxes could have different rules though..

3 6

[Dovecot] Released Pigeonhole Sieve v0.1.16 for Dovecot v1.2.11
by Stephan Bosch 30 Apr '10

30 Apr '10

Hello Dovecot users, Pigeonhole development has slowed down significantly in the last few months due to the fact that I got swamped in work. The plan is now to move active development of Pigeonhole to Dovecot v2.0, meaning that this will be the last release for v1.2 that contains significant development changes and new features. However, if a certain new feature is simple enough and there is a demand for it, I may backport it from v2.0 and release it along with any bugfixes that may still arise. The main thing that this new release adds is full support for the spamtest, spamtestplus and virustest extensions. These extensions implement a uniform means of testing the content spam/virus status headers in mail messages: http://ietfreport.isoc.org/idref/rfc5235/ Not many people have tested these new features yet and therefore these are currently considered experimental. Test these thoroughly before you start using them! Documentation is available in doc/spamtest-virustest.txt Changelog Sieve v0.1.16: * Finished implementation of spamtest, spamtestplus and virustest extensions. These are not enabled by default and need to be activated with the sieve_extensions setting. Documentation available in doc/spamtest-virustest.txt + Vacation extension: the from address of the generated reply is now by default equal to whatever known recipient alias matched the headers of the message. If it is one of the aliases specified with :addresses, it is used in stead of the envelope recipient address that was used before. + Restructured and optimized the lexical scanner. + Added --with-docs configure option to allow disabling installation of documentation. - Accidentally omitted 'extern' in two declarations of global variables in header files, causing compile failures on certain systems. - Deprecated imapflags extension: fixed implicit assignment of flags. Turns out this never really worked, but the effect of this bug was obscured by the removeflag bug fixed in the previous release. - Fixed various memset argument mixups in enotify extension. This caused warnings on certain systems, but luckily no adverse effects at runtime. The releases are available as follows: Sieve: http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-sieve-0.1.16.tar.gz http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-sieve-0.1.16.tar.gz.sig Refer to http://pigeonhole.dovecot.org for more information. Have fun testing the new releases and don't hesitate to notify me when there are problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

3 6

[Dovecot] Again: Occasional problem with POP3-Download
by Andre Tann 30 Apr '10

30 Apr '10

Hello everyone, in february I posted the mail below[1]. I can now reproduce the problem. When filling up a mailbox with postfix' smtp-source with dozens of identical mails, then it is never possible for me to fetch one single mail out of the mailbox. The process of fetching mail via POP3 always fails. It makes no difference which mail client I use. I have tested KMail, Outlook and Thunderbird. Can anyone confirm this? Is dovecot for some reason unable to deliver such identical mails? Can it be the case that this is a problem with too similar message ids? ~/Maildir/cur$ cat * | grep -i message-id Message-Id: <1024.0003.0008@alphamobil> Message-Id: <1024.0003.0009@alphamobil> Message-Id: <1024.0003.0006@alphamobil> Message-Id: <1024.0003.0007@alphamobil> Message-Id: <1024.0003.0005@alphamobil> Message-Id: <1024.0003.0004@alphamobil> Message-Id: <1024.0003.0003@alphamobil> Message-Id: <1024.0003.0002@alphamobil> Message-Id: <1024.0003.0001@alphamobil> Message-Id: <1024.0003.0000@alphamobil> Thanks and greetings from Munich! AT [1] Hello everyone, I have two mailservers [1] running dovecot. Mail store format is maildir. Every once in a while I have the following problem: When a User downloads his mail via POP3, the client says something like "the server has closed the connection unexpectedly, and gives this reason: [...blahblah...]". One can now cancel the download, and restart it, and the problem shows up again and again. The first few mails get downloaded, and then the process stops. Strange to say the "blahblah"-portion is a piece of text out of the email that doesn't want to get downloaded. Then I remove this single message out of the Maildir/cur-directory, and everything is fine again. It is easy to figure out which mail to delete because it's the first one that is not market as seen [...] filename...:2,S otherfilename...;2, <= this file must be deleted [...] For me it looks as if dovecot had a problem with some byte sequence in this mail, and for some reason it gives an error message to the client which is taken out of the mail. On the SuSE-Machine, before dovecot there was a courier-imapd running, which never showed this kind of problem, so it should not be a client problem. Hopefully my description is clear enough. Does anyone have an idea what's going on here? Thanks. Andre [1] One machine is a openSuSE 11.2 with # rpm -qa | grep dovecot dovecot12-backend-sqlite-1.2.9-0.1.1.i586 dovecot12-backend-mysql-1.2.9-0.1.1.i586 dovecot12-backend-pgsql-1.2.9-0.1.1.i586 dovecot12-1.2.9-0.1.1.i586 The other machine is a Debian Lenny with # dpkg -l | grep dovecot dovecot-common 1:1.0.15-2.3+lenny1 dovecot-imapd 1:1.0.15-2.3+lenny1 dovecot-pop3d 1:1.0.15-2.3+lenny1 -- Andre Tann

3 3

[Dovecot] Right way to Dovecot Load Balance
by Proskurin Kirill 30 Apr '10

30 Apr '10

Hello. I building LB&HA Email cluster based on Exim+Dovecot+LDAP. Now I thinking what the most right way to LB Dovecot(2 nodes with shared storage). HA-Proxy? Dovecot Proxy? Nginx? Else? -- Best regards, Proskurin Kirill

2 1

[Dovecot] Question about auth multiple configuration
by Fabrice MATHIEU 30 Apr '10

30 Apr '10

Hello, My mail system is build with postfix, dovecot and roundcube. In first time users can view and "manage" their mail only on the webmail. So this one (webmail) use IMAP (no tls/ssl at all) authentication to give access to users maildir. This connection is made on the 'loopback' interface and use PLAIN method. This works fine (configuration below without ssl parameters). Now I want to see and send my mail with a MUA (thunderbird). As my system is on an Internet provider I want to add more security "solutions". I use smtps with postfix and SASL/auth by dovecot socket mechanism to send mail. I use imaps with dovecot for managing my maildir. I have added ssl parameters to the configuration file (see below) and I required certificate from the client (to avoid man in the middle attack and to get access only for client with user certificate). To get this "ssl_require_client_cert" is set to yes. Ok, now imaps works perfectly. But since a certificate is required webmail authentication (localhost) and SASL (postfix auth trough dovecot socket mechanism) don't work. Webmail => dovecot: imap-login: Disconnected (cert required, client didn't start TLS): method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Postfix => postfix/smtpd[71640]: warning: TOTO[X.A.B.C]: SASL PLAIN authentication failed: Client didn't present valid SSL certificate That's normal. But 127.0.0.1 client(network) is considered by dovecot as secure, so won't the auth possible without certificate ? Can't we make two auth policy to make secure (client crt require) for public IP/client and less "secure" (without crt client) for local process (postfix) and local newtwork(127.0.0.1) for roundcube ? I see section "auth default { ... }" and is used by ... default ! But can we make an other one to make this two particular authentication on the same "instance" ? Thank you. And then my configuration : operating system => FreeBSD 7.1 dovecot --version => 1.2.8 dovecot -n => # 1.2.8: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.1-RELEASE i386 ufs protocols: imap listen: 127.0.0.1 ssl_listen: X.Y.Z.T ssl: yes ssl_ca_file: /usr/local/etc/dovecot/CAclient.pem ssl_cert_file: /usr/local/etc/dovecot/imaps.pem ssl_key_file: /usr/local/etc/dovecot/imaps.key ssl_verify_client_cert: yes login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_privileged_group: mail mail_location: maildir:/jails/mails/%d/%n imap_client_workarounds: delay-newmail netscape-eoh tb-extra-mailbox-sep lda: postmaster_address: postmaster@SOMETHING hostname: SOMETHING_ELSE sendmail_path: /usr/sbin/sendmail auth default: mechanisms: plain login username_format: %Lu passdb: driver: passwd-file args: username_format=%n /jails/mails/dov_pass/%d/usr_pas userdb: driver: passwd-file args: username_format=%n /jails/mails/dov_pass/%d/usr_pas ssl_require_client_cert = yes ssl_username_from_cert = no socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: wheel master: path: /var/run/dovecot/auth-master mode: 384 Best regards, _________________________________________________________________ Consultez gratuitement vos emails Orange, Gmail, Free, ... directement dans HOTMAIL ! http://www.windowslive.fr/hotmail/agregation/

3 8

[Dovecot] Question about dovecot imap proxy
by Monika Janek 29 Apr '10

29 Apr '10

Hi everyone! I have dovecot (1.2.11) on one our external mail servers acting as a proxy. The client (ifor now, my iphone) connects fine via ssl to the external mailserver but I can't seem to get a secure connection now to the internal destination imap server (between external mail server and internal imap server, it's going through port 143). Running tcpdump, I can clearly see my password being transmitted on our internal network. I read the addition to the documentation about dovecot proxy but I'm not sure where to add these variables: In v1.2.rc4+ the connections to destination server can be TLS/SSL encrypted by returning: * ssl=yes: Use SSL and require a valid verified remote certificate. *WARNING: Unless used carefully, this is an insecure setting!* Currently host must be an IP address, so this setting accepts any certificate signed by a trusted CA. The host name isn't checked in any way against the certificate's CN. The only way to use this securely is to only use and allow your own private CA's certs, anything else is exploitable by a man-in-the-middle attack. * ssl=any-cert: Use SSL, but don't require a valid remote certificate. * starttls: Use STARTTLS command instead of doing SSL handshake immediately after connected. Can anyone point me in the right direction? Thanks so much! :) -- Monika Janek Systems Administrator, Side Effects Software Toronto, Ontario Canada 416-504-9876 x207 www.sidefx.com

2 8

[Dovecot] Assertion failed in mail-search-build.c
by Mark Moseley 29 Apr '10

29 Apr '10

With Friday's and today's mercurial repo, I'm getting this: Apr 26 12:55:31 master: Info: Dovecot v2.0.beta4 starting up (core dumps disabled) Apr 26 12:58:34 imap-login: Info: Login: user=<mail@box>, method=PLAIN, rip=10.1.1.206, lip=192.168.152.1 Apr 26 12:58:34 imap(mail@box): Panic: file mail-search-build.c: line 59 (mail_search_build_key_int): assertion failed: (sarg->value.subargs != NULL) Apr 26 12:58:34 imap(mail@box): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0xb76a3ad1] -> /usr/lib/dovecot/libdovecot.so.0 [0xb76a3b4f] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0xb76a3e08] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0xb76f859e] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0xb76f860f] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_search_build+0x82) [0xb76f86f2] -> dovecot/imap [mail@box 10.1.1.206 SEARCH](imap_search_args_build+0x48) [0x805d8a8] -> dovecot/imap [mail@box 10.1.1.206 SEARCH](cmd_search+0xbb) [0x805342b] -> dovecot/imap [mail@box 10.1.1.206 SEARCH] [0x80564dc] -> dovecot/imap [mail@box 10.1.1.206 SEARCH] [0x8056579] -> dovecot/imap [mail@box 10.1.1.206 SEARCH](client_handle_input+0x2d) [0x80566ed] -> dovecot/imap [mail@box 10.1.1.206 SEARCH](client_input+0x5f) [0x805710f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xf5) [0xb76b0115] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x30) [0xb76af160] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x2a) [0xb769ca5a] -> dovecot/imap [mail@box 10.1.1.206 SEARCH](main+0x2b5) [0x805fb95] -> /lib/libc.so.6(__libc_start_main+0xe5) [0xb752e455] -> dovecot/imap [mail@box 10.1.1.206 SEARCH] [0x804e951] Apr 26 12:58:34 master: Error: service(imap): child 13220 killed with signal 6 (core dumps disabled) Login is working fine, just blowing up on that assert by doing a search. The search is pretty basic, in python: server.search( None, "(ALL)" ) Testing with a previous version (from a couple of days earlier -- I don't have the intervening), I don't hit that assertion. The last changeset on mail-search-build.c in the working copy is 11146:3649ad8c9f9a. Let me know if there's anything you'd like me to try.

2 1

[Dovecot] pop3-login: auth failure -- due to number as first character in login name
by dovecot mail list account 29 Apr '10

29 Apr '10

Seem to have found a error in version 1.2.6 regarding usernames having a number as the first character. Customers with a number as the first character in thier user name can not login via pop3 clients. However they can login through our webmail interface. If we remove the number from the username then the customer can login. # 1.2.6: /etc/dovecot.conf # OS: Linux 2.6.31.12-desktop-3mnb x86_64 Mandriva Linux 2010.0 protocols: pop3 ssl_listen: * ssl_cert_file: /etc/pki/tls/certs/dovecot.pem ssl_key_file: /etc/pki/tls/private/dovecot.pem disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib64/dovecot/pop3-login mail_privileged_group: mail mail_location: mbox:~/mail:INBOX=/home/mail/%u mail_executable: /usr/lib64/dovecot/pop3 mail_plugin_dir: /usr/lib64/dovecot/modules/pop3 pop3_uidl_format: %08Xv%08Xu lda: postmaster_address: postmaster(a)example.com auth default: mechanisms: plain login verbose: yes passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix plugin: quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 quota_warning2: storage=80%% /usr/local/bin/quota-warning.sh 80

2 1

[Dovecot] Problems with Mailbox is in inconsistent state, please relogin.
by Daniel Machado Grilo 29 Apr '10

29 Apr '10

Dear Dovecot users, I'm a sysadmin in a company that recently migrated the IMAP from courier-imap to dovecot :-) *urray* Everything with the perl migrating scripts (version 1.0) went with OKs and it was a lot of fun (and pray) to move 400Gb of mails and migrate.. and everything is working even better :-) The problem is for some outside users that use webmails, like: - Squirrel - Roundcube - Horde They claim that the connection is constantly dropping.. You might say now: "Webmail's fault!!!" as I said in the beginning :) But the IMAP logs shows SEVERAL times (almost every 10mins ?!): Apr 28 21:10:48 olive dovecot: IMAP(rcoelho): Maildir /cluster/mail/mailboxes/rcoelho sync: UID inserted in the middle of mailbox (192736 > 192720, file = msg.LDW0C) Apr 28 21:10:48 olive dovecot: IMAP(rcoelho): Disconnected: Mailbox is in inconsistent state, please relogin. Apr 28 19:14:11 olive dovecot: IMAP(pcorreia): Maildir /cluster/mail/mailboxes/pcorreia sync: UID < next_uid (7874 < 7875, file = msg.5BNVC) Apr 28 19:14:12 olive dovecot: IMAP(pcorreia): Disconnected: Mailbox is in inconsistent state, please relogin. and so on. I read somewhere on the web that configuring the mbox_lazy_write=no should work .. it did not :-) I have CentOS 5.4 in our mailserver, so the version of dovecot is not the latest (it is 1.0.7).. But of course, this is production environment and I don't want to update if its not needed :-) So my questions are: - Is this a known bug for this version and I have to upgrade ? - Is this a problem in my configs for dovecot ? - Can this be other problem than dovecot ? -- so probably i should be able to add more debug anoying messages to our logs ? - Probably something went wrong in the migration for these maildirs? So now what can we do to fix this ? Our mail is working and, at the moment, I found 3 users with this error.. They have about 10Gb of mail each, I don't think this is a problem for dovecot.. only for our storages.. :-) Tks for your patience, Best Regards!

4 3

[Dovecot] Maildircrypt
by brainstorm 29 Apr '10

29 Apr '10

Hi guys, I was just wondering if this idea makes sense overall or if there are major impediments (indexing performance ?): http://blogs.nopcode.org/brainstorm/2010/04/28/maildircrypt/ Thanks ! Roman

2 1

[Dovecot] Dovecot headers at start of text returned to KMail
by Barry Scott 29 Apr '10

29 Apr '10

The attachment show Kmail (kdepim-4.4.2-1.fc12.x86_64) accessing an email from dovecot over imap. From the wireshark-imap-trace.txt you can see at line 77 that the headers do not end cleanly "X-)". And at line 84 there is text from the headers that is not part of the body "-Spambayes-Trained: ham". The email being access by dovecot is in: 1272011889.M384349P30156.f12barry.office.onelan.co.uk,S=6494,W=6606:2,S Because of this bug kmail fails to show the message cleanly on screen. # 1.2.11: /etc/dovecot.conf # OS: Linux 2.6.32.11-99.fc12.x86_64 x86_64 Fedora release 12 (Constantine) login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd Barry

2 4

[Dovecot] How can I add change_password
by Yavuz Maşlak 29 Apr '10

29 Apr '10

Hello I use dovecot, postfix, mysql and squirrelmail as a mail server. it works well. Meanwhile I am novice at postfix. As you know, there is a change_password plugin on squirrelmail. I wish to add change_password plugin on squirrelmail. I couldn't find how to integrate postfix and change_password. How can I add it ?

2 1

[Dovecot] How can I integrate change_password plugin, dovecot and postfix
by Yavuz Maşlak 29 Apr '10

29 Apr '10

Hello I use dovecot, postfix, mysql and squirrelmail as a mail server. it works well. Meanwhile I am novice at postfix. As you know, there is a change_password plugin on squirrelmail. I wish to add change_password plugin on squirrelmail. I couldn't find how to integrate postfix and change_password. How can I add it ?

3 3

Re: [Dovecot] returned error 83 (Out of memory)
by J Contad 28 Apr '10

28 Apr '10

FYI, sorted out this issue by taking out a specific email manually. Not sure if it helps, but the email had these attributes: - X-Mailer is PHPMailer [version 1.73] - References: header is quite large, and contains email addresses external to the sender and I's conversation. Removing the email fixed the issue. -- John

3 3

Re: [Dovecot] returned error 83 (Out of memory)
by J Contad 28 Apr '10

28 Apr '10

I tried deleting the file, but got pretty much the same issues. Any other hints on how else to go about it? Cheers! John On Thu, 22 Apr 2010, J Contad wrote: > The folder (which is shared) has about 8 thousand emails in it. I'm not sure > if it's pertinent, but the dovecot.index.cache file is about 8MB. Did you tried to delete the dovecot.index.cache file, maybe it has been corrupted? Regards, - -- Steffen Kaiser -- John

1 0

[Dovecot] somebody using Net::Sieve (Perl) with dovecot 1.2.11?
by Heiko Schlittermann 28 Apr '10

28 Apr '10

Hello, I've just (hopefully) fixed some issue with Net::Sieve (0.05) to cooperate with a current (1.2.11) dovecot managesieve server and STARTTLS. Does somebody use this Perl library? If yes, did it work for you (STARTTLS triggers the problem)? If not, which other (Perl) library do you use? Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann HS12-RIPE ----------------------------------------- gnupg encrypted messages are welcome - key ID: 48D0359B --------------- gnupg fingerprint: 3061 CFBF 2D88 F034 E8D2 7E92 EE4E AC98 48D0 359B -

2 1

[Dovecot] zlib plugin dovecot 2.0 - write email
by Alex Baule 26 Apr '10

26 Apr '10

Hello Everyone. There is possible to rename the email writed by a plugin, like zlib ? i explain.... i need to add 1 line in email header, because of that, i want to rewrite the filename to update the S and W flag. Tks !

1 0

[Dovecot] Anyone successfully using expire plugin?
by Thomas M Goerger 23 Apr '10

23 Apr '10

Anyone out there using expire? At this point, I'm not sure that it's even running. It was touching the plugin libraries yesterday, but doesn't appear to be doing so today. The plugin directory wasn't explictly set, so I've done so now, but it's still not touching these. Anyone have a cf file I could take a look at, or any ideas as to what might be happening? Thanks! ************************************************************************* * Tom Goerger - Email/Unix System Administrator * * * * University of Minnesota Email: tmg(a)umn.edu * * Operations, Infrastructure and Architecture Phone: 4-5804 * * Internet Services Office: 626J WBOB * * * *************************************************************************

2 1

[Dovecot] How can I make dovecot aware of user's email aliases?
by Ian P. Christian 23 Apr '10

23 Apr '10

Sieve will not reply to mail it doesn't think was sent directly to a user. I use an SQL auth backend, and a user might login as user1(a)domain.com. What method can I use to inform dovecot that user2(a)domain.com is a forward to user1(a)domain.com, such that the vacation auto response will fire when user2(a)domain.com is emailed (therefore, the mail ends up in user1(a)domain.com's mailbox). -- Blog: http://pookey.co.uk/blog Follow me on twitter: http://twitter.com/ipchristian

1 0

[Dovecot] best choice of user database file to work with postfix?
by Phil Howard 23 Apr '10

23 Apr '10

I'm setting up a Postfix and Dovecot combination. What I want to do is have a user database that (1) is not running from some engine (so not LDAP or SQL or such) ... and (2) is completely disassociated from system users (e.g. most email users are not in /etc/passwd and most /etc/passwd users are not email users). Ideal would be a one-file solution, which can be managed by text editing or simple command line tools. But what I want is ONE file that both Postfix (for valid recipients) and Dovecot (for user login authentication) can use together. An alternative is some way to get Postfix to go through Dovecot to query for users (at the time of mail arriving on SMTP so it doesn't queue anything that would later be rejected). This is a smallish setup on one server, with probably a max of 50 to 100 users and 50 or so role account mailboxes over the next year or two. Any recommendations?

18 50

[Dovecot] have I been added to the mailing list
by ttplayer 23 Apr '10

23 Apr '10

Hi, have I been added to the mailing list? Thank you.

1 0

[Dovecot] Quota monitoring
by Vlamsdoem 23 Apr '10

23 Apr '10

Hello, I would like to monitor users quotas in Dovecot but I don't find a way to do it for every user. Acutally I can log in with user & password to get the users quota but wat I need is a way to monitor the quota of every user with e.g an admin user which would have an acces to the quota of each mailbox. Is there a way to this? Thanks for your help.

6 11

[Dovecot] message to imap users when connecting ?
by Frank Bonnet 22 Apr '10

22 Apr '10

Hello Is it possible that a IMAP client (thunderbirs in my case) popup a message box containing a short message when a user connect to the server ? Is there such feature in Dovecot ? Thanks

3 2

[Dovecot] imap-zlib patch to fix runaway imap process
by Mike Abbott 22 Apr '10

22 Apr '10

Here is a patch to fix the problem where an imap process runs away when imap-zlib is in use. The backtrace showed: io_loop_handler_run -> stream_send_io -> client_output -> o_stream_flush -> o_stream_zlib_flush -> o_stream_zlib_send_flush When o_stream_zlib_flush returns 0, stream_send_io reinstates the IO_WRITE event, causing the infinite loop. diff -ur dovecot-2.0.beta4/src/plugins/zlib/ostream-bzlib.c dovecot-2.0.beta4+fix/src/plugins/zlib/ostream-bzlib.c --- dovecot-2.0.beta4/src/plugins/zlib/ostream-bzlib.c 2010-02-12 20:22:07.000000000 -0600 +++ dovecot-2.0.beta4+fix/src/plugins/zlib/ostream-bzlib.c 2010-04-20 19:15:29.000000000 -0500 @@ -122,15 +122,15 @@ static int o_stream_bzlib_flush(struct ostream_private *stream) { struct bzlib_ostream *zstream = (struct bzlib_ostream *)stream; + int ret; if (o_stream_bzlib_send_flush(zstream) < 0) return -1; - if (o_stream_flush(zstream->output) < 0) { + ret = o_stream_flush(zstream->output); + if (ret < 0) zstream_copy_error(zstream); - return -1; - } - return 0; + return ret; } static ssize_t diff -ur dovecot-2.0.beta4/src/plugins/zlib/ostream-zlib.c dovecot-2.0.beta4+fix/src/plugins/zlib/ostream-zlib.c --- dovecot-2.0.beta4/src/plugins/zlib/ostream-zlib.c 2010-02-18 22:01:56.000000000 -0600 +++ dovecot-2.0.beta4+fix/src/plugins/zlib/ostream-zlib.c 2010-04-20 19:15:29.000000000 -0500 @@ -184,15 +184,15 @@ static int o_stream_zlib_flush(struct ostream_private *stream) { struct zlib_ostream *zstream = (struct zlib_ostream *)stream; + int ret; if (o_stream_zlib_send_flush(zstream) < 0) return -1; - if (o_stream_flush(zstream->output) < 0) { + ret = o_stream_flush(zstream->output); + if (ret < 0) zstream_copy_error(zstream); - return -1; - } - return 0; + return ret; } static ssize_t

2 1

[Dovecot] Quota Issue
by Peter Fraser 21 Apr '10

21 Apr '10

Hi All I'm using dovecot version 1.2.4_1 and I noticed something strange. I checked the list but so far I haven't found anything that exactly fits my setup. I'm using maildirs and ldap as a backend to authenticate. A user went over quota, realized it and proceeded to delete a lot of email. Even now, after about 15 minutes, the quota indicator is still showing that he is over quota even though the users mailbox size is down by over 200MB. Why isn't Dovecot showing the change, and is there a way around this? Thanks for any help.

2 3

[Dovecot] corrupted index cache file, physcial size, in migration to snow leopard
by Norman Packard 21 Apr '10

21 Apr '10

Hi, I am in the middle of migrating a server from Apple's leopard to snow leopard. Having big problems with migrating mail to dovecot. The version is: # dovecotd --version 1.1.17apple0.5 and I use the migration script provide by Apple, /usr/libexec/dovecot/migrate_mail_data.pl The current problems concern migrating imap accounts. The old data typically shows up to mail clients as only partially migrated, with some issues there, like folders change from being listed on the server to being listed locally, but the biggest problem is that many many messages and folders have disappeared from view. But on the server, they seem to be there, in their correctly migrated place. The log files are full of messages like the ones below, which I'm guessing has something to do with the problem. The number of files with this problem is huge. Are there any scripts to rebuild the index cache files with correct physical sizes? Thanks in advance for any help! Best, Norman Apr 21 08:05:47 newhot dovecot[31163]: IMAP(*): Corrupted index cache file /Volumes/xserveHD2/var/spool/imap/dovecot/mail/A1F36563-F978-4F99- A1FF-EC5D223F18D6/dovecot.index.cache: Corrupted physical size for uid=8142: 4325 != 4214 Apr 21 08:05:50 newhot dovecot[31163]: IMAP(*): Corrupted index cache file /Volumes/xserveHD2/var/spool/imap/dovecot/mail/A1F36563-F978-4F99- A1FF-EC5D223F18D6/dovecot.index.cache: Corrupted physical size for uid=8145: 4625 != 4510 Apr 21 08:05:53 newhot dovecot[31163]: IMAP(*): Corrupted index cache file /Volumes/xserveHD2/var/spool/imap/dovecot/mail/A1F36563-F978-4F99- A1FF-EC5D223F18D6/dovecot.index.cache: Corrupted physical size for uid=8148: 4037 != 3956 Apr 21 08:06:04 newhot dovecot[31163]: IMAP(*): Corrupted index cache file /Volumes/xserveHD2/var/spool/imap/dovecot/mail/A1F36563-F978-4F99- A1FF-EC5D223F18D6/dovecot.index.cache: Corrupted physical size for uid=8158: 4673 != 4571

1 0

[Dovecot] Question about listescape plugin
by Luca Di Vizio 21 Apr '10

21 Apr '10

Hi all, with the listescape plugin enabled we a stange result. ** listescape enabled ** 2 list "" % * LIST (\HasChildren) "/" "INBOX" * LIST (\HasChildren) "/" "INBOX/" ** listescape disabled ** 2 list "" % * LIST (\HasChildren) "/" "INBOX" The prefix for this namespace is "INBOX/". Is correct to have "INBOX/" as result of LIST? Info about the system: - Centos 5.3/x86_64. - Dovecot 1.2.11 (I tried also with 2.0.beta4, same results). mail_nfs_storage: yes mail_nfs_index: yes mail_plugins(imap): listescape quota imap_quota namespace: type: private separator: / inbox: yes list: yes subscriptions: yes plugin: quota: maildir Thanks, Luca

1 0

[Dovecot] POP3: Restrict Connections per timeframe
by Michael Kliewe 21 Apr '10

21 Apr '10

Hi everybody, is it possible to limit the amount of POP3 connections/logins per 15 minutes? Many hoster do that, but I cannot find a configuration setting for that. I can only limit the amount of concurrent connections per IP, but not connections per time. Michael

1 0

[Dovecot] dovecot2 beta and gcc3(?) - compile problem
by Andre Hübner 21 Apr '10

21 Apr '10

Hello, try to compile current dovecot2 beta on older machine with gcc 3.3 Compiling results in error: libtool: link: gcc -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -o .libs/imap-login client.o client-authenticate.o imap-login-settings.o imap-proxy.o ../../src/login-common/.libs/libdovecot-login.so ../../src/lib-dovecot/.libs/libdovecot.so -lrt -Wl,-rpath -Wl,/usr/lib/dovecot ../../src/login-common/.libs/libdovecot-login.so: undefined reference to `ERR_peek_last_error' collect2: ld returned 1 exit status make[3]: *** [imap-login] Error 1 make[3]: Leaving directory `/usr/src/dovecot-1.1.rc12/dovecot-2.0.beta4/src/imap-login' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/usr/src/dovecot-1.1.rc12/dovecot-2.0.beta4/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/usr/src/dovecot-1.1.rc12/dovecot-2.0.beta4' make: *** [all] Error 2 Is there something missed on my side or problem with older gcc? dovecot 1.2.11 compiles just fine with same configure-line also there are some warnings like this: libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../../.. -I../../../../src/lib -I../../../../src/lib-settings -I../../../../src/lib-mail -I../../../../src/lib-imap -I../../../../src/lib-index -I../../../../src/lib-storage -I../../../../src/lib-storage/index -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -MT dbox-sync-rebuild.lo -MD -MP -MF .deps/dbox-sync-rebuild.Tpo -c dbox-sync-rebuild.c -fPIC -DPIC -o .libs/dbox-sync-rebuild.o In file included from dbox-sync-rebuild.c:5: ../../../../src/lib-index/mail-index-modseq.h:34: warning: parameter has incomplete type ../../../../src/lib-index/mail-index-modseq.h:52: warning: parameter has incomplete type or libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../../.. -I../../../../src/lib -I../../../../src/lib-settings -I../../../../src/lib-mail -I../../../../src/lib-imap -I../../../../src/lib-index -I../../../../src/lib-storage -I../../../../src/lib-storage/index -I../../../../src/lib-storage/index/dbox-common -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -MT mdbox-file.lo -MD -MP -MF .deps/mdbox-file.Tpo -c mdbox-file.c -fPIC -DPIC -o .libs/mdbox-file.o In file included from mdbox-storage.h:5, from mdbox-file.c:16: ../../../../src/lib-storage/mailbox-list-private.h:158: warning: parameter has incomplete type Thanks, Andre

2 3

[Dovecot] Question about listescape
by Luca Di Vizio 21 Apr '10

21 Apr '10

Hi all, with the listescape plugin enabled we a stange result. ** listescape enabled ** 2 list "" % * LIST (\HasChildren) "/" "INBOX" * LIST (\HasChildren) "/" "INBOX/" ** listescape disabled ** 2 list "" % * LIST (\HasChildren) "/" "INBOX" The prefix for this namespace is "INBOX/". Is correct to have "INBOX/" as result of LIST? Info about the system: - Centos 5.3/x86_64. - Dovecot 1.2.11 (I tried also with 2.0.beta4, same results). mail_nfs_storage: yes mail_nfs_index: yes mail_plugins(imap): listescape quota imap_quota namespace: type: private separator: / inbox: yes list: yes subscriptions: yes plugin: quota: maildir Thanks, Luca

1 0

[Dovecot] Checkpassword/prefetch/master_user and problems
by Emerson Pinter 20 Apr '10

20 Apr '10

Hi. I'm trying to use checkpassword for simple auth and masteruser auth. I have two programs, one called checkpassword-master (for masteruser lookup) and another called checkpassword for normal passdb and userdb lookup). All works fine for non-masteruser authentication (in this case dovecot makes a single call to checkpassword binary). But if a master-user authenticates, dovecot execute checkpassword-master binary, and then executes checkpassword binary. Checkpassword binary receive the MASTER_USER env and do all the checks correctly, when checkpassword finish, dovecot logs this message "auth(default): checkpassword: sighandler called for unknown child" and authentication fails... I'm trying checkpassword-reply and fd4 too, on 1.2.11 and 2.0b4, no success. Below is my config: auth default { mechanisms = plain passdb checkpassword { args = /srv/dovecot/checkpassword } passdb checkpassword { args = /srv/dovecot/checkpassword-master master=yes pass=yes } userdb prefetch { } } Anybody can help me ? Tks. -- Emerson Pinter Esta mensagem pode conter informações confidenciais, privilegiadas ou privadas. Caso não seja o destinatário, favor apagá-la e notificar o remetente. Saiba que o uso impróprio das informações existentes é estritamente proibido, sendo tratado conforme as normas da empresa e a legislação em vigor.

1 1

Re: [Dovecot] setgid failed - Not owner
by Zilon X 20 Apr '10

20 Apr '10

Changed home dir of users, in my configuration they are /var/postfix/spool and /var/postfix/dovecot/run, but with no effect. I still got the "fatal setgid failed: Not owner" ( Fatal: setgid(12345(postfix)) failed with euid=12346(dovecot), gid=54322(dovecot), egid=54322(dovecot): Not owner ) 2010/4/20 Andreas Schulze <andreas.schulze(a)datev.de>: > Am 19.04.2010 16:49 schrieb Zilon X: >> postfix:x:12345:12345::/dev/null:/bin/false >> dovecot:x:12346:54322::/dev/null:/bin/false > > I would never use /dev/null as homedir. > postfix home is /var/spool/postfix, dovecot likes /var/run/dovecot. > > -- > Andreas Schulze > Internetdienste | P532 > > DATEV eG > 90329 Nürnberg | Telefon +49 911 319-0 | Telefax +49 911 319-3196 > E-Mail info @datev.de | Internet www.datev.de > Sitz: 90429 Nürnberg, Paumgartnerstr. 6-14 | Registergericht Nürnberg, GenReg Nr.70 > Vorstand > Prof. Dieter Kempf (Vorsitzender) > Dipl.-Kfm. Wolfgang Stegmann (stellvertretender Vorsitzender) > Dipl.-Kfm. Michael Leistenschneider > Jörg Rabe v. Pappenheim > Dipl.-Vw. Eckhard Schwarzer > Vorsitzender des Aufsichtsrates: Reinhard Verholen > >

2 1

[Dovecot] zero sized messages in Maildir, corrupt filenames ?
by Rodolphe Buret 20 Apr '10

20 Apr '10

Hi, I'm starting to see more and more duplicates in my cur directory. they seem to be a copy of an incoming mail (messages share the same date) but they appears in the client as a message without subject and without sender or body. Their filename starts with an underscore and the 4th letter is a %. The rest of the filename is random (but it also includes my hostname). Which program could create such a filename ? If it's in the cur directory, it can only be dovecot, right ? Example of 2 probably related messages in the cur folder: 1785 Apr 20 09:18 msg.zMeU:2,d 0 Apr 20 09:18 _J9C%jVVzLB.{myhostname}:2, In addition, it seems that since we have started to use thunderbird 3, indexes are often corrupt, mailboxes needs reconstruction and so on. Could it be an incompatibility with my version of dovecot ? I've disabled my thunderbird filters that were moving the incoming mail automatically, no difference. I use no antivirus (linux imap client mainly). I can (probably) upgrade to dovecot-1.2.11-3_108 but I'd like to be sure that I won't create more problems before doing it. The homedirs are NFS mounted. dovecot 1.1.7-0_84 squirrelmail 1.4.19 postfix 2.6.5-1 Here is my dovecot -n # 1.1.7: /etc/dovecot.conf # OS: Linux 2.6.18-128.1.1.el5xen x86_64 Red Hat Enterprise Linux Server release 5.3 (Tikanga) log_path: /var/log/dovecot.log protocols: imap imaps listen: * login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: maildir:~/Maildir mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock auth default: passdb: driver: pam userdb: driver: passwd plugin: quota: Thanks for your time, -- Rodolphe Buret Ecole Polytechnique Fédérale de Lausanne System Administrator EPFL STI-IEL-ESL Tel: +41-21-693-0922 ELG 136 (bâtiment ELG) Fax: +41-21-693-0909 Station 11 Email: rodolphe.buret(a)epfl.ch CH-1015 Lausanne Switzerland

2 1

[Dovecot] Dovecot-sieve vacation proposal, use address in addresses as recipient
by David Berard 20 Apr '10

20 Apr '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi Dovecot list, In my setup I have several email addresses that uses same account. When I set a vacation the answer is not necessarily send from the destination address. I propose to use the addresses found in addresses (if one match) as From address in vacation reply. I've made a little patch who do that [1]. Best regards. [1] http://polymorf.fr/files/nfrance/cmd-vacation.patch - -- David BERARD - ------------------------------------------------- contact(at)davidberard.fr GPG|PGP KeyId 0xC8533354 GPG|PGP Key http://davidberard.fr/C8533354.gpgkey - ------------------------------------------------- * No electrons were harmed in * * the transmission of this email * -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAku+fUoACgkQOL7fhchTM1TJmACfdQcfgrSqNbjvWTEXrTc7Twly M70An2Nzb2MFby9ARHM1Ys93wGzuRYHy =yaLh -----END PGP SIGNATURE-----

4 4

[Dovecot] setgid failed - Not owner
by Zilon X 19 Apr '10

19 Apr '10

Hello ALL, I got errors on a new installation, maybe I forgot something. The system is Solaris, Dovecot 1.2.10, Postfix 2.7.0, MySQL 5.1.25. Can send mail with dovecot imap, but can`t retrieve the messages. Strange, I can save and retrieve draft messages ok, files are always with postfix:postfix ownership. Sorry if this is newbie question, but can`t find a solution. Syslog info: Apr 19 10:10:17 server postfix/qmgr[10654]: [ID 197553 mail.info] B66EF3FEE7: from=<user@domain>, size=547, nrcpt=1 (queue active) Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] auth(default): master in: USER 1 user@domain service=deliver Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] auth-worker(default): sql(user@domain): SELECT '/var/postfix/domains/domain/user' as home, 'maildir:/var/postfix/domains/domain/user' as mail, 12345 AS uid, 12345 AS gid, concat('dirsize:storage=', quota) AS quota FROM mailbox WHERE username = 'user@domain' AND active = '1' Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] auth(default): master out: USER 1 user@domain home=/var/postfix/domains/domain/user mail=maildir:/var/postfix/domains/domain/user uid=12345 gid=12345 quota=dirsize:storage=10240000 Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] deliver(user@domain): auth input: home=/var/postfix/domains/domain/user Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] deliver(user@domain): auth input: mail=maildir:/var/postfix/domains/domain/user Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] deliver(user@domain): auth input: uid=12345 Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] deliver(user@domain): auth input: gid=12345 Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] deliver(user@domain): auth input: quota=dirsize:storage=10240000 >> Apr 19 10:10:17 server dovecot: [ID 583609 mail.crit] deliver(user@domain): Fatal: setgid(12345(postfix)) failed with euid=12346(dovecot), gid=54322(dovecot), egid=54322(dovecot): Not owner Apr 19 10:10:17 server postfix/pipe[23327]: [ID 197553 mail.info] B66EF3FEE7: to=<user@domain>, relay=dovecot, delay=582, delays=582/0.18/0/0.11, dsn=4.3.0, status=deferred (temporary failure) _____________________________________________________ Configuration at dovecot.conf: login_dir = /var/postfix/dovecot/run/login login_chroot = yes login_user = dovecot mail_privileged_group = postfix mail_full_filesystem_access = yes passdb sql { args = /var/postfix/dovecot/etc/dovecot-sql.conf } userdb sql { args = /var/postfix/dovecot/etc/dovecot-sql.conf } user = nobody socket listen { master { path = /var/postfix/dovecot/run/auth-master mode = 0660 user = postfix group = postfix } client { path = /var/postfix/spool/private/auth mode = 0660 user = postfix group = postfix } } _____________________________________________________ Configuration at main.cf: mail_owner = postfix default_privs = nobody virtual_transport = dovecot dovecot_destination_recipient_limit = 1 smtpd_sasl_type = dovecot _____________________________________________________ Configuration at master.cf: dovecot unix - n n - - pipe flags=DRhu user=dovecot:dovecot argv=/var/postfix/dovecot/libexec/dovecot/deliver -d $(recipient) _____________________________________________________ Entries at passwd: postfix:x:12345:12345::/dev/null:/bin/false dovecot:x:12346:54322::/dev/null:/bin/false Entries at group: postfix::12345: postdrop::54321: dovecot::54322: _____________________________________________________ Thank you for any help!

1 0

[Dovecot] permission denied, no logs
by Shane Brooks 19 Apr '10

19 Apr '10

Hi, We have a sendmail/dovecot/squirrelmail installation that was working ok except for deleted files showing in the list with a [d] beside it. In trying to fix that issue, I apparently made a new error appear in the left navigation area: ERROR: Could not complete request. Query: CREATE "mail/Sent" Reason Given: [NOPERM] Permission denied There are no errors in dovecot, but from what i've read squirrelmail passes these folder requests to the imap server for processing. Can anyone help me verify what my permissions should be? Here is my config: # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.24-19-xen x86_64 CentOS release 5.3 (Final) log_path: /var/log/dovecot/runtime.log protocols: imap imaps pop3 pop3s disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_privileged_group: mail mail_uid: mail mail_gid: mail mail_location: mbox:~:INBOX=/var/mail/%u mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 lda: postmaster_address: postmaster(a)example.com auth default: cache_size: 10 debug: yes passdb: driver: pam args: cache_key=%u dovecot userdb: driver: passwd Thank you very much! Shane brooks IT Manager 940 West Oakland Avenue Suite A8 Oakland, Florida 34787 407-654-6076 Office 407-654-6063 Fax

2 1

[Dovecot] sieve rule problem after upgrade
by Benny Pedersen 19 Apr '10

19 Apr '10

after i updated from 1.2.6 to 1.2.11 in gentoo this sieve rule stopped working :( # X-Cron-Env if exists "X-Cron-Env" { addflag "\\Seen"; fileinto "Trash"; removeflag "\\Seen"; stop; } any hints why ?, this rule is generated with horde ingo so it might be problem in ingo ? -- xpoint

2 2

[Dovecot] dovecot-1.2-sieve sending vacation replies regardless of recipient (patch)
by Mark Washenberger 19 Apr '10

19 Apr '10

I want a way to send VAR messages without having to specify up front all of the addresses for which such VARs should be sent. I realize this goes against rfc 3834, but it seemed reasonable to add a tag to the vacation command to skip the [to, cc, bcc, ...] recipients check. The patch I made is attached. The new usage with this patch is: vacation [":days" number] [":subject" string] [":x_any_address"] [":from" string] [":addresses" string-list] [":mime"] [":handle" string] <reason: string> What do you think of this patch? Is there a better way to accomplish the same thing without writing a patch? Is there a better way to write this patch to make it a cleaner feature or easier to maintain? Could this ever be part of the mainline? Mark Washenberger Rackspace Hosting Software Developer, Email & Apps mark.washenberger(a)rackspace.com

2 2

[Dovecot] sieve plugin - reject sends MDN. Can it 550 reject ?
by Ken A 19 Apr '10

19 Apr '10

I'm using dovecot-1.2-sieve-0.1.15 with dovecot-1.2.11. I have a reject test filter that looks like this: require "reject"; if header :contains "subject" "reject" { reject "bye"; } Is there any way to get a "reject" filter to send back a 550 reject as detailed in http://ietfreport.isoc.org/idref/rfc5429/#section-2.5 rather than a MDN? The MDN can result in blowback spam. :-( Thanks, Ken -- Ken Anderson Pacific Internet - http://www.pacific.net

3 3

[Dovecot] siever_dir default
by Antonio Casado Rodríguez 19 Apr '10

19 Apr '10

Hi all I have this: # The path to the directory where the personal Sieve scripts are stored. For # ManageSieve this is where the uploaded scripts are stored. #sieve_dir=~/sieve but the correct is # The path to the directory where the personal Sieve scripts are stored. For # ManageSieve this is where the uploaded scripts are stored. # Default value: {mail_location}/sieve #sieve_dir=~/sieve

2 1

[Dovecot] PostgreSQL driver supporting [round-robin] load balancing and redundancy [LONG]
by Rainer Weikusat 18 Apr '10

18 Apr '10

One of the things my employer uses dovecot for is as mail download server for an 'e-mail purification service' (AV/ anti-spam) for smartphones. The service itself presently runs on a rented server somewhere in the UK and the corresponding 'web service' front-end and user account/ mail account database resides on a server in Germany. The UK dovecot server uses the PostgreSQL server on the German machine for user authentication. The latter is reachable using two entirely different 'internet paths' and there was an outage of several hours on one of them a couple of weeks ago. This prompted some frantic network reconfiguration efforts in order to get the abovementioned service going again and resulted in the conviction that - ideally - the dovecot server should be capable of using connections to multiple PostgreSQL servers (or a single server reachable via several IPs) simultaneoulsy, distributing requests among them, and should be capable of detecting a possible problem on one of the db server connections and use the still functioning ones to continue operations. After having spent about eight hours reading through the code of existing pgsql driver, I concluded that modifying that in order to achieve the goals outlined above would require some major brain surgery with a high chance of causing a lot of collateral damage in the course of that and that writing a new driver providing the sought-after feature set was the better idea. Which is the point of this e-mail. Example Usage ------------- Multiple connections can be specified in an ordinary connect-string by separating the necessary parameters with a ;;;-sequence. For the server I was writing about above, this looks like: connect = host=1.1.1.1 dbname=mailgate user=mailgate_user password=secret sslmode=require ;;; \ host=2.2.2.2 dbname=mailgate user=mailgate_user password=secret sslmode=require Leading and trailing whitespace in a connect sub-string is ignored. Basic Operation --------------- After having split the connect string, the driver creates a connection structure (struct multi_pgsql_pgc) for each connection specification contained in that and initiates an asynchronous connect for each. As the actual connections become ready, they are put onto a (linked list) (FIFO) queue of 'connections which are ready'. When a query is submitted to the driver, the first connection structure is removed from the ready list and used to execute the query. After this has finished, the connection is added to the end of the 'connections which are ready' list. If no connection is ready at the time a query was submitted, the query is put on a FIFO queue of queries which will be executed as the resources to actually do so become availabe. Each query has a lifetime of 60 seconds (arbitrary). A query which couldn't be started before his lifetime was over will be aborted with a timeout error. A connection which is currently being used to execute a query will be considered dead if no forward progress of any kind has happened for 20 seconds (also arbitrary). If this happens (or if some kind of I/O error occurs), the existing connection will be closed and an asychronous connect on a newly created one will be started. Assuming the lifetime of the query isn't yet over, it will either be started again on another available connection or pushed back onto the front of the query queue, causing it to be started as soon as a connection becomes available. Attemtps to reestablish the failed connection will continue (with 5 seconds of delay between each) in the background until success. Design Overview --------------- struct multi_pgsql_pgdb & routines working on that provide both the 'simple' query interface and transaction support. struct multi_pgsql_pgc represents a database connection. The result interface is implemented as struct multi_pgsql_result & assorted subroutines. Transactions are provided by a struct multi_pgsql_transaction_context which contains a linked-list of transaction subqueries (struct multi_pgsql_transaction_subquery). A 'class hierarchy' of 'query classes' is used to provide the different kinds of 'queries' supported by the driver (simple queries, simple synchronous queries, transaction queries, synchronous transaction queries). The complete hierarchy itself looks like this: multi_pgsql_query / \ / \ multi_pgsql_simple_query multi_pgsql_transaction_query / \ / \ / \ / \ multi_pgsql_user_query multi_pgsql_sync_query \ / \ / \ multi_pgsql_async_transaction_query multi_pgsql_sync_transaction_query Notable Difference to the pgsql Driver -------------------------------------- sql_exec This interface is not implemented. It is (as far as I can tell) not used anywhere except inside the sqllite driver. It cannot be used for queries which return information because there is no way to access this information and it can neither generally be used for queries which cause side effects since it cannot be determined if execution was successful (the only possible use I can think of is actually a rollback after a failed transaction). sql_result_get_field_value_binary Not implemented. Appears to be unused and the way I understand the libpq programming documentation, the only way to retrieve a binary result to some query is to use PQsendQueryParams or PQsendQueryPrepare and request that some columns are returned in binary. Nothing like this is supported in the present, abstract SQL database interface. synchronous query execution Because background connection reestablishment might still be going on after a synchronous query has been executed, it is necessary to switch any timeouts/ io operations registered to the ioloop used for synchronous query execution back to the main ioloop. The code implements this by using io_loop_set_current to temporarily restore the original ioloop, unregistering and registering any timeouts/ io-requests possibly associated with one of the existing database connections, switching back to the synchronous execution ioloop afterwards and then destroying that via io_loop_destroy. This works but is probably not exactly how the existing interfaces were supposed to be used. error messages for synchronously committed transaction These are put onto the data stack by the commit_s subroutine which will hopefully (judging from the dict-code, this should work, too) be sufficient to enable them to survive until someone higher up in the callchain wants to look at them. Remarks on the Patch -------------------- Created against dovecot-1-2-cf3fe573a560. Applies cleanly to 1.2.11. Applies to 2.0.beta4 with a rejection because of a feature which doesn't exist anymore. The result can be compiled but it hasn't been tested. ---- Index: dovecot/configure.in =================================================================== RCS file: /sysdata/cvs/dovecot/configure.in,v retrieving revision 1.1.1.2 retrieving revision 1.1.1.2.6.9 diff -u -r1.1.1.2 -r1.1.1.2.6.9 --- dovecot/configure.in 15 Mar 2010 18:18:14 -0000 1.1.1.2 +++ dovecot/configure.in 5 Apr 2010 16:16:03 -0000 1.1.1.2.6.9 @@ -159,6 +159,11 @@ [ --with-sqlite Build with SQLite3 driver support], TEST_WITH(sqlite, $withval), want_sqlite=no) + +AC_ARG_WITH(multi-pgsql, +[ --with-multi-pgsql Build with PostgreSQL driver supporting multiple connections], + TEST_WITH(multi-pgsql, $withval), + want_multi_pgsql=no) AC_ARG_WITH(lucene, [ --with-lucene Build with CLucene full text search support], @@ -1969,7 +1974,12 @@ LIBS=$old_LIBS fi -if test $want_pgsql != no; then +want_pgsql_driver=no +test "$want_pgsql" != no && want_pgsql_driver=yes +test "$want_multi_pgsql" != no && want_pgsql_driver=yes + + +if test $want_pgsql_driver != no; then AC_CHECK_PROG(PG_CONFIG, pg_config, YES, NO) if test $PG_CONFIG = NO; then # based on code from PHP @@ -2014,19 +2024,20 @@ fi PGSQL_LIBS="$PGSQL_LIBS -lpq" AC_DEFINE(HAVE_PGSQL,, Build with PostgreSQL support) - found_sql_drivers="$found_sql_drivers pgsql" + test "$want_pgsql" != no && found_sql_drivers="$found_sql_drivers pgsql" + test "$want_multi_pgsql" != no && found_sql_drivers="$found_sql_drivers multi_pgsql" if test "$all_sql_drivers" = "yes"; then - sql_drivers="$sql_drivers pgsql" + sql_drivers="$sql_drivers pgsql pgsql_timeout" fi ], [ - if test $want_pgsql = yes; then + if test $want_pgsql_driver = yes; then AC_ERROR([Can't build with PostgreSQL support: libpq-fe.h not found]) fi ]) CPPFLAGS=$old_CPPFLAGS ], [ - if test $want_pgsql = yes; then + if test $want_pgsql_driver = yes; then AC_ERROR([Can't build with PostgreSQL support: libpq not found]) fi ]) @@ -2323,6 +2334,7 @@ build_pgsql=no build_mysql=no build_sqlite=no +build_multi_pgsql=no for driver in $sql_drivers; do if test "$driver" = "pgsql"; then AC_DEFINE(BUILD_PGSQL,, Built-in PostgreSQL support) @@ -2333,7 +2345,10 @@ elif test "$driver" = "sqlite"; then AC_DEFINE(BUILD_SQLITE,, Built-in SQLite support) build_sqlite=yes - fi + elif test "$driver" = "multi_pgsql"; then + AC_DEFINE(BUILD_MULTI_PGSQL,, Built-in PostgreSQL support with multiple connection support) + build_multi_pgsql=yes + fi done if test $build_pgsql = no; then not_sql_drivers="$not_sql_drivers pgsql" @@ -2344,11 +2359,15 @@ if test $build_sqlite = no; then not_sql_drivers="$not_sql_drivers sqlite" fi +if test $build_multi_pgsql = no; then + not_sql_drivers="$not_sql_drivers multi_pgsql" +fi AC_SUBST(sql_drivers) AM_CONDITIONAL(BUILD_PGSQL, test "$build_pgsql" = "yes") AM_CONDITIONAL(BUILD_MYSQL, test "$build_mysql" = "yes") AM_CONDITIONAL(BUILD_SQLITE, test "$build_sqlite" = "yes") +AM_CONDITIONAL(BUILD_MULTI_PGSQL, test "$build_multi_pgsql" = "yes") AM_CONDITIONAL(SQL_PLUGINS, test "$want_sql" = "plugin") dnl ** Index: dovecot/src/lib-sql/Makefile.am =================================================================== RCS file: /sysdata/cvs/dovecot/src/lib-sql/Makefile.am,v retrieving revision 1.1.1.1 retrieving revision 1.1.1.1.6.3 diff -u -r1.1.1.1 -r1.1.1.1.6.3 --- dovecot/src/lib-sql/Makefile.am 28 Dec 2009 13:52:04 -0000 1.1.1.1 +++ dovecot/src/lib-sql/Makefile.am 5 Apr 2010 15:05:54 -0000 1.1.1.1.6.3 @@ -15,11 +15,16 @@ SQLITE_LIB = libdriver_sqlite.la SQL_DRIVER_PLUGINS += sqlite endif +if BUILD_MULTI_PGSQL +MULTI_PGSQL_LIB = libdriver_multi_pgsql.la +SQL_DRIVER_PLUGINS += multi_pgsql +endif sql_module_LTLIBRARIES = \ $(MYSQL_LIB) \ $(PGSQL_LIB) \ - $(SQLITE_LIB) + $(SQLITE_LIB) \ + $(MULTI_PGSQL_LIB) sql_moduledir = $(moduledir)/sql endif @@ -39,7 +44,8 @@ driver_sources = \ driver-mysql.c \ driver-pgsql.c \ - driver-sqlite.c + driver-sqlite.c \ + driver-multi-pgsql.c endif libsql_a_SOURCES = \ @@ -62,6 +68,11 @@ libdriver_sqlite_la_LIBADD = $(SQLITE_LIBS) libdriver_sqlite_la_CPPFLAGS = -I$(top_srcdir)/src/lib $(SQLITE_CFLAGS) libdriver_sqlite_la_SOURCES = driver-sqlite.c + +libdriver_multi_pgsql_la_LDFLAGS = -module -avoid-version +libdriver_multi_pgsql_la_LIBADD = $(MULTI_PGSQL_LIBS) +libdriver_multi_pgsql_la_CPPFLAGS = -I$(top_srcdir)/src/lib $(MULTI_PGSQL_CFLAGS) +libdriver_multi_pgsql_la_SOURCES = driver-multi-pgsql.c endif headers = \ Index: dovecot/src/lib-sql/driver-multi-pgsql.c =================================================================== RCS file: dovecot/src/lib-sql/driver-multi-pgsql.c diff -N dovecot/src/lib-sql/driver-multi-pgsql.c --- /dev/null 1 Jan 1970 00:00:00 -0000 +++ dovecot/src/lib-sql/driver-multi-pgsql.c 14 Apr 2010 15:31:48 -0000 1.1.2.134 @@ -0,0 +1,1763 @@ +/* + Copyright (c) MAD Partners, Ltd 2010 (rweikusat(a)madpartnerltd.com) + Portions Copyright (c) 2004-2010 Dovecot authors, see the included COPYING file +*/ + +/* includes */ +#include "lib.h" +#include "array.h" +#include "ioloop.h" +#include "ioloop-internal.h" /* kind of dirty, but it should be fine.. */ +#include "sql-api-private.h" + +#ifdef BUILD_MULTI_PGSQL +#include <ctype.h> +#include <stdlib.h> +#include <time.h> +#include <libpq-fe.h> + +/* macros */ +/* #define DEBUG */ +#ifdef DEBUG +# define dprintf(args) i_info args +#else +# define dprintf(args) +#endif + +#define DEINIT_ERROR "db driver deinit" +#define TIMEOUT_ERROR "query timed out" + +/* constants */ +enum { + MULTI_PGSQL_POOL = 512, + MULTI_PGSQL_XACT_POOL = 1024, + + TIMEOUT_UNIT = 1000, + + RECONNECT_DELAY = 5 * TIMEOUT_UNIT, + USER_QUERY_LIFETIME = 60, + + PGC_IO_TIMEOUT = 20, + MIN_QUERY_TIMEOUT = 10 +}; + +/** general helper routines */ +static char *kill_pg_errmsg_newline(char *s) +{ + char *r; + unsigned c; + + r = s; + while ((c = *r) && c != '\n') ++r; + if (c) *r = 0; + + return s; +} + +/** error result */ +struct multi_pgsql_error_result { + struct sql_result api; + char *msg; +}; + +static void error_result_free(struct sql_result *r) +{ + struct multi_pgsql_error_result *result; + + result = (void *)r; + dprintf(("%s: %p", __func__, result)); + + i_free(result->msg); + i_free(result); +} + +static void error_result_nop(struct sql_result *r) +{ + dprintf(("%s: %p", __func__, r)); +} + +static int error_result_next_row(struct sql_result *r) +{ + dprintf(("%s: %p", __func__, r)); + return -1; +} + +static char const *error_result_get_error(struct sql_result *r) +{ + struct multi_pgsql_error_result *result; + + result = (void *)r; + dprintf(("%s: %p", __func__, result)); + + return result->msg; +} + +static void init_error_result(struct multi_pgsql_error_result *result, + char const *msg) +{ + struct sql_result_vfuncs *v; + + memset(&result->api, 0, sizeof(result->api)); + + v = &result->api.v; + v->free = error_result_nop; + v->next_row = error_result_next_row; + v->get_error = error_result_get_error; + + result->msg = (char *)msg; + + dprintf(("%s: %p", __func__, result)); +} + +/** multi_pgsql_result */ +struct multi_pgsql_result { + struct sql_result api; + struct multi_pgsql_pgc *pgc; + + PGresult *pgr; + unsigned row, n_rows; + char const **values, *errmsg; +}; + +/*** methods/ subroutines */ +static void multi_pgsql_result_free(struct sql_result *r) +{ + struct multi_pgsql_result *result; + + result = (void *)r; + + PQclear(result->pgr); + if (result->values) i_free(result->values); + i_free(result); +} + +static void multi_pgsql_result_nop(struct sql_result *r) +{ + (void)r; +} + + +static int multi_pgsql_result_next_row(struct sql_result *r) +{ + struct multi_pgsql_result *result; + unsigned row; + + dprintf(("%s: %p", __func__, r)); + + result = (void *)r; + row = result->row; + if (++row < result->n_rows) return result->row = row; + return 0; +} + +static int multi_pgsql_result_first_row(struct sql_result *r) +{ + struct multi_pgsql_result *result; + PGresult *pgr; + ExecStatusType status; + unsigned n_rows; + + result = (void *)r; + pgr = result->pgr; + + status = PQresultStatus(pgr); + dprintf(("%s: %p: result status %s(%d)", + __func__, r, PQresStatus(status), status)); + + switch (status) { + case PGRES_COMMAND_OK: + case PGRES_COPY_OUT: + case PGRES_COPY_IN: + n_rows = 0; + break; + + case PGRES_TUPLES_OK: + n_rows = PQntuples(pgr); + + dprintf(("%s: %p: %u rows", __func__, result, n_rows)); + break; + + default: + return -1; + } + + result->n_rows = n_rows; + result->api.v.next_row = multi_pgsql_result_next_row; + return n_rows; +} + +static unsigned multi_pgsql_result_get_fields_count(struct sql_result *r) +{ + struct multi_pgsql_result *result; + unsigned count; + + result = (void *)r; + count = PQnfields(result->pgr); + + dprintf(("%s: %p: %u", __func__, result, count)); + return count; +} + +static char const *multi_pgsql_result_get_field_name(struct sql_result *r, + unsigned i) +{ + struct multi_pgsql_result *result; + char const *name; + + result = (void *)r; + name = PQfname(result->pgr, i); + + dprintf(("%s: %p: %u: '%s'", __func__, result, i, name)); + return name; +} + +static int multi_pgsql_result_find_field(struct sql_result *r, + char const *fname) +{ + struct multi_pgsql_result *result; + int i; + + result = (void *)r; + i = PQfnumber(result->pgr, fname); + + if (i == -1) { + i_info("%s: %p: no field named '%s'", + __func__, result, fname); + return -1; + } + + dprintf(("%s: %p: '%s' <-> %d", + __func__, result, fname, i)); + return i; +} + +static char const *multi_pgsql_result_get_field_value(struct sql_result *r, + unsigned i) +{ + struct multi_pgsql_result *result; + char const *value; + unsigned row; + + result = (void *)r; + row = result->row; + value = PQgetvalue(result->pgr, row, i); + if (!*value && PQgetisnull(result->pgr, row, i)) value = NULL; + + dprintf(("%s: %p: %u,%u: '%s'", + __func__, result, row, i, value ? value : "NULL")); + return value; +} + +static unsigned char const * +multi_pgsql_result_get_field_value_binary(struct sql_result *r, + unsigned i, size_t *size) +{ + (void)i; + i_info("%s: %p: not implemented", __func__, r); + + *size = 0; + return NULL; +} + +static char const *multi_pgsql_result_find_field_value(struct sql_result *r, + char const *fname) +{ + int i; + + dprintf(("%s: %p", __func__, r)); + + i = r->v.find_field(r, fname); + return i != -1 ? r->v.get_field_value(r, i) : NULL; +} + +static char const * const *multi_pgsql_result_get_values(struct sql_result *r) +{ + struct multi_pgsql_result *result; + char const **values; + unsigned n; + + dprintf(("%s: %p", __func__, r)); + result = (void *)r; + + values = result->values; + if (values) return values; + + n = r->v.get_fields_count(r); + values = result->values = i_new(char const *, n); + do { + --n; + values[n] = r->v.get_field_value(r, n); + } while (n); + + return values; +} + +static char const * +multi_pgsql_result_get_error(struct sql_result *r) +{ + struct multi_pgsql_result *result; + char const *errmsg; + + result = (void *)r; + + errmsg = result->errmsg; + if (errmsg) return errmsg; + + errmsg = result->errmsg = + kill_pg_errmsg_newline(PQresultErrorMessage(result->pgr)); + return errmsg; +} + +/*** vtable/ init */ +static struct sql_result multi_pgsql_result = { + MEMBER(v) { + multi_pgsql_result_nop, + multi_pgsql_result_first_row, + multi_pgsql_result_get_fields_count, + multi_pgsql_result_get_field_name, + multi_pgsql_result_find_field, + multi_pgsql_result_get_field_value, + multi_pgsql_result_get_field_value_binary, + multi_pgsql_result_find_field_value, + multi_pgsql_result_get_values, + multi_pgsql_result_get_error + } +}; + +static void init_multi_pgsql_result(struct multi_pgsql_result *result, + PGresult *pgr) +{ + result->api = multi_pgsql_result; + result->pgr = pgr; + result->row = 0; + result->values = NULL; +} + +/** query classes */ +struct multi_pgsql_query { + struct multi_pgsql_query *p; + struct multi_pgsql_query_vtable *vtable; +}; + +struct multi_pgsql_query_vtable { + void (*start)(struct multi_pgsql_query *, struct multi_pgsql_pgc *); + void (*result)(struct multi_pgsql_query *, struct multi_pgsql_pgc *, + PGresult **); + void (*abort)(struct multi_pgsql_query *, struct sql_result *); + void (*dtor)(struct multi_pgsql_query *); + time_t (*eol)(struct multi_pgsql_query *); + void (*set_sync_ioloop)(struct multi_pgsql_query *, struct ioloop *); + char const *(*get_query)(struct multi_pgsql_query *); +}; + +static void start_new_query_on_pgc(struct multi_pgsql_query *, struct multi_pgsql_pgc *); +static void start_query_on_pgc(struct multi_pgsql_pgc *); +static void done_with_query(struct multi_pgsql_pgc *); + +/*** method invocation wrappers */ +#define the_qry(q) ((struct multi_pgsql_query *)q) + +static inline void start_query(void *q, struct multi_pgsql_pgc *pgc) +{ + dprintf(("%s: %p", __func__, q)); + the_qry(q)->vtable->start(the_qry(q), pgc); +} + +static inline void query_result(void *q, struct multi_pgsql_pgc *pgc, + PGresult **pgr) +{ + dprintf(("%s: %p", __func__, q)); + the_qry(q)->vtable->result(the_qry(q), pgc, pgr); +} + +static inline void abort_query(void *q, struct sql_result *r) +{ + dprintf(("%s: %p", __func__, q)); + + the_qry(q)->vtable->abort(the_qry(q), r); + the_qry(q)->vtable->dtor(the_qry(q)); +} + +static inline void destroy_query(void *q) +{ + dprintf(("%s: %p", __func__, q)); + the_qry(q)->vtable->dtor(the_qry(q)); +} + +static inline time_t query_eol(void *q) +{ + dprintf(("%s: %p", __func__, q)); + return the_qry(q)->vtable->eol(the_qry(q)); +} + +static inline void set_query_sync_ioloop(void *q, struct ioloop *ioloop) +{ + dprintf(("%s: %p", __func__, q)); + the_qry(q)->vtable->set_sync_ioloop(the_qry(q), ioloop); +} + +static inline char const *get_query(void *q) +{ + return + the_qry(q)->vtable->get_query(the_qry(q)); +} + +#undef the_qry + +/*** query */ +static void init_multi_pgsql_query(struct multi_pgsql_query *qry, + struct multi_pgsql_query_vtable *vtable) +{ + qry->p = NULL; + qry->vtable = vtable; +} + +/*** simple_query */ +struct multi_pgsql_simple_query { + struct multi_pgsql_query super; + + time_t eol_at; + char *query; +}; + +static void start_simple_query(struct multi_pgsql_query *q, + struct multi_pgsql_pgc *pgc) +{ + start_new_query_on_pgc(q, pgc); +} + +static time_t simple_query_eol(struct multi_pgsql_query *q) +{ + struct multi_pgsql_simple_query *qry; + + qry = (void *)q; + dprintf(("%s: %p", __func__, qry)); + return qry->eol_at; +} + +static char const *simple_query_get_query(struct multi_pgsql_query *q) +{ + return ((struct multi_pgsql_simple_query *)q)->query; +} + +static void init_simple_query(struct multi_pgsql_simple_query *qry, + struct multi_pgsql_query_vtable *vtable, + unsigned query_lifetime, char const *query) +{ + init_multi_pgsql_query(&qry->super, vtable); + + qry->query = (void *)query; + qry->eol_at = time(NULL) + query_lifetime; +} + +/*** user_query */ +struct multi_pgsql_user_query { + struct multi_pgsql_simple_query super; + + sql_query_callback_t *cb; + void *ctx; +}; + +static void abort_user_query(struct multi_pgsql_query *q, + struct sql_result *r) +{ + struct multi_pgsql_user_query *qry; + + qry = (void *)q; + + T_BEGIN { + qry->cb(r, qry->ctx); + } T_END; +} + +static void user_query_result(struct multi_pgsql_query *q, + struct multi_pgsql_pgc *pgc, + PGresult **pgr) +{ + struct multi_pgsql_result result; + struct multi_pgsql_user_query *qry; + + qry = (void *)q; + init_multi_pgsql_result(&result, *pgr); + + T_BEGIN { + qry->cb(&result.api, qry->ctx); + } T_END; + + if (result.values) i_free(result.values); + + done_with_query(pgc); +} + +static void user_query_dtor(struct multi_pgsql_query *q) +{ + struct multi_pgsql_user_query *qry; + + qry = (void *)q; + + i_free(qry->super.query); + i_free(qry); +} + +/**** vtable/ init */ +static struct multi_pgsql_query_vtable user_query_vtable = { + start_simple_query, + user_query_result, + abort_user_query, + user_query_dtor, + simple_query_eol, + NULL, + simple_query_get_query +}; + +static struct multi_pgsql_query *create_user_query(char const *query, + sql_query_callback_t *cb, void *ctx) +{ + struct multi_pgsql_user_query *qry; + + qry = i_new(struct multi_pgsql_user_query, 1); + + init_simple_query(&qry->super, &user_query_vtable, + USER_QUERY_LIFETIME, i_strdup(query)); + + qry->cb = cb; + qry->ctx = ctx; + return (void *)qry; +} + +/*** sync_query */ +struct multi_pgsql_sync_query { + struct multi_pgsql_simple_query super; + + struct ioloop *ioloop; + PGresult *pgr; + char *errmsg; +}; + +static void sync_query_result(struct multi_pgsql_query *q, + struct multi_pgsql_pgc *pgc, + PGresult **pgr) +{ + struct multi_pgsql_sync_query *qry; + + qry = (void *)q; + + qry->errmsg = NULL; + qry->pgr = *pgr; + *pgr = NULL; + + done_with_query(pgc); +} + +static void abort_sync_query(struct multi_pgsql_query *q, + struct sql_result *r) +{ + struct multi_pgsql_sync_query *qry; + + qry = (void *)q; + + qry->pgr = NULL; + qry->errmsg = i_strdup(r->v.get_error(r)); +} + +static void sync_query_dtor(struct multi_pgsql_query *q) +{ + struct multi_pgsql_sync_query *qry; + + qry = (void *)q; + io_loop_stop(qry->ioloop); +} + +static void set_sync_query_sync_ioloop(struct multi_pgsql_query *q, + struct ioloop *ioloop) +{ + struct multi_pgsql_sync_query *qry; + + qry = (void *)q; + qry->ioloop = ioloop; +} + +static struct sql_result * +result_from_sync_query(struct multi_pgsql_sync_query *qry) +{ + struct sql_result *result; + PGresult *pgr; + + pgr = qry->pgr; + + if (!pgr) { + result = (void *)i_new(struct multi_pgsql_error_result, 1); + init_error_result((void *)result, qry->errmsg); + result->v.free = error_result_free; + + return result; + } + + result = (void *)i_new(struct multi_pgsql_result, 1); + init_multi_pgsql_result((void *)result, pgr); + result->v.free = multi_pgsql_result_free; + + return result; +} + +/**** vtable/ init */ +static struct multi_pgsql_query_vtable sync_query_vtable = { + start_simple_query, + sync_query_result, + abort_sync_query, + sync_query_dtor, + simple_query_eol, + set_sync_query_sync_ioloop, + simple_query_get_query +}; + +static inline void init_sync_query(struct multi_pgsql_sync_query *qry, + char const *query) +{ + init_simple_query(&qry->super, &sync_query_vtable, + USER_QUERY_LIFETIME, query); +} + +/*** transaction query */ +struct multi_pgsql_transaction_subquery { + struct multi_pgsql_transaction_subquery *p; + + char *query; + unsigned *affected_rows; +}; + +struct multi_pgsql_transaction_context { + struct sql_transaction_context super; + struct multi_pgsql_transaction_subquery *first, **link_to; + pool_t pool; +}; + +struct multi_pgsql_transaction_query { + struct multi_pgsql_query super; + struct multi_pgsql_transaction_context *x_ctx; + + struct multi_pgsql_transaction_subquery *sub; + time_t cur_eol; + + /* + If set, points to the PGresult corresponding + with the subquery which caused the transaction + to fail. + */ + PGresult *pgr; +}; + +struct multi_pgsql_transaction_query_vtable { + struct multi_pgsql_query_vtable super; + void (*xact_done)(struct multi_pgsql_transaction_query *, char const *); +}; + +static inline void transaction_query_xact_done(void *q, char const *errmsg) +{ + struct multi_pgsql_transaction_query *qry; + struct multi_pgsql_transaction_query_vtable *vtable; + + dprintf(("%s: %p", __func__, q)); + + qry = q; + vtable = (void *)qry->super.vtable; + vtable->xact_done(q, errmsg); +} + + +static void start_transaction_query(struct multi_pgsql_query *q, + struct multi_pgsql_pgc *pgc) +{ + struct multi_pgsql_transaction_query *qry; + + qry = (void *)q; + qry->sub = qry->x_ctx->first; + start_new_query_on_pgc(q, pgc); +} + +static void transaction_query_result(struct multi_pgsql_query *q, + struct multi_pgsql_pgc *pgc, + PGresult **ppgr) +{ + struct multi_pgsql_transaction_query *qry; + struct multi_pgsql_transaction_subquery *sub; + PGresult *pgr; + char const *errmsg; + ExecStatusType status; + + qry = (void *)q; + + pgr = qry->pgr; + if (pgr) { + errmsg = kill_pg_errmsg_newline(PQresultErrorMessage(pgr)); + + query_done: + transaction_query_xact_done(qry, errmsg); + done_with_query(pgc); + return; + } + + sub = qry->sub; + + pgr = *ppgr; + status = PQresultStatus(pgr); + dprintf(("%s: %p: status %s(%d)", + __func__, qry, PQresStatus(status), status)); + + switch (status) { + case PGRES_COMMAND_OK: + case PGRES_TUPLES_OK: + case PGRES_COPY_OUT: + case PGRES_COPY_IN: + if (sub->affected_rows) + *sub->affected_rows = atoi(PQcmdTuples(pgr)); + + sub = sub->p; + if (!sub) { + errmsg = NULL; + goto query_done; + } + + qry->sub = sub; + qry->cur_eol = time(NULL) + USER_QUERY_LIFETIME; + break; + + default: + qry->pgr = pgr; + *ppgr = NULL; + + qry->cur_eol = 0; /* don't restart failed transactions */ + sub->query = "rollback"; + } + + start_query_on_pgc(pgc); +} + +static void abort_transaction_query(struct multi_pgsql_query *q, + struct sql_result *r) +{ + char const *errmsg; + PGresult *pgr; + + pgr = ((struct multi_pgsql_transaction_query *)q)->pgr; + errmsg = pgr ? + kill_pg_errmsg_newline(PQresultErrorMessage(pgr)) : r->v.get_error(r); + transaction_query_xact_done(q, errmsg); +} + +static time_t transaction_query_eol(struct multi_pgsql_query *q) +{ + return ((struct multi_pgsql_transaction_query *)q)->cur_eol; +} + +static void transaction_query_dtor(struct multi_pgsql_query *q) +{ + struct multi_pgsql_transaction_query *qry; + PGresult *pgr; + pool_t pool; + + qry = (void *)q; + + pgr = qry->pgr; + if (pgr) PQclear(pgr); + + pool = qry->x_ctx->pool; + pool_unref(&pool); +} + +static char const *transaction_query_get_query(struct multi_pgsql_query *q) +{ + struct multi_pgsql_transaction_query *qry; + + qry = (void *)q; + return qry->sub->query; +} + +static void init_transaction_query(struct multi_pgsql_transaction_query *qry, + struct multi_pgsql_transaction_query_vtable *vtable, + struct multi_pgsql_transaction_context *x_ctx) +{ + init_multi_pgsql_query(&qry->super, &vtable->super); + + qry->x_ctx = x_ctx; + qry->cur_eol = time(NULL) + USER_QUERY_LIFETIME; + qry->pgr = NULL; +} + +/*** async transaction query */ +struct multi_pgsql_async_transaction_query { + struct multi_pgsql_transaction_query super; + + sql_commit_callback_t *cb; + void *ctx; +}; + +static void async_transaction_query_xact_done(struct multi_pgsql_transaction_query *q, + char const *errmsg) +{ + struct multi_pgsql_async_transaction_query *qry; + + qry = (void *)q; + qry->cb(errmsg, qry->ctx); +} + +/**** vtable/ init */ +static struct multi_pgsql_transaction_query_vtable async_transaction_query_vtable = { + { + start_transaction_query, + transaction_query_result, + abort_transaction_query, + transaction_query_dtor, + transaction_query_eol, + NULL, + transaction_query_get_query }, + + async_transaction_query_xact_done +}; + +static void +init_async_transaction_query(struct multi_pgsql_async_transaction_query *qry, + struct multi_pgsql_transaction_context *x_ctx, + sql_commit_callback_t *cb, void *cb_ctx) +{ + init_transaction_query(&qry->super, + &async_transaction_query_vtable, x_ctx); + + qry->cb = cb; + qry->ctx = cb_ctx; +} + +/*** sync transaction query */ +struct multi_pgsql_sync_transaction_query { + struct multi_pgsql_transaction_query super; + + struct ioloop *ioloop; + char const *errmsg; +}; + +static void sync_transaction_query_dtor(struct multi_pgsql_query *q) +{ + struct multi_pgsql_sync_transaction_query *qry; + + qry = (void *)q; + io_loop_stop(qry->ioloop); + transaction_query_dtor(q); +} + +static void set_sync_transaction_query_sync_ioloop(struct multi_pgsql_query *q, + struct ioloop *ioloop) +{ + struct multi_pgsql_sync_transaction_query *qry; + + qry = (void *)q; + qry->ioloop = ioloop; +} + +static void sync_transaction_query_xact_done(struct multi_pgsql_transaction_query *q, + char const *errmsg) +{ + struct multi_pgsql_sync_transaction_query *qry; + + qry = (void *)q; + qry->errmsg = i_strdup(errmsg); +} + +/**** vtable/ init */ +static struct multi_pgsql_transaction_query_vtable sync_transaction_query_vtable = { + { + start_transaction_query, + transaction_query_result, + abort_transaction_query, + sync_transaction_query_dtor, + transaction_query_eol, + set_sync_transaction_query_sync_ioloop, + transaction_query_get_query }, + + sync_transaction_query_xact_done +}; + +static void init_sync_transaction_query(struct multi_pgsql_sync_transaction_query *qry, + struct multi_pgsql_transaction_context *x_ctx) +{ + init_transaction_query(&qry->super, + &sync_transaction_query_vtable, x_ctx); +} + +/** pgc (connection) code */ +struct multi_pgsql_pgc { + struct multi_pgsql_pgc *p; + + char *connect_string; + PGconn *pgc; + PGresult *pgr; + struct multi_pgsql_db *pgdb; + struct multi_pgsql_query *qry; + struct io *io; + struct timeout *timeout; +}; + +/*** misc */ +static void start_pgc_connect(struct multi_pgsql_pgc *); + +static void init_pgc(struct multi_pgsql_pgc *pgc, + struct multi_pgsql_db *pgdb, char *connect_string) +{ + pgc->connect_string = connect_string; + pgc->pgdb = pgdb; + + dprintf(("%s: pgc %p, '%s'", __func__, pgc, connect_string)); + + start_pgc_connect(pgc); +} + +static void reset_pgc(struct multi_pgsql_pgc *pgc) +{ + dprintf(("%s: %p", __func__, pgc)); + + if (pgc->io) io_remove(&pgc->io); + if (pgc->timeout) timeout_remove(&pgc->timeout); + + if (pgc->pgr) { + PQclear(pgc->pgr); + pgc->pgr = NULL; + } + + if (pgc->pgc) { + PQfinish(pgc->pgc); + pgc->pgc = NULL; + } +} + +static void pgc_ioloop_switch(struct multi_pgsql_pgc *pgc) +{ + union { + struct io io; + struct timeout timeout; + } old; + + if (pgc->io) { + old.io = *pgc->io; + io_remove(&pgc->io); + + pgc->io = io_add(PQsocket(pgc->pgc), + old.io.condition, old.io.callback, old.io.context); + } + + if (pgc->timeout) { + old.timeout = *pgc->timeout; + timeout_remove(&pgc->timeout); + + pgc->timeout = timeout_add(old.timeout.msecs, + old.timeout.callback, old.timeout.context); + } +} + +static void log_pg_error(struct multi_pgsql_pgc *pgc, char const *fnc, char const *pg_call) +{ + i_error("%s: %p: %s: %s", + fnc, pgc, pg_call, kill_pg_errmsg_newline(PQerrorMessage(pgc->pgc))); +} + +/*** connection establishment */ +static void add_ready_pgc(struct multi_pgsql_db *, struct multi_pgsql_pgc *); + +static void restart_pgc_connect(struct multi_pgsql_pgc *pgc) +{ + timeout_remove(&pgc->timeout); + start_pgc_connect(pgc); +} + +static void continue_pgc_connect(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + char const *pg_call; + PostgresPollingStatusType status; + int io_dir, rc; + + io_remove(&pgc->io); + the_pgc = pgc->pgc; + + status = PQconnectPoll(the_pgc); + dprintf(("%s: %p: PQconnectPoll returned %d", + __func__, pgc, status)); + + switch (status) { + /* + According to the PostgreSQL source, this is an + unused legacy constant. Here to prevent gcc from + complaining about it. + */ + case PGRES_POLLING_ACTIVE: + case PGRES_POLLING_OK: + rc = PQsetnonblocking(the_pgc, 1); + if (rc == -1) { + pg_call = "PQsetnonblocking"; + goto error; + } + + i_info("%s: %p: connected", __func__, pgc); + add_ready_pgc(pgc->pgdb, pgc); + return; + + case PGRES_POLLING_FAILED: + pg_call = "PQconnectPoll"; + goto error; + + case PGRES_POLLING_READING: + io_dir = IO_READ; + break; + + case PGRES_POLLING_WRITING: + io_dir = IO_WRITE; + } + + pgc->io = io_add(PQsocket(the_pgc), io_dir, continue_pgc_connect, pgc); + return; + +error: + log_pg_error(pgc, __func__, pg_call); + + PQfinish(the_pgc); + pgc->pgc = NULL; + + pgc->timeout = timeout_add(RECONNECT_DELAY, + restart_pgc_connect, pgc); +} + +static void start_pgc_connect(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + + dprintf(("%s: %p", __func__, pgc)); + + pgc->pgc = the_pgc = PQconnectStart(pgc->connect_string); + if (!the_pgc) + i_fatal("%s: %p: out of memory", + __func__, pgc); + + if (PQstatus(the_pgc) == CONNECTION_BAD) { + log_pg_error(pgc, __func__, "PQconnectStart"); + pgc->timeout = timeout_add(RECONNECT_DELAY, + restart_pgc_connect, pgc); + return; + } + + pgc->io = io_add(PQsocket(the_pgc), IO_WRITE, + continue_pgc_connect, pgc); +} + +/*** query processing */ +/**** error handling */ +static void requeue_query_to_pgdb(struct multi_pgsql_query *, struct multi_pgsql_db *); + +static void pgc_query_io_timeout(struct multi_pgsql_pgc *pgc) +{ + i_info("%s: %p", __func__, pgc); + + requeue_query_to_pgdb(pgc->qry, pgc->pgdb); + pgc->qry = NULL; + + reset_pgc(pgc); + start_pgc_connect(pgc); +} + +static void pgc_query_processing_failure(struct multi_pgsql_pgc *pgc, + char const *fnc, + char const *pg_call) +{ + log_pg_error(pgc, fnc, pg_call); + + requeue_query_to_pgdb(pgc->qry, pgc->pgdb); + pgc->qry = NULL; + + reset_pgc(pgc); + start_pgc_connect(pgc); +} + +/**** result processing */ +static void done_with_query(struct multi_pgsql_pgc *pgc) +{ + struct multi_pgsql_query *qry; + + qry = pgc->qry; + pgc->qry = NULL; + + destroy_query(qry); +} + +static inline int got_result(PGconn *pgc) +{ + PGresult *pgr; + + pgr = PQgetResult(pgc); + if (!pgr) return 0; + + PQclear(pgr); + return 1; +} + +static void eat_results(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + PGresult *pgr; + int rc; + + dprintf(("%s: %p", __func__, pgc)); + + the_pgc = pgc->pgc; + do { + rc = PQconsumeInput(the_pgc); + if (rc == 0) { + pgc_query_processing_failure(pgc, __func__, + "PQconsumeInput"); + return; + } + + if (PQisBusy(the_pgc)) { + timeout_reset(pgc->timeout); + return; + } + } while (got_result(the_pgc)); + + io_remove(&pgc->io); + timeout_remove(&pgc->timeout); + + pgr = pgc->pgr; + pgc->pgr = NULL; + query_result(pgc->qry, pgc, &pgr); + if (pgr) PQclear(pgr); + + if (!pgc->qry) add_ready_pgc(pgc->pgdb, pgc); +} + +static void get_first_result(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + PGresult *pgr; + int rc; + + dprintf(("%s: %p", __func__, pgc)); + the_pgc = pgc->pgc; + + rc = PQconsumeInput(the_pgc); + if (rc == 0) { + pgc_query_processing_failure(pgc, __func__, + "PQconsumeInput"); + return; + } + + if (PQisBusy(the_pgc)) { + dprintf(("%s: %p: still busy", __func__, pgc)); + + timeout_reset(pgc->timeout); + return; + } + + io_remove(&pgc->io); + + pgr = pgc->pgr = PQgetResult(the_pgc); + if (pgr) { + pgc->io = io_add(PQsocket(the_pgc), IO_READ, eat_results, pgc); + timeout_reset(pgc->timeout); + + eat_results(pgc); + return; + } else + timeout_remove(&pgc->timeout); + + + query_result(pgc->qry, pgc, NULL); + if (!pgc->qry) add_ready_pgc(pgc->pgdb, pgc); +} + +/**** query transmission */ +static void flush_query(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + int rc; + + dprintf(("%s: %p", __func__, pgc)); + the_pgc = pgc->pgc; + + rc = PQflush(the_pgc); + switch (rc) { + case -1: + pgc_query_processing_failure(pgc, __func__, + "PQflush"); + return; + + case 0: + dprintf(("%s: %p: query sent", __func__, pgc)); + + io_remove(&pgc->io); + pgc->io = io_add(PQsocket(the_pgc), IO_READ, get_first_result, pgc); + } + + timeout_reset(pgc->timeout); +} + +static void start_query_on_pgc(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + char const *pg_call, *query; + void (*io_cb)(struct multi_pgsql_pgc *); + int rc, io_dir; + + query = get_query(pgc->qry); + dprintf(("%s: %p: %s", __func__, pgc, query)); + + the_pgc = pgc->pgc; + + rc = PQsendQuery(the_pgc, query); + if (rc == 0) { + pg_call = "PQsendQuery"; + goto error; + } + + rc = PQflush(the_pgc); + switch (rc) { + case -1: + pg_call = "PQflush"; + goto error; + + case 0: + io_cb = get_first_result; + io_dir = IO_READ; + break; + + default: + io_cb = flush_query; + io_dir = IO_WRITE; + } + + pgc->io = io_add(PQsocket(the_pgc), io_dir, io_cb, pgc); + pgc->timeout = timeout_add(PGC_IO_TIMEOUT * TIMEOUT_UNIT, + pgc_query_io_timeout, pgc); + return; + +error: + pgc_query_processing_failure(pgc, __func__, "PQflush"); +} + +static void start_new_query_on_pgc(struct multi_pgsql_query *qry, + struct multi_pgsql_pgc *pgc) +{ + dprintf(("%s: %p -> %p", __func__, qry, pgc)); + + pgc->qry = qry; + start_query_on_pgc(pgc); +} + +/** pgdb */ +struct multi_pgsql_db { + struct sql_db api; + + unsigned n_pgcs; + struct multi_pgsql_pgc *pgcs; + + struct { + struct multi_pgsql_pgc *first, **link_to; + } pgc_q; + + struct { + struct timeout *timeout; + struct multi_pgsql_query *first, **link_to; + } query_q; + + pool_t pool; +}; + +static struct multi_pgsql_query *dequeue_query_from_pgdb(struct multi_pgsql_db *); + +/*** pgc support code */ +static void do_init_pgcs(struct multi_pgsql_db *pgdb, char const *s, unsigned ofs) +{ + char const *r, *lws_start; + unsigned c, semi_count; + + while ((c = *s) && isspace(c)) ++s; + + if (!c) { + if (!ofs) i_fatal("%s: empty connect string", __func__); + + dprintf(("%s: end of connect_string, %u pgcs", + __func__, ofs)); + + pgdb->n_pgcs = ofs; + pgdb->pgcs = p_new(pgdb->pool, struct multi_pgsql_pgc, ofs); + return; + } + + semi_count = 0; + lws_start = NULL; + r = s; + do { + if (c == ';') { + if (++semi_count == 3) break; + continue; + } + + semi_count = 0; + + if (isspace(c)) { + if (!lws_start) lws_start = r; + continue; + } + + lws_start = NULL; + } while ((c = *++r)); + + do_init_pgcs(pgdb, c ? r + 1 : r, ofs + 1); + + if (lws_start) r = lws_start; + else if (c) r -= 2; + + init_pgc(pgdb->pgcs + ofs, pgdb, p_strndup(pgdb->pool, s, r - s)); +} + +static inline void init_pgcs(struct multi_pgsql_db *pgdb, char const *connect_string) +{ + do_init_pgcs(pgdb, connect_string, 0); +} + +static void add_ready_pgc(struct multi_pgsql_db *pgdb, struct multi_pgsql_pgc *pgc) +{ + struct multi_pgsql_query *qry; + + if (!pgdb->pgc_q.first) { + qry = dequeue_query_from_pgdb(pgdb); + + if (qry) { + start_query(qry, pgc); + return; + } + } + + *pgdb->pgc_q.link_to = pgc; + pgdb->pgc_q.link_to = &pgc->p; + + dprintf(("%s: %p -> %p", __func__, pgc, pgdb)); +} + +static struct multi_pgsql_pgc *get_ready_pgc(struct multi_pgsql_db *pgdb) +{ + struct multi_pgsql_pgc *pgc, *next_pgc; + + pgc = pgdb->pgc_q.first; + if (!pgc) return NULL; + + next_pgc = pgc->p; + if (next_pgc) pgc->p = NULL; + else pgdb->pgc_q.link_to = &pgdb->pgc_q.first; + pgdb->pgc_q.first = next_pgc; + + dprintf(("%s: %p -> %p", __func__, pgdb, pgc)); + return pgc; +} + +static void switch_pgdb_pgcs(struct multi_pgsql_db *pgdb) +{ + struct multi_pgsql_pgc *pgcs; + unsigned n; + + pgcs = pgdb->pgcs; + n = pgdb->n_pgcs; + do pgc_ioloop_switch(pgcs + --n); while (n); +} + +/*** query timeout */ +static void start_pgdb_query_timeout(struct multi_pgsql_db *, + struct multi_pgsql_query *); + +static void pgdb_query_timeout(struct multi_pgsql_db *pgdb) +{ + struct multi_pgsql_query *qry, *next_qry; + struct multi_pgsql_error_result timeout; + time_t now; + + dprintf(("%s: %p", __func__, pgdb)); + + timeout_remove(&pgdb->query_q.timeout); + qry = pgdb->query_q.first; + now = time(NULL); + init_error_result(&timeout, TIMEOUT_ERROR); + do { + next_qry = qry->p; + abort_query(qry, &timeout.api); + } while (next_qry && now > query_eol(next_qry)); + + pgdb->query_q.first = next_qry; + + if (next_qry) { + start_pgdb_query_timeout(pgdb, next_qry); + return; + } + + pgdb->query_q.link_to = &pgdb->query_q.first; +} + +static void start_pgdb_query_timeout(struct multi_pgsql_db *pgdb, + struct multi_pgsql_query *qry) +{ + time_t now, timeout, eol; + + now = time(NULL); + eol = query_eol(qry); + timeout = now < eol ? eol - now : 0; + if (timeout < MIN_QUERY_TIMEOUT) timeout = MIN_QUERY_TIMEOUT; + + pgdb->query_q.timeout = timeout_add(timeout * TIMEOUT_UNIT, + pgdb_query_timeout, pgdb); + dprintf(("%s: %p: timeout in %us", __func__, pgdb, (unsigned)timeout)); +} + +/*** query queueing */ +static void queue_query_to_pgdb(struct multi_pgsql_query *qry, struct multi_pgsql_db *pgdb) +{ + if (!pgdb->query_q.first) start_pgdb_query_timeout(pgdb, qry); + + *pgdb->query_q.link_to = qry; + pgdb->query_q.link_to = &qry->p; +} + +static struct multi_pgsql_query *dequeue_query_from_pgdb(struct multi_pgsql_db *pgdb) +{ + struct multi_pgsql_query *qry, *next_qry; + + qry = pgdb->query_q.first; + if (!qry) return NULL; + + timeout_remove(&pgdb->query_q.timeout); + + next_qry = qry->p; + if (next_qry) start_pgdb_query_timeout(pgdb, next_qry); + else pgdb->query_q.link_to = &pgdb->query_q.first; + pgdb->query_q.first = next_qry; + + qry->p = NULL; + return qry; +} + +static void requeue_query_to_pgdb(struct multi_pgsql_query *qry, + struct multi_pgsql_db *pgdb) +{ + struct multi_pgsql_error_result timeout; + struct multi_pgsql_pgc *pgc; + + if (time(NULL) >= query_eol(qry)) { + init_error_result(&timeout, TIMEOUT_ERROR); + abort_query(qry, &timeout.api); + return; + } + + pgc = get_ready_pgc(pgdb); + if (pgc) { + start_query(qry, pgc); + return; + } + + if (pgdb->query_q.timeout) { + timeout_remove(&pgdb->query_q.timeout); + qry->p = pgdb->query_q.first; + } else + pgdb->query_q.link_to = &qry->p; + + pgdb->query_q.first = qry; + start_pgdb_query_timeout(pgdb, qry); +} + + +/*** query submission */ +static void pgdb_async_query(struct multi_pgsql_db *pgdb, + struct multi_pgsql_query *qry) +{ + struct multi_pgsql_pgc *pgc; + + dprintf(("%s: %p: %p", __func__, pgdb, qry)); + + pgc = get_ready_pgc(pgdb); + if (pgc) { + start_query(qry, pgc); + return; + } + + dprintf(("%s: %p: no pgcs ready, queueing", __func__, pgdb)); + queue_query_to_pgdb(qry, pgdb); +} + + +static void pgdb_sync_query(struct multi_pgsql_db *pgdb, + struct multi_pgsql_query *qry) +{ + struct ioloop *old_ioloop, *sync_ioloop; + + dprintf(("%s: %p: %p", __func__, pgdb, qry)); + + old_ioloop = current_ioloop; + sync_ioloop = io_loop_create(); + switch_pgdb_pgcs(pgdb); + + set_query_sync_ioloop(qry, sync_ioloop); + pgdb_async_query(pgdb, qry); + + io_loop_run(sync_ioloop); + + io_loop_set_current(old_ioloop); + switch_pgdb_pgcs(pgdb); + io_loop_set_current(sync_ioloop); + io_loop_destroy(&sync_ioloop); +} + +/*** non-transaction SQL driver methods */ +extern struct sql_db driver_multi_pgsql_db; + +static struct sql_db *multi_pgsql_init_v(char const *connect_string) +{ + struct multi_pgsql_db *pgdb; + pool_t pool; + + dprintf(("%s: %s", __func__, connect_string)); + + pool = pool_alloconly_create("multi_pgsql_pool", MULTI_PGSQL_POOL); + + pgdb = p_new(pool, struct multi_pgsql_db, 1); + pgdb->api = driver_multi_pgsql_db; + pgdb->pool = pool; + + pgdb->query_q.link_to = &pgdb->query_q.first; + pgdb->pgc_q.link_to = &pgdb->pgc_q.first; + + init_pgcs(pgdb, connect_string); + return (void *)pgdb; +} + +static void multi_pgsql_deinit_v(struct sql_db *db) +{ + struct multi_pgsql_error_result deinit; + struct multi_pgsql_db *pgdb; + struct multi_pgsql_pgc *pgc; + struct multi_pgsql_query *qry, *next_qry; + pool_t pool; + unsigned n; + + dprintf(("%s: %p", __func__, db)); + + array_free(&db->module_contexts); + + pgdb = (void *)db; + init_error_result(&deinit, DEINIT_ERROR); + + n = pgdb->n_pgcs; + do { + pgc = pgdb->pgcs + --n; + + qry = pgc->qry; + if (qry) abort_query(qry, &deinit.api); + + reset_pgc(pgc); + + } while (n); + + qry = pgdb->query_q.first; + if (qry) { + timeout_remove(&pgdb->query_q.timeout); + + do { + next_qry = qry->p; + abort_query(qry, &deinit.api); + } while ((qry = next_qry)); + } + + pool = pgdb->pool; + pool_unref(&pool); +} + +static int multi_pgsql_connect(struct sql_db *db) +{ + dprintf(("%s: %p", __func__, db)); + return 1; +} + +static enum sql_db_flags +multi_pgsql_get_flags(struct sql_db *db) +{ + dprintf(("%s: %p", __func__, db)); + return 0; +} + +static const char * +multi_pgsql_escape_string(struct sql_db *db, const char *in) +{ + struct multi_pgsql_db *pgdb; + char *out; + size_t len; + + pgdb = (void *)db; + len = strlen(in); + out = t_buffer_get(len * 2 + 1); + len = PQescapeStringConn(pgdb->pgcs->pgc, out, in, len, + NULL); + t_buffer_alloc(len + 1); + + dprintf(("%s: %p: '%s' -> '%s'", + __func__, pgdb, in, out)); + return out; +} + +static void multi_pgsql_query(struct sql_db *db, const char *query, + sql_query_callback_t *cb, void *ctx) +{ + struct multi_pgsql_query *qry; + + dprintf(("%s: %p: %s", __func__, db, query)); + + qry = create_user_query(query, cb, ctx); + pgdb_async_query((void *)db, qry); +} + +static void multi_pgsql_exec(struct sql_db *db, const char *query) +{ + i_info("%s: %p: %s", __func__, db, query); + i_info("%s: not implemented", __func__); +} + +static struct sql_result * +multi_pgsql_query_s(struct sql_db *db, const char *query) +{ + struct multi_pgsql_db *pgdb; + struct multi_pgsql_sync_query sync_qry; + + pgdb = (void *)db; + dprintf(("%s: %p: %s", __func__, pgdb, query)); + + init_sync_query(&sync_qry, query); + pgdb_sync_query(pgdb, (void *)&sync_qry); + return result_from_sync_query(&sync_qry); +} + +/*** transaction support code */ +static void add_subquery_to(struct multi_pgsql_transaction_context *x_ctx, + char const *query, unsigned *affected_rows) + +{ + struct multi_pgsql_transaction_subquery *sub; + pool_t pool; + + pool = x_ctx->pool; + + sub = p_new(pool, struct multi_pgsql_transaction_subquery, 1); + sub->query = p_strdup(pool, query); + sub->affected_rows = affected_rows; + + *x_ctx->link_to = sub; + x_ctx->link_to = &sub->p; + + dprintf(("%s: %p: '%s'", __func__, x_ctx, query)); +} + +static struct sql_transaction_context * +multi_pgsql_transaction_begin(struct sql_db *db) +{ + struct multi_pgsql_transaction_context *x_ctx; + pool_t pool; + + pool = pool_alloconly_create("multi_pgsql_xact_pool", + MULTI_PGSQL_XACT_POOL); + x_ctx = p_new(pool, struct multi_pgsql_transaction_context, 1); + x_ctx->super.db = db; + x_ctx->link_to = &x_ctx->first; + x_ctx->pool = pool; + + add_subquery_to(x_ctx, "begin", NULL); + + dprintf(("%s: db %p: %p", __func__, db, x_ctx)); + return (void *)x_ctx; +} + +static void +multi_pgsql_transaction_commit(struct sql_transaction_context *ctx, + sql_commit_callback_t *cb, void *cb_ctx) +{ + struct multi_pgsql_transaction_context *x_ctx; + struct multi_pgsql_async_transaction_query *qry; + + x_ctx = (void *)ctx; + dprintf(("%s: %p", __func__, x_ctx)); + + add_subquery_to(x_ctx, "commit", NULL); + + qry = p_new(x_ctx->pool, struct multi_pgsql_async_transaction_query, 1); + init_async_transaction_query(qry, x_ctx, cb, cb_ctx); + pgdb_async_query((void *)ctx->db, (void *)qry); +} + +static int +multi_pgsql_transaction_commit_s(struct sql_transaction_context *ctx, + const char **error_r) +{ + struct multi_pgsql_transaction_context *x_ctx; + struct multi_pgsql_sync_transaction_query sync_qry; + char *errmsg; + + x_ctx = (void *)ctx; + dprintf(("%s: %p", __func__, x_ctx)); + + add_subquery_to(x_ctx, "commit", NULL); + + init_sync_transaction_query(&sync_qry, x_ctx); + pgdb_sync_query((void *)x_ctx->super.db, &sync_qry.super.super); + + errmsg = (char *)sync_qry.errmsg; + if (errmsg) { + *error_r = t_strdup(errmsg); + i_free(errmsg); + + return -1; + } + + return 0; +} + +static void +multi_pgsql_transaction_rollback(struct sql_transaction_context *ctx) +{ + struct multi_pgsql_transaction_context *x_ctx; + + x_ctx = (void *)ctx; + dprintf(("%s: %p", __func__, x_ctx)); + + pool_unref(&x_ctx->pool); +} + +static void +multi_pgsql_transaction_update(struct sql_transaction_context *ctx, const char *query, + unsigned int *affected_rows) +{ + struct multi_pgsql_transaction_context *x_ctx; + + x_ctx = (void *)ctx; + add_subquery_to(x_ctx, query, affected_rows); +} + +/*** db driver vtable */ +struct sql_db driver_multi_pgsql_db = { + "multi-pgsql", + + MEMBER(v) { + multi_pgsql_init_v, + multi_pgsql_deinit_v, + multi_pgsql_get_flags, + multi_pgsql_connect, + multi_pgsql_escape_string, + multi_pgsql_exec, + multi_pgsql_query, + multi_pgsql_query_s, + + multi_pgsql_transaction_begin, + multi_pgsql_transaction_commit, + multi_pgsql_transaction_commit_s, + multi_pgsql_transaction_rollback, + multi_pgsql_transaction_update + } +}; +#endif

3 4

[Dovecot] windows live mail + dovecot and nfs
by Anes Muhametov 17 Apr '10

17 Apr '10

Hi all. My clients have got problem accessing dovecot by "Windows live mail (Windows 7)" client. The problem is that users can't delete two or more folders one-by-one. There is no errors deleting first folder (new dir /storage/vol1/mail/domain/user/Maildir/..DOVECOT-TRASHED appeared and wasn't deleted). If I try to delete second one, error occurs (user, domain, IP address changed): dovecot: IMAP(user@domain): unlink_directory(/storage/vol1/mail/domain/user/Maildir/..DOVECOT-TRASHED) failed: Directory not empty I'm using dovecot 1.2.10 @FreeBSD 7.2-RELEASE-p1 amd64 and NFS storage backend. dovecot -n # 1.2.10: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.2-RELEASE-p1 amd64 syslog_facility: local7 protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/1.crt ssl_key_file: /etc/ssl/1.key.unsec disable_plaintext_auth: no verbose_ssl: yes shutdown_clients: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: mail server ready. login_process_per_connection: no login_process_size: 512 login_processes_count: 60 login_max_processes_count: 256 login_max_connections: 100 max_mail_processes: 4096 mail_max_userip_connections(default): 50 mail_max_userip_connections(imap): 50 mail_max_userip_connections(pop3): 30 verbose_proctitle: yes first_valid_uid: 90 last_valid_uid: 90 first_valid_gid: 90 last_valid_gid: 90 mail_privileged_group: mail mail_location: maildir:%h/Maildir mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock maildir_copy_preserve_filename: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_process_size: 128 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh lda: postmaster_address: postmaster(a)domain.ru mail_plugins: quota sendmail_path: /usr/sbin/sendmail log_path: /var/log/dovecot/deliver.log info_log_path: /var/log/dovecot/deliver.log auth default: mechanisms: plain login cram-md5 cache_size: 262144 cache_ttl: 180 cache_negative_ttl: 60 failure_delay: 1 worker_max_count: 2000 process_size: 512 passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: user group: domain plugin: quota: maildir:Quota Here is listing of ..DOVECOT-TRASHED: ls -la /storage/vol1/mail/domain/user/Maildir/..DOVECOT-TRASHED: total 16 drwx------ 2 user user 4096 Apr 9 11:32 . drwx------ 27 user user 8192 Apr 9 11:41 .. -rw------- 1 user user 156 Apr 9 11:32 .nfs.014cd02e.ffffd11b4.4 -rw------- 1 user user 17 Apr 9 11:32 .nfs.014cd031.ffffd11b4.4 fstat output: [root@ /storage/vol1/mail/domain/user/Maildir/..DOVECOT-TRASHED]# fstat .* USER CMD PID FD MOUNT INUM MODE SZ|DV R/W NAME root fstat 82081 wd /storage/vol1 32454159 drwx------ 4096 r . user imap 53042 7 /storage/vol1 40573622 -rw------- 156 rw .nfs.014cd02e.ffffd11b4.4 user imap 53042 9 /storage/vol1 40573631 -rw------- 17 rw .nfs.014cd031.ffffd11b4.4 root bash 22223 wd /storage/vol1 32454159 drwx------ 4096 r . # ps uxwa|grep user user 53042 0.0 0.1 9812 2400 ?? S 11:31AM 0:00.02 imap [user@domain 1.1.1.1] user 53650 0.0 0.1 10836 2908 ?? S 11:32AM 0:00.05 imap [user@domain 1.1.1.1] It seems like first imap process locked ..DOVECOT-TRASHED. Best regards Anes Muhametoc.

2 2

[Dovecot] get the messages ID after APPEND
by Christian Fischer 17 Apr '10

17 Apr '10

Hi there! I am new to imap "Command Line" and trying to write a script doing the following on a dovecot imap server: - APPEND a message (e.g. to Drafts) - get the ID to reopen the message for reading In short: How do i get the ID back from the APPEND command or which command has to be invoked to get the uid of the newly added message? Thank you! Christian ----------------- dovecot --version 1.0.15 dovecot -n # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S ssl_cert_file: /etc/postfix/tls/mail.cert ssl_key_file: /etc/postfix/tls/mail.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail mail_location: maildir:%h/.EMAIL auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix

3 3

[Dovecot] mysql log entry
by Terry Barnum 17 Apr '10

17 Apr '10

I'm sure this is a really newbie question, but I notice in /var/log/mail.log that there are between 3 and 15 of the following log entries every day for the last five days, which is far back as my logs go--what do they mean? Apr xx hh:mm:ss mail dovecot[109]: auth-worker(default): mysql: Connected to localhost (postfix) Is it dovecot connecting to mysql for password or user info? If so, wouldn't it be more frequent? I've got 20 users with some connecting from outside many times per day. Thanks, -Terry

2 2

[Dovecot] Problems with masteruser
by Неворотин Вадим 16 Apr '10

16 Apr '10

I have very strange problem with masteruser. See two logs below: # telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Welcome to our post server! x login nevorotin password x OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk] Logged in x list "" "*" * LIST (\HasNoChildren) "/" "INBOX" x OK List completed. x getacl INBOX * ACL "INBOX" "nevorotin" lrwstipekxacd x OK Getacl completed. All work perfectly. And then I log in throw masteruser: # telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Welcome to our post server! x login nevorotin*master masterpassword x OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk] Logged in x list "" "*" * LIST (\Unmarked) "/" "INBOX" x OK List completed. x getacl INBOX x NO [NONEXISTENT] Mailbox doesn't exist: INBOX I've turned on debug logging, but there aren't any errors. I only see that masteruser succesfully logged in as nevorotin. How can I make a masteruser login to user account exactly the same as simple user login? Now it don't work at all [?] I use 1.2.10 version of dovecot.

3 10

Re: [Dovecot] zlib Plugin Dovecot 2.0
by Alex Baule 16 Apr '10

16 Apr '10

Hi Paschal You do not understand what I want. I developed a plugin based on the zlib plugin, but want to port it to dovecot 2.0. There are some differences in the 2.0 plugin, which I did not quite understand how it works for me to readjust it in my plugin. As in the source code there are not many comments, I do not quite know what each function does, if they are all necessary in my adaptation. In developing the plugin in version 1.4, Timo helped me a lot. What I need to know is how the hooks on write emails do this, and what the differences in the read function, since the code is different from version 1.4 to 2.0.

2 6

[Dovecot] 2.0beta4 and latest Mercurial: Folder not SELECT-able until LIST-ed
by B. Johannessen 16 Apr '10

16 Apr '10

Have a look at the attached dialog. It shows the folder "shared/a(a)db.org/Archive" not being SELECT-able until after it's been mentioned in a LIST response. This can't possibly be right, can it? Bob

2 4

[Dovecot] flags, keywords in a shared mailbox setup
by Thomas Hummel 16 Apr '10

16 Apr '10

Hello Timo, I'm trying to get a clear understanding of dovecot's (1.2.x) flags and keywords sharing possibilities or impossibilities in a shared-mailboxes setup. By definition, a shared mailbox is a mailbox from a personal namespace which has been made available to someone else who sees it in a shared namespace. There can be some combinatorics according to the fact that INDEX and CONTROL files location can either be user-dependent or user-independent and this in either the private or the shared namespace. Besides, it's not clear to me if the 'dovecot-shared' file is still relevant in 1.2x and shared-namespaces to store flags only in indexes. So what combination is to be avoided because it would break things ? More specifically : . is, in 1.2x, the method for having private flags of a shared mailbox still to have the 'dovecot-shared' file (in order to store flags in indexes) ? . how can shared keywords in a shared mailbox even work ? If they're shared (how ? by pointing CONTROL to the same user-independent location ?), keywords known by a client (user1) won't necessary be known or have the same meaning for another client (user2), will they ? [Note : isn't it the same event with no shared mailboxes but with one user using several clients ?] But, if they're private, they have to be stored outside the filename : how can we do that ? Thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

2 3

[Dovecot] dovecot-auth question
by rmcgraw＠math.purdue.edu 16 Apr '10

16 Apr '10

/export/rpoolbackup# dovecot -n # 1.2.10: /local/etc/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 768). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: SunOS 5.10 i86pc protocols: imaps pop3s ssl_cert_file: /local/ssl/certs/dovecot-cert.pem ssl_key_file: /local/ssl/private/dovecot-key.pem verbose_ssl: yes login_dir: /local/var/run/dovecot/login login_executable(default): /local/libexec/dovecot/imap-login login_executable(imap): /local/libexec/dovecot/imap-login login_executable(pop3): /local/libexec/dovecot/pop3-login first_valid_uid: 101 mail_location: mbox:~/mail:INBOX=/var/mail/%u mail_executable(default): /local/libexec/dovecot/imap mail_executable(imap): /local/libexec/dovecot/imap mail_executable(pop3): /local/libexec/dovecot/pop3 mail_plugin_dir(default): /local/lib/dovecot/imap mail_plugin_dir(imap): /local/lib/dovecot/imap mail_plugin_dir(pop3): /local/lib/dovecot/pop3 auth default: verbose: yes debug: yes passdb: driver: pam userdb: driver: passwd ----- We recently moved to dovecot and after few little configuration problem our dovecot seems to be running without problems for the most part, but I am seeing the following error in /var/adm/messages about ever 3 minutes. Apr 5 09:13:23 gauss.math.purdue.edu dovecot-auth[14359]: [ID 293258 user.error] libsldap: Status: 49 Mesg: openConnection: simple bind failed - Invalid credentials I would like to try and find out what user connection is causing this message. I have turned on most of the verbose logging but I cannot see anything in any logs that might give me the information. Can someone give me guidance on how I can track this down. Thanks Robert _____________________________________________________________________ Robert P. McGraw, Jr. Manager, Computer System EMAIL: rmcgraw(a)purdue.edu Purdue University ROOM: MATH-807 Department of Mathematics PHONE: (765) 494-6055 150 N. University Street West Lafayette, IN 47907-2067

2 1

[Dovecot] dovecot 1.2.11 + virtual plugin + deliver
by Stef Simoens 16 Apr '10

16 Apr '10

Hello List and Timo, I configured the virtual mailboxes which are really nice. To create the virtual-folder, I made a postlogin-script as described in the wiki. However, as my mail is delivered by dovecot's deliver ... I'm getting errors for people not yet logged in... Namespace 'virtual.': virtual : Root mail directory doesn't exist: /var/vmail/domain.org/username/virtual I tried removing the virtual-plugin from the protocol lda-section; and putting the namespace only in the protocol imap-section; but then the error becomes Namespace 'virtual.': Unknown mail storage driver virtual After an IMAP login (thanks to the postlogin-script) the virtual folder is created. However, I would prefer that mails to existing users and new users works even before they logged-in (and before the postlogin-script creates the virtual folder). Any help? Greetings, -- Stef Simoens

3 3

[Dovecot] Per-user flags for shared folders
by Неворотин Вадим 16 Apr '10

16 Apr '10

As I see in 2.0 there willn't be ability to control which flags should be shared, and which should be per-user. But may be there is some plans to implement settings to control that? It'll be great if you can write in dovecot-shared file which flags should be per-user. It's very usefull for group mailboxes, when each user should work with such mailbox like with their own. Now I can't add permission for delete on group mailbox for anybody, because if somebody delete a message, it dissapear for other users of group mailbox. So my group mailboxes look like a big scrapyard[?] I can compile from sources and add also \Deleted flag to private flags, but it's not an elegant solution[?] And my idea is easy to implement :) Only add here: 305 shared_path = t_strconcat(box->path, "/dovecot-shared", NULL); 306 if (stat(shared_path, &st) == 0) 307 box->private_flags_mask = MAIL_SEEN; in maildir-storage.c some code for reading a mask from dovecot-shared file. Unfortunatelly I'm not a good programmer, so I can't make a patch myself(((

2 1

[Dovecot] 2.0beta4 doesn't respond to DONE after untagged FETCH during IDLE
by Daniel I. Applebaum 16 Apr '10

16 Apr '10

Using K-9 Mail to IDLE on a test folder "MyIncTmp". When there is a flag change on a message in the folder, which generates an untagged FETCH, K-9 Mail responds with a DONE, but dovecot does not exit IDLE state (LOG 1). However, if a new message is delivered, generating an untagged EXISTS, K-9 Mail responds the same way, with a DONE, and dovecot does exit IDLE state. (LOG 2) You can also see in LOG 1 that the "OK Still here" continues to be sent, corroborating that dovecot is still in IDLE state. I hope this information is helpful. Sincerely, Dan. LOG 1: failure to exit IDLE after untagged FETCH 04-16 08:25:48.911: VERBOSE/k9(10160): Sending IMAP command IDLE on connection conn1127686952 04-16 08:25:48.921: VERBOSE/k9(10160): conn1127686952>>> 13 IDLE 04-16 08:25:48.921: VERBOSE/k9(10160): Sent IMAP command IDLE with tag 13 for conn1127686952 04-16 08:25:49.191: VERBOSE/k9(10160): <<< #+# [idling] 04-16 08:25:49.201: VERBOSE/k9(10160): conn1127686952<<<#+# [idling] 04-16 08:25:49.201: VERBOSE/k9(10160): Got async response: #+# [idling] 04-16 08:25:49.201: DEBUG/k9(10160): Idling dantest:MyIncTmp/Thread-24/conn1127686952 04-16 08:25:49.201: DEBUG/k9(10160): Considering releasing WakeLock for Pushing 04-16 08:25:49.201: DEBUG/k9(10160): Releasing WakeLock for Pushing for thread Thread-24 04-16 08:25:54.491: VERBOSE/k9(10160): <<< #null# [16, FETCH, [FLAGS, [\Seen, \Recent]]] 04-16 08:25:54.491: VERBOSE/k9(10160): conn1127686952<<<#null# [16, FETCH, [FLAGS, [\Seen, \Recent]]] 04-16 08:25:54.491: VERBOSE/k9(10160): Got async response: #null# [16, FETCH, [FLAGS, [\Seen, \Recent]]] 04-16 08:25:54.501: DEBUG/k9(10160): Acquired WakeLock for Pushing for thread Thread-24 04-16 08:25:54.501: DEBUG/k9(10160): Got useful async untagged response: #null# [16, FETCH, [FLAGS, [\Seen, \Recent]]] for dantest:MyIncTmp/Thread-24/conn1127686952 04-16 08:25:54.501: VERBOSE/k9(10160): conn1127686952>>> DONE 04-16 08:26:54.571: DEBUG/k9(10160): Acquired WakeLock for Pushing for thread Thread-24 04-16 08:26:54.581: ERROR/k9(10160): Error 'Read timed out' 04-16 08:26:54.581: ERROR/k9(10160): java.net.SocketTimeoutException: Read timed out 04-16 08:27:00.141: VERBOSE/k9(10160): Sending IMAP command NOOP on connection conn1127686952 04-16 08:27:00.141: VERBOSE/k9(10160): conn1127686952>>> 14 NOOP 04-16 08:27:00.141: VERBOSE/k9(10160): Sent IMAP command NOOP with tag 14 for conn1127686952 04-16 08:27:26.651: VERBOSE/k9(10160): conn1127686952<<<#null# [OK, Still, here] LOG 2: successful exit from IDLE after untagged EXISTS 04-16 08:28:35.271: INFO/k9(10160): About to IDLE for dantest:MyIncTmp/Thread-24/conn1126759992 04-16 08:28:35.271: VERBOSE/k9(10160): Sending IMAP command IDLE on connection conn1126759992 04-16 08:28:35.281: VERBOSE/k9(10160): conn1126759992>>> 10 IDLE 04-16 08:28:35.281: VERBOSE/k9(10160): Sent IMAP command IDLE with tag 10 for conn1126759992 04-16 08:28:35.531: VERBOSE/k9(10160): <<< #+# [idling] 04-16 08:28:35.531: VERBOSE/k9(10160): conn1126759992<<<#+# [idling] 04-16 08:28:35.531: VERBOSE/k9(10160): Got async response: #+# [idling] 04-16 08:28:35.531: DEBUG/k9(10160): Idling dantest:MyIncTmp/Thread-24/conn1126759992 04-16 08:28:35.531: DEBUG/k9(10160): Considering releasing WakeLock for Pushing 04-16 08:28:35.531: DEBUG/k9(10160): Releasing WakeLock for Pushing for thread Thread-24 04-16 08:28:51.621: VERBOSE/k9(10160): <<< #null# [18, EXISTS] 04-16 08:28:51.621: VERBOSE/k9(10160): conn1126759992<<<#null# [18, EXISTS] 04-16 08:28:51.621: VERBOSE/k9(10160): Got async response: #null# [18, EXISTS] 04-16 08:28:51.621: DEBUG/k9(10160): Acquired WakeLock for Pushing for thread Thread-24 04-16 08:28:51.631: DEBUG/k9(10160): Got useful async untagged response: #null# [18, EXISTS] for dantest:MyIncTmp/Thread-24/conn1126759992 04-16 08:28:51.631: VERBOSE/k9(10160): conn1126759992>>> DONE 04-16 08:28:51.631: VERBOSE/k9(10160): <<< #null# [1, RECENT] 04-16 08:28:51.631: VERBOSE/k9(10160): conn1126759992<<<#null# [1, RECENT] 04-16 08:28:51.631: VERBOSE/k9(10160): Got async response: #null# [1, RECENT] 04-16 08:28:51.901: VERBOSE/k9(10160): <<< #10# [OK, Idle, completed.] 04-16 08:28:51.901: VERBOSE/k9(10160): conn1126759992<<<#10# [OK, Idle, completed.] 04-16 08:28:51.901: VERBOSE/k9(10160): Got async response: #10# [OK, Idle, completed.]

2 2

[Dovecot] Dovecot 2.0 beta 4 errors reported
by Ken A 16 Apr '10

16 Apr '10

Timo, Thank you for an amazing imap/pop server. I'm using Dovecot 2.0 beta 4 and mbox storage, and have encountered a couple of errors worth reporting: ------ 1. When I delete a parent folder that contains sub folders, I get this error message pop up in Thunderbird 3.04: > "The current command did not succeed. The mail server responded: > [CANNOT] Mailbox GUIDs are not permanent without index files." But, the folders are deleted properly, and no error is logged on the server. I have the mail_log plugin currently enabled like so: > mail_plugins = quota mail_log notify > mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename > mail_log_fields = uid box msgid size ------ 2. segfault reported in the system log (unrelated to the error above): > kernel: pop3[6794]: segfault at 0000000000000028 rip 0000000000403489 > rsp 00007fff20a24a20 error 4 ------ Thanks, Ken -- Ken Anderson Pacific Internet - http://www.pacific.net

2 1

[Dovecot] 2.0.beta4 "OK Still here" not flushed?
by Daniel I. Applebaum 16 Apr '10

16 Apr '10

Hello, everybody! I've noticed that my installation of K-9 Mail on Android has been consuming a lot of battery power recently. I've been running it connecting to 2.0.beta3 for the past few weeks and just upgraded to 2.0.beta4 while debugging this issue. There is a conspicuous lack of "OK Still here" messages in my IDLE connections. The lack of these "OK Still here" messages means that the idling connections get dropped very frequently, which causes K-9 Mail to expend much more effort than just receiving the periodic "OK Still here" and going back to sleep. The "OK Still here" messages sometimes arrive, however, just before an untagged FETCH, however. I do not know anything about dovecot internals, but I suspected that the "OK Still here" messages were not being flushed, so I modified line 270 of src/imap/imap-client.c to be: if (1 || o_stream_get_buffer_used_size(client->output) >= which I am sure is the wrong solution, since it forces a flush for every output line and would be quite inefficient. However, with that modification, the "OK Still here" messages appear reliably. Hopefully, there is a way to specifically flush just the "OK Still here" messages appropriately. I'd be happy to test any real solutions to this issue. Sincerely, Dan.

2 2

[Dovecot] Dovecot 2.0b4 configuration issue, listen config option?
by Brandon Lamb 16 Apr '10

16 Apr '10

Hi, In my 1.2 setup I have pop3 running on ip x.x.x.2 and imap on x.x.x.7 In 2.0 how do I say listen x.x.x.2:110 x.x.x.7:143 so that pop3 is not listening on the .7 ip? I tried putting a listen = ip in the listener section but it complained. I cant figure it out and cant seem to find any 2.0 specific documentation, trying to search in the wiki directory of /usr/local/share/doc/dovecot/wiki but so far no help. I realize I can firewall that off but I dont want to rely on that. Is this no longer possible?

3 9

[Dovecot] Thunderbird subscription bug ?
by Thomas Hummel 16 Apr '10

16 Apr '10

Hello Timo, I'm having a hard time trying to understand why Thunderbird 3.0.3 doesn't allow me to subscribe to a shared mailbox which I can subscribe to via Kmail for instance. I'm running dovecot-1.2.11/Maildir. The user 'doveimap' shares his mailbox folder/subfolder to the 'dovepop' user which should see it in the '#shared' shared namespace at the following "location" : #shared/doveimap/folder/subfolder ACL (and unix permissions) are ok : # cat /courriel/boites/doveimap/.folder.subfolder/dovecot-acl user=dovepop akxeilprwts rawlogs give : a) kmail case : in : 4 NAMESPACE 5 LIST "" "" 6 LSUB "" "%" 7 LIST "" "%" 8 LSUB "" "#shared/%" 9 LIST "" "#shared/%" 10 LIST "" "INBOX" 11 SELECT "INBOX" 12 NOOP 13 UID FETCH 1:* (UID FLAGS) 14 UID FETCH 1:2 (UID RFC822.SIZE FLAGS ENVELOPE BODY.PEEK[HEADER.FIELDS (REFERENCES)]) 15 LIST "" "*" 16 LIST "" "#shared/*" 17 LSUB "" "*" 18 LSUB "" "#shared/*" 19 LIST "" "#shared/doveimap/folder/subfolder" 20 SUBSCRIBE "#shared/doveimap/folder/subfolder" out : * NAMESPACE (("" "/")) (("#shared/" "/")) NIL 4 OK Namespace completed. * LIST (\Noselect) "/" "" 5 OK List completed. 6 OK Lsub completed. * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasChildren) "/" "#shared" 7 OK List completed. 8 OK Lsub completed. * LIST (\Noselect \HasChildren) "/" "#shared/doveimap" 9 OK List completed. * LIST (\HasNoChildren) "/" "INBOX" 10 OK List completed. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 2 EXISTS * 0 RECENT * OK [UIDVALIDITY 1270130617] UIDs valid * OK [UIDNEXT 3] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest 11 OK [READ-WRITE] Select completed. 12 OK NOOP completed. * 1 FETCH (UID 1 FLAGS (\Seen)) * 2 FETCH (UID 2 FLAGS (\Seen)) 13 OK Fetch completed. * 1 FETCH (UID 1 RFC822.SIZE 1140 FLAGS (\Seen) ENVELOPE [...] * 2 FETCH (UID 2 RFC822.SIZE 1138 FLAGS (\Seen) ENVELOPE [...] 14 OK Fetch completed. * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasChildren) "/" "#shared/doveimap" * LIST (\HasNoChildren) "/" "#shared/doveimap/folder/subfolder" 15 OK List completed. * LIST (\Noselect \HasChildren) "/" "#shared/doveimap" * LIST (\HasNoChildren) "/" "#shared/doveimap/folder/subfolder" 16 OK List completed. 17 OK Lsub completed. 18 OK Lsub completed. * LIST (\HasNoChildren) "/" "#shared/doveimap/folder/subfolder" 19 OK List completed. 20 OK Subscribe completed. b) Thunderbird case : in : 4 namespace 5 ENABLE CONDSTORE 6 lsub "" "*" 7 lsub "" "#shared/*" 8 list "" "INBOX" 9 list "" "Trash" 10 create "Trash" 11 select "INBOX" (CONDSTORE) 12 myrights "INBOX" 13 getacl "INBOX" 14 UID fetch 1:* (FLAGS) 15 UID fetch 1:2 (UID RFC822.SIZE FLAGS BODY.PEEK[HEADER.FIELDS (From To Cc Bcc Subject Date Message-ID Priority X-Priority References Newsgroups In-Reply-To Content-Type)]) 16 UID fetch 1,2 (UID RFC822.SIZE BODY.PEEK[]) 17 IDLE DONE 18 lsub "" "*" 19 list "" "%" 20 list "" "%/%" 21 lsub "" "#shared/*" 22 list "" "#shared/%" 23 list "" "#shared/%/%" 24 IDLE DONE 25 list "" "#shared/#shared/%" 26 list "" "#shared/#shared/%/%" 27 IDLE DONE 28 noop 29 IDLE DONE out : * NAMESPACE (("" "/")) (("#shared/" "/")) NIL 4 OK Namespace completed. * ENABLED CONDSTORE 5 OK Enabled. 6 OK Lsub completed. 7 OK Lsub completed. * LIST (\HasNoChildren) "/" "INBOX" 8 OK List completed. * LIST (\HasNoChildren) "/" "Trash" 9 OK List completed. 10 NO [ALREADYEXISTS] Mailbox exists. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 2 EXISTS * 0 RECENT * OK [UIDVALIDITY 1270130617] UIDs valid * OK [UIDNEXT 3] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest 11 OK [READ-WRITE] Select completed. * MYRIGHTS "INBOX" lrwstipekxacd 12 OK Myrights completed. * ACL "INBOX" "dovepop" lrwstipekxacd 13 OK Getacl completed. * 1 FETCH (UID 1 FLAGS (\Seen)) * 2 FETCH (UID 2 FLAGS (\Seen)) 14 OK Fetch completed. * 1 FETCH (UID 1 RFC822.SIZE 1140 FLAGS (\Seen) [...] * 2 FETCH (UID 2 RFC822.SIZE 1138 FLAGS (\Seen) [...] 15 OK Fetch completed. * 1 FETCH (UID 1 RFC822.SIZE 1140 BODY[] [...] * 2 FETCH (UID 2 RFC822.SIZE 1138 BODY[] [...] 16 OK Fetch completed. + idling 17 OK Idle completed. 18 OK Lsub completed. * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasChildren) "/" "#shared" 19 OK List completed. * LIST (\Noselect \HasChildren) "/" "#shared/doveimap" 20 OK List completed. 21 OK Lsub completed. * LIST (\Noselect \HasChildren) "/" "#shared/doveimap" 22 OK List completed. * LIST (\Noselect \HasChildren) "/" "#shared/doveimap/folder" 23 OK List completed. + idling * OK Still here 24 OK Idle completed. 25 OK List completed. 26 OK List completed. + idling 27 OK Idle completed. 28 OK NOOP completed. + idling 29 OK Idle completed. So TB doesn't seem to ask for what's behind #shared/doveimap/folder although the server tells him it has children... As a matter of fact, in the subscribe dialog box in th UI, I see #shared doveimap folder but with no check box alongside My server is configured like this : namespace private { separator = / location = maildir:/courriel/boites/%u:CONTROL=/courriel/meta/%u:INDEX=/var/dovecot-test/indexes/%1u/%u inbox = yes hidden = no list = yes subscriptions = yes } namespace shared { separator = / prefix = "#shared/%%u/" location = maildir:/courriel/boites/%%u:INDEX=/var/dovecot-test/indexes/%1u/%u/shared/%%u subscriptions = no list = children } Is it a bug in TB ? Thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

3 2

[Dovecot] Shared mailboxes unix permissions
by Thomas Hummel 16 Apr '10

16 Apr '10

Hello Timo, I'm running dovecot-1.2.11/Maildir and plan to migrate to single UID mailboxes some day, but for now, I've got "system" users and I'm testing permissions handling in order to set up shared mailboxes. The private namespace mailboxes location is location = maildir:/courriel/boites/%u:CONTROL=/courriel/meta/%u:INDEX=/var/dovecot-test/indexes/%1u/%u I've . created a 'doveshared' unix group . added 'mail_access_groups = doveshared' . chmod/chgrp the maildir and control dirs like this : drwxrws--- 7 doveimap doveshared 4096 Mar 31 18:47 /courriel/boites/doveimap drwxrws--- 5 doveimap doveshared 4096 Mar 31 18:47 /courriel/meta/doveimap [which were empty] . added 'acl_shared_dict = file:/var/dovecot-test/dict/shared-mailboxes' with drwxrwxs-- 2 root doveshared 512 Mar 31 18:44 /var/dovecot-test/dict [which were empty] Everything gets created with the permission I was expecting, except : -rw------- 1 doveimap doveshared 8 Mar 31 18:47 /courriel/meta/doveimap/dovecot-uidvalidity -rw------- 1 doveimap doveshared 0 Mar 31 18:44 /courriel/meta/doveimap/dovecot-uidvalidity.4bb37be4 and -rw------- 1 doveimap doveshared 0 Mar 31 18:44 /var/dovecot-test/dict/shared-mailboxes I can't see the explanation in http://wiki.dovecot.org/SharedMailboxes/Permissions and the 'dovecot-shared' file doesn't help (besides, my understanding is that in 1.2x, it's for backward compatibility reason). Any idea ? Thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

2 3

[Dovecot] "try MD5-CRYPT scheme instead"?
by Ralf Hildebrandt 16 Apr '10

16 Apr '10

I'm getting a lot of entries like this in my log: Apr 16 10:10:18 postamt dovecot: auth(default): shadow(doxxxris,141.42.206.38): CRYPT(wrongpassword) != '$1$qSe71xxx$09MoMqNyll.wPLCdSaFuA0', try MD5-CRYPT scheme instead It seems that changing the password via SquirrelMail (poppasswd) breaks the authentication scheme somewhat. Users cannot log in anymore. -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

2 2

[Dovecot] Error in SimpleVirtualInstall
by Simone Neugierig 16 Apr '10

16 Apr '10

Hi, i still got a little Problem (Thunderbird cant copy my mail to "Gesendet") but besides that i can send and receive mail. ive used: http://wiki.dovecot.org/HowTo/SimpleVirtualInstall there it says that /etc/dovecot/passwd should look like: test:{PLAIN}pass bill:{PLAIN}secret timo@example.com:{PLAIN}hello123 dave@example.com:{PLAIN}world234 joe@elsewhere.org:{PLAIN}whee jane@elsewhere.org:{PLAIN}mypass but the syntax used for test and bill didnt work here, i had to add the virtual domain to get it working. or else deliver wasnt able to recognize the user (unknown user). Can anybody please confirm this? Also i would like to suggest to explicitely say that protocol lda { } is needed even if it contains nothing. or better change the example so that it contains the postmaster address. but the one in the howto just contains .. dovecot probably wont even start with that example. this is dovecot 1.2.11 -- GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT! Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01

2 1

[Dovecot] dovecot2: authcache statistics
by Andreas Schulze 16 Apr '10

16 Apr '10

Hello, setting auth_cache_size to nonzero enables caching of authentication data. The cache hitrate may be logged by sending SIGUSR2 to dovecot/auth process. Is it possible that dovecot logs statistics on regular intervals ? ( like http://www.postfix.org/postconf.5.html#anvil_status_update_time ) Andreas -- Andreas Schulze Internetdienste | P532 DATEV eG 90329 Nürnberg | Telefon +49 911 319-0 | Telefax +49 911 319-3196 E-Mail info @datev.de | Internet www.datev.de Sitz: 90429 Nürnberg, Paumgartnerstr. 6-14 | Registergericht Nürnberg, GenReg Nr.70 Vorstand Prof. Dieter Kempf (Vorsitzender) Dipl.-Kfm. Wolfgang Stegmann (stellvertretender Vorsitzender) Dipl.-Kfm. Michael Leistenschneider Jörg Rabe v. Pappenheim Dipl.-Vw. Eckhard Schwarzer Vorsitzender des Aufsichtsrates: Reinhard Verholen

2 2

[Dovecot] manipulating mails
by Sven 16 Apr '10

16 Apr '10

Hi all, sorry for my inexperience. I am still learning. I searched for a while but found nothing useful. I am looking for the best way to manipulate headers, bodies, attachments, locations, folders and/or flags while using deliver and e.g. perl. In other words manipulating the whole mail in respect of the requirements of the LDA, MUA and User. I see two diffent ways. As i understand I can work via IMAP and pre-auth sessions, which keeps track of the index files from dovecot and handles complications with users already logged in. Can I use e.g. some perl imap module -> download the mail -> change it -> upload it again with all other parameters unchanged and no confusions on the user's side? This way I think its complex to rewrite the mail header/body/attachments as desired and keep everything else, eg times, flags, headers. the goal should be close to invisibility for a user. This maybe leads to open pre-authed sockets/ports and a lot of work. The other way would be to directly modify the file system. This keeps everything (i think), but changes mtime and needs some index file and MUA cache update. For performance reasons I would like to not use the index-automatism of dovecot but do it manualy at runtime of some script. How does the index update gets initialized from the outside? Same for the client cache. Is there some command available or is a IMAP login my workaround? This maybe leads to password problems or open pre-authed sockets/ports. Last question: Is it possible to add some received-tag to a mail-header when appending mails via imap to the mailbox? Can anyone turn my head in the desired direction? Thanks in advance Sven

3 6

[Dovecot] Small dovecot.org downtime
by Timo Sirainen 16 Apr '10

16 Apr '10

dovecot.org gets more memory in a few hours, so it'll be down for a while (maybe max 30 mins?)

1 0

[Dovecot] catch-all not working with postfix dovecot lda
by fakessh 16 Apr '10

16 Apr '10

its tha archive to the cross post to postfix-users help me http://www.mail-archive.com/postfix-users@postfix.org/msg22963.html On Fri, 16 Apr 2010 00:26:25 +0200, fakessh <fakessh(a)fakessh.eu> wrote: On Thu, 15 Apr 2010 08:33:43 -0500, Noel Jones <njones(a)megan.vbhcs.org> wrote: On 4/14/2010 3:42 PM, fakessh wrote: On Wed, 14 Apr 2010 13:50:34 -0500, Noel Jones<njones(a)megan.vbhcs.org> wrote: On 4/14/2010 1:45 PM, fakessh wrote: On Wed, 14 Apr 2010 14:12:25 -0400, Charles Marcus <CMarcus(a)Media-Brokers.com> wrote: I changed the entries @fakessh to root@localhost in /etc/postfix/virtual postmap then a file to the postfix restart. all without success, or rather the same mistake Then post your new "postconf -n", log entries showing the problem, and file contents. my postcon -n [root@r13151 ~]# postconf -n alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases body_checks = regexp:/etc/postfix/body_checks.cf bounce_notice_recipient = postmaster broken_sasl_auth_clients = yes command_directory = /usr/sbin config_directory = /etc/postfix content_filter = dksign:[127.0.0.1]:10028 daemon_directory = /usr/libexec/postfix debug_peer_level = 2 default_privs = nobody double_bounce_sender = no header_checks = regexp:/etc/postfix/header_checks.cf home_mailbox = Maildir/ html_directory = no in_flow_delay = 10 inet_interfaces = all mail_spool_directory = /var/spool/mail mailbox_command = /usr/libexec/dovecot/deliver mailq_path = /usr/bin/mailq.postfix manpage_directory = /usr/share/man maps_rbl_domains = bl.spamcop.net mime_header_checks = regexp:/etc/postfix/mime_header_checks.cf mydestination = $myhostname, localhost.$mydomain mydomain = r13151.ovh.net mynetworks = 127.0.0.0/8 ,87.98.186.232 myorigin = $mydomain newaliases_path = /usr/bin/newaliases.postfix queue_run_delay = 2000s readme_directory = /usr/share/doc/postfix-2.3.3/README_FILES recipient_delimiter = + relay_domains = sample_directory = /usr/share/doc/postfix-2.3.3/samples sendmail_path = /usr/sbin/sendmail.postfix setgid_group = postdrop smtp_sasl_security_options = noanonymous smtp_sasl_tls_security_options = noanonymous smtp_sender_dependent_authentication = yes smtp_tls_loglevel = 3 smtp_tls_session_cache_database = btree:/var/lib/postfix/smtp_tls_session_cache smtpd_banner = $myhostname ESMTP $mail_name ($mail_version) smtpd_client_restrictions = permit_mynetworks,reject_unknown_reverse_client_hostname,reject_unauth_pipelining, reject_non_fqdn_recipient , permit smtpd_milters = inet:[127.0.0.1]:10040 smtpd_recipient_restrictions = permit_mynetworks permit_inet_interfaces permit_sasl_authenticated reject_unverified_recipient reject_non_fqdn_sender reject_non_fqdn_recipient reject_unknown_sender_domain reject_unknown_recipient_domain reject_unknown_reverse_client_hostname reject_unauth_destination reject_unauth_pipelining reject_rbl_client zen.spamhaus.org reject_sender_login_mismatch check_policy_service unix:postgrey/socket check_sender_access hash:/etc/postfix/check_backscatterer check_policy_service unix:private/spfpolicy reject_rbl_client bl.spamcop.net reject_rhsbl_sender dbl.spamhaus.org reject_rbl_client cbl.abuseat.org reject_rbl_client b.barracudacentral.org smtpd_reject_unlisted_sender = no smtpd_sasl_auth_enable = yes smtpd_sasl_authenticated_header = yes smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot smtpd_tls_CAfile = /etc/pki/tls/sub.class4.server.ca.pem smtpd_tls_auth_only = yes smtpd_tls_cert_file = /etc/pki/tls/newcerts/01.pem smtpd_tls_key_file = /etc/pki/tls/private/r13151.ovh.net.key smtpd_tls_received_header = yes smtpd_tls_session_cache_database = btree:/var/lib/postfix/smtpd_tls_session_cache smtpd_use_tls = yes soft_bounce = no tls_random_source = dev:/dev/urandom unknown_local_recipient_reject_code = 550 virtual_alias_domains = fakessh.eu renelacroute.fr nicolaspichot.fr virtual_alias_maps = hash:/etc/postfix/virtual But you already have all the information you need to fix this yourself. Key points are 1) use fully qualified names in virtual_alias_maps. ie. user(a)example1.com user(a)example2.com *not* user(a)example1.com user my jed /etc/postfix/virtual # # AUTHOR(S) # Wietse Venema # IBM T.J. Watson Research # P.O. Box 704 # Yorktown Heights, NY 10598, USA # # VIRTUAL(5$ postmaster(a)fakessh.eu root(a)localhost.r13151.ovh.net fakessh(a)fakessh.eu fakessh(a)localhost.r13151.ovh.net webmail(a)fakessh.eu webmail(a)localhost.r13151.ovh.net serge(a)fakessh.eu serge(a)localhost.r13151.ovh.net @fakessh root(a)localhost.r13151.ovh.net renelacroute(a)renelacroute.fr renelacroute(a)localhost.r13151.ovh.net @renelacroute.fr root(a)localhost.r13151.ovh.net postmaster(a)renelacroute.fr root(a)localhost.r13151.ovh.net nicolaspichot(a)nicolaspichot.fr nicolaspichot(a)localhost.r13151.ovh.net @nicolaspichot.fr root(a)localhost.r13151.ovh.net 2) if you want local delivery of the mail, the new domain must be listed in mydestination. i use local delivery agent [root@r13151 ~]# rpm -qa | grep dovecot dovecot-sieve-devel-0.1.15-4.el5 dovecot-sieve-cmu-1.1.8-11.el5 dovecot-1.2.11-3_108.el5 dovecot-sieve-0.1.15-4.el5 dovecot-managesieve-0.11.11-0_4.el5 [root@r13151 ~]# to atrpms repo Your fix may be as simple as adding "localhost.$mydomain" to mydestination. my hostname is r13151.ovh.net -- Noel Jones my log to correct session Apr 16 00:36:16 r13151 postfix/postfix-script: stopping the Postfix mail system Apr 16 00:36:16 r13151 postfix/master[14544]: terminating on signal 15 Apr 16 00:36:17 r13151 postfix/postfix-script: starting the Postfix mail system Apr 16 00:36:17 r13151 postfix/master[14848]: daemon started -- version 2.3.3, configuration /etc/postfix Apr 16 00:36:31 r13151 postfix/tlsmgr[14861]: open smtp TLS cache btree:/var/lib/postfix/smtp_tls_session_cache Apr 16 00:36:31 r13151 postfix/tlsmgr[14861]: tlsmgr_cache_run_event: start TLS smtp session cache cleanup Apr 16 00:36:31 r13151 postfix/smtpd[14859]: connect from smtp20.orange.fr[80.12.242.26] Apr 16 00:36:31 r13151 postfix/cleanup[14866]: 6617457F6F: message-id=<20100415223631.6617457F6F(a)r13151.ovh.net> Apr 16 00:36:31 r13151 postfix/qmgr[14851]: 6617457F6F: from=<postmaster(a)r13151.ovh.net>, size=260, nrcpt=1 (queue active) Apr 16 00:36:31 r13151 postfix/local[14867]: 6617457F6F: to=<fakessh(a)localhost.r13151.ovh.net>, orig_to=<fakessh(a)fakessh.eu>, relay=local, delay=0.16, delays=0.15/0.01/0/0, dsn=2.0.0, status=deliverable (delivers to command: /usr/libexec/dovecot/deliver) Apr 16 00:36:31 r13151 postfix/qmgr[14851]: 6617457F6F: removed Apr 16 00:36:34 r13151 postgrey[838]: action=pass, reason=client whitelist, client_name=smtp20.orange.fr, client_address=80.12.242.26, sender=john.swilting(a)wanadoo.fr, recipient=fakessh(a)fakessh.eu Apr 16 00:36:34 r13151 postgrey[838]: cleaning up old logs... Apr 16 00:36:35 r13151 postfix/policy-spf[14869]: : SPF none (No applicable sender policy available): Envelope-from: john.swilting(a)wanadoo.fr Apr 16 00:36:35 r13151 postfix/policy-spf[14869]: handler sender_policy_framework: is decisive. Apr 16 00:36:35 r13151 postfix/policy-spf[14869]: : Policy action=PREPEND Received-SPF: none (wanadoo.fr: No applicable sender policy available) receiver=r13151.ovh.net; identity=mailfrom; envelope-from="john.swilting(a)wanadoo.fr"; helo=smtp20.orange.fr; client-ip=80.12.242.26 Apr 16 00:36:35 r13151 postfix/smtpd[14859]: AD73957F6F: client=smtp20.orange.fr[80.12.242.26] Apr 16 00:36:35 r13151 postfix/cleanup[14866]: AD73957F6F: message-id=<1271370966.7979.13.camel(a)localhost.localdomain> Apr 16 00:36:37 r13151 postfix/qmgr[14851]: AD73957F6F: from=<john.swilting(a)wanadoo.fr>, size=1460, nrcpt=1 (queue active) Apr 16 00:36:37 r13151 postfix/smtpd[14859]: disconnect from smtp20.orange.fr[80.12.242.26] Apr 16 00:36:37 r13151 dkimproxy.out[817]: connect from 127.0.0.1 Apr 16 00:36:37 r13151 postfix/smtpd[14874]: connect from localhost.localdomain[127.0.0.1] Apr 16 00:36:37 r13151 postfix/smtp[14873]: discarding EHLO keywords: 8BITMIME STARTTLS Apr 16 00:36:38 r13151 postfix/smtpd[14874]: 30AB357F71: client=smtp20.orange.fr[80.12.242.26] Apr 16 00:36:38 r13151 dkimproxy.out[817]: DKIM signing - skipped; message-id=<1271370966.7979.13.camel(a)localhost.localdomain>, from=<john.swilting(a)wanadoo.fr> Apr 16 00:36:38 r13151 postfix/cleanup[14866]: 30AB357F71: message-id=<1271370966.7979.13.camel(a)localhost.localdomain> Apr 16 00:36:39 r13151 postfix/qmgr[14851]: 30AB357F71: from=<john.swilting(a)wanadoo.fr>, size=1866, nrcpt=1 (queue active) Apr 16 00:36:39 r13151 postfix/smtp[14873]: AD73957F6F: to=<fakessh(a)fakessh.eu>, relay=127.0.0.1[127.0.0.1]:10028, delay=7.9, delays=6.5/0.01/0.3/1.1, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as 30AB357F71) Apr 16 00:36:39 r13151 postfix/smtpd[14874]: disconnect from localhost.localdomain[127.0.0.1] Apr 16 00:36:39 r13151 clamd[7779]: SelfCheck: Database status OK. Apr 16 00:36:39 r13151 postfix/qmgr[14851]: AD73957F6F: removed Apr 16 00:36:40 r13151 postfix/smtpd[14880]: connect from localhost.localdomain[127.0.0.1] Apr 16 00:36:40 r13151 postfix/smtpd[14880]: 6C5AB57F6F: client=localhost.localdomain[127.0.0.1] Apr 16 00:36:40 r13151 postfix/cleanup[14866]: 6C5AB57F6F: message-id=<1271370966.7979.13.camel(a)localhost.localdomain> Apr 16 00:36:40 r13151 postfix/qmgr[14851]: 6C5AB57F6F: from=<john.swilting(a)wanadoo.fr>, size=2728, nrcpt=1 (queue active) Apr 16 00:36:40 r13151 postfix/smtpd[14880]: disconnect from localhost.localdomain[127.0.0.1] Apr 16 00:36:40 r13151 postfix/smtpd[14880]: connect from localhost.localdomain[127.0.0.1] Apr 16 00:36:40 r13151 postfix/smtpd[14880]: A3F4A57F74: client=localhost.localdomain[127.0.0.1] Apr 16 00:36:40 r13151 postfix/cleanup[14866]: A3F4A57F74: message-id=<1271370966.7979.13.camel(a)localhost.localdomain> Apr 16 00:36:40 r13151 postfix/qmgr[14851]: A3F4A57F74: from=<>, size=2240, nrcpt=1 (queue active) Apr 16 00:36:40 r13151 postfix/smtpd[14880]: disconnect from localhost.localdomain[127.0.0.1] Apr 16 00:36:41 r13151 amavis[9551]: (09551-05) Passed CLEAN, [127.0.0.1] [90.55.123.193] <john.swilting(a)wanadoo.fr> -> <fakessh(a)localhost.r13151.ovh.net>, Message-ID: <1271370966.7979.13.camel(a)localhost.localdomain>, mail_id: 2HnPlHlQZ5AT, Hits: 4.791, size: 2046, queued_as: 6C5AB57F6F, 1723 ms Apr 16 00:36:41 r13151 postfix/lmtp[14876]: 30AB357F71: to=<fakessh(a)localhost.r13151.ovh.net>, orig_to=<fakessh(a)fakessh.eu>, relay=127.0.0.1[127.0.0.1]:10024, delay=2.8, delays=1.1/0.01/0.01/1.7, dsn=2.0.0, status=sent (250 2.0.0 Ok, id=09551-05, from MTA([127.0.0.1]:10025): 250 2.0.0 Ok: queued as 6C5AB57F6F) Apr 16 00:36:41 r13151 postfix/qmgr[14851]: 30AB357F71: removed Apr 16 00:36:41 r13151 dovecot: deliver(fakessh): msgid=<1271370966.7979.13.camel(a)localhost.localdomain>: saved mail to INBOX Apr 16 00:36:41 r13151 postfix/local[14867]: 6C5AB57F6F: to=<fakessh(a)localhost.r13151.ovh.net>, relay=local, delay=0.93, delays=0.22/0/0/0.71, dsn=2.0.0, status=sent (delivered to command: /usr/libexec/dovecot/deliver) Apr 16 00:36:41 r13151 postfix/qmgr[14851]: 6C5AB57F6F: removed Apr 16 00:36:41 r13151 dovecot: deliver(root): msgid=<1271370966.7979.13.camel(a)localhost.localdomain>: saved mail to INBOX Apr 16 00:36:41 r13151 postfix/local[14886]: A3F4A57F74: to=<root(a)r13151.ovh.net>, orig_to=<postmaster(a)r13151.ovh.net>, relay=local, delay=0.99, delays=0.29/0.01/0/0.68, dsn=2.0.0, status=sent (delivered to command: /usr/libexec/dovecot/deliver) Apr 16 00:36:41 r13151 postfix/qmgr[14851]: A3F4A57F74: removed my error log to tentative a catch-all Apr 16 00:38:28 r13151 dovecot: IMAP(fakessh): Disconnected: Logged out bytes=329/7731 Apr 16 00:39:37 r13151 dovecot: dovecot: Killed with signal 15 (by pid=15053 uid=0 code=kill) Apr 16 00:39:38 r13151 dovecot: Dovecot v1.2.11 starting up (core dumps disabled) Apr 16 00:39:40 r13151 postfix/postfix-script: stopping the Postfix mail system Apr 16 00:39:40 r13151 postfix/master[14848]: terminating on signal 15 Apr 16 00:39:42 r13151 postfix/postfix-script: starting the Postfix mail system Apr 16 00:39:42 r13151 postfix/master[15149]: daemon started -- version 2.3.3, configuration /etc/postfix Apr 16 00:39:52 r13151 postfix/tlsmgr[15162]: open smtp TLS cache btree:/var/lib/postfix/smtp_tls_session_cache Apr 16 00:39:52 r13151 postfix/tlsmgr[15162]: tlsmgr_cache_run_event: start TLS smtp session cache cleanup Apr 16 00:39:52 r13151 postfix/smtpd[15160]: connect from smtp28.orange.fr[80.12.242.101] Apr 16 00:39:52 r13151 postfix/cleanup[15167]: B8F9157F6F: message-id=<20100415223952.B8F9157F6F(a)r13151.ovh.net> Apr 16 00:39:52 r13151 postfix/qmgr[15152]: B8F9157F6F: from=<postmaster(a)r13151.ovh.net>, size=260, nrcpt=1 (queue active) Apr 16 00:39:52 r13151 postfix/error[15168]: B8F9157F6F: to=<catch(a)fakessh.eu>, relay=none, delay=0.17, delays=0.15/0.01/0/0, dsn=5.0.0, status=undeliverable (User unknown in virtual alias table) Apr 16 00:39:52 r13151 postfix/qmgr[15152]: B8F9157F6F: removed Apr 16 00:39:55 r13151 postfix/smtpd[15160]: NOQUEUE: reject: RCPT from smtp28.orange.fr[80.12.242.101]: 450 4.1.1 <catch(a)fakessh.eu>: Recipient address rejected: undeliverable address: User unknown in virtual alias table; from=<john.swilting(a)wanadoo.fr> to=<catch(a)fakessh.eu> proto=ESMTP helo=<smtp28.orange.fr> Apr 16 00:39:55 r13151 postfix/smtpd[15160]: disconnect from smtp28.orange.fr[80.12.242.101] Apr 16 00:40:15 r13151 postfix/smtpd[15160]: connect from smtp28.orange.fr[80.12.242.101] Apr 16 00:40:15 r13151 postfix/smtpd[15160]: NOQUEUE: reject: RCPT from smtp28.orange.fr[80.12.242.101]: 450 4.1.1 <catch(a)fakessh.eu>: Recipient address rejected: undeliverable address: User unknown in virtual alias table; from=<john.swilting(a)wanadoo.fr> to=<catch(a)fakessh.eu> proto=ESMTP helo=<smtp28.orange.fr> Apr 16 00:40:15 r13151 postfix/smtpd[15160]: disconnect from smtp28.orange.fr[80.12.242.101]

3 5

[Dovecot] Fwd: Re: catch-all not working with postfix dovecot lda (fwd)
by fakessh 16 Apr '10

16 Apr '10

it may be a problem in dealing with amavisd perl milter Subject: Re: [Dovecot] catch-all not working with postfix dovecot lda On Fri, 16 Apr 2010 09:07:55 +1000, Noel Butler <noel.butler(a)ausics.net> wrote: > Postfix must first "know the user(s)" > therefore this isa postfix issue and not dovecot > dovecot deliver assumes the MTA has verified the user to accept mail > from and does not do further authentication > > how to build a catch-all with dovecot lda the question then. is not a postfix issue > On Fri, 2010-04-16 at 01:00 +0200, fakessh wrote: > >> its tha archive to the cross post to postfix-users >> help me >> >> http://www.mail-archive.com/postfix-users@postfix.org/msg22963.html >> >> >> >> On Fri, 16 Apr 2010 00:26:25 +0200, fakessh <fakessh(a)fakessh.eu> wrote: >> >> On Thu, 15 Apr 2010 08:33:43 -0500, Noel Jones >> <njones(a)megan.vbhcs.org> wrote: >> >> On 4/14/2010 3:42 PM, fakessh wrote: >> >> On Wed, 14 Apr 2010 13:50:34 -0500, Noel >> Jones<njones(a)megan.vbhcs.org> wrote: >> >> On 4/14/2010 1:45 PM, fakessh wrote: >> >> On Wed, 14 Apr 2010 14:12:25 -0400, Charles Marcus >> <CMarcus(a)Media-Brokers.com> wrote: >> >> I changed the entries @fakessh to root@localhost in >> >> /etc/postfix/virtual >> >> postmap then a file to the postfix restart. all without >> success, or rather the same mistake >> >> Then post your new "postconf -n", log entries showing the >> problem, >> and file contents. >> >> my postcon -n [root@r13151 ~]# postconf -n alias_database = >> hash:/etc/aliases alias_maps = hash:/etc/aliases body_checks = >> regexp:/etc/postfix/body_checks.cf bounce_notice_recipient = postmaster >> broken_sasl_auth_clients = yes command_directory = /usr/sbin >> config_directory = /etc/postfix content_filter = dksign:[127.0.0.1]:10028 >> daemon_directory = /usr/libexec/postfix debug_peer_level = 2 >> default_privs >> = nobody double_bounce_sender = no header_checks = >> regexp:/etc/postfix/header_checks.cf home_mailbox = Maildir/ >> html_directory >> = no in_flow_delay = 10 inet_interfaces = all mail_spool_directory = >> /var/spool/mail mailbox_command = /usr/libexec/dovecot/deliver >> mailq_path = >> /usr/bin/mailq.postfix manpage_directory = /usr/share/man >> maps_rbl_domains >> = bl.spamcop.net mime_header_checks = >> regexp:/etc/postfix/mime_header_checks.cf mydestination = $myhostname, >> localhost.$mydomain mydomain = r13151.ovh.net mynetworks = 127.0.0.0/8 >> ,87.98.186.232 myorigin = $mydomain newaliases_path = >> /usr/bin/newaliases.postfix queue_run_delay = 2000s readme_directory = >> /usr/share/doc/postfix-2.3.3/README_FILES recipient_delimiter = + >> relay_domains = sample_directory = /usr/share/doc/postfix-2.3.3/samples >> sendmail_path = /usr/sbin/sendmail.postfix setgid_group = postdrop >> smtp_sasl_security_options = noanonymous smtp_sasl_tls_security_options = >> noanonymous smtp_sender_dependent_authentication = yes smtp_tls_loglevel >> = >> 3 smtp_tls_session_cache_database = >> btree:/var/lib/postfix/smtp_tls_session_cache smtpd_banner = $myhostname >> ESMTP $mail_name ($mail_version) smtpd_client_restrictions = >> >> permit_mynetworks,reject_unknown_reverse_client_hostname,reject_unauth_pipelining, >> >> reject_non_fqdn_recipient , permit smtpd_milters = >> inet:[127.0.0.1]:10040 smtpd_recipient_restrictions = permit_mynetworks >> permit_inet_interfaces permit_sasl_authenticated >> reject_unverified_recipient reject_non_fqdn_sender >> reject_non_fqdn_recipient reject_unknown_sender_domain >> reject_unknown_recipient_domain reject_unknown_reverse_client_hostname >> reject_unauth_destination reject_unauth_pipelining reject_rbl_client >> zen.spamhaus.org reject_sender_login_mismatch check_policy_service >> unix:postgrey/socket check_sender_access >> hash:/etc/postfix/check_backscatterer check_policy_service >> unix:private/spfpolicy reject_rbl_client bl.spamcop.net >> reject_rhsbl_sender >> dbl.spamhaus.org reject_rbl_client cbl.abuseat.org reject_rbl_client >> b.barracudacentral.org smtpd_reject_unlisted_sender = no >> smtpd_sasl_auth_enable = yes smtpd_sasl_authenticated_header = yes >> smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = private/auth >> smtpd_sasl_type = dovecot smtpd_tls_CAfile = >> /etc/pki/tls/sub.class4.server.ca.pem smtpd_tls_auth_only = yes >> smtpd_tls_cert_file = /etc/pki/tls/newcerts/01.pem smtpd_tls_key_file = >> /etc/pki/tls/private/r13151.ovh.net.key smtpd_tls_received_header = yes >> smtpd_tls_session_cache_database = >> btree:/var/lib/postfix/smtpd_tls_session_cache smtpd_use_tls = yes >> soft_bounce = no tls_random_source = dev:/dev/urandom >> unknown_local_recipient_reject_code = 550 virtual_alias_domains = >> fakessh.eu renelacroute.fr nicolaspichot.fr virtual_alias_maps = >> hash:/etc/postfix/virtual >> >> But you already have all the information you need to fix this >> yourself. Key points are 1) use fully qualified names in >> virtual_alias_maps. ie. user(a)example1.com user(a)example2.com *not* >> user(a)example1.com user >> >> my jed /etc/postfix/virtual # # AUTHOR(S) # Wietse Venema # IBM T.J. >> Watson Research # P.O. Box 704 # Yorktown Heights, NY 10598, USA # # >> VIRTUAL(5$ postmaster(a)fakessh.eu root(a)localhost.r13151.ovh.net >> fakessh(a)fakessh.eu fakessh(a)localhost.r13151.ovh.net webmail(a)fakessh.eu >> webmail(a)localhost.r13151.ovh.net serge(a)fakessh.eu >> serge(a)localhost.r13151.ovh.net @fakessh root(a)localhost.r13151.ovh.net >> renelacroute(a)renelacroute.fr renelacroute(a)localhost.r13151.ovh.net >> @renelacroute.fr root(a)localhost.r13151.ovh.net postmaster(a)renelacroute.fr >> root(a)localhost.r13151.ovh.net nicolaspichot(a)nicolaspichot.fr >> nicolaspichot(a)localhost.r13151.ovh.net @nicolaspichot.fr >> root(a)localhost.r13151.ovh.net >> >> 2) if you want local delivery of the mail, the new domain must be >> listed in mydestination. >> >> i use local delivery agent [root@r13151 ~]# rpm -qa | grep dovecot >> dovecot-sieve-devel-0.1.15-4.el5 dovecot-sieve-cmu-1.1.8-11.el5 >> dovecot-1.2.11-3_108.el5 dovecot-sieve-0.1.15-4.el5 >> dovecot-managesieve-0.11.11-0_4.el5 [root@r13151 ~]# to atrpms repo >> >> Your fix may be as simple as adding "localhost.$mydomain" to >> mydestination. >> >> my hostname is r13151.ovh.net >> >> -- Noel Jones >> >> >> >> my log to correct session >> >> Apr 16 00:36:16 r13151 postfix/postfix-script: stopping the Postfix mail >> system >> Apr 16 00:36:16 r13151 postfix/master[14544]: terminating on signal 15 >> Apr 16 00:36:17 r13151 postfix/postfix-script: starting the Postfix mail >> system >> Apr 16 00:36:17 r13151 postfix/master[14848]: daemon started -- version >> 2.3.3, configuration /etc/postfix >> Apr 16 00:36:31 r13151 postfix/tlsmgr[14861]: open smtp TLS cache >> btree:/var/lib/postfix/smtp_tls_session_cache >> Apr 16 00:36:31 r13151 postfix/tlsmgr[14861]: tlsmgr_cache_run_event: >> start TLS smtp session cache cleanup >> Apr 16 00:36:31 r13151 postfix/smtpd[14859]: connect from >> smtp20.orange.fr[80.12.242.26] >> Apr 16 00:36:31 r13151 postfix/cleanup[14866]: 6617457F6F: >> message-id=<20100415223631.6617457F6F(a)r13151.ovh.net> >> Apr 16 00:36:31 r13151 postfix/qmgr[14851]: 6617457F6F: >> from=<postmaster(a)r13151.ovh.net>, size=260, nrcpt=1 (queue active) >> Apr 16 00:36:31 r13151 postfix/local[14867]: 6617457F6F: >> to=<fakessh(a)localhost.r13151.ovh.net>, orig_to=<fakessh(a)fakessh.eu>, >> relay=local, delay=0.16, delays=0.15/0.01/0/0, dsn=2.0.0, >> status=deliverable (delivers to command: /usr/libexec/dovecot/deliver) >> Apr 16 00:36:31 r13151 postfix/qmgr[14851]: 6617457F6F: removed >> Apr 16 00:36:34 r13151 postgrey[838]: action=pass, reason=client >> whitelist, client_name=smtp20.orange.fr, client_address=80.12.242.26, >> sender=john.swilting(a)wanadoo.fr, recipient=fakessh(a)fakessh.eu >> Apr 16 00:36:34 r13151 postgrey[838]: cleaning up old logs... >> Apr 16 00:36:35 r13151 postfix/policy-spf[14869]: : SPF none (No >> applicable sender policy available): Envelope-from: >> john.swilting(a)wanadoo.fr >> Apr 16 00:36:35 r13151 postfix/policy-spf[14869]: handler >> sender_policy_framework: is decisive. >> Apr 16 00:36:35 r13151 postfix/policy-spf[14869]: : Policy action=PREPEND >> Received-SPF: none (wanadoo.fr: No applicable sender policy available) >> receiver=r13151.ovh.net; identity=mailfrom; >> envelope-from="john.swilting(a)wanadoo.fr"; helo=smtp20.orange.fr; >> client-ip=80.12.242.26 >> Apr 16 00:36:35 r13151 postfix/smtpd[14859]: AD73957F6F: >> client=smtp20.orange.fr[80.12.242.26] >> Apr 16 00:36:35 r13151 postfix/cleanup[14866]: AD73957F6F: >> message-id=<1271370966.7979.13.camel(a)localhost.localdomain> >> Apr 16 00:36:37 r13151 postfix/qmgr[14851]: AD73957F6F: >> from=<john.swilting(a)wanadoo.fr>, size=1460, nrcpt=1 (queue active) >> Apr 16 00:36:37 r13151 postfix/smtpd[14859]: disconnect from >> smtp20.orange.fr[80.12.242.26] >> Apr 16 00:36:37 r13151 dkimproxy.out[817]: connect from 127.0.0.1 >> Apr 16 00:36:37 r13151 postfix/smtpd[14874]: connect from >> localhost.localdomain[127.0.0.1] >> Apr 16 00:36:37 r13151 postfix/smtp[14873]: discarding EHLO keywords: >> 8BITMIME STARTTLS >> Apr 16 00:36:38 r13151 postfix/smtpd[14874]: 30AB357F71: >> client=smtp20.orange.fr[80.12.242.26] >> Apr 16 00:36:38 r13151 dkimproxy.out[817]: DKIM signing - skipped; >> message-id=<1271370966.7979.13.camel(a)localhost.localdomain>, >> from=<john.swilting(a)wanadoo.fr> >> Apr 16 00:36:38 r13151 postfix/cleanup[14866]: 30AB357F71: >> message-id=<1271370966.7979.13.camel(a)localhost.localdomain> >> Apr 16 00:36:39 r13151 postfix/qmgr[14851]: 30AB357F71: >> from=<john.swilting(a)wanadoo.fr>, size=1866, nrcpt=1 (queue active) >> Apr 16 00:36:39 r13151 postfix/smtp[14873]: AD73957F6F: >> to=<fakessh(a)fakessh.eu>, relay=127.0.0.1[127.0.0.1]:10028, delay=7.9, >> delays=6.5/0.01/0.3/1.1, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as >> 30AB357F71) >> Apr 16 00:36:39 r13151 postfix/smtpd[14874]: disconnect from >> localhost.localdomain[127.0.0.1] >> Apr 16 00:36:39 r13151 clamd[7779]: SelfCheck: Database status OK. >> Apr 16 00:36:39 r13151 postfix/qmgr[14851]: AD73957F6F: removed >> Apr 16 00:36:40 r13151 postfix/smtpd[14880]: connect from >> localhost.localdomain[127.0.0.1] >> Apr 16 00:36:40 r13151 postfix/smtpd[14880]: 6C5AB57F6F: >> client=localhost.localdomain[127.0.0.1] >> Apr 16 00:36:40 r13151 postfix/cleanup[14866]: 6C5AB57F6F: >> message-id=<1271370966.7979.13.camel(a)localhost.localdomain> >> Apr 16 00:36:40 r13151 postfix/qmgr[14851]: 6C5AB57F6F: >> from=<john.swilting(a)wanadoo.fr>, size=2728, nrcpt=1 (queue active) >> Apr 16 00:36:40 r13151 postfix/smtpd[14880]: disconnect from >> localhost.localdomain[127.0.0.1] >> Apr 16 00:36:40 r13151 postfix/smtpd[14880]: connect from >> localhost.localdomain[127.0.0.1] >> Apr 16 00:36:40 r13151 postfix/smtpd[14880]: A3F4A57F74: >> client=localhost.localdomain[127.0.0.1] >> Apr 16 00:36:40 r13151 postfix/cleanup[14866]: A3F4A57F74: >> message-id=<1271370966.7979.13.camel(a)localhost.localdomain> >> Apr 16 00:36:40 r13151 postfix/qmgr[14851]: A3F4A57F74: from=<>, >> size=2240, nrcpt=1 (queue active) >> Apr 16 00:36:40 r13151 postfix/smtpd[14880]: disconnect from >> localhost.localdomain[127.0.0.1] >> Apr 16 00:36:41 r13151 amavis[9551]: (09551-05) Passed CLEAN, [127.0.0.1] >> [90.55.123.193] <john.swilting(a)wanadoo.fr> -> >> <fakessh(a)localhost.r13151.ovh.net>, Message-ID: >> <1271370966.7979.13.camel(a)localhost.localdomain>, mail_id: 2HnPlHlQZ5AT, >> Hits: 4.791, size: 2046, queued_as: 6C5AB57F6F, 1723 ms >> Apr 16 00:36:41 r13151 postfix/lmtp[14876]: 30AB357F71: >> to=<fakessh(a)localhost.r13151.ovh.net>, orig_to=<fakessh(a)fakessh.eu>, >> relay=127.0.0.1[127.0.0.1]:10024, delay=2.8, delays=1.1/0.01/0.01/1.7, >> dsn=2.0.0, status=sent (250 2.0.0 Ok, id=09551-05, from >> MTA([127.0.0.1]:10025): 250 2.0.0 Ok: queued as 6C5AB57F6F) >> Apr 16 00:36:41 r13151 postfix/qmgr[14851]: 30AB357F71: removed >> Apr 16 00:36:41 r13151 dovecot: deliver(fakessh): >> msgid=<1271370966.7979.13.camel(a)localhost.localdomain>: saved mail to >> INBOX >> Apr 16 00:36:41 r13151 postfix/local[14867]: 6C5AB57F6F: >> to=<fakessh(a)localhost.r13151.ovh.net>, relay=local, delay=0.93, >> delays=0.22/0/0/0.71, dsn=2.0.0, status=sent (delivered to command: >> /usr/libexec/dovecot/deliver) >> Apr 16 00:36:41 r13151 postfix/qmgr[14851]: 6C5AB57F6F: removed >> Apr 16 00:36:41 r13151 dovecot: deliver(root): >> msgid=<1271370966.7979.13.camel(a)localhost.localdomain>: saved mail to >> INBOX >> Apr 16 00:36:41 r13151 postfix/local[14886]: A3F4A57F74: >> to=<root(a)r13151.ovh.net>, orig_to=<postmaster(a)r13151.ovh.net>, >> relay=local, >> delay=0.99, delays=0.29/0.01/0/0.68, dsn=2.0.0, status=sent (delivered to >> command: /usr/libexec/dovecot/deliver) >> Apr 16 00:36:41 r13151 postfix/qmgr[14851]: A3F4A57F74: removed >> >> >> my error log to tentative a catch-all >> >> Apr 16 00:38:28 r13151 dovecot: IMAP(fakessh): Disconnected: Logged out >> bytes=329/7731 >> Apr 16 00:39:37 r13151 dovecot: dovecot: Killed with signal 15 (by >> pid=15053 uid=0 code=kill) >> Apr 16 00:39:38 r13151 dovecot: Dovecot v1.2.11 starting up (core dumps >> disabled) >> Apr 16 00:39:40 r13151 postfix/postfix-script: stopping the Postfix mail >> system >> Apr 16 00:39:40 r13151 postfix/master[14848]: terminating on signal 15 >> Apr 16 00:39:42 r13151 postfix/postfix-script: starting the Postfix mail >> system >> Apr 16 00:39:42 r13151 postfix/master[15149]: daemon started -- version >> 2.3.3, configuration /etc/postfix >> Apr 16 00:39:52 r13151 postfix/tlsmgr[15162]: open smtp TLS cache >> btree:/var/lib/postfix/smtp_tls_session_cache >> Apr 16 00:39:52 r13151 postfix/tlsmgr[15162]: tlsmgr_cache_run_event: >> start TLS smtp session cache cleanup >> Apr 16 00:39:52 r13151 postfix/smtpd[15160]: connect from >> smtp28.orange.fr[80.12.242.101] >> Apr 16 00:39:52 r13151 postfix/cleanup[15167]: B8F9157F6F: >> message-id=<20100415223952.B8F9157F6F(a)r13151.ovh.net> >> Apr 16 00:39:52 r13151 postfix/qmgr[15152]: B8F9157F6F: >> from=<postmaster(a)r13151.ovh.net>, size=260, nrcpt=1 (queue active) >> Apr 16 00:39:52 r13151 postfix/error[15168]: B8F9157F6F: >> to=<catch(a)fakessh.eu>, relay=none, delay=0.17, delays=0.15/0.01/0/0, >> dsn=5.0.0, status=undeliverable (User unknown in virtual alias table) >> Apr 16 00:39:52 r13151 postfix/qmgr[15152]: B8F9157F6F: removed >> Apr 16 00:39:55 r13151 postfix/smtpd[15160]: NOQUEUE: reject: RCPT from >> smtp28.orange.fr[80.12.242.101]: 450 4.1.1 <catch(a)fakessh.eu>: Recipient >> address rejected: undeliverable address: User unknown in virtual alias >> table; from=<john.swilting(a)wanadoo.fr> to=<catch(a)fakessh.eu> proto=ESMTP >> helo=<smtp28.orange.fr> >> Apr 16 00:39:55 r13151 postfix/smtpd[15160]: disconnect from >> smtp28.orange.fr[80.12.242.101] >> Apr 16 00:40:15 r13151 postfix/smtpd[15160]: connect from >> smtp28.orange.fr[80.12.242.101] >> Apr 16 00:40:15 r13151 postfix/smtpd[15160]: NOQUEUE: reject: RCPT from >> smtp28.orange.fr[80.12.242.101]: 450 4.1.1 <catch(a)fakessh.eu>: Recipient >> address rejected: undeliverable address: User unknown in virtual alias >> table; from=<john.swilting(a)wanadoo.fr> to=<catch(a)fakessh.eu> proto=ESMTP >> helo=<smtp28.orange.fr> >> Apr 16 00:40:15 r13151 postfix/smtpd[15160]: disconnect from >> smtp28.orange.fr[80.12.242.101] >> >> >> >>

1 0

[Dovecot] version 1.2.11 creating symlink loop for config file
by Adrian Pepper 15 Apr '10

15 Apr '10

What is the following at the end of "main_init" in dovecot 1.2.11 (src/master/main.c) intended to accomplish? base_config_path = t_strconcat(settings_root->defaults->base_dir, "/"PACKAGE".conf", NULL); (void)unlink(base_config_path); if (symlink(configfile, base_config_path) < 0) { i_error("symlink(%s, %s) failed: %m", configfile, base_config_path); } } With our compilation parameters and runtime setup it ends up removing the working base_config_path file and making it instead a symlink to itself. (I.e. a non-working loop). Strangely, the one instance of dovecot continues and seems to mostly work. But (for now) I need to put back the proper dovecot.conf before I can restart it. I think that would be the expected result if strcmp(configfile, base_config_path) == 0. Is that in fact not expected to be the case? (See my initial question). I did not expect self-modifying of configuration like this. (See my initial question). Pattern matches (e.g. "config_path") find no apparent mention of this in recent postings. Adrian Pepper Computer Science Computing Facility David R. Cheriton School of Computer Science University of Waterloo arpepper(a)uwaterloo.ca ========================================================================= After the bug has happened... services110.cs# servers/dovecot -n # 1.2.11: /software/imap-dovecot-1.2/data/etc/dovecot/dovecot.conf Error: Can't open configuration file /software/imap-dovecot-1.2/data/etc/dovecot/dovecot.conf: Number of symbolic links encountered during path name traversal exceeds MAXSYMLINKS Fatal: Invalid configuration in /software/imap-dovecot-1.2/data/etc/dovecot/dovecot.conf services110.cs# services110.cs# servers/dovecot -n # 1.2.11: /software/imap-dovecot-1.2/data/etc/dovecot/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 768). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: SunOS 5.8 sun4u base_dir: /software/imap-dovecot-1.2/data/etc/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /software/sslCerts/config/certs/dovecot.pem ssl_key_file: /software/sslCerts/config/certs/private/dovecot.key disable_plaintext_auth: no login_dir: /software/imap-dovecot-1.2/data/etc/dovecot/home/ login_executable(default): /software/imap-dovecot-1.2/libexec/dovecot/imap-login login_executable(imap): /software/imap-dovecot-1.2/libexec/dovecot/imap-login login_executable(pop3): /software/imap-dovecot-1.2/libexec/dovecot/pop3-login first_valid_uid: 100 last_valid_uid: 65535 first_valid_gid: 100 last_valid_gid: 65535 mail_location: mbox:~:INDEX=~/.imap:INBOX=/var/mail/%u mmap_disable: yes dotlock_use_excl: no mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /software/imap-dovecot-1.2/libexec/dovecot/imap mail_executable(imap): /software/imap-dovecot-1.2/libexec/dovecot/imap mail_executable(pop3): /software/imap-dovecot-1.2/libexec/dovecot/pop3 mail_plugin_dir(default): /software/imap-dovecot-1.2/lib/dovecot/imap mail_plugin_dir(imap): /software/imap-dovecot-1.2/lib/dovecot/imap mail_plugin_dir(pop3): /software/imap-dovecot-1.2/lib/dovecot/pop3 namespace: type: private separator: / prefix: maildir_mail/ location: maildir:~/.maildir list: yes subscriptions: yes namespace: type: private separator: / location: mbox:~/.:INBOX=/var/mail/%u:INDEX=~/.imap1 inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: mail/ location: mbox:~/mail:INDEX=~/.imap2 list: yes subscriptions: yes lda: postmaster_address: postmaster(a)cs.uwaterloo.ca hostname: cs.uwaterloo.ca auth default: verbose: yes debug: yes passdb: driver: passwd-file args: /etc/shadow userdb: driver: passwd args: blocking=yes services110.cs# This is not a production setup; some/most configuration is experimental or speculative. "dovecot -n" does not appear to remove the config file.

4 3

[Dovecot] imap login fails with "no auth attempts"
by Niels Richter 15 Apr '10

15 Apr '10

Hi, I'm currently facing a strange behaviour of dovecot 1.2.10 (and before): after some days the login into our mail servers stops working for imap-connections. pop3-users can go on with using dovecot. Looking into the logfile I can only find: [...] imap-login: Disconnected (no auth attempts) imap-login: Disconnected: Shutting down (no auth attempts) [...] as a hint what is maybe happening. After restarting the system is working quite well again for some time. There is no extra load and not other special at the server running. The authentication is handled over mysql. This is our dovecot -n output (relevant parts): # 1.2.10: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.2-STABLE i386 ufs protocols: imaps pop3s pop3 imap ssl_ca_file: /usr/local/etc/ssl/... ssl_cert_file: /usr/local/etc/ssl/... ssl_key_file: /usr/local/etc/ssl/... disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(pop3): 10 verbose_proctitle: yes first_valid_gid: 0 mail_access_groups: mail mail_privileged_group: mail mail_location: maildir:/usr/... mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_process_size: 512 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): namespace: type: private prefix: INBOX. inbox: yes list: yes subscriptions: yes Do you see anything which is unclear or unnecessary and could lead to a crash of the imap-login process after some time? Thanks for your help! -- Niels.

2 1

[Dovecot] Any secret dovecot 2.0 lda configuration documentation anywhere? =)
by Brandon Lamb 15 Apr '10

15 Apr '10

I successfully got imap/pop3 working using 2.0b4, now im trying to also get lda working with exim but im totally confused. I dont know what should run as what user, getting confused on auth sockets, what to call them or set or whatever. My exim runs as user/group mail/mail, dovecot has user dovecot but user mail for mail_user/group settings. At one point running deliver -d user -f user gave me an error userdb lookup not possible with only userdb prefetch. Here is my config at this particular point in time, probably will be hacked up again in a few seconds =P # 2.0.beta4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-3-amd64 x86_64 Debian squeeze/sid auth_cache_negative_ttl = 3600 s auth_cache_size = 4096 auth_debug = yes auth_debug_passwords = yes auth_default_realm = olypen.com auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %Lu auth_worker_max_count = 60 base_dir = /var/run/dovecot debug_log_path = /var/log/dovecot/debug.log default_vsz_limit = 536870912 deliver_log_format = %s from %f %$ disable_plaintext_auth = no dotlock_use_excl = yes first_valid_gid = 8 first_valid_uid = 8 fsync_disable = yes info_log_path = /var/log/dovecot/info.log last_valid_gid = 8 last_valid_uid = 8 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot/dovecot.log log_timestamp = %Y-%m-%d %H:%M:%S login_log_format = %s login_log_format_elements = (%u) (%r) mail_access_groups = mail mail_debug = yes mail_gid = 8 mail_location = maildir:~/:INDEX=~/dovecot-index mail_log_prefix = %Ls <%u>: mail_plugins = quota mail_privileged_group = mail mail_uid = 8 mailbox_idle_check_interval = 60 s namespace { hidden = yes inbox = yes list = yes location = maildir:%h/:INDEX=~/dovecot-index prefix = separator = / type = private } namespace { hidden = yes list = no location = virtual:/etc/dovecot/virtual:INDEX=~/dovecot-index prefix = virtual/ separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autocreate = Trash autocreate2 = Spam autocreate3 = Sent autocreate4 = Drafts quota = maildir quota_rule2 = Trash:ignore quota_rule3 = Deleted Items:ignore quota_rule4 = Spam:ignore quota_warning = storage=95%% /etc/dovecot/quota-warning.sh 95 quota_warning2 = storage=80%% /etc/dovecot/quota-warning.sh 80 } postmaster_address = postmaster(a)olypen.com protocols = imap pop3 quota_full_tempfail = yes rejection_reason = Your message to <%t> with subject of <%s> was automatically rejected:%n%r rejection_subject = Mailbox Full: %s sendmail_path = /usr/sbin/exim service auth { unix_listener /var/spool/exim/auth-userdb { group = mail mode = 0666 user = } } service imap-login { inet_listener imap { port = 143 } process_min_avail = 5 service_count = 0 vsz_limit = 134217728 } service imap { process_limit = 1024 vsz_limit = 1073741824 } service pop3-login { inet_listener pop3 { port = 110 } process_min_avail = 5 service_count = 0 vsz_limit = 134217728 } service pop3 { process_limit = 1024 vsz_limit = 1073741824 } ssl = no userdb { driver = prefetch } valid_chroot_dirs = /mail verbose_proctitle = yes protocol pop3 { mail_max_userip_connections = 1 mail_plugins = $mail_plugins virtual pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_enable_last = no pop3_lock_session = no pop3_logout_format = retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = yes pop3_reuse_xuidl = no pop3_save_uidl = yes pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = auth-master info_log_path = /var/log/dovecot/deliver.log log_path = /var/log/dovecot/deliver.log mail_plugins = quota } protocol imap { imap_client_workarounds = delay-newmail netscape-eoh tb-extra-mailbox-sep imap_idle_notify_interval = 120 s imap_logout_format = bytes=%i/%o imap_max_line_length = 65536 mail_max_userip_connections = 15 mail_plugins = $mail_plugins imap_quota autocreate virtual }

1 0

[Dovecot] pigeonhole: naming and versioning
by Axel Thimm 14 Apr '10

14 Apr '10

Hi Stephan, many thanks for all the work you do on the new sieve parts to dovecot. As a (downstream) packager I have some questions: a) pigeonhole is called a working title - will the final release be called something else like dovecot-sieve again? b) The versioning seems to go from 0.1.15 to 0.1.13. From a packager's POV it would be better to allow a natural version upgrade path. Perhaps the version in hg is just not updated? The reason for these questions/clarifications are that Angel and I are packaging dovecot 2.x betas and matching sieve plugins for allowing more people to a broader testing before the projects go gold. We'd like to have proper naming and versioning in place already for the beta packages. Thanks! -- Axel.Thimm at ATrpms.net

3 5

[Dovecot] dovecot-2.0-beta4, lda and sieve: Permission lookup failed from /tmp/Dovecot Delivery
by Felix Leimbach 14 Apr '10

14 Apr '10

Hi all, I'm testing a dovecot-2.0-beta4 and it is great so far, except that I can't get the sieve plugin for the LDA configured. It doesn't find the user's homedir and uses /tmp instead. Thus it never finds any sieve scripts. The log shows that the SQL queries return the correct home path, namely /mnt/data/vmail/example.com/me dovecot: auth: prefetch(me(a)example.com): passdb didn't return userdb entries, trying the next dovecot: auth: sql(me(a)example.com): SELECT CONCAT(homedir, "/", maildir) AS mail, CONCAT(homedir, "/", maildir) AS home, uid, gid FROM postfix_users WHERE email = 'me(a)example.com' dovecot: auth: master out: USER 1 me(a)example.com mail=/mnt/data/vmail/example.com/me/ home=/mnt/data/vmail/example.com/me/ uid=5000 gid=5000 dovecot: lda(me(a)example.com): Effective uid=5000, gid=5000, home=/mnt/data/vmail/example.com/me/ dovecot: lda(me(a)example.com): Namespace: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes dovecot: lda(me(a)example.com): maildir++: root=/mnt/data/vmail/example.com/me, index=, control=, inbox=/mnt/data/vmail/example.com/me However, the sieve plugin still uses /tmp instead of the home dir and fails: dovecot: lda(me(a)example.com): fs: root=/tmp, index=, control=, inbox= dovecot: lda(me(a)example.com): Namespace : Permission lookup failed from /tmp/Dovecot Delivery Mail dovecot: lda(me(a)example.com): Namespace : Using permissions from /tmp: mode=0777 gid=-1 dovecot: lda(me(a)example.com): Namespace : Permission lookup failed from /tmp/Dovecot Delivery Mail dovecot: lda(me(a)example.com): Namespace : Using permissions from /tmp: mode=0777 gid=-1 dovecot: lda(me(a)example.com): sieve: user has no valid personal script Any idea? Cheers, Felix # doveconf -n # 2.0.beta4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32.2-grsec x86_64 Gentoo Base System release 2.0.1 ext3 auth_debug = yes auth_socket_path = /var/run/dovecot/auth-userdb default_login_user = dovecot_auth lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * login_greeting = Mailserver ready. mail_debug = yes mail_gid = 5000 mail_location = maildir:/mnt/data/vmail/%d/%n mail_uid = 5000 namespace { inbox = yes location = prefix = separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sievescripts } postmaster_address = postmaster(a)example.com protocols = imap pop3 managesieve service auth { unix_listener auth-master { group = vmail mode = 0660 } unix_listener auth-userdb { group = vmail mode = 0660 } } service imap-login { inet_listener imap { port = 10143 } inet_listener imaps { port = 10943 ssl = yes } } service imap { process_limit = 3000 } service managesieve-login { inet_listener sieve { port = 2000 } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 10995 ssl = yes } } shutdown_clients = no ssl_cert = </etc/dovecot/ssl.crt ssl_key = </etc/dovecot/ssl.key userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol managesieve { managesieve_implementation_string = Cyrus timsieved v2.2.13' } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = log_path = mail_plugins = sieve }

3 6

[Dovecot] BAD Error in IMAP command UID COPY: Invalid uidset
by Martin Ott 14 Apr '10

14 Apr '10

Hi, one of our users reported the problem message "BAD Error in IMAP command UID COPY: Invalid uidset" as a result of copying a message from INBOX to INBOX/Test. Is this something to be concerned about, or simply a bug in thunderbird? thx Martin Server: dovecot 1.2.9 Client: Thunderbird 3.04 rawlog in: 4 namespace 5 lsub "" "INBOX/*" 6 lsub "" "shared/*" 7 list "" "INBOX" 8 select "INBOX" 9 myrights "INBOX" 10 getacl "INBOX" 11 getquotaroot "INBOX" 12 UID fetch 4:* (FLAGS) 13 getquotaroot "INBOX" 14 UID fetch 5:* (FLAGS) 16 uid copy 0 "INBOX/Test" 18 uid copy 0 "INBOX/Test" 19 IDLE DONE 20 close 21 logout rawlog out: * OK [RAWLOG TIMESTAMP] 2010-04-14 14:20:27 3 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH ACL RIGHTS=texk QUOTA] Logged in * NAMESPACE (("INBOX/" "/")) NIL (("shared/" "/")) * LSUB () "/" "INBOX/Trash" * LSUB () "/" "INBOX/Junk" * LSUB () "/" "INBOX/Test" 5 OK Lsub completed. * LSUB () "/" "shared/alle" 6 OK Lsub completed. * LIST (\HasChildren) "/" "INBOX" 7 OK List completed. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 4 EXISTS * 0 RECENT * OK [UIDVALIDITY 1264696257] UIDs valid * OK [UIDNEXT 5] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest 8 OK [READ-WRITE] Select completed. * MYRIGHTS "INBOX" lrwstipekxacd 9 OK Myrights completed. * ACL "INBOX" "testuser" lrwstipekxacd 10 OK Getacl completed. * QUOTAROOT "INBOX" "User quota" * QUOTA "User quota" (STORAGE 5 2048000) 11 OK Getquotaroot completed. * 4 FETCH (UID 4 FLAGS (\Seen)) 12 OK Fetch completed. * QUOTAROOT "INBOX" "User quota" * QUOTA "User quota" (STORAGE 5 2048000) 13 OK Getquotaroot completed. * 4 FETCH (UID 4 FLAGS (\Seen)) 14 OK Fetch completed. 16 BAD Error in IMAP command UID COPY: Invalid uidset 18 BAD Error in IMAP command UID COPY: Invalid uidset + idling 19 OK Idle completed.

2 1

[Dovecot] Dovecot 2.0.beta4: auth-worker keeps crashing
by Maxim Balabaev 14 Apr '10

14 Apr '10

Centos 5.4 x64, icc hg rev 11147 log: Apr 14 01:16:17 auth: Info: mysql: Connected to 127.0.0.1 (mail) Apr 14 01:16:25 imap-login: Info: Disconnected (auth failed, 2 attempts): user=<webmaster@>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Apr 14 01:16:40 master: Error: service(auth-worker): child 8642 killed with signal 11 (core dumps disabled) Apr 14 01:16:40 auth: Error: auth worker: Aborted request: Worker process died unexpectedly Everything works, but it`s crashing every time Gdb info: (gdb) bt full #0 0x000000000041782f in auth_stream_reply_find () No symbol table info available. #1 0x0000000000417d97 in lookup_credentials_callback () No symbol table info available. #2 0x00000000004223a2 in passdb_handle_credentials () No symbol table info available. #3 0x0000000000425b1a in sql_query_callback () No symbol table info available. #4 0x0000000000430494 in driver_mysql_query () No symbol table info available. #5 0x000000000042f306 in sql_query () No symbol table info available. #6 0x0000000000425dcb in sql_lookup_credentials () No symbol table info available. #7 0x0000000000418cf5 in auth_worker_input () No symbol table info available. #8 0x00002ad5677acead in io_loop_handler_run () from /opt/dovecot/lib/dovecot/libdovecot.so.0 No symbol table info available. #9 0x00002ad5677ab8d9 in io_loop_run () from /opt/dovecot/lib/dovecot/libdovecot.so.0 No symbol table info available. #10 0x00002ad567796f56 in master_service_run () ---Type <return> to continue, or q <return> to quit--- from /opt/dovecot/lib/dovecot/libdovecot.so.0 No symbol table info available. #11 0x000000000041c79d in main () Hope to get this fixed :)

3 3

[Dovecot] default domain empty
by Leo Unglaub 14 Apr '10

14 Apr '10

Hi friends, i have a question. I have a running dovecot install on my server and a lot of virtual domains. It works great. The users are logging in with user(a)domain.tld but one old domain must be logged in with only the username only (without @domain.tld). My problem is that in this case the mailbox_localtion don't work. For example: > mail_location = maildir:/var/mail/%d/%n/maildir:INDEX=/var/mail/%d/%n/indizies The variable %d is not replaced with the domain. The dokumentation says: domain part in user@domain, empty if user there's no domain Okay, but is there a way to add a domain to this beause i need the %%d for mailbox sharing. Can i override the domain with a value from the user db or is it possible with a login script or somethink? Thank you a lot Greetings from Austria Leo

3 3

[Dovecot] dovecot2: protocols = ... changed ?
by Andreas Schulze 14 Apr '10

14 Apr '10

hello, to use dovecot 1.2 only for sasl authentication I could set "protocols = none" in dovecont.conf. In Version2 this gave me an error. Instead I had to write "protocols =" into the configfile. I wonder about a key without value in the conf ... should the wiki2.dovecot.org be updated? -- Andreas Schulze Internetdienste | P532 DATEV eG 90329 Nürnberg | Telefon +49 911 319-0 | Telefax +49 911 319-3196 E-Mail info @datev.de | Internet www.datev.de Sitz: 90429 Nürnberg, Paumgartnerstr. 6-14 | Registergericht Nürnberg, GenReg Nr.70 Vorstand Prof. Dieter Kempf (Vorsitzender) Dipl.-Kfm. Wolfgang Stegmann (stellvertretender Vorsitzender) Dipl.-Kfm. Michael Leistenschneider Jörg Rabe v. Pappenheim Dipl.-Vw. Eckhard Schwarzer Vorsitzender des Aufsichtsrates: Reinhard Verholen

2 1

[Dovecot] Dovecot 2.0 - LDA auth-master issues
by Floris Bos 14 Apr '10

14 Apr '10

Hi, I'm running a Postfix+Dovecot+MySQL setup, and am trying to upgrade to Dovecot 2.0 beta 4. The problem I run into is that lda cannot connect to the auth-master socket. == Apr 9 15:29:51 mysql postfix/pipe[3749]: 2AAB04517F: to=<EMAIL-ADDRESS>, relay=dovecot, delay=0.02, delays=0.01/0/0/0.02, dsn=4.3.0, status=deferred (temporary failure. Command output: lda: Error: userdb lookup: connect(/usr/local/var/run/dovecot/auth-master) failed: Permission denied (euid=80(www) egid=1003(dovecot) missing +r perm: /usr/local/var/run/dovecot/auth-master, euid is not dir owner) lda: Fatal: User lookup failed: userdb lookup failed ) == Dovecot seems to set the permission of the auth-master socket to user root, mode 600. In Dovecot 1 there was a "mode" and a "user" option to change this. In Dovecot 2 I can only find an option to change the socket path ("auth_socket_path"), but not it's user or mode. Any idea on how to solve this? Your sincerely, Floris Bos

3 2

[Dovecot] Virusscanning
by Andreas Schulze 14 Apr '10

14 Apr '10

Hello list, I use currently a non-dovecot pop3 proxy which has the ability to scan all passing mails for viruses. And I like dovecot. I have to combine both. One (and the only) idea is to call a virusscanner a shellscript, installed as PostLoginScript. But I see multiple disadvantages: 1. it's a shellscript which tents to be slow. 2. it's called *on* the mailbox-host, not on a dedicated proxy 3. I think it's slow and I dont't know howto measure. 4. I thint it's slow. 5. I think it's slow. 6. I like a "Plan B" Any suggestions !? Thanks, Andreas -- ######################################################################## # # Andreas Schulze # https://andreasschulze.de # # GnuPG Key-ID: A7DBA67F, https://andreasschulze.de/sca.asc # GnuPG Fingerprint: 14C1 39A8 CE6D 6BE0 28C6 5652 03B5 6793 A7DB A67F # # $Id: .signature,v 1.3 2007-12-27 21:13:36 sca Exp $ ########################################################################

11 17

[Dovecot] Antispam plugin, compile under osx
by Bradley Giesbrecht 14 Apr '10

14 Apr '10

Any help with the below build failure would be greatly appreciated. If the information I am providing is deficient to diagnose the problem please tell me how to provide better information. Trying to build dovecot-antispam plugin 1.3 from; http://johannes.sipsolutions.net/download/dovecot-antispam/ Dovecot 1.2.11 installed and was configured with --enable-header- install. I also have dovecot compiled with sieve, managesieve and mysql support. Dspam 3.9.0 installed. I'm using the following .config file; BACKEND=dspam-exec DOVECOT=/opt/local/include/dovecot INSTALLDIR=/opt/local/lib/dovecot/imap USER=root GROUP=root PLUGINNAME=antispam make fails with; cc -DHAVE_CONFIG_H -I/opt/local/include/dovecot/ -I/opt/local/include/ dovecot/src/ -I/opt/local/include/dovecot/src/lib/ -I/opt/local/ include/dovecot/src/lib-storage/ -I/opt/local/include/dovecot/src/lib- mail/ -I/opt/local/include/dovecot/src/lib-imap/ -I/opt/local/include/ dovecot/src/lib-dict/ -I/opt/local/include/dovecot/src/lib-index/ -I/ opt/local/include/dovecot/src/imap/ -o dovecot-version dovecot-version.c ./dovecot-version > dovecot-version.h ./version.sh > antispam-version.h cc -c -fPIC -shared -Wall -Wextra -DPLUGINNAME=antispam - DHAVE_CONFIG_H -I/opt/local/include/dovecot/ -I/opt/local/include/ dovecot/src/ -I/opt/local/include/dovecot/src/lib/ -I/opt/local/ include/dovecot/src/lib-storage/ -I/opt/local/include/dovecot/src/lib- mail/ -I/opt/local/include/dovecot/src/lib-imap/ -I/opt/local/include/ dovecot/src/lib-dict/ -I/opt/local/include/dovecot/src/lib-index/ -I/ opt/local/include/dovecot/src/imap/ -o signature.o signature.c cc -c -fPIC -shared -Wall -Wextra -DPLUGINNAME=antispam - DHAVE_CONFIG_H -I/opt/local/include/dovecot/ -I/opt/local/include/ dovecot/src/ -I/opt/local/include/dovecot/src/lib/ -I/opt/local/ include/dovecot/src/lib-storage/ -I/opt/local/include/dovecot/src/lib- mail/ -I/opt/local/include/dovecot/src/lib-imap/ -I/opt/local/include/ dovecot/src/lib-dict/ -I/opt/local/include/dovecot/src/lib-index/ -I/ opt/local/include/dovecot/src/imap/ -o antispam-plugin.o antispam- plugin.c cc -c -fPIC -shared -Wall -Wextra -DPLUGINNAME=antispam - DHAVE_CONFIG_H -I/opt/local/include/dovecot/ -I/opt/local/include/ dovecot/src/ -I/opt/local/include/dovecot/src/lib/ -I/opt/local/ include/dovecot/src/lib-storage/ -I/opt/local/include/dovecot/src/lib- mail/ -I/opt/local/include/dovecot/src/lib-imap/ -I/opt/local/include/ dovecot/src/lib-dict/ -I/opt/local/include/dovecot/src/lib-index/ -I/ opt/local/include/dovecot/src/imap/ -o antispam-storage.o antispam- storage.c cc -c -fPIC -shared -Wall -Wextra -DPLUGINNAME=antispam - DHAVE_CONFIG_H -I/opt/local/include/dovecot/ -I/opt/local/include/ dovecot/src/ -I/opt/local/include/dovecot/src/lib/ -I/opt/local/ include/dovecot/src/lib-storage/ -I/opt/local/include/dovecot/src/lib- mail/ -I/opt/local/include/dovecot/src/lib-imap/ -I/opt/local/include/ dovecot/src/lib-dict/ -I/opt/local/include/dovecot/src/lib-index/ -I/ opt/local/include/dovecot/src/imap/ -o dspam-exec.o dspam-exec.c cc -fPIC -shared -Wall -Wextra -DPLUGINNAME=antispam -DHAVE_CONFIG_H - I/opt/local/include/dovecot/ -I/opt/local/include/dovecot/src/ -I/opt/ local/include/dovecot/src/lib/ -I/opt/local/include/dovecot/src/lib- storage/ -I/opt/local/include/dovecot/src/lib-mail/ -I/opt/local/ include/dovecot/src/lib-imap/ -I/opt/local/include/dovecot/src/lib- dict/ -I/opt/local/include/dovecot/src/lib-index/ -I/opt/local/include/ dovecot/src/imap/ signature.o antispam-plugin.o antispam-storage.o dspam-exec.o -o lib90_antispam_plugin.so Undefined symbols: "_mailbox_get_name", referenced from: _mailbox_patternmatch in antispam-plugin.o _mailbox_is_spam in antispam-plugin.o _mailbox_is_trash in antispam-plugin.o _mailbox_is_unsure in antispam-plugin.o "_t_strconcat", referenced from: _get_setting in antispam-plugin.o _parse_folder_setting in antispam-plugin.o _call_dspam in dspam-exec.o _call_dspam in dspam-exec.o _call_dspam in dspam-exec.o "_main", referenced from: start in crt1.10.5.o "_mailbox_get_storage", referenced from: _mailbox_patternmatch in antispam-plugin.o "_t_push", referenced from: _mailbox_patternmatch in antispam-plugin.o _get_setting in antispam-plugin.o _parse_folder_setting in antispam-plugin.o "_i_panic", referenced from: _signature_list_free in signature.o _move_to_class in antispam-storage.o _antispam_copy in antispam-storage.o _antispam_transaction_begin in antispam-storage.o _antispam_mail_update_keywords in antispam-storage.o _antispam_mail_update_keywords in antispam-storage.o _antispam_mail_update_keywords in antispam-storage.o "_i_malloc", referenced from: _call_dspam in dspam-exec.o "_array_idx_set_i", referenced from: _antispam_mailbox_transaction_begin in antispam-storage.o _antispam_mailbox_mail_alloc in antispam-storage.o _antispam_mailbox_open in antispam-storage.o _antispam_mail_storage_created in antispam-storage.o "_t_buffer_get", referenced from: _mailbox_patternmatch in antispam-plugin.o "_t_pop", referenced from: _mailbox_patternmatch in antispam-plugin.o _get_setting in antispam-plugin.o _parse_folder_setting in antispam-plugin.o "_array_idx_modifiable_i", referenced from: _antispam_copy in antispam-storage.o _antispam_copy in antispam-storage.o _antispam_save_begin in antispam-storage.o _antispam_save_begin in antispam-storage.o _antispam_save_finish in antispam-storage.o _antispam_save_finish in antispam-storage.o _antispam_mail_update_keywords in antispam-storage.o _antispam_mailbox_transaction_begin in antispam-storage.o _antispam_mailbox_transaction_commit in antispam-storage.o _antispam_mailbox_transaction_commit in antispam-storage.o _antispam_mailbox_transaction_rollback in antispam-storage.o _antispam_mailbox_transaction_rollback in antispam-storage.o _antispam_mailbox_mail_alloc in antispam-storage.o _antispam_mailbox_open in antispam-storage.o "_pool_alloconly_create", referenced from: _antispam_plugin_init in antispam-plugin.o "_p_strsplit", referenced from: _parse_folder_setting in antispam-plugin.o _antispam_plugin_init in antispam-plugin.o _backend_init in dspam-exec.o _backend_init in dspam-exec.o "_mailbox_equals", referenced from: _match_info in antispam-plugin.o "_mail_free", referenced from: _antispam_mailbox_transaction_commit in antispam-storage.o _antispam_mailbox_transaction_commit in antispam-storage.o _antispam_mailbox_transaction_rollback in antispam-storage.o "_t_str_ucase", referenced from: _get_setting in antispam-plugin.o "_default_pool", referenced from: _default_pool$non_lazy_ptr in signature.o _default_pool$non_lazy_ptr in antispam-storage.o _default_pool$non_lazy_ptr in dspam-exec.o "_mail_module_register", referenced from: _antispam_mail_module in antispam-storage.o "_mail_storage_set_error", referenced from: _signature_extract_to_list in signature.o _signature_extract in signature.o _antispam_copy in antispam-storage.o _antispam_save_finish in antispam-storage.o _antispam_save_finish in antispam-storage.o _backend_commit in dspam-exec.o "_str_array_length", referenced from: _backend_init in dspam-exec.o _backend_init in dspam-exec.o "_mail_index_get_keywords", referenced from: _antispam_mail_update_keywords in antispam-storage.o "_mail_storage_module_register", referenced from: _antispam_storage_module in antispam-storage.o "_mail_get_headers", referenced from: _get_mail_headers in signature.o _get_mail_headers in dspam-exec.o "_hook_mail_storage_created", referenced from: _hook_mail_storage_created$non_lazy_ptr in antispam-plugin.o "_i_strdup", referenced from: _signature_extract_to_list in signature.o "_mail_alloc", referenced from: _antispam_copy in antispam-storage.o _antispam_save_begin in antispam-storage.o ld: symbol(s) not found Thank you for your consideration, Bradley Giesbrecht

2 3

[Dovecot] dsync convert dovecot 2.0 beta4
by Renaud Allard 13 Apr '10

13 Apr '10

Hello, I am trying to convert a dbox mailbox in maildir format I changed the config to maildir instead of dbox and I am issuing this /opt/dovecot/bin/dsync -u r convert dbox:/home/r/dbox But I get many errors like those below and no mail is stored in the maildir. dsync(r): Error: Corrupted mailbox log at offset 18446743970630342680: /home/r/dbox/dovecot.mailbox.log dsync(r): Error: dbox /home/r/dbox/mailboxes/Drafts/dbox-Mails: Invalid dbox header size dsync(r): Error: dbox /home/r/dbox/mailboxes/Drafts/dbox-Mails: Invalid dbox header size dsync(r): Error: dbox /home/r/dbox/mailboxes/Drafts/dbox-Mails: Invalid dbox header size dsync(r): Warning: dbox /home/r/dbox/mailboxes/Drafts/dbox-Mails: Rebuilding index

2 1

[Dovecot] dict quota and quota recalculation
by Alex 13 Apr '10

13 Apr '10

Hi I am trying to migrate my courier server to dovecot and I've run into some problems. One of the motive that I chose to migrate is quota reporting mechanism which in courier is a pain (if you need to display an accurate quota usage in the control panel). So I follow the instructions on migrations , I convert all the mailboxes, and the next step was to populate the quota table (I use quota/dict). The quota table is empty. From the console (as root): #echo "x GETQUOTAROOT Inbox" | USER=test(a)domain.net /usr/local/sbin/dovecot --exec-mail imap - the result is : | email | used_quota | messages | +----------------+------------+----------+ | test(a)domain.net | 0 | 0 | From mailling logs , relevant parts : dict quota: user=test(a)domain.net, uri=proxy::quotadict, noenforcing=0 Namespace: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes maildir: data=~ maildir++: root=/root, index=, control=, inbox=/root Namespace : Using permissions from /root: mode=0750 gid=-1 - and in the root folder I can see all dovecot specific files (dovecot*) So basically if I execute the script as root the maildir is root the uid/gid is root I search and I found a trick for home : HOME=/home/sites/domain.net/mail/test/Maildir/; USER=test(a)domain.net; echo "1 getquotaroot inbox" | /usr/local/sbin/dovecot -c /usr/local/etc/dovecot.conf --exec-mail imap (but first I must put used_quota and messages values on -1 in the quota table) If I run this , all dovecot files are created in the user homedir (correct) but with the wrong uid/gid (root). If I change the owner of that files , next time I run the same command , nothing changes (uid/gid remain vmail.vmail). My questions are : - is there a way to avoid this behavior (the owner of the dovecot files after quota recreation)? - is there a better way to force all users quota recalculation? PS: and yes , I need to know all quotas even if the user haven't yet login

2 1

[Dovecot] Patch: support URLAUTH, BURL, CATENATE
by Mike Abbott 13 Apr '10

13 Apr '10

Hello Dovecot community, Below please find a patch that adds support to dovecot-1.2.11 for: - RFC 4467 - IMAP URLAUTH Extension - RFC 4468 - Submission BURL - RFC 4469 - IMAP CATENATE Extension URLAUTH URLAUTH is added as a plugin so it can be disabled to satisfy site security requirements. Each user's URLAUTH keys for all mailboxes are stored in a file named "urlauthkeys" at the top level. It is safe to remove this file but doing so invalidates all previously-generated IMAP URLs. BURL BURL is an extension to SMTP not IMAP, but support is needed on the IMAP side to establish a trust relationship between the submission server and the IMAP server. The patch adds the concept of "submit" users. Submit users are like master users in that they may log in as any user. However submit users can use only a limited set of commands: just URLFETCH, ID, CAPABILITY (although the capabilities are a lie since submit users can't use most commands), and LOGOUT. This restriction enables an IMAP server to allow a BURL-capable submission server to use URLFETCH commands without risking a huge security breach if a submit user's credentials are compromised. In other words, you can safely enable limited-power submit users without enabling super-user master users. The patch adds a non-standard X-PLAIN-SUBMIT authentication method specifically to allow plain-text submit user logins while plain-text regular user logins are not allowed. This lets the system administrator configure the same submit user and password credentials on both the submission server and the IMAP server. Today Apple also contributes BURL support to the Postfix open source project. Postfix BURL interoperates with Dovecot BURL/URLAUTH. CATENATE The patch fully supports LITERAL+ and MULTIAPPEND in conjunction with CATENATE. As with our previous patches, all of our changes are commented with "APPLE" not to pollute the code but to help us merge in your new releases. Feel free to remove those comments or restructure or rewrite the code as desired, as long as you preserve our copyright. We understand that our implementation choices may differ from yours; if you see a better way to achieve the same goal please do adopt the better way. Some areas we are aware could use improvement but satisfy our own needs: - the maildir-specific code in urlauth-keys - the NFS-unsafe locking and read-modify-write algorithms in urlauth-keys - hook_delete_mailbox and hook_select_send_urlmech - output_squelch in struct client - urlfetch and urlfetched in struct imap_fetch_context Apple invites the dovecot developers and contributors to port this patch to Dovecot-2.0. Dovecot-2.0 has not been stable enough for us yet to make it the base of our development. Please let me know if you have any questions, concerns, or bug reports regarding this patch. Thanks. diff -Nur dovecot-1.2.11/AUTHORS dovecot-1.2.11+lemonade/AUTHORS --- dovecot-1.2.11/AUTHORS 2008-12-19 01:31:33.000000000 -0600 +++ dovecot-1.2.11+lemonade/AUTHORS 2010-04-08 09:59:12.000000000 -0500 @@ -13,6 +13,6 @@ Vaclav Haisman <v.haisman(a)sh.cvut.cz> (src/lib/ioloop-kqueue.c, src/lib/ioloop-notify-kqueue.c) -Portions Copyright (c) 2008 Apple Inc. All rights reserved. +Portions Copyright (c) 2008-2010 Apple Inc. All rights reserved. Grepping 'Patch by' from ChangeLog shows up more people. diff -Nur dovecot-1.2.11/COPYING dovecot-1.2.11+lemonade/COPYING --- dovecot-1.2.11/COPYING 2008-06-08 21:21:55.000000000 -0500 +++ dovecot-1.2.11+lemonade/COPYING 2010-04-08 09:59:12.000000000 -0500 @@ -75,3 +75,37 @@ not be used in advertising or otherwise to promote the sale, use or other dealings in these Data Files or Software without prior written authorization of the copyright holder. + +CATENATE support in src/imap/cmd-append.c +src/lib/lib-imap/imap-url.c +src/lib/lib-imap/imap-url.h +src/plugins/urlauth/* + + Copyright (c) 2010 Apple Inc. All rights reserved. + + Redistribution and use in source and binary forms, with or without + modification, are permitted provided that the following conditions + are met: + + 1. Redistributions of source code must retain the above copyright + notice, this list of conditions and the following disclaimer. + 2. Redistributions in binary form must reproduce the above + copyright notice, this list of conditions and the following + disclaimer in the documentation and/or other materials provided + with the distribution. + 3. Neither the name of Apple Inc. ("Apple") nor the names of its + contributors may be used to endorse or promote products derived + from this software without specific prior written permission. + + THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND + ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, + THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A + PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS + CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF + USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND + ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, + OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT + OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF + SUCH DAMAGE. diff -Nur dovecot-1.2.11/configure dovecot-1.2.11+lemonade/configure --- dovecot-1.2.11/configure 2010-03-08 11:31:05.000000000 -0600 +++ dovecot-1.2.11+lemonade/configure 2010-04-08 09:59:12.000000000 -0500 @@ -23068,7 +23068,7 @@ capability_banner="IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE" -capability="$capability_banner SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS" +capability="$capability_banner SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND CATENATE UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS" cat >>confdefs.h <<_ACEOF #define CAPABILITY_STRING "$capability" @@ -23089,7 +23089,7 @@ ac_config_headers="$ac_config_headers config.h" -ac_config_files="$ac_config_files Makefile doc/Makefile doc/wiki/Makefile src/Makefile src/lib/Makefile src/lib-sql/Makefile src/lib-auth/Makefile src/lib-charset/Makefile src/lib-dict/Makefile src/lib-imap/Makefile src/lib-index/Makefile src/lib-mail/Makefile src/lib-ntlm/Makefile src/lib-otp/Makefile src/lib-settings/Makefile src/lib-storage/Makefile src/lib-storage/list/Makefile src/lib-storage/index/Makefile src/lib-storage/index/maildir/Makefile src/lib-storage/index/mbox/Makefile src/lib-storage/index/dbox/Makefile src/lib-storage/index/cydir/Makefile src/lib-storage/index/raw/Makefile src/lib-storage/index/shared/Makefile src/lib-storage/register/Makefile src/auth/Makefile src/deliver/Makefile src/dict/Makefile src/imap/Makefile src/imap-login/Makefile src/login-common/Makefile src/master/Makefile src/pop3/Makefile src/pop3-login/Makefile src/tests/Makefile src/util/Makefile src/plugins/Makefile src/plugins/acl/Makefile src/plugins/imap-acl/Makefile src/plugins/autocreate/Makefile src/plugins/convert/Makefile src/plugins/expire/Makefile src/plugins/fts/Makefile src/plugins/fts-lucene/Makefile src/plugins/fts-solr/Makefile src/plugins/fts-squat/Makefile src/plugins/lazy-expunge/Makefile src/plugins/listescape/Makefile src/plugins/mail-log/Makefile src/plugins/mbox-snarf/Makefile src/plugins/quota/Makefile src/plugins/imap-quota/Makefile src/plugins/trash/Makefile src/plugins/virtual/Makefile src/plugins/zlib/Makefile stamp.h dovecot-config.in" +ac_config_files="$ac_config_files Makefile doc/Makefile doc/wiki/Makefile src/Makefile src/lib/Makefile src/lib-sql/Makefile src/lib-auth/Makefile src/lib-charset/Makefile src/lib-dict/Makefile src/lib-imap/Makefile src/lib-index/Makefile src/lib-mail/Makefile src/lib-ntlm/Makefile src/lib-otp/Makefile src/lib-settings/Makefile src/lib-storage/Makefile src/lib-storage/list/Makefile src/lib-storage/index/Makefile src/lib-storage/index/maildir/Makefile src/lib-storage/index/mbox/Makefile src/lib-storage/index/dbox/Makefile src/lib-storage/index/cydir/Makefile src/lib-storage/index/raw/Makefile src/lib-storage/index/shared/Makefile src/lib-storage/register/Makefile src/auth/Makefile src/deliver/Makefile src/dict/Makefile src/imap/Makefile src/imap-login/Makefile src/login-common/Makefile src/master/Makefile src/pop3/Makefile src/pop3-login/Makefile src/tests/Makefile src/util/Makefile src/plugins/Makefile src/plugins/acl/Makefile src/plugins/imap-acl/Makefile src/plugins/autocreate/Makefile src/plugins/convert/Makefile src/plugins/expire/Makefile src/plugins/fts/Makefile src/plugins/fts-lucene/Makefile src/plugins/fts-solr/Makefile src/plugins/fts-squat/Makefile src/plugins/lazy-expunge/Makefile src/plugins/listescape/Makefile src/plugins/mail-log/Makefile src/plugins/mbox-snarf/Makefile src/plugins/quota/Makefile src/plugins/imap-quota/Makefile src/plugins/trash/Makefile src/plugins/urlauth/Makefile src/plugins/virtual/Makefile src/plugins/zlib/Makefile stamp.h dovecot-config.in" cat >confcache <<\_ACEOF @@ -24282,6 +24282,7 @@ "src/plugins/quota/Makefile") CONFIG_FILES="$CONFIG_FILES src/plugins/quota/Makefile" ;; "src/plugins/imap-quota/Makefile") CONFIG_FILES="$CONFIG_FILES src/plugins/imap-quota/Makefile" ;; "src/plugins/trash/Makefile") CONFIG_FILES="$CONFIG_FILES src/plugins/trash/Makefile" ;; + "src/plugins/urlauth/Makefile") CONFIG_FILES="$CONFIG_FILES src/plugins/urlauth/Makefile" ;; "src/plugins/virtual/Makefile") CONFIG_FILES="$CONFIG_FILES src/plugins/virtual/Makefile" ;; "src/plugins/zlib/Makefile") CONFIG_FILES="$CONFIG_FILES src/plugins/zlib/Makefile" ;; "stamp.h") CONFIG_FILES="$CONFIG_FILES stamp.h" ;; diff -Nur dovecot-1.2.11/configure.in dovecot-1.2.11+lemonade/configure.in --- dovecot-1.2.11/configure.in 2010-03-08 11:30:53.000000000 -0600 +++ dovecot-1.2.11+lemonade/configure.in 2010-04-08 09:59:12.000000000 -0500 @@ -2436,7 +2436,7 @@ dnl ** capability_banner="IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE" -capability="$capability_banner SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS" +capability="$capability_banner SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND CATENATE UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS" AC_DEFINE_UNQUOTED(CAPABILITY_STRING, "$capability", IMAP capabilities) AC_DEFINE_UNQUOTED(CAPABILITY_BANNER_STRING, "$capability_banner", IMAP capabilities advertised in banner) @@ -2503,6 +2503,7 @@ src/plugins/quota/Makefile src/plugins/imap-quota/Makefile src/plugins/trash/Makefile +src/plugins/urlauth/Makefile src/plugins/virtual/Makefile src/plugins/zlib/Makefile stamp.h diff -Nur dovecot-1.2.11/dovecot-example.conf dovecot-1.2.11+lemonade/dovecot-example.conf --- dovecot-1.2.11/dovecot-example.conf 2010-01-24 17:30:41.000000000 -0600 +++ dovecot-1.2.11+lemonade/dovecot-example.conf 2010-04-08 09:59:12.000000000 -0500 @@ -323,6 +323,7 @@ # Enable mail process debugging. This can help you figure out why Dovecot # isn't finding your mails. +# (APPLE) This also helps troubleshoot URLFETCH issues. #mail_debug = no # Log prefix for mail processes. See <doc/wiki/Variables.txt> for list of @@ -1187,6 +1188,10 @@ # Mails are first deleted in lowest -> highest priority number order #trash = /etc/dovecot-trash.conf + # (APPLE) Server name for GENURLAUTH/URLFETCH. Can be host:port or + # just a FQHN. Default is the system's real hostname. + #urlauth_hostport = + # Expire plugin. Mails are expunged from mailboxes after being there the # configurable time. The first expiration date for each mailbox is stored in # a dictionary so it can be quickly determined which mailboxes contain diff -Nur dovecot-1.2.11/src/auth/auth-request-handler.c dovecot-1.2.11+lemonade/src/auth/auth-request-handler.c --- dovecot-1.2.11/src/auth/auth-request-handler.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/auth-request-handler.c 2010-04-08 09:59:12.000000000 -0500 @@ -249,7 +249,8 @@ if (request->internal_failure) auth_stream_reply_add(reply, "temp", NULL); - else if (request->master_user != NULL) { + else if (request->master_user != NULL || + request->submit_user != NULL) { /* APPLE - urlauth */ /* authentication succeeded, but we can't log in as the wanted user */ auth_stream_reply_add(reply, "authz", NULL); @@ -473,6 +474,14 @@ "master_user", request->master_user); } + + /* APPLE - urlauth */ + if (request->submit_user != NULL) { + auth_stream_reply_add(request->userdb_reply, + "submit_user", + request->submit_user); + } + auth_stream_reply_import(reply, auth_stream_reply_export(request->userdb_reply)); break; diff -Nur dovecot-1.2.11/src/auth/auth-request.c dovecot-1.2.11+lemonade/src/auth/auth-request.c --- dovecot-1.2.11/src/auth/auth-request.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/auth-request.c 2010-04-08 09:59:12.000000000 -0500 @@ -126,6 +126,12 @@ auth_stream_reply_add(reply, "master_user", request->master_user); } + + /* APPLE - urlauth */ + if (request->submit_user != NULL) + auth_stream_reply_add(reply, "submit_user", + request->submit_user); + auth_stream_reply_add(reply, "original_username", request->original_username); @@ -162,6 +168,11 @@ request->user = p_strdup(request->pool, value); else if (strcmp(key, "master_user") == 0) request->master_user = p_strdup(request->pool, value); + + /* APPLE - urlauth */ + else if (strcmp(key, "submit_user") == 0) + request->submit_user = p_strdup(request->pool, value); + else if (strcmp(key, "original_username") == 0) request->original_username = p_strdup(request->pool, value); else if (strcmp(key, "cert_username") == 0) { @@ -188,7 +199,8 @@ else if (strcmp(key, "valid-client-cert") == 0) request->valid_client_cert = TRUE; else if (strcmp(key, "skip_password_check") == 0) { - i_assert(request->master_user != NULL); + i_assert(request->master_user != NULL || + request->submit_user != NULL); /* APPLE - urlauth */ request->skip_password_check = TRUE; } else if (strcmp(key, "mech") == 0) request->mech_name = p_strdup(request->pool, value); @@ -303,15 +315,27 @@ result == PASSDB_RESULT_OK); } -static bool auth_request_master_lookup_finish(struct auth_request *request) +static bool auth_request_master_lookup_finish(struct auth_request *request, + bool submit) /* APPLE - urlauth */ { if (request->passdb_failure) return TRUE; /* master login successful. update user and master_user variables. */ + + /* APPLE - urlauth */ + if (submit) + auth_request_log_info(request, "passdb", + "Submit user logging in as %s", + request->requested_login_user); + else /* reduce code deltas */ auth_request_log_info(request, "passdb", "Master user logging in as %s", request->requested_login_user); + /* APPLE - urlauth */ + if (submit) + request->submit_user = request->user; + else /* reduce code deltas */ request->master_user = request->user; request->user = request->requested_login_user; request->requested_login_user = NULL; @@ -352,7 +376,20 @@ /* success */ if (request->requested_login_user != NULL) { /* this was a master user lookup. */ - if (!auth_request_master_lookup_finish(request)) + + /* APPLE - urlauth */ + if (request->passdb->submit && + strcasecmp(request->service, "imap") != 0) { + auth_request_log_info(request, "passdb", + "Attempted submit user login for " + "non-imap service %s " + "(trying to log in as user: %s)", + request->service, + request->requested_login_user); + *result = PASSDB_RESULT_USER_DISABLED; + } else /* reduce code deltas */ + if (!auth_request_master_lookup_finish(request, + request->passdb->submit)) /* APPLE - urlauth */ return FALSE; } else { if (request->passdb->pass) { @@ -1310,7 +1347,8 @@ if (request->skip_password_check) { /* currently this can happen only with master logins */ - i_assert(request->master_user != NULL); + i_assert(request->master_user != NULL || + request->submit_user != NULL); /* APPLE - urlauth */ return 1; } @@ -1458,8 +1496,13 @@ str_append_c(str, ','); str_append(str, ip); } - if (auth_request->requested_login_user != NULL) + if (auth_request->requested_login_user != NULL) { + /* APPLE - urlauth */ + if (auth_request->submit_user != NULL) + str_append(str, ",submit"); + else /* reduce code deltas */ str_append(str, ",master"); + } str_append(str, "): "); str_vprintfa(str, format, va); return str_c(str); diff -Nur dovecot-1.2.11/src/auth/auth-request.h dovecot-1.2.11+lemonade/src/auth/auth-request.h --- dovecot-1.2.11/src/auth/auth-request.h 2009-02-21 16:07:43.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/auth-request.h 2010-04-08 09:59:12.000000000 -0500 @@ -32,6 +32,10 @@ has validated user as a valid master user, master_user is set to user and user is set to requested_login_user. */ char *user, *requested_login_user, *master_user; + + /* APPLE - urlauth - when the master user is a submission server */ + char *submit_user; + /* original_username contains the username exactly as given by the client. this is needed at least with DIGEST-MD5 for password verification. however with master logins the master username has diff -Nur dovecot-1.2.11/src/auth/auth.c dovecot-1.2.11+lemonade/src/auth/auth.c --- dovecot-1.2.11/src/auth/auth.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/auth.c 2010-04-08 09:59:12.000000000 -0500 @@ -37,6 +37,8 @@ masterdb_p = &auth->masterdbs; auth_passdb = NULL; for (i = 1; ; i++) { + bool is_master; /* APPLE - urlauth */ + driver = getenv(t_strdup_printf("PASSDB_%u_DRIVER", i)); if (driver == NULL) break; @@ -49,7 +51,16 @@ auth_passdb->pass = getenv(t_strdup_printf("PASSDB_%u_PASS", i)) != NULL; - if (getenv(t_strdup_printf("PASSDB_%u_MASTER", i)) == NULL) { + /* APPLE - urlauth - Submit user has much less power than + master user. Forbid both master and submit in one passdb + so that unaware services (pop3, managesieve) don't + compromise security. */ + auth_passdb->submit = + getenv(t_strdup_printf("PASSDB_%u_SUBMIT", i)) != NULL; + is_master = getenv(t_strdup_printf("PASSDB_%u_MASTER", i)) != NULL; + if (is_master && auth_passdb->submit) + i_fatal("Passdb can't have master=yes and submit=yes"); + if (!is_master && !auth_passdb->submit) { *passdb_p = auth_passdb; passdb_p = &auth_passdb->next; } else { diff -Nur dovecot-1.2.11/src/auth/auth.h dovecot-1.2.11+lemonade/src/auth/auth.h --- dovecot-1.2.11/src/auth/auth.h 2008-06-08 21:21:56.000000000 -0500 +++ dovecot-1.2.11+lemonade/src/auth/auth.h 2010-04-08 09:59:12.000000000 -0500 @@ -16,6 +16,9 @@ unsigned int deny:1; /* after a successful lookup, continue to next passdb */ unsigned int pass:1; + + /* APPLE - urlauth - submission server login */ + unsigned int submit:1; }; struct auth_userdb { diff -Nur dovecot-1.2.11/src/auth/db-checkpassword.c dovecot-1.2.11+lemonade/src/auth/db-checkpassword.c --- dovecot-1.2.11/src/auth/db-checkpassword.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/db-checkpassword.c 2010-04-08 09:59:12.000000000 -0500 @@ -120,6 +120,13 @@ env_put(t_strconcat("MASTER_USER=", request->master_user, NULL)); } + + /* APPLE - urlauth */ + if (request->submit_user != NULL) { + env_put(t_strconcat("SUBMIT_USER=", + request->submit_user, NULL)); + } + if (request->extra_fields != NULL) { const char *fields = auth_stream_reply_export(request->extra_fields); diff -Nur dovecot-1.2.11/src/auth/mech-plain.c dovecot-1.2.11+lemonade/src/auth/mech-plain.c --- dovecot-1.2.11/src/auth/mech-plain.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/mech-plain.c 2010-04-08 09:59:12.000000000 -0500 @@ -6,9 +6,11 @@ #include "passdb.h" #include "plain-common.h" +/* APPLE - urlauth */ static void -mech_plain_auth_continue(struct auth_request *request, - const unsigned char *data, size_t data_size) +mech_plain_auth_continue_submit(struct auth_request *request, + const unsigned char *data, size_t data_size, + bool submit) { const char *authid, *authenid, *error; char *pass; @@ -54,6 +56,19 @@ auth_request_log_info(request, "plain", "login user: %s", error); auth_request_fail(request); + + /* APPLE - urlauth */ + } else if (submit) { + if (request->requested_login_user != NULL && + *request->requested_login_user != '\0') + auth_request_verify_plain(request, pass, + plain_verify_callback); + else { + auth_request_log_info(request, "x-plain-submit", + "non-submit login"); + auth_request_fail(request); + } + } else { auth_request_verify_plain(request, pass, plain_verify_callback); @@ -64,6 +79,14 @@ safe_memset(pass, 0, strlen(pass)); } +/* APPLE - urlauth */ +static void +mech_plain_auth_continue(struct auth_request *request, + const unsigned char *data, size_t data_size) +{ + mech_plain_auth_continue_submit(request, data, data_size, FALSE); +} + static struct auth_request *mech_plain_auth_new(void) { struct auth_request *request; @@ -86,3 +109,26 @@ mech_plain_auth_continue, mech_generic_auth_free }; + +/* APPLE - urlauth - rest of file + The X-PLAIN-SUBMIT mechanism mimics PLAIN but only for submit users + (and master users, since we can't tell the difference so early). */ + +static void +mech_submit_auth_continue(struct auth_request *request, + const unsigned char *data, size_t data_size) +{ + mech_plain_auth_continue_submit(request, data, data_size, TRUE); +} + +const struct mech_module mech_x_plain_submit = { + "X-PLAIN-SUBMIT", + + MEMBER(flags) MECH_SEC_PLAINTEXT, + MEMBER(passdb_need) MECH_PASSDB_NEED_VERIFY_PLAIN, + + mech_plain_auth_new, + mech_generic_auth_initial, + mech_submit_auth_continue, + mech_generic_auth_free +}; diff -Nur dovecot-1.2.11/src/auth/mech.c dovecot-1.2.11+lemonade/src/auth/mech.c --- dovecot-1.2.11/src/auth/mech.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/mech.c 2010-04-08 09:59:12.000000000 -0500 @@ -64,6 +64,7 @@ } extern const struct mech_module mech_plain; +extern const struct mech_module mech_x_plain_submit; /* APPLE - urlauth */ extern const struct mech_module mech_login; extern const struct mech_module mech_apop; extern const struct mech_module mech_cram_md5; @@ -86,6 +87,7 @@ void mech_init(void) { mech_register_module(&mech_plain); + mech_register_module(&mech_x_plain_submit); /* APPLE - urlauth */ mech_register_module(&mech_login); mech_register_module(&mech_apop); mech_register_module(&mech_cram_md5); @@ -112,6 +114,7 @@ void mech_deinit(void) { mech_unregister_module(&mech_plain); + mech_unregister_module(&mech_x_plain_submit); /* APPLE - urlauth */ mech_unregister_module(&mech_login); mech_unregister_module(&mech_apop); mech_unregister_module(&mech_cram_md5); diff -Nur dovecot-1.2.11/src/auth/passdb-blocking.c dovecot-1.2.11+lemonade/src/auth/passdb-blocking.c --- dovecot-1.2.11/src/auth/passdb-blocking.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/passdb-blocking.c 2010-04-08 09:59:12.000000000 -0500 @@ -19,7 +19,8 @@ if (*args != NULL) { i_assert(auth_stream_is_empty(request->extra_fields) || - request->master_user != NULL); + request->master_user != NULL || + request->submit_user != NULL); /* APPLE - urlauth */ auth_request_set_fields(request, args, NULL); } } @@ -73,7 +74,8 @@ struct auth_stream_reply *reply; i_assert(auth_stream_is_empty(request->extra_fields) || - request->master_user != NULL); + request->master_user != NULL || + request->submit_user != NULL); /* APPLE - urlauth */ reply = auth_stream_reply_init(pool_datastack_create()); auth_stream_reply_add(reply, "PASSV", NULL); @@ -112,7 +114,8 @@ struct auth_stream_reply *reply; i_assert(auth_stream_is_empty(request->extra_fields) || - request->master_user != NULL); + request->master_user != NULL || + request->submit_user != NULL); /* APPLE - urlauth */ reply = auth_stream_reply_init(pool_datastack_create()); auth_stream_reply_add(reply, "PASSL", NULL); diff -Nur dovecot-1.2.11/src/imap/client.c dovecot-1.2.11+lemonade/src/imap/client.c --- dovecot-1.2.11/src/imap/client.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/client.c 2010-04-08 09:59:12.000000000 -0500 @@ -53,6 +53,7 @@ client->command_pool = pool_alloconly_create(MEMPOOL_GROWING"client command", 2048); client->user = user; + client->submit = getenv("SUBMIT_USER") != NULL; /* APPLE - urlauth */ for (ns = user->namespaces; ns != NULL; ns = ns->next) { mail_storage_set_callbacks(ns->storage, @@ -225,6 +226,10 @@ if (client->output->closed) return -1; + /* APPLE - urlauth */ + if (client->output_squelch) + return 1; + iov[0].iov_base = data; iov[0].iov_len = strlen(data); iov[1].iov_base = "\r\n"; @@ -250,6 +255,10 @@ if (client->output->closed || cmd->cancel) return; + /* APPLE - urlauth */ + if (client->output_squelch) + return; + if (tag == NULL || *tag == '\0') tag = "*"; @@ -268,6 +277,10 @@ const char *error, *cmd_name; bool fatal; + /* APPLE - urlauth */ + if (client->output_squelch) + return; + if (msg == NULL) { msg = imap_parser_get_error(cmd->parser, &fatal); if (fatal) { @@ -551,7 +564,8 @@ /* Skip incoming data until newline is found, returns TRUE if newline was found. */ -static bool client_skip_line(struct client *client) +/* APPLE - catenate - was static */ +bool client_skip_line(struct client *client) { const unsigned char *data; size_t i, data_size; @@ -655,6 +669,19 @@ cmd->param_error = TRUE; client_command_free(&cmd); return TRUE; + + /* APPLE - urlauth - Users logged in via the submit user may execute + only commands marked with COMMAND_FLAG_OK_FOR_SUBMIT_USER. This + prevents leakage of the submit user's credentials from causing + a huge security breach, as it would be if we relied solely on + dovecot's regular master users who can do anything to any user. */ + } else if ((cmd->cmd_flags & COMMAND_FLAG_OK_FOR_SUBMIT_USER) == 0 && + client->submit) { + client_send_tagline(cmd, "NO Command forbidden to submit user"); + cmd->param_error = TRUE; + client_command_free(&cmd); + return TRUE; + } else { i_assert(!client->disconnected); diff -Nur dovecot-1.2.11/src/imap/client.h dovecot-1.2.11+lemonade/src/imap/client.h --- dovecot-1.2.11/src/imap/client.h 2009-06-26 23:49:34.000000000 -0500 +++ dovecot-1.2.11+lemonade/src/imap/client.h 2010-04-08 09:59:12.000000000 -0500 @@ -138,6 +138,8 @@ unsigned int input_skip_line:1; /* skip all the data until we've found a new line */ unsigned int modseqs_sent_since_sync:1; + unsigned int output_squelch:1; /* APPLE - urlauth */ + unsigned int submit:1; /* APPLE - urlauth */ }; /* Create new client with specified input/output handles. socket specifies @@ -188,6 +190,9 @@ bool client_handle_unfinished_cmd(struct client_command_context *cmd); void client_continue_pending_input(struct client *client); +/* APPLE - catenate */ +bool client_skip_line(struct client *client); + void client_input(struct client *client); bool client_handle_input(struct client *client); int client_output(struct client *client); diff -Nur dovecot-1.2.11/src/imap/cmd-append.c dovecot-1.2.11+lemonade/src/imap/cmd-append.c --- dovecot-1.2.11/src/imap/cmd-append.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/cmd-append.c 2010-04-08 09:59:12.000000000 -0500 @@ -8,9 +8,16 @@ #include "commands.h" #include "imap-parser.h" #include "imap-date.h" +#include "imap-url.h" /* APPLE - catenate */ +#include "imap-fetch.h" /* APPLE - catenate */ +#include "imap-search-args.h" /* APPLE - catenate */ +#include "fd-set-nonblock.h" /* APPLE - catenate */ +#include "mail-storage-private.h" /* APPLE - catenate */ +#include "mail-search.h" /* APPLE - catenate */ #include "mail-storage.h" #include <sys/time.h> +#include <stdlib.h> /* APPLE - catenate */ /* Don't allow internaldates to be too far in the future. At least with Maildir they can cause problems with incremental backups since internaldate is @@ -32,6 +39,21 @@ struct mail_save_context *save_ctx; unsigned int count; + /* APPLE - catenate */ + struct { + struct ostream *output; /* to pipe; input is from pipe */ + struct istream *literal_input; + uoff_t literal_size; + string_t *literal_url; + unsigned int parts; + + /* also, + msg_size is the cumulative size of the message + message_input is used as "reading any literal" + */ + } cat; + const struct imap_arg *args; + unsigned int message_input:1; unsigned int failed:1; }; @@ -40,6 +62,13 @@ static bool cmd_append_continue_message(struct client_command_context *cmd); static bool cmd_append_continue_parsing(struct client_command_context *cmd); +/* APPLE - catenate */ +static bool args_indicate_catenate(const struct imap_arg *args); +static bool catenate_begin_parsing(struct client_command_context *cmd, + const struct imap_arg *args); +static bool catenate_begin_cancel(struct client_command_context *cmd, + const struct imap_arg *args); + static void client_input_append(struct client_command_context *cmd) { struct cmd_append_context *ctx = cmd->context; @@ -226,6 +255,11 @@ /* if error occurs, the CRLF is already read. */ client->input_skip_line = FALSE; + /* APPLE - catenate */ + if (ctx->args != NULL) { + args = ctx->args; + ctx->args = NULL; + } else { /* reduce code deltas */ /* [<flags>] [<internal date>] <message literal> */ ret = imap_parser_read_args(ctx->save_parser, 0, IMAP_PARSE_FLAG_LITERAL_SIZE, &args); @@ -239,6 +273,7 @@ /* need more data */ return FALSE; } + } /* APPLE - catenate */ if (args->type == IMAP_ARG_EOL) { /* last message */ @@ -295,6 +330,11 @@ return cmd_sync(cmd, sync_flags, imap_flags, msg); } + /* APPLE - catenate */ + if (args_indicate_catenate(args)) + return ctx->failed ? catenate_begin_cancel(cmd, args) : + catenate_begin_parsing(cmd, args); + if (!validate_args(args, &flags_list, &internal_date_str, &ctx->msg_size, &nonsync)) { client_send_command_error(cmd, "Invalid arguments."); @@ -330,6 +370,11 @@ } else if (!imap_parse_datetime(internal_date_str, &internal_date, &timezone_offset)) { client_send_tagline(cmd, "BAD Invalid internal date."); + + /* APPLE */ + if (keywords != NULL) + mailbox_keywords_free(ctx->box, &keywords); + return cmd_append_cancel(ctx, nonsync); } @@ -343,6 +388,11 @@ if (ctx->msg_size == 0) { /* no message data, abort */ client_send_tagline(cmd, "NO Can't save a zero byte message."); + + /* APPLE */ + if (keywords != NULL) + mailbox_keywords_free(ctx->box, &keywords); + return cmd_append_cancel(ctx, nonsync); } @@ -527,3 +577,908 @@ cmd->context = ctx; return cmd_append_continue_parsing(cmd); } + +/* APPLE - rest of file - catenate + Implements RFC 4469. + + Tried to weave CATENATE support into the existing code but was too messy. + Chose to keep a separate state machine rather than rewrite it all. + + Enter at catenate_begin_parsing(). That iterates through all the + in-line URLs. If it encounters a URL literal, it continues at + catenate_continue_url(). If it encounters a TEXT literal, it + continues at catenate_continue_text(). Both of these flow to + catenate_continue_parsing(). At the end, catenate_finish() passes + control back to cmd_append_continue_parsing(). */ + +#define MAX_URL_LITERAL_SIZE 8000 +#define MAX_CATENATE_MSG_SIZE ((uint32_t) -1) +#define MAX_CATENATE_PARTS 50 +#ifndef PIPE_MAX +# define PIPE_MAX 5120 +#endif + +static bool catenate_process_args(struct client_command_context *cmd, + const struct imap_arg *args, bool nonsync); +static bool catenate_cancel_args(struct client_command_context *cmd, + const struct imap_arg *args, bool nonsync); +static bool catenate_cancel(struct cmd_append_context *ctx, bool nonsync); +static bool catenate_finish(struct cmd_append_context *ctx, bool cancel); +static bool catenate_finish_literal(struct client_command_context *cmd, + bool cancel); + +static bool args_indicate_catenate(const struct imap_arg *args) +{ + while (args->type != IMAP_ARG_EOL) { + if (args->type == IMAP_ARG_ATOM && + strcasecmp(args->_data.str, "CATENATE") == 0) + return TRUE; + args++; + } + return FALSE; +} + +static void catenate_solicit(struct cmd_append_context *ctx, bool nonsync) +{ + if (!nonsync) { + o_stream_send(ctx->client->output, "+ OK\r\n", 6); + o_stream_flush(ctx->client->output); + o_stream_uncork(ctx->client->output); + o_stream_cork(ctx->client->output); + } +} + +static bool catenate_url_validate(const struct imap_url_parts *parts, + const char **error) +{ + // user: absent; RFC 3501 "userid" + if (parts->user != NULL) { + *error = "user ID present; need relative URL"; + return FALSE; + } + + // auth_type: absent; RFC 3501 "auth-type" + if (parts->auth_type != NULL) { + *error = "auth type present; need relative URL"; + return FALSE; + } + + // hostport: absent; RFC 1738 "hostport" + if (parts->hostport != NULL) { + *error = "server present; need relative URL"; + return FALSE; + } + + // mailbox: optional; RFC 3501 "mailbox" + if (parts->mailbox != NULL && + !imap_url_mailbox_validate(parts->mailbox)) { + *error = "invalid mailbox"; + return FALSE; + } + + // uidvalidity: optional; RFC 3501 "nz-number" + if (parts->uidvalidity != NULL && + !imap_url_nz_number_validate(parts->uidvalidity)) { + *error = "invalid uidvalidity"; + return FALSE; + } + + // uid: mandatory; RFC 3501 "nz-number" + if (parts->uid == NULL || + !imap_url_nz_number_validate(parts->uid)) { + *error = "missing or invalid uid"; + return FALSE; + } + + // section: optional; RFC 2192 "section" + if (parts->section != NULL && + !imap_url_section_validate(parts->section)) { + *error = "invalid section"; + return FALSE; + } + + // expiration: absent; RFC 3339 "date-time" + if (parts->expiration != NULL) { + *error = "expiration present"; + return FALSE; + } + + // access: absent; RFC 4467 "access" + if (parts->access != NULL) { + *error = "missing or invalid access ID"; + return FALSE; + } + + // mechanism: absent + if (parts->mechanism != NULL) { + *error = "mechanism present"; + return FALSE; + } + + // urlauth: absent + if (parts->urlauth != NULL) { + *error = "access token present"; + return FALSE; + } + + return TRUE; +} + +struct catenate_fetch_context { + struct cmd_append_context *ctx; + struct ostream *client_output; + const char *url; + const char *mailbox; + struct mail_storage *storage; + struct mailbox *box; + struct istream *input; + struct imap_parser *parser; + struct mail_search_args *search_args; + struct imap_fetch_context *fetch_ctx; +}; + +static bool catenate_fetch_cleanup(struct catenate_fetch_context *cfctx, + bool toobig, const char *error) +{ + if (cfctx->fetch_ctx != NULL) { + if (!cfctx->fetch_ctx->urlfetched) { + if (error == NULL && !toobig) + error = "message not found"; + } + if (imap_fetch_deinit(cfctx->fetch_ctx) < 0) + cfctx->fetch_ctx->failed = TRUE; + if (cfctx->fetch_ctx->failed) { + if (error == NULL && !toobig) + error = "message fetch failed"; + } + cfctx->fetch_ctx->urlfetch = FALSE; + } + if (cfctx->search_args != NULL) + mail_search_args_unref(&cfctx->search_args); + if (cfctx->parser != NULL) + imap_parser_destroy(&cfctx->parser); + if (cfctx->input != NULL) + i_stream_unref(&cfctx->input); + if (cfctx->box != NULL) + mailbox_close(&cfctx->box); + if (cfctx->client_output != NULL) + cfctx->ctx->client->output = cfctx->client_output; + cfctx->ctx->client->output_squelch = FALSE; + + if (toobig) + client_send_tagline(cfctx->ctx->cmd, + "NO [TOOBIG] Resulting message too large"); + else if (error != NULL) + client_send_tagline(cfctx->ctx->cmd, + t_strconcat("NO [BADURL ", + imap_url_sanitize(cfctx->url), + "] ", error, NULL)); + return error == NULL && !toobig; +} + +static bool catenate_url(struct cmd_append_context *ctx, const char *url) +{ + struct imap_url_parts enc_parts, dec_parts; + const char *error = NULL; + struct catenate_fetch_context cfctx; + struct mailbox_status status; + string_t *fetch_text; + const struct imap_arg *fetch_args = NULL, *next_arg = NULL; + int fetch_ret, flush_ret, ret; + bool header, toobig; + uoff_t size; + + /* parse, decode, and validate the url */ + memset(&enc_parts, 0, sizeof enc_parts); + memset(&dec_parts, 0, sizeof dec_parts); + imap_url_parse(url, &enc_parts); + if (!imap_url_decode(&enc_parts, &dec_parts, &error) || + !catenate_url_validate(&dec_parts, &error)) { + client_send_tagline(ctx->cmd, + t_strconcat("NO [BADURL ", + imap_url_sanitize(url), + "] ", error, NULL)); + return FALSE; + } + + memset(&cfctx, 0, sizeof cfctx); + cfctx.ctx = ctx; + cfctx.url = url; + + ctx->cmd->client->output_squelch = TRUE; + + /* get the mailbox; if none in URL use the selected one */ + if (dec_parts.mailbox) { + cfctx.mailbox = t_strdup(dec_parts.mailbox); + cfctx.storage = client_find_storage(ctx->cmd, &cfctx.mailbox); + if (cfctx.storage == NULL) + return catenate_fetch_cleanup(&cfctx, FALSE, + "can't find storage"); + } else if (ctx->cmd->client->mailbox != NULL) { + cfctx.mailbox = mailbox_get_name(ctx->cmd->client->mailbox); + cfctx.storage = ctx->cmd->client->mailbox->storage; + } else + return catenate_fetch_cleanup(&cfctx, FALSE, + "no mailbox specified or selected"); + cfctx.box = mailbox_open(&cfctx.storage, cfctx.mailbox, NULL, + MAILBOX_OPEN_READONLY | MAILBOX_OPEN_KEEP_RECENT); + if (cfctx.box == NULL) + return catenate_fetch_cleanup(&cfctx, FALSE, + "can't open mailbox"); + + /* verify uidvalidity */ + if (mailbox_sync(cfctx.box, + MAILBOX_SYNC_FLAG_FULL_READ | MAILBOX_SYNC_FLAG_FAST, + STATUS_UIDVALIDITY, &status) < 0 || + (dec_parts.uidvalidity != NULL && + strtoul(dec_parts.uidvalidity, NULL, 10) != status.uidvalidity)) + return catenate_fetch_cleanup(&cfctx, FALSE, + "uidvalidity mismatch"); + + /* fetch the data as in + UID FETCH dec_parts.uid BODY.PEEK[dec_parts.section] + but with less output syntax */ + fetch_text = t_str_new(11 + (dec_parts.section ? + strlen(dec_parts.section) : 0)); + str_append(fetch_text, "BODY.PEEK["); + if (dec_parts.section) + str_append(fetch_text, dec_parts.section); + str_append(fetch_text, "]"); + + cfctx.input = i_stream_create_from_data(str_data(fetch_text), + str_len(fetch_text)); + (void) i_stream_read(cfctx.input); + + cfctx.parser = imap_parser_create(cfctx.input, NULL, (size_t) -1); + if (imap_parser_finish_line(cfctx.parser, 0, 0, &fetch_args) < 0) + return catenate_fetch_cleanup(&cfctx, FALSE, + "can't parse fetch string"); + + ctx->cmd->uid = TRUE; + if (imap_search_get_uidset_arg(ctx->cmd, dec_parts.uid, + &cfctx.search_args, &error) < 0) + return catenate_fetch_cleanup(&cfctx, FALSE, error); + + cfctx.fetch_ctx = imap_fetch_init(ctx->cmd, cfctx.box); + if (cfctx.fetch_ctx == NULL) + return catenate_fetch_cleanup(&cfctx, FALSE, + "can't init fetch"); + cfctx.fetch_ctx->search_args = cfctx.search_args; + mail_search_args_ref(cfctx.search_args); + cfctx.fetch_ctx->urlfetch = TRUE; + + if (!fetch_parse_args(cfctx.fetch_ctx, fetch_args, &next_arg)) + return catenate_fetch_cleanup(&cfctx, FALSE, + "can't parse fetch args"); + + if (imap_fetch_begin(cfctx.fetch_ctx) != 0) + return catenate_fetch_cleanup(&cfctx, FALSE, + "can't begin fetch"); + + /* fix the plumbing: imap_fetch_more() writes to + client->output, so set that to the pipe to mailbox_save()'s + input */ + cfctx.client_output = ctx->client->output; + ctx->client->output = ctx->cat.output; + + fetch_ret = 0; + flush_ret = 0; + error = NULL; + header = TRUE; + toobig = FALSE; + do { + if (fetch_ret == 0) + fetch_ret = imap_fetch_more(cfctx.fetch_ctx); + else + flush_ret = o_stream_flush(ctx->client->output); + while ((ret = i_stream_read(ctx->input)) != 0 && ret != -1) { + /* parse the header line that imap_fetch produces */ + if (header) { + char *line = i_stream_next_line(ctx->input); + if (line == NULL) + continue; + header = FALSE; + + size = 0; + line = strchr(line, '{'); + if (line != NULL) + size = strtoul(line + 1, NULL, 10); + ctx->msg_size += size; + if (ctx->msg_size > MAX_CATENATE_MSG_SIZE) { + toobig = TRUE; + ret = -1; + break; + } + } + + /* feed the message data into the new message */ + if (mailbox_save_continue(ctx->save_ctx) < 0) { + mailbox_save_cancel(&ctx->save_ctx); + ret = -1; + break; + } + } + if (ret == -1) { + if (!toobig) + error = "fetch/save failed"; + break; + } + } while (fetch_ret == 0 || flush_ret == 0); + + return catenate_fetch_cleanup(&cfctx, toobig, error); +} + +static bool catenate_continue_cancel_literal(struct client_command_context *cmd) +{ + struct client *client = cmd->client; + struct cmd_append_context *ctx = cmd->context; + size_t size; + + if (cmd->cancel) + return catenate_finish(ctx, TRUE); + + (void) i_stream_read(ctx->cat.literal_input); + (void) i_stream_get_data(ctx->cat.literal_input, &size); + i_stream_skip(ctx->cat.literal_input, size); + + if (ctx->cat.literal_input->eof || client->input->closed) { + /* finished, but there may be more URL or TEXT nonsync + literals in a continued CATENATE command */ + i_stream_unref(&ctx->cat.literal_input); + ctx->cat.literal_input = NULL; + + if (cmd->client->input->closed || ctx->args != NULL) + return catenate_finish(ctx, TRUE); + + return catenate_finish_literal(cmd, TRUE); + } + + return FALSE; +} + +static bool catenate_cancel(struct cmd_append_context *ctx, bool nonsync) +{ + ctx->failed = TRUE; + + if (!nonsync || ctx->args != NULL) + return catenate_finish(ctx, TRUE); + + /* we have to read this -- and any following -- nonsynced + literals so we don't treat the literal data as commands. */ + i_assert(ctx->cat.literal_input == NULL); + ctx->cat.literal_input = i_stream_create_limit(ctx->client->input, + ctx->cat.literal_size); + + ctx->message_input = TRUE; + ctx->cmd->func = catenate_continue_cancel_literal; + ctx->cmd->context = ctx; + return catenate_continue_cancel_literal(ctx->cmd); +} + +static bool catenate_finish(struct cmd_append_context *ctx, bool cancel) +{ + if (!cancel) { + /* close the pipe and save any lingering output, which also + crucially passes EOF down through the mailbox_save stack */ + o_stream_close(ctx->cat.output); + if (mailbox_save_continue(ctx->save_ctx) < 0 || + mailbox_save_finish(&ctx->save_ctx) < 0) { + ctx->failed = TRUE; + client_send_storage_error(ctx->cmd, ctx->storage); + cancel = TRUE; + } else { + ctx->save_ctx = NULL; + ++ctx->count; + } + + if (ctx->args == NULL) { + // eat CRLF after close of CATENATE list + ctx->cmd->client->input_skip_line = TRUE; + } + } + + if (ctx->cat.output != NULL) + o_stream_unref(&ctx->cat.output); + if (ctx->cat.literal_input != NULL) + i_stream_unref(&ctx->cat.literal_input); + if (ctx->cat.literal_url != NULL) + str_free(&ctx->cat.literal_url); + if (ctx->input != NULL) + i_stream_unref(&ctx->input); + ctx->cat.parts = 0; + + if (ctx->msg_size == 0 || ctx->count == 0) { + if (!ctx->failed) + client_send_tagline(ctx->cmd, + "NO Can't save a zero byte message."); + ctx->failed = TRUE; + cancel = TRUE; + } + + ctx->message_input = FALSE; + if (cancel) { + if (ctx->args != NULL) { + ctx->cmd->func = cmd_append_continue_parsing; + return cmd_append_continue_parsing(ctx->cmd); + } + cmd_append_finish(ctx); + return TRUE; + } else { + if (ctx->args == NULL) + imap_parser_reset(ctx->save_parser); + ctx->cmd->func = cmd_append_continue_parsing; + return cmd_append_continue_parsing(ctx->cmd); + } +} + +static bool catenate_continue_parsing(struct client_command_context *cmd) +{ + struct client *client = cmd->client; + struct cmd_append_context *ctx = cmd->context; + const struct imap_arg *args; + int ret; + bool literal, nonsync; + + if (cmd->cancel) + return catenate_finish(ctx, TRUE); + + if (client->input_skip_line && !client_skip_line(client)) + return FALSE; + ret = imap_parser_read_args(ctx->save_parser, 0, + IMAP_PARSE_FLAG_LITERAL_SIZE, &args); + if (ret == -1) { + if (!ctx->failed) + client_send_command_error(cmd, NULL); + ctx->failed = TRUE; + return catenate_finish(ctx, TRUE); + } + if (ret < 0) + return FALSE; + + // continuing the CATENATE list + i_assert(args->type == IMAP_ARG_LIST); + if (args[1].type != IMAP_ARG_EOL) { + i_assert(ctx->args == NULL); + ctx->args = &args[1]; // MULTIAPPEND + } + args = IMAP_ARG_LIST_ARGS(args); + + if (args->type == IMAP_ARG_EOL) { + /* end of CATENATE list. finish the message and return + to regular MULTIAPPEND processing */ + client->input_skip_line = ctx->args == NULL; + return catenate_finish(ctx, client->input->closed || + ctx->failed); + } + + literal = imap_parser_get_literal_size(ctx->save_parser, + &ctx->cat.literal_size); + client->input_skip_line = !literal; + nonsync = imap_parser_has_nonsync_literal(ctx->save_parser); + return ctx->failed ? catenate_cancel_args(cmd, args, nonsync) : + catenate_process_args(cmd, args, nonsync); +} + +static bool catenate_finish_literal(struct client_command_context *cmd, + bool cancel) +{ + struct cmd_append_context *ctx = cmd->context; + + ctx->message_input = FALSE; + + // continue in the CATENATE list + i_assert(ctx->args == NULL); + imap_parser_reset(ctx->save_parser); + imap_parser_open_list(ctx->save_parser); + + i_assert(!cancel || ctx->failed); + cmd->func = catenate_continue_parsing; + return catenate_continue_parsing(cmd); +} + +static bool catenate_continue_url(struct client_command_context *cmd) +{ + struct client *client = cmd->client; + struct cmd_append_context *ctx = cmd->context; + int ret; + const unsigned char *data; + size_t size; + + if (cmd->cancel) + return catenate_finish(ctx, TRUE); + + if (ctx->cat.literal_input == NULL) { + ctx->cat.literal_input = + i_stream_create_limit(client->input, + ctx->cat.literal_size); + i_assert(ctx->cat.literal_url == NULL); + ctx->cat.literal_url = str_new(cmd->pool, + ctx->cat.literal_size + 1); + ctx->message_input = TRUE; + } + + if (ctx->save_ctx != NULL) { + while (ctx->cat.literal_input->v_offset != + ctx->cat.literal_size) { + ret = i_stream_read(ctx->cat.literal_input); + data = i_stream_get_data(ctx->cat.literal_input, + &size); + buffer_append(ctx->cat.literal_url, data, size); + i_stream_skip(ctx->cat.literal_input, size); + if (ret == -1 || ret == 0) + break; + } + } + + if (ctx->save_ctx == NULL) { + (void) i_stream_read(ctx->cat.literal_input); + (void) i_stream_get_data(ctx->cat.literal_input, &size); + i_stream_skip(ctx->cat.literal_input, size); + } + + if (ctx->cat.literal_input->eof || client->input->closed) { + bool all_written = ctx->cat.literal_input->v_offset == + ctx->cat.literal_size; + + /* finished */ + i_stream_unref(&ctx->cat.literal_input); + ctx->cat.literal_input = NULL; + + if (ctx->save_ctx == NULL) { + /* failed above */ + ctx->failed = TRUE; + } else if (!all_written) { + /* client disconnected before it finished sending the + whole literal. */ + ctx->failed = TRUE; + mailbox_save_cancel(&ctx->save_ctx); + client_disconnect(client, + "EOF while sending URL literal"); + } else if (!catenate_url(ctx, str_c(ctx->cat.literal_url))) + ctx->failed = TRUE; + + str_free(&ctx->cat.literal_url); + ctx->cat.literal_url = NULL; + + if (client->input->closed) + return catenate_finish(ctx, TRUE); + + /* done with this literal, resume the CATENATE list */ + return catenate_finish_literal(cmd, ctx->failed); + } + + return FALSE; +} + +static bool catenate_continue_text(struct client_command_context *cmd) +{ + struct client *client = cmd->client; + struct cmd_append_context *ctx = cmd->context; + int ret; + size_t size; + + if (cmd->cancel) + return catenate_finish(ctx, TRUE); + + if (ctx->cat.literal_input == NULL) { + ctx->cat.literal_input = + i_stream_create_limit(client->input, + ctx->cat.literal_size); + ctx->message_input = TRUE; + } + + if (ctx->save_ctx != NULL) { + off_t send_ret = 1; + int flush_ret = 0; + + do { + if (send_ret > 0) + send_ret = o_stream_send_istream( + ctx->cat.output, + ctx->cat.literal_input); + else + flush_ret = o_stream_flush(ctx->cat.output); + while ((ret = i_stream_read(ctx->input)) != 0 && + ret != -1) { + if (mailbox_save_continue(ctx->save_ctx) < 0) { + mailbox_save_cancel(&ctx->save_ctx); + ret = -1; + break; + } + } + if (ret == -1) + break; + } while (send_ret > 0 || flush_ret == 0); + } + + if (ctx->save_ctx == NULL) { + (void) i_stream_read(ctx->cat.literal_input); + (void) i_stream_get_data(ctx->cat.literal_input, &size); + i_stream_skip(ctx->cat.literal_input, size); + } + + if (ctx->cat.literal_input->eof || client->input->closed) { + bool all_written = ctx->cat.literal_input->v_offset == + ctx->cat.literal_size; + + /* finished */ + i_stream_unref(&ctx->cat.literal_input); + ctx->cat.literal_input = NULL; + + if (ctx->save_ctx == NULL) { + /* failed above */ + client_send_storage_error(cmd, ctx->storage); + ctx->failed = TRUE; + } else if (!all_written) { + /* client disconnected before it finished sending the + whole literal. */ + ctx->failed = TRUE; + mailbox_save_cancel(&ctx->save_ctx); + client_disconnect(client, "EOF while appending"); + } + + if (client->input->closed) + return catenate_finish(ctx, TRUE); + + /* done with this literal, resume the CATENATE list */ + return catenate_finish_literal(cmd, ctx->failed); + } + + return FALSE; +} + +static bool catenate_begin_parsing(struct client_command_context *cmd, + const struct imap_arg *args) +{ + struct client *client = cmd->client; + struct cmd_append_context *ctx = cmd->context; + bool literal, nonsync; + enum mail_flags flags = 0; + struct mail_keywords *keywords = NULL; + time_t internal_date = (time_t) -1; + int ret, timezone_offset = 0; + int fds[2]; + + literal = imap_parser_get_literal_size(ctx->save_parser, + &ctx->cat.literal_size); + client->input_skip_line = !literal; + nonsync = imap_parser_has_nonsync_literal(ctx->save_parser); + + if (ctx->failed) + return catenate_cancel(ctx, nonsync); + + /* [<flags>] */ + if (args->type == IMAP_ARG_LIST) { + const struct imap_arg *flags_list = IMAP_ARG_LIST_ARGS(args); + const char *const *keywords_list = NULL; + ++args; + + if (!client_parse_mail_flags(cmd, flags_list, + &flags, &keywords_list)) + return catenate_cancel(ctx, nonsync); + if (keywords_list != NULL && + mailbox_keywords_create(ctx->box, keywords_list, + &keywords) < 0) { + client_send_storage_error(cmd, ctx->storage); + return catenate_cancel(ctx, nonsync); + } + } + + /* [<internal date>] */ + if (args->type == IMAP_ARG_STRING) { + const char *str = IMAP_ARG_STR(args); + ++args; + + if (!imap_parse_datetime(str, &internal_date, + &timezone_offset)) { + client_send_tagline(cmd, "BAD Invalid internal date."); + if (keywords != NULL) + mailbox_keywords_free(ctx->box, &keywords); + return catenate_cancel(ctx, nonsync); + } + + if (internal_date != (time_t)-1 && + internal_date > ioloop_time + INTERNALDATE_MAX_FUTURE_SECS) { + internal_date = (time_t)-1; + timezone_offset = 0; + } + } + + if (args->type != IMAP_ARG_ATOM || + strcasecmp(args->_data.str, "CATENATE") != 0 || + args[1].type != IMAP_ARG_LIST) { + // do not use client_send_command_error() + client_send_tagline(cmd, "BAD Invalid arguments."); + if (keywords != NULL) + mailbox_keywords_free(ctx->box, &keywords); + return catenate_cancel(ctx, nonsync); + } + ++args; + + /* MULTIAPPEND syntax on a single line, e.g.: + APPEND <mailbox> CATENATE (URL <url>) CATENATE (... */ + if (args[1].type != IMAP_ARG_EOL) + ctx->args = &args[1]; + + // remainder of CATENATE parsing cares only about the items in the list + args = IMAP_ARG_LIST_ARGS(args); + if (args->type == IMAP_ARG_EOL) { // empty list + client_send_tagline(cmd, "BAD Invalid arguments."); + if (keywords != NULL) + mailbox_keywords_free(ctx->box, &keywords); + return catenate_cancel(ctx, nonsync); + } + + /* The mailbox_save() API pulls data from an istream, and the + imap_fetch() API pushes data into an ostream. Dovecot does + not offer an ostream which feeds an istream, so use a UNIX + pipe. That's not the most efficient way to move the data + around, but dovecot's ostreams and istreams are sufficiently + complex (read: under-documented) that it's easier to use a + pipe than to write an ostream-to-istream module. Somebody + call a plumber. */ + if (pipe(fds) < 0) { + i_error("catenate_begin_parsing: pipe: %m"); + client_send_tagline(cmd, "NO "MAIL_ERRSTR_CRITICAL_MSG); + if (keywords != NULL) + mailbox_keywords_free(ctx->box, &keywords); + return catenate_cancel(ctx, nonsync); + } + fd_set_nonblock(fds[0], TRUE); + fd_set_nonblock(fds[1], TRUE); + ctx->cat.output = o_stream_create_fd(fds[1], PIPE_MAX, TRUE); + ctx->input = i_stream_create_fd(fds[0], PIPE_MAX, TRUE); + + /* start assembling the message */ + ctx->save_ctx = mailbox_save_alloc(ctx->t); + mailbox_save_set_flags(ctx->save_ctx, flags, keywords); + mailbox_save_set_received_date(ctx->save_ctx, + internal_date, timezone_offset); + ret = mailbox_save_begin(&ctx->save_ctx, ctx->input); + + if (keywords != NULL) + mailbox_keywords_free(ctx->box, &keywords); + + if (ret < 0) { + /* save initialization failed */ + client_send_storage_error(cmd, ctx->storage); + return catenate_cancel(ctx, nonsync); + } + ctx->msg_size = 0; + + return catenate_process_args(cmd, args, nonsync); +} + +static bool catenate_begin_cancel(struct client_command_context *cmd, + const struct imap_arg *args) +{ + struct client *client = cmd->client; + struct cmd_append_context *ctx = cmd->context; + bool literal, nonsync; + + literal = imap_parser_get_literal_size(ctx->save_parser, + &ctx->cat.literal_size); + client->input_skip_line = !literal; + nonsync = imap_parser_has_nonsync_literal(ctx->save_parser); + + /* [<flags>] */ + if (args->type == IMAP_ARG_LIST) + ++args; + + /* [<internal date>] */ + if (args->type == IMAP_ARG_STRING) + ++args; + + if (args->type != IMAP_ARG_ATOM || + strcasecmp(args->_data.str, "CATENATE") != 0 || + args[1].type != IMAP_ARG_LIST) + return catenate_cancel(ctx, nonsync); + ++args; + + /* MULTIAPPEND syntax on a single line, e.g.: + APPEND <mailbox> CATENATE (URL <url>) CATENATE (... */ + if (args[1].type != IMAP_ARG_EOL) + ctx->args = &args[1]; + + // remainder of CATENATE parsing cares only about the items in the list + args = IMAP_ARG_LIST_ARGS(args); + if (args->type == IMAP_ARG_EOL) // empty list + return catenate_cancel(ctx, nonsync); + + return catenate_cancel_args(cmd, args, nonsync); +} + +static bool catenate_process_args(struct client_command_context *cmd, + const struct imap_arg *args, bool nonsync) +{ + struct cmd_append_context *ctx = cmd->context; + + /* [URL <url>] ... [URL <literal>] */ + while (args->type == IMAP_ARG_ATOM && + strcasecmp(args->_data.str, "URL") == 0) { + if (++ctx->cat.parts > MAX_CATENATE_PARTS) { + client_send_tagline(cmd, + "BAD Too many message parts."); + return catenate_cancel(ctx, nonsync); + } + + ++args; + if (args->type == IMAP_ARG_ATOM || + args->type == IMAP_ARG_STRING) { + if (!catenate_url(ctx, args->_data.str)) + return catenate_cancel(ctx, nonsync); + ++args; + } else if (args->type == IMAP_ARG_LITERAL_SIZE || + args->type == IMAP_ARG_LITERAL_SIZE_NONSYNC) { + if (ctx->cat.literal_size > MAX_URL_LITERAL_SIZE) { + client_send_tagline(cmd, + "BAD URL literal too large"); + return catenate_cancel(ctx, nonsync); + } + + catenate_solicit(ctx, nonsync); + cmd->func = catenate_continue_url; + return catenate_continue_url(cmd); + } else { + client_send_tagline(cmd, "BAD Invalid arguments."); + return catenate_cancel(ctx, nonsync); + } + } + + /* [TEXT <literal>] */ + if (args->type == IMAP_ARG_ATOM && + strcasecmp(args->_data.str, "TEXT") == 0 && + (args[1].type == IMAP_ARG_LITERAL_SIZE || + args[1].type == IMAP_ARG_LITERAL_SIZE_NONSYNC)) { + if (++ctx->cat.parts > MAX_CATENATE_PARTS) { + client_send_tagline(cmd, + "BAD Too many message parts."); + return catenate_cancel(ctx, nonsync); + } + + ctx->msg_size += ctx->cat.literal_size; + if (ctx->msg_size > MAX_CATENATE_MSG_SIZE) { + client_send_tagline(cmd, + "NO [TOOBIG] Resulting message too large"); + return catenate_cancel(ctx, nonsync); + } + + catenate_solicit(ctx, nonsync); + cmd->func = catenate_continue_text; + return catenate_continue_text(cmd); + } else if (args->type != IMAP_ARG_EOL) { + client_send_tagline(cmd, "BAD Invalid arguments."); + return catenate_cancel(ctx, nonsync); + } + + return catenate_finish(ctx, FALSE); +} + +static bool catenate_cancel_args(struct client_command_context *cmd, + const struct imap_arg *args, bool nonsync) +{ + struct cmd_append_context *ctx = cmd->context; + + /* [URL <url>] ... [URL <literal>] */ + while (args->type == IMAP_ARG_ATOM && + strcasecmp(args->_data.str, "URL") == 0) { + ++args; + if (args->type == IMAP_ARG_ATOM || + args->type == IMAP_ARG_STRING) + ++args; + else if (args->type == IMAP_ARG_LITERAL_SIZE || + args->type == IMAP_ARG_LITERAL_SIZE_NONSYNC) + return catenate_cancel(ctx, nonsync); + } + + /* [TEXT <literal>] */ + if (args->type == IMAP_ARG_ATOM && + strcasecmp(args->_data.str, "TEXT") == 0 && + (args[1].type == IMAP_ARG_LITERAL_SIZE || + args[1].type == IMAP_ARG_LITERAL_SIZE_NONSYNC)) + return catenate_cancel(ctx, nonsync); + else if (args->type != IMAP_ARG_EOL) + return catenate_cancel(ctx, nonsync); + + return catenate_finish(ctx, TRUE); +} diff -Nur dovecot-1.2.11/src/imap/cmd-delete.c dovecot-1.2.11+lemonade/src/imap/cmd-delete.c --- dovecot-1.2.11/src/imap/cmd-delete.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/cmd-delete.c 2010-04-08 09:59:12.000000000 -0500 @@ -4,6 +4,10 @@ #include "commands.h" #include "mail-namespace.h" +/* APPLE - urlauth */ +void (*hook_delete_mailbox)(struct mail_storage *storage, + const char *mailbox) = NULL; + bool cmd_delete(struct client_command_context *cmd) { struct client *client = cmd->client; @@ -51,6 +55,10 @@ if (mailbox_list_delete_mailbox(list, name) < 0) client_send_list_error(cmd, list); else { + /* APPLE - urlauth */ + if (hook_delete_mailbox) + hook_delete_mailbox(storage, name); + client_send_tagline(cmd, "OK Delete completed."); } return TRUE; diff -Nur dovecot-1.2.11/src/imap/cmd-fetch.c dovecot-1.2.11+lemonade/src/imap/cmd-fetch.c --- dovecot-1.2.11/src/imap/cmd-fetch.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/cmd-fetch.c 2010-04-08 09:59:12.000000000 -0500 @@ -20,7 +20,7 @@ "FLAGS", "INTERNALDATE", "RFC822.SIZE", "ENVELOPE", "BODY", NULL }; -static bool +bool /* APPLE was static - urlauth */ fetch_parse_args(struct imap_fetch_context *ctx, const struct imap_arg *arg, const struct imap_arg **next_arg_r) { diff -Nur dovecot-1.2.11/src/imap/cmd-rename.c dovecot-1.2.11+lemonade/src/imap/cmd-rename.c --- dovecot-1.2.11/src/imap/cmd-rename.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/cmd-rename.c 2010-04-08 09:59:12.000000000 -0500 @@ -52,6 +52,12 @@ if (mailbox_list_rename_mailbox(list, oldname, newname) < 0) client_send_list_error(cmd, list); else { + /* APPLE - urlauth */ + extern void (*hook_delete_mailbox)(struct mail_storage *storage, + const char *mailbox); + if (hook_delete_mailbox) + hook_delete_mailbox(old_storage, oldname); + client_send_tagline(cmd, "OK Rename completed."); } return TRUE; diff -Nur dovecot-1.2.11/src/imap/cmd-select.c dovecot-1.2.11+lemonade/src/imap/cmd-select.c --- dovecot-1.2.11/src/imap/cmd-select.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/cmd-select.c 2010-04-08 09:59:12.000000000 -0500 @@ -10,6 +10,9 @@ #include <stdlib.h> +/* APPLE - urlauth */ +void (*hook_select_send_urlmech)(struct client *client) = NULL; + struct imap_select_context { struct client_command_context *cmd; struct mail_storage *storage; @@ -316,6 +319,10 @@ client->sync_last_full_modseq = status.highest_modseq; } + /* APPLE - urlauth */ + if (hook_select_send_urlmech) + hook_select_send_urlmech(client); + if (ctx->qresync_uid_validity == status.uidvalidity) { if (select_qresync(ctx) < 0) return -1; diff -Nur dovecot-1.2.11/src/imap/commands.c dovecot-1.2.11+lemonade/src/imap/commands.c --- dovecot-1.2.11/src/imap/commands.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/commands.c 2010-04-08 09:59:12.000000000 -0500 @@ -8,8 +8,12 @@ #include <stdlib.h> static const struct command imap4rev1_commands[] = { - { "CAPABILITY", cmd_capability, 0 }, - { "LOGOUT", cmd_logout, COMMAND_FLAG_BREAKS_MAILBOX }, + { "CAPABILITY", cmd_capability, 0 + /* APPLE - urlauth */ + | COMMAND_FLAG_OK_FOR_SUBMIT_USER }, + { "LOGOUT", cmd_logout, COMMAND_FLAG_BREAKS_MAILBOX + /* APPLE - urlauth */ + | COMMAND_FLAG_OK_FOR_SUBMIT_USER }, { "NOOP", cmd_noop, COMMAND_FLAG_BREAKS_SEQS }, { "APPEND", cmd_append, COMMAND_FLAG_BREAKS_SEQS }, @@ -43,7 +47,9 @@ static const struct command imap_ext_commands[] = { { "CANCELUPDATE", cmd_cancelupdate,0 }, { "ENABLE", cmd_enable, 0 }, - { "ID", cmd_id, 0 }, + { "ID", cmd_id, 0 + /* APPLE - urlauth */ + | COMMAND_FLAG_OK_FOR_SUBMIT_USER }, { "IDLE", cmd_idle, COMMAND_FLAG_BREAKS_SEQS | COMMAND_FLAG_REQUIRES_SYNC }, { "NAMESPACE", cmd_namespace, 0 }, diff -Nur dovecot-1.2.11/src/imap/commands.h dovecot-1.2.11+lemonade/src/imap/commands.h --- dovecot-1.2.11/src/imap/commands.h 2010-01-19 05:56:56.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/commands.h 2010-04-08 09:59:12.000000000 -0500 @@ -28,7 +28,10 @@ Dovecot internally returns it for all kinds of commands, but unfortunately RFC 5530 specifies it only for "delete something" operations. */ - COMMAND_FLAG_USE_NONEXISTENT = 0x10 + COMMAND_FLAG_USE_NONEXISTENT = 0x10, + + /* APPLE - urlauth */ + COMMAND_FLAG_OK_FOR_SUBMIT_USER = 0x20 }; struct command { @@ -108,4 +111,10 @@ bool cmd_select_full(struct client_command_context *cmd, bool readonly); bool cmd_subscribe_full(struct client_command_context *cmd, bool subscribe); +/* APPLE fetch_parse_args() was static - urlauth */ +struct imap_fetch_context; +bool fetch_parse_args(struct imap_fetch_context *ctx, + const struct imap_arg *arg, + const struct imap_arg **next_arg_r); + #endif diff -Nur dovecot-1.2.11/src/imap/imap-fetch-body.c dovecot-1.2.11+lemonade/src/imap/imap-fetch-body.c --- dovecot-1.2.11/src/imap/imap-fetch-body.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/imap-fetch-body.c 2010-04-08 09:59:12.000000000 -0500 @@ -113,6 +113,8 @@ else str_append_c(str, ' '); + /* APPLE - urlauth */ + if (!ctx->urlfetch) /* reduce code deltas */ str_append(str, get_body_name(body)); if (size != (uoff_t)-1) diff -Nur dovecot-1.2.11/src/imap/imap-fetch.c dovecot-1.2.11+lemonade/src/imap/imap-fetch.c --- dovecot-1.2.11/src/imap/imap-fetch.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/imap-fetch.c 2010-04-08 09:59:12.000000000 -0500 @@ -449,6 +449,10 @@ break; ctx->cur_mail = ctx->mail; + /* APPLE - urlauth */ + if (ctx->urlfetch) + ctx->urlfetched = TRUE; + else /* reduce code deltas */ str_printfa(ctx->cur_str, "* %u FETCH (", ctx->cur_mail->seq); ctx->first = TRUE; @@ -504,6 +508,9 @@ ctx->line_finished = TRUE; ctx->line_partial = FALSE; + + /* APPLE - urlauth */ + if (!ctx->urlfetch) /* reduce code deltas */ if (o_stream_send(client->output, ")\r\n", 3) < 0) return -1; client->last_output = ioloop_time; @@ -761,6 +768,8 @@ static int fetch_uid(struct imap_fetch_context *ctx, struct mail *mail, void *context ATTR_UNUSED) { + /* APPLE - urlauth */ + if (!ctx->urlfetch) /* reduce code deltas */ str_printfa(ctx->cur_str, "UID %u ", mail->uid); return 1; } diff -Nur dovecot-1.2.11/src/imap/imap-fetch.h dovecot-1.2.11+lemonade/src/imap/imap-fetch.h --- dovecot-1.2.11/src/imap/imap-fetch.h 2009-06-26 23:49:34.000000000 -0500 +++ dovecot-1.2.11+lemonade/src/imap/imap-fetch.h 2010-04-08 09:59:12.000000000 -0500 @@ -73,6 +73,8 @@ unsigned int partial_fetch:1; unsigned int send_vanished:1; unsigned int failed:1; + unsigned int urlfetch:1; /* APPLE - urlauth */ + unsigned int urlfetched:1; /* APPLE - urlauth */ }; void imap_fetch_handlers_register(const struct imap_fetch_handler *handlers, diff -Nur dovecot-1.2.11/src/imap/imap-search-args.c dovecot-1.2.11+lemonade/src/imap/imap-search-args.c --- dovecot-1.2.11/src/imap/imap-search-args.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/imap-search-args.c 2010-04-08 09:59:12.000000000 -0500 @@ -112,7 +112,7 @@ return 0; } -static int +int /* APPLE was static - urlauth */ imap_search_get_uidset_arg(struct client_command_context *cmd, const char *uidset, struct mail_search_args **args_r, const char **error_r) diff -Nur dovecot-1.2.11/src/imap/imap-search-args.h dovecot-1.2.11+lemonade/src/imap/imap-search-args.h --- dovecot-1.2.11/src/imap/imap-search-args.h 2009-02-21 13:17:03.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/imap-search-args.h 2010-04-08 09:59:12.000000000 -0500 @@ -25,4 +25,10 @@ const char *set, bool uid, struct mail_search_args **search_args_r); +/* APPLE was static - urlauth */ +int imap_search_get_uidset_arg(struct client_command_context *cmd, + const char *uidset, + struct mail_search_args **args_r, + const char **error_r); + #endif diff -Nur dovecot-1.2.11/src/lib-imap/Makefile.am dovecot-1.2.11+lemonade/src/lib-imap/Makefile.am --- dovecot-1.2.11/src/lib-imap/Makefile.am 2008-11-15 13:04:59.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/lib-imap/Makefile.am 2010-04-08 09:59:13.000000000 -0500 @@ -15,6 +15,7 @@ imap-parser.c \ imap-quote.c \ imap-seqset.c \ + imap-url.c \ imap-utf7.c \ imap-util.c @@ -29,6 +30,7 @@ imap-resp-code.h \ imap-quote.h \ imap-seqset.h \ + imap-url.h \ imap-utf7.h \ imap-util.h diff -Nur dovecot-1.2.11/src/lib-imap/Makefile.in dovecot-1.2.11+lemonade/src/lib-imap/Makefile.in --- dovecot-1.2.11/src/lib-imap/Makefile.in 2010-03-08 11:31:07.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/lib-imap/Makefile.in 2010-04-08 09:59:13.000000000 -0500 @@ -55,7 +55,8 @@ imap-bodystructure.$(OBJEXT) imap-date.$(OBJEXT) \ imap-envelope.$(OBJEXT) imap-id.$(OBJEXT) imap-match.$(OBJEXT) \ imap-parser.$(OBJEXT) imap-quote.$(OBJEXT) \ - imap-seqset.$(OBJEXT) imap-utf7.$(OBJEXT) imap-util.$(OBJEXT) + imap-seqset.$(OBJEXT) imap-url.$(OBJEXT) imap-utf7.$(OBJEXT) \ + imap-util.$(OBJEXT) libimap_a_OBJECTS = $(am_libimap_a_OBJECTS) DEFAULT_INCLUDES = -I.@am__isrc@ -I$(top_builddir) depcomp = $(SHELL) $(top_srcdir)/depcomp @@ -75,11 +76,11 @@ am__noinst_HEADERS_DIST = imap-base-subject.h imap-bodystructure.h \ imap-date.h imap-envelope.h imap-id.h imap-match.h \ imap-parser.h imap-resp-code.h imap-quote.h imap-seqset.h \ - imap-utf7.h imap-util.h + imap-url.h imap-utf7.h imap-util.h am__pkginc_lib_HEADERS_DIST = imap-base-subject.h imap-bodystructure.h \ imap-date.h imap-envelope.h imap-id.h imap-match.h \ imap-parser.h imap-resp-code.h imap-quote.h imap-seqset.h \ - imap-utf7.h imap-util.h + imap-url.h imap-utf7.h imap-util.h am__vpath_adj_setup = srcdirstrip=`echo "$(srcdir)" | sed 's|.|.|g'`; am__vpath_adj = case $$p in \ $(srcdir)/*) f=`echo "$$p" | sed "s|^$$srcdirstrip/||"`;; \ @@ -275,6 +276,7 @@ imap-parser.c \ imap-quote.c \ imap-seqset.c \ + imap-url.c \ imap-utf7.c \ imap-util.c @@ -289,6 +291,7 @@ imap-resp-code.h \ imap-quote.h \ imap-seqset.h \ + imap-url.h \ imap-utf7.h \ imap-util.h @@ -352,6 +355,7 @@ @AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/imap-parser.Po@am__quote@ @AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/imap-quote.Po@am__quote@ @AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/imap-seqset.Po@am__quote@ +@AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/imap-url.Po@am__quote@ @AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/imap-utf7.Po@am__quote@ @AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/imap-util.Po@am__quote@ diff -Nur dovecot-1.2.11/src/lib-imap/imap-parser.c dovecot-1.2.11+lemonade/src/lib-imap/imap-parser.c --- dovecot-1.2.11/src/lib-imap/imap-parser.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/lib-imap/imap-parser.c 2010-04-08 09:59:13.000000000 -0500 @@ -133,7 +133,8 @@ return arg; } -static void imap_parser_open_list(struct imap_parser *parser) +/* APPLE - catenate - was static */ +void imap_parser_open_list(struct imap_parser *parser) { parser->list_arg = imap_arg_create(parser); parser->list_arg->type = IMAP_ARG_LIST; @@ -649,6 +650,37 @@ return TRUE; } +/* APPLE - catenate */ +bool imap_parser_has_nonsync_literal(struct imap_parser *parser) +{ + ARRAY_TYPE(imap_arg_list) *list; + struct imap_arg *args; + unsigned int count; + + list = &parser->root_list; + args = array_get_modifiable(&parser->root_list, &count); + i_assert(count > 1 && args[count-1].type == IMAP_ARG_EOL); + count--; + + while (args[count-1].type != IMAP_ARG_LITERAL_SIZE && + args[count-1].type != IMAP_ARG_LITERAL_SIZE_NONSYNC) { + if (args[count-1].type != IMAP_ARG_LIST) + return FALSE; + + /* maybe the list ends with nonsync literal */ + list = &args[count-1]._data.list; + args = array_get_modifiable(list, &count); + + /* you might think the same assertion above would apply + here, but if a list has IMAP_ARG_LITERAL_SIZE* + there is no IMAP_ARG_EOL after it */ + if (count == 0) + return FALSE; + } + + return args[count-1].type == IMAP_ARG_LITERAL_SIZE_NONSYNC; +} + void imap_parser_read_last_literal(struct imap_parser *parser) { ARRAY_TYPE(imap_arg_list) *list; diff -Nur dovecot-1.2.11/src/lib-imap/imap-parser.h dovecot-1.2.11+lemonade/src/lib-imap/imap-parser.h --- dovecot-1.2.11/src/lib-imap/imap-parser.h 2009-03-30 20:41:03.000000000 -0500 +++ dovecot-1.2.11+lemonade/src/lib-imap/imap-parser.h 2010-04-08 09:59:13.000000000 -0500 @@ -112,6 +112,9 @@ given. */ const char *imap_parser_get_error(struct imap_parser *parser, bool *fatal); +/* APPLE - catenate - was static */ +void imap_parser_open_list(struct imap_parser *parser); + /* Read a number of arguments. This function doesn't call i_stream_read(), you need to do that. Returns number of arguments read (may be less than count in case of EOL), -2 if more data is needed or -1 if error occurred. @@ -130,6 +133,9 @@ literal data when continuing argument parsing. */ void imap_parser_read_last_literal(struct imap_parser *parser); +/* APPLE - catenate */ +bool imap_parser_has_nonsync_literal(struct imap_parser *parser); + /* just like imap_parser_read_args(), but assume \n at end of data in input stream. */ int imap_parser_finish_line(struct imap_parser *parser, unsigned int count, diff -Nur dovecot-1.2.11/src/lib-imap/imap-url.c dovecot-1.2.11+lemonade/src/lib-imap/imap-url.c --- dovecot-1.2.11/src/lib-imap/imap-url.c 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/lib-imap/imap-url.c 2010-04-08 10:20:47.000000000 -0500 @@ -0,0 +1,741 @@ +/* + * Copyright (c) 2010 Apple Inc. All rights reserved. + * + * Redistribution and use in source and binary forms, with or without + * modification, are permitted provided that the following conditions + * are met: + * + * 1. Redistributions of source code must retain the above copyright + * notice, this list of conditions and the following disclaimer. + * 2. Redistributions in binary form must reproduce the above + * copyright notice, this list of conditions and the following + * disclaimer in the documentation and/or other materials provided + * with the distribution. + * 3. Neither the name of Apple Inc. ("Apple") nor the names of its + * contributors may be used to endorse or promote products derived + * from this software without specific prior written permission. + * + * THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND + * ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, + * THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A + * PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS + * CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF + * USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND + * ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, + * OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT + * OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF + * SUCH DAMAGE. + */ + +#include "lib.h" +#include "str.h" +#include "utc-mktime.h" +#include "imap-utf7.h" +#include "imap-url.h" + +#include <time.h> +#include <ctype.h> + +#define MECH_INTERNAL_ONLY 1 + +#define LOWALPHA "abcdefghijklmnopqrstuvwxyz" /* RFC 1738 */ +#define HIALPHA "ABCDEFGHIJKLMNOPQRSTUVWXYZ" /* RFC 1738 */ +#define ALPHA LOWALPHA""HIALPHA /* RFC 1738 */ +#define DIGIT "0123456789" /* RFC 1738 */ +#define SAFE "$-_.+" /* RFC 1738 */ +#define EXTRA "!*'()," /* RFC 1738 */ +#define UNRESERVED ALPHA""DIGIT""SAFE""EXTRA /* RFC 1738 */ +#define ESCAPE "%" /* RFC 1738 */ +#define UCHAR UNRESERVED""ESCAPE /* RFC 1738 */ +#define ACHAR UCHAR"&=~" /* RFC 2192 */ +#define BCHAR ACHAR":@/" /* RFC 2192 */ +#define HEXDIG DIGIT"ABCDEFabcdef" /* RFC 2234 */ +#define HOST_CHARS ALPHA".:-"DIGIT /* RFC 1738 */ +#define DATETIME_CHARS DIGIT".+-:TZ" /* RFC 3339 */ + +// any CHAR except "(" / ")" / "{" / SP / CTL / "%" / "*" / '"' / "\" / "]" +#define ATOM_CHARS "\ +!#$&'+,-./0123456789:;<=>?@\ +ABCDEFGHIJKLMNOPQRSTUVWXYZ[^_`\ +abcdefghijklmnopqrstuvwxyz|}~" + +// any CHAR except "(" / ")" / "{" / SP / CTL / "%" / "*" / '"' / "\" +#define ASTRING_CHARS ATOM_CHARS"]" + +static char atom_chars_allowed[256]; +static char astring_chars_allowed[256]; +static char quoted_allowed[256]; // any CHAR except '"' / "\" / CR / LF +static char quoted_specials_allowed[256]; // any CHAR except CR / LF +static char host_chars_allowed[256]; +static char url_resp_allowed[256]; +static bool initialized = FALSE; + +// initialize the *_allowed tables once +static void init_allowed(void) +{ + if (!initialized) { + const unsigned char *cp; + int i; + + for (cp = (const unsigned char *) ATOM_CHARS; *cp; cp++) + atom_chars_allowed[*cp & 0xff] = 1; + + for (cp = (const unsigned char *) ASTRING_CHARS; *cp; cp++) + astring_chars_allowed[*cp & 0xff] = 1; + + for (cp = (const unsigned char *) HOST_CHARS; *cp; cp++) + host_chars_allowed[*cp & 0xff] = 1; + + for (i = 0x01; i <= 0x7f; i++) + quoted_specials_allowed[i] = 1; + quoted_specials_allowed['\r'] = 0; + quoted_specials_allowed['\n'] = 0; + memcpy(quoted_allowed, quoted_specials_allowed, + sizeof quoted_allowed); + quoted_allowed['"'] = 0; + quoted_allowed['\\'] = 0; + + for (i = 0x01; i <= 0x09; i++) + url_resp_allowed[i] = 1; + for (i = 0x0b; i <= 0x0c; i++) + url_resp_allowed[i] = 1; + // RFC 4469 erroneously skips 0x5c but that's "\" not "]" + for (i = 0x0e; i <= 0x5c; i++) + url_resp_allowed[i] = 1; + for (i = 0x5e; i <= 0xfe; i++) + url_resp_allowed[i] = 1; + + initialized = TRUE; + } +} + +// URL-decode enc into dec (%XX decoding) +bool url_decode(const char *enc, string_t *dec) +{ + const char *cp; + + for (cp = enc; *cp; cp++) { + if (*cp == '%') { + unsigned int val; + if (cp[1] >= '0' && cp[1] <= '9') + val = cp[1] - '0'; + else if (cp[1] >= 'A' && cp[1] <= 'F') + val = 10 + cp[1] - 'A'; + else if (cp[1] >= 'a' && cp[1] <= 'f') + val = 10 + cp[1] - 'a'; + else + return FALSE; + val *= 16; + if (cp[2] >= '0' && cp[2] <= '9') + val += cp[2] - '0'; + else if (cp[2] >= 'A' && cp[2] <= 'F') + val += 10 + cp[2] - 'A'; + else if (cp[2] >= 'a' && cp[2] <= 'f') + val += 10 + cp[2] - 'a'; + else + return FALSE; + if (val == 0 || val > 0xff) + return FALSE; + str_append_c(dec, val); + cp += 2; + } else + str_append_c(dec, *cp); + } + + return TRUE; +} + +// parse an RFC 2192+4467 URL into its parts +void imap_url_parse(const char *url, struct imap_url_parts *parts) +{ + const char *rump, *p; + size_t s; + + rump = url; + + // "imap://" ... + if (strncasecmp(url, "imap://", 7) == 0) { + url += 7; + + // ... enc-user ... + s = strcspn(url, ";@"); + if (s <= 0) + return; + parts->user = t_strdup_until(url, url + s); + url += s; + + // ... [";AUTH=" ( "*" / enc_auth_type )] ... + if (strncasecmp(url, ";AUTH=", 6) == 0) { + url += 6; + p = strchr(url, '@'); + if (p == NULL) + return; + parts->auth_type = t_strdup_until(url, p); + url = p; + } + + // ... "@" hostport ... + if (*url != '@') + return; + ++url; + p = strchr(url, '/'); + if (p == NULL) + return; + parts->hostport = t_strdup_until(url, p); + url = p; + } + + // ... ["/" enc_mailbox] ... + if (*url == '/' && strncasecmp(url, "/;UID=", 6) != 0) { + ++url; + p = strcasestr(url, ";UIDVALIDITY="); + if (p == NULL) + p = strcasestr(url, "/;UID="); + if (p == NULL) + return; + parts->mailbox = t_strdup_until(url, p); + url = p; + } + + // ... [";UIDVALIDITY=" nz_number] ... + if (strncasecmp(url, ";UIDVALIDITY=", 13) == 0) { + url += 13; + p = strchr(url, '/'); + if (p == NULL) + return; + parts->uidvalidity = t_strdup_until(url, p); + url = p; + } + + // ... ["/;UID=" nz_number] ... + if (strncasecmp(url, "/;UID=", 6) == 0) { + url += 6; + s = strcspn(url, ";/"); + if (s <= 0) + return; + parts->uid = t_strdup_until(url, url + s); + url += s; + } + + // ... ["/;SECTION=" enc_section] ... + if (strncasecmp(url, "/;SECTION=", 10) == 0) { + url += 10; + p = strchr(url, ';'); + if (p == NULL) { + parts->section = t_strdup(url); + return; + } + parts->section = t_strdup_until(url, p); + url = p; + } + + // ... [";EXPIRE=" date-time] ... + if (strncasecmp(url, ";EXPIRE=", 8) == 0) { + url += 8; + p = strchr(url, ';'); + if (p == NULL) + return; + parts->expiration = t_strdup_until(url, p); + // set expiration_time after decoding + url = p; + } + + // ... [";URLAUTH=" access] ... + if (strncasecmp(url, ";URLAUTH=", 9) != 0) + return; + url += 9; + p = strchr(url, ':'); + if (p == NULL) { + parts->access = url; + return; + } + parts->access = t_strdup_until(url, p); + url = p; + + // save rump + parts->rump = t_strdup_until(rump, url); + + // ... [ ":INTERNAL:" 32*HEXDIG ] + if (strncasecmp(url, ":INTERNAL:", 10) != 0) + return; + parts->mechanism = "INTERNAL"; + url += 10; + parts->urlauth = url; +} + +// parse an RFC 3339 date-time into a time_t, or return 0 +static time_t imap_url_date_time_parse(const char *s) +{ + struct tm tm; + time_t t; + + memset(&tm, 0, sizeof tm); + + /* YYYY- */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1]) || + !i_isdigit(s[2]) || !i_isdigit(s[3]) || s[4] != '-') + return 0; + tm.tm_year = (((s[0] - '0') * 10 + s[1] - '0') * 10 + + s[2] - '0') * 10 + s[3] - '0' - 1900; + s += 5; + + /* MM- */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1]) || s[2] != '-') + return 0; + tm.tm_mon = (s[0] - '0') * 10 + s[1] - '0'; + if (tm.tm_mon < 1 || tm.tm_mon > 12) + return 0; + --tm.tm_mon; /* 0-11 not 1-12 */ + s += 3; + + /* DDT */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1]) || i_toupper(s[2]) != 'T') + return 0; + tm.tm_mday = (s[0] - '0') * 10 + s[1] - '0'; + s += 3; + + /* HH: */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1]) || s[2] != ':') + return 0; + tm.tm_hour = (s[0] - '0') * 10 + s[1] - '0'; + s += 3; + + /* MM: */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1]) || s[2] != ':') + return 0; + tm.tm_min = (s[0] - '0') * 10 + s[1] - '0'; + s += 3; + + /* SS */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1])) + return 0; + tm.tm_sec = (s[0] - '0') * 10 + s[1] - '0'; + s += 2; + + /* skip optional fractional seconds */ + if (*s == '.') { + do + ++s; + while (i_isdigit(*s)); + } + + if (i_toupper(s[0]) == 'Z' && s[1] == '\0') + tm.tm_gmtoff = 0; + else if (s[0] == '+' || s[0] == '-') { + char tzsign = *s++; + + /* HH: */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1]) || s[2] != ':') + return 0; + tm.tm_gmtoff = ((s[0] - '0') * 10 + s[1] - '0') * 3600; + s += 3; + + /* MM */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1]) || s[2] != '\0') + return 0; + tm.tm_gmtoff += ((s[0] - '0') * 10 + s[1] - '0') * 60; + + if (tzsign == '-') + tm.tm_gmtoff = -tm.tm_gmtoff; + } else + return 0; + + t = utc_mktime(&tm); + if (t < 0) + return 0; + return t - tm.tm_gmtoff; +} + +// decode the parts of a URL +bool imap_url_decode(const struct imap_url_parts *enc_parts, + struct imap_url_parts *dec_parts, + const char **error) +{ + string_t *str = t_str_new(256); + +#define URL_DECODE(field, name) \ + if (enc_parts->field != NULL) { \ + if (url_decode(enc_parts->field, str)) \ + dec_parts->field = t_strdup(str_c(str)); \ + else { \ + *error = "invalid " name; \ + str_free(&str); \ + return FALSE; \ + } \ + } \ + str_truncate(str, 0); + + URL_DECODE(user, "user ID"); + URL_DECODE(auth_type, "auth type"); + URL_DECODE(hostport, "server"); + URL_DECODE(mailbox, "mailbox"); + URL_DECODE(uidvalidity, "uidvalidity"); + URL_DECODE(uid, "uid"); + URL_DECODE(section, "section"); + URL_DECODE(expiration, "expiration"); + URL_DECODE(access, "access ID"); + URL_DECODE(mechanism, "mechanism"); + URL_DECODE(urlauth, "urlauth token"); + // do not set dec_parts->rump + + if (dec_parts->mailbox != NULL) { + if (imap_utf8_to_utf7(dec_parts->mailbox, str) == 0) + dec_parts->mailbox = t_strdup(str_c(str)); + else { + *error = "invalid UTF-8 mailbox"; + str_free(&str); + return FALSE; + } + } + str_truncate(str, 0); + + if (dec_parts->expiration != NULL) + dec_parts->expiration_time = + imap_url_date_time_parse(dec_parts->expiration); + + str_free(&str); + + return TRUE; +} + +// validate conformance to RFC 3501 "atom" +bool imap_url_atom_validate(const char *s) +{ + const unsigned char *cp; + + if (*s == '\0') + return FALSE; + + init_allowed(); + + for (cp = (const unsigned char *) s; *cp; cp++) + if (!atom_chars_allowed[*cp & 0xff]) + return FALSE; + return TRUE; +} + +// validate conformance to RFC 3501 "ASTRING-CHAR" +bool imap_url_astring_chars_validate(const char *s) +{ + const unsigned char *cp; + + init_allowed(); + + for (cp = (const unsigned char *) s; *cp; cp++) + if (!astring_chars_allowed[*cp & 0xff]) + return FALSE; + return TRUE; +} + +// validate conformance to RFC 3501 "quoted" +bool imap_url_quoted_validate(const char *s) +{ + const unsigned char *cp; + + if (*s != '"') + return FALSE; + + init_allowed(); + + for (cp = (unsigned char *) s + 1; *cp; cp++) { + if (*cp == '\\') { + if (!quoted_specials_allowed[cp[1] & 0xff]) + return FALSE; + ++cp; + } else if (*cp == '"') + return cp[1] == '\0'; + else { + if (!quoted_allowed[*cp & 0xff]) + return FALSE; + } + } + + return FALSE; +} + +// validate conformance to RFC 3501 "literal" +bool imap_url_literal_validate(const char *s) +{ + const unsigned char *cp; + unsigned int length = 0; + + if (*s != '{') + return FALSE; + for (cp = (const unsigned char *) s + 1; *cp && *cp != '}'; cp++) { + if (*cp < '0' || *cp > '9') + return FALSE; + length = length * 10 + *cp - '0'; + } + if (cp == (const unsigned char *) s + 1 || *cp != '}') + return FALSE; + ++cp; + if (*cp == '\r') + ++cp; + if (*cp != '\n') + return FALSE; + if (strlen((const char *) cp + 1) != length) + return FALSE; + return TRUE; +} + +// validate conformance to RFC 3501 "astring" +bool imap_url_astring_validate(const char *s) +{ + return *s != '\0' && + (imap_url_astring_chars_validate(s) || + imap_url_quoted_validate(s) || + imap_url_literal_validate(s)); +} + +// validate conformance to RFC 1738 "hostport" +bool imap_url_hostport_validate(const char *s) +{ + const unsigned char *cp; + + if (*s == '\0') + return FALSE; + + init_allowed(); + + for (cp = (const unsigned char *) s; *cp; cp++) + if (!host_chars_allowed[*cp & 0xff]) + return FALSE; + return TRUE; +} + +// validate conformance to RFC 3501 "mailbox" +bool imap_url_mailbox_validate(const char *s) +{ + const char *qs; + + if (strcasecmp(s, "INBOX") == 0 || imap_url_astring_validate(s)) + return TRUE; + + // RFC 2192 implies quotes around mailboxes containing, e.g., SP + qs = t_strconcat("\"", s, "\"", NULL); + return imap_url_quoted_validate(qs); +} + +// validate conformance to RFC 3501 "nz_number" +bool imap_url_nz_number_validate(const char *s) +{ + if (*s < '1' || *s > '9') + return FALSE; + while (*++s) + if (*s < '0' || *s > '9') + return FALSE; + return TRUE; +} + +// validate conformance to RFC 3501 "section-text" +bool imap_url_section_text_validate(const char *s) +{ + size_t spn; + const char *field; + + if (strcasecmp(s, "HEADER") == 0 || + strcasecmp(s, "TEXT") == 0 || + strcasecmp(s, "MIME") == 0) + return TRUE; + + if (strncasecmp(s, "HEADER.FIELDS", 13) != 0) + return FALSE; + s += 13; + + if (strncasecmp(s, ".NOT", 4) == 0) + s += 4; + + if (*s != ' ') + return FALSE; + ++s; + + if (*s != '(') + return FALSE; + ++s; + + spn = strcspn(s, " )"); + if (spn <= 0) + return FALSE; + field = t_strdup_until(s, s + spn); + if (!imap_url_astring_validate(field)) + return FALSE; + s += spn; + + while (*s == ' ') { + ++s; + spn = strcspn(s, " )"); + if (spn <= 0) + return FALSE; + field = t_strdup_until(s, s + spn); + if (!imap_url_astring_validate(field)) + return FALSE; + s += spn; + } + + if (*s != ')') + return FALSE; + ++s; + + return *s == '\0'; +} + +// validate conformance to RFC 2192 "section" +bool imap_url_section_validate(const char *s) +{ + size_t spn; + const char *part; + + if (imap_url_section_text_validate(s)) + return TRUE; + + spn = strspn(s, DIGIT); + if (spn <= 0) + return FALSE; + part = t_strdup_until(s, s + spn); + if (!imap_url_nz_number_validate(part)) + return FALSE; + s += spn; + + while (*s == '.') { + ++s; + spn = strspn(s, DIGIT); + if (spn <= 0) { + --s; + break; + } + part = t_strdup_until(s, s + spn); + if (!imap_url_nz_number_validate(part)) + return FALSE; + s += spn; + } + + if (*s == '.') { + ++s; + return imap_url_section_text_validate(s); + } + + return *s == '\0'; +} + +// validate conformance to RFC 3339 "date-time" +bool imap_url_datetime_validate(const char *s) +{ + return *s != '\0' && strspn(s, DATETIME_CHARS) == strlen(s); +} + +// validate conformance to RFC 4467 "access" +bool imap_url_access_validate(const char *s) +{ + if (strncasecmp(s, "submit+", 7) == 0) + return imap_url_astring_validate(s + 7); + if (strncasecmp(s, "user+", 5) == 0) + return imap_url_astring_validate(s + 5); + return strcasecmp(s, "authuser") == 0 || + strcasecmp(s, "anonymous") == 0; +} + +// validate conformance to RFC 4467 "mechanism" +bool imap_url_mechanism_validate(const char *s) +{ +#if MECH_INTERNAL_ONLY + return strcasecmp(s, "INTERNAL") == 0; +#else + if (strcasecmp(s, "INTERNAL") == 0) + return TRUE; + if (*s == '\0') + return FALSE; + do { + if ((*s < 'A' || *s > 'Z') && + (*s < 'a' || *s > 'z') && + (*s < '0' || *s > '9') && + *s != '-' && *s != '.') + return FALSE; + } while (*++s); + return TRUE; +#endif +} + +// validate conformance to RFC 4467 "urlauth" (really enc-urlauth) +bool imap_url_urlauth_validate(const char *s) +{ + const char *cp; + + for (cp = s; *cp; cp++) { + if ((*cp < '0' || *cp > '9') && + (*cp < 'A' || *cp > 'F') && + (*cp < 'a' || *cp > 'f')) + return FALSE; + } + + return cp - s >= 32; +} + +// convert URL parts into a real URL +void imap_url_construct(const struct imap_url_parts *parts, string_t *url) +{ + str_append(url, "imap://"); + if (parts->user) + str_append(url, parts->user); + if (parts->auth_type) { + str_append(url, ";AUTH="); + str_append(url, parts->auth_type); + } + if (parts->hostport) { + str_append_c(url, '@'); + str_append(url, parts->hostport); + } + str_append_c(url, '/'); + if (parts->mailbox) + str_append(url, parts->mailbox); + if (parts->uidvalidity) { + str_append(url, ";UIDVALIDITY="); + str_append(url, parts->uidvalidity); + } + if (parts->uid) { + str_append(url, "/;UID="); + str_append(url, parts->uid); + } + if (parts->section) { + str_append(url, "/;SECTION="); + str_append(url, parts->section); + } + if (parts->expiration) { + str_append(url, ";EXPIRE="); + str_append(url, parts->expiration); + } + if (parts->access) { + str_append(url, ";URLAUTH="); + str_append(url, parts->access); + } + if (parts->mechanism) { + str_append_c(url, ':'); + str_append(url, parts->mechanism); + } + if (parts->urlauth) { + str_append_c(url, ':'); + str_append(url, parts->urlauth); + } +} + +// filter a URL according to RFC 4469 url-resp-text +const char *imap_url_sanitize(const char *url) +{ + const char *cp; + string_t *str; + + init_allowed(); + + for (cp = url; *cp && url_resp_allowed[(unsigned char) *cp]; cp++) + ; + if (*cp == '\0') + return url; + + str = t_str_new(strlen(cp) + 1); + str_append_n(str, url, cp - url); + for ( ; *cp; cp++) + str_append_c(str, + url_resp_allowed[(unsigned char) *cp] ? *cp : '?'); + return str_c(str); +} diff -Nur dovecot-1.2.11/src/lib-imap/imap-url.h dovecot-1.2.11+lemonade/src/lib-imap/imap-url.h --- dovecot-1.2.11/src/lib-imap/imap-url.h 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/lib-imap/imap-url.h 2010-03-05 14:14:18.000000000 -0600 @@ -0,0 +1,100 @@ +/* + * Copyright (c) 2010 Apple Inc. All rights reserved. + * + * Redistribution and use in source and binary forms, with or without + * modification, are permitted provided that the following conditions + * are met: + * + * 1. Redistributions of source code must retain the above copyright + * notice, this list of conditions and the following disclaimer. + * 2. Redistributions in binary form must reproduce the above + * copyright notice, this list of conditions and the following + * disclaimer in the documentation and/or other materials provided + * with the distribution. + * 3. Neither the name of Apple Inc. ("Apple") nor the names of its + * contributors may be used to endorse or promote products derived + * from this software without specific prior written permission. + * + * THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND + * ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, + * THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A + * PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS + * CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF + * USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND + * ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, + * OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT + * OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF + * SUCH DAMAGE. + */ + +/* APPLE - urlauth, catenate */ + +#ifndef IMAP_URL_H +#define IMAP_URL_H + +struct imap_url_parts { + const char *user; + const char *auth_type; + const char *hostport; + const char *mailbox; + const char *uidvalidity; + const char *uid; + const char *section; + const char *expiration; + time_t expiration_time; + const char *access; + const char *mechanism; + const char *urlauth; + + const char *rump; +}; + +// URL-decode enc into dec (%XX decoding) +bool url_decode(const char *enc, string_t *dec); + +// parse an RFC 2192+4467 URL into its parts +void imap_url_parse(const char *url, struct imap_url_parts *parts); + +// decode the parts of an IMAP URL +bool imap_url_decode(const struct imap_url_parts *enc_parts, + struct imap_url_parts *dec_parts, + const char **error); + +// validate conformance to RFC 3501 "atom" +bool imap_url_atom_validate(const char *s); +// validate conformance to RFC 3501 "ASTRING-CHAR" +bool imap_url_astring_chars_validate(const char *s); +// validate conformance to RFC 3501 "quoted" +bool imap_url_quoted_validate(const char *s); +// validate conformance to RFC 3501 "literal" +bool imap_url_literal_validate(const char *s); +// validate conformance to RFC 3501 "astring" +bool imap_url_astring_validate(const char *s); +// validate conformance to RFC 1738 "hostport" +bool imap_url_hostport_validate(const char *s); +// validate conformance to RFC 3501 "mailbox" +bool imap_url_mailbox_validate(const char *s); +// validate conformance to RFC 3501 "nz_number" +bool imap_url_nz_number_validate(const char *s); +// validate conformance to RFC 3501 "section-text" +bool imap_url_section_text_validate(const char *s); +// validate conformance to RFC 2192 "section" +bool imap_url_section_validate(const char *s); +// validate conformance to RFC 3339 "date-time" +bool imap_url_datetime_validate(const char *s); +// validate conformance to RFC 4467 "access" +bool imap_url_access_validate(const char *s); +// validate conformance to RFC 4467 "mechanism" +bool imap_url_mechanism_validate(const char *s); +// validate conformance to RFC 4467 "urlauth" (really enc-urlauth) +bool imap_url_urlauth_validate(const char *s); + +// build a URL from parts +void imap_url_construct(const struct imap_url_parts *parts, string_t *url); + +// filter a URL according to RFC 4469 url-resp-text +const char *imap_url_sanitize(const char *url); + +#endif diff -Nur dovecot-1.2.11/src/master/auth-process.c dovecot-1.2.11+lemonade/src/master/auth-process.c --- dovecot-1.2.11/src/master/auth-process.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/master/auth-process.c 2010-04-08 09:59:13.000000000 -0500 @@ -470,6 +470,10 @@ env_put(t_strdup_printf("PASSDB_%u_PASS=1", i)); if (ap->master) env_put(t_strdup_printf("PASSDB_%u_MASTER=1", i)); + + /* APPLE - urlauth */ + if (ap->submit) + env_put(t_strdup_printf("PASSDB_%u_SUBMIT=1", i)); } for (au = set->userdbs, i = 1; au != NULL; au = au->next, i++) { env_put(t_strdup_printf("USERDB_%u_DRIVER=%s", i, au->driver)); diff -Nur dovecot-1.2.11/src/master/mail-process.c dovecot-1.2.11+lemonade/src/master/mail-process.c --- dovecot-1.2.11/src/master/mail-process.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/master/mail-process.c 2010-04-08 09:59:13.000000000 -0500 @@ -349,6 +349,13 @@ set->imap_logout_format, NULL)); env_put(t_strconcat("IMAP_ID_SEND=", set->imap_id_send, NULL)); env_put(t_strconcat("IMAP_ID_LOG=", set->imap_id_log, NULL)); + + /* APPLE - urlauth */ + if (set->server && set->server->auths) + env_put(t_strconcat("AUTH_ANONYMOUS_USERNAME=", + set->server->auths->anonymous_username, + NULL)); + env_put(t_strdup_printf("IMAP_IDLE_NOTIFY_INTERVAL=%u", set->imap_idle_notify_interval)); } @@ -636,7 +643,9 @@ uid = (uid_t)strtoul(*args + 4, NULL, 10); } else if (strncmp(*args, "gid=", 4) == 0) { gid = (gid_t)strtoul(*args + 4, NULL, 10); - } else if (strncmp(*args, "master_user=", 12) == 0) { + } else if (strncmp(*args, "master_user=", 12) == 0 || + /* APPLE - urlauth */ + strncmp(*args, "submit_user=", 12) == 0) { const char *arg = *args; master_user = arg + 12; diff -Nur dovecot-1.2.11/src/master/master-settings.c dovecot-1.2.11+lemonade/src/master/master-settings.c --- dovecot-1.2.11/src/master/master-settings.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/master/master-settings.c 2010-04-08 09:59:13.000000000 -0500 @@ -134,6 +134,7 @@ DEF_BOOL(deny), DEF_BOOL(pass), DEF_BOOL(master), + DEF_BOOL(submit), /* APPLE - urlauth */ { 0, NULL, 0 } }; diff -Nur dovecot-1.2.11/src/master/master-settings.h dovecot-1.2.11+lemonade/src/master/master-settings.h --- dovecot-1.2.11/src/master/master-settings.h 2010-01-22 10:46:52.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/master/master-settings.h 2010-04-08 09:59:13.000000000 -0500 @@ -182,6 +182,7 @@ bool deny; bool pass; bool master; + bool submit; /* APPLE - urlauth */ }; struct auth_userdb_settings { diff -Nur dovecot-1.2.11/src/plugins/Makefile.am dovecot-1.2.11+lemonade/src/plugins/Makefile.am --- dovecot-1.2.11/src/plugins/Makefile.am 2010-01-24 17:03:13.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/Makefile.am 2010-04-08 09:59:13.000000000 -0500 @@ -25,6 +25,7 @@ quota \ imap-quota \ trash \ + urlauth \ virtual \ $(ZLIB) \ $(FTS_LUCENE) \ diff -Nur dovecot-1.2.11/src/plugins/Makefile.in dovecot-1.2.11+lemonade/src/plugins/Makefile.in --- dovecot-1.2.11/src/plugins/Makefile.in 2010-03-08 11:31:10.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/Makefile.in 2010-04-08 09:59:13.000000000 -0500 @@ -61,7 +61,7 @@ CTAGS = ctags DIST_SUBDIRS = acl imap-acl autocreate convert expire fts fts-squat \ lazy-expunge listescape mail-log mbox-snarf quota imap-quota \ - trash virtual zlib fts-lucene fts-solr + trash urlauth virtual zlib fts-lucene fts-solr DISTFILES = $(DIST_COMMON) $(DIST_SOURCES) $(TEXINFOS) $(EXTRA_DIST) am__relativize = \ dir0=`pwd`; \ @@ -259,6 +259,7 @@ quota \ imap-quota \ trash \ + urlauth \ virtual \ $(ZLIB) \ $(FTS_LUCENE) \ diff -Nur dovecot-1.2.11/src/plugins/acl/acl-mailbox-list.c dovecot-1.2.11+lemonade/src/plugins/acl/acl-mailbox-list.c --- dovecot-1.2.11/src/plugins/acl/acl-mailbox-list.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/acl/acl-mailbox-list.c 2010-04-08 09:59:13.000000000 -0500 @@ -537,6 +537,11 @@ owner_username = list->ns->user->username; current_username = auser->master_user; + + /* APPLE - urlauth */ + if (current_username == NULL) + current_username = auser->submit_user; + if (current_username == NULL) current_username = owner_username; else diff -Nur dovecot-1.2.11/src/plugins/acl/acl-plugin.h dovecot-1.2.11+lemonade/src/plugins/acl/acl-plugin.h --- dovecot-1.2.11/src/plugins/acl/acl-plugin.h 2008-11-16 11:08:55.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/acl/acl-plugin.h 2010-04-08 09:59:13.000000000 -0500 @@ -14,6 +14,7 @@ union mail_user_module_context module_ctx; const char *master_user; + const char *submit_user; /* APPLE - urlauth */ const char *acl_env; const char *const *groups; diff -Nur dovecot-1.2.11/src/plugins/acl/acl-storage.c dovecot-1.2.11+lemonade/src/plugins/acl/acl-storage.c --- dovecot-1.2.11/src/plugins/acl/acl-storage.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/acl/acl-storage.c 2010-04-08 09:59:13.000000000 -0500 @@ -244,6 +244,7 @@ auser->acl_env = getenv("ACL"); i_assert(auser->acl_env != NULL); auser->master_user = getenv("MASTER_USER"); + auser->submit_user = getenv("SUBMIT_USER"); /* APPLE - urlauth */ env = getenv("ACL_GROUPS"); if (env != NULL) { diff -Nur dovecot-1.2.11/src/plugins/urlauth/Makefile.am dovecot-1.2.11+lemonade/src/plugins/urlauth/Makefile.am --- dovecot-1.2.11/src/plugins/urlauth/Makefile.am 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/urlauth/Makefile.am 2010-03-05 14:39:44.000000000 -0600 @@ -0,0 +1,54 @@ +# +# Copyright (c) 2010 Apple Inc. All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# 1. Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# 2. Redistributions in binary form must reproduce the above +# copyright notice, this list of conditions and the following +# disclaimer in the documentation and/or other materials provided +# with the distribution. +# 3. Neither the name of Apple Inc. ("Apple") nor the names of its +# contributors may be used to endorse or promote products derived +# from this software without specific prior written permission. +# +# THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND +# ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, +# THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A +# PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS +# CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF +# USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND +# ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, +# OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT +# OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF +# SUCH DAMAGE. +# + +AM_CPPFLAGS = \ + -I$(top_srcdir)/src/lib \ + -I$(top_srcdir)/src/lib-imap \ + -I$(top_srcdir)/src/lib-index \ + -I$(top_srcdir)/src/lib-mail \ + -I$(top_srcdir)/src/lib-storage \ + -I$(top_srcdir)/src/imap + +imap_moduledir = $(moduledir)/imap + +lib10_urlauth_plugin_la_LDFLAGS = -module -avoid-version +lib10_urlauth_plugin_la_LIBADD = -lcrypto + +imap_module_LTLIBRARIES = \ + lib10_urlauth_plugin.la + +lib10_urlauth_plugin_la_SOURCES = \ + urlauth-keys.c \ + urlauth-plugin.c \ + urlauth.c + +noinst_HEADERS = \ + urlauth-plugin.h diff -Nur dovecot-1.2.11/src/plugins/urlauth/Makefile.in dovecot-1.2.11+lemonade/src/plugins/urlauth/Makefile.in --- dovecot-1.2.11/src/plugins/urlauth/Makefile.in 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/urlauth/Makefile.in 2010-03-05 14:39:44.000000000 -0600 @@ -0,0 +1,614 @@ +# Makefile.in generated by automake 1.11 from Makefile.am. +# @configure_input@ + +# Copyright (C) 1994, 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, +# 2003, 2004, 2005, 2006, 2007, 2008, 2009 Free Software Foundation, +# Inc. +# This Makefile.in is free software; the Free Software Foundation +# gives unlimited permission to copy and/or distribute it, +# with or without modifications, as long as this notice is preserved. + +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY, to the extent permitted by law; without +# even the implied warranty of MERCHANTABILITY or FITNESS FOR A +# PARTICULAR PURPOSE. + +@SET_MAKE@ + +# +# Copyright (c) 2010 Apple Inc. All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# 1. Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# 2. Redistributions in binary form must reproduce the above +# copyright notice, this list of conditions and the following +# disclaimer in the documentation and/or other materials provided +# with the distribution. +# 3. Neither the name of Apple Inc. ("Apple") nor the names of its +# contributors may be used to endorse or promote products derived +# from this software without specific prior written permission. +# +# THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND +# ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, +# THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A +# PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS +# CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF +# USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND +# ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, +# OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT +# OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF +# SUCH DAMAGE. +# + + +VPATH = @srcdir@ +pkgdatadir = $(datadir)/@PACKAGE@ +pkgincludedir = $(includedir)/@PACKAGE@ +pkglibdir = $(libdir)/@PACKAGE@ +pkglibexecdir = $(libexecdir)/@PACKAGE@ +am__cd = CDPATH="$${ZSH_VERSION+.}$(PATH_SEPARATOR)" && cd +install_sh_DATA = $(install_sh) -c -m 644 +install_sh_PROGRAM = $(install_sh) -c +install_sh_SCRIPT = $(install_sh) -c +INSTALL_HEADER = $(INSTALL_DATA) +transform = $(program_transform_name) +NORMAL_INSTALL = : +PRE_INSTALL = : +POST_INSTALL = : +NORMAL_UNINSTALL = : +PRE_UNINSTALL = : +POST_UNINSTALL = : +build_triplet = @build@ +host_triplet = @host@ +subdir = src/plugins/urlauth +DIST_COMMON = $(noinst_HEADERS) $(srcdir)/Makefile.am \ + $(srcdir)/Makefile.in +ACLOCAL_M4 = $(top_srcdir)/aclocal.m4 +am__aclocal_m4_deps = $(top_srcdir)/configure.in +am__configure_deps = $(am__aclocal_m4_deps) $(CONFIGURE_DEPENDENCIES) \ + $(ACLOCAL_M4) +mkinstalldirs = $(install_sh) -d +CONFIG_HEADER = $(top_builddir)/config.h +CONFIG_CLEAN_FILES = +CONFIG_CLEAN_VPATH_FILES = +am__vpath_adj_setup = srcdirstrip=`echo "$(srcdir)" | sed 's|.|.|g'`; +am__vpath_adj = case $$p in \ + $(srcdir)/*) f=`echo "$$p" | sed "s|^$$srcdirstrip/||"`;; \ + *) f=$$p;; \ + esac; +am__strip_dir = f=`echo $$p | sed -e 's|^.*/||'`; +am__install_max = 40 +am__nobase_strip_setup = \ + srcdirstrip=`echo "$(srcdir)" | sed 's/[].[^$$\\*|]/\\\\&/g'` +am__nobase_strip = \ + for p in $$list; do echo "$$p"; done | sed -e "s|$$srcdirstrip/||" +am__nobase_list = $(am__nobase_strip_setup); \ + for p in $$list; do echo "$$p $$p"; done | \ + sed "s| $$srcdirstrip/| |;"' / .*\//!s/ .*/ ./; s,$ .*$/[^/]*$$,\1,' | \ + $(AWK) 'BEGIN { files["."] = "" } { files[$$2] = files[$$2] " " $$1; \ + if (++n[$$2] == $(am__install_max)) \ + { print $$2, files[$$2]; n[$$2] = 0; files[$$2] = "" } } \ + END { for (dir in files) print dir, files[dir] }' +am__base_list = \ + sed '$$!N;$$!N;$$!N;$$!N;$$!N;$$!N;$$!N;s/\n/ /g' | \ + sed '$$!N;$$!N;$$!N;$$!N;s/\n/ /g' +am__installdirs = "$(DESTDIR)$(imap_moduledir)" +LTLIBRARIES = $(imap_module_LTLIBRARIES) +lib10_urlauth_plugin_la_DEPENDENCIES = +am_lib10_urlauth_plugin_la_OBJECTS = urlauth-keys.lo urlauth-plugin.lo \ + urlauth.lo +lib10_urlauth_plugin_la_OBJECTS = \ + $(am_lib10_urlauth_plugin_la_OBJECTS) +lib10_urlauth_plugin_la_LINK = $(LIBTOOL) --tag=CC $(AM_LIBTOOLFLAGS) \ + $(LIBTOOLFLAGS) --mode=link $(CCLD) $(AM_CFLAGS) $(CFLAGS) \ + $(lib10_urlauth_plugin_la_LDFLAGS) $(LDFLAGS) -o $@ +DEFAULT_INCLUDES = -I.@am__isrc@ -I$(top_builddir) +depcomp = $(SHELL) $(top_srcdir)/depcomp +am__depfiles_maybe = depfiles +am__mv = mv -f +COMPILE = $(CC) $(DEFS) $(DEFAULT_INCLUDES) $(INCLUDES) $(AM_CPPFLAGS) \ + $(CPPFLAGS) $(AM_CFLAGS) $(CFLAGS) +LTCOMPILE = $(LIBTOOL) --tag=CC $(AM_LIBTOOLFLAGS) $(LIBTOOLFLAGS) \ + --mode=compile $(CC) $(DEFS) $(DEFAULT_INCLUDES) $(INCLUDES) \ + $(AM_CPPFLAGS) $(CPPFLAGS) $(AM_CFLAGS) $(CFLAGS) +CCLD = $(CC) +LINK = $(LIBTOOL) --tag=CC $(AM_LIBTOOLFLAGS) $(LIBTOOLFLAGS) \ + --mode=link $(CCLD) $(AM_CFLAGS) $(CFLAGS) $(AM_LDFLAGS) \ + $(LDFLAGS) -o $@ +SOURCES = $(lib10_urlauth_plugin_la_SOURCES) +DIST_SOURCES = $(lib10_urlauth_plugin_la_SOURCES) +HEADERS = $(noinst_HEADERS) +ETAGS = etags +CTAGS = ctags +DISTFILES = $(DIST_COMMON) $(DIST_SOURCES) $(TEXINFOS) $(EXTRA_DIST) +ACLOCAL = @ACLOCAL@ +AMTAR = @AMTAR@ +AR = @AR@ +AUTH_CFLAGS = @AUTH_CFLAGS@ +AUTH_LIBS = @AUTH_LIBS@ +AUTOCONF = @AUTOCONF@ +AUTOHEADER = @AUTOHEADER@ +AUTOMAKE = @AUTOMAKE@ +AWK = @AWK@ +CC = @CC@ +CCDEPMODE = @CCDEPMODE@ +CFLAGS = @CFLAGS@ +CPP = @CPP@ +CPPFLAGS = @CPPFLAGS@ +CURLCONFIG = @CURLCONFIG@ +CURL_CFLAGS = @CURL_CFLAGS@ +CURL_LIBS = @CURL_LIBS@ +CXX = @CXX@ +CXXCPP = @CXXCPP@ +CXXDEPMODE = @CXXDEPMODE@ +CXXFLAGS = @CXXFLAGS@ +CYGPATH_W = @CYGPATH_W@ +DEFS = @DEFS@ +DEPDIR = @DEPDIR@ +DICT_LIBS = @DICT_LIBS@ +DSYMUTIL = @DSYMUTIL@ +DUMPBIN = @DUMPBIN@ +ECHO_C = @ECHO_C@ +ECHO_N = @ECHO_N@ +ECHO_T = @ECHO_T@ +EGREP = @EGREP@ +EXEEXT = @EXEEXT@ +FGREP = @FGREP@ +GREP = @GREP@ +INSTALL = @INSTALL@ +INSTALL_DATA = @INSTALL_DATA@ +INSTALL_PROGRAM = @INSTALL_PROGRAM@ +INSTALL_SCRIPT = @INSTALL_SCRIPT@ +INSTALL_STRIP_PROGRAM = @INSTALL_STRIP_PROGRAM@ +KRB5CONFIG = @KRB5CONFIG@ +KRB5_CFLAGS = @KRB5_CFLAGS@ +KRB5_LIBS = @KRB5_LIBS@ +LD = @LD@ +LDAP_LIBS = @LDAP_LIBS@ +LDFLAGS = @LDFLAGS@ +LIBCAP = @LIBCAP@ +LIBICONV = @LIBICONV@ +LIBOBJS = @LIBOBJS@ +LIBS = @LIBS@ +LIBTOOL = @LIBTOOL@ +LIPO = @LIPO@ +LN_S = @LN_S@ +LTLIBICONV = @LTLIBICONV@ +LTLIBOBJS = @LTLIBOBJS@ +MAINT = @MAINT@ +MAKEINFO = @MAKEINFO@ +MKDIR_P = @MKDIR_P@ +MODULE_LIBS = @MODULE_LIBS@ +MODULE_SUFFIX = @MODULE_SUFFIX@ +MYSQL_CFLAGS = @MYSQL_CFLAGS@ +MYSQL_LIBS = @MYSQL_LIBS@ +NM = @NM@ +NMEDIT = @NMEDIT@ +OBJDUMP = @OBJDUMP@ +OBJEXT = @OBJEXT@ +OTOOL = @OTOOL@ +OTOOL64 = @OTOOL64@ +PACKAGE = @PACKAGE@ +PACKAGE_BUGREPORT = @PACKAGE_BUGREPORT@ +PACKAGE_NAME = @PACKAGE_NAME@ +PACKAGE_STRING = @PACKAGE_STRING@ +PACKAGE_TARNAME = @PACKAGE_TARNAME@ +PACKAGE_URL = @PACKAGE_URL@ +PACKAGE_VERSION = @PACKAGE_VERSION@ +PATH_SEPARATOR = @PATH_SEPARATOR@ +PGSQL_CFLAGS = @PGSQL_CFLAGS@ +PGSQL_LIBS = @PGSQL_LIBS@ +PG_CONFIG = @PG_CONFIG@ +PKG_CONFIG = @PKG_CONFIG@ +RANLIB = @RANLIB@ +RPCGEN = @RPCGEN@ +SED = @SED@ +SET_MAKE = @SET_MAKE@ +SHELL = @SHELL@ +SQLITE_CFLAGS = @SQLITE_CFLAGS@ +SQLITE_LIBS = @SQLITE_LIBS@ +SQL_CFLAGS = @SQL_CFLAGS@ +SQL_LIBS = @SQL_LIBS@ +SSL_CFLAGS = @SSL_CFLAGS@ +SSL_LIBS = @SSL_LIBS@ +STORAGE_LIBS = @STORAGE_LIBS@ +STRIP = @STRIP@ +VERSION = @VERSION@ +abs_builddir = @abs_builddir@ +abs_srcdir = @abs_srcdir@ +abs_top_builddir = @abs_top_builddir@ +abs_top_srcdir = @abs_top_srcdir@ +ac_ct_CC = @ac_ct_CC@ +ac_ct_CXX = @ac_ct_CXX@ +ac_ct_DUMPBIN = @ac_ct_DUMPBIN@ +am__include = @am__include@ +am__leading_dot = @am__leading_dot@ +am__quote = @am__quote@ +am__tar = @am__tar@ +am__untar = @am__untar@ +bindir = @bindir@ +build = @build@ +build_alias = @build_alias@ +build_cpu = @build_cpu@ +build_os = @build_os@ +build_vendor = @build_vendor@ +builddir = @builddir@ +datadir = @datadir@ +datarootdir = @datarootdir@ +dict_drivers = @dict_drivers@ +docdir = @docdir@ +dvidir = @dvidir@ +exec_prefix = @exec_prefix@ +host = @host@ +host_alias = @host_alias@ +host_cpu = @host_cpu@ +host_os = @host_os@ +host_vendor = @host_vendor@ +htmldir = @htmldir@ +includedir = @includedir@ +infodir = @infodir@ +install_sh = @install_sh@ +libdir = @libdir@ +libexecdir = @libexecdir@ +localedir = @localedir@ +localstatedir = @localstatedir@ +lt_ECHO = @lt_ECHO@ +mail_storages = @mail_storages@ +mandir = @mandir@ +mkdir_p = @mkdir_p@ +moduledir = @moduledir@ +oldincludedir = @oldincludedir@ +pdfdir = @pdfdir@ +prefix = @prefix@ +program_transform_name = @program_transform_name@ +psdir = @psdir@ +rundir = @rundir@ +sbindir = @sbindir@ +sharedstatedir = @sharedstatedir@ +sql_drivers = @sql_drivers@ +srcdir = @srcdir@ +ssldir = @ssldir@ +statedir = @statedir@ +sysconfdir = @sysconfdir@ +target_alias = @target_alias@ +top_build_prefix = @top_build_prefix@ +top_builddir = @top_builddir@ +top_srcdir = @top_srcdir@ +AM_CPPFLAGS = \ + -I$(top_srcdir)/src/lib \ + -I$(top_srcdir)/src/lib-imap \ + -I$(top_srcdir)/src/lib-index \ + -I$(top_srcdir)/src/lib-mail \ + -I$(top_srcdir)/src/lib-storage \ + -I$(top_srcdir)/src/imap + +imap_moduledir = $(moduledir)/imap +lib10_urlauth_plugin_la_LDFLAGS = -module -avoid-version +lib10_urlauth_plugin_la_LIBADD = -lcrypto +imap_module_LTLIBRARIES = \ + lib10_urlauth_plugin.la + +lib10_urlauth_plugin_la_SOURCES = \ + urlauth-keys.c \ + urlauth-plugin.c \ + urlauth.c + +noinst_HEADERS = \ + urlauth-plugin.h + +all: all-am + +.SUFFIXES: +.SUFFIXES: .c .lo .o .obj +$(srcdir)/Makefile.in: @MAINTAINER_MODE_TRUE@ $(srcdir)/Makefile.am $(am__configure_deps) + @for dep in $?; do \ + case '$(am__configure_deps)' in \ + *$$dep*) \ + ( cd $(top_builddir) && $(MAKE) $(AM_MAKEFLAGS) am--refresh ) \ + && { if test -f $@; then exit 0; else break; fi; }; \ + exit 1;; \ + esac; \ + done; \ + echo ' cd $(top_srcdir) && $(AUTOMAKE) --foreign src/plugins/urlauth/Makefile'; \ + $(am__cd) $(top_srcdir) && \ + $(AUTOMAKE) --foreign src/plugins/urlauth/Makefile +.PRECIOUS: Makefile +Makefile: $(srcdir)/Makefile.in $(top_builddir)/config.status + @case '$?' in \ + *config.status*) \ + cd $(top_builddir) && $(MAKE) $(AM_MAKEFLAGS) am--refresh;; \ + *) \ + echo ' cd $(top_builddir) && $(SHELL) ./config.status $(subdir)/$@ $(am__depfiles_maybe)'; \ + cd $(top_builddir) && $(SHELL) ./config.status $(subdir)/$@ $(am__depfiles_maybe);; \ + esac; + +$(top_builddir)/config.status: $(top_srcdir)/configure $(CONFIG_STATUS_DEPENDENCIES) + cd $(top_builddir) && $(MAKE) $(AM_MAKEFLAGS) am--refresh + +$(top_srcdir)/configure: @MAINTAINER_MODE_TRUE@ $(am__configure_deps) + cd $(top_builddir) && $(MAKE) $(AM_MAKEFLAGS) am--refresh +$(ACLOCAL_M4): @MAINTAINER_MODE_TRUE@ $(am__aclocal_m4_deps) + cd $(top_builddir) && $(MAKE) $(AM_MAKEFLAGS) am--refresh +$(am__aclocal_m4_deps): +install-imap_moduleLTLIBRARIES: $(imap_module_LTLIBRARIES) + @$(NORMAL_INSTALL) + test -z "$(imap_moduledir)" || $(MKDIR_P) "$(DESTDIR)$(imap_moduledir)" + @list='$(imap_module_LTLIBRARIES)'; test -n "$(imap_moduledir)" || list=; \ + list2=; for p in $$list; do \ + if test -f $$p; then \ + list2="$$list2 $$p"; \ + else :; fi; \ + done; \ + test -z "$$list2" || { \ + echo " $(LIBTOOL) $(AM_LIBTOOLFLAGS) $(LIBTOOLFLAGS) --mode=install $(INSTALL) $(INSTALL_STRIP_FLAG) $$list2 '$(DESTDIR)$(imap_moduledir)'"; \ + $(LIBTOOL) $(AM_LIBTOOLFLAGS) $(LIBTOOLFLAGS) --mode=install $(INSTALL) $(INSTALL_STRIP_FLAG) $$list2 "$(DESTDIR)$(imap_moduledir)"; \ + } + +uninstall-imap_moduleLTLIBRARIES: + @$(NORMAL_UNINSTALL) + @list='$(imap_module_LTLIBRARIES)'; test -n "$(imap_moduledir)" || list=; \ + for p in $$list; do \ + $(am__strip_dir) \ + echo " $(LIBTOOL) $(AM_LIBTOOLFLAGS) $(LIBTOOLFLAGS) --mode=uninstall rm -f '$(DESTDIR)$(imap_moduledir)/$$f'"; \ + $(LIBTOOL) $(AM_LIBTOOLFLAGS) $(LIBTOOLFLAGS) --mode=uninstall rm -f "$(DESTDIR)$(imap_moduledir)/$$f"; \ + done + +clean-imap_moduleLTLIBRARIES: + -test -z "$(imap_module_LTLIBRARIES)" || rm -f $(imap_module_LTLIBRARIES) + @list='$(imap_module_LTLIBRARIES)'; for p in $$list; do \ + dir="`echo $$p | sed -e 's|/[^/]*$$||'`"; \ + test "$$dir" != "$$p" || dir=.; \ + echo "rm -f \"$${dir}/so_locations\""; \ + rm -f "$${dir}/so_locations"; \ + done +lib10_urlauth_plugin.la: $(lib10_urlauth_plugin_la_OBJECTS) $(lib10_urlauth_plugin_la_DEPENDENCIES) + $(lib10_urlauth_plugin_la_LINK) -rpath $(imap_moduledir) $(lib10_urlauth_plugin_la_OBJECTS) $(lib10_urlauth_plugin_la_LIBADD) $(LIBS) + +mostlyclean-compile: + -rm -f *.$(OBJEXT) + +distclean-compile: + -rm -f *.tab.c + +@AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/urlauth-keys.Plo@am__quote@ +@AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/urlauth-plugin.Plo@am__quote@ +@AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/urlauth.Plo@am__quote@ + +.c.o: +@am__fastdepCC_TRUE@ $(COMPILE) -MT $@ -MD -MP -MF $(DEPDIR)/$*.Tpo -c -o $@ $< +@am__fastdepCC_TRUE@ $(am__mv) $(DEPDIR)/$*.Tpo $(DEPDIR)/$*.Po +@AMDEP_TRUE@@am__fastdepCC_FALSE@ source='$<' object='$@' libtool=no @AMDEPBACKSLASH@ +@AMDEP_TRUE@@am__fastdepCC_FALSE@ DEPDIR=$(DEPDIR) $(CCDEPMODE) $(depcomp) @AMDEPBACKSLASH@ +@am__fastdepCC_FALSE@ $(COMPILE) -c $< + +.c.obj: +@am__fastdepCC_TRUE@ $(COMPILE) -MT $@ -MD -MP -MF $(DEPDIR)/$*.Tpo -c -o $@ `$(CYGPATH_W) '$<'` +@am__fastdepCC_TRUE@ $(am__mv) $(DEPDIR)/$*.Tpo $(DEPDIR)/$*.Po +@AMDEP_TRUE@@am__fastdepCC_FALSE@ source='$<' object='$@' libtool=no @AMDEPBACKSLASH@ +@AMDEP_TRUE@@am__fastdepCC_FALSE@ DEPDIR=$(DEPDIR) $(CCDEPMODE) $(depcomp) @AMDEPBACKSLASH@ +@am__fastdepCC_FALSE@ $(COMPILE) -c `$(CYGPATH_W) '$<'` + +.c.lo: +@am__fastdepCC_TRUE@ $(LTCOMPILE) -MT $@ -MD -MP -MF $(DEPDIR)/$*.Tpo -c -o $@ $< +@am__fastdepCC_TRUE@ $(am__mv) $(DEPDIR)/$*.Tpo $(DEPDIR)/$*.Plo +@AMDEP_TRUE@@am__fastdepCC_FALSE@ source='$<' object='$@' libtool=yes @AMDEPBACKSLASH@ +@AMDEP_TRUE@@am__fastdepCC_FALSE@ DEPDIR=$(DEPDIR) $(CCDEPMODE) $(depcomp) @AMDEPBACKSLASH@ +@am__fastdepCC_FALSE@ $(LTCOMPILE) -c -o $@ $< + +mostlyclean-libtool: + -rm -f *.lo + +clean-libtool: + -rm -rf .libs _libs + +ID: $(HEADERS) $(SOURCES) $(LISP) $(TAGS_FILES) + list='$(SOURCES) $(HEADERS) $(LISP) $(TAGS_FILES)'; \ + unique=`for i in $$list; do \ + if test -f "$$i"; then echo $$i; else echo $(srcdir)/$$i; fi; \ + done | \ + $(AWK) '{ files[$$0] = 1; nonempty = 1; } \ + END { if (nonempty) { for (i in files) print i; }; }'`; \ + mkid -fID $$unique +tags: TAGS + +TAGS: $(HEADERS) $(SOURCES) $(TAGS_DEPENDENCIES) \ + $(TAGS_FILES) $(LISP) + set x; \ + here=`pwd`; \ + list='$(SOURCES) $(HEADERS) $(LISP) $(TAGS_FILES)'; \ + unique=`for i in $$list; do \ + if test -f "$$i"; then echo $$i; else echo $(srcdir)/$$i; fi; \ + done | \ + $(AWK) '{ files[$$0] = 1; nonempty = 1; } \ + END { if (nonempty) { for (i in files) print i; }; }'`; \ + shift; \ + if test -z "$(ETAGS_ARGS)$$*$$unique"; then :; else \ + test -n "$$unique" || unique=$$empty_fix; \ + if test $$# -gt 0; then \ + $(ETAGS) $(ETAGSFLAGS) $(AM_ETAGSFLAGS) $(ETAGS_ARGS) \ + "$$@" $$unique; \ + else \ + $(ETAGS) $(ETAGSFLAGS) $(AM_ETAGSFLAGS) $(ETAGS_ARGS) \ + $$unique; \ + fi; \ + fi +ctags: CTAGS +CTAGS: $(HEADERS) $(SOURCES) $(TAGS_DEPENDENCIES) \ + $(TAGS_FILES) $(LISP) + list='$(SOURCES) $(HEADERS) $(LISP) $(TAGS_FILES)'; \ + unique=`for i in $$list; do \ + if test -f "$$i"; then echo $$i; else echo $(srcdir)/$$i; fi; \ + done | \ + $(AWK) '{ files[$$0] = 1; nonempty = 1; } \ + END { if (nonempty) { for (i in files) print i; }; }'`; \ + test -z "$(CTAGS_ARGS)$$unique" \ + || $(CTAGS) $(CTAGSFLAGS) $(AM_CTAGSFLAGS) $(CTAGS_ARGS) \ + $$unique + +GTAGS: + here=`$(am__cd) $(top_builddir) && pwd` \ + && $(am__cd) $(top_srcdir) \ + && gtags -i $(GTAGS_ARGS) "$$here" + +distclean-tags: + -rm -f TAGS ID GTAGS GRTAGS GSYMS GPATH tags + +distdir: $(DISTFILES) + @srcdirstrip=`echo "$(srcdir)" | sed 's/[].[^$$\\*]/\\\\&/g'`; \ + topsrcdirstrip=`echo "$(top_srcdir)" | sed 's/[].[^$$\\*]/\\\\&/g'`; \ + list='$(DISTFILES)'; \ + dist_files=`for file in $$list; do echo $$file; done | \ + sed -e "s|^$$srcdirstrip/||;t" \ + -e "s|^$$topsrcdirstrip/|$(top_builddir)/|;t"`; \ + case $$dist_files in \ + */*) $(MKDIR_P) `echo "$$dist_files" | \ + sed '/\//!d;s|^|$(distdir)/|;s,/[^/]*$$,,' | \ + sort -u` ;; \ + esac; \ + for file in $$dist_files; do \ + if test -f $$file || test -d $$file; then d=.; else d=$(srcdir); fi; \ + if test -d $$d/$$file; then \ + dir=`echo "/$$file" | sed -e 's,/[^/]*$$,,'`; \ + if test -d "$(distdir)/$$file"; then \ + find "$(distdir)/$$file" -type d ! -perm -700 -exec chmod u+rwx {} \;; \ + fi; \ + if test -d $(srcdir)/$$file && test $$d != $(srcdir); then \ + cp -fpR $(srcdir)/$$file "$(distdir)$$dir" || exit 1; \ + find "$(distdir)/$$file" -type d ! -perm -700 -exec chmod u+rwx {} \;; \ + fi; \ + cp -fpR $$d/$$file "$(distdir)$$dir" || exit 1; \ + else \ + test -f "$(distdir)/$$file" \ + || cp -p $$d/$$file "$(distdir)/$$file" \ + || exit 1; \ + fi; \ + done +check-am: all-am +check: check-am +all-am: Makefile $(LTLIBRARIES) $(HEADERS) +installdirs: + for dir in "$(DESTDIR)$(imap_moduledir)"; do \ + test -z "$$dir" || $(MKDIR_P) "$$dir"; \ + done +install: install-am +install-exec: install-exec-am +install-data: install-data-am +uninstall: uninstall-am + +install-am: all-am + @$(MAKE) $(AM_MAKEFLAGS) install-exec-am install-data-am + +installcheck: installcheck-am +install-strip: + $(MAKE) $(AM_MAKEFLAGS) INSTALL_PROGRAM="$(INSTALL_STRIP_PROGRAM)" \ + install_sh_PROGRAM="$(INSTALL_STRIP_PROGRAM)" INSTALL_STRIP_FLAG=-s \ + `test -z '$(STRIP)' || \ + echo "INSTALL_PROGRAM_ENV=STRIPPROG='$(STRIP)'"` install +mostlyclean-generic: + +clean-generic: + +distclean-generic: + -test -z "$(CONFIG_CLEAN_FILES)" || rm -f $(CONFIG_CLEAN_FILES) + -test . = "$(srcdir)" || test -z "$(CONFIG_CLEAN_VPATH_FILES)" || rm -f $(CONFIG_CLEAN_VPATH_FILES) + +maintainer-clean-generic: + @echo "This command is intended for maintainers to use" + @echo "it deletes files that may require special tools to rebuild." +clean: clean-am + +clean-am: clean-generic clean-imap_moduleLTLIBRARIES clean-libtool \ + mostlyclean-am + +distclean: distclean-am + -rm -rf ./$(DEPDIR) + -rm -f Makefile +distclean-am: clean-am distclean-compile distclean-generic \ + distclean-tags + +dvi: dvi-am + +dvi-am: + +html: html-am + +html-am: + +info: info-am + +info-am: + +install-data-am: install-imap_moduleLTLIBRARIES + +install-dvi: install-dvi-am + +install-dvi-am: + +install-exec-am: + +install-html: install-html-am + +install-html-am: + +install-info: install-info-am + +install-info-am: + +install-man: + +install-pdf: install-pdf-am + +install-pdf-am: + +install-ps: install-ps-am + +install-ps-am: + +installcheck-am: + +maintainer-clean: maintainer-clean-am + -rm -rf ./$(DEPDIR) + -rm -f Makefile +maintainer-clean-am: distclean-am maintainer-clean-generic + +mostlyclean: mostlyclean-am + +mostlyclean-am: mostlyclean-compile mostlyclean-generic \ + mostlyclean-libtool + +pdf: pdf-am + +pdf-am: + +ps: ps-am + +ps-am: + +uninstall-am: uninstall-imap_moduleLTLIBRARIES + +.MAKE: install-am install-strip + +.PHONY: CTAGS GTAGS all all-am check check-am clean clean-generic \ + clean-imap_moduleLTLIBRARIES clean-libtool ctags distclean \ + distclean-compile distclean-generic distclean-libtool \ + distclean-tags distdir dvi dvi-am html html-am info info-am \ + install install-am install-data install-data-am install-dvi \ + install-dvi-am install-exec install-exec-am install-html \ + install-html-am install-imap_moduleLTLIBRARIES install-info \ + install-info-am install-man install-pdf install-pdf-am \ + install-ps install-ps-am install-strip installcheck \ + installcheck-am installdirs maintainer-clean \ + maintainer-clean-generic mostlyclean mostlyclean-compile \ + mostlyclean-generic mostlyclean-libtool pdf pdf-am ps ps-am \ + tags uninstall uninstall-am uninstall-imap_moduleLTLIBRARIES + + +# Tell versions [3.59,3.63) of GNU make to not export all variables. +# Otherwise a system limit (for SysV at least) may be exceeded. +.NOEXPORT: diff -Nur dovecot-1.2.11/src/plugins/urlauth/urlauth-keys.c dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth-keys.c --- dovecot-1.2.11/src/plugins/urlauth/urlauth-keys.c 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth-keys.c 2010-01-19 16:11:13.000000000 -0600 @@ -0,0 +1,269 @@ +/* + * Copyright (c) 2010 Apple Inc. All rights reserved. + * + * Redistribution and use in source and binary forms, with or without + * modification, are permitted provided that the following conditions + * are met: + * + * 1. Redistributions of source code must retain the above copyright + * notice, this list of conditions and the following disclaimer. + * 2. Redistributions in binary form must reproduce the above + * copyright notice, this list of conditions and the following + * disclaimer in the documentation and/or other materials provided + * with the distribution. + * 3. Neither the name of Apple Inc. ("Apple") nor the names of its + * contributors may be used to endorse or promote products derived + * from this software without specific prior written permission. + * + * THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND + * ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, + * THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A + * PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS + * CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF + * USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND + * ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, + * OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT + * OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF + * SUCH DAMAGE. + */ + +#include "lib.h" +#include "istream.h" +#include "ostream.h" +#include "hash.h" +#include "mail-storage-private.h" +#include "hex-binary.h" +#include "randgen.h" +#include "urlauth-plugin.h" + +#include <ctype.h> + +#define URLAUTH_KEYS_FILENAME "urlauthkeys" + +enum urlauth_keys_action { + URLAUTH_KEYS_GET, // get the key for a mailbox + URLAUTH_KEYS_SET, // set a new random key for a mailbox + URLAUTH_KEYS_DELETE // delete the key for a mailbox +}; + +// get the path to the access keys table +static const char *urlauth_keys_path(struct mail_storage *storage) +{ + const char *control_dir = + mail_storage_get_mailbox_control_dir(storage, ""); + return t_strconcat(control_dir, "/"URLAUTH_KEYS_FILENAME, NULL); + +} + +// read the access keys into the hash table +static struct hash_table *urlauth_keys_read(pool_t pool, int fd) +{ + struct hash_table *keys; + struct istream *is; + const char *line; + + is = i_stream_create_fd(fd, 4096, FALSE); + if (is == NULL) + return NULL; + + keys = hash_table_create(pool, pool, 16, strcase_hash, + (hash_cmp_callback_t *) strcasecmp); + if (keys == NULL) { + i_stream_destroy(&is); + return NULL; + } + + i_stream_set_return_partial_line(is, TRUE); + while ((line = i_stream_read_next_line(is)) != NULL) { + const char *sep; + + if (*line == '\0' || *line == '#') + continue; + + /* future-proofing */ + if (strcmp(line, URLAUTH_KEYS_FILENAME" version 1") == 0) + continue; + + /* key:mailbox, both nonempty */ + sep = strchr(line, ':'); + if (sep == NULL || sep == line || sep[1] == '\0') + continue; + + /* keys[mailbox] = key */ + hash_table_insert(keys, + p_strdup(pool, sep + 1), + p_strdup_until(pool, line, sep)); + } + i_stream_destroy(&is); + + return keys; +} + +// write the access keys to the file +static bool urlauth_keys_write(int fd, struct hash_table *keys) +{ + struct ostream *os; + struct hash_iterate_context *iter; + void *key, *value; + + os = o_stream_create_fd_file(fd, 0, FALSE); + if (os == NULL) + return NULL; + + o_stream_send_str(os, URLAUTH_KEYS_FILENAME" version 1\n"); + iter = hash_table_iterate_init(keys); + while (hash_table_iterate(iter, &key, &value)) { + /* key is the mailbox, value is the access key */ + o_stream_send_str(os, (const char *) value); + o_stream_send(os, ":", 1); + o_stream_send_str(os, (const char *) key); + o_stream_send(os, "\n", 1); + } + hash_table_iterate_deinit(&iter); + o_stream_destroy(&os); + + return TRUE; +} + +// read/modify/write the access keys +static bool urlauth_keys_update(struct mail_storage *storage, + enum urlauth_keys_action action, + const char *mailbox, + buffer_t *out_key) +{ + const char *path; + int flags, fd; + pool_t pool; + struct hash_table *keys; + unsigned char new_key[URLAUTH_KEY_BYTES]; + const char *hex = NULL; + bool modified = FALSE; + + if (strcmp(storage->name, "maildir") != 0) { + i_error("Unsupported URLAUTH backend: %s", storage->name); + return FALSE; + } + + /* open and lock the keys file */ + path = urlauth_keys_path(storage); + flags = O_RDWR | O_EXLOCK; + if (action == URLAUTH_KEYS_GET || action == URLAUTH_KEYS_SET) + flags |= O_CREAT; + fd = open(path, flags, 0644); + if (fd < 0) { + if ((flags & O_CREAT) || errno != ENOENT) + i_error("open(%s) failed: %m", path); + return FALSE; + } + + /* read the keys */ + pool = pool_alloconly_create("urlauth_keys", 1024); + keys = urlauth_keys_read(pool, fd); + if (keys == NULL) { + i_error("error reading %s: %m", path); + pool_unref(&pool); + close(fd); + return FALSE; + } + + /* modify the keys */ + switch (action) { + case URLAUTH_KEYS_GET: + hex = hash_table_lookup(keys, (void *) mailbox); + + /* if hex key is bogus, set a new one */ + if (hex) { + const char *cp; + for (cp = hex; *cp; cp++) + if (!i_isxdigit(*cp)) + break; + if (*cp == '\0') + break; /* good hex */ + } + + /* if not present, set one -- fall through */ + case URLAUTH_KEYS_SET: + random_fill(new_key, sizeof new_key); + hex = binary_to_hex(new_key, sizeof new_key); + if (*mailbox) { + hash_table_insert(keys, (void *) mailbox, + (void *) hex); + modified = TRUE; + } /* else mailbox="" for foiling timing attacks */ + break; + case URLAUTH_KEYS_DELETE: + hex = hash_table_lookup(keys, (void *) mailbox); + if (hex) { + hash_table_remove(keys, (void *) mailbox); + modified = TRUE; + } + break; + } + + if (out_key) + hex_to_binary(hex, out_key); + + /* write the keys */ + if (modified) { + lseek(fd, 0, SEEK_SET); + ftruncate(fd, 0); + urlauth_keys_write(fd, keys); + } + + /* clean up */ + close(fd); + hash_table_destroy(&keys); + pool_unref(&pool); + + return TRUE; +} + +void urlauth_keys_init(void) +{ + random_init(); +} + +void urlauth_keys_deinit(void) +{ + random_deinit(); +} + +// get the access key for a mailbox +bool urlauth_keys_get(struct mail_storage *storage, const char *mailbox, + buffer_t *key) +{ + return urlauth_keys_update(storage, URLAUTH_KEYS_GET, mailbox, key); +} + +// set a new random access key for a mailbox +bool urlauth_keys_set(struct mail_storage *storage, const char *mailbox) +{ + return urlauth_keys_update(storage, URLAUTH_KEYS_SET, mailbox, NULL); +} + +// delete the access key for a mailbox +bool urlauth_keys_delete(struct mail_storage *storage, const char *mailbox) +{ + return urlauth_keys_update(storage, URLAUTH_KEYS_DELETE, mailbox, NULL); +} + +// delete all access keys +bool urlauth_keys_reset(struct mail_storage *storage) +{ + const char *path; + + if (strcmp(storage->name, "maildir") != 0) { + i_error("Unsupported URLAUTH backend: %s", storage->name); + return FALSE; + } + + path = urlauth_keys_path(storage); + if (unlink(path) < 0 && errno != ENOENT && errno != ESTALE) { + i_error("unlink(%s) failed: %m", path); + return FALSE; + } + + return TRUE; +} diff -Nur dovecot-1.2.11/src/plugins/urlauth/urlauth-plugin.c dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth-plugin.c --- dovecot-1.2.11/src/plugins/urlauth/urlauth-plugin.c 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth-plugin.c 2010-02-05 05:34:46.000000000 -0600 @@ -0,0 +1,620 @@ +/* + * Copyright (c) 2010 Apple Inc. All rights reserved. + * + * Redistribution and use in source and binary forms, with or without + * modification, are permitted provided that the following conditions + * are met: + * + * 1. Redistributions of source code must retain the above copyright + * notice, this list of conditions and the following disclaimer. + * 2. Redistributions in binary form must reproduce the above + * copyright notice, this list of conditions and the following + * disclaimer in the documentation and/or other materials provided + * with the distribution. + * 3. Neither the name of Apple Inc. ("Apple") nor the names of its + * contributors may be used to endorse or promote products derived + * from this software without specific prior written permission. + * + * THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND + * ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, + * THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A + * PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS + * CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF + * USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND + * ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, + * OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT + * OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF + * SUCH DAMAGE. + */ + +/* Implements RFC 4467 */ + +#include "lib.h" +#include "str.h" +#include "common.h" +#include "client.h" +#include "hostpid.h" +#include "ioloop.h" +#include "istream.h" +#include "ostream.h" +#include "mail-user.h" +#include "mail-search.h" +#include "imap-fetch.h" +#include "imap-search-args.h" +#include "urlauth-plugin.h" + +#include <stdlib.h> +#include <fcntl.h> +#include <unistd.h> + +/* context for processing nested loops asynchronously: + for (each url in the urlfetch command) + while (the imap fetch is unfinished) + print the info, but non-blocking */ +struct urlfetch_context { + /* pertaining to the urlfetch command as a whole */ + pool_t pool; + struct client_command_context *cmd; + const struct imap_arg *urlfetch_args; + string_t *response; + const char *hostport; + unsigned int debug:1; + unsigned int failed:1; + + /* pertaining to the individual url being processed */ + const char *url; + const char *mailbox; + struct mail_storage *storage; + struct mailbox *box; + struct istream *input; + struct imap_parser *parser; + struct mail_search_args *search_args; + struct imap_fetch_context *fetch_ctx; +}; + +enum urlfetch_status { + URLFETCH_DONE, + URLFETCH_MORE, + URLFETCH_UNFINISHED +}; + +const char *urlauth_plugin_version = PACKAGE_VERSION; + +extern void (*hook_select_send_urlmech)(struct client *client); +extern void (*hook_delete_mailbox)(struct mail_storage *storage, + const char *mailbox); + +// GENURLAUTH command +static bool cmd_genurlauth(struct client_command_context *cmd) +{ + const struct imap_arg *args; + string_t *auth_urls; + const char *hostport; + + /* url mechanism [url mechanism ...] */ + if (!client_read_args(cmd, 0, 0, &args)) + return FALSE; + + auth_urls = t_str_new(256); + + // resolve this each time in case my_hostname changed + hostport = getenv("URLAUTH_HOSTPORT"); + if (hostport == NULL || *hostport == '\0') + hostport = my_hostname; + + while (IMAP_ARG_TYPE_IS_STRING(args[0].type) && + IMAP_ARG_TYPE_IS_STRING(args[1].type)) { + const char *rump = imap_arg_string(&args[0]); + const char *mech = imap_arg_string(&args[1]); + struct imap_url_parts enc_parts, dec_parts; + const char *error = NULL, *mailbox; + struct mail_storage *storage; + buffer_t *key; + + if (strcasecmp(mech, "INTERNAL") != 0) { + client_send_command_error(cmd, + "Unsupported mechanism."); + return TRUE; + } + + memset(&enc_parts, 0, sizeof enc_parts); + memset(&dec_parts, 0, sizeof dec_parts); + imap_url_parse(rump, &enc_parts); + if (!imap_url_decode(&enc_parts, &dec_parts, &error) || + !urlauth_url_validate(&dec_parts, FALSE, &error)) { + if (error) + client_send_command_error(cmd, + t_strconcat("Invalid arguments: ", + error, NULL)); + else + client_send_command_error(cmd, + "Invalid arguments."); + return TRUE; + } + + if (getenv("DEBUG") != NULL) { + string_t *url = t_str_new(strlen(rump) + 1); + imap_url_construct(&enc_parts, url); + if (strcasecmp(rump, str_c(url)) != 0) + i_warning("GENURLAUTH: reconstructed URL (%s) does not match original (%s)", + str_c(url), rump); + } + + // username and servername must match + if (strcmp(dec_parts.user, cmd->client->user->username) != 0 || + strcmp(dec_parts.hostport, hostport) != 0) { + client_send_command_error(cmd, "User/server mismatch."); + return TRUE; + } + + // mailbox must exist + if (!client_verify_mailbox_name(cmd, dec_parts.mailbox, + CLIENT_VERIFY_MAILBOX_SHOULD_EXIST)) + return TRUE; + + // get the access key + mailbox = dec_parts.mailbox; + storage = client_find_storage(cmd, &mailbox); + if (storage == NULL) + return TRUE; + key = buffer_create_static_hard(pool_datastack_create(), + URLAUTH_KEY_BYTES); + if (!urlauth_keys_get(storage, mailbox, key)) { + client_send_tagline(cmd, "NO "MAIL_ERRSTR_CRITICAL_MSG); + return TRUE; + } + + // generate the reply + if (str_len(auth_urls) > 0) + str_append_c(auth_urls, ' '); + str_append_c(auth_urls, '"'); + str_append(auth_urls, rump); + str_append(auth_urls, ":INTERNAL:"); + urlauth_urlauth_generate_internal(rump, key, auth_urls); + str_append_c(auth_urls, '"'); + + args += 2; + } + if (args[0].type == IMAP_ARG_EOL) { + if (str_len(auth_urls) > 0) { + client_send_line(cmd->client, + t_strconcat("* GENURLAUTH ", + str_c(auth_urls), NULL)); + client_send_tagline(cmd, "OK Genurlauth completed."); + } else + client_send_command_error(cmd, "Missing arguments."); + } else if (args[1].type == IMAP_ARG_EOL) + client_send_command_error(cmd, "Missing arguments."); + else + client_send_command_error(cmd, "Invalid arguments."); + + return TRUE; +} + +// initialize context for traversing the urlauth maze +static struct urlfetch_context * +urlfetch_init(struct client_command_context *cmd, const struct imap_arg *args) +{ + struct urlfetch_context *ufctx; + + pool_ref(cmd->pool); + ufctx = p_new(cmd->pool, struct urlfetch_context, 1); + ufctx->pool = cmd->pool; + ufctx->cmd = cmd; + ufctx->urlfetch_args = args; + + ufctx->response = str_new(ufctx->pool, 256); + str_append(ufctx->response, "* URLFETCH"); + + // resolve this each time in case my_hostname changed + ufctx->hostport = getenv("URLAUTH_HOSTPORT"); + if (ufctx->hostport == NULL || *ufctx->hostport == '\0') + ufctx->hostport = my_hostname; + + ufctx->debug = getenv("DEBUG") != NULL; + + return ufctx; +} + +// reset the context for the next url +static enum urlfetch_status urlfetch_reset(struct urlfetch_context *ufctx) +{ + if (ufctx->fetch_ctx != NULL) { + if (!ufctx->fetch_ctx->urlfetched) { + // found no mail with that uid + // HERE - probably should send BAD response instead + if (ufctx->debug) + i_info("URLFETCH: \"%s\" failed: UID not found", + ufctx->url); + i_assert(str_len(ufctx->response) == 0); + str_append_str(ufctx->response, + ufctx->fetch_ctx->cur_str); + str_append(ufctx->response, " NIL"); + } + if (imap_fetch_deinit(ufctx->fetch_ctx) < 0) + ufctx->fetch_ctx->failed = TRUE; + if (ufctx->fetch_ctx->failed) + ufctx->failed = TRUE; + ufctx->fetch_ctx = NULL; + } + if (ufctx->search_args != NULL) + mail_search_args_unref(&ufctx->search_args); + if (ufctx->parser != NULL) + imap_parser_destroy(&ufctx->parser); + if (ufctx->input != NULL) + i_stream_destroy(&ufctx->input); + if (ufctx->box != NULL) + mailbox_close(&ufctx->box); + ufctx->storage = NULL; + ufctx->mailbox = NULL; + ufctx->url = NULL; + + return ufctx->failed ? URLFETCH_DONE : URLFETCH_MORE; +} + +// destroy the context +static void urlfetch_deinit(struct urlfetch_context **_ufctx) +{ + struct urlfetch_context *ufctx = *_ufctx; + *_ufctx = NULL; + + urlfetch_reset(ufctx); + + str_free(&ufctx->response); + pool_unref(&ufctx->pool); +} + +// urlfetch for one url +static int urlfetch_url(struct urlfetch_context *ufctx, const char **error) +{ + struct imap_url_parts enc_parts, dec_parts; + bool authorized = FALSE; + buffer_t *key; + string_t *urlauth, *fetch_text; + struct mailbox_status status; + const struct imap_arg *fetch_args = NULL, *next_arg = NULL; + + memset(&enc_parts, 0, sizeof enc_parts); + memset(&dec_parts, 0, sizeof dec_parts); + imap_url_parse(ufctx->url, &enc_parts); + if (!imap_url_decode(&enc_parts, &dec_parts, error) || + !urlauth_url_validate(&dec_parts, TRUE, error)) + return -1; + if (strcmp(dec_parts.user, ufctx->cmd->client->user->username) != 0 || + strcmp(dec_parts.hostport, ufctx->hostport) != 0) { + *error = "user/server mismatch"; + return -1; + } + + // expired? + if (dec_parts.expiration_time != 0 && + dec_parts.expiration_time < ioloop_time) { + *error = "expired"; + return -1; + } + + // authorized? + if (strcasecmp(dec_parts.access, "anonymous") == 0) { + /* any user */ + authorized = TRUE; + } else if (strcasecmp(dec_parts.access, "authuser") == 0) { + /* any non-anonymous user */ + const char *anonymous = getenv("AUTH_ANONYMOUS_USERNAME"); + authorized = anonymous == NULL || + strcmp(ufctx->cmd->client->user->username, + anonymous) != 0; + } else if (strncasecmp(dec_parts.access, "user+", 5) == 0) { + /* logged-in user */ + authorized = strcmp(dec_parts.access + 5, + ufctx->cmd->client->user->username) == 0; + } else if (strncasecmp(dec_parts.access, "submit+", 7) == 0) { + /* logged-in user via submit-user login */ + authorized = getenv("SUBMIT_USER") != NULL && + strcmp(dec_parts.access + 7, + ufctx->cmd->client->user->username) == 0; + } + if (!authorized) { + *error = "not authorized"; + return -1; + } + + // get the access key + key = buffer_create_static_hard(pool_datastack_create(), + URLAUTH_KEY_BYTES); + ufctx->mailbox = p_strdup(ufctx->pool, dec_parts.mailbox); + ufctx->storage = client_find_storage(ufctx->cmd, &ufctx->mailbox); + if (ufctx->storage == NULL) { + // invent a key to foil timing attacks + ufctx->mailbox = "INBOX"; + ufctx->storage = client_find_storage(ufctx->cmd, + &ufctx->mailbox); + ufctx->mailbox = ""; + } + if (!urlauth_keys_get(ufctx->storage, ufctx->mailbox, key)) { + *error = "can't get mailbox key"; + return -1; + } + + // generate an access token and compare it to the one given + urlauth = t_str_new(strlen(dec_parts.urlauth)); + urlauth_urlauth_generate_internal(enc_parts.rump, key, urlauth); + if (strcasecmp(dec_parts.urlauth, str_c(urlauth)) != 0 || + *ufctx->mailbox == '\0') { + *error = "access token mismatch"; + return -1; + } + + ufctx->box = mailbox_open(&ufctx->storage, ufctx->mailbox, NULL, + MAILBOX_OPEN_READONLY | + MAILBOX_OPEN_KEEP_RECENT); + if (ufctx->box == NULL) { + *error = "can't open mailbox"; + return -1; + } + + // verify uidvalidity + if (mailbox_sync(ufctx->box, + MAILBOX_SYNC_FLAG_FULL_READ | MAILBOX_SYNC_FLAG_FAST, + STATUS_UIDVALIDITY, &status) < 0 || + (dec_parts.uidvalidity != NULL && + strtoul(dec_parts.uidvalidity, NULL, 10) != status.uidvalidity)) { + *error = "uidvalidity mismatch"; + return -1; + } + + /* passed all tests. go get the data as in + UID FETCH dec_parts.uid BODY.PEEK[dec_parts.section] + but with less output syntax */ + fetch_text = str_new(ufctx->pool, + 11 + (dec_parts.section ? + strlen(dec_parts.section) : 0)); + str_append(fetch_text, "BODY.PEEK["); + if (dec_parts.section) + str_append(fetch_text, dec_parts.section); + str_append(fetch_text, "]"); + + ufctx->input = i_stream_create_from_data(str_data(fetch_text), + str_len(fetch_text)); + (void) i_stream_read(ufctx->input); + + ufctx->parser = imap_parser_create(ufctx->input, NULL, (size_t) -1); + if (imap_parser_finish_line(ufctx->parser, 0, 0, &fetch_args) < 0) { + *error = "can't parse fetch string"; + return -1; + } + + ufctx->cmd->uid = TRUE; + if (imap_search_get_uidset_arg(ufctx->cmd, dec_parts.uid, + &ufctx->search_args, error) < 0) + return -1; + + ufctx->fetch_ctx = imap_fetch_init(ufctx->cmd, ufctx->box); + if (ufctx->fetch_ctx == NULL) { + *error = "can't init fetch"; + return -1; + } + ufctx->fetch_ctx->search_args = ufctx->search_args; + mail_search_args_ref(ufctx->search_args); + str_append_str(ufctx->fetch_ctx->cur_str, ufctx->response); + str_truncate(ufctx->response, 0); + ufctx->fetch_ctx->urlfetch = TRUE; + + if (!fetch_parse_args(ufctx->fetch_ctx, fetch_args, &next_arg)) { + *error = "can't parse fetch args"; + return -1; + } + + if (imap_fetch_begin(ufctx->fetch_ctx) != 0) { + *error = "can't begin fetch"; + return -1; + } + + return imap_fetch_more(ufctx->fetch_ctx); +} + +// execute imap fetch for one urlfetch url +static enum urlfetch_status urlfetch_more(struct urlfetch_context *ufctx) +{ + if (ufctx->url == NULL) { + int ret; + const char *error = NULL; + + if (!IMAP_ARG_TYPE_IS_STRING(ufctx->urlfetch_args->type)) + return URLFETCH_DONE; + + ufctx->url = imap_arg_string(ufctx->urlfetch_args); + ++ufctx->urlfetch_args; + + str_printfa(ufctx->response, " \"%s\"", ufctx->url); + ret = urlfetch_url(ufctx, &error); + if (ret < 0) { + if (ufctx->debug) + i_info("URLFETCH: \"%s\" failed: %s", + ufctx->url, + error ? error : "(unspecified)"); + str_append(ufctx->response, " NIL"); + } else if (ret == 0) + return URLFETCH_UNFINISHED; + } else { + if (imap_fetch_more(ufctx->fetch_ctx) == 0) + return URLFETCH_UNFINISHED; + } + + return urlfetch_reset(ufctx); +} + +// finish off an urlfetch command +static int urlfetch_finish(struct urlfetch_context *ufctx) +{ + ufctx->cmd->client->output_squelch = FALSE; + + if (ufctx->failed) { + if (ufctx->cmd->client->output->closed) + client_disconnect(ufctx->cmd->client, "Disconnected"); + else { + const char *error_string; + enum mail_error error; + + error_string = mail_storage_get_last_error( + ufctx->storage, &error); + + /* We never want to reply NO to FETCH requests, + BYE is preferrable (see imap-ml for reasons). */ + client_disconnect_with_error(ufctx->cmd->client, + error_string); + } + } else { + client_send_line(ufctx->cmd->client, str_c(ufctx->response)); + client_send_tagline(ufctx->cmd, "OK Urlfetch completed."); + } + + urlfetch_deinit(&ufctx); + return TRUE; +} + +// client is ready for more output, continue urlfetch where we left off +static bool urlfetch_continue(struct client_command_context *cmd) +{ + struct urlfetch_context *ufctx = cmd->context; + enum urlfetch_status status; + + while ((status = urlfetch_more(ufctx)) == URLFETCH_MORE) + ; + if (status == URLFETCH_UNFINISHED) + return FALSE; + return urlfetch_finish(ufctx); +} + +// URLFETCH command +static bool cmd_urlfetch(struct client_command_context *cmd) +{ + const struct imap_arg *args, *argp; + struct urlfetch_context *ufctx; + enum urlfetch_status status; + + /* url [url ...] */ + if (!client_read_args(cmd, 0, 0, &args)) + return FALSE; + + for (argp = args; argp->type != IMAP_ARG_EOL; argp++) { + if (!IMAP_ARG_TYPE_IS_STRING(argp->type)) { + client_send_command_error(cmd, "Invalid arguments."); + return TRUE; + } + } + if (argp == args) { + client_send_command_error(cmd, "Missing arguments."); + return TRUE; + } + + /* Squelch all errors and output other than the fetched parts; + we are allowed only NIL or "". Dovecot does not cleanly + separate the parsing, execution, and response phases of + command handling, but instead interleaves them. To re-use + the imap-fetch code for urlfetch, output_squelch keeps + dovecot quiet. */ + cmd->client->output_squelch = TRUE; + + ufctx = urlfetch_init(cmd, args); + while ((status = urlfetch_more(ufctx)) == URLFETCH_MORE) + ; + if (status == URLFETCH_UNFINISHED) { + cmd->state = CLIENT_COMMAND_STATE_WAIT_OUTPUT; + cmd->func = urlfetch_continue; + cmd->context = ufctx; + return FALSE; + } + return urlfetch_finish(ufctx); +} + +// RESETKEY command +static bool cmd_resetkey(struct client_command_context *cmd) +{ + const struct imap_arg *args; + const char *mailbox = NULL; + const char *mechanism = NULL; + bool reset_all = FALSE; + struct mail_storage *storage; + + /* [mailbox [mechanism]] */ + if (!client_read_args(cmd, 0, 0, &args)) + return FALSE; + + if (IMAP_ARG_TYPE_IS_STRING(args[0].type)) { + mailbox = imap_arg_string(&args[0]); + + /* mechanism name may be absent, empty, or "INTERNAL" */ + if (IMAP_ARG_TYPE_IS_STRING(args[1].type)) { + mechanism = imap_arg_string(&args[1]); + if (*mechanism != '\0' && + strcasecmp(mechanism, "INTERNAL") != 0) { + client_send_command_error(cmd, + "Unsupported mechanism."); + return TRUE; + } + } + } else { + reset_all = args[0].type == IMAP_ARG_EOL; + mailbox = "INBOX"; + } + + if (!client_verify_mailbox_name(cmd, mailbox, + CLIENT_VERIFY_MAILBOX_SHOULD_EXIST)) + return TRUE; + + storage = client_find_storage(cmd, &mailbox); + if (storage == NULL) + return TRUE; + + if (reset_all) { + if (urlauth_keys_reset(storage)) + client_send_tagline(cmd, "OK All keys removed."); + else + client_send_tagline(cmd, "NO "MAIL_ERRSTR_CRITICAL_MSG); + } else { + if (urlauth_keys_set(storage, mailbox)) + client_send_tagline(cmd, "OK [URLMECH INTERNAL] Key changed."); + else + client_send_tagline(cmd, "NO "MAIL_ERRSTR_CRITICAL_MSG); + } + + return TRUE; +} + +// report urlauth mechanisms +static void urlauth_send_urlmech(struct client *client) +{ + client_send_line(client, + "* OK [URLMECH INTERNAL] Mechanisms supported"); +} + +// a mailbox was deleted (or renamed away) so delete its urlauth key +static void urlauth_delete_mailbox(struct mail_storage *storage, + const char *mailbox) +{ + urlauth_keys_delete(storage, mailbox); +} + +void urlauth_plugin_init(void) +{ + command_register("GENURLAUTH", cmd_genurlauth, 0); + command_register("URLFETCH", cmd_urlfetch, + COMMAND_FLAG_OK_FOR_SUBMIT_USER); + command_register("RESETKEY", cmd_resetkey, 0); + str_append(capability_string, " URLAUTH"); + urlauth_keys_init(); + hook_select_send_urlmech = urlauth_send_urlmech; + hook_delete_mailbox = urlauth_delete_mailbox; +} + +void urlauth_plugin_deinit(void) +{ + command_unregister("GENURLAUTH"); + command_unregister("URLFETCH"); + command_unregister("RESETKEY"); + urlauth_keys_deinit(); + hook_select_send_urlmech = NULL; + hook_delete_mailbox = NULL; +} diff -Nur dovecot-1.2.11/src/plugins/urlauth/urlauth-plugin.h dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth-plugin.h --- dovecot-1.2.11/src/plugins/urlauth/urlauth-plugin.h 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth-plugin.h 2010-01-19 16:11:13.000000000 -0600 @@ -0,0 +1,57 @@ +/* + * Copyright (c) 2010 Apple Inc. All rights reserved. + * + * Redistribution and use in source and binary forms, with or without + * modification, are permitted provided that the following conditions + * are met: + * + * 1. Redistributions of source code must retain the above copyright + * notice, this list of conditions and the following disclaimer. + * 2. Redistributions in binary form must reproduce the above + * copyright notice, this list of conditions and the following + * disclaimer in the documentation and/or other materials provided + * with the distribution. + * 3. Neither the name of Apple Inc. ("Apple") nor the names of its + * contributors may be used to endorse or promote products derived + * from this software without specific prior written permission. + * + * THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND + * ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, + * THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A + * PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS + * CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF + * USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND + * ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, + * OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT + * OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF + * SUCH DAMAGE. + */ + +#ifndef URLAUTH_PLUGIN_H +#define URLAUTH_PLUGIN_H + +#include "imap-url.h" +#include "mail-storage.h" + +#define URLAUTH_KEY_BYTES 16 + +void urlauth_plugin_init(void); +void urlauth_plugin_deinit(void); + +void urlauth_keys_init(void); +void urlauth_keys_deinit(void); +bool urlauth_keys_get(struct mail_storage *storage, const char *mailbox, + buffer_t *key); +bool urlauth_keys_set(struct mail_storage *storage, const char *mailbox); +bool urlauth_keys_delete(struct mail_storage *storage, const char *mailbox); +bool urlauth_keys_reset(struct mail_storage *storage); + +bool urlauth_url_validate(const struct imap_url_parts *parts, bool full, + const char **error); + +void urlauth_urlauth_generate_internal(const char *rump, const buffer_t *key, + string_t *urlauth); + +#endif diff -Nur dovecot-1.2.11/src/plugins/urlauth/urlauth.c dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth.c --- dovecot-1.2.11/src/plugins/urlauth/urlauth.c 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth.c 2010-03-05 14:07:34.000000000 -0600 @@ -0,0 +1,159 @@ +/* + * Copyright (c) 2010 Apple Inc. All rights reserved. + * + * Redistribution and use in source and binary forms, with or without + * modification, are permitted provided that the following conditions + * are met: + * + * 1. Redistributions of source code must retain the above copyright + * notice, this list of conditions and the following disclaimer. + * 2. Redistributions in binary form must reproduce the above + * copyright notice, this list of conditions and the following + * disclaimer in the documentation and/or other materials provided + * with the distribution. + * 3. Neither the name of Apple Inc. ("Apple") nor the names of its + * contributors may be used to endorse or promote products derived + * from this software without specific prior written permission. + * + * THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND + * ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, + * THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A + * PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS + * CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF + * USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND + * ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, + * OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT + * OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF + * SUCH DAMAGE. + */ + +#include "lib.h" +#include "buffer.h" +#include "str.h" +#include "hex-binary.h" +#include "urlauth-plugin.h" + +#include <openssl/hmac.h> + +#define URLAUTH_URLAUTH_INTERNAL_VERSION "d1" /* must be hex */ + +// compute the urlauth token using the INTERNAL mechanism +void urlauth_urlauth_generate_internal(const char *rump, + const buffer_t *key, + string_t *urlauth) +{ + const void *key_data; + size_t key_len = 0; + unsigned char mac[EVP_MAX_MD_SIZE]; + unsigned int mac_len = 0; + + // compute HMAC-SHA1 of rump with key + key_data = buffer_get_data(key, &key_len); + i_assert(key_len > 0); + HMAC(EVP_sha1(), key_data, key_len, (const unsigned char *) rump, + strlen(rump), mac, &mac_len); + + str_append(urlauth, URLAUTH_URLAUTH_INTERNAL_VERSION); + str_append(urlauth, binary_to_hex(mac, mac_len)); +} + +// validate all the parts of the URL +bool urlauth_url_validate(const struct imap_url_parts *parts, bool full, + const char **error) +{ + // user: mandatory; RFC 3501 "userid" + if (parts->user == NULL || + !imap_url_astring_validate(parts->user)) { + *error = "missing or invalid user ID"; + return FALSE; + } + + // auth_type: optional; RFC 3501 "auth-type" + if (parts->auth_type != NULL && + !imap_url_atom_validate(parts->auth_type)) { + *error = "invalid auth type"; + return FALSE; + } + + // hostport: mandatory; RFC 1738 "hostport" + if (parts->hostport == NULL || + !imap_url_hostport_validate(parts->hostport)) { + *error = "missing or invalid server"; + return FALSE; + } + + // mailbox: mandatory; RFC 3501 "mailbox" + if (parts->mailbox == NULL || + !imap_url_mailbox_validate(parts->mailbox)) { + *error = "missing or invalid mailbox"; + return FALSE; + } + + // uidvalidity: optional; RFC 3501 "nz-number" + if (parts->uidvalidity != NULL && + !imap_url_nz_number_validate(parts->uidvalidity)) { + *error = "invalid uidvalidity"; + return FALSE; + } + + // uid: mandatory; RFC 3501 "nz-number" + if (parts->uid == NULL || + !imap_url_nz_number_validate(parts->uid)) { + *error = "missing or invalid uid"; + return FALSE; + } + + // section: optional; RFC 2192 "section" + if (parts->section != NULL && + !imap_url_section_validate(parts->section)) { + *error = "invalid section"; + return FALSE; + } + + // expiration: optional; RFC 3339 "date-time" + if (parts->expiration != NULL && + (!imap_url_datetime_validate(parts->expiration) || + parts->expiration_time == 0)) { + *error = "invalid expiration"; + return FALSE; + } + + // access: mandatory; RFC 4467 "access" + if (parts->access == NULL || + !imap_url_access_validate(parts->access)) { + *error = "missing or invalid access ID"; + return FALSE; + } + + if (full) { + // mechanism: mandatory; RFC 4467 "mechanism" + if (parts->mechanism == NULL || + !imap_url_mechanism_validate(parts->mechanism)) { + *error = "missing or invalid mechanism"; + return FALSE; + } + + // urlauth: mandatory; RFC 4467 "urlauth" + if (parts->urlauth == NULL || + !imap_url_urlauth_validate(parts->urlauth)) { + *error = "missing or invalid access token"; + return FALSE; + } + } else { + // mechanism: absent + if (parts->mechanism != NULL) { + *error = "mechanism present"; + return FALSE; + } + + // urlauth: absent + if (parts->urlauth != NULL) { + *error = "access token present"; + return FALSE; + } + } + + return TRUE; +}

2 12

[Dovecot] Quota: Maildir and other files
by Michael Kliewe 13 Apr '10

13 Apr '10

Hi everybody, I'm currently working on the quota limits in dovecot, and Maildir quota is working fine, it reports the correct numbers. But our users also have additional space where they can put files, and I would like both to have the same quota of 2 GB. So mails + files should not exceed 2 GB. What is the best way to solve this? I already tried the following: - I put the files in /path/to/user/Maildir/Storage/ , where /path/to/ user/Maildir is the users mail directory. But obviously dovecot does not see that files and gives the wrong numbers. - I tried to use the fs quota backend ("Disk quota"), but I don't get it running, I always get an empty result: dovecot -n: plugin: quota: maildir:User quota quota_rule: *:storage=2G quota_rule2: *:messages=50000 quota_rule3: Trash:storage=10%% quota_rule4: Spam:storage=20%% quota2: fs:Disk quota quota2_rule: *:storage=2G quota2_rule2: *:messages=50000 TAG GETQUOTA "User quota" * QUOTA "User quota" (STORAGE 473178 2048000 MESSAGE 20693 50000) TAG OK Getquota completed. TAG GETQUOTA "Disk quota" * QUOTA "Disk quota" () TAG OK Getquota completed. I don't know why fs is not working. /path/to/user/Maildir is a simple local ext4 partition. In the future it will be a nfs share. Can you point me to a solution, so the user has a limit for both, mails and additional files? Where is the best way to place the additional files? Michael

2 1

[Dovecot] RFC 4468
by Erik Logtenberg 12 Apr '10

12 Apr '10

You know, I was thinking: wouldn't it be nice to have RFC 4468 (Message Submission BURL Extension) support in dovecot? Maybe we should ask the guys from Apple to contribute some support for it, I have a gut feeling they would gladly do so ;) Kind regards -- Erik.

4 5

[Dovecot] Problem with .dovecot.lda-dupes file
by Richert, Vitali 12 Apr '10

12 Apr '10

Hello, I have a strange problem with my first dovecot installation. I see this error massage in the logfile: Apr 9 10:42:44 mail2 dovecot: IMAP(admin(a)domain.tld): stat(/srv/mail/vmail/domain.tld/admin/.dovecot.lda-dupes/tmp) failed: Not a directory Why does dovecot thing that the “.dovecot.lda-dupes” file is a directory? I compiled dovecot 1.2.11 with sieve-0.1.15 and managesieve-0.11.11. thanks -- GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT! Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01

2 2

[Dovecot] Slightly OT: iPhone & IMAP IDLE
by Sabahattin Gucukoglu 12 Apr '10

12 Apr '10

Hi all, Does anybody know whether iPhone is supposed to be able to do IMAP IDLE? I know it does "Push" but that seems to be using Apple's Mobile Me and Exchange. Cheers, Sabahattin

2 1

[Dovecot] Dovecot 1.2.11, Quota and SQL
by Mikaël PIRIO 10 Apr '10

10 Apr '10

Hello, I have a problem :(... I try to define User Quotas in Dovecot (in my DB mySQL) but default quotas (in my dovecot.conf) are always set for all users. I've defined default quota to 500M. I set 0 to one account in my DB but when i see my logs, this account have a 500M quota ! Could you help me ? My configuration : # 1.2.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-xenU i686 Debian 5.0.4 ext3 log_path: /var/log/dovecot.err info_log_path: /var/log/dovecot.info log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_location: maildir:/var/vmail/%d/%n/.maildir mail_debug: yes mbox_write_locks: fcntl dotlock mail_plugins: quota imap_quota auth default: debug: yes debug_passwords: yes passdb: driver: pam passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: static args: uid=vmail gid=vmail home=/var/vmail/%d/%n userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: maildir:User quota quota_rule: *:storage=500M quota_rule2: Trash:storage=10M My dovecote-sql.conf : driver = mysql connect = host=localhost dbname=mail user=mail password=MyPassWord default_pass_scheme = CRYPT password_query = SELECT full_address AS user, password FROM admin_mailbox WHERE full_address = '%u' user_query = SELECT path AS home, uid, gid, concat('*:storage=', quota, 'M') AS quota_rule FROM admin_mailbox WHERE full_address = '%u' When I request my DB, it's OK : mysql> SELECT path AS home, uid, gid, concat('*:storage=', quota, 'M') AS quota_rule FROM admin_mailbox WHERE full_address = 'toto(a)dom.tld'; +------------------------+-----+-----+--------------+ | home | uid | gid | quota_rule | +------------------------+-----+-----+--------------+ | dom.tld/toto/.maildir/ | 500 | 500 | *:storage=0M | +-------------- ---------+-----+-----+--------------+ 1 row in set (0.00 sec) But when i see my logs : IMAP(toto(a)dom.tld): Info: Loading modules from directory: /usr/lib/dovecot/modules/imap IMAP(toto(a)dom.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so IMAP(toto(a)dom.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so IMAP(toto(a)dom.tld): Info: Effective uid=1002, gid=1004, home=/var/vmail/dom.tld/toto IMAP(toto(a)dom.tld): Info: Quota root: name=User quota backend=maildir args= IMAP(toto(a)dom.tld): Info: Quota rule: root=User quota mailbox=* bytes=524288000 messages=0 IMAP(toto(a)dom.tld): Info: Quota rule: root=User quota mailbox=Trash bytes=10485760 messages=0 Thanks for your help, -- Mikaël,

1 1

[Dovecot] zlib Plugin Dovecot 2.0
by Alex Baule 09 Apr '10

09 Apr '10

Hi Everyone.... Someone can explain to me the difference from zlib 1.2.X and 2.0 beta4 ?? In zlib from 2.0 beta4, Which part of the plugin is responsible for write the compressed message ?

2 4

[Dovecot] push mail support
by Ibrahim Harrani 09 Apr '10

09 Apr '10

Hello, I would like to use push in qmail+dovecot environments. Can someone tell me which components should I use to enable this feature for mobile devices? Thanks. -Ibrahim.

4 8

[Dovecot] Trouble with managesieve symbolic link creation
by Daniela Silva 09 Apr '10

09 Apr '10

Hi, I've been trying to get managesieve to work on our installation, but although almost everything works fine the symbolic link from .dovecot.sieve to the sieve dir gets created with a / in the beginning: drwx------ 4 vmail users 128 2010-04-08 18:35 . drwxr-xr-x 5 vmail users 144 2009-08-28 18:26 .. lrwxrwxrwx 1 vmail users 17 2010-04-08 18:35 .dovecot.sieve -> /sieve/ingo.sieve drwx------ 20 vmail users 952 2010-04-08 16:47 maildir drwx------ 3 vmail users 104 2010-04-08 18:35 sieve Can anyone see what I'm doing wrong? You can find the dovecot configuration below. Thanks, -- Daniela Silva # 1.2.11: /etc/dovecot/dovecot.conf protocols: imap pop3 managesieve listen: 10.1.0.1 10.1.32.1 10.1.33.1 10.1.33.2 10.1.33.3 ssl: no disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_processes_count: 128 login_max_processes_count: 512 max_mail_processes: 2500 verbose_proctitle: yes mail_uid: 1000 mail_gid: 100 mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): quota imap_quota zlib trash mail_plugins(imap): quota imap_quota zlib trash mail_plugins(pop3): quota zlib mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib64/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib64/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib64/dovecot/modules/managesieve mail_log_max_lines_per_sec: 0 lda: postmaster_address: postmaster(a)portugalmail.net mail_plugins: quota sieve mail_plugin_dir: /usr/lib64/dovecot/modules/lda auth_socket_path: /var/run/dovecot/auth-master auth default: mechanisms: plain login passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: users plugin: quota: maildir trash: /etc/dovecot/dovecot-trash.conf sieve: ~/.dovecot.sieve sieve_dir: ~/sieve

2 1

[Dovecot] Sieve scripts
by Nick Lunt 09 Apr '10

09 Apr '10

Hi I have a simple sieve script to discard email with a certain string in the subject. I now need to beef this up a bit with the following: if header :contains "subject" "A" and "B" and not "C" discard if header :contains "subject" "A" and "D" and not "C" discard else pass Maybe my google skills are failing but I can't find much info on creating sieve scripts. Can anyone point me in the right direction to achieve this please ? Cheers Nick . __________ Information from ESET NOD32 Antivirus, version of virus signature database 4992 (20100401) __________ The message was checked by ESET NOD32 Antivirus. http://www.eset.com

4 5

[Dovecot] Dovecot 2.0 and QUOTA capability
by Frode Nordahl 09 Apr '10

09 Apr '10

Hello, In Dovecot 2.0 the QUOTA capability is not announced until after the user has logged in. This breaks quota-support in some webmail clients (Roundcube, Atmail, probably more). After searching the lists, I see that this was fixed as a bug back in 1.0, but I guess it crept back in. :-) 1.0.7: * OK Dovecot ready. . CAPABILITY * CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS QUOTA STARTTLS AUTH=PLAIN . OK Capability completed. 2.0: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN] Dovecot ready. . capability * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN . OK Capability completed. -- Frode Nordahl

3 4

[Dovecot] Shared folders in 2.0
by B. Johannessen 09 Apr '10

09 Apr '10

Anyone using shared folders in 2.0? If so, would you care to share your configuration? I'm seeing all kinds of strangeness, and the only consistent thing so far is that my results are thoroughly inconsistent. There's a very good chance this is all because of my very limited experience with Dovecot, which is why I'd like to be able to start my experiments from a known good configuration. Anyone? Bob

1 0

[Dovecot] unknown user
by Simone Neugierig 08 Apr '10

08 Apr '10

Hi, im in the process of setting up a virtual domain next to a real one with dovecot and postfix. Looks like postfix sends the mail to deliver: #mail.info postfix/pipe[23588]: F254880ED8: to=<julius(a)abm.ath.cx>, relay=dovecot, delay=0.04, delays=0.03/0/0/0.01, dsn=5.1.1, status=bounced (user unknown) but dovecot doesnt know my user: #dovecot-info.log dovecot: Apr 08 16:16:42 Info: auth(default): passwd-file(julius(a)abm.ath.cx): unknown user my user: #/etc/dovecot/passwd julius:{PLAIN}somepassword Any ideas whats wrong? more infos: this is a debian lenny with the default postfix installation, changes to #master.cf dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${recipient} #main.cf dovecot_destination_recipient_limit = 1 virtual_mailbox_domains = abm.ath.cx virtual_transport = dovecot #dovecot.conf protocols = imap imaps pop3 pop3s log_path = /var/log/dovecot.log info_log_path = /var/log/dovecot-info.log disable_plaintext_auth = no mail_location = maildir:~/Maildir pop3_uidl_format = %08Xu%08Xv auth_verbose = yes auth default { mechanisms = plain passdb passwd-file { args = /etc/dovecot/passwd } userdb static { args = uid=vmail gid=vmail home=/home/vmail/%u } socket listen { master { path = /var/run/dovecot/auth-master mode = 0600 } } } greets -- GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT! Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01

2 2

[Dovecot] Incoming mails + remote backup
by minim 08 Apr '10

08 Apr '10

Hello, I have to take two copy of incoming mails on different servers(local & remote). I am using plain server without any panel on it and using sendmail, pop3 server Dovecot. Is there a way(any configurations) to take a remote backup for all incoming mails? except configuring forwarder to each mail ID !!!! Waiting for suggestions. Thanks in advance -- View this message in context: http://old.nabble.com/Incoming-mails-%2B-remote-backup-tp28137629p28137629.… Sent from the Dovecot mailing list archive at Nabble.com.

3 9

[Dovecot] Manage mails from server
by Неворотин Вадим 08 Apr '10

08 Apr '10

I've configure Dovecot with shared namespace and IMAP ACL's to make a group mailboxes. I use maildir mailboxes, and I add dovecot-shared file to each group mailbox. So each user with access to group mailbox has their own \Seen flag. And now I need automatically delete a mail from server after 2 weeks after each user has readed email in shared mailbox. How can I from, e.g. Perl script, get \Seen flag for user and mail and then correctly delete a mail from a server? I need to create fully automatical mail system, maybe there is some HOW-TO's or examples anywhere? And will I can in 2.0 use per-user \Deleted flag, not only \Seen?

3 5

[Dovecot] Have problem with antispam plugin
by gerasew＠gmail.com 08 Apr '10

08 Apr '10

I downloaded the source code plug-in version 1.3 from http://johannes.sipsolutions.net/download/dovecot-antispam/ Unpack and make from this .config file: BACKEND=mailtrain DOVECOT=/usr/include/dovecot INSTALLDIR=/usr/lib/dovecot/modules/imap USER=root GROUP=root DEBUG=syslog DEBUG_VERBOSE=1 PLUGINNAME=antispam Dovecot cofing file: protocol imap { login_executable = /usr/lib/dovecot/imap-login mail_executable = /usr/lib/dovecot/imap mail_plugins = quota imap_quota antispam } plugin { antispam_mail_sendmail = /usr/bin/sa-learn antispam_mail_spam = --spam antispam_mail_notspam = --ham antispam_mail_tmpdir = /tmp antispam_trash_pattern_ignorecase = trash;Deleted * antispam_spam_pattern_ignorecase = junk;spam } When move message into\from "Spam" folder get error: [SERVERBUG] failed to send email In syslog: imap: antispam: plugin initialising (1.3-notgit) dovecot: IMAP(test(a)u-kon.ru): Loading modules from directory: /usr/lib/dovecot/modules/imap dovecot: IMAP(test(a)u-kon.ru): Module loaded: /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so dovecot: IMAP(test(a)u-kon.ru): Module loaded: /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so dovecot: IMAP(test(a)u-kon.ru): Module loaded: /usr/lib/dovecot/modules/imap/lib90_antispam_plugin.so dovecot: IMAP(test(a)u-kon.ru): Effective uid=8, gid=12, home=(none) dovecot: IMAP(test(a)u-kon.ru): Quota root: name= backend=maildir args= dovecot: IMAP(test(a)u-kon.ru): Quota rule: root= mailbox=* bytes=2134810624 messages=0 dovecot: imap-login: Login: user=<test(a)u-kon.ru>, method=PLAIN, rip=192.168.10.59, lip=192.168.10.77, TLS imap: antispam: "trash" is case-insensitive wildcard match trash folder imap: antispam: "deleted *" is case-insensitive wildcard match trash folder imap: antispam: "SPAM" is exact match spam folder imap: antispam: "junk" is case-insensitive wildcard match spam folder imap: antispam: "spam" is case-insensitive wildcard match spam folder imap: antispam: no unsure folders imap: antispam: mail backend spam address --spam imap: antispam: mail backend not-spam address --ham imap: antispam: mail backend sendmail /usr/bin/sa-learn imap: antispam: mail backend sendmail arg --single imap: antispam: mail backend tmpdir /tmp dovecot: IMAP(test(a)u-kon.ru): maildir: data=/var/spool/mail/test(a)u-kon.ru dovecot: IMAP(test(a)u-kon.ru): maildir++: root=/var/spool/mail/test(a)u-kon.ru, index=, control=, inbox=/var/spool/mail/test(a)u-kon.ru dovecot: IMAP(test(a)u-kon.ru): Namespace : Using permissions from /var/spool/mail/test(a)u-kon.ru: mode=0700 gid=-1 imap: antispam: mailbox_is_unsure(Junk): 0 imap: antispam: mailbox_is_trash(INBOX): 0 imap: antispam: mailbox_is_trash(Junk): 0 imap: antispam: mail copy: from trash: 0, to trash: 0 imap: antispam: mailbox_is_spam(INBOX): 0 imap: antispam: mailbox_is_spam(Junk): 1 imap: antispam: mailbox_is_unsure(INBOX): 0 imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 imap: antispam: running mailtrain backend program /usr/bin/sa-learn imap: antispam: running mailtrain backend program /usr/bin/sa-learn imap: antispam: run program failed with exit code 9 Get sa-learn output from help this script: #!/bin/bash ( id -a sa-learn rc=$? echo "exit code $rc" exit $rc ) > /tmp/antispam.out.$$ 2> /tmp/antispam.err.$$ antispam.err - contains output as "sa-learn --help" So this means that the call comes without any parameters or with incorrect parameters. I need this to work, please help.

2 4

[Dovecot] ImapTest build problem
by Proskurin Kirill 08 Apr '10

08 Apr '10

Hello. My system is: Debian Lenny 2.6.26-2-amd64 I try to build Imaptest and follow http://www.imapwiki.org/ImapTest/Installation But get this: ./configure --with-dovecot=../dovecot-2.0.beta4 && make checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for gawk... gawk checking whether make sets $(MAKE)... yes checking whether to enable maintainer-specific portions of Makefiles... no checking for gcc... gcc checking for C compiler default output file name... a.out checking whether the C compiler works... yes checking whether we are cross compiling... no checking for suffix of executables... checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether gcc accepts -g... yes checking for gcc option to accept ANSI C... none needed checking for style of include used by make... GNU checking dependency style of gcc... gcc3 checking how to run the C preprocessor... gcc -E checking build system type... x86_64-unknown-linux-gnu checking host system type... x86_64-unknown-linux-gnu checking for a sed that does not truncate output... /bin/sed checking for egrep... grep -E checking for ld used by gcc... /usr/bin/ld checking if the linker (/usr/bin/ld) is GNU ld... yes checking for /usr/bin/ld option to reload object files... -r checking for BSD-compatible nm... /usr/bin/nm -B checking whether ln -s works... yes checking how to recognise dependent libraries... pass_all checking for ANSI C header files... yes checking for sys/types.h... yes checking for sys/stat.h... yes checking for stdlib.h... yes checking for string.h... yes checking for memory.h... yes checking for strings.h... yes checking for inttypes.h... yes checking for stdint.h... yes checking for unistd.h... yes checking dlfcn.h usability... yes checking dlfcn.h presence... yes checking for dlfcn.h... yes checking for g++... g++ checking whether we are using the GNU C++ compiler... yes checking whether g++ accepts -g... yes checking dependency style of g++... gcc3 checking how to run the C++ preprocessor... g++ -E checking for g77... no checking for f77... no checking for xlf... no checking for frt... no checking for pgf77... no checking for fort77... no checking for fl32... no checking for af77... no checking for f90... no checking for xlf90... no checking for pgf90... no checking for epcf90... no checking for f95... no checking for fort... no checking for xlf95... no checking for ifc... no checking for efc... no checking for pgf95... no checking for lf95... no checking for gfortran... no checking whether we are using the GNU Fortran 77 compiler... no checking whether accepts -g... no checking the maximum length of command line arguments... 32768 checking command to parse /usr/bin/nm -B output from gcc object... ok checking for objdir... .libs checking for ar... ar checking for ranlib... ranlib checking for strip... strip checking if gcc supports -fno-rtti -fno-exceptions... no checking for gcc option to produce PIC... -fPIC checking if gcc PIC flag -fPIC works... yes checking if gcc static flag -static works... yes checking if gcc supports -c -o file.o... yes checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes checking whether -lc should be explicitly linked in... no checking dynamic linker characteristics... GNU/Linux ld.so checking how to hardcode library paths into programs... immediate checking whether stripping libraries is possible... yes checking if libtool supports shared libraries... yes checking whether to build shared libraries... yes checking whether to build static libraries... yes configure: creating libtool appending configuration tag "CXX" to libtool checking for ld used by g++... /usr/bin/ld -m elf_x86_64 checking if the linker (/usr/bin/ld -m elf_x86_64) is GNU ld... yes checking whether the g++ linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes checking for g++ option to produce PIC... -fPIC checking if g++ PIC flag -fPIC works... yes checking if g++ static flag -static works... yes checking if g++ supports -c -o file.o... yes checking whether the g++ linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes checking dynamic linker characteristics... GNU/Linux ld.so checking how to hardcode library paths into programs... immediate appending configuration tag "F77" to libtool configure: creating ./config.status config.status: creating Makefile config.status: creating src/Makefile config.status: creating stamp.h config.status: creating imaptest-config.h config.status: imaptest-config.h is unchanged config.status: executing depfiles commands make all-recursive make[1]: Entering directory `/root/imaptest-20100221' Making all in src make[2]: Entering directory `/root/imaptest-20100221/src' if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I/root/dovecot-2.0.beta4 -I/root/dovecot-2.0.beta4/src/lib -I/root/dovecot-2.0.beta4/src/lib-mail -I/root/dovecot-2.0.beta4/src/lib-imap -g -O2 -MT client.o -MD -MP -MF ".deps/client.Tpo" -c -o client.o client.c; \ then mv -f ".deps/client.Tpo" ".deps/client.Po"; else rm -f ".deps/client.Tpo"; exit 1; fi client.c: In function ‘client_enabled’: client.c:178: warning: assignment makes pointer from integer without a cast client.c: In function ‘client_vanished’: client.c:203: error: called object ‘3’ is not a function client.c:207: warning: passing argument 1 of ‘strlen’ makes pointer from integer without a cast client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: passing argument 1 of ‘__builtin_strcmp’ makes pointer from integer without a cast client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: passing argument 1 of ‘strlen’ makes pointer from integer without a cast client.c:207: warning: passing argument 1 of ‘__builtin_strcmp’ makes pointer from integer without a cast client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: passing argument 1 of ‘__builtin_strcmp’ makes pointer from integer without a cast client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: passing argument 1 of ‘__builtin_strcmp’ makes pointer from integer without a cast client.c:221: warning: assignment makes pointer from integer without a cast client.c: In function ‘client_handle_untagged’: client.c:278: warning: passing argument 1 of ‘t_str_ucase’ makes pointer from integer without a cast client.c:286: warning: passing argument 1 of ‘t_str_ucase’ makes pointer from integer without a cast client.c:312: warning: pointer/integer type mismatch in conditional expression client.c: In function ‘client_input_args’: client.c:354: warning: assignment makes pointer from integer without a cast client.c:378: warning: assignment makes pointer from integer without a cast make[2]: *** [client.o] Error 1 make[2]: Leaving directory `/root/imaptest-20100221/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/root/imaptest-20100221' make: *** [all] Error 2 -- Best regards, Proskurin Kirill

2 5

[Dovecot] dovecot upgrade problems
by Cieslak, Andreas 08 Apr '10

08 Apr '10

Hi list, i made an upgrade from dovecot 1.0RC15 to 1.1.20 the default installation was under /etc/dovecot. The upgrade installation was made under /usr/local/etc. After that i changed all the paths in the /usr/local/etc/dovecot.conf and the dovecot-binary to work with the new installation. Even path-changes were made for /etc/init.d/dovecot to work with the version 1.1.20. Changes in the /etc/init.d/dovecot: #### PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin DAEMON=/usr/local/sbin/dovecot NAME=dovecot DESC="mail server" test -x $DAEMON || exit 0 set -e # The init script should do nothing if dovecot is being run from inetd for p in `sed -r "s/^ *(([^:]+|\[[^]]+]|\*):)?(pop3s?|imaps?)[ \t].*/\3/;t;d" \ /etc/inetd.conf` do for q in `sed -r "s/^ *protocols[ \t]*=[ \t]*(([^\"]*)|\"(.*)\")/\2\3/;t;d" \ /usr/local/etc/dovecot.conf` do if [ $p = $q ]; then exit 0 fi done done case "$1" in start) if grep protocols /usr/local/etc/dovecot.conf | sed 's/#.*$//' | tr -d '"' | \ egrep -q '[^#]*(\bpop3s?\b|\bimaps?\b)'; then if [ -x /usr/local/libexec/dovecot/imap-login -a -x /usr/local/libexec/dovecot/imap ] \ || [ -x /usr/local/libexec/dovecot/pop3-login -a -x /usr/local/libexec/dovecot/pop3 ] #### If I leave the DAEMON-Path to =/usr/sbin/dovecot Dovecot is running fine!!! The only thing which is missing under /usr/local is the auth-master file. Under /var/run/dovecot the old auth-master file exists. Why not under the upgrade path? Anyway, here is the logging when i try to start dovecot: Apr 6 16:18:37 server dovecot: dovecot v1.1.20 starting up (core dumps disabled) Apr 6 16:18:37 server dovecot: Fatal: auth(default): Dovecot version mismatch: Master is v1.1.20, dovecot-auth is v1.0.rc15 (if you don't care, set version_ignore=yes) Apr 6 16:18:37 server dovecot: Fatal: Auth process died too early - shutting down server:/usr/local/etc# /etc/init.d/dovecot restart Restarting mail server: dovecotWarning: Last died with error (see error log for more information): Auth process died too early - shutting down Also the configuration output: dovecot -n # 1.1.20: /usr/local/etc/dovecot.conf # OS: Linux 2.6.18-4-686 i686 Debian 4.0 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps pop3s imap ssl_key_file: /etc/ssl/private/dovecot.key disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_max_processes_count: 256 first_valid_uid: 1000 last_valid_uid: 5000 mail_access_groups: mail mail_location: maildir:~/Maildir mail_debug: yes mail_full_filesystem_access: yes mbox_write_locks: fcntl mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 lda: postmaster_address: cieslak(a)folkwang-hochschule.de hostname: server log_path: /var/log/dovecot-deliver.log info_log_path: /var/log/dovecot-deliver.log sendmail_path: /usr/lib/sendmail auth default: mechanisms: login plain verbose: yes debug: yes process_size: 512 passdb: driver: passwd args: /etc/passwd passdb: driver: shadow args: /etc/shadow passdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf userdb: driver: passwd args: blocking=yes userdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf socket: type: listen master: path: /usr/local/var/run/dovecot/auth-master mode: 384 user: mail plugin: quota: maildir ###auth-master is not existing under the path /usr/local/var/run/dovecot/auth-master. Is this the fault? Can anyone help me out? Andreas Cieslak IT-Systeme Folkwang Hochschule Musik | Theater | Tanz | Gestaltung | Wissenschaft Klemensborn 39 45239 Essen Fon: 0201_4903-218 Fax: 0201_4903-288 cieslak(a)folkwang-hochschule.de www.folkwang-hochschule.de <http://www.folkwang-hochschule.de/>

4 7

[Dovecot] sasl problem
by Yavuz Maşlak 07 Apr '10

07 Apr '10

Hello I installed postfix, mysql, dovecot on freebsd7.3. Yet I can't start dovecot service. I get some errors; Apr 4 17:03:14 postfix dovecot: auth(default): Fatal: Socket already exists: /var/spool/postfix/private/auth Apr 4 17:03:14 postfix dovecot: dovecot: Fatal: Auth process died too early - shutting down How can I get rid of that ? # dovecot --version 1.2.10 # postconf -a dovecot # dovecot -n # 1.2.10: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.3-RELEASE i386 ufs base_dir: /var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/dovecot/cert.pem ssl_key_file: /etc/ssl/dovecot/key.pem disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: ISP Mail Server Ready. first_valid_uid: 125 last_valid_uid: 125 first_valid_gid: 125 last_valid_gid: 125 mail_location: maildir:/usr/local/virtual/%d/%n mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 lda: postmaster_address: postmaster(a)test.com auth default: mechanisms: plain login debug: yes passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix # grep -v '^ *$#.*$\?$' /usr/local/etc/dovecot-sql.conf driver = mysql connect = host=localhost dbname=postfix user=postfix password=postfix_mysql_password default_pass_scheme = MD5 password_query = SELECT password FROM mailbox WHERE username = '%u' user_query = SELECT maildir, 125 AS uid, 125 AS gid, CONCAT('maildir:storage=', FLOOR( quota / 1024 ) ) AS quota FROM mailbox WHERE username = '%u' AND active = '1' # postconf -n broken_sasl_auth_clients = yes command_directory = /usr/local/sbin config_directory = /usr/local/etc/postfix daemon_directory = /usr/local/libexec/postfix data_directory = /var/db/postfix debug_peer_level = 2 html_directory = /usr/local/share/doc/postfix mail_owner = postfix mailq_path = /usr/local/bin/mailq manpage_directory = /usr/local/man mydestination = localhost.$mydomain, localhost mydomain = test.com myhostname = www.test.com mynetworks_style = host newaliases_path = /usr/local/bin/newaliases proxy_read_maps = $local_recipient_maps $mydestination $virtual_alias_maps $virtual_alias_domains $virtual_mailbox_maps $virtual_mailbox_domains $relay_recipient_maps $relay_domains $canonical_maps $sender_canonical_maps $recipient_canonical_maps $relocated_maps $transport_maps $mynetworks $virtual_mailbox_limit_maps queue_directory = /var/spool/postfix readme_directory = /usr/local/share/doc/postfix relay_domains = proxy:mysql:/usr/local/etc/postfix/mysql_relay_domains_maps.cf sample_directory = /usr/local/etc/postfix sendmail_path = /usr/local/sbin/sendmail setgid_group = maildrop smtp_tls_note_starttls_offer = yes smtp_use_tls = yes smtpd_recipient_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_non_fqdn_hostname, reject_non_fqdn_sender, reject_non_fqdn_recipient, reject_unauth_destination, reject_unauth_pipelining, reject_invalid_hostname, reject_rbl_client list.dsbl.org, reject_rbl_client bl.spamcop.net, reject_rbl_client sbl-xbl.spamhaus.org smtpd_sasl_auth_enable = yes smtpd_sasl_authenticated_header = yes smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = private/auth smtpd_sasl_security_options = noanonymous smtpd_sasl_type = dovecot smtpd_sender_restrictions = permit_sasl_authenticated, permit_mynetworks smtpd_tls_CAfile = /etc/ssl/postfix/smtpd.pem smtpd_tls_cert_file = /etc/ssl/postfix/smtpd.pem smtpd_tls_key_file = /etc/ssl/postfix/smtpd.pem smtpd_tls_loglevel = 0 smtpd_tls_received_header = yes smtpd_tls_session_cache_timeout = 3600s smtpd_use_tls = yes soft_bounce = no tls_random_source = dev:/dev/urandom unknown_local_recipient_reject_code = 550 virtual_alias_maps = proxy:mysql:/usr/local/etc/postfix/mysql_virtual_alias_maps.cf virtual_gid_maps = static:125 virtual_mailbox_base = /usr/local/virtual virtual_mailbox_domains = proxy:mysql:/usr/local/etc/postfix/mysql_virtual_domains_maps.cf virtual_mailbox_limit = 51200000 virtual_mailbox_limit_maps = proxy:mysql:/usr/local/etc/postfix/mysql_virtual_mailbox_limit_maps.cf virtual_mailbox_limit_override = yes virtual_mailbox_maps = proxy:mysql:/usr/local/etc/postfix/mysql_virtual_mailbox_maps.cf virtual_maildir_limit_message = Sorry, this user has overdrawn their diskspace quota. Please try again later. virtual_minimum_uid = 125 virtual_overquota_bounce = yes virtual_transport = virtual virtual_uid_maps = static:125

2 4

[Dovecot] Forcing NOSELECT for a Maildir folder?
by Nils 07 Apr '10

07 Apr '10

Hello, is it at all possible, possibly without modifying the source code of Dovecot, to enforce that a mailbox gets the NOSELECT attribute? I have a namespace set up like this: namespace private { separator = / prefix = Local Folders/ location = maildir:/xyz/core/store/maildir/%u/ inbox = yes hidden = no list = yes subscriptions = yes } And the folder hierarchy my client builds based on the LIST response from Dovecot comes out as: INBOX Local Folders <--- (standard flags, but no NOSELECT) - Folder 1 -- Folder 1.1 - Folder 2 - Sent - Trash Public Folders <--- NOSELECT - Announcements That's how I expect it, except that I don't want "Local Folders" to be selectable. When I select it and list the contents, I get the contents of INBOX. I have no clue why that happens. :-/ For the public namespace, everything works as expected, so I'm lost. Basically: I want "Local Folders" to be like "Public Folders" and have \NOSELECT. In maildir_storage.c I can find places where a MAILBOX_NOSELECT flag is set, but from what I understand that's only done if the path is not a directory or if the permissions are insufficient. Random taking away of permissions on folders didn't yield the result I wanted. Either it resulted in no change, or in Dovecot complaining that the permissions were now too restrictive. Forgive me if I missed something obvious. I only studied the source using grep and nano for 10 minutes before adding an ugly hack in my client to fake that Dovecot gave the "Local Folders" mailbox the NOSELECT attribute (my client is the only one that will ever talk to my installation of Dovecot, so I can do that). The wiki also didn't mention anything on NOSELECT. Google searches didn't help either. I'd much rather have Dovecot give the response I want, rather than bending its responses around in my client. Any ideas how I can achieve that? - Nils --------------- [q@lala dovecot]# dovecot --version 1.2.11 --------------- [q@lala dovecot]# telnet 127.0.0.1 144 * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5] Private Messages Server 0 LOGIN abc def OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS QUOTA] Logged in 1 LIST "" "*" * LIST (\HasChildren) "/" "Local Folders" * LIST (\HasNoChildren) "/" "Local Folders/Trash" * LIST (\HasNoChildren) "/" "Local Folders/Sent" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasChildren) "/" "Public Folders" * LIST (\HasNoChildren) "/" "Public Folders/Announcements" 1 OK List completed. 2 STATUS INBOX (messages) * STATUS "INBOX" (MESSAGES 4) 2 OK Status completed. 3 STATUS "Local Folders" (messages) * STATUS "Local Folders" (MESSAGES 4) 3 OK Status completed. 4 LOGOUT * BYE Logging out 4 OK Logout completed. --------------- [q@lala dovecot]# dovecot -n -c /etc/dovecot/dovecot-pm.conf # 1.2.11: /etc/dovecot/dovecot-pm.conf # OS: Linux 2.6.32-ARCH i686 base_dir: /var/run/dovecot-pm/ listen: 127.0.0.1:144 ssl: no disable_plaintext_auth: no login_dir: /var/run/dovecot-pm//login login_executable: /usr/lib/dovecot/imap-login login_greeting: Private Messages Server mail_max_userip_connections: 5 mail_debug: yes mail_plugins: quota imap_quota trash acl namespace: type: private separator: / prefix: Local Folders/ location: maildir:/xyz/core/store/maildir/%u/ inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: Public Folders/ location: maildir:/xyz/core/store/publicmaildir/:INDEX=~/public/ list: yes auth default: mechanisms: plain login cram-md5 user: xyz passdb: driver: sql args: /etc/dovecot/dovecot-pm-sql.conf userdb: driver: static args: uid=xyz gid=xyz home=/xyz/core/store/maildir/%n plugin: quota: maildir:User Quota quota_rule: *:backend=1000C,26214400S quota_rule2: Trash:storage=25M quota_warning: storage=80%% /xyz/cronobs/QuotaWarning.php quota_warning2: messages=9500 /xyz/cronobs/QuotaWarning.php trash: /etc/dovecot/dovecot-pm-trash.conf acl_anyone: allow acl: vfile:/etc/dovecot/pm-acls --------------- [q@lala dovecot]# cat /etc/dovecot/dovecot-pm-sql.conf driver = pgsql connect = host=127.0.0.1 dbname=xyz user=abc password=def default_pass_scheme = PLAIN password_query = \ SELECT "Username" AS "username", "Password" as "password" \ FROM "users" WHERE "Username" = '%n'; --------------- [q@lala dovecot]# cat /etc/dovecot/dovecot-pm-trash.conf 1 Local Folders/Trash --------------- [q@lala dovecot]# cat /etc/dovecot/pm-acls/Announcements authenticated lrs

3 2

[Dovecot] Clients to manage ACL
by Martin Ott 07 Apr '10

07 Apr '10

Hi, is there any list with clients which support setting ACL on imap-mailboxes? Up to now, a only know about KMail and imapACLM. Thanks, Martin

7 10

[Dovecot] Maildir archive utility for historical filing
by Dimitrios Karapiperis 07 Apr '10

07 Apr '10

Hi all! Is there any utility to archive maildir folders based on message date? I found cleanup-maildir, but you have to supply the directory as parameter. thanks in advance Dimitrios

3 2

[Dovecot] Testing 2.0b3 - problem with pop3
by Odhiambo Washington 07 Apr '10

07 Apr '10

I am testing the version on FreeBSD 7.3-PRELEASE (I doubt it's the issue) and I am having a problem with pop3. Here is what I see in the log when I attempt to connect to port 110: Feb 22 18:15:03 master: Warning: SIGHUP received - reloading configuration Feb 22 18:15:08 pop3-login: Panic: file login-settings.c: line 216 (login_settings_read): assertion failed: (input.roots[count] == NULL) Feb 22 18:15:08 master: Error: service(pop3-login): child 70115 killed with signal 6 (core dumped) Feb 22 18:15:08 master: Error: service(pop3-login): command startup failed, throttling And the output of doveconf can be seen at http://62.8.64.102/~wash/2.0b3.txt I've basically made my best effort to reflect the settings I had on 2.0b1 into this version. What could the problem be? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254733744121/+254722743223 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ "If you have nothing good to say about someone, just shut up!." -- Lucky Dube

7 10

[Dovecot] Timeout Value
by JackyC＠umac.mo 07 Apr '10

07 Apr '10

Dear All, I constantly encounter 'dovecot-auth', 'login-imap', 'login-pop3' and 'imap' processes consume 100% CPU. I run 'ps' and found those hanged up processes were running for a long time. I am wondering whether dovecot.conf has some configuration parameters that timeout those processes (or kill those after certain period of time). I am using dovecot 1.2.11 on RHEL 5.3. Many thanks ~~~ Yours Sincerely, Jacky Chan

4 11

[Dovecot] expires
by ben＠electricembers.net 07 Apr '10

07 Apr '10

When the expire cronjob actually finds a folder needs pruning, does it then purge the row from the database? Or could it update the row with the "new" oldest message's expiration time? I guess I can test this for myself. I did just learn that emptying the Trash removes the row from the expires db. . . I had misconfigured expires here, and think I fixed it, but in checking things over, I do find some "over age" files, and their users don't appear in the expires db. So I'm assuming it's because expiration worked on that folder some time ago, and no "new" messages have been delivered there since then to reset the expires db? (Sometimes I wish there wasn't the db, and we could just have a nightly cronjob do all the work on all users' Trash, Spam, Virus folders -- where we pretty much expect to be constantly pruning, or shaving as it were ;) Benjamin

1 0

[Dovecot] please me help with correct that error than upgrade to dovecot
by fakessh 06 Apr '10

06 Apr '10

hello all hello list hello girl hello much many people me help with correct that error than upgrade to dovecot the upgrace goes well, but I have errors when restarting the application necessary: mistake here. please help me to correct them. I would really benefit from the novelties of this version of dovecot [root@r13151 ~]# rpm -Uvh /home/ftpchrootshell/fakessh/dovecot-1.2.10-2_107.el5.i386.rpm attention: /home/ftpchrootshell/fakessh/dovecot-1.2.10-2_107.el5.i386.rpm: Ent�te V4 DSA signature: NOKEY, key ID 66534c2b Pr�paration... ########################################### [100%] 1:dovecot attention: /etc/dovecot.conf cr�� en tant que /etc/dovecot.conf.rpmnew ########################################### [100%] [root@r13151 ~]# service dovecot restart Arr�t de Dovecot Imap : [ OK ] D�marrage de Dovecot Imap :Warning: fd limit 1024 is lower than what Dovecot can use under full load (more than 1280). Either grow the limit or change login_max_processes_count and max_mail_processes settings If you have trouble with authentication failures, enable auth_debug setting. See http://wiki.dovecot.org/WhyDoesItNotWork This message goes away after the first successful login. Fatal: listen(::, 143) failed: Address already in use [�CHOU] [root@r13151 ~]#

2 1

Re: [Dovecot] Manage mails from server
by Steffen Kaiser 06 Apr '10

06 Apr '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 6 Apr 2010, Неворотин Вадим wrote: >> Use PREAUTH sessions on behalf of each user to get the user-specific flag. > > But how can I use PREAUTH sessions for virtual users? I can only start See: http://wiki.dovecot.org/PreAuth if already available, I've created that page a few minutes ago. set USER= HOME= and MAIL= for the dovecot programm accordingly. regards, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iQEVAwUBS7s2gL+Vh58GPL/cAQKL3wf7BpRIYYS/Tzv7l7eSfyFGpvT/llHS13Xr EaGrbNOLPHYzRl7FFTUHrioO8I6EzHBudrWbq3ha/P065jJd0Pmmsg1vTIYGAK4c lMPYXlF/RN+J7qJ6yIgI7JrSZrYTUDKzQ1+yVtyjcgyFl0o2GGlLSHV0oQL1HEFD VojKnWLriHIJxEgmMQtGfjr8ICMVkYnXVkJcU1Ted0+IdyrBfUOs750vs84c2cxz BGmfnbsDC5s2TuhxOir7RRvfbSsg0siOEB2wyO1Gae3QYtuRDwwtWgJmG++URLiw yI6w+W/mE38NxDxlBM2BQoXLbC8e/1AmN1gHlwiDbTRwfQqBqhHhgw== =z3LP -----END PGP SIGNATURE-----

1 0

[Dovecot] PIGEON HOLE - am I being stupid?
by corpus.defero 06 Apr '10

06 Apr '10

Hi, I'm trying to compile dovecot-1.2-sieve-0.1.15 on a CENTOS 5 box. Using: ./configure --with-dovecot=/usr/local/etc and with: ls -Al /usr/local/etc/ total 100 -rw-r--r-- 1 root root 49576 Apr 6 12:25 dovecot.conf -rw-r--r-- 1 root root 410 Apr 6 12:25 dovecot-db-example.conf -rw-r--r-- 1 root root 782 Apr 6 12:25 dovecot-dict-sql-example.conf -rw-r--r-- 1 root root 4986 Apr 6 12:25 dovecot-ldap-example.conf -rw-r--r-- 1 root root 5097 Apr 6 12:25 dovecot-sql-example.conf But it bails with: appending configuration tag "F77" to libtool dovecot-config not found from /usr/local/etc, use --with-dovecot=PATH to give path to compiled Dovecot sources or to a directory with the installed dovecot-config file. configure: error: dovecot-config not found What am I missing here?

3 3

[Dovecot] Managing IMAP ACL from script
by Неворотин Вадим 06 Apr '10

06 Apr '10

I need to change ALC for mailboxes from a script on my server. As I understand now I can correctly change ACL only via telnet using IMAP commands. And moreover I need to know user's password for it. Is there any plans to add inheritance of ACL and ability to manage it directly from a server? And if it is in which version? Will 2.0 fully support ACL? Now I use Dovecot 1.2.10.

2 1

[Dovecot] Dovecot index storage question
by Stewart Dean 06 Apr '10

06 Apr '10

I currently run DC V1.2 for some 4K accounts using mbox folder format. I am migrating to maildir. I have a separate filesystem for the indices. Currently, the data there amounts to 4GB. I'm wondering if anyone can tell me how the storage used will change with maildir folder formatting. Will more space be used and if so, could you rough guess what the increase might be? -- ==== Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows.... ==== Stewart Dean, Unix System Admin, Bard College, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

1 0

[Dovecot] Cant get the config file just right
by eng15ine 06 Apr '10

06 Apr '10

Hello, I have been trying to get POP3 on my ubuntu server for the past week now (In Las Vegas on a family vacation carrying my netbook from hotel to hotel.) My config file is below I am trying to access pop3 from Outlook Express and Thunderbird with no luck. When ever I try to access pop3 with one of these two programs I get a prompt saying my user/pass is invalid and I am asked to logon again. I cant figure out whats wrong?!? Help would be much appreciated. Thanks in advance!!:-D -=-=-=-=-CONFIG FILE BELOW=-=-=-==-=- # Required on x86_64 kernels login_process_size = 64 protocols = imap imaps pop3 pop3s listen = * ssl_listen = * ssl_disable = yes mail_location = maildir:~/Maildir ssl_cert_file = /etc/postfix/ssl/smtpd.crt ssl_key_file = /etc/postfix/ssl/smtpd.key protocol imap { imap_client_workarounds = outlook-idle delay-newmail listen = 127.0.0.1:10143 } protocol pop3 { pop3_uidl_format = %08Xu%08Xv pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { postmaster_address = postmaster(a)example.com } auth default { mechanisms = plain login passdb pam { } userdb passwd { } # user = root socket listen { client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = postfix } } } dict { #quota = mysql:/etc/dovecot-dict-quota.conf } plugin { } mail_extra_groups = carlos admin users -- View this message in context: http://old.nabble.com/Cant-get-the-config-file-just-right-tp28146341p281463… Sent from the Dovecot mailing list archive at Nabble.com.

2 1

[Dovecot] Core dump in 2.0-beta4 and latest Mercurial
by B. Johannessen 06 Apr '10

06 Apr '10

I'm seeing core-dumps with both 2.0-beta4 and a fresh checkout from Mercurial. I'm very new to Dovecot, so there's a good chance this is caused by my limited experience with Dovecot configuration, but it's my understanding that any core-dump is considered a bug (nice policy by the way). The installation seemed to be working as expected until I added the two namespaces and tried to set up shared mailboxes. Timo: The installation is running on a KVM dedicated to testing Dovecot, so if you want to debug anything in my environment, just send me your SSH key, and I'll set it up. Attached files (from test with latest Mercurial): ------------------------------------------------- dialog.txt: IMAP dialogue to reproduce the core dump mail.info.txt: Resulting log entries debug.log.txt: Resulting debug-log entries bt-full.txt: br full for dumped core dovecot-n.txt: Output of dovecot -n sql.txt: passdb/userdb SQL configuration -- Regards B. Johannessen

2 1

[Dovecot] back soon / clang static analyzer
by Timo Sirainen 05 Apr '10

05 Apr '10

I had a flu (or something) last week and couldn't get almost anything done. I'm pretty much healed now, and today I spent some time fixing bugs already, but then I got stuck fixing issues reported by clang's static analyzer. The good thing is that it found several real bugs from error handling paths too. I'm now planning on getting the false positive list down to zero and maybe then "make distcheck" could also run the analyzer and fail if there are any warnings, so releases would be less buggy. (I guess I should make some kind of nightly check do that too and email me the results.) Anyway, I'll try to start answering some mails tomorrow. Although I'm also now lagged in my studies and there's an exam on Thursday, so it'll probably take a while to go through all the 100+ mails again..

2 1

[Dovecot] Dovecot+LDAP issues
by Daniel Gomes 05 Apr '10

05 Apr '10

Dear list members, I am having some problems with a LDAP passdb authentication on Dovecot. Before I forget, the specs: it's a Ubuntu 7.10 server running Dovecot 1.0.5 connecting to 2 different machines running LDAP servers: gold with OpenLDAP 2.4.19 and extra with OpenLDAP 2.4.9 (extra is a replication slave of gold). The initial setup of dovecot was with a MySQL passdb, which is still the first passdb, now followed by my new LDAP passdb, all with a static userdb. Here is my dovecot-ldap.conf (the LDAP passdb) (I switched the domain with example.com for privacy sake): ----------------------------------------------------------------- #Servidor hosts = gold.example.com extra.example.com tls = yes ldap_version = 3 base = ou=people,dc=example,dc=com scope = onelevel #uid/gid user_global_uid = 5000 user_global_gid = 5000 #Bind para ler coisas dn = cn=dovecot,ou=people,dc=example,dc=com dnpass = secret sasl_bind = no sasl_mech = #passdb: usar password lookups para autenticar utilizadores auth_bind = no pass_attrs = userPassword=password #, =userdb_home=/home/vmail/%d/%n pass_filter = (&(maildrop=%u)(mailacceptinguser=1)) default_pass_scheme = PLAIN-MD5 ----------------------------------------------------------------- This setup is currently working for some tests users (the others are still being auth'ed with the old MySQL passdb). Unfortunately, I seemed to have run into a big problem on an occasion when dovecot was unable to connect my first server (gold) and hence went to the second one (extra). Backtracking from the logs (starting with dovecot-error.log): Mar 31 13:11:50 bunker dovecot: auth(default): LDAP: ldap_result() failed: Can't contact LDAP server Mar 31 13:11:50 bunker dovecot: auth-worker(default): LDAP: ldap_result() failed: Can't contact LDAP server -------------------- This is when the users stopped being able to login via imap, with the following message being shown on dovecot-info.log: Mar 31 13:13:00 bunker dovecot: auth(default): ldap(user(a)domain.com,xxx.xxx.xxx.xxx): unknown user (I know, an auth_debug log would be handy here, but it wasn't activated at the time). I went on to investigate and from the slapd logs I noticed that the second LDAP server (extra) was being contacted for the passdb lookups, thus proving that dovecot considered the gold to be dead (it wasn't, but that's a different matter). Anyway, the problem is that dovecot doesn't seem to be able to retrieve the user information from extra. As the slapd log shows: Mar 31 13:41:37 extra slapd[31473]: conn=4 op=140 SRCH base="ou=people,dc=example,dc=com" scope=1 deref=0 filter="(&(?=undefined)(?=undefined))" Mar 31 13:41:37 extra slapd[31473]: conn=4 op=140 SRCH attr=userPassword Mar 31 13:41:37 extra slapd[31473]: conn=4 op=140 SEARCH RESULT tag=101 err=0 nentries=0 text= For some reason, dovecot sends an undefined filter to extra, even though the same filter works without issues with gold (and remember they are "clones"). I just can't see how this is caused by any of my configurations! Any ideas? Thanks in advance, -- Daniel Gomes

3 5

[Dovecot] POP3 how do I either retrieve spam or never put mail in spam?
by Tony Nelson 05 Apr '10

05 Apr '10

I retrieve my mail from dovecot over POP3. Sometimes dovecot delivers a message into the spam mailbox, even though I have no spam filtering enabled. I can't find anything in the wiki about "other" mailboxes and POP3. I want to either never deliver mail in any mailbox other than my default inbox, or be able to retrieve mail over POP3 from those other mailboxes. How do I do them? -- ____________________________________________________________________ TonyN.:' <mailto:tonynelson@georgeanelson.com> ' <http://www.georgeanelson.com/>

3 4

[Dovecot] dovecot + Active Directory + LDA
by Christian Lyra 04 Apr '10

04 Apr '10

Hi there, I´m working on a setup with postfix (2.5.5) + dovecot (1.2.11) using a Active Directory user backend. At first, I used the instructions found here[1] to do the base configuration. As I understand, I need to use dovecot as a LDA to be able to use the quota plugin and have a per-user quota configuration, and this led me to two distinct (and opposed) configuration options. It seems that the usual dovecot + AD configuration uses the "auth_bind = yes" option, where the dovecot tries to bind to AD using user credentials. *But* to be able to use LDA, dovecot cant rely on user credentials, as there´s none when a mail arrives, so one need to use "auth_bind = no" and choose a "user" to bind to AD, using the dn and dnpass options. Am I right until here? I could just use auth_bind=no *IF* the "dn" user has the necessary privileges to read other AD users passwords (like a administrator user). Is this correct? Well, antecipating that the AD sysadmin guy will not be happy with this, I thought that maybe I could "mix" the two configurations, since I dont need the user password to find user mailbox (while delivering), but I do while doing his authentication. I may use one configuration for userdb, and another for passdb. BUT (again!) there´s another problem, since delivering needs "email" (user@domain) and authentication needs "user" values (and, it´s perfectly valid that one should use "John Doe" as user, and foo@bar as email!). So, I messed a little with user filters and got this configuration: dovecot.conf: mail_uid = 1001 mail_gid = 1001 passdb ldap { args = /etc/dovecot/dovecot-ldap-pass.conf } userdb ldap { args = /etc/dovecot/dovecot-ldap.conf } dovecot-ldap-pass.conf: hosts = 10.x.x.x base = dc=mydomain,dc=com,dc=br ldap_version = 3 auth_bind = yes auth_bind_userdn = mydomain\%u dovecot-ldap-pass.conf: hosts = 10.x.x.x auth_bind = no dn = cn=Unprivleged User,cn=Users,dc=mydomain,dc=com,dc=br dnpass = 123456 ldap_version = 3 base = dc=mydomain,dc=com,dc=br deref = never scope = subtree user_attrs = sAMAccountName=mail=maildir:/var/vmail/%$/Maildir user_filter = (&(objectClass=person)(|(mail=%u)(sAMAccountName=%u))) pass_attrs = sAMAaccountName=user,userPassword=password pass_filter = (&(objectClass=person)(sAMAaccountName=%u)) The "pass_attrs and pass_filter" in dovecot-ldap-pass.conf is not used. The clever part, or the incredible stupid one, is the the filter (&(objectClass=person)(|(mail=%u)(sAMAccountName=%u))) which means "find some person with email=something OR some person with username=user". I´m not sure of the full implications this could have... Anyway, it´s working, as the system accepts emails and the user can retrieve it using pop3. Is there a better way to doing all this? Is it safe to bind dovecot to AD with the necessary privileges to read user passwords? I´m no AD expert, but can this special user be "read-only" ? thanks in advance [1] http://www.linuxmail.info/postfix-dovecot-ldap-centos-5/ -- Christian Lyra

1 0