- dovecot - dovecot.org

[Dovecot] log_path and info_log_path - ownership of parent directory
by Phil Howard 07 May '10

07 May '10

The Ubuntu package didn't create the directory for these. What ownership/permissions are needed for it? Does it need to be owned by the dovecot user?

2 1

[Dovecot] disable plaintext auth ... only for some addresses
by Phil Howard 06 May '10

06 May '10

I'd like to disable plaintext authentication (e.g. only allow authentication that does STARTTLS or connects on SSL/TLS only ports) only for certain (most) IP addresses. I want to exempt a few addresses (users coming over known VPNs). Fortunately, all this is coming in over a firewall (Sonicwall) in which I can NAT traffic by IP address to go to specific port numbers. So, if I can establish a different disable_plaintext_auth policy by port number (for extra port numbers I'll choose later), that would let me accomplish this. If I cannot do this, then my only alternative is making the SSL/TLS only ports the only ones open to the internet, and use the non-SSL/TLS ports only for the VPNs (with disable_plaintext_auth = no). But I read somewhere that this is discouraged. What say ye?

1 0

[Dovecot] adding users to passwd-file
by Phil Howard 06 May '10

06 May '10

Is there a tool equivalent to the system "passwd" command (or maybe "adduser" or "useradd") that can support a passwd-file by setting a password, encrypting it with the salted MD5 scheme? The system "passwd" command doesn't have an option to "do it to this alternate file instead of /etc/shadow".

4 5

[Dovecot] dovecot and pigeonhole
by Vasiliy G Tolstov 06 May '10

06 May '10

Hello. Today i'm compile dovecot and pigeonhole from hg repo. After start dovecot i get errors in log like this: May 6 12:04:15 selfip dovecot: imap: Error: dlopen(/usr/lib/dovecot/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_get_log_var_expand_table Google sasys, that this functions added in dovecto 2010-04-26, why a get this error when load sieve plugin? Thnak You. -- Vasiliy G Tolstov <v.tolstov(a)selfip.ru> Selfip.Ru

2 2

[Dovecot] !include
by Andre Hübner 06 May '10

06 May '10

dovecot 1.2.11 Hello, i do some tests with: !include /etc/dovecot/conf.d/*.conf dovecot fails to start if /etc/dovecot/conf.d/ is empty. Is this a expected behaviour? !include_try works without error but seems to me to be more usual when explicit, complete filename is given. is a little bit strange in contrast to behaviour of other servertypes which support a include-directive. Thanks, Andre

1 0

Re: [Dovecot] Dovecot Won't start on SLITAZ Linux
by Ludovic LEMARINEL 06 May '10

06 May '10

2010/5/6 Ludovic LEMARINEL <l.lemarinel(a)gmail.com> > 2010/5/6 Tom Hendrikx <tom(a)whyscream.net> > > On 06/05/10 13:40, Ludovic LEMARINEL wrote: >> > 2010/5/6 Charles Marcus <CMarcus(a)media-brokers.com> >> > >> >> On 2010-05-06 4:51 AM, Ludovic LEMARINEL wrote: >> >>> I've just compiled dovecot under Slitaz, but I can't get it to >> >>> run... >> >>> >> >>> It always die with this message in log : >> >>> >> >>> 2010-05-06 12:35:12 dovecot: Info: Dovecot v1.2.11 starting up >> >>> 2010-05-06 12:35:12 dovecot: Fatal: setrlimit(RLIMIT_DATA, 256): >> >>> Operation not permitted >> >> >> >> Google is your friend. Simply highlighting the above error: >> >> >> >> Fatal: setrlimit(RLIMIT_DATA, 256): Operation not permitted >> >> >> >> Provides the answer: >> >> >> >> http://tinyurl.com/25rmjod >> >> >> >> > >> > Thanks for your answer, but no, this page does not provide the answer. >> > The error message this guy gets is not the same as me >> >> Your original post says it does. If you receive another error message, >> please add it to your problem report. Also, please try to start dovecot >> from the commandline (as suggested in the url from Charles), and tell us >> about its behaviour, output and logging. >> >> > , and I don't have any >> > "/etc/security/limits.conf" file, so I can't change this setting . >> >> Dovecot tells you only what setting to to adjust. Where you put your >> settings is largely dependant on your OS or distro implementation. >> >> >> Ow, and please do not top-post. >> >> Regards, >> Tom >> > > > I've tried to run dovecot from the command line : it says what was the last > error (see my first post), and then nothing more. > When I do "ps", I can't see any process running, and the log says dovecot > finished... > > No more message than this :( > I'm going to try with 2.0 beta, and if no luck, I'll try to go down to 1.1. > Some news from my problem : I've tried 2.0 beta, 1.1, and both didn't worked. I went down to v1.0.15, and it works... Still haven't found what's wrong with newer versions...

1 0

[Dovecot] 2.0 beta4 (5d76f5b13883): Home directory not recognized
by Thomas Leuxner 06 May '10

06 May '10

Hi, latest Mercurial seems to have problems with the Config Module unloads: May 5 19:18:16 spectre dovecot: master: Dovecot v2.0.beta4 (5d76f5b13883) starting up May 5 19:18:34 spectre dovecot: managesieve: Error: fd_read() partial input (54/88) May 5 19:18:34 spectre dovecot: imap-login: Fatal: Error reading configuration: read(/var/run/dovecot/config) failed: EOF May 5 19:18:34 spectre dovecot: master: Error: service(imap-login): command startup failed, throttling Restarting IMAP/POP3 mail server: dovecotError: user root: Initialization failed: userdb didn't return a home directory, but plugin setting quota used it (%h): dict:user::file:%h/mdbox/dovecot-quota Fatal: Invalid user settings. Refer to server log for more information. $ tail /etc/dovecot/conf.d/90-plugin.conf quota = dict:user::file:%h/mdbox/dovecot-quota quota_rule = *:storage=1GB quota_rule2 = Trash:storage=10%% acl = vfile:/var/vmail/conf.d/%d/acls:cache_secs=300 } Regards Thomas

2 2

[Dovecot] migrating maildir from 1.1.7 to 1.2.11
by Romer Ventura 05 May '10

05 May '10

Hello, I have a SLES server running dovecot 1.1.7 and postfix which happens to be the production server. We are dumping all of the paid OSes so i have configured a Debian Lenny server to run the new mail server. The debian server has everything installed and it seems to be working fine. However, i need to get all the mailboxes from the SLES server, will there be any problem if i just copy the "vmail" folder to the new server...? Thanks ------ Romer Ventura

2 1

[Dovecot] Expire plugin
by Thomas M Goerger 05 May '10

05 May '10

Hi, I'm testing out the dovecot expire plugin, and not seeing anything go into the database I've got set up. It's a mysql db. I've gone in and verified that the db is set up correctly. The socket is set up so that deliver should be able to talk to the db, but I'm not seeing anything in the expires table when I look. Is there anywhere that expire can log to so I can see what might be happening? It doesn't look like it logs to the dovecot log. Thanks! ************************************************************************* * Tom Goerger - Email/Unix System Administrator * * * * University of Minnesota Email: tmg(a)umn.edu * * Operations, Infrastructure and Architecture Phone: 4-5804 * * Internet Services Office: 626J WBOB * * * *************************************************************************

2 6

[Dovecot] Plugin to handle message saved and handle move from tmp to cur/new
by Alex Baule 05 May '10

05 May '10

Hello everyone.... I need to finish my plugin, but i depends from some stuffs in the save/move process that i can't find how its work. In new zlib plugin (2.0) , the message is saved compressed now, but i dont find how is done the process to write the file to tmp, and move it to the cur or new directory (inside .Sent). I need to hook this function, to get access to some variables, like Flags and filename. There is a way to do this ? Tks.

1 0

[Dovecot] [Bug] Case sensitive usernames and variables
by Неворотин Вадим 05 May '10

05 May '10

Today I've found a very irritating bug: I use mail_location = maildir:/var/mail/%u/ in my dovecot.conf. And if user type Username, username, USERname etc at login dovecot create a different Maildir's for one real user. But LDA works corretly and save all messages to lowercase username mailbox. No problem, add L: mail_location = maildir:/var/mail/%Lu/ Then all works good. But I has also such namespace configuration: namespace shared { separator = / prefix = &BCAEMARBBEEESwQ7BDoEOA-/%%u/ location = maildir:/var/mail/%%u:INDEX=/var/mail/%u/shared/%%u subscriptions = no list = children } And here I can't replace %u with %Lu, because dovecot write to dovecot.log: IMAP(malamut): Error: Namespace '&BCAEMARBBEEESwQ7BDoEOA-/%Lu/': shared: Shared namespace prefix contains unknown variables So user has only one mailbox (with lovercase name), but a lot of different indexes for shared mailboxes, eg /var/mail/username/shared, /var/mail/USERname/shared etc. How can I tune dovecot to use always lowercase username? Dovecot 1.2.10

2 2

[Dovecot] 2.0 FTBFS since sqlpool changes when --with-sql=plugin is used
by Michal Hlavinka 05 May '10

05 May '10

Hi, yesterday lib-sql got driver-sqlpool with some changes in Makefile.am, but these changes in makefile works only for --with-sql=yes. When --with-sql=plugin is used build fails with: libtool --tag=CC --mode=link gcc -std=gnu99 -O2 -g -pipe -Wall -Wp,- D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 - m64 -mtune=generic -Wall -W -Wmissing-prototypes -Wmissing-declarations - Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict- aliasing=2 -o checkpassword-reply checkpassword-reply.o ../../src/lib- dovecot/libdovecot.la -lrt libtool: link: gcc -std=gnu99 -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 - fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic - Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -o .libs/auth auth.o auth-cache.o auth-client-connection.o auth-master-connection.o mech- otp-skey-common.o mech-plain-common.o auth-penalty.o auth-request.o auth- request-handler.o auth-settings.o auth-stream.o auth-worker-client.o auth- worker-server.o db-checkpassword.o db-sql.o db-passwd-file.o main.o mech.o mech-anonymous.o mech-plain.o mech-login.o mech-cram-md5.o mech-digest-md5.o mech-external.o mech-gssapi.o mech-ntlm.o mech-otp.o mech-skey.o mech-rpa.o mech-apop.o mech-winbind.o passdb.o passdb-blocking.o passdb-bsdauth.o passdb- cache.o passdb-checkpassword.o passdb-passwd.o passdb-passwd-file.o passdb- pam.o passdb-shadow.o passdb-sia.o passdb-vpopmail.o passdb-sql.o userdb.o userdb-blocking.o userdb-checkpassword.o userdb-nss.o userdb-passwd.o userdb- passwd-file.o userdb-prefetch.o userdb-static.o userdb-vpopmail.o userdb-sql.o db-ldap.o passdb-ldap.o userdb-ldap.o -Wl,--export-dynamic libpassword.a ../lib-ntlm/libntlm.a ../lib-otp/libotp.a ../../src/lib-sql/.libs/libsql.a ../../src/lib-dovecot/.libs/libdovecot.so -lcrypt -lpam -ldl -lrt -Wl,-rpath - Wl,/usr/lib64/dovecot libtool: link: gcc -std=gnu99 -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 - fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic - Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -o .libs/checkpassword-reply checkpassword-reply.o ../../src/lib- dovecot/.libs/libdovecot.so -ldl -lrt -Wl,-rpath -Wl,/usr/lib64/dovecot ../../src/lib-sql/.libs/libsql.a(sql-api.o): In function `sql_init': /home/mhlavink/cvsf/dovecot/devel/dovecot-2.0.beta4/src/lib-sql/sql-api.c:70: undefined reference to `driver_sqlpool_init' Regards, Michal Hlavinka

1 1

[Dovecot] Access filesystem (NFS) as some user
by Mihamina Rakotomandimby 05 May '10

05 May '10

Manao ahoana, Hello, Bonjour, My Dovecot server has to access the users Maildirs. Maildirs are on a NFS mount that only a user (vmail/500) may read and write. No one else. How to configure Dovecot so that at least disk read-write are performed as a "vmail" user (that I have created with the right attributes)? Is the workaround of changing dovecot's system UID/GID a not-so-bad one? (I am trying to see if it works, at least...) Misaotra, Thanks, Merci. -- Architecte Informatique chez Blueline/Gulfsat: Administration Systeme, Recherche & Developpement +261 34 29 155 34 / +261 33 11 207 36

2 3

Re: [Dovecot] Dovecot deliver LDA problem
by Noel Butler 05 May '10

05 May '10

bugger sent that direct, please send that output to the list :) On Wed, 2010-05-05 at 09:04 +1000, Noel Butler wrote: > Alex, > > Please show the output of dovecot -n > > > On Tue, 2010-05-04 at 15:23 -0700, Alex wrote: > > > Thanks for the hint. > > > > I enabled 'socket listen' it in dovecot.conf as you pointed it out. > > > > Now dovecot.err log has these error messages: > > > > May 04 14:57:19 deliver(user1(a)some_domain.com): Error: User > > user1(a)some_domain.com is missing UID (set mail_uid) > > May 04 14:57:19 deliver(user2(a)some_domain.com): Error: User > > user2(a)some_domain.com is missing UID (set mail_uid) > > May 04 14:57:25 deliver(user3(a)some_domain.com): Error: User > > user3(a)some_domain.com is missing UID (set mail_uid) > > > > > > I tried to set necessary mail_uid in dovecot-sql.conf in user_query: > > > > user_query = SELECT maildir as mail, 51 as userdb_uid, 51 as > > userdb_gid, > > 51 as mail_uid FROM dovecot_email_maps WHERE email = '%u' > > > >

2 2

[Dovecot] Dovecot deliver LDA problem
by Alex 05 May '10

05 May '10

Hello folks, I was trying to set up Dovecot deliver LDA instead of Postfix default virtual LDA In Postfix main.cf I specified: virtual_transport = dovecot dovecot_destination_recipient_limit = 1 In Postfix master.cf I entered: dovecot unix - n n - - pipe user=mailer flags=DRhu argv=/usr/local/mail/libexec/dovecot/deliver -f ${sender} -d ${recipient} In Dovecot dovecot.conf I have the following entries: passdb sql { args = /etc/dovecot/dovecot-sql.conf } userdb prefetch { } userdb sql { args = /etc/dovecot/dovecot-sql.conf } In Dovecot dovecot-sql.conf I have this: user_query = SELECT maildir as mail FROM dovecot_email_maps WHERE email = '%u' password_query = SELECT user, password, userdb_uid, userdb_gid, userdb_home, userdb_mail FROM dovecot_user_maps WHERE user = '%n' After reloading postfix and restarting dovecot I'm getting this type of warnings in dovecot.err log: May 04 10:43:10 deliver(some_address(a)some_domain.com): Error: userdb lookup: connect(/var/run/dovecot//auth-master) failed: No such file or directory Could somebody please help me to resolve this mistery. What am I missing ether in configuration file or somewhere else? Many thanks in advance, Alex

2 2

[Dovecot] CDB Authentication database
by Luca Corti 04 May '10

04 May '10

Hello, I'd be interested in seeing a CDB based backend for the userdb/passdb lookups. Is anyone working on this? Is there any documentation (other than the wiki Design section and the code itself) on implementing database backends? thanks Luca

5 5

[Dovecot] Dovecot antispam plugin with virtual users
by Philipp 04 May '10

04 May '10

Hi, I'm running dovecot 1.2.11 with the antispam plugin 1.2+20090702-1+b1 installed from the debian repos (squeeze) and dspam 3.9.0+git20100416-1. Unfortunately this doesn't seem to work well with my virtual users, stored on a local openldap server: While sending mail manually to dspam does work, there's some trouble when trying to use the antispam plugin. I tried using both sendmail (exim4 in my case) and configuring antispam_mail_sendmail = /usr/bin/dspam to point to dspam, with similar results: exim: [15042] Failed to get user name for uid 5001 dspam: dspam[18961]: Unable to determine the runtime user both errors are reproducible by running exim/dspam with sudo -u \#5001 with 5001 being the virtual uid used of the user that is logged in through imap. Of course the uid 5001 is invalid for the rest of the system, so it can't run anything, but as far as I can tell the plugin uses this uid to call the respective programs :\ Now I was wondering if it was possible to keep the plugin from using the imap-uid and instead specifying one elsewhere? I guess this would be of fairly great interest for everyone using virtual users, be it ldap or anything else. Or is there a different way to do this? Do I maybe just miss setting a variable somewhere? Philipp

2 1

[Dovecot] dovecot user
by Timo Sirainen 04 May '10

04 May '10

Any thoughts on this: The primary use for "dovecot" user has been for login processes. But people keep misunderstanding this and try to use dovecot for accessing mails. For years I've been wondering about renaming this user to something else like dovelogin, but it never really seemed practical. So now with v2.0 there are a bunch of new processes, and for example anvil and dict are now run as dovecot user by default. But it's not really good that login processes can just go and kill those processes. And even worse, if drop_priv_before_exec=yes they could ptrace these processes. So I think we need two Dovecot users for v2.0: 1. Completely untrusted user for login processes. 2. Slightly more trusted internal Dovecot user. So "dovecot" could be reused for 2. And it would no longer be a mortal sin to use dovecot user for owning mail files. For 1. there would be a new user. I'd use "dovelogin", but apparently tools still don't much like usernames that are longer than 8 characters. Like ps could show numeric uid instead of 9 character long username. So .. any suggestions? "dovlogin" could be one possibility I guess. It would be nice if the name somehow reminded of login processes, but maybe something else could be used too, like: dovenil, dovenull, dovezero, dovenone, dovevoid, doveint, dovedown, dovein, dove0

17 33

[Dovecot] Dovecot SQL user_query
by Alex 04 May '10

04 May '10

Hello folkz, Is it possible to setup in dovecot-sql.conf file to run user_query twice if its first run didn't yield any values. And likewise don't proceed with the second run if the first user_query execution produced the result. I have to query two tables which specify there email messages shall be delivered via Dovecot deliver LDA depending on the incoming email addresses. Please don't question me about this setup. I inherited this mess from the previous Network Admin. First query should be ran like this: user_query = SELECT concat('maildir:/data/mail/',maildir) as mail FROM folders WHERE email = '%u' If the first query doesn't yield any result the second shall be ran like this: user_query = SELECT maildir as home FROM users WHERE email = '%u' Please advise if such user_query setup is possible at all. Thanks in advance, Alex

5 4

[Dovecot] exit codes for 'sievec'
by Jerry 04 May '10

04 May '10

As far as I can tell, 'sievec' always exits with '0' whether there is an error or not. If that is correct, I believe it should be modified to exit with some other code if the conversion and writing of the new file are not completed successfully. I have written a few script files and a 'make' file specifically for sievec. The inability to get an accurate exit code is problematic for me. -- Jerry Dovecot.user(a)seibercom.net Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ Fortune's Fictitious Country Song Title of the Week: "How Can I Miss You if You Won't Go Away?"

2 2

[Dovecot] zlib Plugin Dovecot 2.0 - ostream
by Alex Baule 03 May '10

03 May '10

Hello Everyone... In zlib save mail have it: struct ostream *output; There is a way to get the file descriptor from output used in ostream zlib plugin ? to get in istream is i_stream_get_fd, but don't have o_stream_get_fd......

2 6

[Dovecot] Dovecot Vs Procmail LDA
by Wilberth Pérez 03 May '10

03 May '10

Hi everyone: Anyone knows what are the differences (or advantages and disadvantages) between Dovecot LDA with postfix Vs. Procmail LDA with postfix ? -- -------------------------------------------------------- LCC Wilberth de Jesús Pérez Segura CCSA- Administración de Servicios y Seguridad de las TI Correo: wilberth.perez(a)uady.mx Universidad Autónoma de Yucatán Secretaría General Coordinación Administrativa de Tecnologías de Información RIUADY C-59 x Av. Itzáes (999)923-74-28 Ext. 1117 Mérida, Yucatán, México 2010 --------------------------------------------------------

1 0

[Dovecot] [SUGGESTION] Managesieve: Transparent home dir creation
by Felix Leimbach 03 May '10

03 May '10

Hi all, I'm using dovecot 2.0-beta4's sieve plugin and it works great but here is an idea for improvement: When creating the first sieve script for an account whose home dir does not yet exist then dovecot *does* create that homedir but the sieve client times out. Tried Thunderbird's sieve addon as well as horde's ingo. The log says: dovecot: managesieve-login: Login: user=<me(a)example.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured dovecot: managesieve(me(a)example.com): sieve-storage: sieve_storage_verify_dir(/mnt/data/vmail/dovecot-homedirs/example.com/me//s… failed: File exists dovecot: managesieve(me(a)example.com): Fatal: Failed to open Sieve storage. Because the homedir was created (great!) when I retry the same action then all works perfectly well. So why not make that homedir creation transparent so that the clients' first try succeeds instead of the second try? Cheers, Felix

3 3

[Dovecot] Migrating domain with diferent default_pass_scheme
by emiliojoel 03 May '10

03 May '10

Hi I have now my main mail server using dovecot with diferents domains and for user auth using mysql with default_pass_scheme = PLAIN, Now I am migrating a new domain from other server with dovecot using mysql with default_pass_scheme = MD5. My question is: Is possible have a different default_pass_scheme depending of the domain? could I use dovecot with domains using mysql auth with default_pass_scheme = PLAIN and other with default_pass_scheme = MD5? any sugestion? thanks Emilio -- View this message in context: http://old.nabble.com/Migrating-domain-with-diferent-default_pass_scheme-tp… Sent from the Dovecot mailing list archive at Nabble.com.

2 1

[Dovecot] dovecot server down, dovecot deliver keeps mail?
by mimosinnet＠gmail.com 03 May '10

03 May '10

My dovecot server was down las friday, and it seems that mails have been lost. This is what I have got in my logs since the server has been down: May 3 03:35:34 generatech dovecot: deliver(mail(a)domain.org): userdb lookup: connect(/var/run/dovecot/auth-master) failed: No such file or directory I guess that because the server was down dovecot transport could not deliver the mail. Nevertheless, I am wondering if dovecot deliver agent keeps undelivered mail somewhere. Thanks! I have been using this howto for the configuration: http://en.gentoo-wiki.com/wiki/Mail_server_using_Postfix_and_Dovecot This is dovecot 1.2.6, and my configuration: # dovecot -n # 1.2.6: /etc/dovecot/dovecot.conf # OS: Linux 2.6.28-hardened-r9 x86_64 Gentoo Base System release 2.0.1 rootfs listen: *:143 ssl_listen: *:52003 ssl_cert_file: /etc/ssl/dovecot/dovecot.pem ssl_key_file: /etc/ssl/dovecot/dovecot.key login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login first_valid_uid: 8 last_valid_uid: 8 first_valid_gid: 12 last_valid_gid: 12 mail_uid: 8 mail_gid: 12 mail_location: maildir:/var/mail/%d/%n/Maildir/:INDEX=/var/mail/%d/%n/indexes mail_plugins: quota imap_quota lda: postmaster_address: postmaster(a)generatech.org mail_plugins: quota sieve auth default: mechanisms: plain login user: nobody passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: mail group: mail plugin: sieve: /var/mail/%d/%n/.dovecot.sieve sieve_dir: ~/var/mail/%d/%n/sieve -- Ningún Lugar Activisme Cultural per a la Transformació Social Cultural Activism for Social Transformation ningun_lugar(a)riereta.net http://ningunlugar.org/ http://generatech.ningunlugar.org/ http://video.ningunlugar.org

2 1

[Dovecot] courier-imap and dovecot in migration process
by No body ist Perfect 02 May '10

02 May '10

Hello! I plan a migration from courier-imap to dovecot. at now run courier-imap as imaps server only and with perdition as redirector. can i run courier-imap and dovecot at same time on the same server(listing on diferent ports of course), i mean with shared home directory tree (Mailbox dir) ? Maybe access conflict or some problems ? Thanks a lot

1 0

[Dovecot] What causes dovecot to rebuild dovecot-uidlist?
by Pat 02 May '10

02 May '10

Hello, In what situations will Dovecot 1.2.11 rebuild its uidlist? I am using the maildir storage format, and I am also modifying the uidlist manually (so it's possible I could jack* things up). I have found some related code in maildir-uidlist.c: maildir_uidlist_next. 1) Blank filename or UID 0 2) Any UID not being greater than the proceeding UID 3) Any UID being greater than ~4 billion. 4) Any UID being greater than the suggested next uid. 6) If a filename contains a / 7) General header line sanity checking. Are there any other sections of the code that do sanity checks on dovecot-uidlist (for Maildir type storage)? And optionally do you agree that maildir_uidlist_set_corrupted is the best place to watch to see if I have mangled the uidlist? Thanks in advance, Pat * I insert into dovecot-uidlist manually when I deliver new messages, or discover a message that is not in uidlist for some reason. For compatability reasons I maintain a completely separate cache. If there is a better way to keep the uidlist up to date when the user isn't necessarily accessing the account via dovecot imap, I'm open to suggestions. However my situation is fairly unique I think.

2 2

[Dovecot] My dovecot does not store Thunderbird flags
by Julien Buratto 01 May '10

01 May '10

Hi all, my Dovecot 1.1.20 does not store flags (I mean, Thunderbird Labels like ToDo, Important and so on..) When logging in via telnet, I get: . examine INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk $MDNSent Junk $Forwarded NotJunk receipt-handled $Label7 $label1 $label2 $label3 $label4 $label5 expired_2w expired_2m delete rimandata forwarded) * OK [PERMANENTFLAGS ()] Read-only mailbox. As per Thunderbird mozillazine page about tags (http://kb.mozillazine.org/Tags#IMAP) that's what the issue is. PERMANENTFLAGS should allow /* while in my server it's empty. Could someone point me how can I change this behaviour or some hints ? Thank you -- Julien Buratto PS: In case someone asks for it > dovecot -n # 1.1.20: /usr/local/etc/dovecot.conf # OS: Linux 2.6.9-67.0.4.EL i686 CentOS release 4.7 (Final) log_path: /var/log/maillog info_log_path: /var/log/maillog protocols: imaps imap pop3 pop3s disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_location: mbox:~/mail/:INBOX=mbox mbox_lazy_writes: no mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes lda: postmaster_address: postmaster(a)example.com auth default: cache_size: 1024 verbose: yes passdb: driver: pam args: session=yes cache_key=%u%s dovecot userdb: driver: passwd plugin: acl: vfile:/etc/dovecot-acls

1 2

[Dovecot] UK Blackberry BIS and Dovecot - 2-way sync
by Lucio Godoy 01 May '10

01 May '10

Hi All; I have search the net and i cannot find any answers or fixes for this issue. I have a RHEL5 server running Dovecot Version 1.2.11 all worked well until i have diceded to subscribe to Vodafone's BIS service (BB Bold 9700). Internally I use outlook, and it does 2-way sync without any issues, but the blackberry only syncs new email and it does not sync deleted emails when I delete them in Outlook. Is there any special setting to allow such synchronisation? My server is secured by a pix firewall with ports 993, and 995 open for email sync (Secure IMAP and Secure Pop), i have setup the blackberry to use port 993. Many thanks for your help. Lucio =========================================================== The Home CCTV Security System made easy! http://www.kaduco.com/our-list-products-services/cctv-security-camera-syste… _________________________________________________________________ http://clk.atdmt.com/UKM/go/197222280/direct/01/ We want to hear all your funny, exciting and crazy Hotmail stories. Tell us now

1 0

[Dovecot] zlib Plugin Dovecot 2.0 - ostream
by Alex Baule 30 Apr '10

30 Apr '10

Hello Everyone. There is possible to rename the email saved by a plugin, like zlib ? i explain.... i need to add 1 line in email header, because of that, i want to rewrite the filename to update the S and W flag. Tks !

1 0

[Dovecot] 1.0.15 --> 1.2.11 --> got too little data
by Andre Hübner 30 Apr '10

30 Apr '10

Hello, did updates from 1.0.15 to 1.2.11 and is in most cases succesful. Sometimes dovecot leaves errormessage in Log: IMAP(username): FETCH [HEADER] for mailbox INBOX UID 5106 got too little data (copying): 516 vs 528 Until now only Inbox was effected and no other folders. I delete cachesfiles in ~mail/.imap to solve this but is there a way to do this automatical (self healing)? Dovecot could recreate complete caches if there was a difference in calculation. Thanks, Andre

2 6

[Dovecot] convert old configuration file with doveconf : Unknown setting
by de Lafond Guillaume 30 Apr '10

30 Apr '10

Hi, It happens when I try to convert this config (with the dovecot 2.0 beta4 release) : test-mail:/tmp# dovecot -n -c ./dovecot.old.conf # 1.2.11: ./dovecot.old.conf # OS: Linux 2.6.26-2-686-bigmem i686 Debian 5.0.4 log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot_info.log protocols: imap listen: 127.0.0.1:30143 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_user: aquaray login_greeting: Mail - test v2 login_process_per_connection: no login_process_size: 96 login_processes_count: 20 login_max_processes_count: 196 max_mail_processes: 10024 mail_max_userip_connections: 10000 verbose_proctitle: yes first_valid_uid: 89 mail_location: maildir:~/:INDEX=/var/mail/dovecot_indexes/%1d/%d/%n fsync_disable: yes maildir_very_dirty_syncs: yes mbox_write_locks: fcntl dotlock mail_drop_priv_before_exec: yes mail_plugins: quota imap_quota imap_client_workarounds: outlook-idle delay-newmail namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: INBOX/ hidden: yes list: no subscriptions: yes lda: postmaster_address: postmaster(a)test-dovecotv2.aquaray.com hostname: test-dovecotv2.aquaray.com log_path: /var/log/dovecot-deliver.log info_log_path: /var/log/dovecot-deliver.log auth_socket_path: /var/run/dovecot-socket-auth/auth-master auth default-auth-master: mechanisms: plain login apop cram-md5 master_user_separator: * passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen master: path: /var/run/dovecot-socket-auth/auth-master mode: 384 user: aquaray auth default: mechanisms: plain login apop cram-md5 cache_size: 2048 cache_ttl: 2000 master_user_separator: * count: 10 passdb: driver: sql args: /etc/dovecot/dovecot-sql-master.conf pass: yes master: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf plugin: quota: maildir:User quota test-mail:/tmp# /usr/local/dovecot2/bin/doveconf -n -c ./ dovecot.old.conf # 2.0.beta4 (6891d20929ca): ./dovecot.old.conf doveconf: Warning: Obsolete setting in ./dovecot.old.conf:26: login_dir has been removed doveconf: Warning: Obsolete setting in ./dovecot.old.conf:29: login_chroot has been replaced by service { chroot } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 29: Unknown setting: chroot doveconf: Warning: Obsolete setting in ./dovecot.old.conf:32: login_user has been replaced by service { user } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 32: Unknown setting: user doveconf: Warning: Obsolete setting in ./dovecot.old.conf:36: login_process_size has been replaced by service { vsz_limit } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 36: Unknown setting: vsz_limit doveconf: Warning: Obsolete setting in ./dovecot.old.conf:39: login_process_per_connection has been replaced by service { service_count } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 39: Unknown setting: service_count doveconf: Warning: Obsolete setting in ./dovecot.old.conf:42: login_processes_count has been replaced by service { process_min_avail } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 42: Unknown setting: process_min_avail doveconf: Warning: Obsolete setting in ./dovecot.old.conf:45: login_max_processes_count has been replaced by service { process_limit } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 45: Unknown setting: process_limit doveconf: Warning: Obsolete setting in ./dovecot.old.conf:48: login_max_connections has been replaced by service { client_limit } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 48: Unknown setting: client_limit doveconf: Warning: Obsolete setting in ./dovecot.old.conf:75: mail_drop_priv_before_exec has been replaced by service { drop_priv_before_exec } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 75: Unknown setting: drop_priv_before_exec doveconf: Warning: Obsolete setting in ./dovecot.old.conf:88: max_mail_processes has been replaced by service { process_limit } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 88: Unknown setting: process_limit doveconf: Warning: Obsolete setting in ./dovecot.old.conf:91: mail_process_size has been replaced by service { vsz_limit } doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 91: Unknown setting: vsz_limit It does not understand the old 1.1 setting "ssl_disable". test-mail:/tmp# /usr/local/dovecot2/bin/doveconf -n -c ./ dovecot.old.conf # 2.0.beta4 (6891d20929ca): ./dovecot.old.conf doveconf: Fatal: Error in configuration file ./dovecot.old.conf line 21: Unknown setting: ssl_disable ----------------------------------------------------------- After removing all fatal error (comment all settings that are not understood), it works. If needed, I could test against the another other version (latest hg ?). Regards, -- Guillaume de Lafond Aqua Ray SARL

2 3

[Dovecot] Quota maildirsize and dbox
by luben karavelov 30 Apr '10

30 Apr '10

Hello, Is there any reason that maildirsize Quota store should not work in dbox folders or any other folder based mailbox stores? I have patched a test version here and it seems to work (added "dbox" check in src/plugins/quota/quota-maildir.c line 785). If there could be any complications or unexpected consequences of this setup? Thanks in advance luben

3 2

[Dovecot] Expire plugin / expire-tool redesign for doveadm
by Timo Sirainen 30 Apr '10

30 Apr '10

Expire plugin / expire-tool seems annoyingly inflexible currently, so I was thinking about a more generic redesign: The expire plugin keeps track of the oldest message in configured mailboxes. Its only configuration is the list of tracked mailboxes. There's no configuration like what the expire timeouts are or anything. There will be a new doveadm command: doveadm expunge [-u user | -A] <mailbox> <search query> So when you want to expunge all mails from Trash older than 1 week for all users, you say: doveadm expunge -A Trash savedbefore 1w This command works even without expire plugin. To optimize it to avoid looking into all users' Trash mailbox, there's a new expire doveadm plugin, which can use the expire dict to filter out users who don't have anything to expunge. This also supports another feature that the plugin can optimize: doveadm move -A INBOX Archive/2009/INBOX since 2009-01-01 before 2010-01-01 And since people have had problems waiting for expire dict to fill, there could be also a new parameter that does the filling immediately. TODO: - dbox altmove feature will be removed from expire plugin. it may need another plugin, or some other way to configure expire plugin for it. it's anyway a special case. - When using multiple mailboxes it would be more optimal to handle all mailboxes for a user at once, rather than using separate doveadm commands. Maybe the command syntax needs some more thinking to support this. Different mailboxes could have different rules though..

3 6

[Dovecot] Released Pigeonhole Sieve v0.1.16 for Dovecot v1.2.11
by Stephan Bosch 30 Apr '10

30 Apr '10

Hello Dovecot users, Pigeonhole development has slowed down significantly in the last few months due to the fact that I got swamped in work. The plan is now to move active development of Pigeonhole to Dovecot v2.0, meaning that this will be the last release for v1.2 that contains significant development changes and new features. However, if a certain new feature is simple enough and there is a demand for it, I may backport it from v2.0 and release it along with any bugfixes that may still arise. The main thing that this new release adds is full support for the spamtest, spamtestplus and virustest extensions. These extensions implement a uniform means of testing the content spam/virus status headers in mail messages: http://ietfreport.isoc.org/idref/rfc5235/ Not many people have tested these new features yet and therefore these are currently considered experimental. Test these thoroughly before you start using them! Documentation is available in doc/spamtest-virustest.txt Changelog Sieve v0.1.16: * Finished implementation of spamtest, spamtestplus and virustest extensions. These are not enabled by default and need to be activated with the sieve_extensions setting. Documentation available in doc/spamtest-virustest.txt + Vacation extension: the from address of the generated reply is now by default equal to whatever known recipient alias matched the headers of the message. If it is one of the aliases specified with :addresses, it is used in stead of the envelope recipient address that was used before. + Restructured and optimized the lexical scanner. + Added --with-docs configure option to allow disabling installation of documentation. - Accidentally omitted 'extern' in two declarations of global variables in header files, causing compile failures on certain systems. - Deprecated imapflags extension: fixed implicit assignment of flags. Turns out this never really worked, but the effect of this bug was obscured by the removeflag bug fixed in the previous release. - Fixed various memset argument mixups in enotify extension. This caused warnings on certain systems, but luckily no adverse effects at runtime. The releases are available as follows: Sieve: http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-sieve-0.1.16.tar.gz http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-sieve-0.1.16.tar.gz.sig Refer to http://pigeonhole.dovecot.org for more information. Have fun testing the new releases and don't hesitate to notify me when there are problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

3 6

[Dovecot] Again: Occasional problem with POP3-Download
by Andre Tann 30 Apr '10

30 Apr '10

Hello everyone, in february I posted the mail below[1]. I can now reproduce the problem. When filling up a mailbox with postfix' smtp-source with dozens of identical mails, then it is never possible for me to fetch one single mail out of the mailbox. The process of fetching mail via POP3 always fails. It makes no difference which mail client I use. I have tested KMail, Outlook and Thunderbird. Can anyone confirm this? Is dovecot for some reason unable to deliver such identical mails? Can it be the case that this is a problem with too similar message ids? ~/Maildir/cur$ cat * | grep -i message-id Message-Id: <1024.0003.0008@alphamobil> Message-Id: <1024.0003.0009@alphamobil> Message-Id: <1024.0003.0006@alphamobil> Message-Id: <1024.0003.0007@alphamobil> Message-Id: <1024.0003.0005@alphamobil> Message-Id: <1024.0003.0004@alphamobil> Message-Id: <1024.0003.0003@alphamobil> Message-Id: <1024.0003.0002@alphamobil> Message-Id: <1024.0003.0001@alphamobil> Message-Id: <1024.0003.0000@alphamobil> Thanks and greetings from Munich! AT [1] Hello everyone, I have two mailservers [1] running dovecot. Mail store format is maildir. Every once in a while I have the following problem: When a User downloads his mail via POP3, the client says something like "the server has closed the connection unexpectedly, and gives this reason: [...blahblah...]". One can now cancel the download, and restart it, and the problem shows up again and again. The first few mails get downloaded, and then the process stops. Strange to say the "blahblah"-portion is a piece of text out of the email that doesn't want to get downloaded. Then I remove this single message out of the Maildir/cur-directory, and everything is fine again. It is easy to figure out which mail to delete because it's the first one that is not market as seen [...] filename...:2,S otherfilename...;2, <= this file must be deleted [...] For me it looks as if dovecot had a problem with some byte sequence in this mail, and for some reason it gives an error message to the client which is taken out of the mail. On the SuSE-Machine, before dovecot there was a courier-imapd running, which never showed this kind of problem, so it should not be a client problem. Hopefully my description is clear enough. Does anyone have an idea what's going on here? Thanks. Andre [1] One machine is a openSuSE 11.2 with # rpm -qa | grep dovecot dovecot12-backend-sqlite-1.2.9-0.1.1.i586 dovecot12-backend-mysql-1.2.9-0.1.1.i586 dovecot12-backend-pgsql-1.2.9-0.1.1.i586 dovecot12-1.2.9-0.1.1.i586 The other machine is a Debian Lenny with # dpkg -l | grep dovecot dovecot-common 1:1.0.15-2.3+lenny1 dovecot-imapd 1:1.0.15-2.3+lenny1 dovecot-pop3d 1:1.0.15-2.3+lenny1 -- Andre Tann

3 3

[Dovecot] Right way to Dovecot Load Balance
by Proskurin Kirill 30 Apr '10

30 Apr '10

Hello. I building LB&HA Email cluster based on Exim+Dovecot+LDAP. Now I thinking what the most right way to LB Dovecot(2 nodes with shared storage). HA-Proxy? Dovecot Proxy? Nginx? Else? -- Best regards, Proskurin Kirill

2 1

[Dovecot] Question about auth multiple configuration
by Fabrice MATHIEU 30 Apr '10

30 Apr '10

Hello, My mail system is build with postfix, dovecot and roundcube. In first time users can view and "manage" their mail only on the webmail. So this one (webmail) use IMAP (no tls/ssl at all) authentication to give access to users maildir. This connection is made on the 'loopback' interface and use PLAIN method. This works fine (configuration below without ssl parameters). Now I want to see and send my mail with a MUA (thunderbird). As my system is on an Internet provider I want to add more security "solutions". I use smtps with postfix and SASL/auth by dovecot socket mechanism to send mail. I use imaps with dovecot for managing my maildir. I have added ssl parameters to the configuration file (see below) and I required certificate from the client (to avoid man in the middle attack and to get access only for client with user certificate). To get this "ssl_require_client_cert" is set to yes. Ok, now imaps works perfectly. But since a certificate is required webmail authentication (localhost) and SASL (postfix auth trough dovecot socket mechanism) don't work. Webmail => dovecot: imap-login: Disconnected (cert required, client didn't start TLS): method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Postfix => postfix/smtpd[71640]: warning: TOTO[X.A.B.C]: SASL PLAIN authentication failed: Client didn't present valid SSL certificate That's normal. But 127.0.0.1 client(network) is considered by dovecot as secure, so won't the auth possible without certificate ? Can't we make two auth policy to make secure (client crt require) for public IP/client and less "secure" (without crt client) for local process (postfix) and local newtwork(127.0.0.1) for roundcube ? I see section "auth default { ... }" and is used by ... default ! But can we make an other one to make this two particular authentication on the same "instance" ? Thank you. And then my configuration : operating system => FreeBSD 7.1 dovecot --version => 1.2.8 dovecot -n => # 1.2.8: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.1-RELEASE i386 ufs protocols: imap listen: 127.0.0.1 ssl_listen: X.Y.Z.T ssl: yes ssl_ca_file: /usr/local/etc/dovecot/CAclient.pem ssl_cert_file: /usr/local/etc/dovecot/imaps.pem ssl_key_file: /usr/local/etc/dovecot/imaps.key ssl_verify_client_cert: yes login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_privileged_group: mail mail_location: maildir:/jails/mails/%d/%n imap_client_workarounds: delay-newmail netscape-eoh tb-extra-mailbox-sep lda: postmaster_address: postmaster@SOMETHING hostname: SOMETHING_ELSE sendmail_path: /usr/sbin/sendmail auth default: mechanisms: plain login username_format: %Lu passdb: driver: passwd-file args: username_format=%n /jails/mails/dov_pass/%d/usr_pas userdb: driver: passwd-file args: username_format=%n /jails/mails/dov_pass/%d/usr_pas ssl_require_client_cert = yes ssl_username_from_cert = no socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: wheel master: path: /var/run/dovecot/auth-master mode: 384 Best regards, _________________________________________________________________ Consultez gratuitement vos emails Orange, Gmail, Free, ... directement dans HOTMAIL ! http://www.windowslive.fr/hotmail/agregation/

3 8

[Dovecot] Question about dovecot imap proxy
by Monika Janek 29 Apr '10

29 Apr '10

Hi everyone! I have dovecot (1.2.11) on one our external mail servers acting as a proxy. The client (ifor now, my iphone) connects fine via ssl to the external mailserver but I can't seem to get a secure connection now to the internal destination imap server (between external mail server and internal imap server, it's going through port 143). Running tcpdump, I can clearly see my password being transmitted on our internal network. I read the addition to the documentation about dovecot proxy but I'm not sure where to add these variables: In v1.2.rc4+ the connections to destination server can be TLS/SSL encrypted by returning: * ssl=yes: Use SSL and require a valid verified remote certificate. *WARNING: Unless used carefully, this is an insecure setting!* Currently host must be an IP address, so this setting accepts any certificate signed by a trusted CA. The host name isn't checked in any way against the certificate's CN. The only way to use this securely is to only use and allow your own private CA's certs, anything else is exploitable by a man-in-the-middle attack. * ssl=any-cert: Use SSL, but don't require a valid remote certificate. * starttls: Use STARTTLS command instead of doing SSL handshake immediately after connected. Can anyone point me in the right direction? Thanks so much! :) -- Monika Janek Systems Administrator, Side Effects Software Toronto, Ontario Canada 416-504-9876 x207 www.sidefx.com

2 8

[Dovecot] Assertion failed in mail-search-build.c
by Mark Moseley 29 Apr '10

29 Apr '10

With Friday's and today's mercurial repo, I'm getting this: Apr 26 12:55:31 master: Info: Dovecot v2.0.beta4 starting up (core dumps disabled) Apr 26 12:58:34 imap-login: Info: Login: user=<mail@box>, method=PLAIN, rip=10.1.1.206, lip=192.168.152.1 Apr 26 12:58:34 imap(mail@box): Panic: file mail-search-build.c: line 59 (mail_search_build_key_int): assertion failed: (sarg->value.subargs != NULL) Apr 26 12:58:34 imap(mail@box): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0xb76a3ad1] -> /usr/lib/dovecot/libdovecot.so.0 [0xb76a3b4f] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0xb76a3e08] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0xb76f859e] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0xb76f860f] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_search_build+0x82) [0xb76f86f2] -> dovecot/imap [mail@box 10.1.1.206 SEARCH](imap_search_args_build+0x48) [0x805d8a8] -> dovecot/imap [mail@box 10.1.1.206 SEARCH](cmd_search+0xbb) [0x805342b] -> dovecot/imap [mail@box 10.1.1.206 SEARCH] [0x80564dc] -> dovecot/imap [mail@box 10.1.1.206 SEARCH] [0x8056579] -> dovecot/imap [mail@box 10.1.1.206 SEARCH](client_handle_input+0x2d) [0x80566ed] -> dovecot/imap [mail@box 10.1.1.206 SEARCH](client_input+0x5f) [0x805710f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xf5) [0xb76b0115] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x30) [0xb76af160] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x2a) [0xb769ca5a] -> dovecot/imap [mail@box 10.1.1.206 SEARCH](main+0x2b5) [0x805fb95] -> /lib/libc.so.6(__libc_start_main+0xe5) [0xb752e455] -> dovecot/imap [mail@box 10.1.1.206 SEARCH] [0x804e951] Apr 26 12:58:34 master: Error: service(imap): child 13220 killed with signal 6 (core dumps disabled) Login is working fine, just blowing up on that assert by doing a search. The search is pretty basic, in python: server.search( None, "(ALL)" ) Testing with a previous version (from a couple of days earlier -- I don't have the intervening), I don't hit that assertion. The last changeset on mail-search-build.c in the working copy is 11146:3649ad8c9f9a. Let me know if there's anything you'd like me to try.

2 1

[Dovecot] pop3-login: auth failure -- due to number as first character in login name
by dovecot mail list account 29 Apr '10

29 Apr '10

Seem to have found a error in version 1.2.6 regarding usernames having a number as the first character. Customers with a number as the first character in thier user name can not login via pop3 clients. However they can login through our webmail interface. If we remove the number from the username then the customer can login. # 1.2.6: /etc/dovecot.conf # OS: Linux 2.6.31.12-desktop-3mnb x86_64 Mandriva Linux 2010.0 protocols: pop3 ssl_listen: * ssl_cert_file: /etc/pki/tls/certs/dovecot.pem ssl_key_file: /etc/pki/tls/private/dovecot.pem disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib64/dovecot/pop3-login mail_privileged_group: mail mail_location: mbox:~/mail:INBOX=/home/mail/%u mail_executable: /usr/lib64/dovecot/pop3 mail_plugin_dir: /usr/lib64/dovecot/modules/pop3 pop3_uidl_format: %08Xv%08Xu lda: postmaster_address: postmaster(a)example.com auth default: mechanisms: plain login verbose: yes passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix plugin: quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 quota_warning2: storage=80%% /usr/local/bin/quota-warning.sh 80

2 1

[Dovecot] Problems with Mailbox is in inconsistent state, please relogin.
by Daniel Machado Grilo 29 Apr '10

29 Apr '10

Dear Dovecot users, I'm a sysadmin in a company that recently migrated the IMAP from courier-imap to dovecot :-) *urray* Everything with the perl migrating scripts (version 1.0) went with OKs and it was a lot of fun (and pray) to move 400Gb of mails and migrate.. and everything is working even better :-) The problem is for some outside users that use webmails, like: - Squirrel - Roundcube - Horde They claim that the connection is constantly dropping.. You might say now: "Webmail's fault!!!" as I said in the beginning :) But the IMAP logs shows SEVERAL times (almost every 10mins ?!): Apr 28 21:10:48 olive dovecot: IMAP(rcoelho): Maildir /cluster/mail/mailboxes/rcoelho sync: UID inserted in the middle of mailbox (192736 > 192720, file = msg.LDW0C) Apr 28 21:10:48 olive dovecot: IMAP(rcoelho): Disconnected: Mailbox is in inconsistent state, please relogin. Apr 28 19:14:11 olive dovecot: IMAP(pcorreia): Maildir /cluster/mail/mailboxes/pcorreia sync: UID < next_uid (7874 < 7875, file = msg.5BNVC) Apr 28 19:14:12 olive dovecot: IMAP(pcorreia): Disconnected: Mailbox is in inconsistent state, please relogin. and so on. I read somewhere on the web that configuring the mbox_lazy_write=no should work .. it did not :-) I have CentOS 5.4 in our mailserver, so the version of dovecot is not the latest (it is 1.0.7).. But of course, this is production environment and I don't want to update if its not needed :-) So my questions are: - Is this a known bug for this version and I have to upgrade ? - Is this a problem in my configs for dovecot ? - Can this be other problem than dovecot ? -- so probably i should be able to add more debug anoying messages to our logs ? - Probably something went wrong in the migration for these maildirs? So now what can we do to fix this ? Our mail is working and, at the moment, I found 3 users with this error.. They have about 10Gb of mail each, I don't think this is a problem for dovecot.. only for our storages.. :-) Tks for your patience, Best Regards!

4 3

[Dovecot] Maildircrypt
by brainstorm 29 Apr '10

29 Apr '10

Hi guys, I was just wondering if this idea makes sense overall or if there are major impediments (indexing performance ?): http://blogs.nopcode.org/brainstorm/2010/04/28/maildircrypt/ Thanks ! Roman

2 1

[Dovecot] Dovecot headers at start of text returned to KMail
by Barry Scott 29 Apr '10

29 Apr '10

The attachment show Kmail (kdepim-4.4.2-1.fc12.x86_64) accessing an email from dovecot over imap. From the wireshark-imap-trace.txt you can see at line 77 that the headers do not end cleanly "X-)". And at line 84 there is text from the headers that is not part of the body "-Spambayes-Trained: ham". The email being access by dovecot is in: 1272011889.M384349P30156.f12barry.office.onelan.co.uk,S=6494,W=6606:2,S Because of this bug kmail fails to show the message cleanly on screen. # 1.2.11: /etc/dovecot.conf # OS: Linux 2.6.32.11-99.fc12.x86_64 x86_64 Fedora release 12 (Constantine) login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd Barry

2 4

[Dovecot] How can I add change_password
by Yavuz Maşlak 29 Apr '10

29 Apr '10

Hello I use dovecot, postfix, mysql and squirrelmail as a mail server. it works well. Meanwhile I am novice at postfix. As you know, there is a change_password plugin on squirrelmail. I wish to add change_password plugin on squirrelmail. I couldn't find how to integrate postfix and change_password. How can I add it ?

2 1

[Dovecot] How can I integrate change_password plugin, dovecot and postfix
by Yavuz Maşlak 29 Apr '10

29 Apr '10

Hello I use dovecot, postfix, mysql and squirrelmail as a mail server. it works well. Meanwhile I am novice at postfix. As you know, there is a change_password plugin on squirrelmail. I wish to add change_password plugin on squirrelmail. I couldn't find how to integrate postfix and change_password. How can I add it ?

3 3

Re: [Dovecot] returned error 83 (Out of memory)
by J Contad 28 Apr '10

28 Apr '10

FYI, sorted out this issue by taking out a specific email manually. Not sure if it helps, but the email had these attributes: - X-Mailer is PHPMailer [version 1.73] - References: header is quite large, and contains email addresses external to the sender and I's conversation. Removing the email fixed the issue. -- John

3 3

Re: [Dovecot] returned error 83 (Out of memory)
by J Contad 28 Apr '10

28 Apr '10

I tried deleting the file, but got pretty much the same issues. Any other hints on how else to go about it? Cheers! John On Thu, 22 Apr 2010, J Contad wrote: > The folder (which is shared) has about 8 thousand emails in it. I'm not sure > if it's pertinent, but the dovecot.index.cache file is about 8MB. Did you tried to delete the dovecot.index.cache file, maybe it has been corrupted? Regards, - -- Steffen Kaiser -- John

1 0

[Dovecot] somebody using Net::Sieve (Perl) with dovecot 1.2.11?
by Heiko Schlittermann 28 Apr '10

28 Apr '10

Hello, I've just (hopefully) fixed some issue with Net::Sieve (0.05) to cooperate with a current (1.2.11) dovecot managesieve server and STARTTLS. Does somebody use this Perl library? If yes, did it work for you (STARTTLS triggers the problem)? If not, which other (Perl) library do you use? Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann HS12-RIPE ----------------------------------------- gnupg encrypted messages are welcome - key ID: 48D0359B --------------- gnupg fingerprint: 3061 CFBF 2D88 F034 E8D2 7E92 EE4E AC98 48D0 359B -

2 1

[Dovecot] zlib plugin dovecot 2.0 - write email
by Alex Baule 26 Apr '10

26 Apr '10

Hello Everyone. There is possible to rename the email writed by a plugin, like zlib ? i explain.... i need to add 1 line in email header, because of that, i want to rewrite the filename to update the S and W flag. Tks !

1 0

[Dovecot] Anyone successfully using expire plugin?
by Thomas M Goerger 23 Apr '10

23 Apr '10

Anyone out there using expire? At this point, I'm not sure that it's even running. It was touching the plugin libraries yesterday, but doesn't appear to be doing so today. The plugin directory wasn't explictly set, so I've done so now, but it's still not touching these. Anyone have a cf file I could take a look at, or any ideas as to what might be happening? Thanks! ************************************************************************* * Tom Goerger - Email/Unix System Administrator * * * * University of Minnesota Email: tmg(a)umn.edu * * Operations, Infrastructure and Architecture Phone: 4-5804 * * Internet Services Office: 626J WBOB * * * *************************************************************************

2 1

[Dovecot] How can I make dovecot aware of user's email aliases?
by Ian P. Christian 23 Apr '10

23 Apr '10

Sieve will not reply to mail it doesn't think was sent directly to a user. I use an SQL auth backend, and a user might login as user1(a)domain.com. What method can I use to inform dovecot that user2(a)domain.com is a forward to user1(a)domain.com, such that the vacation auto response will fire when user2(a)domain.com is emailed (therefore, the mail ends up in user1(a)domain.com's mailbox). -- Blog: http://pookey.co.uk/blog Follow me on twitter: http://twitter.com/ipchristian

1 0

[Dovecot] best choice of user database file to work with postfix?
by Phil Howard 23 Apr '10

23 Apr '10

I'm setting up a Postfix and Dovecot combination. What I want to do is have a user database that (1) is not running from some engine (so not LDAP or SQL or such) ... and (2) is completely disassociated from system users (e.g. most email users are not in /etc/passwd and most /etc/passwd users are not email users). Ideal would be a one-file solution, which can be managed by text editing or simple command line tools. But what I want is ONE file that both Postfix (for valid recipients) and Dovecot (for user login authentication) can use together. An alternative is some way to get Postfix to go through Dovecot to query for users (at the time of mail arriving on SMTP so it doesn't queue anything that would later be rejected). This is a smallish setup on one server, with probably a max of 50 to 100 users and 50 or so role account mailboxes over the next year or two. Any recommendations?

18 50

[Dovecot] have I been added to the mailing list
by ttplayer 23 Apr '10

23 Apr '10

Hi, have I been added to the mailing list? Thank you.

1 0

[Dovecot] Quota monitoring
by Vlamsdoem 23 Apr '10

23 Apr '10

Hello, I would like to monitor users quotas in Dovecot but I don't find a way to do it for every user. Acutally I can log in with user & password to get the users quota but wat I need is a way to monitor the quota of every user with e.g an admin user which would have an acces to the quota of each mailbox. Is there a way to this? Thanks for your help.

6 11

[Dovecot] message to imap users when connecting ?
by Frank Bonnet 22 Apr '10

22 Apr '10

Hello Is it possible that a IMAP client (thunderbirs in my case) popup a message box containing a short message when a user connect to the server ? Is there such feature in Dovecot ? Thanks

3 2

[Dovecot] imap-zlib patch to fix runaway imap process
by Mike Abbott 22 Apr '10

22 Apr '10

Here is a patch to fix the problem where an imap process runs away when imap-zlib is in use. The backtrace showed: io_loop_handler_run -> stream_send_io -> client_output -> o_stream_flush -> o_stream_zlib_flush -> o_stream_zlib_send_flush When o_stream_zlib_flush returns 0, stream_send_io reinstates the IO_WRITE event, causing the infinite loop. diff -ur dovecot-2.0.beta4/src/plugins/zlib/ostream-bzlib.c dovecot-2.0.beta4+fix/src/plugins/zlib/ostream-bzlib.c --- dovecot-2.0.beta4/src/plugins/zlib/ostream-bzlib.c 2010-02-12 20:22:07.000000000 -0600 +++ dovecot-2.0.beta4+fix/src/plugins/zlib/ostream-bzlib.c 2010-04-20 19:15:29.000000000 -0500 @@ -122,15 +122,15 @@ static int o_stream_bzlib_flush(struct ostream_private *stream) { struct bzlib_ostream *zstream = (struct bzlib_ostream *)stream; + int ret; if (o_stream_bzlib_send_flush(zstream) < 0) return -1; - if (o_stream_flush(zstream->output) < 0) { + ret = o_stream_flush(zstream->output); + if (ret < 0) zstream_copy_error(zstream); - return -1; - } - return 0; + return ret; } static ssize_t diff -ur dovecot-2.0.beta4/src/plugins/zlib/ostream-zlib.c dovecot-2.0.beta4+fix/src/plugins/zlib/ostream-zlib.c --- dovecot-2.0.beta4/src/plugins/zlib/ostream-zlib.c 2010-02-18 22:01:56.000000000 -0600 +++ dovecot-2.0.beta4+fix/src/plugins/zlib/ostream-zlib.c 2010-04-20 19:15:29.000000000 -0500 @@ -184,15 +184,15 @@ static int o_stream_zlib_flush(struct ostream_private *stream) { struct zlib_ostream *zstream = (struct zlib_ostream *)stream; + int ret; if (o_stream_zlib_send_flush(zstream) < 0) return -1; - if (o_stream_flush(zstream->output) < 0) { + ret = o_stream_flush(zstream->output); + if (ret < 0) zstream_copy_error(zstream); - return -1; - } - return 0; + return ret; } static ssize_t

2 1

[Dovecot] Quota Issue
by Peter Fraser 21 Apr '10

21 Apr '10

Hi All I'm using dovecot version 1.2.4_1 and I noticed something strange. I checked the list but so far I haven't found anything that exactly fits my setup. I'm using maildirs and ldap as a backend to authenticate. A user went over quota, realized it and proceeded to delete a lot of email. Even now, after about 15 minutes, the quota indicator is still showing that he is over quota even though the users mailbox size is down by over 200MB. Why isn't Dovecot showing the change, and is there a way around this? Thanks for any help.

2 3

[Dovecot] corrupted index cache file, physcial size, in migration to snow leopard
by Norman Packard 21 Apr '10

21 Apr '10

Hi, I am in the middle of migrating a server from Apple's leopard to snow leopard. Having big problems with migrating mail to dovecot. The version is: # dovecotd --version 1.1.17apple0.5 and I use the migration script provide by Apple, /usr/libexec/dovecot/migrate_mail_data.pl The current problems concern migrating imap accounts. The old data typically shows up to mail clients as only partially migrated, with some issues there, like folders change from being listed on the server to being listed locally, but the biggest problem is that many many messages and folders have disappeared from view. But on the server, they seem to be there, in their correctly migrated place. The log files are full of messages like the ones below, which I'm guessing has something to do with the problem. The number of files with this problem is huge. Are there any scripts to rebuild the index cache files with correct physical sizes? Thanks in advance for any help! Best, Norman Apr 21 08:05:47 newhot dovecot[31163]: IMAP(*): Corrupted index cache file /Volumes/xserveHD2/var/spool/imap/dovecot/mail/A1F36563-F978-4F99- A1FF-EC5D223F18D6/dovecot.index.cache: Corrupted physical size for uid=8142: 4325 != 4214 Apr 21 08:05:50 newhot dovecot[31163]: IMAP(*): Corrupted index cache file /Volumes/xserveHD2/var/spool/imap/dovecot/mail/A1F36563-F978-4F99- A1FF-EC5D223F18D6/dovecot.index.cache: Corrupted physical size for uid=8145: 4625 != 4510 Apr 21 08:05:53 newhot dovecot[31163]: IMAP(*): Corrupted index cache file /Volumes/xserveHD2/var/spool/imap/dovecot/mail/A1F36563-F978-4F99- A1FF-EC5D223F18D6/dovecot.index.cache: Corrupted physical size for uid=8148: 4037 != 3956 Apr 21 08:06:04 newhot dovecot[31163]: IMAP(*): Corrupted index cache file /Volumes/xserveHD2/var/spool/imap/dovecot/mail/A1F36563-F978-4F99- A1FF-EC5D223F18D6/dovecot.index.cache: Corrupted physical size for uid=8158: 4673 != 4571

1 0

[Dovecot] Question about listescape plugin
by Luca Di Vizio 21 Apr '10

21 Apr '10

Hi all, with the listescape plugin enabled we a stange result. ** listescape enabled ** 2 list "" % * LIST (\HasChildren) "/" "INBOX" * LIST (\HasChildren) "/" "INBOX/" ** listescape disabled ** 2 list "" % * LIST (\HasChildren) "/" "INBOX" The prefix for this namespace is "INBOX/". Is correct to have "INBOX/" as result of LIST? Info about the system: - Centos 5.3/x86_64. - Dovecot 1.2.11 (I tried also with 2.0.beta4, same results). mail_nfs_storage: yes mail_nfs_index: yes mail_plugins(imap): listescape quota imap_quota namespace: type: private separator: / inbox: yes list: yes subscriptions: yes plugin: quota: maildir Thanks, Luca

1 0

[Dovecot] POP3: Restrict Connections per timeframe
by Michael Kliewe 21 Apr '10

21 Apr '10

Hi everybody, is it possible to limit the amount of POP3 connections/logins per 15 minutes? Many hoster do that, but I cannot find a configuration setting for that. I can only limit the amount of concurrent connections per IP, but not connections per time. Michael

1 0

[Dovecot] dovecot2 beta and gcc3(?) - compile problem
by Andre Hübner 21 Apr '10

21 Apr '10

Hello, try to compile current dovecot2 beta on older machine with gcc 3.3 Compiling results in error: libtool: link: gcc -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -o .libs/imap-login client.o client-authenticate.o imap-login-settings.o imap-proxy.o ../../src/login-common/.libs/libdovecot-login.so ../../src/lib-dovecot/.libs/libdovecot.so -lrt -Wl,-rpath -Wl,/usr/lib/dovecot ../../src/login-common/.libs/libdovecot-login.so: undefined reference to `ERR_peek_last_error' collect2: ld returned 1 exit status make[3]: *** [imap-login] Error 1 make[3]: Leaving directory `/usr/src/dovecot-1.1.rc12/dovecot-2.0.beta4/src/imap-login' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/usr/src/dovecot-1.1.rc12/dovecot-2.0.beta4/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/usr/src/dovecot-1.1.rc12/dovecot-2.0.beta4' make: *** [all] Error 2 Is there something missed on my side or problem with older gcc? dovecot 1.2.11 compiles just fine with same configure-line also there are some warnings like this: libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../../.. -I../../../../src/lib -I../../../../src/lib-settings -I../../../../src/lib-mail -I../../../../src/lib-imap -I../../../../src/lib-index -I../../../../src/lib-storage -I../../../../src/lib-storage/index -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -MT dbox-sync-rebuild.lo -MD -MP -MF .deps/dbox-sync-rebuild.Tpo -c dbox-sync-rebuild.c -fPIC -DPIC -o .libs/dbox-sync-rebuild.o In file included from dbox-sync-rebuild.c:5: ../../../../src/lib-index/mail-index-modseq.h:34: warning: parameter has incomplete type ../../../../src/lib-index/mail-index-modseq.h:52: warning: parameter has incomplete type or libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../../.. -I../../../../src/lib -I../../../../src/lib-settings -I../../../../src/lib-mail -I../../../../src/lib-imap -I../../../../src/lib-index -I../../../../src/lib-storage -I../../../../src/lib-storage/index -I../../../../src/lib-storage/index/dbox-common -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -MT mdbox-file.lo -MD -MP -MF .deps/mdbox-file.Tpo -c mdbox-file.c -fPIC -DPIC -o .libs/mdbox-file.o In file included from mdbox-storage.h:5, from mdbox-file.c:16: ../../../../src/lib-storage/mailbox-list-private.h:158: warning: parameter has incomplete type Thanks, Andre

2 3

[Dovecot] Question about listescape
by Luca Di Vizio 21 Apr '10

21 Apr '10

Hi all, with the listescape plugin enabled we a stange result. ** listescape enabled ** 2 list "" % * LIST (\HasChildren) "/" "INBOX" * LIST (\HasChildren) "/" "INBOX/" ** listescape disabled ** 2 list "" % * LIST (\HasChildren) "/" "INBOX" The prefix for this namespace is "INBOX/". Is correct to have "INBOX/" as result of LIST? Info about the system: - Centos 5.3/x86_64. - Dovecot 1.2.11 (I tried also with 2.0.beta4, same results). mail_nfs_storage: yes mail_nfs_index: yes mail_plugins(imap): listescape quota imap_quota namespace: type: private separator: / inbox: yes list: yes subscriptions: yes plugin: quota: maildir Thanks, Luca

1 0

[Dovecot] Checkpassword/prefetch/master_user and problems
by Emerson Pinter 20 Apr '10

20 Apr '10

Hi. I'm trying to use checkpassword for simple auth and masteruser auth. I have two programs, one called checkpassword-master (for masteruser lookup) and another called checkpassword for normal passdb and userdb lookup). All works fine for non-masteruser authentication (in this case dovecot makes a single call to checkpassword binary). But if a master-user authenticates, dovecot execute checkpassword-master binary, and then executes checkpassword binary. Checkpassword binary receive the MASTER_USER env and do all the checks correctly, when checkpassword finish, dovecot logs this message "auth(default): checkpassword: sighandler called for unknown child" and authentication fails... I'm trying checkpassword-reply and fd4 too, on 1.2.11 and 2.0b4, no success. Below is my config: auth default { mechanisms = plain passdb checkpassword { args = /srv/dovecot/checkpassword } passdb checkpassword { args = /srv/dovecot/checkpassword-master master=yes pass=yes } userdb prefetch { } } Anybody can help me ? Tks. -- Emerson Pinter Esta mensagem pode conter informações confidenciais, privilegiadas ou privadas. Caso não seja o destinatário, favor apagá-la e notificar o remetente. Saiba que o uso impróprio das informações existentes é estritamente proibido, sendo tratado conforme as normas da empresa e a legislação em vigor.

1 1

Re: [Dovecot] setgid failed - Not owner
by Zilon X 20 Apr '10

20 Apr '10

Changed home dir of users, in my configuration they are /var/postfix/spool and /var/postfix/dovecot/run, but with no effect. I still got the "fatal setgid failed: Not owner" ( Fatal: setgid(12345(postfix)) failed with euid=12346(dovecot), gid=54322(dovecot), egid=54322(dovecot): Not owner ) 2010/4/20 Andreas Schulze <andreas.schulze(a)datev.de>: > Am 19.04.2010 16:49 schrieb Zilon X: >> postfix:x:12345:12345::/dev/null:/bin/false >> dovecot:x:12346:54322::/dev/null:/bin/false > > I would never use /dev/null as homedir. > postfix home is /var/spool/postfix, dovecot likes /var/run/dovecot. > > -- > Andreas Schulze > Internetdienste | P532 > > DATEV eG > 90329 Nürnberg | Telefon +49 911 319-0 | Telefax +49 911 319-3196 > E-Mail info @datev.de | Internet www.datev.de > Sitz: 90429 Nürnberg, Paumgartnerstr. 6-14 | Registergericht Nürnberg, GenReg Nr.70 > Vorstand > Prof. Dieter Kempf (Vorsitzender) > Dipl.-Kfm. Wolfgang Stegmann (stellvertretender Vorsitzender) > Dipl.-Kfm. Michael Leistenschneider > Jörg Rabe v. Pappenheim > Dipl.-Vw. Eckhard Schwarzer > Vorsitzender des Aufsichtsrates: Reinhard Verholen > >

2 1

[Dovecot] zero sized messages in Maildir, corrupt filenames ?
by Rodolphe Buret 20 Apr '10

20 Apr '10

Hi, I'm starting to see more and more duplicates in my cur directory. they seem to be a copy of an incoming mail (messages share the same date) but they appears in the client as a message without subject and without sender or body. Their filename starts with an underscore and the 4th letter is a %. The rest of the filename is random (but it also includes my hostname). Which program could create such a filename ? If it's in the cur directory, it can only be dovecot, right ? Example of 2 probably related messages in the cur folder: 1785 Apr 20 09:18 msg.zMeU:2,d 0 Apr 20 09:18 _J9C%jVVzLB.{myhostname}:2, In addition, it seems that since we have started to use thunderbird 3, indexes are often corrupt, mailboxes needs reconstruction and so on. Could it be an incompatibility with my version of dovecot ? I've disabled my thunderbird filters that were moving the incoming mail automatically, no difference. I use no antivirus (linux imap client mainly). I can (probably) upgrade to dovecot-1.2.11-3_108 but I'd like to be sure that I won't create more problems before doing it. The homedirs are NFS mounted. dovecot 1.1.7-0_84 squirrelmail 1.4.19 postfix 2.6.5-1 Here is my dovecot -n # 1.1.7: /etc/dovecot.conf # OS: Linux 2.6.18-128.1.1.el5xen x86_64 Red Hat Enterprise Linux Server release 5.3 (Tikanga) log_path: /var/log/dovecot.log protocols: imap imaps listen: * login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: maildir:~/Maildir mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock auth default: passdb: driver: pam userdb: driver: passwd plugin: quota: Thanks for your time, -- Rodolphe Buret Ecole Polytechnique Fédérale de Lausanne System Administrator EPFL STI-IEL-ESL Tel: +41-21-693-0922 ELG 136 (bâtiment ELG) Fax: +41-21-693-0909 Station 11 Email: rodolphe.buret(a)epfl.ch CH-1015 Lausanne Switzerland

2 1

[Dovecot] Dovecot-sieve vacation proposal, use address in addresses as recipient
by David Berard 20 Apr '10

20 Apr '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi Dovecot list, In my setup I have several email addresses that uses same account. When I set a vacation the answer is not necessarily send from the destination address. I propose to use the addresses found in addresses (if one match) as From address in vacation reply. I've made a little patch who do that [1]. Best regards. [1] http://polymorf.fr/files/nfrance/cmd-vacation.patch - -- David BERARD - ------------------------------------------------- contact(at)davidberard.fr GPG|PGP KeyId 0xC8533354 GPG|PGP Key http://davidberard.fr/C8533354.gpgkey - ------------------------------------------------- * No electrons were harmed in * * the transmission of this email * -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAku+fUoACgkQOL7fhchTM1TJmACfdQcfgrSqNbjvWTEXrTc7Twly M70An2Nzb2MFby9ARHM1Ys93wGzuRYHy =yaLh -----END PGP SIGNATURE-----

4 4

[Dovecot] setgid failed - Not owner
by Zilon X 19 Apr '10

19 Apr '10

Hello ALL, I got errors on a new installation, maybe I forgot something. The system is Solaris, Dovecot 1.2.10, Postfix 2.7.0, MySQL 5.1.25. Can send mail with dovecot imap, but can`t retrieve the messages. Strange, I can save and retrieve draft messages ok, files are always with postfix:postfix ownership. Sorry if this is newbie question, but can`t find a solution. Syslog info: Apr 19 10:10:17 server postfix/qmgr[10654]: [ID 197553 mail.info] B66EF3FEE7: from=<user@domain>, size=547, nrcpt=1 (queue active) Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] auth(default): master in: USER 1 user@domain service=deliver Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] auth-worker(default): sql(user@domain): SELECT '/var/postfix/domains/domain/user' as home, 'maildir:/var/postfix/domains/domain/user' as mail, 12345 AS uid, 12345 AS gid, concat('dirsize:storage=', quota) AS quota FROM mailbox WHERE username = 'user@domain' AND active = '1' Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] auth(default): master out: USER 1 user@domain home=/var/postfix/domains/domain/user mail=maildir:/var/postfix/domains/domain/user uid=12345 gid=12345 quota=dirsize:storage=10240000 Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] deliver(user@domain): auth input: home=/var/postfix/domains/domain/user Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] deliver(user@domain): auth input: mail=maildir:/var/postfix/domains/domain/user Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] deliver(user@domain): auth input: uid=12345 Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] deliver(user@domain): auth input: gid=12345 Apr 19 10:10:17 server dovecot: [ID 583609 mail.info] deliver(user@domain): auth input: quota=dirsize:storage=10240000 >> Apr 19 10:10:17 server dovecot: [ID 583609 mail.crit] deliver(user@domain): Fatal: setgid(12345(postfix)) failed with euid=12346(dovecot), gid=54322(dovecot), egid=54322(dovecot): Not owner Apr 19 10:10:17 server postfix/pipe[23327]: [ID 197553 mail.info] B66EF3FEE7: to=<user@domain>, relay=dovecot, delay=582, delays=582/0.18/0/0.11, dsn=4.3.0, status=deferred (temporary failure) _____________________________________________________ Configuration at dovecot.conf: login_dir = /var/postfix/dovecot/run/login login_chroot = yes login_user = dovecot mail_privileged_group = postfix mail_full_filesystem_access = yes passdb sql { args = /var/postfix/dovecot/etc/dovecot-sql.conf } userdb sql { args = /var/postfix/dovecot/etc/dovecot-sql.conf } user = nobody socket listen { master { path = /var/postfix/dovecot/run/auth-master mode = 0660 user = postfix group = postfix } client { path = /var/postfix/spool/private/auth mode = 0660 user = postfix group = postfix } } _____________________________________________________ Configuration at main.cf: mail_owner = postfix default_privs = nobody virtual_transport = dovecot dovecot_destination_recipient_limit = 1 smtpd_sasl_type = dovecot _____________________________________________________ Configuration at master.cf: dovecot unix - n n - - pipe flags=DRhu user=dovecot:dovecot argv=/var/postfix/dovecot/libexec/dovecot/deliver -d $(recipient) _____________________________________________________ Entries at passwd: postfix:x:12345:12345::/dev/null:/bin/false dovecot:x:12346:54322::/dev/null:/bin/false Entries at group: postfix::12345: postdrop::54321: dovecot::54322: _____________________________________________________ Thank you for any help!

1 0

[Dovecot] permission denied, no logs
by Shane Brooks 19 Apr '10

19 Apr '10

Hi, We have a sendmail/dovecot/squirrelmail installation that was working ok except for deleted files showing in the list with a [d] beside it. In trying to fix that issue, I apparently made a new error appear in the left navigation area: ERROR: Could not complete request. Query: CREATE "mail/Sent" Reason Given: [NOPERM] Permission denied There are no errors in dovecot, but from what i've read squirrelmail passes these folder requests to the imap server for processing. Can anyone help me verify what my permissions should be? Here is my config: # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.24-19-xen x86_64 CentOS release 5.3 (Final) log_path: /var/log/dovecot/runtime.log protocols: imap imaps pop3 pop3s disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_privileged_group: mail mail_uid: mail mail_gid: mail mail_location: mbox:~:INBOX=/var/mail/%u mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 lda: postmaster_address: postmaster(a)example.com auth default: cache_size: 10 debug: yes passdb: driver: pam args: cache_key=%u dovecot userdb: driver: passwd Thank you very much! Shane brooks IT Manager 940 West Oakland Avenue Suite A8 Oakland, Florida 34787 407-654-6076 Office 407-654-6063 Fax

2 1

[Dovecot] sieve rule problem after upgrade
by Benny Pedersen 19 Apr '10

19 Apr '10

after i updated from 1.2.6 to 1.2.11 in gentoo this sieve rule stopped working :( # X-Cron-Env if exists "X-Cron-Env" { addflag "\\Seen"; fileinto "Trash"; removeflag "\\Seen"; stop; } any hints why ?, this rule is generated with horde ingo so it might be problem in ingo ? -- xpoint

2 2

[Dovecot] dovecot-1.2-sieve sending vacation replies regardless of recipient (patch)
by Mark Washenberger 19 Apr '10

19 Apr '10

I want a way to send VAR messages without having to specify up front all of the addresses for which such VARs should be sent. I realize this goes against rfc 3834, but it seemed reasonable to add a tag to the vacation command to skip the [to, cc, bcc, ...] recipients check. The patch I made is attached. The new usage with this patch is: vacation [":days" number] [":subject" string] [":x_any_address"] [":from" string] [":addresses" string-list] [":mime"] [":handle" string] <reason: string> What do you think of this patch? Is there a better way to accomplish the same thing without writing a patch? Is there a better way to write this patch to make it a cleaner feature or easier to maintain? Could this ever be part of the mainline? Mark Washenberger Rackspace Hosting Software Developer, Email & Apps mark.washenberger(a)rackspace.com

2 2

[Dovecot] sieve plugin - reject sends MDN. Can it 550 reject ?
by Ken A 19 Apr '10

19 Apr '10

I'm using dovecot-1.2-sieve-0.1.15 with dovecot-1.2.11. I have a reject test filter that looks like this: require "reject"; if header :contains "subject" "reject" { reject "bye"; } Is there any way to get a "reject" filter to send back a 550 reject as detailed in http://ietfreport.isoc.org/idref/rfc5429/#section-2.5 rather than a MDN? The MDN can result in blowback spam. :-( Thanks, Ken -- Ken Anderson Pacific Internet - http://www.pacific.net

3 3

[Dovecot] siever_dir default
by Antonio Casado Rodríguez 19 Apr '10

19 Apr '10

Hi all I have this: # The path to the directory where the personal Sieve scripts are stored. For # ManageSieve this is where the uploaded scripts are stored. #sieve_dir=~/sieve but the correct is # The path to the directory where the personal Sieve scripts are stored. For # ManageSieve this is where the uploaded scripts are stored. # Default value: {mail_location}/sieve #sieve_dir=~/sieve

2 1

[Dovecot] PostgreSQL driver supporting [round-robin] load balancing and redundancy [LONG]
by Rainer Weikusat 18 Apr '10

18 Apr '10

One of the things my employer uses dovecot for is as mail download server for an 'e-mail purification service' (AV/ anti-spam) for smartphones. The service itself presently runs on a rented server somewhere in the UK and the corresponding 'web service' front-end and user account/ mail account database resides on a server in Germany. The UK dovecot server uses the PostgreSQL server on the German machine for user authentication. The latter is reachable using two entirely different 'internet paths' and there was an outage of several hours on one of them a couple of weeks ago. This prompted some frantic network reconfiguration efforts in order to get the abovementioned service going again and resulted in the conviction that - ideally - the dovecot server should be capable of using connections to multiple PostgreSQL servers (or a single server reachable via several IPs) simultaneoulsy, distributing requests among them, and should be capable of detecting a possible problem on one of the db server connections and use the still functioning ones to continue operations. After having spent about eight hours reading through the code of existing pgsql driver, I concluded that modifying that in order to achieve the goals outlined above would require some major brain surgery with a high chance of causing a lot of collateral damage in the course of that and that writing a new driver providing the sought-after feature set was the better idea. Which is the point of this e-mail. Example Usage ------------- Multiple connections can be specified in an ordinary connect-string by separating the necessary parameters with a ;;;-sequence. For the server I was writing about above, this looks like: connect = host=1.1.1.1 dbname=mailgate user=mailgate_user password=secret sslmode=require ;;; \ host=2.2.2.2 dbname=mailgate user=mailgate_user password=secret sslmode=require Leading and trailing whitespace in a connect sub-string is ignored. Basic Operation --------------- After having split the connect string, the driver creates a connection structure (struct multi_pgsql_pgc) for each connection specification contained in that and initiates an asynchronous connect for each. As the actual connections become ready, they are put onto a (linked list) (FIFO) queue of 'connections which are ready'. When a query is submitted to the driver, the first connection structure is removed from the ready list and used to execute the query. After this has finished, the connection is added to the end of the 'connections which are ready' list. If no connection is ready at the time a query was submitted, the query is put on a FIFO queue of queries which will be executed as the resources to actually do so become availabe. Each query has a lifetime of 60 seconds (arbitrary). A query which couldn't be started before his lifetime was over will be aborted with a timeout error. A connection which is currently being used to execute a query will be considered dead if no forward progress of any kind has happened for 20 seconds (also arbitrary). If this happens (or if some kind of I/O error occurs), the existing connection will be closed and an asychronous connect on a newly created one will be started. Assuming the lifetime of the query isn't yet over, it will either be started again on another available connection or pushed back onto the front of the query queue, causing it to be started as soon as a connection becomes available. Attemtps to reestablish the failed connection will continue (with 5 seconds of delay between each) in the background until success. Design Overview --------------- struct multi_pgsql_pgdb & routines working on that provide both the 'simple' query interface and transaction support. struct multi_pgsql_pgc represents a database connection. The result interface is implemented as struct multi_pgsql_result & assorted subroutines. Transactions are provided by a struct multi_pgsql_transaction_context which contains a linked-list of transaction subqueries (struct multi_pgsql_transaction_subquery). A 'class hierarchy' of 'query classes' is used to provide the different kinds of 'queries' supported by the driver (simple queries, simple synchronous queries, transaction queries, synchronous transaction queries). The complete hierarchy itself looks like this: multi_pgsql_query / \ / \ multi_pgsql_simple_query multi_pgsql_transaction_query / \ / \ / \ / \ multi_pgsql_user_query multi_pgsql_sync_query \ / \ / \ multi_pgsql_async_transaction_query multi_pgsql_sync_transaction_query Notable Difference to the pgsql Driver -------------------------------------- sql_exec This interface is not implemented. It is (as far as I can tell) not used anywhere except inside the sqllite driver. It cannot be used for queries which return information because there is no way to access this information and it can neither generally be used for queries which cause side effects since it cannot be determined if execution was successful (the only possible use I can think of is actually a rollback after a failed transaction). sql_result_get_field_value_binary Not implemented. Appears to be unused and the way I understand the libpq programming documentation, the only way to retrieve a binary result to some query is to use PQsendQueryParams or PQsendQueryPrepare and request that some columns are returned in binary. Nothing like this is supported in the present, abstract SQL database interface. synchronous query execution Because background connection reestablishment might still be going on after a synchronous query has been executed, it is necessary to switch any timeouts/ io operations registered to the ioloop used for synchronous query execution back to the main ioloop. The code implements this by using io_loop_set_current to temporarily restore the original ioloop, unregistering and registering any timeouts/ io-requests possibly associated with one of the existing database connections, switching back to the synchronous execution ioloop afterwards and then destroying that via io_loop_destroy. This works but is probably not exactly how the existing interfaces were supposed to be used. error messages for synchronously committed transaction These are put onto the data stack by the commit_s subroutine which will hopefully (judging from the dict-code, this should work, too) be sufficient to enable them to survive until someone higher up in the callchain wants to look at them. Remarks on the Patch -------------------- Created against dovecot-1-2-cf3fe573a560. Applies cleanly to 1.2.11. Applies to 2.0.beta4 with a rejection because of a feature which doesn't exist anymore. The result can be compiled but it hasn't been tested. ---- Index: dovecot/configure.in =================================================================== RCS file: /sysdata/cvs/dovecot/configure.in,v retrieving revision 1.1.1.2 retrieving revision 1.1.1.2.6.9 diff -u -r1.1.1.2 -r1.1.1.2.6.9 --- dovecot/configure.in 15 Mar 2010 18:18:14 -0000 1.1.1.2 +++ dovecot/configure.in 5 Apr 2010 16:16:03 -0000 1.1.1.2.6.9 @@ -159,6 +159,11 @@ [ --with-sqlite Build with SQLite3 driver support], TEST_WITH(sqlite, $withval), want_sqlite=no) + +AC_ARG_WITH(multi-pgsql, +[ --with-multi-pgsql Build with PostgreSQL driver supporting multiple connections], + TEST_WITH(multi-pgsql, $withval), + want_multi_pgsql=no) AC_ARG_WITH(lucene, [ --with-lucene Build with CLucene full text search support], @@ -1969,7 +1974,12 @@ LIBS=$old_LIBS fi -if test $want_pgsql != no; then +want_pgsql_driver=no +test "$want_pgsql" != no && want_pgsql_driver=yes +test "$want_multi_pgsql" != no && want_pgsql_driver=yes + + +if test $want_pgsql_driver != no; then AC_CHECK_PROG(PG_CONFIG, pg_config, YES, NO) if test $PG_CONFIG = NO; then # based on code from PHP @@ -2014,19 +2024,20 @@ fi PGSQL_LIBS="$PGSQL_LIBS -lpq" AC_DEFINE(HAVE_PGSQL,, Build with PostgreSQL support) - found_sql_drivers="$found_sql_drivers pgsql" + test "$want_pgsql" != no && found_sql_drivers="$found_sql_drivers pgsql" + test "$want_multi_pgsql" != no && found_sql_drivers="$found_sql_drivers multi_pgsql" if test "$all_sql_drivers" = "yes"; then - sql_drivers="$sql_drivers pgsql" + sql_drivers="$sql_drivers pgsql pgsql_timeout" fi ], [ - if test $want_pgsql = yes; then + if test $want_pgsql_driver = yes; then AC_ERROR([Can't build with PostgreSQL support: libpq-fe.h not found]) fi ]) CPPFLAGS=$old_CPPFLAGS ], [ - if test $want_pgsql = yes; then + if test $want_pgsql_driver = yes; then AC_ERROR([Can't build with PostgreSQL support: libpq not found]) fi ]) @@ -2323,6 +2334,7 @@ build_pgsql=no build_mysql=no build_sqlite=no +build_multi_pgsql=no for driver in $sql_drivers; do if test "$driver" = "pgsql"; then AC_DEFINE(BUILD_PGSQL,, Built-in PostgreSQL support) @@ -2333,7 +2345,10 @@ elif test "$driver" = "sqlite"; then AC_DEFINE(BUILD_SQLITE,, Built-in SQLite support) build_sqlite=yes - fi + elif test "$driver" = "multi_pgsql"; then + AC_DEFINE(BUILD_MULTI_PGSQL,, Built-in PostgreSQL support with multiple connection support) + build_multi_pgsql=yes + fi done if test $build_pgsql = no; then not_sql_drivers="$not_sql_drivers pgsql" @@ -2344,11 +2359,15 @@ if test $build_sqlite = no; then not_sql_drivers="$not_sql_drivers sqlite" fi +if test $build_multi_pgsql = no; then + not_sql_drivers="$not_sql_drivers multi_pgsql" +fi AC_SUBST(sql_drivers) AM_CONDITIONAL(BUILD_PGSQL, test "$build_pgsql" = "yes") AM_CONDITIONAL(BUILD_MYSQL, test "$build_mysql" = "yes") AM_CONDITIONAL(BUILD_SQLITE, test "$build_sqlite" = "yes") +AM_CONDITIONAL(BUILD_MULTI_PGSQL, test "$build_multi_pgsql" = "yes") AM_CONDITIONAL(SQL_PLUGINS, test "$want_sql" = "plugin") dnl ** Index: dovecot/src/lib-sql/Makefile.am =================================================================== RCS file: /sysdata/cvs/dovecot/src/lib-sql/Makefile.am,v retrieving revision 1.1.1.1 retrieving revision 1.1.1.1.6.3 diff -u -r1.1.1.1 -r1.1.1.1.6.3 --- dovecot/src/lib-sql/Makefile.am 28 Dec 2009 13:52:04 -0000 1.1.1.1 +++ dovecot/src/lib-sql/Makefile.am 5 Apr 2010 15:05:54 -0000 1.1.1.1.6.3 @@ -15,11 +15,16 @@ SQLITE_LIB = libdriver_sqlite.la SQL_DRIVER_PLUGINS += sqlite endif +if BUILD_MULTI_PGSQL +MULTI_PGSQL_LIB = libdriver_multi_pgsql.la +SQL_DRIVER_PLUGINS += multi_pgsql +endif sql_module_LTLIBRARIES = \ $(MYSQL_LIB) \ $(PGSQL_LIB) \ - $(SQLITE_LIB) + $(SQLITE_LIB) \ + $(MULTI_PGSQL_LIB) sql_moduledir = $(moduledir)/sql endif @@ -39,7 +44,8 @@ driver_sources = \ driver-mysql.c \ driver-pgsql.c \ - driver-sqlite.c + driver-sqlite.c \ + driver-multi-pgsql.c endif libsql_a_SOURCES = \ @@ -62,6 +68,11 @@ libdriver_sqlite_la_LIBADD = $(SQLITE_LIBS) libdriver_sqlite_la_CPPFLAGS = -I$(top_srcdir)/src/lib $(SQLITE_CFLAGS) libdriver_sqlite_la_SOURCES = driver-sqlite.c + +libdriver_multi_pgsql_la_LDFLAGS = -module -avoid-version +libdriver_multi_pgsql_la_LIBADD = $(MULTI_PGSQL_LIBS) +libdriver_multi_pgsql_la_CPPFLAGS = -I$(top_srcdir)/src/lib $(MULTI_PGSQL_CFLAGS) +libdriver_multi_pgsql_la_SOURCES = driver-multi-pgsql.c endif headers = \ Index: dovecot/src/lib-sql/driver-multi-pgsql.c =================================================================== RCS file: dovecot/src/lib-sql/driver-multi-pgsql.c diff -N dovecot/src/lib-sql/driver-multi-pgsql.c --- /dev/null 1 Jan 1970 00:00:00 -0000 +++ dovecot/src/lib-sql/driver-multi-pgsql.c 14 Apr 2010 15:31:48 -0000 1.1.2.134 @@ -0,0 +1,1763 @@ +/* + Copyright (c) MAD Partners, Ltd 2010 (rweikusat(a)madpartnerltd.com) + Portions Copyright (c) 2004-2010 Dovecot authors, see the included COPYING file +*/ + +/* includes */ +#include "lib.h" +#include "array.h" +#include "ioloop.h" +#include "ioloop-internal.h" /* kind of dirty, but it should be fine.. */ +#include "sql-api-private.h" + +#ifdef BUILD_MULTI_PGSQL +#include <ctype.h> +#include <stdlib.h> +#include <time.h> +#include <libpq-fe.h> + +/* macros */ +/* #define DEBUG */ +#ifdef DEBUG +# define dprintf(args) i_info args +#else +# define dprintf(args) +#endif + +#define DEINIT_ERROR "db driver deinit" +#define TIMEOUT_ERROR "query timed out" + +/* constants */ +enum { + MULTI_PGSQL_POOL = 512, + MULTI_PGSQL_XACT_POOL = 1024, + + TIMEOUT_UNIT = 1000, + + RECONNECT_DELAY = 5 * TIMEOUT_UNIT, + USER_QUERY_LIFETIME = 60, + + PGC_IO_TIMEOUT = 20, + MIN_QUERY_TIMEOUT = 10 +}; + +/** general helper routines */ +static char *kill_pg_errmsg_newline(char *s) +{ + char *r; + unsigned c; + + r = s; + while ((c = *r) && c != '\n') ++r; + if (c) *r = 0; + + return s; +} + +/** error result */ +struct multi_pgsql_error_result { + struct sql_result api; + char *msg; +}; + +static void error_result_free(struct sql_result *r) +{ + struct multi_pgsql_error_result *result; + + result = (void *)r; + dprintf(("%s: %p", __func__, result)); + + i_free(result->msg); + i_free(result); +} + +static void error_result_nop(struct sql_result *r) +{ + dprintf(("%s: %p", __func__, r)); +} + +static int error_result_next_row(struct sql_result *r) +{ + dprintf(("%s: %p", __func__, r)); + return -1; +} + +static char const *error_result_get_error(struct sql_result *r) +{ + struct multi_pgsql_error_result *result; + + result = (void *)r; + dprintf(("%s: %p", __func__, result)); + + return result->msg; +} + +static void init_error_result(struct multi_pgsql_error_result *result, + char const *msg) +{ + struct sql_result_vfuncs *v; + + memset(&result->api, 0, sizeof(result->api)); + + v = &result->api.v; + v->free = error_result_nop; + v->next_row = error_result_next_row; + v->get_error = error_result_get_error; + + result->msg = (char *)msg; + + dprintf(("%s: %p", __func__, result)); +} + +/** multi_pgsql_result */ +struct multi_pgsql_result { + struct sql_result api; + struct multi_pgsql_pgc *pgc; + + PGresult *pgr; + unsigned row, n_rows; + char const **values, *errmsg; +}; + +/*** methods/ subroutines */ +static void multi_pgsql_result_free(struct sql_result *r) +{ + struct multi_pgsql_result *result; + + result = (void *)r; + + PQclear(result->pgr); + if (result->values) i_free(result->values); + i_free(result); +} + +static void multi_pgsql_result_nop(struct sql_result *r) +{ + (void)r; +} + + +static int multi_pgsql_result_next_row(struct sql_result *r) +{ + struct multi_pgsql_result *result; + unsigned row; + + dprintf(("%s: %p", __func__, r)); + + result = (void *)r; + row = result->row; + if (++row < result->n_rows) return result->row = row; + return 0; +} + +static int multi_pgsql_result_first_row(struct sql_result *r) +{ + struct multi_pgsql_result *result; + PGresult *pgr; + ExecStatusType status; + unsigned n_rows; + + result = (void *)r; + pgr = result->pgr; + + status = PQresultStatus(pgr); + dprintf(("%s: %p: result status %s(%d)", + __func__, r, PQresStatus(status), status)); + + switch (status) { + case PGRES_COMMAND_OK: + case PGRES_COPY_OUT: + case PGRES_COPY_IN: + n_rows = 0; + break; + + case PGRES_TUPLES_OK: + n_rows = PQntuples(pgr); + + dprintf(("%s: %p: %u rows", __func__, result, n_rows)); + break; + + default: + return -1; + } + + result->n_rows = n_rows; + result->api.v.next_row = multi_pgsql_result_next_row; + return n_rows; +} + +static unsigned multi_pgsql_result_get_fields_count(struct sql_result *r) +{ + struct multi_pgsql_result *result; + unsigned count; + + result = (void *)r; + count = PQnfields(result->pgr); + + dprintf(("%s: %p: %u", __func__, result, count)); + return count; +} + +static char const *multi_pgsql_result_get_field_name(struct sql_result *r, + unsigned i) +{ + struct multi_pgsql_result *result; + char const *name; + + result = (void *)r; + name = PQfname(result->pgr, i); + + dprintf(("%s: %p: %u: '%s'", __func__, result, i, name)); + return name; +} + +static int multi_pgsql_result_find_field(struct sql_result *r, + char const *fname) +{ + struct multi_pgsql_result *result; + int i; + + result = (void *)r; + i = PQfnumber(result->pgr, fname); + + if (i == -1) { + i_info("%s: %p: no field named '%s'", + __func__, result, fname); + return -1; + } + + dprintf(("%s: %p: '%s' <-> %d", + __func__, result, fname, i)); + return i; +} + +static char const *multi_pgsql_result_get_field_value(struct sql_result *r, + unsigned i) +{ + struct multi_pgsql_result *result; + char const *value; + unsigned row; + + result = (void *)r; + row = result->row; + value = PQgetvalue(result->pgr, row, i); + if (!*value && PQgetisnull(result->pgr, row, i)) value = NULL; + + dprintf(("%s: %p: %u,%u: '%s'", + __func__, result, row, i, value ? value : "NULL")); + return value; +} + +static unsigned char const * +multi_pgsql_result_get_field_value_binary(struct sql_result *r, + unsigned i, size_t *size) +{ + (void)i; + i_info("%s: %p: not implemented", __func__, r); + + *size = 0; + return NULL; +} + +static char const *multi_pgsql_result_find_field_value(struct sql_result *r, + char const *fname) +{ + int i; + + dprintf(("%s: %p", __func__, r)); + + i = r->v.find_field(r, fname); + return i != -1 ? r->v.get_field_value(r, i) : NULL; +} + +static char const * const *multi_pgsql_result_get_values(struct sql_result *r) +{ + struct multi_pgsql_result *result; + char const **values; + unsigned n; + + dprintf(("%s: %p", __func__, r)); + result = (void *)r; + + values = result->values; + if (values) return values; + + n = r->v.get_fields_count(r); + values = result->values = i_new(char const *, n); + do { + --n; + values[n] = r->v.get_field_value(r, n); + } while (n); + + return values; +} + +static char const * +multi_pgsql_result_get_error(struct sql_result *r) +{ + struct multi_pgsql_result *result; + char const *errmsg; + + result = (void *)r; + + errmsg = result->errmsg; + if (errmsg) return errmsg; + + errmsg = result->errmsg = + kill_pg_errmsg_newline(PQresultErrorMessage(result->pgr)); + return errmsg; +} + +/*** vtable/ init */ +static struct sql_result multi_pgsql_result = { + MEMBER(v) { + multi_pgsql_result_nop, + multi_pgsql_result_first_row, + multi_pgsql_result_get_fields_count, + multi_pgsql_result_get_field_name, + multi_pgsql_result_find_field, + multi_pgsql_result_get_field_value, + multi_pgsql_result_get_field_value_binary, + multi_pgsql_result_find_field_value, + multi_pgsql_result_get_values, + multi_pgsql_result_get_error + } +}; + +static void init_multi_pgsql_result(struct multi_pgsql_result *result, + PGresult *pgr) +{ + result->api = multi_pgsql_result; + result->pgr = pgr; + result->row = 0; + result->values = NULL; +} + +/** query classes */ +struct multi_pgsql_query { + struct multi_pgsql_query *p; + struct multi_pgsql_query_vtable *vtable; +}; + +struct multi_pgsql_query_vtable { + void (*start)(struct multi_pgsql_query *, struct multi_pgsql_pgc *); + void (*result)(struct multi_pgsql_query *, struct multi_pgsql_pgc *, + PGresult **); + void (*abort)(struct multi_pgsql_query *, struct sql_result *); + void (*dtor)(struct multi_pgsql_query *); + time_t (*eol)(struct multi_pgsql_query *); + void (*set_sync_ioloop)(struct multi_pgsql_query *, struct ioloop *); + char const *(*get_query)(struct multi_pgsql_query *); +}; + +static void start_new_query_on_pgc(struct multi_pgsql_query *, struct multi_pgsql_pgc *); +static void start_query_on_pgc(struct multi_pgsql_pgc *); +static void done_with_query(struct multi_pgsql_pgc *); + +/*** method invocation wrappers */ +#define the_qry(q) ((struct multi_pgsql_query *)q) + +static inline void start_query(void *q, struct multi_pgsql_pgc *pgc) +{ + dprintf(("%s: %p", __func__, q)); + the_qry(q)->vtable->start(the_qry(q), pgc); +} + +static inline void query_result(void *q, struct multi_pgsql_pgc *pgc, + PGresult **pgr) +{ + dprintf(("%s: %p", __func__, q)); + the_qry(q)->vtable->result(the_qry(q), pgc, pgr); +} + +static inline void abort_query(void *q, struct sql_result *r) +{ + dprintf(("%s: %p", __func__, q)); + + the_qry(q)->vtable->abort(the_qry(q), r); + the_qry(q)->vtable->dtor(the_qry(q)); +} + +static inline void destroy_query(void *q) +{ + dprintf(("%s: %p", __func__, q)); + the_qry(q)->vtable->dtor(the_qry(q)); +} + +static inline time_t query_eol(void *q) +{ + dprintf(("%s: %p", __func__, q)); + return the_qry(q)->vtable->eol(the_qry(q)); +} + +static inline void set_query_sync_ioloop(void *q, struct ioloop *ioloop) +{ + dprintf(("%s: %p", __func__, q)); + the_qry(q)->vtable->set_sync_ioloop(the_qry(q), ioloop); +} + +static inline char const *get_query(void *q) +{ + return + the_qry(q)->vtable->get_query(the_qry(q)); +} + +#undef the_qry + +/*** query */ +static void init_multi_pgsql_query(struct multi_pgsql_query *qry, + struct multi_pgsql_query_vtable *vtable) +{ + qry->p = NULL; + qry->vtable = vtable; +} + +/*** simple_query */ +struct multi_pgsql_simple_query { + struct multi_pgsql_query super; + + time_t eol_at; + char *query; +}; + +static void start_simple_query(struct multi_pgsql_query *q, + struct multi_pgsql_pgc *pgc) +{ + start_new_query_on_pgc(q, pgc); +} + +static time_t simple_query_eol(struct multi_pgsql_query *q) +{ + struct multi_pgsql_simple_query *qry; + + qry = (void *)q; + dprintf(("%s: %p", __func__, qry)); + return qry->eol_at; +} + +static char const *simple_query_get_query(struct multi_pgsql_query *q) +{ + return ((struct multi_pgsql_simple_query *)q)->query; +} + +static void init_simple_query(struct multi_pgsql_simple_query *qry, + struct multi_pgsql_query_vtable *vtable, + unsigned query_lifetime, char const *query) +{ + init_multi_pgsql_query(&qry->super, vtable); + + qry->query = (void *)query; + qry->eol_at = time(NULL) + query_lifetime; +} + +/*** user_query */ +struct multi_pgsql_user_query { + struct multi_pgsql_simple_query super; + + sql_query_callback_t *cb; + void *ctx; +}; + +static void abort_user_query(struct multi_pgsql_query *q, + struct sql_result *r) +{ + struct multi_pgsql_user_query *qry; + + qry = (void *)q; + + T_BEGIN { + qry->cb(r, qry->ctx); + } T_END; +} + +static void user_query_result(struct multi_pgsql_query *q, + struct multi_pgsql_pgc *pgc, + PGresult **pgr) +{ + struct multi_pgsql_result result; + struct multi_pgsql_user_query *qry; + + qry = (void *)q; + init_multi_pgsql_result(&result, *pgr); + + T_BEGIN { + qry->cb(&result.api, qry->ctx); + } T_END; + + if (result.values) i_free(result.values); + + done_with_query(pgc); +} + +static void user_query_dtor(struct multi_pgsql_query *q) +{ + struct multi_pgsql_user_query *qry; + + qry = (void *)q; + + i_free(qry->super.query); + i_free(qry); +} + +/**** vtable/ init */ +static struct multi_pgsql_query_vtable user_query_vtable = { + start_simple_query, + user_query_result, + abort_user_query, + user_query_dtor, + simple_query_eol, + NULL, + simple_query_get_query +}; + +static struct multi_pgsql_query *create_user_query(char const *query, + sql_query_callback_t *cb, void *ctx) +{ + struct multi_pgsql_user_query *qry; + + qry = i_new(struct multi_pgsql_user_query, 1); + + init_simple_query(&qry->super, &user_query_vtable, + USER_QUERY_LIFETIME, i_strdup(query)); + + qry->cb = cb; + qry->ctx = ctx; + return (void *)qry; +} + +/*** sync_query */ +struct multi_pgsql_sync_query { + struct multi_pgsql_simple_query super; + + struct ioloop *ioloop; + PGresult *pgr; + char *errmsg; +}; + +static void sync_query_result(struct multi_pgsql_query *q, + struct multi_pgsql_pgc *pgc, + PGresult **pgr) +{ + struct multi_pgsql_sync_query *qry; + + qry = (void *)q; + + qry->errmsg = NULL; + qry->pgr = *pgr; + *pgr = NULL; + + done_with_query(pgc); +} + +static void abort_sync_query(struct multi_pgsql_query *q, + struct sql_result *r) +{ + struct multi_pgsql_sync_query *qry; + + qry = (void *)q; + + qry->pgr = NULL; + qry->errmsg = i_strdup(r->v.get_error(r)); +} + +static void sync_query_dtor(struct multi_pgsql_query *q) +{ + struct multi_pgsql_sync_query *qry; + + qry = (void *)q; + io_loop_stop(qry->ioloop); +} + +static void set_sync_query_sync_ioloop(struct multi_pgsql_query *q, + struct ioloop *ioloop) +{ + struct multi_pgsql_sync_query *qry; + + qry = (void *)q; + qry->ioloop = ioloop; +} + +static struct sql_result * +result_from_sync_query(struct multi_pgsql_sync_query *qry) +{ + struct sql_result *result; + PGresult *pgr; + + pgr = qry->pgr; + + if (!pgr) { + result = (void *)i_new(struct multi_pgsql_error_result, 1); + init_error_result((void *)result, qry->errmsg); + result->v.free = error_result_free; + + return result; + } + + result = (void *)i_new(struct multi_pgsql_result, 1); + init_multi_pgsql_result((void *)result, pgr); + result->v.free = multi_pgsql_result_free; + + return result; +} + +/**** vtable/ init */ +static struct multi_pgsql_query_vtable sync_query_vtable = { + start_simple_query, + sync_query_result, + abort_sync_query, + sync_query_dtor, + simple_query_eol, + set_sync_query_sync_ioloop, + simple_query_get_query +}; + +static inline void init_sync_query(struct multi_pgsql_sync_query *qry, + char const *query) +{ + init_simple_query(&qry->super, &sync_query_vtable, + USER_QUERY_LIFETIME, query); +} + +/*** transaction query */ +struct multi_pgsql_transaction_subquery { + struct multi_pgsql_transaction_subquery *p; + + char *query; + unsigned *affected_rows; +}; + +struct multi_pgsql_transaction_context { + struct sql_transaction_context super; + struct multi_pgsql_transaction_subquery *first, **link_to; + pool_t pool; +}; + +struct multi_pgsql_transaction_query { + struct multi_pgsql_query super; + struct multi_pgsql_transaction_context *x_ctx; + + struct multi_pgsql_transaction_subquery *sub; + time_t cur_eol; + + /* + If set, points to the PGresult corresponding + with the subquery which caused the transaction + to fail. + */ + PGresult *pgr; +}; + +struct multi_pgsql_transaction_query_vtable { + struct multi_pgsql_query_vtable super; + void (*xact_done)(struct multi_pgsql_transaction_query *, char const *); +}; + +static inline void transaction_query_xact_done(void *q, char const *errmsg) +{ + struct multi_pgsql_transaction_query *qry; + struct multi_pgsql_transaction_query_vtable *vtable; + + dprintf(("%s: %p", __func__, q)); + + qry = q; + vtable = (void *)qry->super.vtable; + vtable->xact_done(q, errmsg); +} + + +static void start_transaction_query(struct multi_pgsql_query *q, + struct multi_pgsql_pgc *pgc) +{ + struct multi_pgsql_transaction_query *qry; + + qry = (void *)q; + qry->sub = qry->x_ctx->first; + start_new_query_on_pgc(q, pgc); +} + +static void transaction_query_result(struct multi_pgsql_query *q, + struct multi_pgsql_pgc *pgc, + PGresult **ppgr) +{ + struct multi_pgsql_transaction_query *qry; + struct multi_pgsql_transaction_subquery *sub; + PGresult *pgr; + char const *errmsg; + ExecStatusType status; + + qry = (void *)q; + + pgr = qry->pgr; + if (pgr) { + errmsg = kill_pg_errmsg_newline(PQresultErrorMessage(pgr)); + + query_done: + transaction_query_xact_done(qry, errmsg); + done_with_query(pgc); + return; + } + + sub = qry->sub; + + pgr = *ppgr; + status = PQresultStatus(pgr); + dprintf(("%s: %p: status %s(%d)", + __func__, qry, PQresStatus(status), status)); + + switch (status) { + case PGRES_COMMAND_OK: + case PGRES_TUPLES_OK: + case PGRES_COPY_OUT: + case PGRES_COPY_IN: + if (sub->affected_rows) + *sub->affected_rows = atoi(PQcmdTuples(pgr)); + + sub = sub->p; + if (!sub) { + errmsg = NULL; + goto query_done; + } + + qry->sub = sub; + qry->cur_eol = time(NULL) + USER_QUERY_LIFETIME; + break; + + default: + qry->pgr = pgr; + *ppgr = NULL; + + qry->cur_eol = 0; /* don't restart failed transactions */ + sub->query = "rollback"; + } + + start_query_on_pgc(pgc); +} + +static void abort_transaction_query(struct multi_pgsql_query *q, + struct sql_result *r) +{ + char const *errmsg; + PGresult *pgr; + + pgr = ((struct multi_pgsql_transaction_query *)q)->pgr; + errmsg = pgr ? + kill_pg_errmsg_newline(PQresultErrorMessage(pgr)) : r->v.get_error(r); + transaction_query_xact_done(q, errmsg); +} + +static time_t transaction_query_eol(struct multi_pgsql_query *q) +{ + return ((struct multi_pgsql_transaction_query *)q)->cur_eol; +} + +static void transaction_query_dtor(struct multi_pgsql_query *q) +{ + struct multi_pgsql_transaction_query *qry; + PGresult *pgr; + pool_t pool; + + qry = (void *)q; + + pgr = qry->pgr; + if (pgr) PQclear(pgr); + + pool = qry->x_ctx->pool; + pool_unref(&pool); +} + +static char const *transaction_query_get_query(struct multi_pgsql_query *q) +{ + struct multi_pgsql_transaction_query *qry; + + qry = (void *)q; + return qry->sub->query; +} + +static void init_transaction_query(struct multi_pgsql_transaction_query *qry, + struct multi_pgsql_transaction_query_vtable *vtable, + struct multi_pgsql_transaction_context *x_ctx) +{ + init_multi_pgsql_query(&qry->super, &vtable->super); + + qry->x_ctx = x_ctx; + qry->cur_eol = time(NULL) + USER_QUERY_LIFETIME; + qry->pgr = NULL; +} + +/*** async transaction query */ +struct multi_pgsql_async_transaction_query { + struct multi_pgsql_transaction_query super; + + sql_commit_callback_t *cb; + void *ctx; +}; + +static void async_transaction_query_xact_done(struct multi_pgsql_transaction_query *q, + char const *errmsg) +{ + struct multi_pgsql_async_transaction_query *qry; + + qry = (void *)q; + qry->cb(errmsg, qry->ctx); +} + +/**** vtable/ init */ +static struct multi_pgsql_transaction_query_vtable async_transaction_query_vtable = { + { + start_transaction_query, + transaction_query_result, + abort_transaction_query, + transaction_query_dtor, + transaction_query_eol, + NULL, + transaction_query_get_query }, + + async_transaction_query_xact_done +}; + +static void +init_async_transaction_query(struct multi_pgsql_async_transaction_query *qry, + struct multi_pgsql_transaction_context *x_ctx, + sql_commit_callback_t *cb, void *cb_ctx) +{ + init_transaction_query(&qry->super, + &async_transaction_query_vtable, x_ctx); + + qry->cb = cb; + qry->ctx = cb_ctx; +} + +/*** sync transaction query */ +struct multi_pgsql_sync_transaction_query { + struct multi_pgsql_transaction_query super; + + struct ioloop *ioloop; + char const *errmsg; +}; + +static void sync_transaction_query_dtor(struct multi_pgsql_query *q) +{ + struct multi_pgsql_sync_transaction_query *qry; + + qry = (void *)q; + io_loop_stop(qry->ioloop); + transaction_query_dtor(q); +} + +static void set_sync_transaction_query_sync_ioloop(struct multi_pgsql_query *q, + struct ioloop *ioloop) +{ + struct multi_pgsql_sync_transaction_query *qry; + + qry = (void *)q; + qry->ioloop = ioloop; +} + +static void sync_transaction_query_xact_done(struct multi_pgsql_transaction_query *q, + char const *errmsg) +{ + struct multi_pgsql_sync_transaction_query *qry; + + qry = (void *)q; + qry->errmsg = i_strdup(errmsg); +} + +/**** vtable/ init */ +static struct multi_pgsql_transaction_query_vtable sync_transaction_query_vtable = { + { + start_transaction_query, + transaction_query_result, + abort_transaction_query, + sync_transaction_query_dtor, + transaction_query_eol, + set_sync_transaction_query_sync_ioloop, + transaction_query_get_query }, + + sync_transaction_query_xact_done +}; + +static void init_sync_transaction_query(struct multi_pgsql_sync_transaction_query *qry, + struct multi_pgsql_transaction_context *x_ctx) +{ + init_transaction_query(&qry->super, + &sync_transaction_query_vtable, x_ctx); +} + +/** pgc (connection) code */ +struct multi_pgsql_pgc { + struct multi_pgsql_pgc *p; + + char *connect_string; + PGconn *pgc; + PGresult *pgr; + struct multi_pgsql_db *pgdb; + struct multi_pgsql_query *qry; + struct io *io; + struct timeout *timeout; +}; + +/*** misc */ +static void start_pgc_connect(struct multi_pgsql_pgc *); + +static void init_pgc(struct multi_pgsql_pgc *pgc, + struct multi_pgsql_db *pgdb, char *connect_string) +{ + pgc->connect_string = connect_string; + pgc->pgdb = pgdb; + + dprintf(("%s: pgc %p, '%s'", __func__, pgc, connect_string)); + + start_pgc_connect(pgc); +} + +static void reset_pgc(struct multi_pgsql_pgc *pgc) +{ + dprintf(("%s: %p", __func__, pgc)); + + if (pgc->io) io_remove(&pgc->io); + if (pgc->timeout) timeout_remove(&pgc->timeout); + + if (pgc->pgr) { + PQclear(pgc->pgr); + pgc->pgr = NULL; + } + + if (pgc->pgc) { + PQfinish(pgc->pgc); + pgc->pgc = NULL; + } +} + +static void pgc_ioloop_switch(struct multi_pgsql_pgc *pgc) +{ + union { + struct io io; + struct timeout timeout; + } old; + + if (pgc->io) { + old.io = *pgc->io; + io_remove(&pgc->io); + + pgc->io = io_add(PQsocket(pgc->pgc), + old.io.condition, old.io.callback, old.io.context); + } + + if (pgc->timeout) { + old.timeout = *pgc->timeout; + timeout_remove(&pgc->timeout); + + pgc->timeout = timeout_add(old.timeout.msecs, + old.timeout.callback, old.timeout.context); + } +} + +static void log_pg_error(struct multi_pgsql_pgc *pgc, char const *fnc, char const *pg_call) +{ + i_error("%s: %p: %s: %s", + fnc, pgc, pg_call, kill_pg_errmsg_newline(PQerrorMessage(pgc->pgc))); +} + +/*** connection establishment */ +static void add_ready_pgc(struct multi_pgsql_db *, struct multi_pgsql_pgc *); + +static void restart_pgc_connect(struct multi_pgsql_pgc *pgc) +{ + timeout_remove(&pgc->timeout); + start_pgc_connect(pgc); +} + +static void continue_pgc_connect(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + char const *pg_call; + PostgresPollingStatusType status; + int io_dir, rc; + + io_remove(&pgc->io); + the_pgc = pgc->pgc; + + status = PQconnectPoll(the_pgc); + dprintf(("%s: %p: PQconnectPoll returned %d", + __func__, pgc, status)); + + switch (status) { + /* + According to the PostgreSQL source, this is an + unused legacy constant. Here to prevent gcc from + complaining about it. + */ + case PGRES_POLLING_ACTIVE: + case PGRES_POLLING_OK: + rc = PQsetnonblocking(the_pgc, 1); + if (rc == -1) { + pg_call = "PQsetnonblocking"; + goto error; + } + + i_info("%s: %p: connected", __func__, pgc); + add_ready_pgc(pgc->pgdb, pgc); + return; + + case PGRES_POLLING_FAILED: + pg_call = "PQconnectPoll"; + goto error; + + case PGRES_POLLING_READING: + io_dir = IO_READ; + break; + + case PGRES_POLLING_WRITING: + io_dir = IO_WRITE; + } + + pgc->io = io_add(PQsocket(the_pgc), io_dir, continue_pgc_connect, pgc); + return; + +error: + log_pg_error(pgc, __func__, pg_call); + + PQfinish(the_pgc); + pgc->pgc = NULL; + + pgc->timeout = timeout_add(RECONNECT_DELAY, + restart_pgc_connect, pgc); +} + +static void start_pgc_connect(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + + dprintf(("%s: %p", __func__, pgc)); + + pgc->pgc = the_pgc = PQconnectStart(pgc->connect_string); + if (!the_pgc) + i_fatal("%s: %p: out of memory", + __func__, pgc); + + if (PQstatus(the_pgc) == CONNECTION_BAD) { + log_pg_error(pgc, __func__, "PQconnectStart"); + pgc->timeout = timeout_add(RECONNECT_DELAY, + restart_pgc_connect, pgc); + return; + } + + pgc->io = io_add(PQsocket(the_pgc), IO_WRITE, + continue_pgc_connect, pgc); +} + +/*** query processing */ +/**** error handling */ +static void requeue_query_to_pgdb(struct multi_pgsql_query *, struct multi_pgsql_db *); + +static void pgc_query_io_timeout(struct multi_pgsql_pgc *pgc) +{ + i_info("%s: %p", __func__, pgc); + + requeue_query_to_pgdb(pgc->qry, pgc->pgdb); + pgc->qry = NULL; + + reset_pgc(pgc); + start_pgc_connect(pgc); +} + +static void pgc_query_processing_failure(struct multi_pgsql_pgc *pgc, + char const *fnc, + char const *pg_call) +{ + log_pg_error(pgc, fnc, pg_call); + + requeue_query_to_pgdb(pgc->qry, pgc->pgdb); + pgc->qry = NULL; + + reset_pgc(pgc); + start_pgc_connect(pgc); +} + +/**** result processing */ +static void done_with_query(struct multi_pgsql_pgc *pgc) +{ + struct multi_pgsql_query *qry; + + qry = pgc->qry; + pgc->qry = NULL; + + destroy_query(qry); +} + +static inline int got_result(PGconn *pgc) +{ + PGresult *pgr; + + pgr = PQgetResult(pgc); + if (!pgr) return 0; + + PQclear(pgr); + return 1; +} + +static void eat_results(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + PGresult *pgr; + int rc; + + dprintf(("%s: %p", __func__, pgc)); + + the_pgc = pgc->pgc; + do { + rc = PQconsumeInput(the_pgc); + if (rc == 0) { + pgc_query_processing_failure(pgc, __func__, + "PQconsumeInput"); + return; + } + + if (PQisBusy(the_pgc)) { + timeout_reset(pgc->timeout); + return; + } + } while (got_result(the_pgc)); + + io_remove(&pgc->io); + timeout_remove(&pgc->timeout); + + pgr = pgc->pgr; + pgc->pgr = NULL; + query_result(pgc->qry, pgc, &pgr); + if (pgr) PQclear(pgr); + + if (!pgc->qry) add_ready_pgc(pgc->pgdb, pgc); +} + +static void get_first_result(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + PGresult *pgr; + int rc; + + dprintf(("%s: %p", __func__, pgc)); + the_pgc = pgc->pgc; + + rc = PQconsumeInput(the_pgc); + if (rc == 0) { + pgc_query_processing_failure(pgc, __func__, + "PQconsumeInput"); + return; + } + + if (PQisBusy(the_pgc)) { + dprintf(("%s: %p: still busy", __func__, pgc)); + + timeout_reset(pgc->timeout); + return; + } + + io_remove(&pgc->io); + + pgr = pgc->pgr = PQgetResult(the_pgc); + if (pgr) { + pgc->io = io_add(PQsocket(the_pgc), IO_READ, eat_results, pgc); + timeout_reset(pgc->timeout); + + eat_results(pgc); + return; + } else + timeout_remove(&pgc->timeout); + + + query_result(pgc->qry, pgc, NULL); + if (!pgc->qry) add_ready_pgc(pgc->pgdb, pgc); +} + +/**** query transmission */ +static void flush_query(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + int rc; + + dprintf(("%s: %p", __func__, pgc)); + the_pgc = pgc->pgc; + + rc = PQflush(the_pgc); + switch (rc) { + case -1: + pgc_query_processing_failure(pgc, __func__, + "PQflush"); + return; + + case 0: + dprintf(("%s: %p: query sent", __func__, pgc)); + + io_remove(&pgc->io); + pgc->io = io_add(PQsocket(the_pgc), IO_READ, get_first_result, pgc); + } + + timeout_reset(pgc->timeout); +} + +static void start_query_on_pgc(struct multi_pgsql_pgc *pgc) +{ + PGconn *the_pgc; + char const *pg_call, *query; + void (*io_cb)(struct multi_pgsql_pgc *); + int rc, io_dir; + + query = get_query(pgc->qry); + dprintf(("%s: %p: %s", __func__, pgc, query)); + + the_pgc = pgc->pgc; + + rc = PQsendQuery(the_pgc, query); + if (rc == 0) { + pg_call = "PQsendQuery"; + goto error; + } + + rc = PQflush(the_pgc); + switch (rc) { + case -1: + pg_call = "PQflush"; + goto error; + + case 0: + io_cb = get_first_result; + io_dir = IO_READ; + break; + + default: + io_cb = flush_query; + io_dir = IO_WRITE; + } + + pgc->io = io_add(PQsocket(the_pgc), io_dir, io_cb, pgc); + pgc->timeout = timeout_add(PGC_IO_TIMEOUT * TIMEOUT_UNIT, + pgc_query_io_timeout, pgc); + return; + +error: + pgc_query_processing_failure(pgc, __func__, "PQflush"); +} + +static void start_new_query_on_pgc(struct multi_pgsql_query *qry, + struct multi_pgsql_pgc *pgc) +{ + dprintf(("%s: %p -> %p", __func__, qry, pgc)); + + pgc->qry = qry; + start_query_on_pgc(pgc); +} + +/** pgdb */ +struct multi_pgsql_db { + struct sql_db api; + + unsigned n_pgcs; + struct multi_pgsql_pgc *pgcs; + + struct { + struct multi_pgsql_pgc *first, **link_to; + } pgc_q; + + struct { + struct timeout *timeout; + struct multi_pgsql_query *first, **link_to; + } query_q; + + pool_t pool; +}; + +static struct multi_pgsql_query *dequeue_query_from_pgdb(struct multi_pgsql_db *); + +/*** pgc support code */ +static void do_init_pgcs(struct multi_pgsql_db *pgdb, char const *s, unsigned ofs) +{ + char const *r, *lws_start; + unsigned c, semi_count; + + while ((c = *s) && isspace(c)) ++s; + + if (!c) { + if (!ofs) i_fatal("%s: empty connect string", __func__); + + dprintf(("%s: end of connect_string, %u pgcs", + __func__, ofs)); + + pgdb->n_pgcs = ofs; + pgdb->pgcs = p_new(pgdb->pool, struct multi_pgsql_pgc, ofs); + return; + } + + semi_count = 0; + lws_start = NULL; + r = s; + do { + if (c == ';') { + if (++semi_count == 3) break; + continue; + } + + semi_count = 0; + + if (isspace(c)) { + if (!lws_start) lws_start = r; + continue; + } + + lws_start = NULL; + } while ((c = *++r)); + + do_init_pgcs(pgdb, c ? r + 1 : r, ofs + 1); + + if (lws_start) r = lws_start; + else if (c) r -= 2; + + init_pgc(pgdb->pgcs + ofs, pgdb, p_strndup(pgdb->pool, s, r - s)); +} + +static inline void init_pgcs(struct multi_pgsql_db *pgdb, char const *connect_string) +{ + do_init_pgcs(pgdb, connect_string, 0); +} + +static void add_ready_pgc(struct multi_pgsql_db *pgdb, struct multi_pgsql_pgc *pgc) +{ + struct multi_pgsql_query *qry; + + if (!pgdb->pgc_q.first) { + qry = dequeue_query_from_pgdb(pgdb); + + if (qry) { + start_query(qry, pgc); + return; + } + } + + *pgdb->pgc_q.link_to = pgc; + pgdb->pgc_q.link_to = &pgc->p; + + dprintf(("%s: %p -> %p", __func__, pgc, pgdb)); +} + +static struct multi_pgsql_pgc *get_ready_pgc(struct multi_pgsql_db *pgdb) +{ + struct multi_pgsql_pgc *pgc, *next_pgc; + + pgc = pgdb->pgc_q.first; + if (!pgc) return NULL; + + next_pgc = pgc->p; + if (next_pgc) pgc->p = NULL; + else pgdb->pgc_q.link_to = &pgdb->pgc_q.first; + pgdb->pgc_q.first = next_pgc; + + dprintf(("%s: %p -> %p", __func__, pgdb, pgc)); + return pgc; +} + +static void switch_pgdb_pgcs(struct multi_pgsql_db *pgdb) +{ + struct multi_pgsql_pgc *pgcs; + unsigned n; + + pgcs = pgdb->pgcs; + n = pgdb->n_pgcs; + do pgc_ioloop_switch(pgcs + --n); while (n); +} + +/*** query timeout */ +static void start_pgdb_query_timeout(struct multi_pgsql_db *, + struct multi_pgsql_query *); + +static void pgdb_query_timeout(struct multi_pgsql_db *pgdb) +{ + struct multi_pgsql_query *qry, *next_qry; + struct multi_pgsql_error_result timeout; + time_t now; + + dprintf(("%s: %p", __func__, pgdb)); + + timeout_remove(&pgdb->query_q.timeout); + qry = pgdb->query_q.first; + now = time(NULL); + init_error_result(&timeout, TIMEOUT_ERROR); + do { + next_qry = qry->p; + abort_query(qry, &timeout.api); + } while (next_qry && now > query_eol(next_qry)); + + pgdb->query_q.first = next_qry; + + if (next_qry) { + start_pgdb_query_timeout(pgdb, next_qry); + return; + } + + pgdb->query_q.link_to = &pgdb->query_q.first; +} + +static void start_pgdb_query_timeout(struct multi_pgsql_db *pgdb, + struct multi_pgsql_query *qry) +{ + time_t now, timeout, eol; + + now = time(NULL); + eol = query_eol(qry); + timeout = now < eol ? eol - now : 0; + if (timeout < MIN_QUERY_TIMEOUT) timeout = MIN_QUERY_TIMEOUT; + + pgdb->query_q.timeout = timeout_add(timeout * TIMEOUT_UNIT, + pgdb_query_timeout, pgdb); + dprintf(("%s: %p: timeout in %us", __func__, pgdb, (unsigned)timeout)); +} + +/*** query queueing */ +static void queue_query_to_pgdb(struct multi_pgsql_query *qry, struct multi_pgsql_db *pgdb) +{ + if (!pgdb->query_q.first) start_pgdb_query_timeout(pgdb, qry); + + *pgdb->query_q.link_to = qry; + pgdb->query_q.link_to = &qry->p; +} + +static struct multi_pgsql_query *dequeue_query_from_pgdb(struct multi_pgsql_db *pgdb) +{ + struct multi_pgsql_query *qry, *next_qry; + + qry = pgdb->query_q.first; + if (!qry) return NULL; + + timeout_remove(&pgdb->query_q.timeout); + + next_qry = qry->p; + if (next_qry) start_pgdb_query_timeout(pgdb, next_qry); + else pgdb->query_q.link_to = &pgdb->query_q.first; + pgdb->query_q.first = next_qry; + + qry->p = NULL; + return qry; +} + +static void requeue_query_to_pgdb(struct multi_pgsql_query *qry, + struct multi_pgsql_db *pgdb) +{ + struct multi_pgsql_error_result timeout; + struct multi_pgsql_pgc *pgc; + + if (time(NULL) >= query_eol(qry)) { + init_error_result(&timeout, TIMEOUT_ERROR); + abort_query(qry, &timeout.api); + return; + } + + pgc = get_ready_pgc(pgdb); + if (pgc) { + start_query(qry, pgc); + return; + } + + if (pgdb->query_q.timeout) { + timeout_remove(&pgdb->query_q.timeout); + qry->p = pgdb->query_q.first; + } else + pgdb->query_q.link_to = &qry->p; + + pgdb->query_q.first = qry; + start_pgdb_query_timeout(pgdb, qry); +} + + +/*** query submission */ +static void pgdb_async_query(struct multi_pgsql_db *pgdb, + struct multi_pgsql_query *qry) +{ + struct multi_pgsql_pgc *pgc; + + dprintf(("%s: %p: %p", __func__, pgdb, qry)); + + pgc = get_ready_pgc(pgdb); + if (pgc) { + start_query(qry, pgc); + return; + } + + dprintf(("%s: %p: no pgcs ready, queueing", __func__, pgdb)); + queue_query_to_pgdb(qry, pgdb); +} + + +static void pgdb_sync_query(struct multi_pgsql_db *pgdb, + struct multi_pgsql_query *qry) +{ + struct ioloop *old_ioloop, *sync_ioloop; + + dprintf(("%s: %p: %p", __func__, pgdb, qry)); + + old_ioloop = current_ioloop; + sync_ioloop = io_loop_create(); + switch_pgdb_pgcs(pgdb); + + set_query_sync_ioloop(qry, sync_ioloop); + pgdb_async_query(pgdb, qry); + + io_loop_run(sync_ioloop); + + io_loop_set_current(old_ioloop); + switch_pgdb_pgcs(pgdb); + io_loop_set_current(sync_ioloop); + io_loop_destroy(&sync_ioloop); +} + +/*** non-transaction SQL driver methods */ +extern struct sql_db driver_multi_pgsql_db; + +static struct sql_db *multi_pgsql_init_v(char const *connect_string) +{ + struct multi_pgsql_db *pgdb; + pool_t pool; + + dprintf(("%s: %s", __func__, connect_string)); + + pool = pool_alloconly_create("multi_pgsql_pool", MULTI_PGSQL_POOL); + + pgdb = p_new(pool, struct multi_pgsql_db, 1); + pgdb->api = driver_multi_pgsql_db; + pgdb->pool = pool; + + pgdb->query_q.link_to = &pgdb->query_q.first; + pgdb->pgc_q.link_to = &pgdb->pgc_q.first; + + init_pgcs(pgdb, connect_string); + return (void *)pgdb; +} + +static void multi_pgsql_deinit_v(struct sql_db *db) +{ + struct multi_pgsql_error_result deinit; + struct multi_pgsql_db *pgdb; + struct multi_pgsql_pgc *pgc; + struct multi_pgsql_query *qry, *next_qry; + pool_t pool; + unsigned n; + + dprintf(("%s: %p", __func__, db)); + + array_free(&db->module_contexts); + + pgdb = (void *)db; + init_error_result(&deinit, DEINIT_ERROR); + + n = pgdb->n_pgcs; + do { + pgc = pgdb->pgcs + --n; + + qry = pgc->qry; + if (qry) abort_query(qry, &deinit.api); + + reset_pgc(pgc); + + } while (n); + + qry = pgdb->query_q.first; + if (qry) { + timeout_remove(&pgdb->query_q.timeout); + + do { + next_qry = qry->p; + abort_query(qry, &deinit.api); + } while ((qry = next_qry)); + } + + pool = pgdb->pool; + pool_unref(&pool); +} + +static int multi_pgsql_connect(struct sql_db *db) +{ + dprintf(("%s: %p", __func__, db)); + return 1; +} + +static enum sql_db_flags +multi_pgsql_get_flags(struct sql_db *db) +{ + dprintf(("%s: %p", __func__, db)); + return 0; +} + +static const char * +multi_pgsql_escape_string(struct sql_db *db, const char *in) +{ + struct multi_pgsql_db *pgdb; + char *out; + size_t len; + + pgdb = (void *)db; + len = strlen(in); + out = t_buffer_get(len * 2 + 1); + len = PQescapeStringConn(pgdb->pgcs->pgc, out, in, len, + NULL); + t_buffer_alloc(len + 1); + + dprintf(("%s: %p: '%s' -> '%s'", + __func__, pgdb, in, out)); + return out; +} + +static void multi_pgsql_query(struct sql_db *db, const char *query, + sql_query_callback_t *cb, void *ctx) +{ + struct multi_pgsql_query *qry; + + dprintf(("%s: %p: %s", __func__, db, query)); + + qry = create_user_query(query, cb, ctx); + pgdb_async_query((void *)db, qry); +} + +static void multi_pgsql_exec(struct sql_db *db, const char *query) +{ + i_info("%s: %p: %s", __func__, db, query); + i_info("%s: not implemented", __func__); +} + +static struct sql_result * +multi_pgsql_query_s(struct sql_db *db, const char *query) +{ + struct multi_pgsql_db *pgdb; + struct multi_pgsql_sync_query sync_qry; + + pgdb = (void *)db; + dprintf(("%s: %p: %s", __func__, pgdb, query)); + + init_sync_query(&sync_qry, query); + pgdb_sync_query(pgdb, (void *)&sync_qry); + return result_from_sync_query(&sync_qry); +} + +/*** transaction support code */ +static void add_subquery_to(struct multi_pgsql_transaction_context *x_ctx, + char const *query, unsigned *affected_rows) + +{ + struct multi_pgsql_transaction_subquery *sub; + pool_t pool; + + pool = x_ctx->pool; + + sub = p_new(pool, struct multi_pgsql_transaction_subquery, 1); + sub->query = p_strdup(pool, query); + sub->affected_rows = affected_rows; + + *x_ctx->link_to = sub; + x_ctx->link_to = &sub->p; + + dprintf(("%s: %p: '%s'", __func__, x_ctx, query)); +} + +static struct sql_transaction_context * +multi_pgsql_transaction_begin(struct sql_db *db) +{ + struct multi_pgsql_transaction_context *x_ctx; + pool_t pool; + + pool = pool_alloconly_create("multi_pgsql_xact_pool", + MULTI_PGSQL_XACT_POOL); + x_ctx = p_new(pool, struct multi_pgsql_transaction_context, 1); + x_ctx->super.db = db; + x_ctx->link_to = &x_ctx->first; + x_ctx->pool = pool; + + add_subquery_to(x_ctx, "begin", NULL); + + dprintf(("%s: db %p: %p", __func__, db, x_ctx)); + return (void *)x_ctx; +} + +static void +multi_pgsql_transaction_commit(struct sql_transaction_context *ctx, + sql_commit_callback_t *cb, void *cb_ctx) +{ + struct multi_pgsql_transaction_context *x_ctx; + struct multi_pgsql_async_transaction_query *qry; + + x_ctx = (void *)ctx; + dprintf(("%s: %p", __func__, x_ctx)); + + add_subquery_to(x_ctx, "commit", NULL); + + qry = p_new(x_ctx->pool, struct multi_pgsql_async_transaction_query, 1); + init_async_transaction_query(qry, x_ctx, cb, cb_ctx); + pgdb_async_query((void *)ctx->db, (void *)qry); +} + +static int +multi_pgsql_transaction_commit_s(struct sql_transaction_context *ctx, + const char **error_r) +{ + struct multi_pgsql_transaction_context *x_ctx; + struct multi_pgsql_sync_transaction_query sync_qry; + char *errmsg; + + x_ctx = (void *)ctx; + dprintf(("%s: %p", __func__, x_ctx)); + + add_subquery_to(x_ctx, "commit", NULL); + + init_sync_transaction_query(&sync_qry, x_ctx); + pgdb_sync_query((void *)x_ctx->super.db, &sync_qry.super.super); + + errmsg = (char *)sync_qry.errmsg; + if (errmsg) { + *error_r = t_strdup(errmsg); + i_free(errmsg); + + return -1; + } + + return 0; +} + +static void +multi_pgsql_transaction_rollback(struct sql_transaction_context *ctx) +{ + struct multi_pgsql_transaction_context *x_ctx; + + x_ctx = (void *)ctx; + dprintf(("%s: %p", __func__, x_ctx)); + + pool_unref(&x_ctx->pool); +} + +static void +multi_pgsql_transaction_update(struct sql_transaction_context *ctx, const char *query, + unsigned int *affected_rows) +{ + struct multi_pgsql_transaction_context *x_ctx; + + x_ctx = (void *)ctx; + add_subquery_to(x_ctx, query, affected_rows); +} + +/*** db driver vtable */ +struct sql_db driver_multi_pgsql_db = { + "multi-pgsql", + + MEMBER(v) { + multi_pgsql_init_v, + multi_pgsql_deinit_v, + multi_pgsql_get_flags, + multi_pgsql_connect, + multi_pgsql_escape_string, + multi_pgsql_exec, + multi_pgsql_query, + multi_pgsql_query_s, + + multi_pgsql_transaction_begin, + multi_pgsql_transaction_commit, + multi_pgsql_transaction_commit_s, + multi_pgsql_transaction_rollback, + multi_pgsql_transaction_update + } +}; +#endif

3 4

[Dovecot] windows live mail + dovecot and nfs
by Anes Muhametov 17 Apr '10

17 Apr '10

Hi all. My clients have got problem accessing dovecot by "Windows live mail (Windows 7)" client. The problem is that users can't delete two or more folders one-by-one. There is no errors deleting first folder (new dir /storage/vol1/mail/domain/user/Maildir/..DOVECOT-TRASHED appeared and wasn't deleted). If I try to delete second one, error occurs (user, domain, IP address changed): dovecot: IMAP(user@domain): unlink_directory(/storage/vol1/mail/domain/user/Maildir/..DOVECOT-TRASHED) failed: Directory not empty I'm using dovecot 1.2.10 @FreeBSD 7.2-RELEASE-p1 amd64 and NFS storage backend. dovecot -n # 1.2.10: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.2-RELEASE-p1 amd64 syslog_facility: local7 protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/1.crt ssl_key_file: /etc/ssl/1.key.unsec disable_plaintext_auth: no verbose_ssl: yes shutdown_clients: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: mail server ready. login_process_per_connection: no login_process_size: 512 login_processes_count: 60 login_max_processes_count: 256 login_max_connections: 100 max_mail_processes: 4096 mail_max_userip_connections(default): 50 mail_max_userip_connections(imap): 50 mail_max_userip_connections(pop3): 30 verbose_proctitle: yes first_valid_uid: 90 last_valid_uid: 90 first_valid_gid: 90 last_valid_gid: 90 mail_privileged_group: mail mail_location: maildir:%h/Maildir mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock maildir_copy_preserve_filename: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_process_size: 128 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh lda: postmaster_address: postmaster(a)domain.ru mail_plugins: quota sendmail_path: /usr/sbin/sendmail log_path: /var/log/dovecot/deliver.log info_log_path: /var/log/dovecot/deliver.log auth default: mechanisms: plain login cram-md5 cache_size: 262144 cache_ttl: 180 cache_negative_ttl: 60 failure_delay: 1 worker_max_count: 2000 process_size: 512 passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: user group: domain plugin: quota: maildir:Quota Here is listing of ..DOVECOT-TRASHED: ls -la /storage/vol1/mail/domain/user/Maildir/..DOVECOT-TRASHED: total 16 drwx------ 2 user user 4096 Apr 9 11:32 . drwx------ 27 user user 8192 Apr 9 11:41 .. -rw------- 1 user user 156 Apr 9 11:32 .nfs.014cd02e.ffffd11b4.4 -rw------- 1 user user 17 Apr 9 11:32 .nfs.014cd031.ffffd11b4.4 fstat output: [root@ /storage/vol1/mail/domain/user/Maildir/..DOVECOT-TRASHED]# fstat .* USER CMD PID FD MOUNT INUM MODE SZ|DV R/W NAME root fstat 82081 wd /storage/vol1 32454159 drwx------ 4096 r . user imap 53042 7 /storage/vol1 40573622 -rw------- 156 rw .nfs.014cd02e.ffffd11b4.4 user imap 53042 9 /storage/vol1 40573631 -rw------- 17 rw .nfs.014cd031.ffffd11b4.4 root bash 22223 wd /storage/vol1 32454159 drwx------ 4096 r . # ps uxwa|grep user user 53042 0.0 0.1 9812 2400 ?? S 11:31AM 0:00.02 imap [user@domain 1.1.1.1] user 53650 0.0 0.1 10836 2908 ?? S 11:32AM 0:00.05 imap [user@domain 1.1.1.1] It seems like first imap process locked ..DOVECOT-TRASHED. Best regards Anes Muhametoc.

2 2

[Dovecot] get the messages ID after APPEND
by Christian Fischer 17 Apr '10

17 Apr '10

Hi there! I am new to imap "Command Line" and trying to write a script doing the following on a dovecot imap server: - APPEND a message (e.g. to Drafts) - get the ID to reopen the message for reading In short: How do i get the ID back from the APPEND command or which command has to be invoked to get the uid of the newly added message? Thank you! Christian ----------------- dovecot --version 1.0.15 dovecot -n # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S ssl_cert_file: /etc/postfix/tls/mail.cert ssl_key_file: /etc/postfix/tls/mail.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail mail_location: maildir:%h/.EMAIL auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix

3 3

[Dovecot] mysql log entry
by Terry Barnum 17 Apr '10

17 Apr '10

I'm sure this is a really newbie question, but I notice in /var/log/mail.log that there are between 3 and 15 of the following log entries every day for the last five days, which is far back as my logs go--what do they mean? Apr xx hh:mm:ss mail dovecot[109]: auth-worker(default): mysql: Connected to localhost (postfix) Is it dovecot connecting to mysql for password or user info? If so, wouldn't it be more frequent? I've got 20 users with some connecting from outside many times per day. Thanks, -Terry

2 2

[Dovecot] Problems with masteruser
by Неворотин Вадим 16 Apr '10

16 Apr '10

I have very strange problem with masteruser. See two logs below: # telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Welcome to our post server! x login nevorotin password x OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk] Logged in x list "" "*" * LIST (\HasNoChildren) "/" "INBOX" x OK List completed. x getacl INBOX * ACL "INBOX" "nevorotin" lrwstipekxacd x OK Getacl completed. All work perfectly. And then I log in throw masteruser: # telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Welcome to our post server! x login nevorotin*master masterpassword x OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk] Logged in x list "" "*" * LIST (\Unmarked) "/" "INBOX" x OK List completed. x getacl INBOX x NO [NONEXISTENT] Mailbox doesn't exist: INBOX I've turned on debug logging, but there aren't any errors. I only see that masteruser succesfully logged in as nevorotin. How can I make a masteruser login to user account exactly the same as simple user login? Now it don't work at all [?] I use 1.2.10 version of dovecot.

3 10

Re: [Dovecot] zlib Plugin Dovecot 2.0
by Alex Baule 16 Apr '10

16 Apr '10

Hi Paschal You do not understand what I want. I developed a plugin based on the zlib plugin, but want to port it to dovecot 2.0. There are some differences in the 2.0 plugin, which I did not quite understand how it works for me to readjust it in my plugin. As in the source code there are not many comments, I do not quite know what each function does, if they are all necessary in my adaptation. In developing the plugin in version 1.4, Timo helped me a lot. What I need to know is how the hooks on write emails do this, and what the differences in the read function, since the code is different from version 1.4 to 2.0.

2 6

[Dovecot] 2.0beta4 and latest Mercurial: Folder not SELECT-able until LIST-ed
by B. Johannessen 16 Apr '10

16 Apr '10

Have a look at the attached dialog. It shows the folder "shared/a(a)db.org/Archive" not being SELECT-able until after it's been mentioned in a LIST response. This can't possibly be right, can it? Bob

2 4

[Dovecot] flags, keywords in a shared mailbox setup
by Thomas Hummel 16 Apr '10

16 Apr '10

Hello Timo, I'm trying to get a clear understanding of dovecot's (1.2.x) flags and keywords sharing possibilities or impossibilities in a shared-mailboxes setup. By definition, a shared mailbox is a mailbox from a personal namespace which has been made available to someone else who sees it in a shared namespace. There can be some combinatorics according to the fact that INDEX and CONTROL files location can either be user-dependent or user-independent and this in either the private or the shared namespace. Besides, it's not clear to me if the 'dovecot-shared' file is still relevant in 1.2x and shared-namespaces to store flags only in indexes. So what combination is to be avoided because it would break things ? More specifically : . is, in 1.2x, the method for having private flags of a shared mailbox still to have the 'dovecot-shared' file (in order to store flags in indexes) ? . how can shared keywords in a shared mailbox even work ? If they're shared (how ? by pointing CONTROL to the same user-independent location ?), keywords known by a client (user1) won't necessary be known or have the same meaning for another client (user2), will they ? [Note : isn't it the same event with no shared mailboxes but with one user using several clients ?] But, if they're private, they have to be stored outside the filename : how can we do that ? Thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

2 3

[Dovecot] dovecot-auth question
by rmcgraw＠math.purdue.edu 16 Apr '10

16 Apr '10

/export/rpoolbackup# dovecot -n # 1.2.10: /local/etc/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 768). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: SunOS 5.10 i86pc protocols: imaps pop3s ssl_cert_file: /local/ssl/certs/dovecot-cert.pem ssl_key_file: /local/ssl/private/dovecot-key.pem verbose_ssl: yes login_dir: /local/var/run/dovecot/login login_executable(default): /local/libexec/dovecot/imap-login login_executable(imap): /local/libexec/dovecot/imap-login login_executable(pop3): /local/libexec/dovecot/pop3-login first_valid_uid: 101 mail_location: mbox:~/mail:INBOX=/var/mail/%u mail_executable(default): /local/libexec/dovecot/imap mail_executable(imap): /local/libexec/dovecot/imap mail_executable(pop3): /local/libexec/dovecot/pop3 mail_plugin_dir(default): /local/lib/dovecot/imap mail_plugin_dir(imap): /local/lib/dovecot/imap mail_plugin_dir(pop3): /local/lib/dovecot/pop3 auth default: verbose: yes debug: yes passdb: driver: pam userdb: driver: passwd ----- We recently moved to dovecot and after few little configuration problem our dovecot seems to be running without problems for the most part, but I am seeing the following error in /var/adm/messages about ever 3 minutes. Apr 5 09:13:23 gauss.math.purdue.edu dovecot-auth[14359]: [ID 293258 user.error] libsldap: Status: 49 Mesg: openConnection: simple bind failed - Invalid credentials I would like to try and find out what user connection is causing this message. I have turned on most of the verbose logging but I cannot see anything in any logs that might give me the information. Can someone give me guidance on how I can track this down. Thanks Robert _____________________________________________________________________ Robert P. McGraw, Jr. Manager, Computer System EMAIL: rmcgraw(a)purdue.edu Purdue University ROOM: MATH-807 Department of Mathematics PHONE: (765) 494-6055 150 N. University Street West Lafayette, IN 47907-2067

2 1

[Dovecot] dovecot 1.2.11 + virtual plugin + deliver
by Stef Simoens 16 Apr '10

16 Apr '10

Hello List and Timo, I configured the virtual mailboxes which are really nice. To create the virtual-folder, I made a postlogin-script as described in the wiki. However, as my mail is delivered by dovecot's deliver ... I'm getting errors for people not yet logged in... Namespace 'virtual.': virtual : Root mail directory doesn't exist: /var/vmail/domain.org/username/virtual I tried removing the virtual-plugin from the protocol lda-section; and putting the namespace only in the protocol imap-section; but then the error becomes Namespace 'virtual.': Unknown mail storage driver virtual After an IMAP login (thanks to the postlogin-script) the virtual folder is created. However, I would prefer that mails to existing users and new users works even before they logged-in (and before the postlogin-script creates the virtual folder). Any help? Greetings, -- Stef Simoens

3 3

[Dovecot] Per-user flags for shared folders
by Неворотин Вадим 16 Apr '10

16 Apr '10

As I see in 2.0 there willn't be ability to control which flags should be shared, and which should be per-user. But may be there is some plans to implement settings to control that? It'll be great if you can write in dovecot-shared file which flags should be per-user. It's very usefull for group mailboxes, when each user should work with such mailbox like with their own. Now I can't add permission for delete on group mailbox for anybody, because if somebody delete a message, it dissapear for other users of group mailbox. So my group mailboxes look like a big scrapyard[?] I can compile from sources and add also \Deleted flag to private flags, but it's not an elegant solution[?] And my idea is easy to implement :) Only add here: 305 shared_path = t_strconcat(box->path, "/dovecot-shared", NULL); 306 if (stat(shared_path, &st) == 0) 307 box->private_flags_mask = MAIL_SEEN; in maildir-storage.c some code for reading a mask from dovecot-shared file. Unfortunatelly I'm not a good programmer, so I can't make a patch myself(((

2 1

[Dovecot] 2.0beta4 doesn't respond to DONE after untagged FETCH during IDLE
by Daniel I. Applebaum 16 Apr '10

16 Apr '10

Using K-9 Mail to IDLE on a test folder "MyIncTmp". When there is a flag change on a message in the folder, which generates an untagged FETCH, K-9 Mail responds with a DONE, but dovecot does not exit IDLE state (LOG 1). However, if a new message is delivered, generating an untagged EXISTS, K-9 Mail responds the same way, with a DONE, and dovecot does exit IDLE state. (LOG 2) You can also see in LOG 1 that the "OK Still here" continues to be sent, corroborating that dovecot is still in IDLE state. I hope this information is helpful. Sincerely, Dan. LOG 1: failure to exit IDLE after untagged FETCH 04-16 08:25:48.911: VERBOSE/k9(10160): Sending IMAP command IDLE on connection conn1127686952 04-16 08:25:48.921: VERBOSE/k9(10160): conn1127686952>>> 13 IDLE 04-16 08:25:48.921: VERBOSE/k9(10160): Sent IMAP command IDLE with tag 13 for conn1127686952 04-16 08:25:49.191: VERBOSE/k9(10160): <<< #+# [idling] 04-16 08:25:49.201: VERBOSE/k9(10160): conn1127686952<<<#+# [idling] 04-16 08:25:49.201: VERBOSE/k9(10160): Got async response: #+# [idling] 04-16 08:25:49.201: DEBUG/k9(10160): Idling dantest:MyIncTmp/Thread-24/conn1127686952 04-16 08:25:49.201: DEBUG/k9(10160): Considering releasing WakeLock for Pushing 04-16 08:25:49.201: DEBUG/k9(10160): Releasing WakeLock for Pushing for thread Thread-24 04-16 08:25:54.491: VERBOSE/k9(10160): <<< #null# [16, FETCH, [FLAGS, [\Seen, \Recent]]] 04-16 08:25:54.491: VERBOSE/k9(10160): conn1127686952<<<#null# [16, FETCH, [FLAGS, [\Seen, \Recent]]] 04-16 08:25:54.491: VERBOSE/k9(10160): Got async response: #null# [16, FETCH, [FLAGS, [\Seen, \Recent]]] 04-16 08:25:54.501: DEBUG/k9(10160): Acquired WakeLock for Pushing for thread Thread-24 04-16 08:25:54.501: DEBUG/k9(10160): Got useful async untagged response: #null# [16, FETCH, [FLAGS, [\Seen, \Recent]]] for dantest:MyIncTmp/Thread-24/conn1127686952 04-16 08:25:54.501: VERBOSE/k9(10160): conn1127686952>>> DONE 04-16 08:26:54.571: DEBUG/k9(10160): Acquired WakeLock for Pushing for thread Thread-24 04-16 08:26:54.581: ERROR/k9(10160): Error 'Read timed out' 04-16 08:26:54.581: ERROR/k9(10160): java.net.SocketTimeoutException: Read timed out 04-16 08:27:00.141: VERBOSE/k9(10160): Sending IMAP command NOOP on connection conn1127686952 04-16 08:27:00.141: VERBOSE/k9(10160): conn1127686952>>> 14 NOOP 04-16 08:27:00.141: VERBOSE/k9(10160): Sent IMAP command NOOP with tag 14 for conn1127686952 04-16 08:27:26.651: VERBOSE/k9(10160): conn1127686952<<<#null# [OK, Still, here] LOG 2: successful exit from IDLE after untagged EXISTS 04-16 08:28:35.271: INFO/k9(10160): About to IDLE for dantest:MyIncTmp/Thread-24/conn1126759992 04-16 08:28:35.271: VERBOSE/k9(10160): Sending IMAP command IDLE on connection conn1126759992 04-16 08:28:35.281: VERBOSE/k9(10160): conn1126759992>>> 10 IDLE 04-16 08:28:35.281: VERBOSE/k9(10160): Sent IMAP command IDLE with tag 10 for conn1126759992 04-16 08:28:35.531: VERBOSE/k9(10160): <<< #+# [idling] 04-16 08:28:35.531: VERBOSE/k9(10160): conn1126759992<<<#+# [idling] 04-16 08:28:35.531: VERBOSE/k9(10160): Got async response: #+# [idling] 04-16 08:28:35.531: DEBUG/k9(10160): Idling dantest:MyIncTmp/Thread-24/conn1126759992 04-16 08:28:35.531: DEBUG/k9(10160): Considering releasing WakeLock for Pushing 04-16 08:28:35.531: DEBUG/k9(10160): Releasing WakeLock for Pushing for thread Thread-24 04-16 08:28:51.621: VERBOSE/k9(10160): <<< #null# [18, EXISTS] 04-16 08:28:51.621: VERBOSE/k9(10160): conn1126759992<<<#null# [18, EXISTS] 04-16 08:28:51.621: VERBOSE/k9(10160): Got async response: #null# [18, EXISTS] 04-16 08:28:51.621: DEBUG/k9(10160): Acquired WakeLock for Pushing for thread Thread-24 04-16 08:28:51.631: DEBUG/k9(10160): Got useful async untagged response: #null# [18, EXISTS] for dantest:MyIncTmp/Thread-24/conn1126759992 04-16 08:28:51.631: VERBOSE/k9(10160): conn1126759992>>> DONE 04-16 08:28:51.631: VERBOSE/k9(10160): <<< #null# [1, RECENT] 04-16 08:28:51.631: VERBOSE/k9(10160): conn1126759992<<<#null# [1, RECENT] 04-16 08:28:51.631: VERBOSE/k9(10160): Got async response: #null# [1, RECENT] 04-16 08:28:51.901: VERBOSE/k9(10160): <<< #10# [OK, Idle, completed.] 04-16 08:28:51.901: VERBOSE/k9(10160): conn1126759992<<<#10# [OK, Idle, completed.] 04-16 08:28:51.901: VERBOSE/k9(10160): Got async response: #10# [OK, Idle, completed.]

2 2

[Dovecot] Dovecot 2.0 beta 4 errors reported
by Ken A 16 Apr '10

16 Apr '10

Timo, Thank you for an amazing imap/pop server. I'm using Dovecot 2.0 beta 4 and mbox storage, and have encountered a couple of errors worth reporting: ------ 1. When I delete a parent folder that contains sub folders, I get this error message pop up in Thunderbird 3.04: > "The current command did not succeed. The mail server responded: > [CANNOT] Mailbox GUIDs are not permanent without index files." But, the folders are deleted properly, and no error is logged on the server. I have the mail_log plugin currently enabled like so: > mail_plugins = quota mail_log notify > mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename > mail_log_fields = uid box msgid size ------ 2. segfault reported in the system log (unrelated to the error above): > kernel: pop3[6794]: segfault at 0000000000000028 rip 0000000000403489 > rsp 00007fff20a24a20 error 4 ------ Thanks, Ken -- Ken Anderson Pacific Internet - http://www.pacific.net

2 1

[Dovecot] 2.0.beta4 "OK Still here" not flushed?
by Daniel I. Applebaum 16 Apr '10

16 Apr '10

Hello, everybody! I've noticed that my installation of K-9 Mail on Android has been consuming a lot of battery power recently. I've been running it connecting to 2.0.beta3 for the past few weeks and just upgraded to 2.0.beta4 while debugging this issue. There is a conspicuous lack of "OK Still here" messages in my IDLE connections. The lack of these "OK Still here" messages means that the idling connections get dropped very frequently, which causes K-9 Mail to expend much more effort than just receiving the periodic "OK Still here" and going back to sleep. The "OK Still here" messages sometimes arrive, however, just before an untagged FETCH, however. I do not know anything about dovecot internals, but I suspected that the "OK Still here" messages were not being flushed, so I modified line 270 of src/imap/imap-client.c to be: if (1 || o_stream_get_buffer_used_size(client->output) >= which I am sure is the wrong solution, since it forces a flush for every output line and would be quite inefficient. However, with that modification, the "OK Still here" messages appear reliably. Hopefully, there is a way to specifically flush just the "OK Still here" messages appropriately. I'd be happy to test any real solutions to this issue. Sincerely, Dan.

2 2

[Dovecot] Dovecot 2.0b4 configuration issue, listen config option?
by Brandon Lamb 16 Apr '10

16 Apr '10

Hi, In my 1.2 setup I have pop3 running on ip x.x.x.2 and imap on x.x.x.7 In 2.0 how do I say listen x.x.x.2:110 x.x.x.7:143 so that pop3 is not listening on the .7 ip? I tried putting a listen = ip in the listener section but it complained. I cant figure it out and cant seem to find any 2.0 specific documentation, trying to search in the wiki directory of /usr/local/share/doc/dovecot/wiki but so far no help. I realize I can firewall that off but I dont want to rely on that. Is this no longer possible?

3 9

[Dovecot] Thunderbird subscription bug ?
by Thomas Hummel 16 Apr '10

16 Apr '10

Hello Timo, I'm having a hard time trying to understand why Thunderbird 3.0.3 doesn't allow me to subscribe to a shared mailbox which I can subscribe to via Kmail for instance. I'm running dovecot-1.2.11/Maildir. The user 'doveimap' shares his mailbox folder/subfolder to the 'dovepop' user which should see it in the '#shared' shared namespace at the following "location" : #shared/doveimap/folder/subfolder ACL (and unix permissions) are ok : # cat /courriel/boites/doveimap/.folder.subfolder/dovecot-acl user=dovepop akxeilprwts rawlogs give : a) kmail case : in : 4 NAMESPACE 5 LIST "" "" 6 LSUB "" "%" 7 LIST "" "%" 8 LSUB "" "#shared/%" 9 LIST "" "#shared/%" 10 LIST "" "INBOX" 11 SELECT "INBOX" 12 NOOP 13 UID FETCH 1:* (UID FLAGS) 14 UID FETCH 1:2 (UID RFC822.SIZE FLAGS ENVELOPE BODY.PEEK[HEADER.FIELDS (REFERENCES)]) 15 LIST "" "*" 16 LIST "" "#shared/*" 17 LSUB "" "*" 18 LSUB "" "#shared/*" 19 LIST "" "#shared/doveimap/folder/subfolder" 20 SUBSCRIBE "#shared/doveimap/folder/subfolder" out : * NAMESPACE (("" "/")) (("#shared/" "/")) NIL 4 OK Namespace completed. * LIST (\Noselect) "/" "" 5 OK List completed. 6 OK Lsub completed. * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasChildren) "/" "#shared" 7 OK List completed. 8 OK Lsub completed. * LIST (\Noselect \HasChildren) "/" "#shared/doveimap" 9 OK List completed. * LIST (\HasNoChildren) "/" "INBOX" 10 OK List completed. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 2 EXISTS * 0 RECENT * OK [UIDVALIDITY 1270130617] UIDs valid * OK [UIDNEXT 3] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest 11 OK [READ-WRITE] Select completed. 12 OK NOOP completed. * 1 FETCH (UID 1 FLAGS (\Seen)) * 2 FETCH (UID 2 FLAGS (\Seen)) 13 OK Fetch completed. * 1 FETCH (UID 1 RFC822.SIZE 1140 FLAGS (\Seen) ENVELOPE [...] * 2 FETCH (UID 2 RFC822.SIZE 1138 FLAGS (\Seen) ENVELOPE [...] 14 OK Fetch completed. * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasChildren) "/" "#shared/doveimap" * LIST (\HasNoChildren) "/" "#shared/doveimap/folder/subfolder" 15 OK List completed. * LIST (\Noselect \HasChildren) "/" "#shared/doveimap" * LIST (\HasNoChildren) "/" "#shared/doveimap/folder/subfolder" 16 OK List completed. 17 OK Lsub completed. 18 OK Lsub completed. * LIST (\HasNoChildren) "/" "#shared/doveimap/folder/subfolder" 19 OK List completed. 20 OK Subscribe completed. b) Thunderbird case : in : 4 namespace 5 ENABLE CONDSTORE 6 lsub "" "*" 7 lsub "" "#shared/*" 8 list "" "INBOX" 9 list "" "Trash" 10 create "Trash" 11 select "INBOX" (CONDSTORE) 12 myrights "INBOX" 13 getacl "INBOX" 14 UID fetch 1:* (FLAGS) 15 UID fetch 1:2 (UID RFC822.SIZE FLAGS BODY.PEEK[HEADER.FIELDS (From To Cc Bcc Subject Date Message-ID Priority X-Priority References Newsgroups In-Reply-To Content-Type)]) 16 UID fetch 1,2 (UID RFC822.SIZE BODY.PEEK[]) 17 IDLE DONE 18 lsub "" "*" 19 list "" "%" 20 list "" "%/%" 21 lsub "" "#shared/*" 22 list "" "#shared/%" 23 list "" "#shared/%/%" 24 IDLE DONE 25 list "" "#shared/#shared/%" 26 list "" "#shared/#shared/%/%" 27 IDLE DONE 28 noop 29 IDLE DONE out : * NAMESPACE (("" "/")) (("#shared/" "/")) NIL 4 OK Namespace completed. * ENABLED CONDSTORE 5 OK Enabled. 6 OK Lsub completed. 7 OK Lsub completed. * LIST (\HasNoChildren) "/" "INBOX" 8 OK List completed. * LIST (\HasNoChildren) "/" "Trash" 9 OK List completed. 10 NO [ALREADYEXISTS] Mailbox exists. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 2 EXISTS * 0 RECENT * OK [UIDVALIDITY 1270130617] UIDs valid * OK [UIDNEXT 3] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest 11 OK [READ-WRITE] Select completed. * MYRIGHTS "INBOX" lrwstipekxacd 12 OK Myrights completed. * ACL "INBOX" "dovepop" lrwstipekxacd 13 OK Getacl completed. * 1 FETCH (UID 1 FLAGS (\Seen)) * 2 FETCH (UID 2 FLAGS (\Seen)) 14 OK Fetch completed. * 1 FETCH (UID 1 RFC822.SIZE 1140 FLAGS (\Seen) [...] * 2 FETCH (UID 2 RFC822.SIZE 1138 FLAGS (\Seen) [...] 15 OK Fetch completed. * 1 FETCH (UID 1 RFC822.SIZE 1140 BODY[] [...] * 2 FETCH (UID 2 RFC822.SIZE 1138 BODY[] [...] 16 OK Fetch completed. + idling 17 OK Idle completed. 18 OK Lsub completed. * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasChildren) "/" "#shared" 19 OK List completed. * LIST (\Noselect \HasChildren) "/" "#shared/doveimap" 20 OK List completed. 21 OK Lsub completed. * LIST (\Noselect \HasChildren) "/" "#shared/doveimap" 22 OK List completed. * LIST (\Noselect \HasChildren) "/" "#shared/doveimap/folder" 23 OK List completed. + idling * OK Still here 24 OK Idle completed. 25 OK List completed. 26 OK List completed. + idling 27 OK Idle completed. 28 OK NOOP completed. + idling 29 OK Idle completed. So TB doesn't seem to ask for what's behind #shared/doveimap/folder although the server tells him it has children... As a matter of fact, in the subscribe dialog box in th UI, I see #shared doveimap folder but with no check box alongside My server is configured like this : namespace private { separator = / location = maildir:/courriel/boites/%u:CONTROL=/courriel/meta/%u:INDEX=/var/dovecot-test/indexes/%1u/%u inbox = yes hidden = no list = yes subscriptions = yes } namespace shared { separator = / prefix = "#shared/%%u/" location = maildir:/courriel/boites/%%u:INDEX=/var/dovecot-test/indexes/%1u/%u/shared/%%u subscriptions = no list = children } Is it a bug in TB ? Thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

3 2

[Dovecot] Shared mailboxes unix permissions
by Thomas Hummel 16 Apr '10

16 Apr '10

Hello Timo, I'm running dovecot-1.2.11/Maildir and plan to migrate to single UID mailboxes some day, but for now, I've got "system" users and I'm testing permissions handling in order to set up shared mailboxes. The private namespace mailboxes location is location = maildir:/courriel/boites/%u:CONTROL=/courriel/meta/%u:INDEX=/var/dovecot-test/indexes/%1u/%u I've . created a 'doveshared' unix group . added 'mail_access_groups = doveshared' . chmod/chgrp the maildir and control dirs like this : drwxrws--- 7 doveimap doveshared 4096 Mar 31 18:47 /courriel/boites/doveimap drwxrws--- 5 doveimap doveshared 4096 Mar 31 18:47 /courriel/meta/doveimap [which were empty] . added 'acl_shared_dict = file:/var/dovecot-test/dict/shared-mailboxes' with drwxrwxs-- 2 root doveshared 512 Mar 31 18:44 /var/dovecot-test/dict [which were empty] Everything gets created with the permission I was expecting, except : -rw------- 1 doveimap doveshared 8 Mar 31 18:47 /courriel/meta/doveimap/dovecot-uidvalidity -rw------- 1 doveimap doveshared 0 Mar 31 18:44 /courriel/meta/doveimap/dovecot-uidvalidity.4bb37be4 and -rw------- 1 doveimap doveshared 0 Mar 31 18:44 /var/dovecot-test/dict/shared-mailboxes I can't see the explanation in http://wiki.dovecot.org/SharedMailboxes/Permissions and the 'dovecot-shared' file doesn't help (besides, my understanding is that in 1.2x, it's for backward compatibility reason). Any idea ? Thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

2 3

[Dovecot] "try MD5-CRYPT scheme instead"?
by Ralf Hildebrandt 16 Apr '10

16 Apr '10

I'm getting a lot of entries like this in my log: Apr 16 10:10:18 postamt dovecot: auth(default): shadow(doxxxris,141.42.206.38): CRYPT(wrongpassword) != '$1$qSe71xxx$09MoMqNyll.wPLCdSaFuA0', try MD5-CRYPT scheme instead It seems that changing the password via SquirrelMail (poppasswd) breaks the authentication scheme somewhat. Users cannot log in anymore. -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

2 2

[Dovecot] Error in SimpleVirtualInstall
by Simone Neugierig 16 Apr '10

16 Apr '10

Hi, i still got a little Problem (Thunderbird cant copy my mail to "Gesendet") but besides that i can send and receive mail. ive used: http://wiki.dovecot.org/HowTo/SimpleVirtualInstall there it says that /etc/dovecot/passwd should look like: test:{PLAIN}pass bill:{PLAIN}secret timo@example.com:{PLAIN}hello123 dave@example.com:{PLAIN}world234 joe@elsewhere.org:{PLAIN}whee jane@elsewhere.org:{PLAIN}mypass but the syntax used for test and bill didnt work here, i had to add the virtual domain to get it working. or else deliver wasnt able to recognize the user (unknown user). Can anybody please confirm this? Also i would like to suggest to explicitely say that protocol lda { } is needed even if it contains nothing. or better change the example so that it contains the postmaster address. but the one in the howto just contains .. dovecot probably wont even start with that example. this is dovecot 1.2.11 -- GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT! Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01

2 1

[Dovecot] dovecot2: authcache statistics
by Andreas Schulze 16 Apr '10

16 Apr '10

Hello, setting auth_cache_size to nonzero enables caching of authentication data. The cache hitrate may be logged by sending SIGUSR2 to dovecot/auth process. Is it possible that dovecot logs statistics on regular intervals ? ( like http://www.postfix.org/postconf.5.html#anvil_status_update_time ) Andreas -- Andreas Schulze Internetdienste | P532 DATEV eG 90329 Nürnberg | Telefon +49 911 319-0 | Telefax +49 911 319-3196 E-Mail info @datev.de | Internet www.datev.de Sitz: 90429 Nürnberg, Paumgartnerstr. 6-14 | Registergericht Nürnberg, GenReg Nr.70 Vorstand Prof. Dieter Kempf (Vorsitzender) Dipl.-Kfm. Wolfgang Stegmann (stellvertretender Vorsitzender) Dipl.-Kfm. Michael Leistenschneider Jörg Rabe v. Pappenheim Dipl.-Vw. Eckhard Schwarzer Vorsitzender des Aufsichtsrates: Reinhard Verholen

2 2

[Dovecot] manipulating mails
by Sven 16 Apr '10

16 Apr '10

Hi all, sorry for my inexperience. I am still learning. I searched for a while but found nothing useful. I am looking for the best way to manipulate headers, bodies, attachments, locations, folders and/or flags while using deliver and e.g. perl. In other words manipulating the whole mail in respect of the requirements of the LDA, MUA and User. I see two diffent ways. As i understand I can work via IMAP and pre-auth sessions, which keeps track of the index files from dovecot and handles complications with users already logged in. Can I use e.g. some perl imap module -> download the mail -> change it -> upload it again with all other parameters unchanged and no confusions on the user's side? This way I think its complex to rewrite the mail header/body/attachments as desired and keep everything else, eg times, flags, headers. the goal should be close to invisibility for a user. This maybe leads to open pre-authed sockets/ports and a lot of work. The other way would be to directly modify the file system. This keeps everything (i think), but changes mtime and needs some index file and MUA cache update. For performance reasons I would like to not use the index-automatism of dovecot but do it manualy at runtime of some script. How does the index update gets initialized from the outside? Same for the client cache. Is there some command available or is a IMAP login my workaround? This maybe leads to password problems or open pre-authed sockets/ports. Last question: Is it possible to add some received-tag to a mail-header when appending mails via imap to the mailbox? Can anyone turn my head in the desired direction? Thanks in advance Sven

3 6

[Dovecot] Small dovecot.org downtime
by Timo Sirainen 16 Apr '10

16 Apr '10

dovecot.org gets more memory in a few hours, so it'll be down for a while (maybe max 30 mins?)

1 0

[Dovecot] catch-all not working with postfix dovecot lda
by fakessh 16 Apr '10

16 Apr '10

its tha archive to the cross post to postfix-users help me http://www.mail-archive.com/postfix-users@postfix.org/msg22963.html On Fri, 16 Apr 2010 00:26:25 +0200, fakessh <fakessh(a)fakessh.eu> wrote: On Thu, 15 Apr 2010 08:33:43 -0500, Noel Jones <njones(a)megan.vbhcs.org> wrote: On 4/14/2010 3:42 PM, fakessh wrote: On Wed, 14 Apr 2010 13:50:34 -0500, Noel Jones<njones(a)megan.vbhcs.org> wrote: On 4/14/2010 1:45 PM, fakessh wrote: On Wed, 14 Apr 2010 14:12:25 -0400, Charles Marcus <CMarcus(a)Media-Brokers.com> wrote: I changed the entries @fakessh to root@localhost in /etc/postfix/virtual postmap then a file to the postfix restart. all without success, or rather the same mistake Then post your new "postconf -n", log entries showing the problem, and file contents. my postcon -n [root@r13151 ~]# postconf -n alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases body_checks = regexp:/etc/postfix/body_checks.cf bounce_notice_recipient = postmaster broken_sasl_auth_clients = yes command_directory = /usr/sbin config_directory = /etc/postfix content_filter = dksign:[127.0.0.1]:10028 daemon_directory = /usr/libexec/postfix debug_peer_level = 2 default_privs = nobody double_bounce_sender = no header_checks = regexp:/etc/postfix/header_checks.cf home_mailbox = Maildir/ html_directory = no in_flow_delay = 10 inet_interfaces = all mail_spool_directory = /var/spool/mail mailbox_command = /usr/libexec/dovecot/deliver mailq_path = /usr/bin/mailq.postfix manpage_directory = /usr/share/man maps_rbl_domains = bl.spamcop.net mime_header_checks = regexp:/etc/postfix/mime_header_checks.cf mydestination = $myhostname, localhost.$mydomain mydomain = r13151.ovh.net mynetworks = 127.0.0.0/8 ,87.98.186.232 myorigin = $mydomain newaliases_path = /usr/bin/newaliases.postfix queue_run_delay = 2000s readme_directory = /usr/share/doc/postfix-2.3.3/README_FILES recipient_delimiter = + relay_domains = sample_directory = /usr/share/doc/postfix-2.3.3/samples sendmail_path = /usr/sbin/sendmail.postfix setgid_group = postdrop smtp_sasl_security_options = noanonymous smtp_sasl_tls_security_options = noanonymous smtp_sender_dependent_authentication = yes smtp_tls_loglevel = 3 smtp_tls_session_cache_database = btree:/var/lib/postfix/smtp_tls_session_cache smtpd_banner = $myhostname ESMTP $mail_name ($mail_version) smtpd_client_restrictions = permit_mynetworks,reject_unknown_reverse_client_hostname,reject_unauth_pipelining, reject_non_fqdn_recipient , permit smtpd_milters = inet:[127.0.0.1]:10040 smtpd_recipient_restrictions = permit_mynetworks permit_inet_interfaces permit_sasl_authenticated reject_unverified_recipient reject_non_fqdn_sender reject_non_fqdn_recipient reject_unknown_sender_domain reject_unknown_recipient_domain reject_unknown_reverse_client_hostname reject_unauth_destination reject_unauth_pipelining reject_rbl_client zen.spamhaus.org reject_sender_login_mismatch check_policy_service unix:postgrey/socket check_sender_access hash:/etc/postfix/check_backscatterer check_policy_service unix:private/spfpolicy reject_rbl_client bl.spamcop.net reject_rhsbl_sender dbl.spamhaus.org reject_rbl_client cbl.abuseat.org reject_rbl_client b.barracudacentral.org smtpd_reject_unlisted_sender = no smtpd_sasl_auth_enable = yes smtpd_sasl_authenticated_header = yes smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot smtpd_tls_CAfile = /etc/pki/tls/sub.class4.server.ca.pem smtpd_tls_auth_only = yes smtpd_tls_cert_file = /etc/pki/tls/newcerts/01.pem smtpd_tls_key_file = /etc/pki/tls/private/r13151.ovh.net.key smtpd_tls_received_header = yes smtpd_tls_session_cache_database = btree:/var/lib/postfix/smtpd_tls_session_cache smtpd_use_tls = yes soft_bounce = no tls_random_source = dev:/dev/urandom unknown_local_recipient_reject_code = 550 virtual_alias_domains = fakessh.eu renelacroute.fr nicolaspichot.fr virtual_alias_maps = hash:/etc/postfix/virtual But you already have all the information you need to fix this yourself. Key points are 1) use fully qualified names in virtual_alias_maps. ie. user(a)example1.com user(a)example2.com *not* user(a)example1.com user my jed /etc/postfix/virtual # # AUTHOR(S) # Wietse Venema # IBM T.J. Watson Research # P.O. Box 704 # Yorktown Heights, NY 10598, USA # # VIRTUAL(5$ postmaster(a)fakessh.eu root(a)localhost.r13151.ovh.net fakessh(a)fakessh.eu fakessh(a)localhost.r13151.ovh.net webmail(a)fakessh.eu webmail(a)localhost.r13151.ovh.net serge(a)fakessh.eu serge(a)localhost.r13151.ovh.net @fakessh root(a)localhost.r13151.ovh.net renelacroute(a)renelacroute.fr renelacroute(a)localhost.r13151.ovh.net @renelacroute.fr root(a)localhost.r13151.ovh.net postmaster(a)renelacroute.fr root(a)localhost.r13151.ovh.net nicolaspichot(a)nicolaspichot.fr nicolaspichot(a)localhost.r13151.ovh.net @nicolaspichot.fr root(a)localhost.r13151.ovh.net 2) if you want local delivery of the mail, the new domain must be listed in mydestination. i use local delivery agent [root@r13151 ~]# rpm -qa | grep dovecot dovecot-sieve-devel-0.1.15-4.el5 dovecot-sieve-cmu-1.1.8-11.el5 dovecot-1.2.11-3_108.el5 dovecot-sieve-0.1.15-4.el5 dovecot-managesieve-0.11.11-0_4.el5 [root@r13151 ~]# to atrpms repo Your fix may be as simple as adding "localhost.$mydomain" to mydestination. my hostname is r13151.ovh.net -- Noel Jones my log to correct session Apr 16 00:36:16 r13151 postfix/postfix-script: stopping the Postfix mail system Apr 16 00:36:16 r13151 postfix/master[14544]: terminating on signal 15 Apr 16 00:36:17 r13151 postfix/postfix-script: starting the Postfix mail system Apr 16 00:36:17 r13151 postfix/master[14848]: daemon started -- version 2.3.3, configuration /etc/postfix Apr 16 00:36:31 r13151 postfix/tlsmgr[14861]: open smtp TLS cache btree:/var/lib/postfix/smtp_tls_session_cache Apr 16 00:36:31 r13151 postfix/tlsmgr[14861]: tlsmgr_cache_run_event: start TLS smtp session cache cleanup Apr 16 00:36:31 r13151 postfix/smtpd[14859]: connect from smtp20.orange.fr[80.12.242.26] Apr 16 00:36:31 r13151 postfix/cleanup[14866]: 6617457F6F: message-id=<20100415223631.6617457F6F(a)r13151.ovh.net> Apr 16 00:36:31 r13151 postfix/qmgr[14851]: 6617457F6F: from=<postmaster(a)r13151.ovh.net>, size=260, nrcpt=1 (queue active) Apr 16 00:36:31 r13151 postfix/local[14867]: 6617457F6F: to=<fakessh(a)localhost.r13151.ovh.net>, orig_to=<fakessh(a)fakessh.eu>, relay=local, delay=0.16, delays=0.15/0.01/0/0, dsn=2.0.0, status=deliverable (delivers to command: /usr/libexec/dovecot/deliver) Apr 16 00:36:31 r13151 postfix/qmgr[14851]: 6617457F6F: removed Apr 16 00:36:34 r13151 postgrey[838]: action=pass, reason=client whitelist, client_name=smtp20.orange.fr, client_address=80.12.242.26, sender=john.swilting(a)wanadoo.fr, recipient=fakessh(a)fakessh.eu Apr 16 00:36:34 r13151 postgrey[838]: cleaning up old logs... Apr 16 00:36:35 r13151 postfix/policy-spf[14869]: : SPF none (No applicable sender policy available): Envelope-from: john.swilting(a)wanadoo.fr Apr 16 00:36:35 r13151 postfix/policy-spf[14869]: handler sender_policy_framework: is decisive. Apr 16 00:36:35 r13151 postfix/policy-spf[14869]: : Policy action=PREPEND Received-SPF: none (wanadoo.fr: No applicable sender policy available) receiver=r13151.ovh.net; identity=mailfrom; envelope-from="john.swilting(a)wanadoo.fr"; helo=smtp20.orange.fr; client-ip=80.12.242.26 Apr 16 00:36:35 r13151 postfix/smtpd[14859]: AD73957F6F: client=smtp20.orange.fr[80.12.242.26] Apr 16 00:36:35 r13151 postfix/cleanup[14866]: AD73957F6F: message-id=<1271370966.7979.13.camel(a)localhost.localdomain> Apr 16 00:36:37 r13151 postfix/qmgr[14851]: AD73957F6F: from=<john.swilting(a)wanadoo.fr>, size=1460, nrcpt=1 (queue active) Apr 16 00:36:37 r13151 postfix/smtpd[14859]: disconnect from smtp20.orange.fr[80.12.242.26] Apr 16 00:36:37 r13151 dkimproxy.out[817]: connect from 127.0.0.1 Apr 16 00:36:37 r13151 postfix/smtpd[14874]: connect from localhost.localdomain[127.0.0.1] Apr 16 00:36:37 r13151 postfix/smtp[14873]: discarding EHLO keywords: 8BITMIME STARTTLS Apr 16 00:36:38 r13151 postfix/smtpd[14874]: 30AB357F71: client=smtp20.orange.fr[80.12.242.26] Apr 16 00:36:38 r13151 dkimproxy.out[817]: DKIM signing - skipped; message-id=<1271370966.7979.13.camel(a)localhost.localdomain>, from=<john.swilting(a)wanadoo.fr> Apr 16 00:36:38 r13151 postfix/cleanup[14866]: 30AB357F71: message-id=<1271370966.7979.13.camel(a)localhost.localdomain> Apr 16 00:36:39 r13151 postfix/qmgr[14851]: 30AB357F71: from=<john.swilting(a)wanadoo.fr>, size=1866, nrcpt=1 (queue active) Apr 16 00:36:39 r13151 postfix/smtp[14873]: AD73957F6F: to=<fakessh(a)fakessh.eu>, relay=127.0.0.1[127.0.0.1]:10028, delay=7.9, delays=6.5/0.01/0.3/1.1, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as 30AB357F71) Apr 16 00:36:39 r13151 postfix/smtpd[14874]: disconnect from localhost.localdomain[127.0.0.1] Apr 16 00:36:39 r13151 clamd[7779]: SelfCheck: Database status OK. Apr 16 00:36:39 r13151 postfix/qmgr[14851]: AD73957F6F: removed Apr 16 00:36:40 r13151 postfix/smtpd[14880]: connect from localhost.localdomain[127.0.0.1] Apr 16 00:36:40 r13151 postfix/smtpd[14880]: 6C5AB57F6F: client=localhost.localdomain[127.0.0.1] Apr 16 00:36:40 r13151 postfix/cleanup[14866]: 6C5AB57F6F: message-id=<1271370966.7979.13.camel(a)localhost.localdomain> Apr 16 00:36:40 r13151 postfix/qmgr[14851]: 6C5AB57F6F: from=<john.swilting(a)wanadoo.fr>, size=2728, nrcpt=1 (queue active) Apr 16 00:36:40 r13151 postfix/smtpd[14880]: disconnect from localhost.localdomain[127.0.0.1] Apr 16 00:36:40 r13151 postfix/smtpd[14880]: connect from localhost.localdomain[127.0.0.1] Apr 16 00:36:40 r13151 postfix/smtpd[14880]: A3F4A57F74: client=localhost.localdomain[127.0.0.1] Apr 16 00:36:40 r13151 postfix/cleanup[14866]: A3F4A57F74: message-id=<1271370966.7979.13.camel(a)localhost.localdomain> Apr 16 00:36:40 r13151 postfix/qmgr[14851]: A3F4A57F74: from=<>, size=2240, nrcpt=1 (queue active) Apr 16 00:36:40 r13151 postfix/smtpd[14880]: disconnect from localhost.localdomain[127.0.0.1] Apr 16 00:36:41 r13151 amavis[9551]: (09551-05) Passed CLEAN, [127.0.0.1] [90.55.123.193] <john.swilting(a)wanadoo.fr> -> <fakessh(a)localhost.r13151.ovh.net>, Message-ID: <1271370966.7979.13.camel(a)localhost.localdomain>, mail_id: 2HnPlHlQZ5AT, Hits: 4.791, size: 2046, queued_as: 6C5AB57F6F, 1723 ms Apr 16 00:36:41 r13151 postfix/lmtp[14876]: 30AB357F71: to=<fakessh(a)localhost.r13151.ovh.net>, orig_to=<fakessh(a)fakessh.eu>, relay=127.0.0.1[127.0.0.1]:10024, delay=2.8, delays=1.1/0.01/0.01/1.7, dsn=2.0.0, status=sent (250 2.0.0 Ok, id=09551-05, from MTA([127.0.0.1]:10025): 250 2.0.0 Ok: queued as 6C5AB57F6F) Apr 16 00:36:41 r13151 postfix/qmgr[14851]: 30AB357F71: removed Apr 16 00:36:41 r13151 dovecot: deliver(fakessh): msgid=<1271370966.7979.13.camel(a)localhost.localdomain>: saved mail to INBOX Apr 16 00:36:41 r13151 postfix/local[14867]: 6C5AB57F6F: to=<fakessh(a)localhost.r13151.ovh.net>, relay=local, delay=0.93, delays=0.22/0/0/0.71, dsn=2.0.0, status=sent (delivered to command: /usr/libexec/dovecot/deliver) Apr 16 00:36:41 r13151 postfix/qmgr[14851]: 6C5AB57F6F: removed Apr 16 00:36:41 r13151 dovecot: deliver(root): msgid=<1271370966.7979.13.camel(a)localhost.localdomain>: saved mail to INBOX Apr 16 00:36:41 r13151 postfix/local[14886]: A3F4A57F74: to=<root(a)r13151.ovh.net>, orig_to=<postmaster(a)r13151.ovh.net>, relay=local, delay=0.99, delays=0.29/0.01/0/0.68, dsn=2.0.0, status=sent (delivered to command: /usr/libexec/dovecot/deliver) Apr 16 00:36:41 r13151 postfix/qmgr[14851]: A3F4A57F74: removed my error log to tentative a catch-all Apr 16 00:38:28 r13151 dovecot: IMAP(fakessh): Disconnected: Logged out bytes=329/7731 Apr 16 00:39:37 r13151 dovecot: dovecot: Killed with signal 15 (by pid=15053 uid=0 code=kill) Apr 16 00:39:38 r13151 dovecot: Dovecot v1.2.11 starting up (core dumps disabled) Apr 16 00:39:40 r13151 postfix/postfix-script: stopping the Postfix mail system Apr 16 00:39:40 r13151 postfix/master[14848]: terminating on signal 15 Apr 16 00:39:42 r13151 postfix/postfix-script: starting the Postfix mail system Apr 16 00:39:42 r13151 postfix/master[15149]: daemon started -- version 2.3.3, configuration /etc/postfix Apr 16 00:39:52 r13151 postfix/tlsmgr[15162]: open smtp TLS cache btree:/var/lib/postfix/smtp_tls_session_cache Apr 16 00:39:52 r13151 postfix/tlsmgr[15162]: tlsmgr_cache_run_event: start TLS smtp session cache cleanup Apr 16 00:39:52 r13151 postfix/smtpd[15160]: connect from smtp28.orange.fr[80.12.242.101] Apr 16 00:39:52 r13151 postfix/cleanup[15167]: B8F9157F6F: message-id=<20100415223952.B8F9157F6F(a)r13151.ovh.net> Apr 16 00:39:52 r13151 postfix/qmgr[15152]: B8F9157F6F: from=<postmaster(a)r13151.ovh.net>, size=260, nrcpt=1 (queue active) Apr 16 00:39:52 r13151 postfix/error[15168]: B8F9157F6F: to=<catch(a)fakessh.eu>, relay=none, delay=0.17, delays=0.15/0.01/0/0, dsn=5.0.0, status=undeliverable (User unknown in virtual alias table) Apr 16 00:39:52 r13151 postfix/qmgr[15152]: B8F9157F6F: removed Apr 16 00:39:55 r13151 postfix/smtpd[15160]: NOQUEUE: reject: RCPT from smtp28.orange.fr[80.12.242.101]: 450 4.1.1 <catch(a)fakessh.eu>: Recipient address rejected: undeliverable address: User unknown in virtual alias table; from=<john.swilting(a)wanadoo.fr> to=<catch(a)fakessh.eu> proto=ESMTP helo=<smtp28.orange.fr> Apr 16 00:39:55 r13151 postfix/smtpd[15160]: disconnect from smtp28.orange.fr[80.12.242.101] Apr 16 00:40:15 r13151 postfix/smtpd[15160]: connect from smtp28.orange.fr[80.12.242.101] Apr 16 00:40:15 r13151 postfix/smtpd[15160]: NOQUEUE: reject: RCPT from smtp28.orange.fr[80.12.242.101]: 450 4.1.1 <catch(a)fakessh.eu>: Recipient address rejected: undeliverable address: User unknown in virtual alias table; from=<john.swilting(a)wanadoo.fr> to=<catch(a)fakessh.eu> proto=ESMTP helo=<smtp28.orange.fr> Apr 16 00:40:15 r13151 postfix/smtpd[15160]: disconnect from smtp28.orange.fr[80.12.242.101]

3 5

[Dovecot] Fwd: Re: catch-all not working with postfix dovecot lda (fwd)
by fakessh 16 Apr '10

16 Apr '10

it may be a problem in dealing with amavisd perl milter Subject: Re: [Dovecot] catch-all not working with postfix dovecot lda On Fri, 16 Apr 2010 09:07:55 +1000, Noel Butler <noel.butler(a)ausics.net> wrote: > Postfix must first "know the user(s)" > therefore this isa postfix issue and not dovecot > dovecot deliver assumes the MTA has verified the user to accept mail > from and does not do further authentication > > how to build a catch-all with dovecot lda the question then. is not a postfix issue > On Fri, 2010-04-16 at 01:00 +0200, fakessh wrote: > >> its tha archive to the cross post to postfix-users >> help me >> >> http://www.mail-archive.com/postfix-users@postfix.org/msg22963.html >> >> >> >> On Fri, 16 Apr 2010 00:26:25 +0200, fakessh <fakessh(a)fakessh.eu> wrote: >> >> On Thu, 15 Apr 2010 08:33:43 -0500, Noel Jones >> <njones(a)megan.vbhcs.org> wrote: >> >> On 4/14/2010 3:42 PM, fakessh wrote: >> >> On Wed, 14 Apr 2010 13:50:34 -0500, Noel >> Jones<njones(a)megan.vbhcs.org> wrote: >> >> On 4/14/2010 1:45 PM, fakessh wrote: >> >> On Wed, 14 Apr 2010 14:12:25 -0400, Charles Marcus >> <CMarcus(a)Media-Brokers.com> wrote: >> >> I changed the entries @fakessh to root@localhost in >> >> /etc/postfix/virtual >> >> postmap then a file to the postfix restart. all without >> success, or rather the same mistake >> >> Then post your new "postconf -n", log entries showing the >> problem, >> and file contents. >> >> my postcon -n [root@r13151 ~]# postconf -n alias_database = >> hash:/etc/aliases alias_maps = hash:/etc/aliases body_checks = >> regexp:/etc/postfix/body_checks.cf bounce_notice_recipient = postmaster >> broken_sasl_auth_clients = yes command_directory = /usr/sbin >> config_directory = /etc/postfix content_filter = dksign:[127.0.0.1]:10028 >> daemon_directory = /usr/libexec/postfix debug_peer_level = 2 >> default_privs >> = nobody double_bounce_sender = no header_checks = >> regexp:/etc/postfix/header_checks.cf home_mailbox = Maildir/ >> html_directory >> = no in_flow_delay = 10 inet_interfaces = all mail_spool_directory = >> /var/spool/mail mailbox_command = /usr/libexec/dovecot/deliver >> mailq_path = >> /usr/bin/mailq.postfix manpage_directory = /usr/share/man >> maps_rbl_domains >> = bl.spamcop.net mime_header_checks = >> regexp:/etc/postfix/mime_header_checks.cf mydestination = $myhostname, >> localhost.$mydomain mydomain = r13151.ovh.net mynetworks = 127.0.0.0/8 >> ,87.98.186.232 myorigin = $mydomain newaliases_path = >> /usr/bin/newaliases.postfix queue_run_delay = 2000s readme_directory = >> /usr/share/doc/postfix-2.3.3/README_FILES recipient_delimiter = + >> relay_domains = sample_directory = /usr/share/doc/postfix-2.3.3/samples >> sendmail_path = /usr/sbin/sendmail.postfix setgid_group = postdrop >> smtp_sasl_security_options = noanonymous smtp_sasl_tls_security_options = >> noanonymous smtp_sender_dependent_authentication = yes smtp_tls_loglevel >> = >> 3 smtp_tls_session_cache_database = >> btree:/var/lib/postfix/smtp_tls_session_cache smtpd_banner = $myhostname >> ESMTP $mail_name ($mail_version) smtpd_client_restrictions = >> >> permit_mynetworks,reject_unknown_reverse_client_hostname,reject_unauth_pipelining, >> >> reject_non_fqdn_recipient , permit smtpd_milters = >> inet:[127.0.0.1]:10040 smtpd_recipient_restrictions = permit_mynetworks >> permit_inet_interfaces permit_sasl_authenticated >> reject_unverified_recipient reject_non_fqdn_sender >> reject_non_fqdn_recipient reject_unknown_sender_domain >> reject_unknown_recipient_domain reject_unknown_reverse_client_hostname >> reject_unauth_destination reject_unauth_pipelining reject_rbl_client >> zen.spamhaus.org reject_sender_login_mismatch check_policy_service >> unix:postgrey/socket check_sender_access >> hash:/etc/postfix/check_backscatterer check_policy_service >> unix:private/spfpolicy reject_rbl_client bl.spamcop.net >> reject_rhsbl_sender >> dbl.spamhaus.org reject_rbl_client cbl.abuseat.org reject_rbl_client >> b.barracudacentral.org smtpd_reject_unlisted_sender = no >> smtpd_sasl_auth_enable = yes smtpd_sasl_authenticated_header = yes >> smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = private/auth >> smtpd_sasl_type = dovecot smtpd_tls_CAfile = >> /etc/pki/tls/sub.class4.server.ca.pem smtpd_tls_auth_only = yes >> smtpd_tls_cert_file = /etc/pki/tls/newcerts/01.pem smtpd_tls_key_file = >> /etc/pki/tls/private/r13151.ovh.net.key smtpd_tls_received_header = yes >> smtpd_tls_session_cache_database = >> btree:/var/lib/postfix/smtpd_tls_session_cache smtpd_use_tls = yes >> soft_bounce = no tls_random_source = dev:/dev/urandom >> unknown_local_recipient_reject_code = 550 virtual_alias_domains = >> fakessh.eu renelacroute.fr nicolaspichot.fr virtual_alias_maps = >> hash:/etc/postfix/virtual >> >> But you already have all the information you need to fix this >> yourself. Key points are 1) use fully qualified names in >> virtual_alias_maps. ie. user(a)example1.com user(a)example2.com *not* >> user(a)example1.com user >> >> my jed /etc/postfix/virtual # # AUTHOR(S) # Wietse Venema # IBM T.J. >> Watson Research # P.O. Box 704 # Yorktown Heights, NY 10598, USA # # >> VIRTUAL(5$ postmaster(a)fakessh.eu root(a)localhost.r13151.ovh.net >> fakessh(a)fakessh.eu fakessh(a)localhost.r13151.ovh.net webmail(a)fakessh.eu >> webmail(a)localhost.r13151.ovh.net serge(a)fakessh.eu >> serge(a)localhost.r13151.ovh.net @fakessh root(a)localhost.r13151.ovh.net >> renelacroute(a)renelacroute.fr renelacroute(a)localhost.r13151.ovh.net >> @renelacroute.fr root(a)localhost.r13151.ovh.net postmaster(a)renelacroute.fr >> root(a)localhost.r13151.ovh.net nicolaspichot(a)nicolaspichot.fr >> nicolaspichot(a)localhost.r13151.ovh.net @nicolaspichot.fr >> root(a)localhost.r13151.ovh.net >> >> 2) if you want local delivery of the mail, the new domain must be >> listed in mydestination. >> >> i use local delivery agent [root@r13151 ~]# rpm -qa | grep dovecot >> dovecot-sieve-devel-0.1.15-4.el5 dovecot-sieve-cmu-1.1.8-11.el5 >> dovecot-1.2.11-3_108.el5 dovecot-sieve-0.1.15-4.el5 >> dovecot-managesieve-0.11.11-0_4.el5 [root@r13151 ~]# to atrpms repo >> >> Your fix may be as simple as adding "localhost.$mydomain" to >> mydestination. >> >> my hostname is r13151.ovh.net >> >> -- Noel Jones >> >> >> >> my log to correct session >> >> Apr 16 00:36:16 r13151 postfix/postfix-script: stopping the Postfix mail >> system >> Apr 16 00:36:16 r13151 postfix/master[14544]: terminating on signal 15 >> Apr 16 00:36:17 r13151 postfix/postfix-script: starting the Postfix mail >> system >> Apr 16 00:36:17 r13151 postfix/master[14848]: daemon started -- version >> 2.3.3, configuration /etc/postfix >> Apr 16 00:36:31 r13151 postfix/tlsmgr[14861]: open smtp TLS cache >> btree:/var/lib/postfix/smtp_tls_session_cache >> Apr 16 00:36:31 r13151 postfix/tlsmgr[14861]: tlsmgr_cache_run_event: >> start TLS smtp session cache cleanup >> Apr 16 00:36:31 r13151 postfix/smtpd[14859]: connect from >> smtp20.orange.fr[80.12.242.26] >> Apr 16 00:36:31 r13151 postfix/cleanup[14866]: 6617457F6F: >> message-id=<20100415223631.6617457F6F(a)r13151.ovh.net> >> Apr 16 00:36:31 r13151 postfix/qmgr[14851]: 6617457F6F: >> from=<postmaster(a)r13151.ovh.net>, size=260, nrcpt=1 (queue active) >> Apr 16 00:36:31 r13151 postfix/local[14867]: 6617457F6F: >> to=<fakessh(a)localhost.r13151.ovh.net>, orig_to=<fakessh(a)fakessh.eu>, >> relay=local, delay=0.16, delays=0.15/0.01/0/0, dsn=2.0.0, >> status=deliverable (delivers to command: /usr/libexec/dovecot/deliver) >> Apr 16 00:36:31 r13151 postfix/qmgr[14851]: 6617457F6F: removed >> Apr 16 00:36:34 r13151 postgrey[838]: action=pass, reason=client >> whitelist, client_name=smtp20.orange.fr, client_address=80.12.242.26, >> sender=john.swilting(a)wanadoo.fr, recipient=fakessh(a)fakessh.eu >> Apr 16 00:36:34 r13151 postgrey[838]: cleaning up old logs... >> Apr 16 00:36:35 r13151 postfix/policy-spf[14869]: : SPF none (No >> applicable sender policy available): Envelope-from: >> john.swilting(a)wanadoo.fr >> Apr 16 00:36:35 r13151 postfix/policy-spf[14869]: handler >> sender_policy_framework: is decisive. >> Apr 16 00:36:35 r13151 postfix/policy-spf[14869]: : Policy action=PREPEND >> Received-SPF: none (wanadoo.fr: No applicable sender policy available) >> receiver=r13151.ovh.net; identity=mailfrom; >> envelope-from="john.swilting(a)wanadoo.fr"; helo=smtp20.orange.fr; >> client-ip=80.12.242.26 >> Apr 16 00:36:35 r13151 postfix/smtpd[14859]: AD73957F6F: >> client=smtp20.orange.fr[80.12.242.26] >> Apr 16 00:36:35 r13151 postfix/cleanup[14866]: AD73957F6F: >> message-id=<1271370966.7979.13.camel(a)localhost.localdomain> >> Apr 16 00:36:37 r13151 postfix/qmgr[14851]: AD73957F6F: >> from=<john.swilting(a)wanadoo.fr>, size=1460, nrcpt=1 (queue active) >> Apr 16 00:36:37 r13151 postfix/smtpd[14859]: disconnect from >> smtp20.orange.fr[80.12.242.26] >> Apr 16 00:36:37 r13151 dkimproxy.out[817]: connect from 127.0.0.1 >> Apr 16 00:36:37 r13151 postfix/smtpd[14874]: connect from >> localhost.localdomain[127.0.0.1] >> Apr 16 00:36:37 r13151 postfix/smtp[14873]: discarding EHLO keywords: >> 8BITMIME STARTTLS >> Apr 16 00:36:38 r13151 postfix/smtpd[14874]: 30AB357F71: >> client=smtp20.orange.fr[80.12.242.26] >> Apr 16 00:36:38 r13151 dkimproxy.out[817]: DKIM signing - skipped; >> message-id=<1271370966.7979.13.camel(a)localhost.localdomain>, >> from=<john.swilting(a)wanadoo.fr> >> Apr 16 00:36:38 r13151 postfix/cleanup[14866]: 30AB357F71: >> message-id=<1271370966.7979.13.camel(a)localhost.localdomain> >> Apr 16 00:36:39 r13151 postfix/qmgr[14851]: 30AB357F71: >> from=<john.swilting(a)wanadoo.fr>, size=1866, nrcpt=1 (queue active) >> Apr 16 00:36:39 r13151 postfix/smtp[14873]: AD73957F6F: >> to=<fakessh(a)fakessh.eu>, relay=127.0.0.1[127.0.0.1]:10028, delay=7.9, >> delays=6.5/0.01/0.3/1.1, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as >> 30AB357F71) >> Apr 16 00:36:39 r13151 postfix/smtpd[14874]: disconnect from >> localhost.localdomain[127.0.0.1] >> Apr 16 00:36:39 r13151 clamd[7779]: SelfCheck: Database status OK. >> Apr 16 00:36:39 r13151 postfix/qmgr[14851]: AD73957F6F: removed >> Apr 16 00:36:40 r13151 postfix/smtpd[14880]: connect from >> localhost.localdomain[127.0.0.1] >> Apr 16 00:36:40 r13151 postfix/smtpd[14880]: 6C5AB57F6F: >> client=localhost.localdomain[127.0.0.1] >> Apr 16 00:36:40 r13151 postfix/cleanup[14866]: 6C5AB57F6F: >> message-id=<1271370966.7979.13.camel(a)localhost.localdomain> >> Apr 16 00:36:40 r13151 postfix/qmgr[14851]: 6C5AB57F6F: >> from=<john.swilting(a)wanadoo.fr>, size=2728, nrcpt=1 (queue active) >> Apr 16 00:36:40 r13151 postfix/smtpd[14880]: disconnect from >> localhost.localdomain[127.0.0.1] >> Apr 16 00:36:40 r13151 postfix/smtpd[14880]: connect from >> localhost.localdomain[127.0.0.1] >> Apr 16 00:36:40 r13151 postfix/smtpd[14880]: A3F4A57F74: >> client=localhost.localdomain[127.0.0.1] >> Apr 16 00:36:40 r13151 postfix/cleanup[14866]: A3F4A57F74: >> message-id=<1271370966.7979.13.camel(a)localhost.localdomain> >> Apr 16 00:36:40 r13151 postfix/qmgr[14851]: A3F4A57F74: from=<>, >> size=2240, nrcpt=1 (queue active) >> Apr 16 00:36:40 r13151 postfix/smtpd[14880]: disconnect from >> localhost.localdomain[127.0.0.1] >> Apr 16 00:36:41 r13151 amavis[9551]: (09551-05) Passed CLEAN, [127.0.0.1] >> [90.55.123.193] <john.swilting(a)wanadoo.fr> -> >> <fakessh(a)localhost.r13151.ovh.net>, Message-ID: >> <1271370966.7979.13.camel(a)localhost.localdomain>, mail_id: 2HnPlHlQZ5AT, >> Hits: 4.791, size: 2046, queued_as: 6C5AB57F6F, 1723 ms >> Apr 16 00:36:41 r13151 postfix/lmtp[14876]: 30AB357F71: >> to=<fakessh(a)localhost.r13151.ovh.net>, orig_to=<fakessh(a)fakessh.eu>, >> relay=127.0.0.1[127.0.0.1]:10024, delay=2.8, delays=1.1/0.01/0.01/1.7, >> dsn=2.0.0, status=sent (250 2.0.0 Ok, id=09551-05, from >> MTA([127.0.0.1]:10025): 250 2.0.0 Ok: queued as 6C5AB57F6F) >> Apr 16 00:36:41 r13151 postfix/qmgr[14851]: 30AB357F71: removed >> Apr 16 00:36:41 r13151 dovecot: deliver(fakessh): >> msgid=<1271370966.7979.13.camel(a)localhost.localdomain>: saved mail to >> INBOX >> Apr 16 00:36:41 r13151 postfix/local[14867]: 6C5AB57F6F: >> to=<fakessh(a)localhost.r13151.ovh.net>, relay=local, delay=0.93, >> delays=0.22/0/0/0.71, dsn=2.0.0, status=sent (delivered to command: >> /usr/libexec/dovecot/deliver) >> Apr 16 00:36:41 r13151 postfix/qmgr[14851]: 6C5AB57F6F: removed >> Apr 16 00:36:41 r13151 dovecot: deliver(root): >> msgid=<1271370966.7979.13.camel(a)localhost.localdomain>: saved mail to >> INBOX >> Apr 16 00:36:41 r13151 postfix/local[14886]: A3F4A57F74: >> to=<root(a)r13151.ovh.net>, orig_to=<postmaster(a)r13151.ovh.net>, >> relay=local, >> delay=0.99, delays=0.29/0.01/0/0.68, dsn=2.0.0, status=sent (delivered to >> command: /usr/libexec/dovecot/deliver) >> Apr 16 00:36:41 r13151 postfix/qmgr[14851]: A3F4A57F74: removed >> >> >> my error log to tentative a catch-all >> >> Apr 16 00:38:28 r13151 dovecot: IMAP(fakessh): Disconnected: Logged out >> bytes=329/7731 >> Apr 16 00:39:37 r13151 dovecot: dovecot: Killed with signal 15 (by >> pid=15053 uid=0 code=kill) >> Apr 16 00:39:38 r13151 dovecot: Dovecot v1.2.11 starting up (core dumps >> disabled) >> Apr 16 00:39:40 r13151 postfix/postfix-script: stopping the Postfix mail >> system >> Apr 16 00:39:40 r13151 postfix/master[14848]: terminating on signal 15 >> Apr 16 00:39:42 r13151 postfix/postfix-script: starting the Postfix mail >> system >> Apr 16 00:39:42 r13151 postfix/master[15149]: daemon started -- version >> 2.3.3, configuration /etc/postfix >> Apr 16 00:39:52 r13151 postfix/tlsmgr[15162]: open smtp TLS cache >> btree:/var/lib/postfix/smtp_tls_session_cache >> Apr 16 00:39:52 r13151 postfix/tlsmgr[15162]: tlsmgr_cache_run_event: >> start TLS smtp session cache cleanup >> Apr 16 00:39:52 r13151 postfix/smtpd[15160]: connect from >> smtp28.orange.fr[80.12.242.101] >> Apr 16 00:39:52 r13151 postfix/cleanup[15167]: B8F9157F6F: >> message-id=<20100415223952.B8F9157F6F(a)r13151.ovh.net> >> Apr 16 00:39:52 r13151 postfix/qmgr[15152]: B8F9157F6F: >> from=<postmaster(a)r13151.ovh.net>, size=260, nrcpt=1 (queue active) >> Apr 16 00:39:52 r13151 postfix/error[15168]: B8F9157F6F: >> to=<catch(a)fakessh.eu>, relay=none, delay=0.17, delays=0.15/0.01/0/0, >> dsn=5.0.0, status=undeliverable (User unknown in virtual alias table) >> Apr 16 00:39:52 r13151 postfix/qmgr[15152]: B8F9157F6F: removed >> Apr 16 00:39:55 r13151 postfix/smtpd[15160]: NOQUEUE: reject: RCPT from >> smtp28.orange.fr[80.12.242.101]: 450 4.1.1 <catch(a)fakessh.eu>: Recipient >> address rejected: undeliverable address: User unknown in virtual alias >> table; from=<john.swilting(a)wanadoo.fr> to=<catch(a)fakessh.eu> proto=ESMTP >> helo=<smtp28.orange.fr> >> Apr 16 00:39:55 r13151 postfix/smtpd[15160]: disconnect from >> smtp28.orange.fr[80.12.242.101] >> Apr 16 00:40:15 r13151 postfix/smtpd[15160]: connect from >> smtp28.orange.fr[80.12.242.101] >> Apr 16 00:40:15 r13151 postfix/smtpd[15160]: NOQUEUE: reject: RCPT from >> smtp28.orange.fr[80.12.242.101]: 450 4.1.1 <catch(a)fakessh.eu>: Recipient >> address rejected: undeliverable address: User unknown in virtual alias >> table; from=<john.swilting(a)wanadoo.fr> to=<catch(a)fakessh.eu> proto=ESMTP >> helo=<smtp28.orange.fr> >> Apr 16 00:40:15 r13151 postfix/smtpd[15160]: disconnect from >> smtp28.orange.fr[80.12.242.101] >> >> >> >>

1 0

[Dovecot] version 1.2.11 creating symlink loop for config file
by Adrian Pepper 15 Apr '10

15 Apr '10

What is the following at the end of "main_init" in dovecot 1.2.11 (src/master/main.c) intended to accomplish? base_config_path = t_strconcat(settings_root->defaults->base_dir, "/"PACKAGE".conf", NULL); (void)unlink(base_config_path); if (symlink(configfile, base_config_path) < 0) { i_error("symlink(%s, %s) failed: %m", configfile, base_config_path); } } With our compilation parameters and runtime setup it ends up removing the working base_config_path file and making it instead a symlink to itself. (I.e. a non-working loop). Strangely, the one instance of dovecot continues and seems to mostly work. But (for now) I need to put back the proper dovecot.conf before I can restart it. I think that would be the expected result if strcmp(configfile, base_config_path) == 0. Is that in fact not expected to be the case? (See my initial question). I did not expect self-modifying of configuration like this. (See my initial question). Pattern matches (e.g. "config_path") find no apparent mention of this in recent postings. Adrian Pepper Computer Science Computing Facility David R. Cheriton School of Computer Science University of Waterloo arpepper(a)uwaterloo.ca ========================================================================= After the bug has happened... services110.cs# servers/dovecot -n # 1.2.11: /software/imap-dovecot-1.2/data/etc/dovecot/dovecot.conf Error: Can't open configuration file /software/imap-dovecot-1.2/data/etc/dovecot/dovecot.conf: Number of symbolic links encountered during path name traversal exceeds MAXSYMLINKS Fatal: Invalid configuration in /software/imap-dovecot-1.2/data/etc/dovecot/dovecot.conf services110.cs# services110.cs# servers/dovecot -n # 1.2.11: /software/imap-dovecot-1.2/data/etc/dovecot/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 768). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: SunOS 5.8 sun4u base_dir: /software/imap-dovecot-1.2/data/etc/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /software/sslCerts/config/certs/dovecot.pem ssl_key_file: /software/sslCerts/config/certs/private/dovecot.key disable_plaintext_auth: no login_dir: /software/imap-dovecot-1.2/data/etc/dovecot/home/ login_executable(default): /software/imap-dovecot-1.2/libexec/dovecot/imap-login login_executable(imap): /software/imap-dovecot-1.2/libexec/dovecot/imap-login login_executable(pop3): /software/imap-dovecot-1.2/libexec/dovecot/pop3-login first_valid_uid: 100 last_valid_uid: 65535 first_valid_gid: 100 last_valid_gid: 65535 mail_location: mbox:~:INDEX=~/.imap:INBOX=/var/mail/%u mmap_disable: yes dotlock_use_excl: no mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /software/imap-dovecot-1.2/libexec/dovecot/imap mail_executable(imap): /software/imap-dovecot-1.2/libexec/dovecot/imap mail_executable(pop3): /software/imap-dovecot-1.2/libexec/dovecot/pop3 mail_plugin_dir(default): /software/imap-dovecot-1.2/lib/dovecot/imap mail_plugin_dir(imap): /software/imap-dovecot-1.2/lib/dovecot/imap mail_plugin_dir(pop3): /software/imap-dovecot-1.2/lib/dovecot/pop3 namespace: type: private separator: / prefix: maildir_mail/ location: maildir:~/.maildir list: yes subscriptions: yes namespace: type: private separator: / location: mbox:~/.:INBOX=/var/mail/%u:INDEX=~/.imap1 inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: mail/ location: mbox:~/mail:INDEX=~/.imap2 list: yes subscriptions: yes lda: postmaster_address: postmaster(a)cs.uwaterloo.ca hostname: cs.uwaterloo.ca auth default: verbose: yes debug: yes passdb: driver: passwd-file args: /etc/shadow userdb: driver: passwd args: blocking=yes services110.cs# This is not a production setup; some/most configuration is experimental or speculative. "dovecot -n" does not appear to remove the config file.

4 3

[Dovecot] imap login fails with "no auth attempts"
by Niels Richter 15 Apr '10

15 Apr '10

Hi, I'm currently facing a strange behaviour of dovecot 1.2.10 (and before): after some days the login into our mail servers stops working for imap-connections. pop3-users can go on with using dovecot. Looking into the logfile I can only find: [...] imap-login: Disconnected (no auth attempts) imap-login: Disconnected: Shutting down (no auth attempts) [...] as a hint what is maybe happening. After restarting the system is working quite well again for some time. There is no extra load and not other special at the server running. The authentication is handled over mysql. This is our dovecot -n output (relevant parts): # 1.2.10: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.2-STABLE i386 ufs protocols: imaps pop3s pop3 imap ssl_ca_file: /usr/local/etc/ssl/... ssl_cert_file: /usr/local/etc/ssl/... ssl_key_file: /usr/local/etc/ssl/... disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(pop3): 10 verbose_proctitle: yes first_valid_gid: 0 mail_access_groups: mail mail_privileged_group: mail mail_location: maildir:/usr/... mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_process_size: 512 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): namespace: type: private prefix: INBOX. inbox: yes list: yes subscriptions: yes Do you see anything which is unclear or unnecessary and could lead to a crash of the imap-login process after some time? Thanks for your help! -- Niels.

2 1

[Dovecot] Any secret dovecot 2.0 lda configuration documentation anywhere? =)
by Brandon Lamb 15 Apr '10

15 Apr '10

I successfully got imap/pop3 working using 2.0b4, now im trying to also get lda working with exim but im totally confused. I dont know what should run as what user, getting confused on auth sockets, what to call them or set or whatever. My exim runs as user/group mail/mail, dovecot has user dovecot but user mail for mail_user/group settings. At one point running deliver -d user -f user gave me an error userdb lookup not possible with only userdb prefetch. Here is my config at this particular point in time, probably will be hacked up again in a few seconds =P # 2.0.beta4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-3-amd64 x86_64 Debian squeeze/sid auth_cache_negative_ttl = 3600 s auth_cache_size = 4096 auth_debug = yes auth_debug_passwords = yes auth_default_realm = olypen.com auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %Lu auth_worker_max_count = 60 base_dir = /var/run/dovecot debug_log_path = /var/log/dovecot/debug.log default_vsz_limit = 536870912 deliver_log_format = %s from %f %$ disable_plaintext_auth = no dotlock_use_excl = yes first_valid_gid = 8 first_valid_uid = 8 fsync_disable = yes info_log_path = /var/log/dovecot/info.log last_valid_gid = 8 last_valid_uid = 8 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot/dovecot.log log_timestamp = %Y-%m-%d %H:%M:%S login_log_format = %s login_log_format_elements = (%u) (%r) mail_access_groups = mail mail_debug = yes mail_gid = 8 mail_location = maildir:~/:INDEX=~/dovecot-index mail_log_prefix = %Ls <%u>: mail_plugins = quota mail_privileged_group = mail mail_uid = 8 mailbox_idle_check_interval = 60 s namespace { hidden = yes inbox = yes list = yes location = maildir:%h/:INDEX=~/dovecot-index prefix = separator = / type = private } namespace { hidden = yes list = no location = virtual:/etc/dovecot/virtual:INDEX=~/dovecot-index prefix = virtual/ separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autocreate = Trash autocreate2 = Spam autocreate3 = Sent autocreate4 = Drafts quota = maildir quota_rule2 = Trash:ignore quota_rule3 = Deleted Items:ignore quota_rule4 = Spam:ignore quota_warning = storage=95%% /etc/dovecot/quota-warning.sh 95 quota_warning2 = storage=80%% /etc/dovecot/quota-warning.sh 80 } postmaster_address = postmaster(a)olypen.com protocols = imap pop3 quota_full_tempfail = yes rejection_reason = Your message to <%t> with subject of <%s> was automatically rejected:%n%r rejection_subject = Mailbox Full: %s sendmail_path = /usr/sbin/exim service auth { unix_listener /var/spool/exim/auth-userdb { group = mail mode = 0666 user = } } service imap-login { inet_listener imap { port = 143 } process_min_avail = 5 service_count = 0 vsz_limit = 134217728 } service imap { process_limit = 1024 vsz_limit = 1073741824 } service pop3-login { inet_listener pop3 { port = 110 } process_min_avail = 5 service_count = 0 vsz_limit = 134217728 } service pop3 { process_limit = 1024 vsz_limit = 1073741824 } ssl = no userdb { driver = prefetch } valid_chroot_dirs = /mail verbose_proctitle = yes protocol pop3 { mail_max_userip_connections = 1 mail_plugins = $mail_plugins virtual pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_enable_last = no pop3_lock_session = no pop3_logout_format = retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = yes pop3_reuse_xuidl = no pop3_save_uidl = yes pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = auth-master info_log_path = /var/log/dovecot/deliver.log log_path = /var/log/dovecot/deliver.log mail_plugins = quota } protocol imap { imap_client_workarounds = delay-newmail netscape-eoh tb-extra-mailbox-sep imap_idle_notify_interval = 120 s imap_logout_format = bytes=%i/%o imap_max_line_length = 65536 mail_max_userip_connections = 15 mail_plugins = $mail_plugins imap_quota autocreate virtual }

1 0

[Dovecot] pigeonhole: naming and versioning
by Axel Thimm 14 Apr '10

14 Apr '10

Hi Stephan, many thanks for all the work you do on the new sieve parts to dovecot. As a (downstream) packager I have some questions: a) pigeonhole is called a working title - will the final release be called something else like dovecot-sieve again? b) The versioning seems to go from 0.1.15 to 0.1.13. From a packager's POV it would be better to allow a natural version upgrade path. Perhaps the version in hg is just not updated? The reason for these questions/clarifications are that Angel and I are packaging dovecot 2.x betas and matching sieve plugins for allowing more people to a broader testing before the projects go gold. We'd like to have proper naming and versioning in place already for the beta packages. Thanks! -- Axel.Thimm at ATrpms.net

3 5

[Dovecot] dovecot-2.0-beta4, lda and sieve: Permission lookup failed from /tmp/Dovecot Delivery
by Felix Leimbach 14 Apr '10

14 Apr '10

Hi all, I'm testing a dovecot-2.0-beta4 and it is great so far, except that I can't get the sieve plugin for the LDA configured. It doesn't find the user's homedir and uses /tmp instead. Thus it never finds any sieve scripts. The log shows that the SQL queries return the correct home path, namely /mnt/data/vmail/example.com/me dovecot: auth: prefetch(me(a)example.com): passdb didn't return userdb entries, trying the next dovecot: auth: sql(me(a)example.com): SELECT CONCAT(homedir, "/", maildir) AS mail, CONCAT(homedir, "/", maildir) AS home, uid, gid FROM postfix_users WHERE email = 'me(a)example.com' dovecot: auth: master out: USER 1 me(a)example.com mail=/mnt/data/vmail/example.com/me/ home=/mnt/data/vmail/example.com/me/ uid=5000 gid=5000 dovecot: lda(me(a)example.com): Effective uid=5000, gid=5000, home=/mnt/data/vmail/example.com/me/ dovecot: lda(me(a)example.com): Namespace: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes dovecot: lda(me(a)example.com): maildir++: root=/mnt/data/vmail/example.com/me, index=, control=, inbox=/mnt/data/vmail/example.com/me However, the sieve plugin still uses /tmp instead of the home dir and fails: dovecot: lda(me(a)example.com): fs: root=/tmp, index=, control=, inbox= dovecot: lda(me(a)example.com): Namespace : Permission lookup failed from /tmp/Dovecot Delivery Mail dovecot: lda(me(a)example.com): Namespace : Using permissions from /tmp: mode=0777 gid=-1 dovecot: lda(me(a)example.com): Namespace : Permission lookup failed from /tmp/Dovecot Delivery Mail dovecot: lda(me(a)example.com): Namespace : Using permissions from /tmp: mode=0777 gid=-1 dovecot: lda(me(a)example.com): sieve: user has no valid personal script Any idea? Cheers, Felix # doveconf -n # 2.0.beta4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32.2-grsec x86_64 Gentoo Base System release 2.0.1 ext3 auth_debug = yes auth_socket_path = /var/run/dovecot/auth-userdb default_login_user = dovecot_auth lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * login_greeting = Mailserver ready. mail_debug = yes mail_gid = 5000 mail_location = maildir:/mnt/data/vmail/%d/%n mail_uid = 5000 namespace { inbox = yes location = prefix = separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sievescripts } postmaster_address = postmaster(a)example.com protocols = imap pop3 managesieve service auth { unix_listener auth-master { group = vmail mode = 0660 } unix_listener auth-userdb { group = vmail mode = 0660 } } service imap-login { inet_listener imap { port = 10143 } inet_listener imaps { port = 10943 ssl = yes } } service imap { process_limit = 3000 } service managesieve-login { inet_listener sieve { port = 2000 } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 10995 ssl = yes } } shutdown_clients = no ssl_cert = </etc/dovecot/ssl.crt ssl_key = </etc/dovecot/ssl.key userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol managesieve { managesieve_implementation_string = Cyrus timsieved v2.2.13' } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = log_path = mail_plugins = sieve }

3 6

[Dovecot] BAD Error in IMAP command UID COPY: Invalid uidset
by Martin Ott 14 Apr '10

14 Apr '10

Hi, one of our users reported the problem message "BAD Error in IMAP command UID COPY: Invalid uidset" as a result of copying a message from INBOX to INBOX/Test. Is this something to be concerned about, or simply a bug in thunderbird? thx Martin Server: dovecot 1.2.9 Client: Thunderbird 3.04 rawlog in: 4 namespace 5 lsub "" "INBOX/*" 6 lsub "" "shared/*" 7 list "" "INBOX" 8 select "INBOX" 9 myrights "INBOX" 10 getacl "INBOX" 11 getquotaroot "INBOX" 12 UID fetch 4:* (FLAGS) 13 getquotaroot "INBOX" 14 UID fetch 5:* (FLAGS) 16 uid copy 0 "INBOX/Test" 18 uid copy 0 "INBOX/Test" 19 IDLE DONE 20 close 21 logout rawlog out: * OK [RAWLOG TIMESTAMP] 2010-04-14 14:20:27 3 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH ACL RIGHTS=texk QUOTA] Logged in * NAMESPACE (("INBOX/" "/")) NIL (("shared/" "/")) * LSUB () "/" "INBOX/Trash" * LSUB () "/" "INBOX/Junk" * LSUB () "/" "INBOX/Test" 5 OK Lsub completed. * LSUB () "/" "shared/alle" 6 OK Lsub completed. * LIST (\HasChildren) "/" "INBOX" 7 OK List completed. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 4 EXISTS * 0 RECENT * OK [UIDVALIDITY 1264696257] UIDs valid * OK [UIDNEXT 5] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest 8 OK [READ-WRITE] Select completed. * MYRIGHTS "INBOX" lrwstipekxacd 9 OK Myrights completed. * ACL "INBOX" "testuser" lrwstipekxacd 10 OK Getacl completed. * QUOTAROOT "INBOX" "User quota" * QUOTA "User quota" (STORAGE 5 2048000) 11 OK Getquotaroot completed. * 4 FETCH (UID 4 FLAGS (\Seen)) 12 OK Fetch completed. * QUOTAROOT "INBOX" "User quota" * QUOTA "User quota" (STORAGE 5 2048000) 13 OK Getquotaroot completed. * 4 FETCH (UID 4 FLAGS (\Seen)) 14 OK Fetch completed. 16 BAD Error in IMAP command UID COPY: Invalid uidset 18 BAD Error in IMAP command UID COPY: Invalid uidset + idling 19 OK Idle completed.

2 1

[Dovecot] Dovecot 2.0.beta4: auth-worker keeps crashing
by Maxim Balabaev 14 Apr '10

14 Apr '10

Centos 5.4 x64, icc hg rev 11147 log: Apr 14 01:16:17 auth: Info: mysql: Connected to 127.0.0.1 (mail) Apr 14 01:16:25 imap-login: Info: Disconnected (auth failed, 2 attempts): user=<webmaster@>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Apr 14 01:16:40 master: Error: service(auth-worker): child 8642 killed with signal 11 (core dumps disabled) Apr 14 01:16:40 auth: Error: auth worker: Aborted request: Worker process died unexpectedly Everything works, but it`s crashing every time Gdb info: (gdb) bt full #0 0x000000000041782f in auth_stream_reply_find () No symbol table info available. #1 0x0000000000417d97 in lookup_credentials_callback () No symbol table info available. #2 0x00000000004223a2 in passdb_handle_credentials () No symbol table info available. #3 0x0000000000425b1a in sql_query_callback () No symbol table info available. #4 0x0000000000430494 in driver_mysql_query () No symbol table info available. #5 0x000000000042f306 in sql_query () No symbol table info available. #6 0x0000000000425dcb in sql_lookup_credentials () No symbol table info available. #7 0x0000000000418cf5 in auth_worker_input () No symbol table info available. #8 0x00002ad5677acead in io_loop_handler_run () from /opt/dovecot/lib/dovecot/libdovecot.so.0 No symbol table info available. #9 0x00002ad5677ab8d9 in io_loop_run () from /opt/dovecot/lib/dovecot/libdovecot.so.0 No symbol table info available. #10 0x00002ad567796f56 in master_service_run () ---Type <return> to continue, or q <return> to quit--- from /opt/dovecot/lib/dovecot/libdovecot.so.0 No symbol table info available. #11 0x000000000041c79d in main () Hope to get this fixed :)

3 3

[Dovecot] default domain empty
by Leo Unglaub 14 Apr '10

14 Apr '10

Hi friends, i have a question. I have a running dovecot install on my server and a lot of virtual domains. It works great. The users are logging in with user(a)domain.tld but one old domain must be logged in with only the username only (without @domain.tld). My problem is that in this case the mailbox_localtion don't work. For example: > mail_location = maildir:/var/mail/%d/%n/maildir:INDEX=/var/mail/%d/%n/indizies The variable %d is not replaced with the domain. The dokumentation says: domain part in user@domain, empty if user there's no domain Okay, but is there a way to add a domain to this beause i need the %%d for mailbox sharing. Can i override the domain with a value from the user db or is it possible with a login script or somethink? Thank you a lot Greetings from Austria Leo

3 3

[Dovecot] dovecot2: protocols = ... changed ?
by Andreas Schulze 14 Apr '10

14 Apr '10

hello, to use dovecot 1.2 only for sasl authentication I could set "protocols = none" in dovecont.conf. In Version2 this gave me an error. Instead I had to write "protocols =" into the configfile. I wonder about a key without value in the conf ... should the wiki2.dovecot.org be updated? -- Andreas Schulze Internetdienste | P532 DATEV eG 90329 Nürnberg | Telefon +49 911 319-0 | Telefax +49 911 319-3196 E-Mail info @datev.de | Internet www.datev.de Sitz: 90429 Nürnberg, Paumgartnerstr. 6-14 | Registergericht Nürnberg, GenReg Nr.70 Vorstand Prof. Dieter Kempf (Vorsitzender) Dipl.-Kfm. Wolfgang Stegmann (stellvertretender Vorsitzender) Dipl.-Kfm. Michael Leistenschneider Jörg Rabe v. Pappenheim Dipl.-Vw. Eckhard Schwarzer Vorsitzender des Aufsichtsrates: Reinhard Verholen

2 1

[Dovecot] Dovecot 2.0 - LDA auth-master issues
by Floris Bos 14 Apr '10

14 Apr '10

Hi, I'm running a Postfix+Dovecot+MySQL setup, and am trying to upgrade to Dovecot 2.0 beta 4. The problem I run into is that lda cannot connect to the auth-master socket. == Apr 9 15:29:51 mysql postfix/pipe[3749]: 2AAB04517F: to=<EMAIL-ADDRESS>, relay=dovecot, delay=0.02, delays=0.01/0/0/0.02, dsn=4.3.0, status=deferred (temporary failure. Command output: lda: Error: userdb lookup: connect(/usr/local/var/run/dovecot/auth-master) failed: Permission denied (euid=80(www) egid=1003(dovecot) missing +r perm: /usr/local/var/run/dovecot/auth-master, euid is not dir owner) lda: Fatal: User lookup failed: userdb lookup failed ) == Dovecot seems to set the permission of the auth-master socket to user root, mode 600. In Dovecot 1 there was a "mode" and a "user" option to change this. In Dovecot 2 I can only find an option to change the socket path ("auth_socket_path"), but not it's user or mode. Any idea on how to solve this? Your sincerely, Floris Bos

3 2

[Dovecot] Virusscanning
by Andreas Schulze 14 Apr '10

14 Apr '10

Hello list, I use currently a non-dovecot pop3 proxy which has the ability to scan all passing mails for viruses. And I like dovecot. I have to combine both. One (and the only) idea is to call a virusscanner a shellscript, installed as PostLoginScript. But I see multiple disadvantages: 1. it's a shellscript which tents to be slow. 2. it's called *on* the mailbox-host, not on a dedicated proxy 3. I think it's slow and I dont't know howto measure. 4. I thint it's slow. 5. I think it's slow. 6. I like a "Plan B" Any suggestions !? Thanks, Andreas -- ######################################################################## # # Andreas Schulze # https://andreasschulze.de # # GnuPG Key-ID: A7DBA67F, https://andreasschulze.de/sca.asc # GnuPG Fingerprint: 14C1 39A8 CE6D 6BE0 28C6 5652 03B5 6793 A7DB A67F # # $Id: .signature,v 1.3 2007-12-27 21:13:36 sca Exp $ ########################################################################

11 17

[Dovecot] Antispam plugin, compile under osx
by Bradley Giesbrecht 14 Apr '10

14 Apr '10

Any help with the below build failure would be greatly appreciated. If the information I am providing is deficient to diagnose the problem please tell me how to provide better information. Trying to build dovecot-antispam plugin 1.3 from; http://johannes.sipsolutions.net/download/dovecot-antispam/ Dovecot 1.2.11 installed and was configured with --enable-header- install. I also have dovecot compiled with sieve, managesieve and mysql support. Dspam 3.9.0 installed. I'm using the following .config file; BACKEND=dspam-exec DOVECOT=/opt/local/include/dovecot INSTALLDIR=/opt/local/lib/dovecot/imap USER=root GROUP=root PLUGINNAME=antispam make fails with; cc -DHAVE_CONFIG_H -I/opt/local/include/dovecot/ -I/opt/local/include/ dovecot/src/ -I/opt/local/include/dovecot/src/lib/ -I/opt/local/ include/dovecot/src/lib-storage/ -I/opt/local/include/dovecot/src/lib- mail/ -I/opt/local/include/dovecot/src/lib-imap/ -I/opt/local/include/ dovecot/src/lib-dict/ -I/opt/local/include/dovecot/src/lib-index/ -I/ opt/local/include/dovecot/src/imap/ -o dovecot-version dovecot-version.c ./dovecot-version > dovecot-version.h ./version.sh > antispam-version.h cc -c -fPIC -shared -Wall -Wextra -DPLUGINNAME=antispam - DHAVE_CONFIG_H -I/opt/local/include/dovecot/ -I/opt/local/include/ dovecot/src/ -I/opt/local/include/dovecot/src/lib/ -I/opt/local/ include/dovecot/src/lib-storage/ -I/opt/local/include/dovecot/src/lib- mail/ -I/opt/local/include/dovecot/src/lib-imap/ -I/opt/local/include/ dovecot/src/lib-dict/ -I/opt/local/include/dovecot/src/lib-index/ -I/ opt/local/include/dovecot/src/imap/ -o signature.o signature.c cc -c -fPIC -shared -Wall -Wextra -DPLUGINNAME=antispam - DHAVE_CONFIG_H -I/opt/local/include/dovecot/ -I/opt/local/include/ dovecot/src/ -I/opt/local/include/dovecot/src/lib/ -I/opt/local/ include/dovecot/src/lib-storage/ -I/opt/local/include/dovecot/src/lib- mail/ -I/opt/local/include/dovecot/src/lib-imap/ -I/opt/local/include/ dovecot/src/lib-dict/ -I/opt/local/include/dovecot/src/lib-index/ -I/ opt/local/include/dovecot/src/imap/ -o antispam-plugin.o antispam- plugin.c cc -c -fPIC -shared -Wall -Wextra -DPLUGINNAME=antispam - DHAVE_CONFIG_H -I/opt/local/include/dovecot/ -I/opt/local/include/ dovecot/src/ -I/opt/local/include/dovecot/src/lib/ -I/opt/local/ include/dovecot/src/lib-storage/ -I/opt/local/include/dovecot/src/lib- mail/ -I/opt/local/include/dovecot/src/lib-imap/ -I/opt/local/include/ dovecot/src/lib-dict/ -I/opt/local/include/dovecot/src/lib-index/ -I/ opt/local/include/dovecot/src/imap/ -o antispam-storage.o antispam- storage.c cc -c -fPIC -shared -Wall -Wextra -DPLUGINNAME=antispam - DHAVE_CONFIG_H -I/opt/local/include/dovecot/ -I/opt/local/include/ dovecot/src/ -I/opt/local/include/dovecot/src/lib/ -I/opt/local/ include/dovecot/src/lib-storage/ -I/opt/local/include/dovecot/src/lib- mail/ -I/opt/local/include/dovecot/src/lib-imap/ -I/opt/local/include/ dovecot/src/lib-dict/ -I/opt/local/include/dovecot/src/lib-index/ -I/ opt/local/include/dovecot/src/imap/ -o dspam-exec.o dspam-exec.c cc -fPIC -shared -Wall -Wextra -DPLUGINNAME=antispam -DHAVE_CONFIG_H - I/opt/local/include/dovecot/ -I/opt/local/include/dovecot/src/ -I/opt/ local/include/dovecot/src/lib/ -I/opt/local/include/dovecot/src/lib- storage/ -I/opt/local/include/dovecot/src/lib-mail/ -I/opt/local/ include/dovecot/src/lib-imap/ -I/opt/local/include/dovecot/src/lib- dict/ -I/opt/local/include/dovecot/src/lib-index/ -I/opt/local/include/ dovecot/src/imap/ signature.o antispam-plugin.o antispam-storage.o dspam-exec.o -o lib90_antispam_plugin.so Undefined symbols: "_mailbox_get_name", referenced from: _mailbox_patternmatch in antispam-plugin.o _mailbox_is_spam in antispam-plugin.o _mailbox_is_trash in antispam-plugin.o _mailbox_is_unsure in antispam-plugin.o "_t_strconcat", referenced from: _get_setting in antispam-plugin.o _parse_folder_setting in antispam-plugin.o _call_dspam in dspam-exec.o _call_dspam in dspam-exec.o _call_dspam in dspam-exec.o "_main", referenced from: start in crt1.10.5.o "_mailbox_get_storage", referenced from: _mailbox_patternmatch in antispam-plugin.o "_t_push", referenced from: _mailbox_patternmatch in antispam-plugin.o _get_setting in antispam-plugin.o _parse_folder_setting in antispam-plugin.o "_i_panic", referenced from: _signature_list_free in signature.o _move_to_class in antispam-storage.o _antispam_copy in antispam-storage.o _antispam_transaction_begin in antispam-storage.o _antispam_mail_update_keywords in antispam-storage.o _antispam_mail_update_keywords in antispam-storage.o _antispam_mail_update_keywords in antispam-storage.o "_i_malloc", referenced from: _call_dspam in dspam-exec.o "_array_idx_set_i", referenced from: _antispam_mailbox_transaction_begin in antispam-storage.o _antispam_mailbox_mail_alloc in antispam-storage.o _antispam_mailbox_open in antispam-storage.o _antispam_mail_storage_created in antispam-storage.o "_t_buffer_get", referenced from: _mailbox_patternmatch in antispam-plugin.o "_t_pop", referenced from: _mailbox_patternmatch in antispam-plugin.o _get_setting in antispam-plugin.o _parse_folder_setting in antispam-plugin.o "_array_idx_modifiable_i", referenced from: _antispam_copy in antispam-storage.o _antispam_copy in antispam-storage.o _antispam_save_begin in antispam-storage.o _antispam_save_begin in antispam-storage.o _antispam_save_finish in antispam-storage.o _antispam_save_finish in antispam-storage.o _antispam_mail_update_keywords in antispam-storage.o _antispam_mailbox_transaction_begin in antispam-storage.o _antispam_mailbox_transaction_commit in antispam-storage.o _antispam_mailbox_transaction_commit in antispam-storage.o _antispam_mailbox_transaction_rollback in antispam-storage.o _antispam_mailbox_transaction_rollback in antispam-storage.o _antispam_mailbox_mail_alloc in antispam-storage.o _antispam_mailbox_open in antispam-storage.o "_pool_alloconly_create", referenced from: _antispam_plugin_init in antispam-plugin.o "_p_strsplit", referenced from: _parse_folder_setting in antispam-plugin.o _antispam_plugin_init in antispam-plugin.o _backend_init in dspam-exec.o _backend_init in dspam-exec.o "_mailbox_equals", referenced from: _match_info in antispam-plugin.o "_mail_free", referenced from: _antispam_mailbox_transaction_commit in antispam-storage.o _antispam_mailbox_transaction_commit in antispam-storage.o _antispam_mailbox_transaction_rollback in antispam-storage.o "_t_str_ucase", referenced from: _get_setting in antispam-plugin.o "_default_pool", referenced from: _default_pool$non_lazy_ptr in signature.o _default_pool$non_lazy_ptr in antispam-storage.o _default_pool$non_lazy_ptr in dspam-exec.o "_mail_module_register", referenced from: _antispam_mail_module in antispam-storage.o "_mail_storage_set_error", referenced from: _signature_extract_to_list in signature.o _signature_extract in signature.o _antispam_copy in antispam-storage.o _antispam_save_finish in antispam-storage.o _antispam_save_finish in antispam-storage.o _backend_commit in dspam-exec.o "_str_array_length", referenced from: _backend_init in dspam-exec.o _backend_init in dspam-exec.o "_mail_index_get_keywords", referenced from: _antispam_mail_update_keywords in antispam-storage.o "_mail_storage_module_register", referenced from: _antispam_storage_module in antispam-storage.o "_mail_get_headers", referenced from: _get_mail_headers in signature.o _get_mail_headers in dspam-exec.o "_hook_mail_storage_created", referenced from: _hook_mail_storage_created$non_lazy_ptr in antispam-plugin.o "_i_strdup", referenced from: _signature_extract_to_list in signature.o "_mail_alloc", referenced from: _antispam_copy in antispam-storage.o _antispam_save_begin in antispam-storage.o ld: symbol(s) not found Thank you for your consideration, Bradley Giesbrecht

2 3

[Dovecot] dsync convert dovecot 2.0 beta4
by Renaud Allard 13 Apr '10

13 Apr '10

Hello, I am trying to convert a dbox mailbox in maildir format I changed the config to maildir instead of dbox and I am issuing this /opt/dovecot/bin/dsync -u r convert dbox:/home/r/dbox But I get many errors like those below and no mail is stored in the maildir. dsync(r): Error: Corrupted mailbox log at offset 18446743970630342680: /home/r/dbox/dovecot.mailbox.log dsync(r): Error: dbox /home/r/dbox/mailboxes/Drafts/dbox-Mails: Invalid dbox header size dsync(r): Error: dbox /home/r/dbox/mailboxes/Drafts/dbox-Mails: Invalid dbox header size dsync(r): Error: dbox /home/r/dbox/mailboxes/Drafts/dbox-Mails: Invalid dbox header size dsync(r): Warning: dbox /home/r/dbox/mailboxes/Drafts/dbox-Mails: Rebuilding index

2 1

[Dovecot] dict quota and quota recalculation
by Alex 13 Apr '10

13 Apr '10

Hi I am trying to migrate my courier server to dovecot and I've run into some problems. One of the motive that I chose to migrate is quota reporting mechanism which in courier is a pain (if you need to display an accurate quota usage in the control panel). So I follow the instructions on migrations , I convert all the mailboxes, and the next step was to populate the quota table (I use quota/dict). The quota table is empty. From the console (as root): #echo "x GETQUOTAROOT Inbox" | USER=test(a)domain.net /usr/local/sbin/dovecot --exec-mail imap - the result is : | email | used_quota | messages | +----------------+------------+----------+ | test(a)domain.net | 0 | 0 | From mailling logs , relevant parts : dict quota: user=test(a)domain.net, uri=proxy::quotadict, noenforcing=0 Namespace: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes maildir: data=~ maildir++: root=/root, index=, control=, inbox=/root Namespace : Using permissions from /root: mode=0750 gid=-1 - and in the root folder I can see all dovecot specific files (dovecot*) So basically if I execute the script as root the maildir is root the uid/gid is root I search and I found a trick for home : HOME=/home/sites/domain.net/mail/test/Maildir/; USER=test(a)domain.net; echo "1 getquotaroot inbox" | /usr/local/sbin/dovecot -c /usr/local/etc/dovecot.conf --exec-mail imap (but first I must put used_quota and messages values on -1 in the quota table) If I run this , all dovecot files are created in the user homedir (correct) but with the wrong uid/gid (root). If I change the owner of that files , next time I run the same command , nothing changes (uid/gid remain vmail.vmail). My questions are : - is there a way to avoid this behavior (the owner of the dovecot files after quota recreation)? - is there a better way to force all users quota recalculation? PS: and yes , I need to know all quotas even if the user haven't yet login

2 1

[Dovecot] Patch: support URLAUTH, BURL, CATENATE
by Mike Abbott 13 Apr '10

13 Apr '10

Hello Dovecot community, Below please find a patch that adds support to dovecot-1.2.11 for: - RFC 4467 - IMAP URLAUTH Extension - RFC 4468 - Submission BURL - RFC 4469 - IMAP CATENATE Extension URLAUTH URLAUTH is added as a plugin so it can be disabled to satisfy site security requirements. Each user's URLAUTH keys for all mailboxes are stored in a file named "urlauthkeys" at the top level. It is safe to remove this file but doing so invalidates all previously-generated IMAP URLs. BURL BURL is an extension to SMTP not IMAP, but support is needed on the IMAP side to establish a trust relationship between the submission server and the IMAP server. The patch adds the concept of "submit" users. Submit users are like master users in that they may log in as any user. However submit users can use only a limited set of commands: just URLFETCH, ID, CAPABILITY (although the capabilities are a lie since submit users can't use most commands), and LOGOUT. This restriction enables an IMAP server to allow a BURL-capable submission server to use URLFETCH commands without risking a huge security breach if a submit user's credentials are compromised. In other words, you can safely enable limited-power submit users without enabling super-user master users. The patch adds a non-standard X-PLAIN-SUBMIT authentication method specifically to allow plain-text submit user logins while plain-text regular user logins are not allowed. This lets the system administrator configure the same submit user and password credentials on both the submission server and the IMAP server. Today Apple also contributes BURL support to the Postfix open source project. Postfix BURL interoperates with Dovecot BURL/URLAUTH. CATENATE The patch fully supports LITERAL+ and MULTIAPPEND in conjunction with CATENATE. As with our previous patches, all of our changes are commented with "APPLE" not to pollute the code but to help us merge in your new releases. Feel free to remove those comments or restructure or rewrite the code as desired, as long as you preserve our copyright. We understand that our implementation choices may differ from yours; if you see a better way to achieve the same goal please do adopt the better way. Some areas we are aware could use improvement but satisfy our own needs: - the maildir-specific code in urlauth-keys - the NFS-unsafe locking and read-modify-write algorithms in urlauth-keys - hook_delete_mailbox and hook_select_send_urlmech - output_squelch in struct client - urlfetch and urlfetched in struct imap_fetch_context Apple invites the dovecot developers and contributors to port this patch to Dovecot-2.0. Dovecot-2.0 has not been stable enough for us yet to make it the base of our development. Please let me know if you have any questions, concerns, or bug reports regarding this patch. Thanks. diff -Nur dovecot-1.2.11/AUTHORS dovecot-1.2.11+lemonade/AUTHORS --- dovecot-1.2.11/AUTHORS 2008-12-19 01:31:33.000000000 -0600 +++ dovecot-1.2.11+lemonade/AUTHORS 2010-04-08 09:59:12.000000000 -0500 @@ -13,6 +13,6 @@ Vaclav Haisman <v.haisman(a)sh.cvut.cz> (src/lib/ioloop-kqueue.c, src/lib/ioloop-notify-kqueue.c) -Portions Copyright (c) 2008 Apple Inc. All rights reserved. +Portions Copyright (c) 2008-2010 Apple Inc. All rights reserved. Grepping 'Patch by' from ChangeLog shows up more people. diff -Nur dovecot-1.2.11/COPYING dovecot-1.2.11+lemonade/COPYING --- dovecot-1.2.11/COPYING 2008-06-08 21:21:55.000000000 -0500 +++ dovecot-1.2.11+lemonade/COPYING 2010-04-08 09:59:12.000000000 -0500 @@ -75,3 +75,37 @@ not be used in advertising or otherwise to promote the sale, use or other dealings in these Data Files or Software without prior written authorization of the copyright holder. + +CATENATE support in src/imap/cmd-append.c +src/lib/lib-imap/imap-url.c +src/lib/lib-imap/imap-url.h +src/plugins/urlauth/* + + Copyright (c) 2010 Apple Inc. All rights reserved. + + Redistribution and use in source and binary forms, with or without + modification, are permitted provided that the following conditions + are met: + + 1. Redistributions of source code must retain the above copyright + notice, this list of conditions and the following disclaimer. + 2. Redistributions in binary form must reproduce the above + copyright notice, this list of conditions and the following + disclaimer in the documentation and/or other materials provided + with the distribution. + 3. Neither the name of Apple Inc. ("Apple") nor the names of its + contributors may be used to endorse or promote products derived + from this software without specific prior written permission. + + THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND + ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, + THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A + PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS + CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF + USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND + ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, + OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT + OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF + SUCH DAMAGE. diff -Nur dovecot-1.2.11/configure dovecot-1.2.11+lemonade/configure --- dovecot-1.2.11/configure 2010-03-08 11:31:05.000000000 -0600 +++ dovecot-1.2.11+lemonade/configure 2010-04-08 09:59:12.000000000 -0500 @@ -23068,7 +23068,7 @@ capability_banner="IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE" -capability="$capability_banner SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS" +capability="$capability_banner SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND CATENATE UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS" cat >>confdefs.h <<_ACEOF #define CAPABILITY_STRING "$capability" @@ -23089,7 +23089,7 @@ ac_config_headers="$ac_config_headers config.h" -ac_config_files="$ac_config_files Makefile doc/Makefile doc/wiki/Makefile src/Makefile src/lib/Makefile src/lib-sql/Makefile src/lib-auth/Makefile src/lib-charset/Makefile src/lib-dict/Makefile src/lib-imap/Makefile src/lib-index/Makefile src/lib-mail/Makefile src/lib-ntlm/Makefile src/lib-otp/Makefile src/lib-settings/Makefile src/lib-storage/Makefile src/lib-storage/list/Makefile src/lib-storage/index/Makefile src/lib-storage/index/maildir/Makefile src/lib-storage/index/mbox/Makefile src/lib-storage/index/dbox/Makefile src/lib-storage/index/cydir/Makefile src/lib-storage/index/raw/Makefile src/lib-storage/index/shared/Makefile src/lib-storage/register/Makefile src/auth/Makefile src/deliver/Makefile src/dict/Makefile src/imap/Makefile src/imap-login/Makefile src/login-common/Makefile src/master/Makefile src/pop3/Makefile src/pop3-login/Makefile src/tests/Makefile src/util/Makefile src/plugins/Makefile src/plugins/acl/Makefile src/plugins/imap-acl/Makefile src/plugins/autocreate/Makefile src/plugins/convert/Makefile src/plugins/expire/Makefile src/plugins/fts/Makefile src/plugins/fts-lucene/Makefile src/plugins/fts-solr/Makefile src/plugins/fts-squat/Makefile src/plugins/lazy-expunge/Makefile src/plugins/listescape/Makefile src/plugins/mail-log/Makefile src/plugins/mbox-snarf/Makefile src/plugins/quota/Makefile src/plugins/imap-quota/Makefile src/plugins/trash/Makefile src/plugins/virtual/Makefile src/plugins/zlib/Makefile stamp.h dovecot-config.in" +ac_config_files="$ac_config_files Makefile doc/Makefile doc/wiki/Makefile src/Makefile src/lib/Makefile src/lib-sql/Makefile src/lib-auth/Makefile src/lib-charset/Makefile src/lib-dict/Makefile src/lib-imap/Makefile src/lib-index/Makefile src/lib-mail/Makefile src/lib-ntlm/Makefile src/lib-otp/Makefile src/lib-settings/Makefile src/lib-storage/Makefile src/lib-storage/list/Makefile src/lib-storage/index/Makefile src/lib-storage/index/maildir/Makefile src/lib-storage/index/mbox/Makefile src/lib-storage/index/dbox/Makefile src/lib-storage/index/cydir/Makefile src/lib-storage/index/raw/Makefile src/lib-storage/index/shared/Makefile src/lib-storage/register/Makefile src/auth/Makefile src/deliver/Makefile src/dict/Makefile src/imap/Makefile src/imap-login/Makefile src/login-common/Makefile src/master/Makefile src/pop3/Makefile src/pop3-login/Makefile src/tests/Makefile src/util/Makefile src/plugins/Makefile src/plugins/acl/Makefile src/plugins/imap-acl/Makefile src/plugins/autocreate/Makefile src/plugins/convert/Makefile src/plugins/expire/Makefile src/plugins/fts/Makefile src/plugins/fts-lucene/Makefile src/plugins/fts-solr/Makefile src/plugins/fts-squat/Makefile src/plugins/lazy-expunge/Makefile src/plugins/listescape/Makefile src/plugins/mail-log/Makefile src/plugins/mbox-snarf/Makefile src/plugins/quota/Makefile src/plugins/imap-quota/Makefile src/plugins/trash/Makefile src/plugins/urlauth/Makefile src/plugins/virtual/Makefile src/plugins/zlib/Makefile stamp.h dovecot-config.in" cat >confcache <<\_ACEOF @@ -24282,6 +24282,7 @@ "src/plugins/quota/Makefile") CONFIG_FILES="$CONFIG_FILES src/plugins/quota/Makefile" ;; "src/plugins/imap-quota/Makefile") CONFIG_FILES="$CONFIG_FILES src/plugins/imap-quota/Makefile" ;; "src/plugins/trash/Makefile") CONFIG_FILES="$CONFIG_FILES src/plugins/trash/Makefile" ;; + "src/plugins/urlauth/Makefile") CONFIG_FILES="$CONFIG_FILES src/plugins/urlauth/Makefile" ;; "src/plugins/virtual/Makefile") CONFIG_FILES="$CONFIG_FILES src/plugins/virtual/Makefile" ;; "src/plugins/zlib/Makefile") CONFIG_FILES="$CONFIG_FILES src/plugins/zlib/Makefile" ;; "stamp.h") CONFIG_FILES="$CONFIG_FILES stamp.h" ;; diff -Nur dovecot-1.2.11/configure.in dovecot-1.2.11+lemonade/configure.in --- dovecot-1.2.11/configure.in 2010-03-08 11:30:53.000000000 -0600 +++ dovecot-1.2.11+lemonade/configure.in 2010-04-08 09:59:12.000000000 -0500 @@ -2436,7 +2436,7 @@ dnl ** capability_banner="IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE" -capability="$capability_banner SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS" +capability="$capability_banner SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND CATENATE UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS" AC_DEFINE_UNQUOTED(CAPABILITY_STRING, "$capability", IMAP capabilities) AC_DEFINE_UNQUOTED(CAPABILITY_BANNER_STRING, "$capability_banner", IMAP capabilities advertised in banner) @@ -2503,6 +2503,7 @@ src/plugins/quota/Makefile src/plugins/imap-quota/Makefile src/plugins/trash/Makefile +src/plugins/urlauth/Makefile src/plugins/virtual/Makefile src/plugins/zlib/Makefile stamp.h diff -Nur dovecot-1.2.11/dovecot-example.conf dovecot-1.2.11+lemonade/dovecot-example.conf --- dovecot-1.2.11/dovecot-example.conf 2010-01-24 17:30:41.000000000 -0600 +++ dovecot-1.2.11+lemonade/dovecot-example.conf 2010-04-08 09:59:12.000000000 -0500 @@ -323,6 +323,7 @@ # Enable mail process debugging. This can help you figure out why Dovecot # isn't finding your mails. +# (APPLE) This also helps troubleshoot URLFETCH issues. #mail_debug = no # Log prefix for mail processes. See <doc/wiki/Variables.txt> for list of @@ -1187,6 +1188,10 @@ # Mails are first deleted in lowest -> highest priority number order #trash = /etc/dovecot-trash.conf + # (APPLE) Server name for GENURLAUTH/URLFETCH. Can be host:port or + # just a FQHN. Default is the system's real hostname. + #urlauth_hostport = + # Expire plugin. Mails are expunged from mailboxes after being there the # configurable time. The first expiration date for each mailbox is stored in # a dictionary so it can be quickly determined which mailboxes contain diff -Nur dovecot-1.2.11/src/auth/auth-request-handler.c dovecot-1.2.11+lemonade/src/auth/auth-request-handler.c --- dovecot-1.2.11/src/auth/auth-request-handler.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/auth-request-handler.c 2010-04-08 09:59:12.000000000 -0500 @@ -249,7 +249,8 @@ if (request->internal_failure) auth_stream_reply_add(reply, "temp", NULL); - else if (request->master_user != NULL) { + else if (request->master_user != NULL || + request->submit_user != NULL) { /* APPLE - urlauth */ /* authentication succeeded, but we can't log in as the wanted user */ auth_stream_reply_add(reply, "authz", NULL); @@ -473,6 +474,14 @@ "master_user", request->master_user); } + + /* APPLE - urlauth */ + if (request->submit_user != NULL) { + auth_stream_reply_add(request->userdb_reply, + "submit_user", + request->submit_user); + } + auth_stream_reply_import(reply, auth_stream_reply_export(request->userdb_reply)); break; diff -Nur dovecot-1.2.11/src/auth/auth-request.c dovecot-1.2.11+lemonade/src/auth/auth-request.c --- dovecot-1.2.11/src/auth/auth-request.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/auth-request.c 2010-04-08 09:59:12.000000000 -0500 @@ -126,6 +126,12 @@ auth_stream_reply_add(reply, "master_user", request->master_user); } + + /* APPLE - urlauth */ + if (request->submit_user != NULL) + auth_stream_reply_add(reply, "submit_user", + request->submit_user); + auth_stream_reply_add(reply, "original_username", request->original_username); @@ -162,6 +168,11 @@ request->user = p_strdup(request->pool, value); else if (strcmp(key, "master_user") == 0) request->master_user = p_strdup(request->pool, value); + + /* APPLE - urlauth */ + else if (strcmp(key, "submit_user") == 0) + request->submit_user = p_strdup(request->pool, value); + else if (strcmp(key, "original_username") == 0) request->original_username = p_strdup(request->pool, value); else if (strcmp(key, "cert_username") == 0) { @@ -188,7 +199,8 @@ else if (strcmp(key, "valid-client-cert") == 0) request->valid_client_cert = TRUE; else if (strcmp(key, "skip_password_check") == 0) { - i_assert(request->master_user != NULL); + i_assert(request->master_user != NULL || + request->submit_user != NULL); /* APPLE - urlauth */ request->skip_password_check = TRUE; } else if (strcmp(key, "mech") == 0) request->mech_name = p_strdup(request->pool, value); @@ -303,15 +315,27 @@ result == PASSDB_RESULT_OK); } -static bool auth_request_master_lookup_finish(struct auth_request *request) +static bool auth_request_master_lookup_finish(struct auth_request *request, + bool submit) /* APPLE - urlauth */ { if (request->passdb_failure) return TRUE; /* master login successful. update user and master_user variables. */ + + /* APPLE - urlauth */ + if (submit) + auth_request_log_info(request, "passdb", + "Submit user logging in as %s", + request->requested_login_user); + else /* reduce code deltas */ auth_request_log_info(request, "passdb", "Master user logging in as %s", request->requested_login_user); + /* APPLE - urlauth */ + if (submit) + request->submit_user = request->user; + else /* reduce code deltas */ request->master_user = request->user; request->user = request->requested_login_user; request->requested_login_user = NULL; @@ -352,7 +376,20 @@ /* success */ if (request->requested_login_user != NULL) { /* this was a master user lookup. */ - if (!auth_request_master_lookup_finish(request)) + + /* APPLE - urlauth */ + if (request->passdb->submit && + strcasecmp(request->service, "imap") != 0) { + auth_request_log_info(request, "passdb", + "Attempted submit user login for " + "non-imap service %s " + "(trying to log in as user: %s)", + request->service, + request->requested_login_user); + *result = PASSDB_RESULT_USER_DISABLED; + } else /* reduce code deltas */ + if (!auth_request_master_lookup_finish(request, + request->passdb->submit)) /* APPLE - urlauth */ return FALSE; } else { if (request->passdb->pass) { @@ -1310,7 +1347,8 @@ if (request->skip_password_check) { /* currently this can happen only with master logins */ - i_assert(request->master_user != NULL); + i_assert(request->master_user != NULL || + request->submit_user != NULL); /* APPLE - urlauth */ return 1; } @@ -1458,8 +1496,13 @@ str_append_c(str, ','); str_append(str, ip); } - if (auth_request->requested_login_user != NULL) + if (auth_request->requested_login_user != NULL) { + /* APPLE - urlauth */ + if (auth_request->submit_user != NULL) + str_append(str, ",submit"); + else /* reduce code deltas */ str_append(str, ",master"); + } str_append(str, "): "); str_vprintfa(str, format, va); return str_c(str); diff -Nur dovecot-1.2.11/src/auth/auth-request.h dovecot-1.2.11+lemonade/src/auth/auth-request.h --- dovecot-1.2.11/src/auth/auth-request.h 2009-02-21 16:07:43.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/auth-request.h 2010-04-08 09:59:12.000000000 -0500 @@ -32,6 +32,10 @@ has validated user as a valid master user, master_user is set to user and user is set to requested_login_user. */ char *user, *requested_login_user, *master_user; + + /* APPLE - urlauth - when the master user is a submission server */ + char *submit_user; + /* original_username contains the username exactly as given by the client. this is needed at least with DIGEST-MD5 for password verification. however with master logins the master username has diff -Nur dovecot-1.2.11/src/auth/auth.c dovecot-1.2.11+lemonade/src/auth/auth.c --- dovecot-1.2.11/src/auth/auth.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/auth.c 2010-04-08 09:59:12.000000000 -0500 @@ -37,6 +37,8 @@ masterdb_p = &auth->masterdbs; auth_passdb = NULL; for (i = 1; ; i++) { + bool is_master; /* APPLE - urlauth */ + driver = getenv(t_strdup_printf("PASSDB_%u_DRIVER", i)); if (driver == NULL) break; @@ -49,7 +51,16 @@ auth_passdb->pass = getenv(t_strdup_printf("PASSDB_%u_PASS", i)) != NULL; - if (getenv(t_strdup_printf("PASSDB_%u_MASTER", i)) == NULL) { + /* APPLE - urlauth - Submit user has much less power than + master user. Forbid both master and submit in one passdb + so that unaware services (pop3, managesieve) don't + compromise security. */ + auth_passdb->submit = + getenv(t_strdup_printf("PASSDB_%u_SUBMIT", i)) != NULL; + is_master = getenv(t_strdup_printf("PASSDB_%u_MASTER", i)) != NULL; + if (is_master && auth_passdb->submit) + i_fatal("Passdb can't have master=yes and submit=yes"); + if (!is_master && !auth_passdb->submit) { *passdb_p = auth_passdb; passdb_p = &auth_passdb->next; } else { diff -Nur dovecot-1.2.11/src/auth/auth.h dovecot-1.2.11+lemonade/src/auth/auth.h --- dovecot-1.2.11/src/auth/auth.h 2008-06-08 21:21:56.000000000 -0500 +++ dovecot-1.2.11+lemonade/src/auth/auth.h 2010-04-08 09:59:12.000000000 -0500 @@ -16,6 +16,9 @@ unsigned int deny:1; /* after a successful lookup, continue to next passdb */ unsigned int pass:1; + + /* APPLE - urlauth - submission server login */ + unsigned int submit:1; }; struct auth_userdb { diff -Nur dovecot-1.2.11/src/auth/db-checkpassword.c dovecot-1.2.11+lemonade/src/auth/db-checkpassword.c --- dovecot-1.2.11/src/auth/db-checkpassword.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/db-checkpassword.c 2010-04-08 09:59:12.000000000 -0500 @@ -120,6 +120,13 @@ env_put(t_strconcat("MASTER_USER=", request->master_user, NULL)); } + + /* APPLE - urlauth */ + if (request->submit_user != NULL) { + env_put(t_strconcat("SUBMIT_USER=", + request->submit_user, NULL)); + } + if (request->extra_fields != NULL) { const char *fields = auth_stream_reply_export(request->extra_fields); diff -Nur dovecot-1.2.11/src/auth/mech-plain.c dovecot-1.2.11+lemonade/src/auth/mech-plain.c --- dovecot-1.2.11/src/auth/mech-plain.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/mech-plain.c 2010-04-08 09:59:12.000000000 -0500 @@ -6,9 +6,11 @@ #include "passdb.h" #include "plain-common.h" +/* APPLE - urlauth */ static void -mech_plain_auth_continue(struct auth_request *request, - const unsigned char *data, size_t data_size) +mech_plain_auth_continue_submit(struct auth_request *request, + const unsigned char *data, size_t data_size, + bool submit) { const char *authid, *authenid, *error; char *pass; @@ -54,6 +56,19 @@ auth_request_log_info(request, "plain", "login user: %s", error); auth_request_fail(request); + + /* APPLE - urlauth */ + } else if (submit) { + if (request->requested_login_user != NULL && + *request->requested_login_user != '\0') + auth_request_verify_plain(request, pass, + plain_verify_callback); + else { + auth_request_log_info(request, "x-plain-submit", + "non-submit login"); + auth_request_fail(request); + } + } else { auth_request_verify_plain(request, pass, plain_verify_callback); @@ -64,6 +79,14 @@ safe_memset(pass, 0, strlen(pass)); } +/* APPLE - urlauth */ +static void +mech_plain_auth_continue(struct auth_request *request, + const unsigned char *data, size_t data_size) +{ + mech_plain_auth_continue_submit(request, data, data_size, FALSE); +} + static struct auth_request *mech_plain_auth_new(void) { struct auth_request *request; @@ -86,3 +109,26 @@ mech_plain_auth_continue, mech_generic_auth_free }; + +/* APPLE - urlauth - rest of file + The X-PLAIN-SUBMIT mechanism mimics PLAIN but only for submit users + (and master users, since we can't tell the difference so early). */ + +static void +mech_submit_auth_continue(struct auth_request *request, + const unsigned char *data, size_t data_size) +{ + mech_plain_auth_continue_submit(request, data, data_size, TRUE); +} + +const struct mech_module mech_x_plain_submit = { + "X-PLAIN-SUBMIT", + + MEMBER(flags) MECH_SEC_PLAINTEXT, + MEMBER(passdb_need) MECH_PASSDB_NEED_VERIFY_PLAIN, + + mech_plain_auth_new, + mech_generic_auth_initial, + mech_submit_auth_continue, + mech_generic_auth_free +}; diff -Nur dovecot-1.2.11/src/auth/mech.c dovecot-1.2.11+lemonade/src/auth/mech.c --- dovecot-1.2.11/src/auth/mech.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/mech.c 2010-04-08 09:59:12.000000000 -0500 @@ -64,6 +64,7 @@ } extern const struct mech_module mech_plain; +extern const struct mech_module mech_x_plain_submit; /* APPLE - urlauth */ extern const struct mech_module mech_login; extern const struct mech_module mech_apop; extern const struct mech_module mech_cram_md5; @@ -86,6 +87,7 @@ void mech_init(void) { mech_register_module(&mech_plain); + mech_register_module(&mech_x_plain_submit); /* APPLE - urlauth */ mech_register_module(&mech_login); mech_register_module(&mech_apop); mech_register_module(&mech_cram_md5); @@ -112,6 +114,7 @@ void mech_deinit(void) { mech_unregister_module(&mech_plain); + mech_unregister_module(&mech_x_plain_submit); /* APPLE - urlauth */ mech_unregister_module(&mech_login); mech_unregister_module(&mech_apop); mech_unregister_module(&mech_cram_md5); diff -Nur dovecot-1.2.11/src/auth/passdb-blocking.c dovecot-1.2.11+lemonade/src/auth/passdb-blocking.c --- dovecot-1.2.11/src/auth/passdb-blocking.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/auth/passdb-blocking.c 2010-04-08 09:59:12.000000000 -0500 @@ -19,7 +19,8 @@ if (*args != NULL) { i_assert(auth_stream_is_empty(request->extra_fields) || - request->master_user != NULL); + request->master_user != NULL || + request->submit_user != NULL); /* APPLE - urlauth */ auth_request_set_fields(request, args, NULL); } } @@ -73,7 +74,8 @@ struct auth_stream_reply *reply; i_assert(auth_stream_is_empty(request->extra_fields) || - request->master_user != NULL); + request->master_user != NULL || + request->submit_user != NULL); /* APPLE - urlauth */ reply = auth_stream_reply_init(pool_datastack_create()); auth_stream_reply_add(reply, "PASSV", NULL); @@ -112,7 +114,8 @@ struct auth_stream_reply *reply; i_assert(auth_stream_is_empty(request->extra_fields) || - request->master_user != NULL); + request->master_user != NULL || + request->submit_user != NULL); /* APPLE - urlauth */ reply = auth_stream_reply_init(pool_datastack_create()); auth_stream_reply_add(reply, "PASSL", NULL); diff -Nur dovecot-1.2.11/src/imap/client.c dovecot-1.2.11+lemonade/src/imap/client.c --- dovecot-1.2.11/src/imap/client.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/client.c 2010-04-08 09:59:12.000000000 -0500 @@ -53,6 +53,7 @@ client->command_pool = pool_alloconly_create(MEMPOOL_GROWING"client command", 2048); client->user = user; + client->submit = getenv("SUBMIT_USER") != NULL; /* APPLE - urlauth */ for (ns = user->namespaces; ns != NULL; ns = ns->next) { mail_storage_set_callbacks(ns->storage, @@ -225,6 +226,10 @@ if (client->output->closed) return -1; + /* APPLE - urlauth */ + if (client->output_squelch) + return 1; + iov[0].iov_base = data; iov[0].iov_len = strlen(data); iov[1].iov_base = "\r\n"; @@ -250,6 +255,10 @@ if (client->output->closed || cmd->cancel) return; + /* APPLE - urlauth */ + if (client->output_squelch) + return; + if (tag == NULL || *tag == '\0') tag = "*"; @@ -268,6 +277,10 @@ const char *error, *cmd_name; bool fatal; + /* APPLE - urlauth */ + if (client->output_squelch) + return; + if (msg == NULL) { msg = imap_parser_get_error(cmd->parser, &fatal); if (fatal) { @@ -551,7 +564,8 @@ /* Skip incoming data until newline is found, returns TRUE if newline was found. */ -static bool client_skip_line(struct client *client) +/* APPLE - catenate - was static */ +bool client_skip_line(struct client *client) { const unsigned char *data; size_t i, data_size; @@ -655,6 +669,19 @@ cmd->param_error = TRUE; client_command_free(&cmd); return TRUE; + + /* APPLE - urlauth - Users logged in via the submit user may execute + only commands marked with COMMAND_FLAG_OK_FOR_SUBMIT_USER. This + prevents leakage of the submit user's credentials from causing + a huge security breach, as it would be if we relied solely on + dovecot's regular master users who can do anything to any user. */ + } else if ((cmd->cmd_flags & COMMAND_FLAG_OK_FOR_SUBMIT_USER) == 0 && + client->submit) { + client_send_tagline(cmd, "NO Command forbidden to submit user"); + cmd->param_error = TRUE; + client_command_free(&cmd); + return TRUE; + } else { i_assert(!client->disconnected); diff -Nur dovecot-1.2.11/src/imap/client.h dovecot-1.2.11+lemonade/src/imap/client.h --- dovecot-1.2.11/src/imap/client.h 2009-06-26 23:49:34.000000000 -0500 +++ dovecot-1.2.11+lemonade/src/imap/client.h 2010-04-08 09:59:12.000000000 -0500 @@ -138,6 +138,8 @@ unsigned int input_skip_line:1; /* skip all the data until we've found a new line */ unsigned int modseqs_sent_since_sync:1; + unsigned int output_squelch:1; /* APPLE - urlauth */ + unsigned int submit:1; /* APPLE - urlauth */ }; /* Create new client with specified input/output handles. socket specifies @@ -188,6 +190,9 @@ bool client_handle_unfinished_cmd(struct client_command_context *cmd); void client_continue_pending_input(struct client *client); +/* APPLE - catenate */ +bool client_skip_line(struct client *client); + void client_input(struct client *client); bool client_handle_input(struct client *client); int client_output(struct client *client); diff -Nur dovecot-1.2.11/src/imap/cmd-append.c dovecot-1.2.11+lemonade/src/imap/cmd-append.c --- dovecot-1.2.11/src/imap/cmd-append.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/cmd-append.c 2010-04-08 09:59:12.000000000 -0500 @@ -8,9 +8,16 @@ #include "commands.h" #include "imap-parser.h" #include "imap-date.h" +#include "imap-url.h" /* APPLE - catenate */ +#include "imap-fetch.h" /* APPLE - catenate */ +#include "imap-search-args.h" /* APPLE - catenate */ +#include "fd-set-nonblock.h" /* APPLE - catenate */ +#include "mail-storage-private.h" /* APPLE - catenate */ +#include "mail-search.h" /* APPLE - catenate */ #include "mail-storage.h" #include <sys/time.h> +#include <stdlib.h> /* APPLE - catenate */ /* Don't allow internaldates to be too far in the future. At least with Maildir they can cause problems with incremental backups since internaldate is @@ -32,6 +39,21 @@ struct mail_save_context *save_ctx; unsigned int count; + /* APPLE - catenate */ + struct { + struct ostream *output; /* to pipe; input is from pipe */ + struct istream *literal_input; + uoff_t literal_size; + string_t *literal_url; + unsigned int parts; + + /* also, + msg_size is the cumulative size of the message + message_input is used as "reading any literal" + */ + } cat; + const struct imap_arg *args; + unsigned int message_input:1; unsigned int failed:1; }; @@ -40,6 +62,13 @@ static bool cmd_append_continue_message(struct client_command_context *cmd); static bool cmd_append_continue_parsing(struct client_command_context *cmd); +/* APPLE - catenate */ +static bool args_indicate_catenate(const struct imap_arg *args); +static bool catenate_begin_parsing(struct client_command_context *cmd, + const struct imap_arg *args); +static bool catenate_begin_cancel(struct client_command_context *cmd, + const struct imap_arg *args); + static void client_input_append(struct client_command_context *cmd) { struct cmd_append_context *ctx = cmd->context; @@ -226,6 +255,11 @@ /* if error occurs, the CRLF is already read. */ client->input_skip_line = FALSE; + /* APPLE - catenate */ + if (ctx->args != NULL) { + args = ctx->args; + ctx->args = NULL; + } else { /* reduce code deltas */ /* [<flags>] [<internal date>] <message literal> */ ret = imap_parser_read_args(ctx->save_parser, 0, IMAP_PARSE_FLAG_LITERAL_SIZE, &args); @@ -239,6 +273,7 @@ /* need more data */ return FALSE; } + } /* APPLE - catenate */ if (args->type == IMAP_ARG_EOL) { /* last message */ @@ -295,6 +330,11 @@ return cmd_sync(cmd, sync_flags, imap_flags, msg); } + /* APPLE - catenate */ + if (args_indicate_catenate(args)) + return ctx->failed ? catenate_begin_cancel(cmd, args) : + catenate_begin_parsing(cmd, args); + if (!validate_args(args, &flags_list, &internal_date_str, &ctx->msg_size, &nonsync)) { client_send_command_error(cmd, "Invalid arguments."); @@ -330,6 +370,11 @@ } else if (!imap_parse_datetime(internal_date_str, &internal_date, &timezone_offset)) { client_send_tagline(cmd, "BAD Invalid internal date."); + + /* APPLE */ + if (keywords != NULL) + mailbox_keywords_free(ctx->box, &keywords); + return cmd_append_cancel(ctx, nonsync); } @@ -343,6 +388,11 @@ if (ctx->msg_size == 0) { /* no message data, abort */ client_send_tagline(cmd, "NO Can't save a zero byte message."); + + /* APPLE */ + if (keywords != NULL) + mailbox_keywords_free(ctx->box, &keywords); + return cmd_append_cancel(ctx, nonsync); } @@ -527,3 +577,908 @@ cmd->context = ctx; return cmd_append_continue_parsing(cmd); } + +/* APPLE - rest of file - catenate + Implements RFC 4469. + + Tried to weave CATENATE support into the existing code but was too messy. + Chose to keep a separate state machine rather than rewrite it all. + + Enter at catenate_begin_parsing(). That iterates through all the + in-line URLs. If it encounters a URL literal, it continues at + catenate_continue_url(). If it encounters a TEXT literal, it + continues at catenate_continue_text(). Both of these flow to + catenate_continue_parsing(). At the end, catenate_finish() passes + control back to cmd_append_continue_parsing(). */ + +#define MAX_URL_LITERAL_SIZE 8000 +#define MAX_CATENATE_MSG_SIZE ((uint32_t) -1) +#define MAX_CATENATE_PARTS 50 +#ifndef PIPE_MAX +# define PIPE_MAX 5120 +#endif + +static bool catenate_process_args(struct client_command_context *cmd, + const struct imap_arg *args, bool nonsync); +static bool catenate_cancel_args(struct client_command_context *cmd, + const struct imap_arg *args, bool nonsync); +static bool catenate_cancel(struct cmd_append_context *ctx, bool nonsync); +static bool catenate_finish(struct cmd_append_context *ctx, bool cancel); +static bool catenate_finish_literal(struct client_command_context *cmd, + bool cancel); + +static bool args_indicate_catenate(const struct imap_arg *args) +{ + while (args->type != IMAP_ARG_EOL) { + if (args->type == IMAP_ARG_ATOM && + strcasecmp(args->_data.str, "CATENATE") == 0) + return TRUE; + args++; + } + return FALSE; +} + +static void catenate_solicit(struct cmd_append_context *ctx, bool nonsync) +{ + if (!nonsync) { + o_stream_send(ctx->client->output, "+ OK\r\n", 6); + o_stream_flush(ctx->client->output); + o_stream_uncork(ctx->client->output); + o_stream_cork(ctx->client->output); + } +} + +static bool catenate_url_validate(const struct imap_url_parts *parts, + const char **error) +{ + // user: absent; RFC 3501 "userid" + if (parts->user != NULL) { + *error = "user ID present; need relative URL"; + return FALSE; + } + + // auth_type: absent; RFC 3501 "auth-type" + if (parts->auth_type != NULL) { + *error = "auth type present; need relative URL"; + return FALSE; + } + + // hostport: absent; RFC 1738 "hostport" + if (parts->hostport != NULL) { + *error = "server present; need relative URL"; + return FALSE; + } + + // mailbox: optional; RFC 3501 "mailbox" + if (parts->mailbox != NULL && + !imap_url_mailbox_validate(parts->mailbox)) { + *error = "invalid mailbox"; + return FALSE; + } + + // uidvalidity: optional; RFC 3501 "nz-number" + if (parts->uidvalidity != NULL && + !imap_url_nz_number_validate(parts->uidvalidity)) { + *error = "invalid uidvalidity"; + return FALSE; + } + + // uid: mandatory; RFC 3501 "nz-number" + if (parts->uid == NULL || + !imap_url_nz_number_validate(parts->uid)) { + *error = "missing or invalid uid"; + return FALSE; + } + + // section: optional; RFC 2192 "section" + if (parts->section != NULL && + !imap_url_section_validate(parts->section)) { + *error = "invalid section"; + return FALSE; + } + + // expiration: absent; RFC 3339 "date-time" + if (parts->expiration != NULL) { + *error = "expiration present"; + return FALSE; + } + + // access: absent; RFC 4467 "access" + if (parts->access != NULL) { + *error = "missing or invalid access ID"; + return FALSE; + } + + // mechanism: absent + if (parts->mechanism != NULL) { + *error = "mechanism present"; + return FALSE; + } + + // urlauth: absent + if (parts->urlauth != NULL) { + *error = "access token present"; + return FALSE; + } + + return TRUE; +} + +struct catenate_fetch_context { + struct cmd_append_context *ctx; + struct ostream *client_output; + const char *url; + const char *mailbox; + struct mail_storage *storage; + struct mailbox *box; + struct istream *input; + struct imap_parser *parser; + struct mail_search_args *search_args; + struct imap_fetch_context *fetch_ctx; +}; + +static bool catenate_fetch_cleanup(struct catenate_fetch_context *cfctx, + bool toobig, const char *error) +{ + if (cfctx->fetch_ctx != NULL) { + if (!cfctx->fetch_ctx->urlfetched) { + if (error == NULL && !toobig) + error = "message not found"; + } + if (imap_fetch_deinit(cfctx->fetch_ctx) < 0) + cfctx->fetch_ctx->failed = TRUE; + if (cfctx->fetch_ctx->failed) { + if (error == NULL && !toobig) + error = "message fetch failed"; + } + cfctx->fetch_ctx->urlfetch = FALSE; + } + if (cfctx->search_args != NULL) + mail_search_args_unref(&cfctx->search_args); + if (cfctx->parser != NULL) + imap_parser_destroy(&cfctx->parser); + if (cfctx->input != NULL) + i_stream_unref(&cfctx->input); + if (cfctx->box != NULL) + mailbox_close(&cfctx->box); + if (cfctx->client_output != NULL) + cfctx->ctx->client->output = cfctx->client_output; + cfctx->ctx->client->output_squelch = FALSE; + + if (toobig) + client_send_tagline(cfctx->ctx->cmd, + "NO [TOOBIG] Resulting message too large"); + else if (error != NULL) + client_send_tagline(cfctx->ctx->cmd, + t_strconcat("NO [BADURL ", + imap_url_sanitize(cfctx->url), + "] ", error, NULL)); + return error == NULL && !toobig; +} + +static bool catenate_url(struct cmd_append_context *ctx, const char *url) +{ + struct imap_url_parts enc_parts, dec_parts; + const char *error = NULL; + struct catenate_fetch_context cfctx; + struct mailbox_status status; + string_t *fetch_text; + const struct imap_arg *fetch_args = NULL, *next_arg = NULL; + int fetch_ret, flush_ret, ret; + bool header, toobig; + uoff_t size; + + /* parse, decode, and validate the url */ + memset(&enc_parts, 0, sizeof enc_parts); + memset(&dec_parts, 0, sizeof dec_parts); + imap_url_parse(url, &enc_parts); + if (!imap_url_decode(&enc_parts, &dec_parts, &error) || + !catenate_url_validate(&dec_parts, &error)) { + client_send_tagline(ctx->cmd, + t_strconcat("NO [BADURL ", + imap_url_sanitize(url), + "] ", error, NULL)); + return FALSE; + } + + memset(&cfctx, 0, sizeof cfctx); + cfctx.ctx = ctx; + cfctx.url = url; + + ctx->cmd->client->output_squelch = TRUE; + + /* get the mailbox; if none in URL use the selected one */ + if (dec_parts.mailbox) { + cfctx.mailbox = t_strdup(dec_parts.mailbox); + cfctx.storage = client_find_storage(ctx->cmd, &cfctx.mailbox); + if (cfctx.storage == NULL) + return catenate_fetch_cleanup(&cfctx, FALSE, + "can't find storage"); + } else if (ctx->cmd->client->mailbox != NULL) { + cfctx.mailbox = mailbox_get_name(ctx->cmd->client->mailbox); + cfctx.storage = ctx->cmd->client->mailbox->storage; + } else + return catenate_fetch_cleanup(&cfctx, FALSE, + "no mailbox specified or selected"); + cfctx.box = mailbox_open(&cfctx.storage, cfctx.mailbox, NULL, + MAILBOX_OPEN_READONLY | MAILBOX_OPEN_KEEP_RECENT); + if (cfctx.box == NULL) + return catenate_fetch_cleanup(&cfctx, FALSE, + "can't open mailbox"); + + /* verify uidvalidity */ + if (mailbox_sync(cfctx.box, + MAILBOX_SYNC_FLAG_FULL_READ | MAILBOX_SYNC_FLAG_FAST, + STATUS_UIDVALIDITY, &status) < 0 || + (dec_parts.uidvalidity != NULL && + strtoul(dec_parts.uidvalidity, NULL, 10) != status.uidvalidity)) + return catenate_fetch_cleanup(&cfctx, FALSE, + "uidvalidity mismatch"); + + /* fetch the data as in + UID FETCH dec_parts.uid BODY.PEEK[dec_parts.section] + but with less output syntax */ + fetch_text = t_str_new(11 + (dec_parts.section ? + strlen(dec_parts.section) : 0)); + str_append(fetch_text, "BODY.PEEK["); + if (dec_parts.section) + str_append(fetch_text, dec_parts.section); + str_append(fetch_text, "]"); + + cfctx.input = i_stream_create_from_data(str_data(fetch_text), + str_len(fetch_text)); + (void) i_stream_read(cfctx.input); + + cfctx.parser = imap_parser_create(cfctx.input, NULL, (size_t) -1); + if (imap_parser_finish_line(cfctx.parser, 0, 0, &fetch_args) < 0) + return catenate_fetch_cleanup(&cfctx, FALSE, + "can't parse fetch string"); + + ctx->cmd->uid = TRUE; + if (imap_search_get_uidset_arg(ctx->cmd, dec_parts.uid, + &cfctx.search_args, &error) < 0) + return catenate_fetch_cleanup(&cfctx, FALSE, error); + + cfctx.fetch_ctx = imap_fetch_init(ctx->cmd, cfctx.box); + if (cfctx.fetch_ctx == NULL) + return catenate_fetch_cleanup(&cfctx, FALSE, + "can't init fetch"); + cfctx.fetch_ctx->search_args = cfctx.search_args; + mail_search_args_ref(cfctx.search_args); + cfctx.fetch_ctx->urlfetch = TRUE; + + if (!fetch_parse_args(cfctx.fetch_ctx, fetch_args, &next_arg)) + return catenate_fetch_cleanup(&cfctx, FALSE, + "can't parse fetch args"); + + if (imap_fetch_begin(cfctx.fetch_ctx) != 0) + return catenate_fetch_cleanup(&cfctx, FALSE, + "can't begin fetch"); + + /* fix the plumbing: imap_fetch_more() writes to + client->output, so set that to the pipe to mailbox_save()'s + input */ + cfctx.client_output = ctx->client->output; + ctx->client->output = ctx->cat.output; + + fetch_ret = 0; + flush_ret = 0; + error = NULL; + header = TRUE; + toobig = FALSE; + do { + if (fetch_ret == 0) + fetch_ret = imap_fetch_more(cfctx.fetch_ctx); + else + flush_ret = o_stream_flush(ctx->client->output); + while ((ret = i_stream_read(ctx->input)) != 0 && ret != -1) { + /* parse the header line that imap_fetch produces */ + if (header) { + char *line = i_stream_next_line(ctx->input); + if (line == NULL) + continue; + header = FALSE; + + size = 0; + line = strchr(line, '{'); + if (line != NULL) + size = strtoul(line + 1, NULL, 10); + ctx->msg_size += size; + if (ctx->msg_size > MAX_CATENATE_MSG_SIZE) { + toobig = TRUE; + ret = -1; + break; + } + } + + /* feed the message data into the new message */ + if (mailbox_save_continue(ctx->save_ctx) < 0) { + mailbox_save_cancel(&ctx->save_ctx); + ret = -1; + break; + } + } + if (ret == -1) { + if (!toobig) + error = "fetch/save failed"; + break; + } + } while (fetch_ret == 0 || flush_ret == 0); + + return catenate_fetch_cleanup(&cfctx, toobig, error); +} + +static bool catenate_continue_cancel_literal(struct client_command_context *cmd) +{ + struct client *client = cmd->client; + struct cmd_append_context *ctx = cmd->context; + size_t size; + + if (cmd->cancel) + return catenate_finish(ctx, TRUE); + + (void) i_stream_read(ctx->cat.literal_input); + (void) i_stream_get_data(ctx->cat.literal_input, &size); + i_stream_skip(ctx->cat.literal_input, size); + + if (ctx->cat.literal_input->eof || client->input->closed) { + /* finished, but there may be more URL or TEXT nonsync + literals in a continued CATENATE command */ + i_stream_unref(&ctx->cat.literal_input); + ctx->cat.literal_input = NULL; + + if (cmd->client->input->closed || ctx->args != NULL) + return catenate_finish(ctx, TRUE); + + return catenate_finish_literal(cmd, TRUE); + } + + return FALSE; +} + +static bool catenate_cancel(struct cmd_append_context *ctx, bool nonsync) +{ + ctx->failed = TRUE; + + if (!nonsync || ctx->args != NULL) + return catenate_finish(ctx, TRUE); + + /* we have to read this -- and any following -- nonsynced + literals so we don't treat the literal data as commands. */ + i_assert(ctx->cat.literal_input == NULL); + ctx->cat.literal_input = i_stream_create_limit(ctx->client->input, + ctx->cat.literal_size); + + ctx->message_input = TRUE; + ctx->cmd->func = catenate_continue_cancel_literal; + ctx->cmd->context = ctx; + return catenate_continue_cancel_literal(ctx->cmd); +} + +static bool catenate_finish(struct cmd_append_context *ctx, bool cancel) +{ + if (!cancel) { + /* close the pipe and save any lingering output, which also + crucially passes EOF down through the mailbox_save stack */ + o_stream_close(ctx->cat.output); + if (mailbox_save_continue(ctx->save_ctx) < 0 || + mailbox_save_finish(&ctx->save_ctx) < 0) { + ctx->failed = TRUE; + client_send_storage_error(ctx->cmd, ctx->storage); + cancel = TRUE; + } else { + ctx->save_ctx = NULL; + ++ctx->count; + } + + if (ctx->args == NULL) { + // eat CRLF after close of CATENATE list + ctx->cmd->client->input_skip_line = TRUE; + } + } + + if (ctx->cat.output != NULL) + o_stream_unref(&ctx->cat.output); + if (ctx->cat.literal_input != NULL) + i_stream_unref(&ctx->cat.literal_input); + if (ctx->cat.literal_url != NULL) + str_free(&ctx->cat.literal_url); + if (ctx->input != NULL) + i_stream_unref(&ctx->input); + ctx->cat.parts = 0; + + if (ctx->msg_size == 0 || ctx->count == 0) { + if (!ctx->failed) + client_send_tagline(ctx->cmd, + "NO Can't save a zero byte message."); + ctx->failed = TRUE; + cancel = TRUE; + } + + ctx->message_input = FALSE; + if (cancel) { + if (ctx->args != NULL) { + ctx->cmd->func = cmd_append_continue_parsing; + return cmd_append_continue_parsing(ctx->cmd); + } + cmd_append_finish(ctx); + return TRUE; + } else { + if (ctx->args == NULL) + imap_parser_reset(ctx->save_parser); + ctx->cmd->func = cmd_append_continue_parsing; + return cmd_append_continue_parsing(ctx->cmd); + } +} + +static bool catenate_continue_parsing(struct client_command_context *cmd) +{ + struct client *client = cmd->client; + struct cmd_append_context *ctx = cmd->context; + const struct imap_arg *args; + int ret; + bool literal, nonsync; + + if (cmd->cancel) + return catenate_finish(ctx, TRUE); + + if (client->input_skip_line && !client_skip_line(client)) + return FALSE; + ret = imap_parser_read_args(ctx->save_parser, 0, + IMAP_PARSE_FLAG_LITERAL_SIZE, &args); + if (ret == -1) { + if (!ctx->failed) + client_send_command_error(cmd, NULL); + ctx->failed = TRUE; + return catenate_finish(ctx, TRUE); + } + if (ret < 0) + return FALSE; + + // continuing the CATENATE list + i_assert(args->type == IMAP_ARG_LIST); + if (args[1].type != IMAP_ARG_EOL) { + i_assert(ctx->args == NULL); + ctx->args = &args[1]; // MULTIAPPEND + } + args = IMAP_ARG_LIST_ARGS(args); + + if (args->type == IMAP_ARG_EOL) { + /* end of CATENATE list. finish the message and return + to regular MULTIAPPEND processing */ + client->input_skip_line = ctx->args == NULL; + return catenate_finish(ctx, client->input->closed || + ctx->failed); + } + + literal = imap_parser_get_literal_size(ctx->save_parser, + &ctx->cat.literal_size); + client->input_skip_line = !literal; + nonsync = imap_parser_has_nonsync_literal(ctx->save_parser); + return ctx->failed ? catenate_cancel_args(cmd, args, nonsync) : + catenate_process_args(cmd, args, nonsync); +} + +static bool catenate_finish_literal(struct client_command_context *cmd, + bool cancel) +{ + struct cmd_append_context *ctx = cmd->context; + + ctx->message_input = FALSE; + + // continue in the CATENATE list + i_assert(ctx->args == NULL); + imap_parser_reset(ctx->save_parser); + imap_parser_open_list(ctx->save_parser); + + i_assert(!cancel || ctx->failed); + cmd->func = catenate_continue_parsing; + return catenate_continue_parsing(cmd); +} + +static bool catenate_continue_url(struct client_command_context *cmd) +{ + struct client *client = cmd->client; + struct cmd_append_context *ctx = cmd->context; + int ret; + const unsigned char *data; + size_t size; + + if (cmd->cancel) + return catenate_finish(ctx, TRUE); + + if (ctx->cat.literal_input == NULL) { + ctx->cat.literal_input = + i_stream_create_limit(client->input, + ctx->cat.literal_size); + i_assert(ctx->cat.literal_url == NULL); + ctx->cat.literal_url = str_new(cmd->pool, + ctx->cat.literal_size + 1); + ctx->message_input = TRUE; + } + + if (ctx->save_ctx != NULL) { + while (ctx->cat.literal_input->v_offset != + ctx->cat.literal_size) { + ret = i_stream_read(ctx->cat.literal_input); + data = i_stream_get_data(ctx->cat.literal_input, + &size); + buffer_append(ctx->cat.literal_url, data, size); + i_stream_skip(ctx->cat.literal_input, size); + if (ret == -1 || ret == 0) + break; + } + } + + if (ctx->save_ctx == NULL) { + (void) i_stream_read(ctx->cat.literal_input); + (void) i_stream_get_data(ctx->cat.literal_input, &size); + i_stream_skip(ctx->cat.literal_input, size); + } + + if (ctx->cat.literal_input->eof || client->input->closed) { + bool all_written = ctx->cat.literal_input->v_offset == + ctx->cat.literal_size; + + /* finished */ + i_stream_unref(&ctx->cat.literal_input); + ctx->cat.literal_input = NULL; + + if (ctx->save_ctx == NULL) { + /* failed above */ + ctx->failed = TRUE; + } else if (!all_written) { + /* client disconnected before it finished sending the + whole literal. */ + ctx->failed = TRUE; + mailbox_save_cancel(&ctx->save_ctx); + client_disconnect(client, + "EOF while sending URL literal"); + } else if (!catenate_url(ctx, str_c(ctx->cat.literal_url))) + ctx->failed = TRUE; + + str_free(&ctx->cat.literal_url); + ctx->cat.literal_url = NULL; + + if (client->input->closed) + return catenate_finish(ctx, TRUE); + + /* done with this literal, resume the CATENATE list */ + return catenate_finish_literal(cmd, ctx->failed); + } + + return FALSE; +} + +static bool catenate_continue_text(struct client_command_context *cmd) +{ + struct client *client = cmd->client; + struct cmd_append_context *ctx = cmd->context; + int ret; + size_t size; + + if (cmd->cancel) + return catenate_finish(ctx, TRUE); + + if (ctx->cat.literal_input == NULL) { + ctx->cat.literal_input = + i_stream_create_limit(client->input, + ctx->cat.literal_size); + ctx->message_input = TRUE; + } + + if (ctx->save_ctx != NULL) { + off_t send_ret = 1; + int flush_ret = 0; + + do { + if (send_ret > 0) + send_ret = o_stream_send_istream( + ctx->cat.output, + ctx->cat.literal_input); + else + flush_ret = o_stream_flush(ctx->cat.output); + while ((ret = i_stream_read(ctx->input)) != 0 && + ret != -1) { + if (mailbox_save_continue(ctx->save_ctx) < 0) { + mailbox_save_cancel(&ctx->save_ctx); + ret = -1; + break; + } + } + if (ret == -1) + break; + } while (send_ret > 0 || flush_ret == 0); + } + + if (ctx->save_ctx == NULL) { + (void) i_stream_read(ctx->cat.literal_input); + (void) i_stream_get_data(ctx->cat.literal_input, &size); + i_stream_skip(ctx->cat.literal_input, size); + } + + if (ctx->cat.literal_input->eof || client->input->closed) { + bool all_written = ctx->cat.literal_input->v_offset == + ctx->cat.literal_size; + + /* finished */ + i_stream_unref(&ctx->cat.literal_input); + ctx->cat.literal_input = NULL; + + if (ctx->save_ctx == NULL) { + /* failed above */ + client_send_storage_error(cmd, ctx->storage); + ctx->failed = TRUE; + } else if (!all_written) { + /* client disconnected before it finished sending the + whole literal. */ + ctx->failed = TRUE; + mailbox_save_cancel(&ctx->save_ctx); + client_disconnect(client, "EOF while appending"); + } + + if (client->input->closed) + return catenate_finish(ctx, TRUE); + + /* done with this literal, resume the CATENATE list */ + return catenate_finish_literal(cmd, ctx->failed); + } + + return FALSE; +} + +static bool catenate_begin_parsing(struct client_command_context *cmd, + const struct imap_arg *args) +{ + struct client *client = cmd->client; + struct cmd_append_context *ctx = cmd->context; + bool literal, nonsync; + enum mail_flags flags = 0; + struct mail_keywords *keywords = NULL; + time_t internal_date = (time_t) -1; + int ret, timezone_offset = 0; + int fds[2]; + + literal = imap_parser_get_literal_size(ctx->save_parser, + &ctx->cat.literal_size); + client->input_skip_line = !literal; + nonsync = imap_parser_has_nonsync_literal(ctx->save_parser); + + if (ctx->failed) + return catenate_cancel(ctx, nonsync); + + /* [<flags>] */ + if (args->type == IMAP_ARG_LIST) { + const struct imap_arg *flags_list = IMAP_ARG_LIST_ARGS(args); + const char *const *keywords_list = NULL; + ++args; + + if (!client_parse_mail_flags(cmd, flags_list, + &flags, &keywords_list)) + return catenate_cancel(ctx, nonsync); + if (keywords_list != NULL && + mailbox_keywords_create(ctx->box, keywords_list, + &keywords) < 0) { + client_send_storage_error(cmd, ctx->storage); + return catenate_cancel(ctx, nonsync); + } + } + + /* [<internal date>] */ + if (args->type == IMAP_ARG_STRING) { + const char *str = IMAP_ARG_STR(args); + ++args; + + if (!imap_parse_datetime(str, &internal_date, + &timezone_offset)) { + client_send_tagline(cmd, "BAD Invalid internal date."); + if (keywords != NULL) + mailbox_keywords_free(ctx->box, &keywords); + return catenate_cancel(ctx, nonsync); + } + + if (internal_date != (time_t)-1 && + internal_date > ioloop_time + INTERNALDATE_MAX_FUTURE_SECS) { + internal_date = (time_t)-1; + timezone_offset = 0; + } + } + + if (args->type != IMAP_ARG_ATOM || + strcasecmp(args->_data.str, "CATENATE") != 0 || + args[1].type != IMAP_ARG_LIST) { + // do not use client_send_command_error() + client_send_tagline(cmd, "BAD Invalid arguments."); + if (keywords != NULL) + mailbox_keywords_free(ctx->box, &keywords); + return catenate_cancel(ctx, nonsync); + } + ++args; + + /* MULTIAPPEND syntax on a single line, e.g.: + APPEND <mailbox> CATENATE (URL <url>) CATENATE (... */ + if (args[1].type != IMAP_ARG_EOL) + ctx->args = &args[1]; + + // remainder of CATENATE parsing cares only about the items in the list + args = IMAP_ARG_LIST_ARGS(args); + if (args->type == IMAP_ARG_EOL) { // empty list + client_send_tagline(cmd, "BAD Invalid arguments."); + if (keywords != NULL) + mailbox_keywords_free(ctx->box, &keywords); + return catenate_cancel(ctx, nonsync); + } + + /* The mailbox_save() API pulls data from an istream, and the + imap_fetch() API pushes data into an ostream. Dovecot does + not offer an ostream which feeds an istream, so use a UNIX + pipe. That's not the most efficient way to move the data + around, but dovecot's ostreams and istreams are sufficiently + complex (read: under-documented) that it's easier to use a + pipe than to write an ostream-to-istream module. Somebody + call a plumber. */ + if (pipe(fds) < 0) { + i_error("catenate_begin_parsing: pipe: %m"); + client_send_tagline(cmd, "NO "MAIL_ERRSTR_CRITICAL_MSG); + if (keywords != NULL) + mailbox_keywords_free(ctx->box, &keywords); + return catenate_cancel(ctx, nonsync); + } + fd_set_nonblock(fds[0], TRUE); + fd_set_nonblock(fds[1], TRUE); + ctx->cat.output = o_stream_create_fd(fds[1], PIPE_MAX, TRUE); + ctx->input = i_stream_create_fd(fds[0], PIPE_MAX, TRUE); + + /* start assembling the message */ + ctx->save_ctx = mailbox_save_alloc(ctx->t); + mailbox_save_set_flags(ctx->save_ctx, flags, keywords); + mailbox_save_set_received_date(ctx->save_ctx, + internal_date, timezone_offset); + ret = mailbox_save_begin(&ctx->save_ctx, ctx->input); + + if (keywords != NULL) + mailbox_keywords_free(ctx->box, &keywords); + + if (ret < 0) { + /* save initialization failed */ + client_send_storage_error(cmd, ctx->storage); + return catenate_cancel(ctx, nonsync); + } + ctx->msg_size = 0; + + return catenate_process_args(cmd, args, nonsync); +} + +static bool catenate_begin_cancel(struct client_command_context *cmd, + const struct imap_arg *args) +{ + struct client *client = cmd->client; + struct cmd_append_context *ctx = cmd->context; + bool literal, nonsync; + + literal = imap_parser_get_literal_size(ctx->save_parser, + &ctx->cat.literal_size); + client->input_skip_line = !literal; + nonsync = imap_parser_has_nonsync_literal(ctx->save_parser); + + /* [<flags>] */ + if (args->type == IMAP_ARG_LIST) + ++args; + + /* [<internal date>] */ + if (args->type == IMAP_ARG_STRING) + ++args; + + if (args->type != IMAP_ARG_ATOM || + strcasecmp(args->_data.str, "CATENATE") != 0 || + args[1].type != IMAP_ARG_LIST) + return catenate_cancel(ctx, nonsync); + ++args; + + /* MULTIAPPEND syntax on a single line, e.g.: + APPEND <mailbox> CATENATE (URL <url>) CATENATE (... */ + if (args[1].type != IMAP_ARG_EOL) + ctx->args = &args[1]; + + // remainder of CATENATE parsing cares only about the items in the list + args = IMAP_ARG_LIST_ARGS(args); + if (args->type == IMAP_ARG_EOL) // empty list + return catenate_cancel(ctx, nonsync); + + return catenate_cancel_args(cmd, args, nonsync); +} + +static bool catenate_process_args(struct client_command_context *cmd, + const struct imap_arg *args, bool nonsync) +{ + struct cmd_append_context *ctx = cmd->context; + + /* [URL <url>] ... [URL <literal>] */ + while (args->type == IMAP_ARG_ATOM && + strcasecmp(args->_data.str, "URL") == 0) { + if (++ctx->cat.parts > MAX_CATENATE_PARTS) { + client_send_tagline(cmd, + "BAD Too many message parts."); + return catenate_cancel(ctx, nonsync); + } + + ++args; + if (args->type == IMAP_ARG_ATOM || + args->type == IMAP_ARG_STRING) { + if (!catenate_url(ctx, args->_data.str)) + return catenate_cancel(ctx, nonsync); + ++args; + } else if (args->type == IMAP_ARG_LITERAL_SIZE || + args->type == IMAP_ARG_LITERAL_SIZE_NONSYNC) { + if (ctx->cat.literal_size > MAX_URL_LITERAL_SIZE) { + client_send_tagline(cmd, + "BAD URL literal too large"); + return catenate_cancel(ctx, nonsync); + } + + catenate_solicit(ctx, nonsync); + cmd->func = catenate_continue_url; + return catenate_continue_url(cmd); + } else { + client_send_tagline(cmd, "BAD Invalid arguments."); + return catenate_cancel(ctx, nonsync); + } + } + + /* [TEXT <literal>] */ + if (args->type == IMAP_ARG_ATOM && + strcasecmp(args->_data.str, "TEXT") == 0 && + (args[1].type == IMAP_ARG_LITERAL_SIZE || + args[1].type == IMAP_ARG_LITERAL_SIZE_NONSYNC)) { + if (++ctx->cat.parts > MAX_CATENATE_PARTS) { + client_send_tagline(cmd, + "BAD Too many message parts."); + return catenate_cancel(ctx, nonsync); + } + + ctx->msg_size += ctx->cat.literal_size; + if (ctx->msg_size > MAX_CATENATE_MSG_SIZE) { + client_send_tagline(cmd, + "NO [TOOBIG] Resulting message too large"); + return catenate_cancel(ctx, nonsync); + } + + catenate_solicit(ctx, nonsync); + cmd->func = catenate_continue_text; + return catenate_continue_text(cmd); + } else if (args->type != IMAP_ARG_EOL) { + client_send_tagline(cmd, "BAD Invalid arguments."); + return catenate_cancel(ctx, nonsync); + } + + return catenate_finish(ctx, FALSE); +} + +static bool catenate_cancel_args(struct client_command_context *cmd, + const struct imap_arg *args, bool nonsync) +{ + struct cmd_append_context *ctx = cmd->context; + + /* [URL <url>] ... [URL <literal>] */ + while (args->type == IMAP_ARG_ATOM && + strcasecmp(args->_data.str, "URL") == 0) { + ++args; + if (args->type == IMAP_ARG_ATOM || + args->type == IMAP_ARG_STRING) + ++args; + else if (args->type == IMAP_ARG_LITERAL_SIZE || + args->type == IMAP_ARG_LITERAL_SIZE_NONSYNC) + return catenate_cancel(ctx, nonsync); + } + + /* [TEXT <literal>] */ + if (args->type == IMAP_ARG_ATOM && + strcasecmp(args->_data.str, "TEXT") == 0 && + (args[1].type == IMAP_ARG_LITERAL_SIZE || + args[1].type == IMAP_ARG_LITERAL_SIZE_NONSYNC)) + return catenate_cancel(ctx, nonsync); + else if (args->type != IMAP_ARG_EOL) + return catenate_cancel(ctx, nonsync); + + return catenate_finish(ctx, TRUE); +} diff -Nur dovecot-1.2.11/src/imap/cmd-delete.c dovecot-1.2.11+lemonade/src/imap/cmd-delete.c --- dovecot-1.2.11/src/imap/cmd-delete.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/cmd-delete.c 2010-04-08 09:59:12.000000000 -0500 @@ -4,6 +4,10 @@ #include "commands.h" #include "mail-namespace.h" +/* APPLE - urlauth */ +void (*hook_delete_mailbox)(struct mail_storage *storage, + const char *mailbox) = NULL; + bool cmd_delete(struct client_command_context *cmd) { struct client *client = cmd->client; @@ -51,6 +55,10 @@ if (mailbox_list_delete_mailbox(list, name) < 0) client_send_list_error(cmd, list); else { + /* APPLE - urlauth */ + if (hook_delete_mailbox) + hook_delete_mailbox(storage, name); + client_send_tagline(cmd, "OK Delete completed."); } return TRUE; diff -Nur dovecot-1.2.11/src/imap/cmd-fetch.c dovecot-1.2.11+lemonade/src/imap/cmd-fetch.c --- dovecot-1.2.11/src/imap/cmd-fetch.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/cmd-fetch.c 2010-04-08 09:59:12.000000000 -0500 @@ -20,7 +20,7 @@ "FLAGS", "INTERNALDATE", "RFC822.SIZE", "ENVELOPE", "BODY", NULL }; -static bool +bool /* APPLE was static - urlauth */ fetch_parse_args(struct imap_fetch_context *ctx, const struct imap_arg *arg, const struct imap_arg **next_arg_r) { diff -Nur dovecot-1.2.11/src/imap/cmd-rename.c dovecot-1.2.11+lemonade/src/imap/cmd-rename.c --- dovecot-1.2.11/src/imap/cmd-rename.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/cmd-rename.c 2010-04-08 09:59:12.000000000 -0500 @@ -52,6 +52,12 @@ if (mailbox_list_rename_mailbox(list, oldname, newname) < 0) client_send_list_error(cmd, list); else { + /* APPLE - urlauth */ + extern void (*hook_delete_mailbox)(struct mail_storage *storage, + const char *mailbox); + if (hook_delete_mailbox) + hook_delete_mailbox(old_storage, oldname); + client_send_tagline(cmd, "OK Rename completed."); } return TRUE; diff -Nur dovecot-1.2.11/src/imap/cmd-select.c dovecot-1.2.11+lemonade/src/imap/cmd-select.c --- dovecot-1.2.11/src/imap/cmd-select.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/cmd-select.c 2010-04-08 09:59:12.000000000 -0500 @@ -10,6 +10,9 @@ #include <stdlib.h> +/* APPLE - urlauth */ +void (*hook_select_send_urlmech)(struct client *client) = NULL; + struct imap_select_context { struct client_command_context *cmd; struct mail_storage *storage; @@ -316,6 +319,10 @@ client->sync_last_full_modseq = status.highest_modseq; } + /* APPLE - urlauth */ + if (hook_select_send_urlmech) + hook_select_send_urlmech(client); + if (ctx->qresync_uid_validity == status.uidvalidity) { if (select_qresync(ctx) < 0) return -1; diff -Nur dovecot-1.2.11/src/imap/commands.c dovecot-1.2.11+lemonade/src/imap/commands.c --- dovecot-1.2.11/src/imap/commands.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/commands.c 2010-04-08 09:59:12.000000000 -0500 @@ -8,8 +8,12 @@ #include <stdlib.h> static const struct command imap4rev1_commands[] = { - { "CAPABILITY", cmd_capability, 0 }, - { "LOGOUT", cmd_logout, COMMAND_FLAG_BREAKS_MAILBOX }, + { "CAPABILITY", cmd_capability, 0 + /* APPLE - urlauth */ + | COMMAND_FLAG_OK_FOR_SUBMIT_USER }, + { "LOGOUT", cmd_logout, COMMAND_FLAG_BREAKS_MAILBOX + /* APPLE - urlauth */ + | COMMAND_FLAG_OK_FOR_SUBMIT_USER }, { "NOOP", cmd_noop, COMMAND_FLAG_BREAKS_SEQS }, { "APPEND", cmd_append, COMMAND_FLAG_BREAKS_SEQS }, @@ -43,7 +47,9 @@ static const struct command imap_ext_commands[] = { { "CANCELUPDATE", cmd_cancelupdate,0 }, { "ENABLE", cmd_enable, 0 }, - { "ID", cmd_id, 0 }, + { "ID", cmd_id, 0 + /* APPLE - urlauth */ + | COMMAND_FLAG_OK_FOR_SUBMIT_USER }, { "IDLE", cmd_idle, COMMAND_FLAG_BREAKS_SEQS | COMMAND_FLAG_REQUIRES_SYNC }, { "NAMESPACE", cmd_namespace, 0 }, diff -Nur dovecot-1.2.11/src/imap/commands.h dovecot-1.2.11+lemonade/src/imap/commands.h --- dovecot-1.2.11/src/imap/commands.h 2010-01-19 05:56:56.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/commands.h 2010-04-08 09:59:12.000000000 -0500 @@ -28,7 +28,10 @@ Dovecot internally returns it for all kinds of commands, but unfortunately RFC 5530 specifies it only for "delete something" operations. */ - COMMAND_FLAG_USE_NONEXISTENT = 0x10 + COMMAND_FLAG_USE_NONEXISTENT = 0x10, + + /* APPLE - urlauth */ + COMMAND_FLAG_OK_FOR_SUBMIT_USER = 0x20 }; struct command { @@ -108,4 +111,10 @@ bool cmd_select_full(struct client_command_context *cmd, bool readonly); bool cmd_subscribe_full(struct client_command_context *cmd, bool subscribe); +/* APPLE fetch_parse_args() was static - urlauth */ +struct imap_fetch_context; +bool fetch_parse_args(struct imap_fetch_context *ctx, + const struct imap_arg *arg, + const struct imap_arg **next_arg_r); + #endif diff -Nur dovecot-1.2.11/src/imap/imap-fetch-body.c dovecot-1.2.11+lemonade/src/imap/imap-fetch-body.c --- dovecot-1.2.11/src/imap/imap-fetch-body.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/imap-fetch-body.c 2010-04-08 09:59:12.000000000 -0500 @@ -113,6 +113,8 @@ else str_append_c(str, ' '); + /* APPLE - urlauth */ + if (!ctx->urlfetch) /* reduce code deltas */ str_append(str, get_body_name(body)); if (size != (uoff_t)-1) diff -Nur dovecot-1.2.11/src/imap/imap-fetch.c dovecot-1.2.11+lemonade/src/imap/imap-fetch.c --- dovecot-1.2.11/src/imap/imap-fetch.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/imap-fetch.c 2010-04-08 09:59:12.000000000 -0500 @@ -449,6 +449,10 @@ break; ctx->cur_mail = ctx->mail; + /* APPLE - urlauth */ + if (ctx->urlfetch) + ctx->urlfetched = TRUE; + else /* reduce code deltas */ str_printfa(ctx->cur_str, "* %u FETCH (", ctx->cur_mail->seq); ctx->first = TRUE; @@ -504,6 +508,9 @@ ctx->line_finished = TRUE; ctx->line_partial = FALSE; + + /* APPLE - urlauth */ + if (!ctx->urlfetch) /* reduce code deltas */ if (o_stream_send(client->output, ")\r\n", 3) < 0) return -1; client->last_output = ioloop_time; @@ -761,6 +768,8 @@ static int fetch_uid(struct imap_fetch_context *ctx, struct mail *mail, void *context ATTR_UNUSED) { + /* APPLE - urlauth */ + if (!ctx->urlfetch) /* reduce code deltas */ str_printfa(ctx->cur_str, "UID %u ", mail->uid); return 1; } diff -Nur dovecot-1.2.11/src/imap/imap-fetch.h dovecot-1.2.11+lemonade/src/imap/imap-fetch.h --- dovecot-1.2.11/src/imap/imap-fetch.h 2009-06-26 23:49:34.000000000 -0500 +++ dovecot-1.2.11+lemonade/src/imap/imap-fetch.h 2010-04-08 09:59:12.000000000 -0500 @@ -73,6 +73,8 @@ unsigned int partial_fetch:1; unsigned int send_vanished:1; unsigned int failed:1; + unsigned int urlfetch:1; /* APPLE - urlauth */ + unsigned int urlfetched:1; /* APPLE - urlauth */ }; void imap_fetch_handlers_register(const struct imap_fetch_handler *handlers, diff -Nur dovecot-1.2.11/src/imap/imap-search-args.c dovecot-1.2.11+lemonade/src/imap/imap-search-args.c --- dovecot-1.2.11/src/imap/imap-search-args.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/imap-search-args.c 2010-04-08 09:59:12.000000000 -0500 @@ -112,7 +112,7 @@ return 0; } -static int +int /* APPLE was static - urlauth */ imap_search_get_uidset_arg(struct client_command_context *cmd, const char *uidset, struct mail_search_args **args_r, const char **error_r) diff -Nur dovecot-1.2.11/src/imap/imap-search-args.h dovecot-1.2.11+lemonade/src/imap/imap-search-args.h --- dovecot-1.2.11/src/imap/imap-search-args.h 2009-02-21 13:17:03.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/imap/imap-search-args.h 2010-04-08 09:59:12.000000000 -0500 @@ -25,4 +25,10 @@ const char *set, bool uid, struct mail_search_args **search_args_r); +/* APPLE was static - urlauth */ +int imap_search_get_uidset_arg(struct client_command_context *cmd, + const char *uidset, + struct mail_search_args **args_r, + const char **error_r); + #endif diff -Nur dovecot-1.2.11/src/lib-imap/Makefile.am dovecot-1.2.11+lemonade/src/lib-imap/Makefile.am --- dovecot-1.2.11/src/lib-imap/Makefile.am 2008-11-15 13:04:59.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/lib-imap/Makefile.am 2010-04-08 09:59:13.000000000 -0500 @@ -15,6 +15,7 @@ imap-parser.c \ imap-quote.c \ imap-seqset.c \ + imap-url.c \ imap-utf7.c \ imap-util.c @@ -29,6 +30,7 @@ imap-resp-code.h \ imap-quote.h \ imap-seqset.h \ + imap-url.h \ imap-utf7.h \ imap-util.h diff -Nur dovecot-1.2.11/src/lib-imap/Makefile.in dovecot-1.2.11+lemonade/src/lib-imap/Makefile.in --- dovecot-1.2.11/src/lib-imap/Makefile.in 2010-03-08 11:31:07.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/lib-imap/Makefile.in 2010-04-08 09:59:13.000000000 -0500 @@ -55,7 +55,8 @@ imap-bodystructure.$(OBJEXT) imap-date.$(OBJEXT) \ imap-envelope.$(OBJEXT) imap-id.$(OBJEXT) imap-match.$(OBJEXT) \ imap-parser.$(OBJEXT) imap-quote.$(OBJEXT) \ - imap-seqset.$(OBJEXT) imap-utf7.$(OBJEXT) imap-util.$(OBJEXT) + imap-seqset.$(OBJEXT) imap-url.$(OBJEXT) imap-utf7.$(OBJEXT) \ + imap-util.$(OBJEXT) libimap_a_OBJECTS = $(am_libimap_a_OBJECTS) DEFAULT_INCLUDES = -I.@am__isrc@ -I$(top_builddir) depcomp = $(SHELL) $(top_srcdir)/depcomp @@ -75,11 +76,11 @@ am__noinst_HEADERS_DIST = imap-base-subject.h imap-bodystructure.h \ imap-date.h imap-envelope.h imap-id.h imap-match.h \ imap-parser.h imap-resp-code.h imap-quote.h imap-seqset.h \ - imap-utf7.h imap-util.h + imap-url.h imap-utf7.h imap-util.h am__pkginc_lib_HEADERS_DIST = imap-base-subject.h imap-bodystructure.h \ imap-date.h imap-envelope.h imap-id.h imap-match.h \ imap-parser.h imap-resp-code.h imap-quote.h imap-seqset.h \ - imap-utf7.h imap-util.h + imap-url.h imap-utf7.h imap-util.h am__vpath_adj_setup = srcdirstrip=`echo "$(srcdir)" | sed 's|.|.|g'`; am__vpath_adj = case $$p in \ $(srcdir)/*) f=`echo "$$p" | sed "s|^$$srcdirstrip/||"`;; \ @@ -275,6 +276,7 @@ imap-parser.c \ imap-quote.c \ imap-seqset.c \ + imap-url.c \ imap-utf7.c \ imap-util.c @@ -289,6 +291,7 @@ imap-resp-code.h \ imap-quote.h \ imap-seqset.h \ + imap-url.h \ imap-utf7.h \ imap-util.h @@ -352,6 +355,7 @@ @AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/imap-parser.Po@am__quote@ @AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/imap-quote.Po@am__quote@ @AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/imap-seqset.Po@am__quote@ +@AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/imap-url.Po@am__quote@ @AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/imap-utf7.Po@am__quote@ @AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/imap-util.Po@am__quote@ diff -Nur dovecot-1.2.11/src/lib-imap/imap-parser.c dovecot-1.2.11+lemonade/src/lib-imap/imap-parser.c --- dovecot-1.2.11/src/lib-imap/imap-parser.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/lib-imap/imap-parser.c 2010-04-08 09:59:13.000000000 -0500 @@ -133,7 +133,8 @@ return arg; } -static void imap_parser_open_list(struct imap_parser *parser) +/* APPLE - catenate - was static */ +void imap_parser_open_list(struct imap_parser *parser) { parser->list_arg = imap_arg_create(parser); parser->list_arg->type = IMAP_ARG_LIST; @@ -649,6 +650,37 @@ return TRUE; } +/* APPLE - catenate */ +bool imap_parser_has_nonsync_literal(struct imap_parser *parser) +{ + ARRAY_TYPE(imap_arg_list) *list; + struct imap_arg *args; + unsigned int count; + + list = &parser->root_list; + args = array_get_modifiable(&parser->root_list, &count); + i_assert(count > 1 && args[count-1].type == IMAP_ARG_EOL); + count--; + + while (args[count-1].type != IMAP_ARG_LITERAL_SIZE && + args[count-1].type != IMAP_ARG_LITERAL_SIZE_NONSYNC) { + if (args[count-1].type != IMAP_ARG_LIST) + return FALSE; + + /* maybe the list ends with nonsync literal */ + list = &args[count-1]._data.list; + args = array_get_modifiable(list, &count); + + /* you might think the same assertion above would apply + here, but if a list has IMAP_ARG_LITERAL_SIZE* + there is no IMAP_ARG_EOL after it */ + if (count == 0) + return FALSE; + } + + return args[count-1].type == IMAP_ARG_LITERAL_SIZE_NONSYNC; +} + void imap_parser_read_last_literal(struct imap_parser *parser) { ARRAY_TYPE(imap_arg_list) *list; diff -Nur dovecot-1.2.11/src/lib-imap/imap-parser.h dovecot-1.2.11+lemonade/src/lib-imap/imap-parser.h --- dovecot-1.2.11/src/lib-imap/imap-parser.h 2009-03-30 20:41:03.000000000 -0500 +++ dovecot-1.2.11+lemonade/src/lib-imap/imap-parser.h 2010-04-08 09:59:13.000000000 -0500 @@ -112,6 +112,9 @@ given. */ const char *imap_parser_get_error(struct imap_parser *parser, bool *fatal); +/* APPLE - catenate - was static */ +void imap_parser_open_list(struct imap_parser *parser); + /* Read a number of arguments. This function doesn't call i_stream_read(), you need to do that. Returns number of arguments read (may be less than count in case of EOL), -2 if more data is needed or -1 if error occurred. @@ -130,6 +133,9 @@ literal data when continuing argument parsing. */ void imap_parser_read_last_literal(struct imap_parser *parser); +/* APPLE - catenate */ +bool imap_parser_has_nonsync_literal(struct imap_parser *parser); + /* just like imap_parser_read_args(), but assume \n at end of data in input stream. */ int imap_parser_finish_line(struct imap_parser *parser, unsigned int count, diff -Nur dovecot-1.2.11/src/lib-imap/imap-url.c dovecot-1.2.11+lemonade/src/lib-imap/imap-url.c --- dovecot-1.2.11/src/lib-imap/imap-url.c 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/lib-imap/imap-url.c 2010-04-08 10:20:47.000000000 -0500 @@ -0,0 +1,741 @@ +/* + * Copyright (c) 2010 Apple Inc. All rights reserved. + * + * Redistribution and use in source and binary forms, with or without + * modification, are permitted provided that the following conditions + * are met: + * + * 1. Redistributions of source code must retain the above copyright + * notice, this list of conditions and the following disclaimer. + * 2. Redistributions in binary form must reproduce the above + * copyright notice, this list of conditions and the following + * disclaimer in the documentation and/or other materials provided + * with the distribution. + * 3. Neither the name of Apple Inc. ("Apple") nor the names of its + * contributors may be used to endorse or promote products derived + * from this software without specific prior written permission. + * + * THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND + * ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, + * THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A + * PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS + * CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF + * USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND + * ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, + * OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT + * OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF + * SUCH DAMAGE. + */ + +#include "lib.h" +#include "str.h" +#include "utc-mktime.h" +#include "imap-utf7.h" +#include "imap-url.h" + +#include <time.h> +#include <ctype.h> + +#define MECH_INTERNAL_ONLY 1 + +#define LOWALPHA "abcdefghijklmnopqrstuvwxyz" /* RFC 1738 */ +#define HIALPHA "ABCDEFGHIJKLMNOPQRSTUVWXYZ" /* RFC 1738 */ +#define ALPHA LOWALPHA""HIALPHA /* RFC 1738 */ +#define DIGIT "0123456789" /* RFC 1738 */ +#define SAFE "$-_.+" /* RFC 1738 */ +#define EXTRA "!*'()," /* RFC 1738 */ +#define UNRESERVED ALPHA""DIGIT""SAFE""EXTRA /* RFC 1738 */ +#define ESCAPE "%" /* RFC 1738 */ +#define UCHAR UNRESERVED""ESCAPE /* RFC 1738 */ +#define ACHAR UCHAR"&=~" /* RFC 2192 */ +#define BCHAR ACHAR":@/" /* RFC 2192 */ +#define HEXDIG DIGIT"ABCDEFabcdef" /* RFC 2234 */ +#define HOST_CHARS ALPHA".:-"DIGIT /* RFC 1738 */ +#define DATETIME_CHARS DIGIT".+-:TZ" /* RFC 3339 */ + +// any CHAR except "(" / ")" / "{" / SP / CTL / "%" / "*" / '"' / "\" / "]" +#define ATOM_CHARS "\ +!#$&'+,-./0123456789:;<=>?@\ +ABCDEFGHIJKLMNOPQRSTUVWXYZ[^_`\ +abcdefghijklmnopqrstuvwxyz|}~" + +// any CHAR except "(" / ")" / "{" / SP / CTL / "%" / "*" / '"' / "\" +#define ASTRING_CHARS ATOM_CHARS"]" + +static char atom_chars_allowed[256]; +static char astring_chars_allowed[256]; +static char quoted_allowed[256]; // any CHAR except '"' / "\" / CR / LF +static char quoted_specials_allowed[256]; // any CHAR except CR / LF +static char host_chars_allowed[256]; +static char url_resp_allowed[256]; +static bool initialized = FALSE; + +// initialize the *_allowed tables once +static void init_allowed(void) +{ + if (!initialized) { + const unsigned char *cp; + int i; + + for (cp = (const unsigned char *) ATOM_CHARS; *cp; cp++) + atom_chars_allowed[*cp & 0xff] = 1; + + for (cp = (const unsigned char *) ASTRING_CHARS; *cp; cp++) + astring_chars_allowed[*cp & 0xff] = 1; + + for (cp = (const unsigned char *) HOST_CHARS; *cp; cp++) + host_chars_allowed[*cp & 0xff] = 1; + + for (i = 0x01; i <= 0x7f; i++) + quoted_specials_allowed[i] = 1; + quoted_specials_allowed['\r'] = 0; + quoted_specials_allowed['\n'] = 0; + memcpy(quoted_allowed, quoted_specials_allowed, + sizeof quoted_allowed); + quoted_allowed['"'] = 0; + quoted_allowed['\\'] = 0; + + for (i = 0x01; i <= 0x09; i++) + url_resp_allowed[i] = 1; + for (i = 0x0b; i <= 0x0c; i++) + url_resp_allowed[i] = 1; + // RFC 4469 erroneously skips 0x5c but that's "\" not "]" + for (i = 0x0e; i <= 0x5c; i++) + url_resp_allowed[i] = 1; + for (i = 0x5e; i <= 0xfe; i++) + url_resp_allowed[i] = 1; + + initialized = TRUE; + } +} + +// URL-decode enc into dec (%XX decoding) +bool url_decode(const char *enc, string_t *dec) +{ + const char *cp; + + for (cp = enc; *cp; cp++) { + if (*cp == '%') { + unsigned int val; + if (cp[1] >= '0' && cp[1] <= '9') + val = cp[1] - '0'; + else if (cp[1] >= 'A' && cp[1] <= 'F') + val = 10 + cp[1] - 'A'; + else if (cp[1] >= 'a' && cp[1] <= 'f') + val = 10 + cp[1] - 'a'; + else + return FALSE; + val *= 16; + if (cp[2] >= '0' && cp[2] <= '9') + val += cp[2] - '0'; + else if (cp[2] >= 'A' && cp[2] <= 'F') + val += 10 + cp[2] - 'A'; + else if (cp[2] >= 'a' && cp[2] <= 'f') + val += 10 + cp[2] - 'a'; + else + return FALSE; + if (val == 0 || val > 0xff) + return FALSE; + str_append_c(dec, val); + cp += 2; + } else + str_append_c(dec, *cp); + } + + return TRUE; +} + +// parse an RFC 2192+4467 URL into its parts +void imap_url_parse(const char *url, struct imap_url_parts *parts) +{ + const char *rump, *p; + size_t s; + + rump = url; + + // "imap://" ... + if (strncasecmp(url, "imap://", 7) == 0) { + url += 7; + + // ... enc-user ... + s = strcspn(url, ";@"); + if (s <= 0) + return; + parts->user = t_strdup_until(url, url + s); + url += s; + + // ... [";AUTH=" ( "*" / enc_auth_type )] ... + if (strncasecmp(url, ";AUTH=", 6) == 0) { + url += 6; + p = strchr(url, '@'); + if (p == NULL) + return; + parts->auth_type = t_strdup_until(url, p); + url = p; + } + + // ... "@" hostport ... + if (*url != '@') + return; + ++url; + p = strchr(url, '/'); + if (p == NULL) + return; + parts->hostport = t_strdup_until(url, p); + url = p; + } + + // ... ["/" enc_mailbox] ... + if (*url == '/' && strncasecmp(url, "/;UID=", 6) != 0) { + ++url; + p = strcasestr(url, ";UIDVALIDITY="); + if (p == NULL) + p = strcasestr(url, "/;UID="); + if (p == NULL) + return; + parts->mailbox = t_strdup_until(url, p); + url = p; + } + + // ... [";UIDVALIDITY=" nz_number] ... + if (strncasecmp(url, ";UIDVALIDITY=", 13) == 0) { + url += 13; + p = strchr(url, '/'); + if (p == NULL) + return; + parts->uidvalidity = t_strdup_until(url, p); + url = p; + } + + // ... ["/;UID=" nz_number] ... + if (strncasecmp(url, "/;UID=", 6) == 0) { + url += 6; + s = strcspn(url, ";/"); + if (s <= 0) + return; + parts->uid = t_strdup_until(url, url + s); + url += s; + } + + // ... ["/;SECTION=" enc_section] ... + if (strncasecmp(url, "/;SECTION=", 10) == 0) { + url += 10; + p = strchr(url, ';'); + if (p == NULL) { + parts->section = t_strdup(url); + return; + } + parts->section = t_strdup_until(url, p); + url = p; + } + + // ... [";EXPIRE=" date-time] ... + if (strncasecmp(url, ";EXPIRE=", 8) == 0) { + url += 8; + p = strchr(url, ';'); + if (p == NULL) + return; + parts->expiration = t_strdup_until(url, p); + // set expiration_time after decoding + url = p; + } + + // ... [";URLAUTH=" access] ... + if (strncasecmp(url, ";URLAUTH=", 9) != 0) + return; + url += 9; + p = strchr(url, ':'); + if (p == NULL) { + parts->access = url; + return; + } + parts->access = t_strdup_until(url, p); + url = p; + + // save rump + parts->rump = t_strdup_until(rump, url); + + // ... [ ":INTERNAL:" 32*HEXDIG ] + if (strncasecmp(url, ":INTERNAL:", 10) != 0) + return; + parts->mechanism = "INTERNAL"; + url += 10; + parts->urlauth = url; +} + +// parse an RFC 3339 date-time into a time_t, or return 0 +static time_t imap_url_date_time_parse(const char *s) +{ + struct tm tm; + time_t t; + + memset(&tm, 0, sizeof tm); + + /* YYYY- */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1]) || + !i_isdigit(s[2]) || !i_isdigit(s[3]) || s[4] != '-') + return 0; + tm.tm_year = (((s[0] - '0') * 10 + s[1] - '0') * 10 + + s[2] - '0') * 10 + s[3] - '0' - 1900; + s += 5; + + /* MM- */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1]) || s[2] != '-') + return 0; + tm.tm_mon = (s[0] - '0') * 10 + s[1] - '0'; + if (tm.tm_mon < 1 || tm.tm_mon > 12) + return 0; + --tm.tm_mon; /* 0-11 not 1-12 */ + s += 3; + + /* DDT */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1]) || i_toupper(s[2]) != 'T') + return 0; + tm.tm_mday = (s[0] - '0') * 10 + s[1] - '0'; + s += 3; + + /* HH: */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1]) || s[2] != ':') + return 0; + tm.tm_hour = (s[0] - '0') * 10 + s[1] - '0'; + s += 3; + + /* MM: */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1]) || s[2] != ':') + return 0; + tm.tm_min = (s[0] - '0') * 10 + s[1] - '0'; + s += 3; + + /* SS */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1])) + return 0; + tm.tm_sec = (s[0] - '0') * 10 + s[1] - '0'; + s += 2; + + /* skip optional fractional seconds */ + if (*s == '.') { + do + ++s; + while (i_isdigit(*s)); + } + + if (i_toupper(s[0]) == 'Z' && s[1] == '\0') + tm.tm_gmtoff = 0; + else if (s[0] == '+' || s[0] == '-') { + char tzsign = *s++; + + /* HH: */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1]) || s[2] != ':') + return 0; + tm.tm_gmtoff = ((s[0] - '0') * 10 + s[1] - '0') * 3600; + s += 3; + + /* MM */ + if (!i_isdigit(s[0]) || !i_isdigit(s[1]) || s[2] != '\0') + return 0; + tm.tm_gmtoff += ((s[0] - '0') * 10 + s[1] - '0') * 60; + + if (tzsign == '-') + tm.tm_gmtoff = -tm.tm_gmtoff; + } else + return 0; + + t = utc_mktime(&tm); + if (t < 0) + return 0; + return t - tm.tm_gmtoff; +} + +// decode the parts of a URL +bool imap_url_decode(const struct imap_url_parts *enc_parts, + struct imap_url_parts *dec_parts, + const char **error) +{ + string_t *str = t_str_new(256); + +#define URL_DECODE(field, name) \ + if (enc_parts->field != NULL) { \ + if (url_decode(enc_parts->field, str)) \ + dec_parts->field = t_strdup(str_c(str)); \ + else { \ + *error = "invalid " name; \ + str_free(&str); \ + return FALSE; \ + } \ + } \ + str_truncate(str, 0); + + URL_DECODE(user, "user ID"); + URL_DECODE(auth_type, "auth type"); + URL_DECODE(hostport, "server"); + URL_DECODE(mailbox, "mailbox"); + URL_DECODE(uidvalidity, "uidvalidity"); + URL_DECODE(uid, "uid"); + URL_DECODE(section, "section"); + URL_DECODE(expiration, "expiration"); + URL_DECODE(access, "access ID"); + URL_DECODE(mechanism, "mechanism"); + URL_DECODE(urlauth, "urlauth token"); + // do not set dec_parts->rump + + if (dec_parts->mailbox != NULL) { + if (imap_utf8_to_utf7(dec_parts->mailbox, str) == 0) + dec_parts->mailbox = t_strdup(str_c(str)); + else { + *error = "invalid UTF-8 mailbox"; + str_free(&str); + return FALSE; + } + } + str_truncate(str, 0); + + if (dec_parts->expiration != NULL) + dec_parts->expiration_time = + imap_url_date_time_parse(dec_parts->expiration); + + str_free(&str); + + return TRUE; +} + +// validate conformance to RFC 3501 "atom" +bool imap_url_atom_validate(const char *s) +{ + const unsigned char *cp; + + if (*s == '\0') + return FALSE; + + init_allowed(); + + for (cp = (const unsigned char *) s; *cp; cp++) + if (!atom_chars_allowed[*cp & 0xff]) + return FALSE; + return TRUE; +} + +// validate conformance to RFC 3501 "ASTRING-CHAR" +bool imap_url_astring_chars_validate(const char *s) +{ + const unsigned char *cp; + + init_allowed(); + + for (cp = (const unsigned char *) s; *cp; cp++) + if (!astring_chars_allowed[*cp & 0xff]) + return FALSE; + return TRUE; +} + +// validate conformance to RFC 3501 "quoted" +bool imap_url_quoted_validate(const char *s) +{ + const unsigned char *cp; + + if (*s != '"') + return FALSE; + + init_allowed(); + + for (cp = (unsigned char *) s + 1; *cp; cp++) { + if (*cp == '\\') { + if (!quoted_specials_allowed[cp[1] & 0xff]) + return FALSE; + ++cp; + } else if (*cp == '"') + return cp[1] == '\0'; + else { + if (!quoted_allowed[*cp & 0xff]) + return FALSE; + } + } + + return FALSE; +} + +// validate conformance to RFC 3501 "literal" +bool imap_url_literal_validate(const char *s) +{ + const unsigned char *cp; + unsigned int length = 0; + + if (*s != '{') + return FALSE; + for (cp = (const unsigned char *) s + 1; *cp && *cp != '}'; cp++) { + if (*cp < '0' || *cp > '9') + return FALSE; + length = length * 10 + *cp - '0'; + } + if (cp == (const unsigned char *) s + 1 || *cp != '}') + return FALSE; + ++cp; + if (*cp == '\r') + ++cp; + if (*cp != '\n') + return FALSE; + if (strlen((const char *) cp + 1) != length) + return FALSE; + return TRUE; +} + +// validate conformance to RFC 3501 "astring" +bool imap_url_astring_validate(const char *s) +{ + return *s != '\0' && + (imap_url_astring_chars_validate(s) || + imap_url_quoted_validate(s) || + imap_url_literal_validate(s)); +} + +// validate conformance to RFC 1738 "hostport" +bool imap_url_hostport_validate(const char *s) +{ + const unsigned char *cp; + + if (*s == '\0') + return FALSE; + + init_allowed(); + + for (cp = (const unsigned char *) s; *cp; cp++) + if (!host_chars_allowed[*cp & 0xff]) + return FALSE; + return TRUE; +} + +// validate conformance to RFC 3501 "mailbox" +bool imap_url_mailbox_validate(const char *s) +{ + const char *qs; + + if (strcasecmp(s, "INBOX") == 0 || imap_url_astring_validate(s)) + return TRUE; + + // RFC 2192 implies quotes around mailboxes containing, e.g., SP + qs = t_strconcat("\"", s, "\"", NULL); + return imap_url_quoted_validate(qs); +} + +// validate conformance to RFC 3501 "nz_number" +bool imap_url_nz_number_validate(const char *s) +{ + if (*s < '1' || *s > '9') + return FALSE; + while (*++s) + if (*s < '0' || *s > '9') + return FALSE; + return TRUE; +} + +// validate conformance to RFC 3501 "section-text" +bool imap_url_section_text_validate(const char *s) +{ + size_t spn; + const char *field; + + if (strcasecmp(s, "HEADER") == 0 || + strcasecmp(s, "TEXT") == 0 || + strcasecmp(s, "MIME") == 0) + return TRUE; + + if (strncasecmp(s, "HEADER.FIELDS", 13) != 0) + return FALSE; + s += 13; + + if (strncasecmp(s, ".NOT", 4) == 0) + s += 4; + + if (*s != ' ') + return FALSE; + ++s; + + if (*s != '(') + return FALSE; + ++s; + + spn = strcspn(s, " )"); + if (spn <= 0) + return FALSE; + field = t_strdup_until(s, s + spn); + if (!imap_url_astring_validate(field)) + return FALSE; + s += spn; + + while (*s == ' ') { + ++s; + spn = strcspn(s, " )"); + if (spn <= 0) + return FALSE; + field = t_strdup_until(s, s + spn); + if (!imap_url_astring_validate(field)) + return FALSE; + s += spn; + } + + if (*s != ')') + return FALSE; + ++s; + + return *s == '\0'; +} + +// validate conformance to RFC 2192 "section" +bool imap_url_section_validate(const char *s) +{ + size_t spn; + const char *part; + + if (imap_url_section_text_validate(s)) + return TRUE; + + spn = strspn(s, DIGIT); + if (spn <= 0) + return FALSE; + part = t_strdup_until(s, s + spn); + if (!imap_url_nz_number_validate(part)) + return FALSE; + s += spn; + + while (*s == '.') { + ++s; + spn = strspn(s, DIGIT); + if (spn <= 0) { + --s; + break; + } + part = t_strdup_until(s, s + spn); + if (!imap_url_nz_number_validate(part)) + return FALSE; + s += spn; + } + + if (*s == '.') { + ++s; + return imap_url_section_text_validate(s); + } + + return *s == '\0'; +} + +// validate conformance to RFC 3339 "date-time" +bool imap_url_datetime_validate(const char *s) +{ + return *s != '\0' && strspn(s, DATETIME_CHARS) == strlen(s); +} + +// validate conformance to RFC 4467 "access" +bool imap_url_access_validate(const char *s) +{ + if (strncasecmp(s, "submit+", 7) == 0) + return imap_url_astring_validate(s + 7); + if (strncasecmp(s, "user+", 5) == 0) + return imap_url_astring_validate(s + 5); + return strcasecmp(s, "authuser") == 0 || + strcasecmp(s, "anonymous") == 0; +} + +// validate conformance to RFC 4467 "mechanism" +bool imap_url_mechanism_validate(const char *s) +{ +#if MECH_INTERNAL_ONLY + return strcasecmp(s, "INTERNAL") == 0; +#else + if (strcasecmp(s, "INTERNAL") == 0) + return TRUE; + if (*s == '\0') + return FALSE; + do { + if ((*s < 'A' || *s > 'Z') && + (*s < 'a' || *s > 'z') && + (*s < '0' || *s > '9') && + *s != '-' && *s != '.') + return FALSE; + } while (*++s); + return TRUE; +#endif +} + +// validate conformance to RFC 4467 "urlauth" (really enc-urlauth) +bool imap_url_urlauth_validate(const char *s) +{ + const char *cp; + + for (cp = s; *cp; cp++) { + if ((*cp < '0' || *cp > '9') && + (*cp < 'A' || *cp > 'F') && + (*cp < 'a' || *cp > 'f')) + return FALSE; + } + + return cp - s >= 32; +} + +// convert URL parts into a real URL +void imap_url_construct(const struct imap_url_parts *parts, string_t *url) +{ + str_append(url, "imap://"); + if (parts->user) + str_append(url, parts->user); + if (parts->auth_type) { + str_append(url, ";AUTH="); + str_append(url, parts->auth_type); + } + if (parts->hostport) { + str_append_c(url, '@'); + str_append(url, parts->hostport); + } + str_append_c(url, '/'); + if (parts->mailbox) + str_append(url, parts->mailbox); + if (parts->uidvalidity) { + str_append(url, ";UIDVALIDITY="); + str_append(url, parts->uidvalidity); + } + if (parts->uid) { + str_append(url, "/;UID="); + str_append(url, parts->uid); + } + if (parts->section) { + str_append(url, "/;SECTION="); + str_append(url, parts->section); + } + if (parts->expiration) { + str_append(url, ";EXPIRE="); + str_append(url, parts->expiration); + } + if (parts->access) { + str_append(url, ";URLAUTH="); + str_append(url, parts->access); + } + if (parts->mechanism) { + str_append_c(url, ':'); + str_append(url, parts->mechanism); + } + if (parts->urlauth) { + str_append_c(url, ':'); + str_append(url, parts->urlauth); + } +} + +// filter a URL according to RFC 4469 url-resp-text +const char *imap_url_sanitize(const char *url) +{ + const char *cp; + string_t *str; + + init_allowed(); + + for (cp = url; *cp && url_resp_allowed[(unsigned char) *cp]; cp++) + ; + if (*cp == '\0') + return url; + + str = t_str_new(strlen(cp) + 1); + str_append_n(str, url, cp - url); + for ( ; *cp; cp++) + str_append_c(str, + url_resp_allowed[(unsigned char) *cp] ? *cp : '?'); + return str_c(str); +} diff -Nur dovecot-1.2.11/src/lib-imap/imap-url.h dovecot-1.2.11+lemonade/src/lib-imap/imap-url.h --- dovecot-1.2.11/src/lib-imap/imap-url.h 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/lib-imap/imap-url.h 2010-03-05 14:14:18.000000000 -0600 @@ -0,0 +1,100 @@ +/* + * Copyright (c) 2010 Apple Inc. All rights reserved. + * + * Redistribution and use in source and binary forms, with or without + * modification, are permitted provided that the following conditions + * are met: + * + * 1. Redistributions of source code must retain the above copyright + * notice, this list of conditions and the following disclaimer. + * 2. Redistributions in binary form must reproduce the above + * copyright notice, this list of conditions and the following + * disclaimer in the documentation and/or other materials provided + * with the distribution. + * 3. Neither the name of Apple Inc. ("Apple") nor the names of its + * contributors may be used to endorse or promote products derived + * from this software without specific prior written permission. + * + * THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND + * ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, + * THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A + * PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS + * CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF + * USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND + * ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, + * OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT + * OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF + * SUCH DAMAGE. + */ + +/* APPLE - urlauth, catenate */ + +#ifndef IMAP_URL_H +#define IMAP_URL_H + +struct imap_url_parts { + const char *user; + const char *auth_type; + const char *hostport; + const char *mailbox; + const char *uidvalidity; + const char *uid; + const char *section; + const char *expiration; + time_t expiration_time; + const char *access; + const char *mechanism; + const char *urlauth; + + const char *rump; +}; + +// URL-decode enc into dec (%XX decoding) +bool url_decode(const char *enc, string_t *dec); + +// parse an RFC 2192+4467 URL into its parts +void imap_url_parse(const char *url, struct imap_url_parts *parts); + +// decode the parts of an IMAP URL +bool imap_url_decode(const struct imap_url_parts *enc_parts, + struct imap_url_parts *dec_parts, + const char **error); + +// validate conformance to RFC 3501 "atom" +bool imap_url_atom_validate(const char *s); +// validate conformance to RFC 3501 "ASTRING-CHAR" +bool imap_url_astring_chars_validate(const char *s); +// validate conformance to RFC 3501 "quoted" +bool imap_url_quoted_validate(const char *s); +// validate conformance to RFC 3501 "literal" +bool imap_url_literal_validate(const char *s); +// validate conformance to RFC 3501 "astring" +bool imap_url_astring_validate(const char *s); +// validate conformance to RFC 1738 "hostport" +bool imap_url_hostport_validate(const char *s); +// validate conformance to RFC 3501 "mailbox" +bool imap_url_mailbox_validate(const char *s); +// validate conformance to RFC 3501 "nz_number" +bool imap_url_nz_number_validate(const char *s); +// validate conformance to RFC 3501 "section-text" +bool imap_url_section_text_validate(const char *s); +// validate conformance to RFC 2192 "section" +bool imap_url_section_validate(const char *s); +// validate conformance to RFC 3339 "date-time" +bool imap_url_datetime_validate(const char *s); +// validate conformance to RFC 4467 "access" +bool imap_url_access_validate(const char *s); +// validate conformance to RFC 4467 "mechanism" +bool imap_url_mechanism_validate(const char *s); +// validate conformance to RFC 4467 "urlauth" (really enc-urlauth) +bool imap_url_urlauth_validate(const char *s); + +// build a URL from parts +void imap_url_construct(const struct imap_url_parts *parts, string_t *url); + +// filter a URL according to RFC 4469 url-resp-text +const char *imap_url_sanitize(const char *url); + +#endif diff -Nur dovecot-1.2.11/src/master/auth-process.c dovecot-1.2.11+lemonade/src/master/auth-process.c --- dovecot-1.2.11/src/master/auth-process.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/master/auth-process.c 2010-04-08 09:59:13.000000000 -0500 @@ -470,6 +470,10 @@ env_put(t_strdup_printf("PASSDB_%u_PASS=1", i)); if (ap->master) env_put(t_strdup_printf("PASSDB_%u_MASTER=1", i)); + + /* APPLE - urlauth */ + if (ap->submit) + env_put(t_strdup_printf("PASSDB_%u_SUBMIT=1", i)); } for (au = set->userdbs, i = 1; au != NULL; au = au->next, i++) { env_put(t_strdup_printf("USERDB_%u_DRIVER=%s", i, au->driver)); diff -Nur dovecot-1.2.11/src/master/mail-process.c dovecot-1.2.11+lemonade/src/master/mail-process.c --- dovecot-1.2.11/src/master/mail-process.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/master/mail-process.c 2010-04-08 09:59:13.000000000 -0500 @@ -349,6 +349,13 @@ set->imap_logout_format, NULL)); env_put(t_strconcat("IMAP_ID_SEND=", set->imap_id_send, NULL)); env_put(t_strconcat("IMAP_ID_LOG=", set->imap_id_log, NULL)); + + /* APPLE - urlauth */ + if (set->server && set->server->auths) + env_put(t_strconcat("AUTH_ANONYMOUS_USERNAME=", + set->server->auths->anonymous_username, + NULL)); + env_put(t_strdup_printf("IMAP_IDLE_NOTIFY_INTERVAL=%u", set->imap_idle_notify_interval)); } @@ -636,7 +643,9 @@ uid = (uid_t)strtoul(*args + 4, NULL, 10); } else if (strncmp(*args, "gid=", 4) == 0) { gid = (gid_t)strtoul(*args + 4, NULL, 10); - } else if (strncmp(*args, "master_user=", 12) == 0) { + } else if (strncmp(*args, "master_user=", 12) == 0 || + /* APPLE - urlauth */ + strncmp(*args, "submit_user=", 12) == 0) { const char *arg = *args; master_user = arg + 12; diff -Nur dovecot-1.2.11/src/master/master-settings.c dovecot-1.2.11+lemonade/src/master/master-settings.c --- dovecot-1.2.11/src/master/master-settings.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/master/master-settings.c 2010-04-08 09:59:13.000000000 -0500 @@ -134,6 +134,7 @@ DEF_BOOL(deny), DEF_BOOL(pass), DEF_BOOL(master), + DEF_BOOL(submit), /* APPLE - urlauth */ { 0, NULL, 0 } }; diff -Nur dovecot-1.2.11/src/master/master-settings.h dovecot-1.2.11+lemonade/src/master/master-settings.h --- dovecot-1.2.11/src/master/master-settings.h 2010-01-22 10:46:52.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/master/master-settings.h 2010-04-08 09:59:13.000000000 -0500 @@ -182,6 +182,7 @@ bool deny; bool pass; bool master; + bool submit; /* APPLE - urlauth */ }; struct auth_userdb_settings { diff -Nur dovecot-1.2.11/src/plugins/Makefile.am dovecot-1.2.11+lemonade/src/plugins/Makefile.am --- dovecot-1.2.11/src/plugins/Makefile.am 2010-01-24 17:03:13.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/Makefile.am 2010-04-08 09:59:13.000000000 -0500 @@ -25,6 +25,7 @@ quota \ imap-quota \ trash \ + urlauth \ virtual \ $(ZLIB) \ $(FTS_LUCENE) \ diff -Nur dovecot-1.2.11/src/plugins/Makefile.in dovecot-1.2.11+lemonade/src/plugins/Makefile.in --- dovecot-1.2.11/src/plugins/Makefile.in 2010-03-08 11:31:10.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/Makefile.in 2010-04-08 09:59:13.000000000 -0500 @@ -61,7 +61,7 @@ CTAGS = ctags DIST_SUBDIRS = acl imap-acl autocreate convert expire fts fts-squat \ lazy-expunge listescape mail-log mbox-snarf quota imap-quota \ - trash virtual zlib fts-lucene fts-solr + trash urlauth virtual zlib fts-lucene fts-solr DISTFILES = $(DIST_COMMON) $(DIST_SOURCES) $(TEXINFOS) $(EXTRA_DIST) am__relativize = \ dir0=`pwd`; \ @@ -259,6 +259,7 @@ quota \ imap-quota \ trash \ + urlauth \ virtual \ $(ZLIB) \ $(FTS_LUCENE) \ diff -Nur dovecot-1.2.11/src/plugins/acl/acl-mailbox-list.c dovecot-1.2.11+lemonade/src/plugins/acl/acl-mailbox-list.c --- dovecot-1.2.11/src/plugins/acl/acl-mailbox-list.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/acl/acl-mailbox-list.c 2010-04-08 09:59:13.000000000 -0500 @@ -537,6 +537,11 @@ owner_username = list->ns->user->username; current_username = auser->master_user; + + /* APPLE - urlauth */ + if (current_username == NULL) + current_username = auser->submit_user; + if (current_username == NULL) current_username = owner_username; else diff -Nur dovecot-1.2.11/src/plugins/acl/acl-plugin.h dovecot-1.2.11+lemonade/src/plugins/acl/acl-plugin.h --- dovecot-1.2.11/src/plugins/acl/acl-plugin.h 2008-11-16 11:08:55.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/acl/acl-plugin.h 2010-04-08 09:59:13.000000000 -0500 @@ -14,6 +14,7 @@ union mail_user_module_context module_ctx; const char *master_user; + const char *submit_user; /* APPLE - urlauth */ const char *acl_env; const char *const *groups; diff -Nur dovecot-1.2.11/src/plugins/acl/acl-storage.c dovecot-1.2.11+lemonade/src/plugins/acl/acl-storage.c --- dovecot-1.2.11/src/plugins/acl/acl-storage.c 2010-01-24 17:14:17.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/acl/acl-storage.c 2010-04-08 09:59:13.000000000 -0500 @@ -244,6 +244,7 @@ auser->acl_env = getenv("ACL"); i_assert(auser->acl_env != NULL); auser->master_user = getenv("MASTER_USER"); + auser->submit_user = getenv("SUBMIT_USER"); /* APPLE - urlauth */ env = getenv("ACL_GROUPS"); if (env != NULL) { diff -Nur dovecot-1.2.11/src/plugins/urlauth/Makefile.am dovecot-1.2.11+lemonade/src/plugins/urlauth/Makefile.am --- dovecot-1.2.11/src/plugins/urlauth/Makefile.am 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/urlauth/Makefile.am 2010-03-05 14:39:44.000000000 -0600 @@ -0,0 +1,54 @@ +# +# Copyright (c) 2010 Apple Inc. All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# 1. Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# 2. Redistributions in binary form must reproduce the above +# copyright notice, this list of conditions and the following +# disclaimer in the documentation and/or other materials provided +# with the distribution. +# 3. Neither the name of Apple Inc. ("Apple") nor the names of its +# contributors may be used to endorse or promote products derived +# from this software without specific prior written permission. +# +# THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND +# ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, +# THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A +# PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS +# CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF +# USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND +# ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, +# OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT +# OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF +# SUCH DAMAGE. +# + +AM_CPPFLAGS = \ + -I$(top_srcdir)/src/lib \ + -I$(top_srcdir)/src/lib-imap \ + -I$(top_srcdir)/src/lib-index \ + -I$(top_srcdir)/src/lib-mail \ + -I$(top_srcdir)/src/lib-storage \ + -I$(top_srcdir)/src/imap + +imap_moduledir = $(moduledir)/imap + +lib10_urlauth_plugin_la_LDFLAGS = -module -avoid-version +lib10_urlauth_plugin_la_LIBADD = -lcrypto + +imap_module_LTLIBRARIES = \ + lib10_urlauth_plugin.la + +lib10_urlauth_plugin_la_SOURCES = \ + urlauth-keys.c \ + urlauth-plugin.c \ + urlauth.c + +noinst_HEADERS = \ + urlauth-plugin.h diff -Nur dovecot-1.2.11/src/plugins/urlauth/Makefile.in dovecot-1.2.11+lemonade/src/plugins/urlauth/Makefile.in --- dovecot-1.2.11/src/plugins/urlauth/Makefile.in 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/urlauth/Makefile.in 2010-03-05 14:39:44.000000000 -0600 @@ -0,0 +1,614 @@ +# Makefile.in generated by automake 1.11 from Makefile.am. +# @configure_input@ + +# Copyright (C) 1994, 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, +# 2003, 2004, 2005, 2006, 2007, 2008, 2009 Free Software Foundation, +# Inc. +# This Makefile.in is free software; the Free Software Foundation +# gives unlimited permission to copy and/or distribute it, +# with or without modifications, as long as this notice is preserved. + +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY, to the extent permitted by law; without +# even the implied warranty of MERCHANTABILITY or FITNESS FOR A +# PARTICULAR PURPOSE. + +@SET_MAKE@ + +# +# Copyright (c) 2010 Apple Inc. All rights reserved. +# +# Redistribution and use in source and binary forms, with or without +# modification, are permitted provided that the following conditions +# are met: +# +# 1. Redistributions of source code must retain the above copyright +# notice, this list of conditions and the following disclaimer. +# 2. Redistributions in binary form must reproduce the above +# copyright notice, this list of conditions and the following +# disclaimer in the documentation and/or other materials provided +# with the distribution. +# 3. Neither the name of Apple Inc. ("Apple") nor the names of its +# contributors may be used to endorse or promote products derived +# from this software without specific prior written permission. +# +# THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND +# ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, +# THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A +# PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS +# CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF +# USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND +# ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, +# OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT +# OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF +# SUCH DAMAGE. +# + + +VPATH = @srcdir@ +pkgdatadir = $(datadir)/@PACKAGE@ +pkgincludedir = $(includedir)/@PACKAGE@ +pkglibdir = $(libdir)/@PACKAGE@ +pkglibexecdir = $(libexecdir)/@PACKAGE@ +am__cd = CDPATH="$${ZSH_VERSION+.}$(PATH_SEPARATOR)" && cd +install_sh_DATA = $(install_sh) -c -m 644 +install_sh_PROGRAM = $(install_sh) -c +install_sh_SCRIPT = $(install_sh) -c +INSTALL_HEADER = $(INSTALL_DATA) +transform = $(program_transform_name) +NORMAL_INSTALL = : +PRE_INSTALL = : +POST_INSTALL = : +NORMAL_UNINSTALL = : +PRE_UNINSTALL = : +POST_UNINSTALL = : +build_triplet = @build@ +host_triplet = @host@ +subdir = src/plugins/urlauth +DIST_COMMON = $(noinst_HEADERS) $(srcdir)/Makefile.am \ + $(srcdir)/Makefile.in +ACLOCAL_M4 = $(top_srcdir)/aclocal.m4 +am__aclocal_m4_deps = $(top_srcdir)/configure.in +am__configure_deps = $(am__aclocal_m4_deps) $(CONFIGURE_DEPENDENCIES) \ + $(ACLOCAL_M4) +mkinstalldirs = $(install_sh) -d +CONFIG_HEADER = $(top_builddir)/config.h +CONFIG_CLEAN_FILES = +CONFIG_CLEAN_VPATH_FILES = +am__vpath_adj_setup = srcdirstrip=`echo "$(srcdir)" | sed 's|.|.|g'`; +am__vpath_adj = case $$p in \ + $(srcdir)/*) f=`echo "$$p" | sed "s|^$$srcdirstrip/||"`;; \ + *) f=$$p;; \ + esac; +am__strip_dir = f=`echo $$p | sed -e 's|^.*/||'`; +am__install_max = 40 +am__nobase_strip_setup = \ + srcdirstrip=`echo "$(srcdir)" | sed 's/[].[^$$\\*|]/\\\\&/g'` +am__nobase_strip = \ + for p in $$list; do echo "$$p"; done | sed -e "s|$$srcdirstrip/||" +am__nobase_list = $(am__nobase_strip_setup); \ + for p in $$list; do echo "$$p $$p"; done | \ + sed "s| $$srcdirstrip/| |;"' / .*\//!s/ .*/ ./; s,$ .*$/[^/]*$$,\1,' | \ + $(AWK) 'BEGIN { files["."] = "" } { files[$$2] = files[$$2] " " $$1; \ + if (++n[$$2] == $(am__install_max)) \ + { print $$2, files[$$2]; n[$$2] = 0; files[$$2] = "" } } \ + END { for (dir in files) print dir, files[dir] }' +am__base_list = \ + sed '$$!N;$$!N;$$!N;$$!N;$$!N;$$!N;$$!N;s/\n/ /g' | \ + sed '$$!N;$$!N;$$!N;$$!N;s/\n/ /g' +am__installdirs = "$(DESTDIR)$(imap_moduledir)" +LTLIBRARIES = $(imap_module_LTLIBRARIES) +lib10_urlauth_plugin_la_DEPENDENCIES = +am_lib10_urlauth_plugin_la_OBJECTS = urlauth-keys.lo urlauth-plugin.lo \ + urlauth.lo +lib10_urlauth_plugin_la_OBJECTS = \ + $(am_lib10_urlauth_plugin_la_OBJECTS) +lib10_urlauth_plugin_la_LINK = $(LIBTOOL) --tag=CC $(AM_LIBTOOLFLAGS) \ + $(LIBTOOLFLAGS) --mode=link $(CCLD) $(AM_CFLAGS) $(CFLAGS) \ + $(lib10_urlauth_plugin_la_LDFLAGS) $(LDFLAGS) -o $@ +DEFAULT_INCLUDES = -I.@am__isrc@ -I$(top_builddir) +depcomp = $(SHELL) $(top_srcdir)/depcomp +am__depfiles_maybe = depfiles +am__mv = mv -f +COMPILE = $(CC) $(DEFS) $(DEFAULT_INCLUDES) $(INCLUDES) $(AM_CPPFLAGS) \ + $(CPPFLAGS) $(AM_CFLAGS) $(CFLAGS) +LTCOMPILE = $(LIBTOOL) --tag=CC $(AM_LIBTOOLFLAGS) $(LIBTOOLFLAGS) \ + --mode=compile $(CC) $(DEFS) $(DEFAULT_INCLUDES) $(INCLUDES) \ + $(AM_CPPFLAGS) $(CPPFLAGS) $(AM_CFLAGS) $(CFLAGS) +CCLD = $(CC) +LINK = $(LIBTOOL) --tag=CC $(AM_LIBTOOLFLAGS) $(LIBTOOLFLAGS) \ + --mode=link $(CCLD) $(AM_CFLAGS) $(CFLAGS) $(AM_LDFLAGS) \ + $(LDFLAGS) -o $@ +SOURCES = $(lib10_urlauth_plugin_la_SOURCES) +DIST_SOURCES = $(lib10_urlauth_plugin_la_SOURCES) +HEADERS = $(noinst_HEADERS) +ETAGS = etags +CTAGS = ctags +DISTFILES = $(DIST_COMMON) $(DIST_SOURCES) $(TEXINFOS) $(EXTRA_DIST) +ACLOCAL = @ACLOCAL@ +AMTAR = @AMTAR@ +AR = @AR@ +AUTH_CFLAGS = @AUTH_CFLAGS@ +AUTH_LIBS = @AUTH_LIBS@ +AUTOCONF = @AUTOCONF@ +AUTOHEADER = @AUTOHEADER@ +AUTOMAKE = @AUTOMAKE@ +AWK = @AWK@ +CC = @CC@ +CCDEPMODE = @CCDEPMODE@ +CFLAGS = @CFLAGS@ +CPP = @CPP@ +CPPFLAGS = @CPPFLAGS@ +CURLCONFIG = @CURLCONFIG@ +CURL_CFLAGS = @CURL_CFLAGS@ +CURL_LIBS = @CURL_LIBS@ +CXX = @CXX@ +CXXCPP = @CXXCPP@ +CXXDEPMODE = @CXXDEPMODE@ +CXXFLAGS = @CXXFLAGS@ +CYGPATH_W = @CYGPATH_W@ +DEFS = @DEFS@ +DEPDIR = @DEPDIR@ +DICT_LIBS = @DICT_LIBS@ +DSYMUTIL = @DSYMUTIL@ +DUMPBIN = @DUMPBIN@ +ECHO_C = @ECHO_C@ +ECHO_N = @ECHO_N@ +ECHO_T = @ECHO_T@ +EGREP = @EGREP@ +EXEEXT = @EXEEXT@ +FGREP = @FGREP@ +GREP = @GREP@ +INSTALL = @INSTALL@ +INSTALL_DATA = @INSTALL_DATA@ +INSTALL_PROGRAM = @INSTALL_PROGRAM@ +INSTALL_SCRIPT = @INSTALL_SCRIPT@ +INSTALL_STRIP_PROGRAM = @INSTALL_STRIP_PROGRAM@ +KRB5CONFIG = @KRB5CONFIG@ +KRB5_CFLAGS = @KRB5_CFLAGS@ +KRB5_LIBS = @KRB5_LIBS@ +LD = @LD@ +LDAP_LIBS = @LDAP_LIBS@ +LDFLAGS = @LDFLAGS@ +LIBCAP = @LIBCAP@ +LIBICONV = @LIBICONV@ +LIBOBJS = @LIBOBJS@ +LIBS = @LIBS@ +LIBTOOL = @LIBTOOL@ +LIPO = @LIPO@ +LN_S = @LN_S@ +LTLIBICONV = @LTLIBICONV@ +LTLIBOBJS = @LTLIBOBJS@ +MAINT = @MAINT@ +MAKEINFO = @MAKEINFO@ +MKDIR_P = @MKDIR_P@ +MODULE_LIBS = @MODULE_LIBS@ +MODULE_SUFFIX = @MODULE_SUFFIX@ +MYSQL_CFLAGS = @MYSQL_CFLAGS@ +MYSQL_LIBS = @MYSQL_LIBS@ +NM = @NM@ +NMEDIT = @NMEDIT@ +OBJDUMP = @OBJDUMP@ +OBJEXT = @OBJEXT@ +OTOOL = @OTOOL@ +OTOOL64 = @OTOOL64@ +PACKAGE = @PACKAGE@ +PACKAGE_BUGREPORT = @PACKAGE_BUGREPORT@ +PACKAGE_NAME = @PACKAGE_NAME@ +PACKAGE_STRING = @PACKAGE_STRING@ +PACKAGE_TARNAME = @PACKAGE_TARNAME@ +PACKAGE_URL = @PACKAGE_URL@ +PACKAGE_VERSION = @PACKAGE_VERSION@ +PATH_SEPARATOR = @PATH_SEPARATOR@ +PGSQL_CFLAGS = @PGSQL_CFLAGS@ +PGSQL_LIBS = @PGSQL_LIBS@ +PG_CONFIG = @PG_CONFIG@ +PKG_CONFIG = @PKG_CONFIG@ +RANLIB = @RANLIB@ +RPCGEN = @RPCGEN@ +SED = @SED@ +SET_MAKE = @SET_MAKE@ +SHELL = @SHELL@ +SQLITE_CFLAGS = @SQLITE_CFLAGS@ +SQLITE_LIBS = @SQLITE_LIBS@ +SQL_CFLAGS = @SQL_CFLAGS@ +SQL_LIBS = @SQL_LIBS@ +SSL_CFLAGS = @SSL_CFLAGS@ +SSL_LIBS = @SSL_LIBS@ +STORAGE_LIBS = @STORAGE_LIBS@ +STRIP = @STRIP@ +VERSION = @VERSION@ +abs_builddir = @abs_builddir@ +abs_srcdir = @abs_srcdir@ +abs_top_builddir = @abs_top_builddir@ +abs_top_srcdir = @abs_top_srcdir@ +ac_ct_CC = @ac_ct_CC@ +ac_ct_CXX = @ac_ct_CXX@ +ac_ct_DUMPBIN = @ac_ct_DUMPBIN@ +am__include = @am__include@ +am__leading_dot = @am__leading_dot@ +am__quote = @am__quote@ +am__tar = @am__tar@ +am__untar = @am__untar@ +bindir = @bindir@ +build = @build@ +build_alias = @build_alias@ +build_cpu = @build_cpu@ +build_os = @build_os@ +build_vendor = @build_vendor@ +builddir = @builddir@ +datadir = @datadir@ +datarootdir = @datarootdir@ +dict_drivers = @dict_drivers@ +docdir = @docdir@ +dvidir = @dvidir@ +exec_prefix = @exec_prefix@ +host = @host@ +host_alias = @host_alias@ +host_cpu = @host_cpu@ +host_os = @host_os@ +host_vendor = @host_vendor@ +htmldir = @htmldir@ +includedir = @includedir@ +infodir = @infodir@ +install_sh = @install_sh@ +libdir = @libdir@ +libexecdir = @libexecdir@ +localedir = @localedir@ +localstatedir = @localstatedir@ +lt_ECHO = @lt_ECHO@ +mail_storages = @mail_storages@ +mandir = @mandir@ +mkdir_p = @mkdir_p@ +moduledir = @moduledir@ +oldincludedir = @oldincludedir@ +pdfdir = @pdfdir@ +prefix = @prefix@ +program_transform_name = @program_transform_name@ +psdir = @psdir@ +rundir = @rundir@ +sbindir = @sbindir@ +sharedstatedir = @sharedstatedir@ +sql_drivers = @sql_drivers@ +srcdir = @srcdir@ +ssldir = @ssldir@ +statedir = @statedir@ +sysconfdir = @sysconfdir@ +target_alias = @target_alias@ +top_build_prefix = @top_build_prefix@ +top_builddir = @top_builddir@ +top_srcdir = @top_srcdir@ +AM_CPPFLAGS = \ + -I$(top_srcdir)/src/lib \ + -I$(top_srcdir)/src/lib-imap \ + -I$(top_srcdir)/src/lib-index \ + -I$(top_srcdir)/src/lib-mail \ + -I$(top_srcdir)/src/lib-storage \ + -I$(top_srcdir)/src/imap + +imap_moduledir = $(moduledir)/imap +lib10_urlauth_plugin_la_LDFLAGS = -module -avoid-version +lib10_urlauth_plugin_la_LIBADD = -lcrypto +imap_module_LTLIBRARIES = \ + lib10_urlauth_plugin.la + +lib10_urlauth_plugin_la_SOURCES = \ + urlauth-keys.c \ + urlauth-plugin.c \ + urlauth.c + +noinst_HEADERS = \ + urlauth-plugin.h + +all: all-am + +.SUFFIXES: +.SUFFIXES: .c .lo .o .obj +$(srcdir)/Makefile.in: @MAINTAINER_MODE_TRUE@ $(srcdir)/Makefile.am $(am__configure_deps) + @for dep in $?; do \ + case '$(am__configure_deps)' in \ + *$$dep*) \ + ( cd $(top_builddir) && $(MAKE) $(AM_MAKEFLAGS) am--refresh ) \ + && { if test -f $@; then exit 0; else break; fi; }; \ + exit 1;; \ + esac; \ + done; \ + echo ' cd $(top_srcdir) && $(AUTOMAKE) --foreign src/plugins/urlauth/Makefile'; \ + $(am__cd) $(top_srcdir) && \ + $(AUTOMAKE) --foreign src/plugins/urlauth/Makefile +.PRECIOUS: Makefile +Makefile: $(srcdir)/Makefile.in $(top_builddir)/config.status + @case '$?' in \ + *config.status*) \ + cd $(top_builddir) && $(MAKE) $(AM_MAKEFLAGS) am--refresh;; \ + *) \ + echo ' cd $(top_builddir) && $(SHELL) ./config.status $(subdir)/$@ $(am__depfiles_maybe)'; \ + cd $(top_builddir) && $(SHELL) ./config.status $(subdir)/$@ $(am__depfiles_maybe);; \ + esac; + +$(top_builddir)/config.status: $(top_srcdir)/configure $(CONFIG_STATUS_DEPENDENCIES) + cd $(top_builddir) && $(MAKE) $(AM_MAKEFLAGS) am--refresh + +$(top_srcdir)/configure: @MAINTAINER_MODE_TRUE@ $(am__configure_deps) + cd $(top_builddir) && $(MAKE) $(AM_MAKEFLAGS) am--refresh +$(ACLOCAL_M4): @MAINTAINER_MODE_TRUE@ $(am__aclocal_m4_deps) + cd $(top_builddir) && $(MAKE) $(AM_MAKEFLAGS) am--refresh +$(am__aclocal_m4_deps): +install-imap_moduleLTLIBRARIES: $(imap_module_LTLIBRARIES) + @$(NORMAL_INSTALL) + test -z "$(imap_moduledir)" || $(MKDIR_P) "$(DESTDIR)$(imap_moduledir)" + @list='$(imap_module_LTLIBRARIES)'; test -n "$(imap_moduledir)" || list=; \ + list2=; for p in $$list; do \ + if test -f $$p; then \ + list2="$$list2 $$p"; \ + else :; fi; \ + done; \ + test -z "$$list2" || { \ + echo " $(LIBTOOL) $(AM_LIBTOOLFLAGS) $(LIBTOOLFLAGS) --mode=install $(INSTALL) $(INSTALL_STRIP_FLAG) $$list2 '$(DESTDIR)$(imap_moduledir)'"; \ + $(LIBTOOL) $(AM_LIBTOOLFLAGS) $(LIBTOOLFLAGS) --mode=install $(INSTALL) $(INSTALL_STRIP_FLAG) $$list2 "$(DESTDIR)$(imap_moduledir)"; \ + } + +uninstall-imap_moduleLTLIBRARIES: + @$(NORMAL_UNINSTALL) + @list='$(imap_module_LTLIBRARIES)'; test -n "$(imap_moduledir)" || list=; \ + for p in $$list; do \ + $(am__strip_dir) \ + echo " $(LIBTOOL) $(AM_LIBTOOLFLAGS) $(LIBTOOLFLAGS) --mode=uninstall rm -f '$(DESTDIR)$(imap_moduledir)/$$f'"; \ + $(LIBTOOL) $(AM_LIBTOOLFLAGS) $(LIBTOOLFLAGS) --mode=uninstall rm -f "$(DESTDIR)$(imap_moduledir)/$$f"; \ + done + +clean-imap_moduleLTLIBRARIES: + -test -z "$(imap_module_LTLIBRARIES)" || rm -f $(imap_module_LTLIBRARIES) + @list='$(imap_module_LTLIBRARIES)'; for p in $$list; do \ + dir="`echo $$p | sed -e 's|/[^/]*$$||'`"; \ + test "$$dir" != "$$p" || dir=.; \ + echo "rm -f \"$${dir}/so_locations\""; \ + rm -f "$${dir}/so_locations"; \ + done +lib10_urlauth_plugin.la: $(lib10_urlauth_plugin_la_OBJECTS) $(lib10_urlauth_plugin_la_DEPENDENCIES) + $(lib10_urlauth_plugin_la_LINK) -rpath $(imap_moduledir) $(lib10_urlauth_plugin_la_OBJECTS) $(lib10_urlauth_plugin_la_LIBADD) $(LIBS) + +mostlyclean-compile: + -rm -f *.$(OBJEXT) + +distclean-compile: + -rm -f *.tab.c + +@AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/urlauth-keys.Plo@am__quote@ +@AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/urlauth-plugin.Plo@am__quote@ +@AMDEP_TRUE@@am__include@ @am__quote@./$(DEPDIR)/urlauth.Plo@am__quote@ + +.c.o: +@am__fastdepCC_TRUE@ $(COMPILE) -MT $@ -MD -MP -MF $(DEPDIR)/$*.Tpo -c -o $@ $< +@am__fastdepCC_TRUE@ $(am__mv) $(DEPDIR)/$*.Tpo $(DEPDIR)/$*.Po +@AMDEP_TRUE@@am__fastdepCC_FALSE@ source='$<' object='$@' libtool=no @AMDEPBACKSLASH@ +@AMDEP_TRUE@@am__fastdepCC_FALSE@ DEPDIR=$(DEPDIR) $(CCDEPMODE) $(depcomp) @AMDEPBACKSLASH@ +@am__fastdepCC_FALSE@ $(COMPILE) -c $< + +.c.obj: +@am__fastdepCC_TRUE@ $(COMPILE) -MT $@ -MD -MP -MF $(DEPDIR)/$*.Tpo -c -o $@ `$(CYGPATH_W) '$<'` +@am__fastdepCC_TRUE@ $(am__mv) $(DEPDIR)/$*.Tpo $(DEPDIR)/$*.Po +@AMDEP_TRUE@@am__fastdepCC_FALSE@ source='$<' object='$@' libtool=no @AMDEPBACKSLASH@ +@AMDEP_TRUE@@am__fastdepCC_FALSE@ DEPDIR=$(DEPDIR) $(CCDEPMODE) $(depcomp) @AMDEPBACKSLASH@ +@am__fastdepCC_FALSE@ $(COMPILE) -c `$(CYGPATH_W) '$<'` + +.c.lo: +@am__fastdepCC_TRUE@ $(LTCOMPILE) -MT $@ -MD -MP -MF $(DEPDIR)/$*.Tpo -c -o $@ $< +@am__fastdepCC_TRUE@ $(am__mv) $(DEPDIR)/$*.Tpo $(DEPDIR)/$*.Plo +@AMDEP_TRUE@@am__fastdepCC_FALSE@ source='$<' object='$@' libtool=yes @AMDEPBACKSLASH@ +@AMDEP_TRUE@@am__fastdepCC_FALSE@ DEPDIR=$(DEPDIR) $(CCDEPMODE) $(depcomp) @AMDEPBACKSLASH@ +@am__fastdepCC_FALSE@ $(LTCOMPILE) -c -o $@ $< + +mostlyclean-libtool: + -rm -f *.lo + +clean-libtool: + -rm -rf .libs _libs + +ID: $(HEADERS) $(SOURCES) $(LISP) $(TAGS_FILES) + list='$(SOURCES) $(HEADERS) $(LISP) $(TAGS_FILES)'; \ + unique=`for i in $$list; do \ + if test -f "$$i"; then echo $$i; else echo $(srcdir)/$$i; fi; \ + done | \ + $(AWK) '{ files[$$0] = 1; nonempty = 1; } \ + END { if (nonempty) { for (i in files) print i; }; }'`; \ + mkid -fID $$unique +tags: TAGS + +TAGS: $(HEADERS) $(SOURCES) $(TAGS_DEPENDENCIES) \ + $(TAGS_FILES) $(LISP) + set x; \ + here=`pwd`; \ + list='$(SOURCES) $(HEADERS) $(LISP) $(TAGS_FILES)'; \ + unique=`for i in $$list; do \ + if test -f "$$i"; then echo $$i; else echo $(srcdir)/$$i; fi; \ + done | \ + $(AWK) '{ files[$$0] = 1; nonempty = 1; } \ + END { if (nonempty) { for (i in files) print i; }; }'`; \ + shift; \ + if test -z "$(ETAGS_ARGS)$$*$$unique"; then :; else \ + test -n "$$unique" || unique=$$empty_fix; \ + if test $$# -gt 0; then \ + $(ETAGS) $(ETAGSFLAGS) $(AM_ETAGSFLAGS) $(ETAGS_ARGS) \ + "$$@" $$unique; \ + else \ + $(ETAGS) $(ETAGSFLAGS) $(AM_ETAGSFLAGS) $(ETAGS_ARGS) \ + $$unique; \ + fi; \ + fi +ctags: CTAGS +CTAGS: $(HEADERS) $(SOURCES) $(TAGS_DEPENDENCIES) \ + $(TAGS_FILES) $(LISP) + list='$(SOURCES) $(HEADERS) $(LISP) $(TAGS_FILES)'; \ + unique=`for i in $$list; do \ + if test -f "$$i"; then echo $$i; else echo $(srcdir)/$$i; fi; \ + done | \ + $(AWK) '{ files[$$0] = 1; nonempty = 1; } \ + END { if (nonempty) { for (i in files) print i; }; }'`; \ + test -z "$(CTAGS_ARGS)$$unique" \ + || $(CTAGS) $(CTAGSFLAGS) $(AM_CTAGSFLAGS) $(CTAGS_ARGS) \ + $$unique + +GTAGS: + here=`$(am__cd) $(top_builddir) && pwd` \ + && $(am__cd) $(top_srcdir) \ + && gtags -i $(GTAGS_ARGS) "$$here" + +distclean-tags: + -rm -f TAGS ID GTAGS GRTAGS GSYMS GPATH tags + +distdir: $(DISTFILES) + @srcdirstrip=`echo "$(srcdir)" | sed 's/[].[^$$\\*]/\\\\&/g'`; \ + topsrcdirstrip=`echo "$(top_srcdir)" | sed 's/[].[^$$\\*]/\\\\&/g'`; \ + list='$(DISTFILES)'; \ + dist_files=`for file in $$list; do echo $$file; done | \ + sed -e "s|^$$srcdirstrip/||;t" \ + -e "s|^$$topsrcdirstrip/|$(top_builddir)/|;t"`; \ + case $$dist_files in \ + */*) $(MKDIR_P) `echo "$$dist_files" | \ + sed '/\//!d;s|^|$(distdir)/|;s,/[^/]*$$,,' | \ + sort -u` ;; \ + esac; \ + for file in $$dist_files; do \ + if test -f $$file || test -d $$file; then d=.; else d=$(srcdir); fi; \ + if test -d $$d/$$file; then \ + dir=`echo "/$$file" | sed -e 's,/[^/]*$$,,'`; \ + if test -d "$(distdir)/$$file"; then \ + find "$(distdir)/$$file" -type d ! -perm -700 -exec chmod u+rwx {} \;; \ + fi; \ + if test -d $(srcdir)/$$file && test $$d != $(srcdir); then \ + cp -fpR $(srcdir)/$$file "$(distdir)$$dir" || exit 1; \ + find "$(distdir)/$$file" -type d ! -perm -700 -exec chmod u+rwx {} \;; \ + fi; \ + cp -fpR $$d/$$file "$(distdir)$$dir" || exit 1; \ + else \ + test -f "$(distdir)/$$file" \ + || cp -p $$d/$$file "$(distdir)/$$file" \ + || exit 1; \ + fi; \ + done +check-am: all-am +check: check-am +all-am: Makefile $(LTLIBRARIES) $(HEADERS) +installdirs: + for dir in "$(DESTDIR)$(imap_moduledir)"; do \ + test -z "$$dir" || $(MKDIR_P) "$$dir"; \ + done +install: install-am +install-exec: install-exec-am +install-data: install-data-am +uninstall: uninstall-am + +install-am: all-am + @$(MAKE) $(AM_MAKEFLAGS) install-exec-am install-data-am + +installcheck: installcheck-am +install-strip: + $(MAKE) $(AM_MAKEFLAGS) INSTALL_PROGRAM="$(INSTALL_STRIP_PROGRAM)" \ + install_sh_PROGRAM="$(INSTALL_STRIP_PROGRAM)" INSTALL_STRIP_FLAG=-s \ + `test -z '$(STRIP)' || \ + echo "INSTALL_PROGRAM_ENV=STRIPPROG='$(STRIP)'"` install +mostlyclean-generic: + +clean-generic: + +distclean-generic: + -test -z "$(CONFIG_CLEAN_FILES)" || rm -f $(CONFIG_CLEAN_FILES) + -test . = "$(srcdir)" || test -z "$(CONFIG_CLEAN_VPATH_FILES)" || rm -f $(CONFIG_CLEAN_VPATH_FILES) + +maintainer-clean-generic: + @echo "This command is intended for maintainers to use" + @echo "it deletes files that may require special tools to rebuild." +clean: clean-am + +clean-am: clean-generic clean-imap_moduleLTLIBRARIES clean-libtool \ + mostlyclean-am + +distclean: distclean-am + -rm -rf ./$(DEPDIR) + -rm -f Makefile +distclean-am: clean-am distclean-compile distclean-generic \ + distclean-tags + +dvi: dvi-am + +dvi-am: + +html: html-am + +html-am: + +info: info-am + +info-am: + +install-data-am: install-imap_moduleLTLIBRARIES + +install-dvi: install-dvi-am + +install-dvi-am: + +install-exec-am: + +install-html: install-html-am + +install-html-am: + +install-info: install-info-am + +install-info-am: + +install-man: + +install-pdf: install-pdf-am + +install-pdf-am: + +install-ps: install-ps-am + +install-ps-am: + +installcheck-am: + +maintainer-clean: maintainer-clean-am + -rm -rf ./$(DEPDIR) + -rm -f Makefile +maintainer-clean-am: distclean-am maintainer-clean-generic + +mostlyclean: mostlyclean-am + +mostlyclean-am: mostlyclean-compile mostlyclean-generic \ + mostlyclean-libtool + +pdf: pdf-am + +pdf-am: + +ps: ps-am + +ps-am: + +uninstall-am: uninstall-imap_moduleLTLIBRARIES + +.MAKE: install-am install-strip + +.PHONY: CTAGS GTAGS all all-am check check-am clean clean-generic \ + clean-imap_moduleLTLIBRARIES clean-libtool ctags distclean \ + distclean-compile distclean-generic distclean-libtool \ + distclean-tags distdir dvi dvi-am html html-am info info-am \ + install install-am install-data install-data-am install-dvi \ + install-dvi-am install-exec install-exec-am install-html \ + install-html-am install-imap_moduleLTLIBRARIES install-info \ + install-info-am install-man install-pdf install-pdf-am \ + install-ps install-ps-am install-strip installcheck \ + installcheck-am installdirs maintainer-clean \ + maintainer-clean-generic mostlyclean mostlyclean-compile \ + mostlyclean-generic mostlyclean-libtool pdf pdf-am ps ps-am \ + tags uninstall uninstall-am uninstall-imap_moduleLTLIBRARIES + + +# Tell versions [3.59,3.63) of GNU make to not export all variables. +# Otherwise a system limit (for SysV at least) may be exceeded. +.NOEXPORT: diff -Nur dovecot-1.2.11/src/plugins/urlauth/urlauth-keys.c dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth-keys.c --- dovecot-1.2.11/src/plugins/urlauth/urlauth-keys.c 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth-keys.c 2010-01-19 16:11:13.000000000 -0600 @@ -0,0 +1,269 @@ +/* + * Copyright (c) 2010 Apple Inc. All rights reserved. + * + * Redistribution and use in source and binary forms, with or without + * modification, are permitted provided that the following conditions + * are met: + * + * 1. Redistributions of source code must retain the above copyright + * notice, this list of conditions and the following disclaimer. + * 2. Redistributions in binary form must reproduce the above + * copyright notice, this list of conditions and the following + * disclaimer in the documentation and/or other materials provided + * with the distribution. + * 3. Neither the name of Apple Inc. ("Apple") nor the names of its + * contributors may be used to endorse or promote products derived + * from this software without specific prior written permission. + * + * THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND + * ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, + * THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A + * PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS + * CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF + * USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND + * ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, + * OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT + * OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF + * SUCH DAMAGE. + */ + +#include "lib.h" +#include "istream.h" +#include "ostream.h" +#include "hash.h" +#include "mail-storage-private.h" +#include "hex-binary.h" +#include "randgen.h" +#include "urlauth-plugin.h" + +#include <ctype.h> + +#define URLAUTH_KEYS_FILENAME "urlauthkeys" + +enum urlauth_keys_action { + URLAUTH_KEYS_GET, // get the key for a mailbox + URLAUTH_KEYS_SET, // set a new random key for a mailbox + URLAUTH_KEYS_DELETE // delete the key for a mailbox +}; + +// get the path to the access keys table +static const char *urlauth_keys_path(struct mail_storage *storage) +{ + const char *control_dir = + mail_storage_get_mailbox_control_dir(storage, ""); + return t_strconcat(control_dir, "/"URLAUTH_KEYS_FILENAME, NULL); + +} + +// read the access keys into the hash table +static struct hash_table *urlauth_keys_read(pool_t pool, int fd) +{ + struct hash_table *keys; + struct istream *is; + const char *line; + + is = i_stream_create_fd(fd, 4096, FALSE); + if (is == NULL) + return NULL; + + keys = hash_table_create(pool, pool, 16, strcase_hash, + (hash_cmp_callback_t *) strcasecmp); + if (keys == NULL) { + i_stream_destroy(&is); + return NULL; + } + + i_stream_set_return_partial_line(is, TRUE); + while ((line = i_stream_read_next_line(is)) != NULL) { + const char *sep; + + if (*line == '\0' || *line == '#') + continue; + + /* future-proofing */ + if (strcmp(line, URLAUTH_KEYS_FILENAME" version 1") == 0) + continue; + + /* key:mailbox, both nonempty */ + sep = strchr(line, ':'); + if (sep == NULL || sep == line || sep[1] == '\0') + continue; + + /* keys[mailbox] = key */ + hash_table_insert(keys, + p_strdup(pool, sep + 1), + p_strdup_until(pool, line, sep)); + } + i_stream_destroy(&is); + + return keys; +} + +// write the access keys to the file +static bool urlauth_keys_write(int fd, struct hash_table *keys) +{ + struct ostream *os; + struct hash_iterate_context *iter; + void *key, *value; + + os = o_stream_create_fd_file(fd, 0, FALSE); + if (os == NULL) + return NULL; + + o_stream_send_str(os, URLAUTH_KEYS_FILENAME" version 1\n"); + iter = hash_table_iterate_init(keys); + while (hash_table_iterate(iter, &key, &value)) { + /* key is the mailbox, value is the access key */ + o_stream_send_str(os, (const char *) value); + o_stream_send(os, ":", 1); + o_stream_send_str(os, (const char *) key); + o_stream_send(os, "\n", 1); + } + hash_table_iterate_deinit(&iter); + o_stream_destroy(&os); + + return TRUE; +} + +// read/modify/write the access keys +static bool urlauth_keys_update(struct mail_storage *storage, + enum urlauth_keys_action action, + const char *mailbox, + buffer_t *out_key) +{ + const char *path; + int flags, fd; + pool_t pool; + struct hash_table *keys; + unsigned char new_key[URLAUTH_KEY_BYTES]; + const char *hex = NULL; + bool modified = FALSE; + + if (strcmp(storage->name, "maildir") != 0) { + i_error("Unsupported URLAUTH backend: %s", storage->name); + return FALSE; + } + + /* open and lock the keys file */ + path = urlauth_keys_path(storage); + flags = O_RDWR | O_EXLOCK; + if (action == URLAUTH_KEYS_GET || action == URLAUTH_KEYS_SET) + flags |= O_CREAT; + fd = open(path, flags, 0644); + if (fd < 0) { + if ((flags & O_CREAT) || errno != ENOENT) + i_error("open(%s) failed: %m", path); + return FALSE; + } + + /* read the keys */ + pool = pool_alloconly_create("urlauth_keys", 1024); + keys = urlauth_keys_read(pool, fd); + if (keys == NULL) { + i_error("error reading %s: %m", path); + pool_unref(&pool); + close(fd); + return FALSE; + } + + /* modify the keys */ + switch (action) { + case URLAUTH_KEYS_GET: + hex = hash_table_lookup(keys, (void *) mailbox); + + /* if hex key is bogus, set a new one */ + if (hex) { + const char *cp; + for (cp = hex; *cp; cp++) + if (!i_isxdigit(*cp)) + break; + if (*cp == '\0') + break; /* good hex */ + } + + /* if not present, set one -- fall through */ + case URLAUTH_KEYS_SET: + random_fill(new_key, sizeof new_key); + hex = binary_to_hex(new_key, sizeof new_key); + if (*mailbox) { + hash_table_insert(keys, (void *) mailbox, + (void *) hex); + modified = TRUE; + } /* else mailbox="" for foiling timing attacks */ + break; + case URLAUTH_KEYS_DELETE: + hex = hash_table_lookup(keys, (void *) mailbox); + if (hex) { + hash_table_remove(keys, (void *) mailbox); + modified = TRUE; + } + break; + } + + if (out_key) + hex_to_binary(hex, out_key); + + /* write the keys */ + if (modified) { + lseek(fd, 0, SEEK_SET); + ftruncate(fd, 0); + urlauth_keys_write(fd, keys); + } + + /* clean up */ + close(fd); + hash_table_destroy(&keys); + pool_unref(&pool); + + return TRUE; +} + +void urlauth_keys_init(void) +{ + random_init(); +} + +void urlauth_keys_deinit(void) +{ + random_deinit(); +} + +// get the access key for a mailbox +bool urlauth_keys_get(struct mail_storage *storage, const char *mailbox, + buffer_t *key) +{ + return urlauth_keys_update(storage, URLAUTH_KEYS_GET, mailbox, key); +} + +// set a new random access key for a mailbox +bool urlauth_keys_set(struct mail_storage *storage, const char *mailbox) +{ + return urlauth_keys_update(storage, URLAUTH_KEYS_SET, mailbox, NULL); +} + +// delete the access key for a mailbox +bool urlauth_keys_delete(struct mail_storage *storage, const char *mailbox) +{ + return urlauth_keys_update(storage, URLAUTH_KEYS_DELETE, mailbox, NULL); +} + +// delete all access keys +bool urlauth_keys_reset(struct mail_storage *storage) +{ + const char *path; + + if (strcmp(storage->name, "maildir") != 0) { + i_error("Unsupported URLAUTH backend: %s", storage->name); + return FALSE; + } + + path = urlauth_keys_path(storage); + if (unlink(path) < 0 && errno != ENOENT && errno != ESTALE) { + i_error("unlink(%s) failed: %m", path); + return FALSE; + } + + return TRUE; +} diff -Nur dovecot-1.2.11/src/plugins/urlauth/urlauth-plugin.c dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth-plugin.c --- dovecot-1.2.11/src/plugins/urlauth/urlauth-plugin.c 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth-plugin.c 2010-02-05 05:34:46.000000000 -0600 @@ -0,0 +1,620 @@ +/* + * Copyright (c) 2010 Apple Inc. All rights reserved. + * + * Redistribution and use in source and binary forms, with or without + * modification, are permitted provided that the following conditions + * are met: + * + * 1. Redistributions of source code must retain the above copyright + * notice, this list of conditions and the following disclaimer. + * 2. Redistributions in binary form must reproduce the above + * copyright notice, this list of conditions and the following + * disclaimer in the documentation and/or other materials provided + * with the distribution. + * 3. Neither the name of Apple Inc. ("Apple") nor the names of its + * contributors may be used to endorse or promote products derived + * from this software without specific prior written permission. + * + * THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND + * ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, + * THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A + * PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS + * CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF + * USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND + * ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, + * OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT + * OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF + * SUCH DAMAGE. + */ + +/* Implements RFC 4467 */ + +#include "lib.h" +#include "str.h" +#include "common.h" +#include "client.h" +#include "hostpid.h" +#include "ioloop.h" +#include "istream.h" +#include "ostream.h" +#include "mail-user.h" +#include "mail-search.h" +#include "imap-fetch.h" +#include "imap-search-args.h" +#include "urlauth-plugin.h" + +#include <stdlib.h> +#include <fcntl.h> +#include <unistd.h> + +/* context for processing nested loops asynchronously: + for (each url in the urlfetch command) + while (the imap fetch is unfinished) + print the info, but non-blocking */ +struct urlfetch_context { + /* pertaining to the urlfetch command as a whole */ + pool_t pool; + struct client_command_context *cmd; + const struct imap_arg *urlfetch_args; + string_t *response; + const char *hostport; + unsigned int debug:1; + unsigned int failed:1; + + /* pertaining to the individual url being processed */ + const char *url; + const char *mailbox; + struct mail_storage *storage; + struct mailbox *box; + struct istream *input; + struct imap_parser *parser; + struct mail_search_args *search_args; + struct imap_fetch_context *fetch_ctx; +}; + +enum urlfetch_status { + URLFETCH_DONE, + URLFETCH_MORE, + URLFETCH_UNFINISHED +}; + +const char *urlauth_plugin_version = PACKAGE_VERSION; + +extern void (*hook_select_send_urlmech)(struct client *client); +extern void (*hook_delete_mailbox)(struct mail_storage *storage, + const char *mailbox); + +// GENURLAUTH command +static bool cmd_genurlauth(struct client_command_context *cmd) +{ + const struct imap_arg *args; + string_t *auth_urls; + const char *hostport; + + /* url mechanism [url mechanism ...] */ + if (!client_read_args(cmd, 0, 0, &args)) + return FALSE; + + auth_urls = t_str_new(256); + + // resolve this each time in case my_hostname changed + hostport = getenv("URLAUTH_HOSTPORT"); + if (hostport == NULL || *hostport == '\0') + hostport = my_hostname; + + while (IMAP_ARG_TYPE_IS_STRING(args[0].type) && + IMAP_ARG_TYPE_IS_STRING(args[1].type)) { + const char *rump = imap_arg_string(&args[0]); + const char *mech = imap_arg_string(&args[1]); + struct imap_url_parts enc_parts, dec_parts; + const char *error = NULL, *mailbox; + struct mail_storage *storage; + buffer_t *key; + + if (strcasecmp(mech, "INTERNAL") != 0) { + client_send_command_error(cmd, + "Unsupported mechanism."); + return TRUE; + } + + memset(&enc_parts, 0, sizeof enc_parts); + memset(&dec_parts, 0, sizeof dec_parts); + imap_url_parse(rump, &enc_parts); + if (!imap_url_decode(&enc_parts, &dec_parts, &error) || + !urlauth_url_validate(&dec_parts, FALSE, &error)) { + if (error) + client_send_command_error(cmd, + t_strconcat("Invalid arguments: ", + error, NULL)); + else + client_send_command_error(cmd, + "Invalid arguments."); + return TRUE; + } + + if (getenv("DEBUG") != NULL) { + string_t *url = t_str_new(strlen(rump) + 1); + imap_url_construct(&enc_parts, url); + if (strcasecmp(rump, str_c(url)) != 0) + i_warning("GENURLAUTH: reconstructed URL (%s) does not match original (%s)", + str_c(url), rump); + } + + // username and servername must match + if (strcmp(dec_parts.user, cmd->client->user->username) != 0 || + strcmp(dec_parts.hostport, hostport) != 0) { + client_send_command_error(cmd, "User/server mismatch."); + return TRUE; + } + + // mailbox must exist + if (!client_verify_mailbox_name(cmd, dec_parts.mailbox, + CLIENT_VERIFY_MAILBOX_SHOULD_EXIST)) + return TRUE; + + // get the access key + mailbox = dec_parts.mailbox; + storage = client_find_storage(cmd, &mailbox); + if (storage == NULL) + return TRUE; + key = buffer_create_static_hard(pool_datastack_create(), + URLAUTH_KEY_BYTES); + if (!urlauth_keys_get(storage, mailbox, key)) { + client_send_tagline(cmd, "NO "MAIL_ERRSTR_CRITICAL_MSG); + return TRUE; + } + + // generate the reply + if (str_len(auth_urls) > 0) + str_append_c(auth_urls, ' '); + str_append_c(auth_urls, '"'); + str_append(auth_urls, rump); + str_append(auth_urls, ":INTERNAL:"); + urlauth_urlauth_generate_internal(rump, key, auth_urls); + str_append_c(auth_urls, '"'); + + args += 2; + } + if (args[0].type == IMAP_ARG_EOL) { + if (str_len(auth_urls) > 0) { + client_send_line(cmd->client, + t_strconcat("* GENURLAUTH ", + str_c(auth_urls), NULL)); + client_send_tagline(cmd, "OK Genurlauth completed."); + } else + client_send_command_error(cmd, "Missing arguments."); + } else if (args[1].type == IMAP_ARG_EOL) + client_send_command_error(cmd, "Missing arguments."); + else + client_send_command_error(cmd, "Invalid arguments."); + + return TRUE; +} + +// initialize context for traversing the urlauth maze +static struct urlfetch_context * +urlfetch_init(struct client_command_context *cmd, const struct imap_arg *args) +{ + struct urlfetch_context *ufctx; + + pool_ref(cmd->pool); + ufctx = p_new(cmd->pool, struct urlfetch_context, 1); + ufctx->pool = cmd->pool; + ufctx->cmd = cmd; + ufctx->urlfetch_args = args; + + ufctx->response = str_new(ufctx->pool, 256); + str_append(ufctx->response, "* URLFETCH"); + + // resolve this each time in case my_hostname changed + ufctx->hostport = getenv("URLAUTH_HOSTPORT"); + if (ufctx->hostport == NULL || *ufctx->hostport == '\0') + ufctx->hostport = my_hostname; + + ufctx->debug = getenv("DEBUG") != NULL; + + return ufctx; +} + +// reset the context for the next url +static enum urlfetch_status urlfetch_reset(struct urlfetch_context *ufctx) +{ + if (ufctx->fetch_ctx != NULL) { + if (!ufctx->fetch_ctx->urlfetched) { + // found no mail with that uid + // HERE - probably should send BAD response instead + if (ufctx->debug) + i_info("URLFETCH: \"%s\" failed: UID not found", + ufctx->url); + i_assert(str_len(ufctx->response) == 0); + str_append_str(ufctx->response, + ufctx->fetch_ctx->cur_str); + str_append(ufctx->response, " NIL"); + } + if (imap_fetch_deinit(ufctx->fetch_ctx) < 0) + ufctx->fetch_ctx->failed = TRUE; + if (ufctx->fetch_ctx->failed) + ufctx->failed = TRUE; + ufctx->fetch_ctx = NULL; + } + if (ufctx->search_args != NULL) + mail_search_args_unref(&ufctx->search_args); + if (ufctx->parser != NULL) + imap_parser_destroy(&ufctx->parser); + if (ufctx->input != NULL) + i_stream_destroy(&ufctx->input); + if (ufctx->box != NULL) + mailbox_close(&ufctx->box); + ufctx->storage = NULL; + ufctx->mailbox = NULL; + ufctx->url = NULL; + + return ufctx->failed ? URLFETCH_DONE : URLFETCH_MORE; +} + +// destroy the context +static void urlfetch_deinit(struct urlfetch_context **_ufctx) +{ + struct urlfetch_context *ufctx = *_ufctx; + *_ufctx = NULL; + + urlfetch_reset(ufctx); + + str_free(&ufctx->response); + pool_unref(&ufctx->pool); +} + +// urlfetch for one url +static int urlfetch_url(struct urlfetch_context *ufctx, const char **error) +{ + struct imap_url_parts enc_parts, dec_parts; + bool authorized = FALSE; + buffer_t *key; + string_t *urlauth, *fetch_text; + struct mailbox_status status; + const struct imap_arg *fetch_args = NULL, *next_arg = NULL; + + memset(&enc_parts, 0, sizeof enc_parts); + memset(&dec_parts, 0, sizeof dec_parts); + imap_url_parse(ufctx->url, &enc_parts); + if (!imap_url_decode(&enc_parts, &dec_parts, error) || + !urlauth_url_validate(&dec_parts, TRUE, error)) + return -1; + if (strcmp(dec_parts.user, ufctx->cmd->client->user->username) != 0 || + strcmp(dec_parts.hostport, ufctx->hostport) != 0) { + *error = "user/server mismatch"; + return -1; + } + + // expired? + if (dec_parts.expiration_time != 0 && + dec_parts.expiration_time < ioloop_time) { + *error = "expired"; + return -1; + } + + // authorized? + if (strcasecmp(dec_parts.access, "anonymous") == 0) { + /* any user */ + authorized = TRUE; + } else if (strcasecmp(dec_parts.access, "authuser") == 0) { + /* any non-anonymous user */ + const char *anonymous = getenv("AUTH_ANONYMOUS_USERNAME"); + authorized = anonymous == NULL || + strcmp(ufctx->cmd->client->user->username, + anonymous) != 0; + } else if (strncasecmp(dec_parts.access, "user+", 5) == 0) { + /* logged-in user */ + authorized = strcmp(dec_parts.access + 5, + ufctx->cmd->client->user->username) == 0; + } else if (strncasecmp(dec_parts.access, "submit+", 7) == 0) { + /* logged-in user via submit-user login */ + authorized = getenv("SUBMIT_USER") != NULL && + strcmp(dec_parts.access + 7, + ufctx->cmd->client->user->username) == 0; + } + if (!authorized) { + *error = "not authorized"; + return -1; + } + + // get the access key + key = buffer_create_static_hard(pool_datastack_create(), + URLAUTH_KEY_BYTES); + ufctx->mailbox = p_strdup(ufctx->pool, dec_parts.mailbox); + ufctx->storage = client_find_storage(ufctx->cmd, &ufctx->mailbox); + if (ufctx->storage == NULL) { + // invent a key to foil timing attacks + ufctx->mailbox = "INBOX"; + ufctx->storage = client_find_storage(ufctx->cmd, + &ufctx->mailbox); + ufctx->mailbox = ""; + } + if (!urlauth_keys_get(ufctx->storage, ufctx->mailbox, key)) { + *error = "can't get mailbox key"; + return -1; + } + + // generate an access token and compare it to the one given + urlauth = t_str_new(strlen(dec_parts.urlauth)); + urlauth_urlauth_generate_internal(enc_parts.rump, key, urlauth); + if (strcasecmp(dec_parts.urlauth, str_c(urlauth)) != 0 || + *ufctx->mailbox == '\0') { + *error = "access token mismatch"; + return -1; + } + + ufctx->box = mailbox_open(&ufctx->storage, ufctx->mailbox, NULL, + MAILBOX_OPEN_READONLY | + MAILBOX_OPEN_KEEP_RECENT); + if (ufctx->box == NULL) { + *error = "can't open mailbox"; + return -1; + } + + // verify uidvalidity + if (mailbox_sync(ufctx->box, + MAILBOX_SYNC_FLAG_FULL_READ | MAILBOX_SYNC_FLAG_FAST, + STATUS_UIDVALIDITY, &status) < 0 || + (dec_parts.uidvalidity != NULL && + strtoul(dec_parts.uidvalidity, NULL, 10) != status.uidvalidity)) { + *error = "uidvalidity mismatch"; + return -1; + } + + /* passed all tests. go get the data as in + UID FETCH dec_parts.uid BODY.PEEK[dec_parts.section] + but with less output syntax */ + fetch_text = str_new(ufctx->pool, + 11 + (dec_parts.section ? + strlen(dec_parts.section) : 0)); + str_append(fetch_text, "BODY.PEEK["); + if (dec_parts.section) + str_append(fetch_text, dec_parts.section); + str_append(fetch_text, "]"); + + ufctx->input = i_stream_create_from_data(str_data(fetch_text), + str_len(fetch_text)); + (void) i_stream_read(ufctx->input); + + ufctx->parser = imap_parser_create(ufctx->input, NULL, (size_t) -1); + if (imap_parser_finish_line(ufctx->parser, 0, 0, &fetch_args) < 0) { + *error = "can't parse fetch string"; + return -1; + } + + ufctx->cmd->uid = TRUE; + if (imap_search_get_uidset_arg(ufctx->cmd, dec_parts.uid, + &ufctx->search_args, error) < 0) + return -1; + + ufctx->fetch_ctx = imap_fetch_init(ufctx->cmd, ufctx->box); + if (ufctx->fetch_ctx == NULL) { + *error = "can't init fetch"; + return -1; + } + ufctx->fetch_ctx->search_args = ufctx->search_args; + mail_search_args_ref(ufctx->search_args); + str_append_str(ufctx->fetch_ctx->cur_str, ufctx->response); + str_truncate(ufctx->response, 0); + ufctx->fetch_ctx->urlfetch = TRUE; + + if (!fetch_parse_args(ufctx->fetch_ctx, fetch_args, &next_arg)) { + *error = "can't parse fetch args"; + return -1; + } + + if (imap_fetch_begin(ufctx->fetch_ctx) != 0) { + *error = "can't begin fetch"; + return -1; + } + + return imap_fetch_more(ufctx->fetch_ctx); +} + +// execute imap fetch for one urlfetch url +static enum urlfetch_status urlfetch_more(struct urlfetch_context *ufctx) +{ + if (ufctx->url == NULL) { + int ret; + const char *error = NULL; + + if (!IMAP_ARG_TYPE_IS_STRING(ufctx->urlfetch_args->type)) + return URLFETCH_DONE; + + ufctx->url = imap_arg_string(ufctx->urlfetch_args); + ++ufctx->urlfetch_args; + + str_printfa(ufctx->response, " \"%s\"", ufctx->url); + ret = urlfetch_url(ufctx, &error); + if (ret < 0) { + if (ufctx->debug) + i_info("URLFETCH: \"%s\" failed: %s", + ufctx->url, + error ? error : "(unspecified)"); + str_append(ufctx->response, " NIL"); + } else if (ret == 0) + return URLFETCH_UNFINISHED; + } else { + if (imap_fetch_more(ufctx->fetch_ctx) == 0) + return URLFETCH_UNFINISHED; + } + + return urlfetch_reset(ufctx); +} + +// finish off an urlfetch command +static int urlfetch_finish(struct urlfetch_context *ufctx) +{ + ufctx->cmd->client->output_squelch = FALSE; + + if (ufctx->failed) { + if (ufctx->cmd->client->output->closed) + client_disconnect(ufctx->cmd->client, "Disconnected"); + else { + const char *error_string; + enum mail_error error; + + error_string = mail_storage_get_last_error( + ufctx->storage, &error); + + /* We never want to reply NO to FETCH requests, + BYE is preferrable (see imap-ml for reasons). */ + client_disconnect_with_error(ufctx->cmd->client, + error_string); + } + } else { + client_send_line(ufctx->cmd->client, str_c(ufctx->response)); + client_send_tagline(ufctx->cmd, "OK Urlfetch completed."); + } + + urlfetch_deinit(&ufctx); + return TRUE; +} + +// client is ready for more output, continue urlfetch where we left off +static bool urlfetch_continue(struct client_command_context *cmd) +{ + struct urlfetch_context *ufctx = cmd->context; + enum urlfetch_status status; + + while ((status = urlfetch_more(ufctx)) == URLFETCH_MORE) + ; + if (status == URLFETCH_UNFINISHED) + return FALSE; + return urlfetch_finish(ufctx); +} + +// URLFETCH command +static bool cmd_urlfetch(struct client_command_context *cmd) +{ + const struct imap_arg *args, *argp; + struct urlfetch_context *ufctx; + enum urlfetch_status status; + + /* url [url ...] */ + if (!client_read_args(cmd, 0, 0, &args)) + return FALSE; + + for (argp = args; argp->type != IMAP_ARG_EOL; argp++) { + if (!IMAP_ARG_TYPE_IS_STRING(argp->type)) { + client_send_command_error(cmd, "Invalid arguments."); + return TRUE; + } + } + if (argp == args) { + client_send_command_error(cmd, "Missing arguments."); + return TRUE; + } + + /* Squelch all errors and output other than the fetched parts; + we are allowed only NIL or "". Dovecot does not cleanly + separate the parsing, execution, and response phases of + command handling, but instead interleaves them. To re-use + the imap-fetch code for urlfetch, output_squelch keeps + dovecot quiet. */ + cmd->client->output_squelch = TRUE; + + ufctx = urlfetch_init(cmd, args); + while ((status = urlfetch_more(ufctx)) == URLFETCH_MORE) + ; + if (status == URLFETCH_UNFINISHED) { + cmd->state = CLIENT_COMMAND_STATE_WAIT_OUTPUT; + cmd->func = urlfetch_continue; + cmd->context = ufctx; + return FALSE; + } + return urlfetch_finish(ufctx); +} + +// RESETKEY command +static bool cmd_resetkey(struct client_command_context *cmd) +{ + const struct imap_arg *args; + const char *mailbox = NULL; + const char *mechanism = NULL; + bool reset_all = FALSE; + struct mail_storage *storage; + + /* [mailbox [mechanism]] */ + if (!client_read_args(cmd, 0, 0, &args)) + return FALSE; + + if (IMAP_ARG_TYPE_IS_STRING(args[0].type)) { + mailbox = imap_arg_string(&args[0]); + + /* mechanism name may be absent, empty, or "INTERNAL" */ + if (IMAP_ARG_TYPE_IS_STRING(args[1].type)) { + mechanism = imap_arg_string(&args[1]); + if (*mechanism != '\0' && + strcasecmp(mechanism, "INTERNAL") != 0) { + client_send_command_error(cmd, + "Unsupported mechanism."); + return TRUE; + } + } + } else { + reset_all = args[0].type == IMAP_ARG_EOL; + mailbox = "INBOX"; + } + + if (!client_verify_mailbox_name(cmd, mailbox, + CLIENT_VERIFY_MAILBOX_SHOULD_EXIST)) + return TRUE; + + storage = client_find_storage(cmd, &mailbox); + if (storage == NULL) + return TRUE; + + if (reset_all) { + if (urlauth_keys_reset(storage)) + client_send_tagline(cmd, "OK All keys removed."); + else + client_send_tagline(cmd, "NO "MAIL_ERRSTR_CRITICAL_MSG); + } else { + if (urlauth_keys_set(storage, mailbox)) + client_send_tagline(cmd, "OK [URLMECH INTERNAL] Key changed."); + else + client_send_tagline(cmd, "NO "MAIL_ERRSTR_CRITICAL_MSG); + } + + return TRUE; +} + +// report urlauth mechanisms +static void urlauth_send_urlmech(struct client *client) +{ + client_send_line(client, + "* OK [URLMECH INTERNAL] Mechanisms supported"); +} + +// a mailbox was deleted (or renamed away) so delete its urlauth key +static void urlauth_delete_mailbox(struct mail_storage *storage, + const char *mailbox) +{ + urlauth_keys_delete(storage, mailbox); +} + +void urlauth_plugin_init(void) +{ + command_register("GENURLAUTH", cmd_genurlauth, 0); + command_register("URLFETCH", cmd_urlfetch, + COMMAND_FLAG_OK_FOR_SUBMIT_USER); + command_register("RESETKEY", cmd_resetkey, 0); + str_append(capability_string, " URLAUTH"); + urlauth_keys_init(); + hook_select_send_urlmech = urlauth_send_urlmech; + hook_delete_mailbox = urlauth_delete_mailbox; +} + +void urlauth_plugin_deinit(void) +{ + command_unregister("GENURLAUTH"); + command_unregister("URLFETCH"); + command_unregister("RESETKEY"); + urlauth_keys_deinit(); + hook_select_send_urlmech = NULL; + hook_delete_mailbox = NULL; +} diff -Nur dovecot-1.2.11/src/plugins/urlauth/urlauth-plugin.h dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth-plugin.h --- dovecot-1.2.11/src/plugins/urlauth/urlauth-plugin.h 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth-plugin.h 2010-01-19 16:11:13.000000000 -0600 @@ -0,0 +1,57 @@ +/* + * Copyright (c) 2010 Apple Inc. All rights reserved. + * + * Redistribution and use in source and binary forms, with or without + * modification, are permitted provided that the following conditions + * are met: + * + * 1. Redistributions of source code must retain the above copyright + * notice, this list of conditions and the following disclaimer. + * 2. Redistributions in binary form must reproduce the above + * copyright notice, this list of conditions and the following + * disclaimer in the documentation and/or other materials provided + * with the distribution. + * 3. Neither the name of Apple Inc. ("Apple") nor the names of its + * contributors may be used to endorse or promote products derived + * from this software without specific prior written permission. + * + * THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND + * ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, + * THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A + * PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS + * CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF + * USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND + * ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, + * OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT + * OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF + * SUCH DAMAGE. + */ + +#ifndef URLAUTH_PLUGIN_H +#define URLAUTH_PLUGIN_H + +#include "imap-url.h" +#include "mail-storage.h" + +#define URLAUTH_KEY_BYTES 16 + +void urlauth_plugin_init(void); +void urlauth_plugin_deinit(void); + +void urlauth_keys_init(void); +void urlauth_keys_deinit(void); +bool urlauth_keys_get(struct mail_storage *storage, const char *mailbox, + buffer_t *key); +bool urlauth_keys_set(struct mail_storage *storage, const char *mailbox); +bool urlauth_keys_delete(struct mail_storage *storage, const char *mailbox); +bool urlauth_keys_reset(struct mail_storage *storage); + +bool urlauth_url_validate(const struct imap_url_parts *parts, bool full, + const char **error); + +void urlauth_urlauth_generate_internal(const char *rump, const buffer_t *key, + string_t *urlauth); + +#endif diff -Nur dovecot-1.2.11/src/plugins/urlauth/urlauth.c dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth.c --- dovecot-1.2.11/src/plugins/urlauth/urlauth.c 1969-12-31 18:00:00.000000000 -0600 +++ dovecot-1.2.11+lemonade/src/plugins/urlauth/urlauth.c 2010-03-05 14:07:34.000000000 -0600 @@ -0,0 +1,159 @@ +/* + * Copyright (c) 2010 Apple Inc. All rights reserved. + * + * Redistribution and use in source and binary forms, with or without + * modification, are permitted provided that the following conditions + * are met: + * + * 1. Redistributions of source code must retain the above copyright + * notice, this list of conditions and the following disclaimer. + * 2. Redistributions in binary form must reproduce the above + * copyright notice, this list of conditions and the following + * disclaimer in the documentation and/or other materials provided + * with the distribution. + * 3. Neither the name of Apple Inc. ("Apple") nor the names of its + * contributors may be used to endorse or promote products derived + * from this software without specific prior written permission. + * + * THIS SOFTWARE IS PROVIDED BY APPLE AND ITS CONTRIBUTORS "AS IS" AND + * ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, + * THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A + * PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL APPLE OR ITS + * CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF + * USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND + * ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, + * OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT + * OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF + * SUCH DAMAGE. + */ + +#include "lib.h" +#include "buffer.h" +#include "str.h" +#include "hex-binary.h" +#include "urlauth-plugin.h" + +#include <openssl/hmac.h> + +#define URLAUTH_URLAUTH_INTERNAL_VERSION "d1" /* must be hex */ + +// compute the urlauth token using the INTERNAL mechanism +void urlauth_urlauth_generate_internal(const char *rump, + const buffer_t *key, + string_t *urlauth) +{ + const void *key_data; + size_t key_len = 0; + unsigned char mac[EVP_MAX_MD_SIZE]; + unsigned int mac_len = 0; + + // compute HMAC-SHA1 of rump with key + key_data = buffer_get_data(key, &key_len); + i_assert(key_len > 0); + HMAC(EVP_sha1(), key_data, key_len, (const unsigned char *) rump, + strlen(rump), mac, &mac_len); + + str_append(urlauth, URLAUTH_URLAUTH_INTERNAL_VERSION); + str_append(urlauth, binary_to_hex(mac, mac_len)); +} + +// validate all the parts of the URL +bool urlauth_url_validate(const struct imap_url_parts *parts, bool full, + const char **error) +{ + // user: mandatory; RFC 3501 "userid" + if (parts->user == NULL || + !imap_url_astring_validate(parts->user)) { + *error = "missing or invalid user ID"; + return FALSE; + } + + // auth_type: optional; RFC 3501 "auth-type" + if (parts->auth_type != NULL && + !imap_url_atom_validate(parts->auth_type)) { + *error = "invalid auth type"; + return FALSE; + } + + // hostport: mandatory; RFC 1738 "hostport" + if (parts->hostport == NULL || + !imap_url_hostport_validate(parts->hostport)) { + *error = "missing or invalid server"; + return FALSE; + } + + // mailbox: mandatory; RFC 3501 "mailbox" + if (parts->mailbox == NULL || + !imap_url_mailbox_validate(parts->mailbox)) { + *error = "missing or invalid mailbox"; + return FALSE; + } + + // uidvalidity: optional; RFC 3501 "nz-number" + if (parts->uidvalidity != NULL && + !imap_url_nz_number_validate(parts->uidvalidity)) { + *error = "invalid uidvalidity"; + return FALSE; + } + + // uid: mandatory; RFC 3501 "nz-number" + if (parts->uid == NULL || + !imap_url_nz_number_validate(parts->uid)) { + *error = "missing or invalid uid"; + return FALSE; + } + + // section: optional; RFC 2192 "section" + if (parts->section != NULL && + !imap_url_section_validate(parts->section)) { + *error = "invalid section"; + return FALSE; + } + + // expiration: optional; RFC 3339 "date-time" + if (parts->expiration != NULL && + (!imap_url_datetime_validate(parts->expiration) || + parts->expiration_time == 0)) { + *error = "invalid expiration"; + return FALSE; + } + + // access: mandatory; RFC 4467 "access" + if (parts->access == NULL || + !imap_url_access_validate(parts->access)) { + *error = "missing or invalid access ID"; + return FALSE; + } + + if (full) { + // mechanism: mandatory; RFC 4467 "mechanism" + if (parts->mechanism == NULL || + !imap_url_mechanism_validate(parts->mechanism)) { + *error = "missing or invalid mechanism"; + return FALSE; + } + + // urlauth: mandatory; RFC 4467 "urlauth" + if (parts->urlauth == NULL || + !imap_url_urlauth_validate(parts->urlauth)) { + *error = "missing or invalid access token"; + return FALSE; + } + } else { + // mechanism: absent + if (parts->mechanism != NULL) { + *error = "mechanism present"; + return FALSE; + } + + // urlauth: absent + if (parts->urlauth != NULL) { + *error = "access token present"; + return FALSE; + } + } + + return TRUE; +}

2 12

[Dovecot] Quota: Maildir and other files
by Michael Kliewe 13 Apr '10

13 Apr '10

Hi everybody, I'm currently working on the quota limits in dovecot, and Maildir quota is working fine, it reports the correct numbers. But our users also have additional space where they can put files, and I would like both to have the same quota of 2 GB. So mails + files should not exceed 2 GB. What is the best way to solve this? I already tried the following: - I put the files in /path/to/user/Maildir/Storage/ , where /path/to/ user/Maildir is the users mail directory. But obviously dovecot does not see that files and gives the wrong numbers. - I tried to use the fs quota backend ("Disk quota"), but I don't get it running, I always get an empty result: dovecot -n: plugin: quota: maildir:User quota quota_rule: *:storage=2G quota_rule2: *:messages=50000 quota_rule3: Trash:storage=10%% quota_rule4: Spam:storage=20%% quota2: fs:Disk quota quota2_rule: *:storage=2G quota2_rule2: *:messages=50000 TAG GETQUOTA "User quota" * QUOTA "User quota" (STORAGE 473178 2048000 MESSAGE 20693 50000) TAG OK Getquota completed. TAG GETQUOTA "Disk quota" * QUOTA "Disk quota" () TAG OK Getquota completed. I don't know why fs is not working. /path/to/user/Maildir is a simple local ext4 partition. In the future it will be a nfs share. Can you point me to a solution, so the user has a limit for both, mails and additional files? Where is the best way to place the additional files? Michael

2 1

[Dovecot] RFC 4468
by Erik Logtenberg 12 Apr '10

12 Apr '10

You know, I was thinking: wouldn't it be nice to have RFC 4468 (Message Submission BURL Extension) support in dovecot? Maybe we should ask the guys from Apple to contribute some support for it, I have a gut feeling they would gladly do so ;) Kind regards -- Erik.

4 5

[Dovecot] Problem with .dovecot.lda-dupes file
by Richert, Vitali 12 Apr '10

12 Apr '10

Hello, I have a strange problem with my first dovecot installation. I see this error massage in the logfile: Apr 9 10:42:44 mail2 dovecot: IMAP(admin(a)domain.tld): stat(/srv/mail/vmail/domain.tld/admin/.dovecot.lda-dupes/tmp) failed: Not a directory Why does dovecot thing that the “.dovecot.lda-dupes” file is a directory? I compiled dovecot 1.2.11 with sieve-0.1.15 and managesieve-0.11.11. thanks -- GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT! Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01

2 2

[Dovecot] Slightly OT: iPhone & IMAP IDLE
by Sabahattin Gucukoglu 12 Apr '10

12 Apr '10

Hi all, Does anybody know whether iPhone is supposed to be able to do IMAP IDLE? I know it does "Push" but that seems to be using Apple's Mobile Me and Exchange. Cheers, Sabahattin

2 1

[Dovecot] Dovecot 1.2.11, Quota and SQL
by Mikaël PIRIO 10 Apr '10

10 Apr '10

Hello, I have a problem :(... I try to define User Quotas in Dovecot (in my DB mySQL) but default quotas (in my dovecot.conf) are always set for all users. I've defined default quota to 500M. I set 0 to one account in my DB but when i see my logs, this account have a 500M quota ! Could you help me ? My configuration : # 1.2.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-xenU i686 Debian 5.0.4 ext3 log_path: /var/log/dovecot.err info_log_path: /var/log/dovecot.info log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_location: maildir:/var/vmail/%d/%n/.maildir mail_debug: yes mbox_write_locks: fcntl dotlock mail_plugins: quota imap_quota auth default: debug: yes debug_passwords: yes passdb: driver: pam passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: static args: uid=vmail gid=vmail home=/var/vmail/%d/%n userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: maildir:User quota quota_rule: *:storage=500M quota_rule2: Trash:storage=10M My dovecote-sql.conf : driver = mysql connect = host=localhost dbname=mail user=mail password=MyPassWord default_pass_scheme = CRYPT password_query = SELECT full_address AS user, password FROM admin_mailbox WHERE full_address = '%u' user_query = SELECT path AS home, uid, gid, concat('*:storage=', quota, 'M') AS quota_rule FROM admin_mailbox WHERE full_address = '%u' When I request my DB, it's OK : mysql> SELECT path AS home, uid, gid, concat('*:storage=', quota, 'M') AS quota_rule FROM admin_mailbox WHERE full_address = 'toto(a)dom.tld'; +------------------------+-----+-----+--------------+ | home | uid | gid | quota_rule | +------------------------+-----+-----+--------------+ | dom.tld/toto/.maildir/ | 500 | 500 | *:storage=0M | +-------------- ---------+-----+-----+--------------+ 1 row in set (0.00 sec) But when i see my logs : IMAP(toto(a)dom.tld): Info: Loading modules from directory: /usr/lib/dovecot/modules/imap IMAP(toto(a)dom.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so IMAP(toto(a)dom.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so IMAP(toto(a)dom.tld): Info: Effective uid=1002, gid=1004, home=/var/vmail/dom.tld/toto IMAP(toto(a)dom.tld): Info: Quota root: name=User quota backend=maildir args= IMAP(toto(a)dom.tld): Info: Quota rule: root=User quota mailbox=* bytes=524288000 messages=0 IMAP(toto(a)dom.tld): Info: Quota rule: root=User quota mailbox=Trash bytes=10485760 messages=0 Thanks for your help, -- Mikaël,

1 1

[Dovecot] zlib Plugin Dovecot 2.0
by Alex Baule 09 Apr '10

09 Apr '10

Hi Everyone.... Someone can explain to me the difference from zlib 1.2.X and 2.0 beta4 ?? In zlib from 2.0 beta4, Which part of the plugin is responsible for write the compressed message ?

2 4

[Dovecot] push mail support
by Ibrahim Harrani 09 Apr '10

09 Apr '10

Hello, I would like to use push in qmail+dovecot environments. Can someone tell me which components should I use to enable this feature for mobile devices? Thanks. -Ibrahim.

4 8

[Dovecot] Trouble with managesieve symbolic link creation
by Daniela Silva 09 Apr '10

09 Apr '10

Hi, I've been trying to get managesieve to work on our installation, but although almost everything works fine the symbolic link from .dovecot.sieve to the sieve dir gets created with a / in the beginning: drwx------ 4 vmail users 128 2010-04-08 18:35 . drwxr-xr-x 5 vmail users 144 2009-08-28 18:26 .. lrwxrwxrwx 1 vmail users 17 2010-04-08 18:35 .dovecot.sieve -> /sieve/ingo.sieve drwx------ 20 vmail users 952 2010-04-08 16:47 maildir drwx------ 3 vmail users 104 2010-04-08 18:35 sieve Can anyone see what I'm doing wrong? You can find the dovecot configuration below. Thanks, -- Daniela Silva # 1.2.11: /etc/dovecot/dovecot.conf protocols: imap pop3 managesieve listen: 10.1.0.1 10.1.32.1 10.1.33.1 10.1.33.2 10.1.33.3 ssl: no disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_processes_count: 128 login_max_processes_count: 512 max_mail_processes: 2500 verbose_proctitle: yes mail_uid: 1000 mail_gid: 100 mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): quota imap_quota zlib trash mail_plugins(imap): quota imap_quota zlib trash mail_plugins(pop3): quota zlib mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib64/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib64/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib64/dovecot/modules/managesieve mail_log_max_lines_per_sec: 0 lda: postmaster_address: postmaster(a)portugalmail.net mail_plugins: quota sieve mail_plugin_dir: /usr/lib64/dovecot/modules/lda auth_socket_path: /var/run/dovecot/auth-master auth default: mechanisms: plain login passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: users plugin: quota: maildir trash: /etc/dovecot/dovecot-trash.conf sieve: ~/.dovecot.sieve sieve_dir: ~/sieve

2 1

[Dovecot] Sieve scripts
by Nick Lunt 09 Apr '10

09 Apr '10

Hi I have a simple sieve script to discard email with a certain string in the subject. I now need to beef this up a bit with the following: if header :contains "subject" "A" and "B" and not "C" discard if header :contains "subject" "A" and "D" and not "C" discard else pass Maybe my google skills are failing but I can't find much info on creating sieve scripts. Can anyone point me in the right direction to achieve this please ? Cheers Nick . __________ Information from ESET NOD32 Antivirus, version of virus signature database 4992 (20100401) __________ The message was checked by ESET NOD32 Antivirus. http://www.eset.com

4 5

[Dovecot] Dovecot 2.0 and QUOTA capability
by Frode Nordahl 09 Apr '10

09 Apr '10

Hello, In Dovecot 2.0 the QUOTA capability is not announced until after the user has logged in. This breaks quota-support in some webmail clients (Roundcube, Atmail, probably more). After searching the lists, I see that this was fixed as a bug back in 1.0, but I guess it crept back in. :-) 1.0.7: * OK Dovecot ready. . CAPABILITY * CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS QUOTA STARTTLS AUTH=PLAIN . OK Capability completed. 2.0: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN] Dovecot ready. . capability * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN . OK Capability completed. -- Frode Nordahl

3 4

[Dovecot] Shared folders in 2.0
by B. Johannessen 09 Apr '10

09 Apr '10

Anyone using shared folders in 2.0? If so, would you care to share your configuration? I'm seeing all kinds of strangeness, and the only consistent thing so far is that my results are thoroughly inconsistent. There's a very good chance this is all because of my very limited experience with Dovecot, which is why I'd like to be able to start my experiments from a known good configuration. Anyone? Bob

1 0

[Dovecot] unknown user
by Simone Neugierig 08 Apr '10

08 Apr '10

Hi, im in the process of setting up a virtual domain next to a real one with dovecot and postfix. Looks like postfix sends the mail to deliver: #mail.info postfix/pipe[23588]: F254880ED8: to=<julius(a)abm.ath.cx>, relay=dovecot, delay=0.04, delays=0.03/0/0/0.01, dsn=5.1.1, status=bounced (user unknown) but dovecot doesnt know my user: #dovecot-info.log dovecot: Apr 08 16:16:42 Info: auth(default): passwd-file(julius(a)abm.ath.cx): unknown user my user: #/etc/dovecot/passwd julius:{PLAIN}somepassword Any ideas whats wrong? more infos: this is a debian lenny with the default postfix installation, changes to #master.cf dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${recipient} #main.cf dovecot_destination_recipient_limit = 1 virtual_mailbox_domains = abm.ath.cx virtual_transport = dovecot #dovecot.conf protocols = imap imaps pop3 pop3s log_path = /var/log/dovecot.log info_log_path = /var/log/dovecot-info.log disable_plaintext_auth = no mail_location = maildir:~/Maildir pop3_uidl_format = %08Xu%08Xv auth_verbose = yes auth default { mechanisms = plain passdb passwd-file { args = /etc/dovecot/passwd } userdb static { args = uid=vmail gid=vmail home=/home/vmail/%u } socket listen { master { path = /var/run/dovecot/auth-master mode = 0600 } } } greets -- GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT! Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01

2 2

[Dovecot] Incoming mails + remote backup
by minim 08 Apr '10

08 Apr '10

Hello, I have to take two copy of incoming mails on different servers(local & remote). I am using plain server without any panel on it and using sendmail, pop3 server Dovecot. Is there a way(any configurations) to take a remote backup for all incoming mails? except configuring forwarder to each mail ID !!!! Waiting for suggestions. Thanks in advance -- View this message in context: http://old.nabble.com/Incoming-mails-%2B-remote-backup-tp28137629p28137629.… Sent from the Dovecot mailing list archive at Nabble.com.

3 9

[Dovecot] Manage mails from server
by Неворотин Вадим 08 Apr '10

08 Apr '10

I've configure Dovecot with shared namespace and IMAP ACL's to make a group mailboxes. I use maildir mailboxes, and I add dovecot-shared file to each group mailbox. So each user with access to group mailbox has their own \Seen flag. And now I need automatically delete a mail from server after 2 weeks after each user has readed email in shared mailbox. How can I from, e.g. Perl script, get \Seen flag for user and mail and then correctly delete a mail from a server? I need to create fully automatical mail system, maybe there is some HOW-TO's or examples anywhere? And will I can in 2.0 use per-user \Deleted flag, not only \Seen?

3 5

[Dovecot] Have problem with antispam plugin
by gerasew＠gmail.com 08 Apr '10

08 Apr '10

I downloaded the source code plug-in version 1.3 from http://johannes.sipsolutions.net/download/dovecot-antispam/ Unpack and make from this .config file: BACKEND=mailtrain DOVECOT=/usr/include/dovecot INSTALLDIR=/usr/lib/dovecot/modules/imap USER=root GROUP=root DEBUG=syslog DEBUG_VERBOSE=1 PLUGINNAME=antispam Dovecot cofing file: protocol imap { login_executable = /usr/lib/dovecot/imap-login mail_executable = /usr/lib/dovecot/imap mail_plugins = quota imap_quota antispam } plugin { antispam_mail_sendmail = /usr/bin/sa-learn antispam_mail_spam = --spam antispam_mail_notspam = --ham antispam_mail_tmpdir = /tmp antispam_trash_pattern_ignorecase = trash;Deleted * antispam_spam_pattern_ignorecase = junk;spam } When move message into\from "Spam" folder get error: [SERVERBUG] failed to send email In syslog: imap: antispam: plugin initialising (1.3-notgit) dovecot: IMAP(test(a)u-kon.ru): Loading modules from directory: /usr/lib/dovecot/modules/imap dovecot: IMAP(test(a)u-kon.ru): Module loaded: /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so dovecot: IMAP(test(a)u-kon.ru): Module loaded: /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so dovecot: IMAP(test(a)u-kon.ru): Module loaded: /usr/lib/dovecot/modules/imap/lib90_antispam_plugin.so dovecot: IMAP(test(a)u-kon.ru): Effective uid=8, gid=12, home=(none) dovecot: IMAP(test(a)u-kon.ru): Quota root: name= backend=maildir args= dovecot: IMAP(test(a)u-kon.ru): Quota rule: root= mailbox=* bytes=2134810624 messages=0 dovecot: imap-login: Login: user=<test(a)u-kon.ru>, method=PLAIN, rip=192.168.10.59, lip=192.168.10.77, TLS imap: antispam: "trash" is case-insensitive wildcard match trash folder imap: antispam: "deleted *" is case-insensitive wildcard match trash folder imap: antispam: "SPAM" is exact match spam folder imap: antispam: "junk" is case-insensitive wildcard match spam folder imap: antispam: "spam" is case-insensitive wildcard match spam folder imap: antispam: no unsure folders imap: antispam: mail backend spam address --spam imap: antispam: mail backend not-spam address --ham imap: antispam: mail backend sendmail /usr/bin/sa-learn imap: antispam: mail backend sendmail arg --single imap: antispam: mail backend tmpdir /tmp dovecot: IMAP(test(a)u-kon.ru): maildir: data=/var/spool/mail/test(a)u-kon.ru dovecot: IMAP(test(a)u-kon.ru): maildir++: root=/var/spool/mail/test(a)u-kon.ru, index=, control=, inbox=/var/spool/mail/test(a)u-kon.ru dovecot: IMAP(test(a)u-kon.ru): Namespace : Using permissions from /var/spool/mail/test(a)u-kon.ru: mode=0700 gid=-1 imap: antispam: mailbox_is_unsure(Junk): 0 imap: antispam: mailbox_is_trash(INBOX): 0 imap: antispam: mailbox_is_trash(Junk): 0 imap: antispam: mail copy: from trash: 0, to trash: 0 imap: antispam: mailbox_is_spam(INBOX): 0 imap: antispam: mailbox_is_spam(Junk): 1 imap: antispam: mailbox_is_unsure(INBOX): 0 imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 imap: antispam: running mailtrain backend program /usr/bin/sa-learn imap: antispam: running mailtrain backend program /usr/bin/sa-learn imap: antispam: run program failed with exit code 9 Get sa-learn output from help this script: #!/bin/bash ( id -a sa-learn rc=$? echo "exit code $rc" exit $rc ) > /tmp/antispam.out.$$ 2> /tmp/antispam.err.$$ antispam.err - contains output as "sa-learn --help" So this means that the call comes without any parameters or with incorrect parameters. I need this to work, please help.

2 4

[Dovecot] ImapTest build problem
by Proskurin Kirill 08 Apr '10

08 Apr '10

Hello. My system is: Debian Lenny 2.6.26-2-amd64 I try to build Imaptest and follow http://www.imapwiki.org/ImapTest/Installation But get this: ./configure --with-dovecot=../dovecot-2.0.beta4 && make checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for gawk... gawk checking whether make sets $(MAKE)... yes checking whether to enable maintainer-specific portions of Makefiles... no checking for gcc... gcc checking for C compiler default output file name... a.out checking whether the C compiler works... yes checking whether we are cross compiling... no checking for suffix of executables... checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether gcc accepts -g... yes checking for gcc option to accept ANSI C... none needed checking for style of include used by make... GNU checking dependency style of gcc... gcc3 checking how to run the C preprocessor... gcc -E checking build system type... x86_64-unknown-linux-gnu checking host system type... x86_64-unknown-linux-gnu checking for a sed that does not truncate output... /bin/sed checking for egrep... grep -E checking for ld used by gcc... /usr/bin/ld checking if the linker (/usr/bin/ld) is GNU ld... yes checking for /usr/bin/ld option to reload object files... -r checking for BSD-compatible nm... /usr/bin/nm -B checking whether ln -s works... yes checking how to recognise dependent libraries... pass_all checking for ANSI C header files... yes checking for sys/types.h... yes checking for sys/stat.h... yes checking for stdlib.h... yes checking for string.h... yes checking for memory.h... yes checking for strings.h... yes checking for inttypes.h... yes checking for stdint.h... yes checking for unistd.h... yes checking dlfcn.h usability... yes checking dlfcn.h presence... yes checking for dlfcn.h... yes checking for g++... g++ checking whether we are using the GNU C++ compiler... yes checking whether g++ accepts -g... yes checking dependency style of g++... gcc3 checking how to run the C++ preprocessor... g++ -E checking for g77... no checking for f77... no checking for xlf... no checking for frt... no checking for pgf77... no checking for fort77... no checking for fl32... no checking for af77... no checking for f90... no checking for xlf90... no checking for pgf90... no checking for epcf90... no checking for f95... no checking for fort... no checking for xlf95... no checking for ifc... no checking for efc... no checking for pgf95... no checking for lf95... no checking for gfortran... no checking whether we are using the GNU Fortran 77 compiler... no checking whether accepts -g... no checking the maximum length of command line arguments... 32768 checking command to parse /usr/bin/nm -B output from gcc object... ok checking for objdir... .libs checking for ar... ar checking for ranlib... ranlib checking for strip... strip checking if gcc supports -fno-rtti -fno-exceptions... no checking for gcc option to produce PIC... -fPIC checking if gcc PIC flag -fPIC works... yes checking if gcc static flag -static works... yes checking if gcc supports -c -o file.o... yes checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes checking whether -lc should be explicitly linked in... no checking dynamic linker characteristics... GNU/Linux ld.so checking how to hardcode library paths into programs... immediate checking whether stripping libraries is possible... yes checking if libtool supports shared libraries... yes checking whether to build shared libraries... yes checking whether to build static libraries... yes configure: creating libtool appending configuration tag "CXX" to libtool checking for ld used by g++... /usr/bin/ld -m elf_x86_64 checking if the linker (/usr/bin/ld -m elf_x86_64) is GNU ld... yes checking whether the g++ linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes checking for g++ option to produce PIC... -fPIC checking if g++ PIC flag -fPIC works... yes checking if g++ static flag -static works... yes checking if g++ supports -c -o file.o... yes checking whether the g++ linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes checking dynamic linker characteristics... GNU/Linux ld.so checking how to hardcode library paths into programs... immediate appending configuration tag "F77" to libtool configure: creating ./config.status config.status: creating Makefile config.status: creating src/Makefile config.status: creating stamp.h config.status: creating imaptest-config.h config.status: imaptest-config.h is unchanged config.status: executing depfiles commands make all-recursive make[1]: Entering directory `/root/imaptest-20100221' Making all in src make[2]: Entering directory `/root/imaptest-20100221/src' if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I/root/dovecot-2.0.beta4 -I/root/dovecot-2.0.beta4/src/lib -I/root/dovecot-2.0.beta4/src/lib-mail -I/root/dovecot-2.0.beta4/src/lib-imap -g -O2 -MT client.o -MD -MP -MF ".deps/client.Tpo" -c -o client.o client.c; \ then mv -f ".deps/client.Tpo" ".deps/client.Po"; else rm -f ".deps/client.Tpo"; exit 1; fi client.c: In function ‘client_enabled’: client.c:178: warning: assignment makes pointer from integer without a cast client.c: In function ‘client_vanished’: client.c:203: error: called object ‘3’ is not a function client.c:207: warning: passing argument 1 of ‘strlen’ makes pointer from integer without a cast client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: passing argument 1 of ‘__builtin_strcmp’ makes pointer from integer without a cast client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: passing argument 1 of ‘strlen’ makes pointer from integer without a cast client.c:207: warning: passing argument 1 of ‘__builtin_strcmp’ makes pointer from integer without a cast client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: passing argument 1 of ‘__builtin_strcmp’ makes pointer from integer without a cast client.c:207: warning: cast to pointer from integer of different size client.c:207: warning: passing argument 1 of ‘__builtin_strcmp’ makes pointer from integer without a cast client.c:221: warning: assignment makes pointer from integer without a cast client.c: In function ‘client_handle_untagged’: client.c:278: warning: passing argument 1 of ‘t_str_ucase’ makes pointer from integer without a cast client.c:286: warning: passing argument 1 of ‘t_str_ucase’ makes pointer from integer without a cast client.c:312: warning: pointer/integer type mismatch in conditional expression client.c: In function ‘client_input_args’: client.c:354: warning: assignment makes pointer from integer without a cast client.c:378: warning: assignment makes pointer from integer without a cast make[2]: *** [client.o] Error 1 make[2]: Leaving directory `/root/imaptest-20100221/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/root/imaptest-20100221' make: *** [all] Error 2 -- Best regards, Proskurin Kirill

2 5

[Dovecot] dovecot upgrade problems
by Cieslak, Andreas 08 Apr '10

08 Apr '10

Hi list, i made an upgrade from dovecot 1.0RC15 to 1.1.20 the default installation was under /etc/dovecot. The upgrade installation was made under /usr/local/etc. After that i changed all the paths in the /usr/local/etc/dovecot.conf and the dovecot-binary to work with the new installation. Even path-changes were made for /etc/init.d/dovecot to work with the version 1.1.20. Changes in the /etc/init.d/dovecot: #### PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin DAEMON=/usr/local/sbin/dovecot NAME=dovecot DESC="mail server" test -x $DAEMON || exit 0 set -e # The init script should do nothing if dovecot is being run from inetd for p in `sed -r "s/^ *(([^:]+|\[[^]]+]|\*):)?(pop3s?|imaps?)[ \t].*/\3/;t;d" \ /etc/inetd.conf` do for q in `sed -r "s/^ *protocols[ \t]*=[ \t]*(([^\"]*)|\"(.*)\")/\2\3/;t;d" \ /usr/local/etc/dovecot.conf` do if [ $p = $q ]; then exit 0 fi done done case "$1" in start) if grep protocols /usr/local/etc/dovecot.conf | sed 's/#.*$//' | tr -d '"' | \ egrep -q '[^#]*(\bpop3s?\b|\bimaps?\b)'; then if [ -x /usr/local/libexec/dovecot/imap-login -a -x /usr/local/libexec/dovecot/imap ] \ || [ -x /usr/local/libexec/dovecot/pop3-login -a -x /usr/local/libexec/dovecot/pop3 ] #### If I leave the DAEMON-Path to =/usr/sbin/dovecot Dovecot is running fine!!! The only thing which is missing under /usr/local is the auth-master file. Under /var/run/dovecot the old auth-master file exists. Why not under the upgrade path? Anyway, here is the logging when i try to start dovecot: Apr 6 16:18:37 server dovecot: dovecot v1.1.20 starting up (core dumps disabled) Apr 6 16:18:37 server dovecot: Fatal: auth(default): Dovecot version mismatch: Master is v1.1.20, dovecot-auth is v1.0.rc15 (if you don't care, set version_ignore=yes) Apr 6 16:18:37 server dovecot: Fatal: Auth process died too early - shutting down server:/usr/local/etc# /etc/init.d/dovecot restart Restarting mail server: dovecotWarning: Last died with error (see error log for more information): Auth process died too early - shutting down Also the configuration output: dovecot -n # 1.1.20: /usr/local/etc/dovecot.conf # OS: Linux 2.6.18-4-686 i686 Debian 4.0 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps pop3s imap ssl_key_file: /etc/ssl/private/dovecot.key disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_max_processes_count: 256 first_valid_uid: 1000 last_valid_uid: 5000 mail_access_groups: mail mail_location: maildir:~/Maildir mail_debug: yes mail_full_filesystem_access: yes mbox_write_locks: fcntl mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 lda: postmaster_address: cieslak(a)folkwang-hochschule.de hostname: server log_path: /var/log/dovecot-deliver.log info_log_path: /var/log/dovecot-deliver.log sendmail_path: /usr/lib/sendmail auth default: mechanisms: login plain verbose: yes debug: yes process_size: 512 passdb: driver: passwd args: /etc/passwd passdb: driver: shadow args: /etc/shadow passdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf userdb: driver: passwd args: blocking=yes userdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf socket: type: listen master: path: /usr/local/var/run/dovecot/auth-master mode: 384 user: mail plugin: quota: maildir ###auth-master is not existing under the path /usr/local/var/run/dovecot/auth-master. Is this the fault? Can anyone help me out? Andreas Cieslak IT-Systeme Folkwang Hochschule Musik | Theater | Tanz | Gestaltung | Wissenschaft Klemensborn 39 45239 Essen Fon: 0201_4903-218 Fax: 0201_4903-288 cieslak(a)folkwang-hochschule.de www.folkwang-hochschule.de <http://www.folkwang-hochschule.de/>

4 7

[Dovecot] sasl problem
by Yavuz Maşlak 07 Apr '10

07 Apr '10

Hello I installed postfix, mysql, dovecot on freebsd7.3. Yet I can't start dovecot service. I get some errors; Apr 4 17:03:14 postfix dovecot: auth(default): Fatal: Socket already exists: /var/spool/postfix/private/auth Apr 4 17:03:14 postfix dovecot: dovecot: Fatal: Auth process died too early - shutting down How can I get rid of that ? # dovecot --version 1.2.10 # postconf -a dovecot # dovecot -n # 1.2.10: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.3-RELEASE i386 ufs base_dir: /var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/dovecot/cert.pem ssl_key_file: /etc/ssl/dovecot/key.pem disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: ISP Mail Server Ready. first_valid_uid: 125 last_valid_uid: 125 first_valid_gid: 125 last_valid_gid: 125 mail_location: maildir:/usr/local/virtual/%d/%n mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 lda: postmaster_address: postmaster(a)test.com auth default: mechanisms: plain login debug: yes passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix # grep -v '^ *$#.*$\?$' /usr/local/etc/dovecot-sql.conf driver = mysql connect = host=localhost dbname=postfix user=postfix password=postfix_mysql_password default_pass_scheme = MD5 password_query = SELECT password FROM mailbox WHERE username = '%u' user_query = SELECT maildir, 125 AS uid, 125 AS gid, CONCAT('maildir:storage=', FLOOR( quota / 1024 ) ) AS quota FROM mailbox WHERE username = '%u' AND active = '1' # postconf -n broken_sasl_auth_clients = yes command_directory = /usr/local/sbin config_directory = /usr/local/etc/postfix daemon_directory = /usr/local/libexec/postfix data_directory = /var/db/postfix debug_peer_level = 2 html_directory = /usr/local/share/doc/postfix mail_owner = postfix mailq_path = /usr/local/bin/mailq manpage_directory = /usr/local/man mydestination = localhost.$mydomain, localhost mydomain = test.com myhostname = www.test.com mynetworks_style = host newaliases_path = /usr/local/bin/newaliases proxy_read_maps = $local_recipient_maps $mydestination $virtual_alias_maps $virtual_alias_domains $virtual_mailbox_maps $virtual_mailbox_domains $relay_recipient_maps $relay_domains $canonical_maps $sender_canonical_maps $recipient_canonical_maps $relocated_maps $transport_maps $mynetworks $virtual_mailbox_limit_maps queue_directory = /var/spool/postfix readme_directory = /usr/local/share/doc/postfix relay_domains = proxy:mysql:/usr/local/etc/postfix/mysql_relay_domains_maps.cf sample_directory = /usr/local/etc/postfix sendmail_path = /usr/local/sbin/sendmail setgid_group = maildrop smtp_tls_note_starttls_offer = yes smtp_use_tls = yes smtpd_recipient_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_non_fqdn_hostname, reject_non_fqdn_sender, reject_non_fqdn_recipient, reject_unauth_destination, reject_unauth_pipelining, reject_invalid_hostname, reject_rbl_client list.dsbl.org, reject_rbl_client bl.spamcop.net, reject_rbl_client sbl-xbl.spamhaus.org smtpd_sasl_auth_enable = yes smtpd_sasl_authenticated_header = yes smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = private/auth smtpd_sasl_security_options = noanonymous smtpd_sasl_type = dovecot smtpd_sender_restrictions = permit_sasl_authenticated, permit_mynetworks smtpd_tls_CAfile = /etc/ssl/postfix/smtpd.pem smtpd_tls_cert_file = /etc/ssl/postfix/smtpd.pem smtpd_tls_key_file = /etc/ssl/postfix/smtpd.pem smtpd_tls_loglevel = 0 smtpd_tls_received_header = yes smtpd_tls_session_cache_timeout = 3600s smtpd_use_tls = yes soft_bounce = no tls_random_source = dev:/dev/urandom unknown_local_recipient_reject_code = 550 virtual_alias_maps = proxy:mysql:/usr/local/etc/postfix/mysql_virtual_alias_maps.cf virtual_gid_maps = static:125 virtual_mailbox_base = /usr/local/virtual virtual_mailbox_domains = proxy:mysql:/usr/local/etc/postfix/mysql_virtual_domains_maps.cf virtual_mailbox_limit = 51200000 virtual_mailbox_limit_maps = proxy:mysql:/usr/local/etc/postfix/mysql_virtual_mailbox_limit_maps.cf virtual_mailbox_limit_override = yes virtual_mailbox_maps = proxy:mysql:/usr/local/etc/postfix/mysql_virtual_mailbox_maps.cf virtual_maildir_limit_message = Sorry, this user has overdrawn their diskspace quota. Please try again later. virtual_minimum_uid = 125 virtual_overquota_bounce = yes virtual_transport = virtual virtual_uid_maps = static:125

2 4

[Dovecot] Forcing NOSELECT for a Maildir folder?
by Nils 07 Apr '10

07 Apr '10

Hello, is it at all possible, possibly without modifying the source code of Dovecot, to enforce that a mailbox gets the NOSELECT attribute? I have a namespace set up like this: namespace private { separator = / prefix = Local Folders/ location = maildir:/xyz/core/store/maildir/%u/ inbox = yes hidden = no list = yes subscriptions = yes } And the folder hierarchy my client builds based on the LIST response from Dovecot comes out as: INBOX Local Folders <--- (standard flags, but no NOSELECT) - Folder 1 -- Folder 1.1 - Folder 2 - Sent - Trash Public Folders <--- NOSELECT - Announcements That's how I expect it, except that I don't want "Local Folders" to be selectable. When I select it and list the contents, I get the contents of INBOX. I have no clue why that happens. :-/ For the public namespace, everything works as expected, so I'm lost. Basically: I want "Local Folders" to be like "Public Folders" and have \NOSELECT. In maildir_storage.c I can find places where a MAILBOX_NOSELECT flag is set, but from what I understand that's only done if the path is not a directory or if the permissions are insufficient. Random taking away of permissions on folders didn't yield the result I wanted. Either it resulted in no change, or in Dovecot complaining that the permissions were now too restrictive. Forgive me if I missed something obvious. I only studied the source using grep and nano for 10 minutes before adding an ugly hack in my client to fake that Dovecot gave the "Local Folders" mailbox the NOSELECT attribute (my client is the only one that will ever talk to my installation of Dovecot, so I can do that). The wiki also didn't mention anything on NOSELECT. Google searches didn't help either. I'd much rather have Dovecot give the response I want, rather than bending its responses around in my client. Any ideas how I can achieve that? - Nils --------------- [q@lala dovecot]# dovecot --version 1.2.11 --------------- [q@lala dovecot]# telnet 127.0.0.1 144 * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5] Private Messages Server 0 LOGIN abc def OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS QUOTA] Logged in 1 LIST "" "*" * LIST (\HasChildren) "/" "Local Folders" * LIST (\HasNoChildren) "/" "Local Folders/Trash" * LIST (\HasNoChildren) "/" "Local Folders/Sent" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasChildren) "/" "Public Folders" * LIST (\HasNoChildren) "/" "Public Folders/Announcements" 1 OK List completed. 2 STATUS INBOX (messages) * STATUS "INBOX" (MESSAGES 4) 2 OK Status completed. 3 STATUS "Local Folders" (messages) * STATUS "Local Folders" (MESSAGES 4) 3 OK Status completed. 4 LOGOUT * BYE Logging out 4 OK Logout completed. --------------- [q@lala dovecot]# dovecot -n -c /etc/dovecot/dovecot-pm.conf # 1.2.11: /etc/dovecot/dovecot-pm.conf # OS: Linux 2.6.32-ARCH i686 base_dir: /var/run/dovecot-pm/ listen: 127.0.0.1:144 ssl: no disable_plaintext_auth: no login_dir: /var/run/dovecot-pm//login login_executable: /usr/lib/dovecot/imap-login login_greeting: Private Messages Server mail_max_userip_connections: 5 mail_debug: yes mail_plugins: quota imap_quota trash acl namespace: type: private separator: / prefix: Local Folders/ location: maildir:/xyz/core/store/maildir/%u/ inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: Public Folders/ location: maildir:/xyz/core/store/publicmaildir/:INDEX=~/public/ list: yes auth default: mechanisms: plain login cram-md5 user: xyz passdb: driver: sql args: /etc/dovecot/dovecot-pm-sql.conf userdb: driver: static args: uid=xyz gid=xyz home=/xyz/core/store/maildir/%n plugin: quota: maildir:User Quota quota_rule: *:backend=1000C,26214400S quota_rule2: Trash:storage=25M quota_warning: storage=80%% /xyz/cronobs/QuotaWarning.php quota_warning2: messages=9500 /xyz/cronobs/QuotaWarning.php trash: /etc/dovecot/dovecot-pm-trash.conf acl_anyone: allow acl: vfile:/etc/dovecot/pm-acls --------------- [q@lala dovecot]# cat /etc/dovecot/dovecot-pm-sql.conf driver = pgsql connect = host=127.0.0.1 dbname=xyz user=abc password=def default_pass_scheme = PLAIN password_query = \ SELECT "Username" AS "username", "Password" as "password" \ FROM "users" WHERE "Username" = '%n'; --------------- [q@lala dovecot]# cat /etc/dovecot/dovecot-pm-trash.conf 1 Local Folders/Trash --------------- [q@lala dovecot]# cat /etc/dovecot/pm-acls/Announcements authenticated lrs

3 2

[Dovecot] Clients to manage ACL
by Martin Ott 07 Apr '10

07 Apr '10

Hi, is there any list with clients which support setting ACL on imap-mailboxes? Up to now, a only know about KMail and imapACLM. Thanks, Martin

7 10

[Dovecot] Maildir archive utility for historical filing
by Dimitrios Karapiperis 07 Apr '10

07 Apr '10

Hi all! Is there any utility to archive maildir folders based on message date? I found cleanup-maildir, but you have to supply the directory as parameter. thanks in advance Dimitrios

3 2

[Dovecot] Testing 2.0b3 - problem with pop3
by Odhiambo Washington 07 Apr '10

07 Apr '10

I am testing the version on FreeBSD 7.3-PRELEASE (I doubt it's the issue) and I am having a problem with pop3. Here is what I see in the log when I attempt to connect to port 110: Feb 22 18:15:03 master: Warning: SIGHUP received - reloading configuration Feb 22 18:15:08 pop3-login: Panic: file login-settings.c: line 216 (login_settings_read): assertion failed: (input.roots[count] == NULL) Feb 22 18:15:08 master: Error: service(pop3-login): child 70115 killed with signal 6 (core dumped) Feb 22 18:15:08 master: Error: service(pop3-login): command startup failed, throttling And the output of doveconf can be seen at http://62.8.64.102/~wash/2.0b3.txt I've basically made my best effort to reflect the settings I had on 2.0b1 into this version. What could the problem be? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254733744121/+254722743223 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ "If you have nothing good to say about someone, just shut up!." -- Lucky Dube

7 10

[Dovecot] Timeout Value
by JackyC＠umac.mo 07 Apr '10

07 Apr '10

Dear All, I constantly encounter 'dovecot-auth', 'login-imap', 'login-pop3' and 'imap' processes consume 100% CPU. I run 'ps' and found those hanged up processes were running for a long time. I am wondering whether dovecot.conf has some configuration parameters that timeout those processes (or kill those after certain period of time). I am using dovecot 1.2.11 on RHEL 5.3. Many thanks ~~~ Yours Sincerely, Jacky Chan

4 11

[Dovecot] expires
by ben＠electricembers.net 07 Apr '10

07 Apr '10

When the expire cronjob actually finds a folder needs pruning, does it then purge the row from the database? Or could it update the row with the "new" oldest message's expiration time? I guess I can test this for myself. I did just learn that emptying the Trash removes the row from the expires db. . . I had misconfigured expires here, and think I fixed it, but in checking things over, I do find some "over age" files, and their users don't appear in the expires db. So I'm assuming it's because expiration worked on that folder some time ago, and no "new" messages have been delivered there since then to reset the expires db? (Sometimes I wish there wasn't the db, and we could just have a nightly cronjob do all the work on all users' Trash, Spam, Virus folders -- where we pretty much expect to be constantly pruning, or shaving as it were ;) Benjamin

1 0

[Dovecot] please me help with correct that error than upgrade to dovecot
by fakessh 06 Apr '10

06 Apr '10

hello all hello list hello girl hello much many people me help with correct that error than upgrade to dovecot the upgrace goes well, but I have errors when restarting the application necessary: mistake here. please help me to correct them. I would really benefit from the novelties of this version of dovecot [root@r13151 ~]# rpm -Uvh /home/ftpchrootshell/fakessh/dovecot-1.2.10-2_107.el5.i386.rpm attention: /home/ftpchrootshell/fakessh/dovecot-1.2.10-2_107.el5.i386.rpm: Ent�te V4 DSA signature: NOKEY, key ID 66534c2b Pr�paration... ########################################### [100%] 1:dovecot attention: /etc/dovecot.conf cr�� en tant que /etc/dovecot.conf.rpmnew ########################################### [100%] [root@r13151 ~]# service dovecot restart Arr�t de Dovecot Imap : [ OK ] D�marrage de Dovecot Imap :Warning: fd limit 1024 is lower than what Dovecot can use under full load (more than 1280). Either grow the limit or change login_max_processes_count and max_mail_processes settings If you have trouble with authentication failures, enable auth_debug setting. See http://wiki.dovecot.org/WhyDoesItNotWork This message goes away after the first successful login. Fatal: listen(::, 143) failed: Address already in use [�CHOU] [root@r13151 ~]#

2 1

Re: [Dovecot] Manage mails from server
by Steffen Kaiser 06 Apr '10

06 Apr '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 6 Apr 2010, Неворотин Вадим wrote: >> Use PREAUTH sessions on behalf of each user to get the user-specific flag. > > But how can I use PREAUTH sessions for virtual users? I can only start See: http://wiki.dovecot.org/PreAuth if already available, I've created that page a few minutes ago. set USER= HOME= and MAIL= for the dovecot programm accordingly. regards, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iQEVAwUBS7s2gL+Vh58GPL/cAQKL3wf7BpRIYYS/Tzv7l7eSfyFGpvT/llHS13Xr EaGrbNOLPHYzRl7FFTUHrioO8I6EzHBudrWbq3ha/P065jJd0Pmmsg1vTIYGAK4c lMPYXlF/RN+J7qJ6yIgI7JrSZrYTUDKzQ1+yVtyjcgyFl0o2GGlLSHV0oQL1HEFD VojKnWLriHIJxEgmMQtGfjr8ICMVkYnXVkJcU1Ted0+IdyrBfUOs750vs84c2cxz BGmfnbsDC5s2TuhxOir7RRvfbSsg0siOEB2wyO1Gae3QYtuRDwwtWgJmG++URLiw yI6w+W/mE38NxDxlBM2BQoXLbC8e/1AmN1gHlwiDbTRwfQqBqhHhgw== =z3LP -----END PGP SIGNATURE-----

1 0

[Dovecot] PIGEON HOLE - am I being stupid?
by corpus.defero 06 Apr '10

06 Apr '10

Hi, I'm trying to compile dovecot-1.2-sieve-0.1.15 on a CENTOS 5 box. Using: ./configure --with-dovecot=/usr/local/etc and with: ls -Al /usr/local/etc/ total 100 -rw-r--r-- 1 root root 49576 Apr 6 12:25 dovecot.conf -rw-r--r-- 1 root root 410 Apr 6 12:25 dovecot-db-example.conf -rw-r--r-- 1 root root 782 Apr 6 12:25 dovecot-dict-sql-example.conf -rw-r--r-- 1 root root 4986 Apr 6 12:25 dovecot-ldap-example.conf -rw-r--r-- 1 root root 5097 Apr 6 12:25 dovecot-sql-example.conf But it bails with: appending configuration tag "F77" to libtool dovecot-config not found from /usr/local/etc, use --with-dovecot=PATH to give path to compiled Dovecot sources or to a directory with the installed dovecot-config file. configure: error: dovecot-config not found What am I missing here?

3 3

[Dovecot] Managing IMAP ACL from script
by Неворотин Вадим 06 Apr '10

06 Apr '10

I need to change ALC for mailboxes from a script on my server. As I understand now I can correctly change ACL only via telnet using IMAP commands. And moreover I need to know user's password for it. Is there any plans to add inheritance of ACL and ability to manage it directly from a server? And if it is in which version? Will 2.0 fully support ACL? Now I use Dovecot 1.2.10.

2 1

[Dovecot] Dovecot index storage question
by Stewart Dean 06 Apr '10

06 Apr '10

I currently run DC V1.2 for some 4K accounts using mbox folder format. I am migrating to maildir. I have a separate filesystem for the indices. Currently, the data there amounts to 4GB. I'm wondering if anyone can tell me how the storage used will change with maildir folder formatting. Will more space be used and if so, could you rough guess what the increase might be? -- ==== Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows.... ==== Stewart Dean, Unix System Admin, Bard College, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

1 0

[Dovecot] Cant get the config file just right
by eng15ine 06 Apr '10

06 Apr '10

Hello, I have been trying to get POP3 on my ubuntu server for the past week now (In Las Vegas on a family vacation carrying my netbook from hotel to hotel.) My config file is below I am trying to access pop3 from Outlook Express and Thunderbird with no luck. When ever I try to access pop3 with one of these two programs I get a prompt saying my user/pass is invalid and I am asked to logon again. I cant figure out whats wrong?!? Help would be much appreciated. Thanks in advance!!:-D -=-=-=-=-CONFIG FILE BELOW=-=-=-==-=- # Required on x86_64 kernels login_process_size = 64 protocols = imap imaps pop3 pop3s listen = * ssl_listen = * ssl_disable = yes mail_location = maildir:~/Maildir ssl_cert_file = /etc/postfix/ssl/smtpd.crt ssl_key_file = /etc/postfix/ssl/smtpd.key protocol imap { imap_client_workarounds = outlook-idle delay-newmail listen = 127.0.0.1:10143 } protocol pop3 { pop3_uidl_format = %08Xu%08Xv pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { postmaster_address = postmaster(a)example.com } auth default { mechanisms = plain login passdb pam { } userdb passwd { } # user = root socket listen { client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = postfix } } } dict { #quota = mysql:/etc/dovecot-dict-quota.conf } plugin { } mail_extra_groups = carlos admin users -- View this message in context: http://old.nabble.com/Cant-get-the-config-file-just-right-tp28146341p281463… Sent from the Dovecot mailing list archive at Nabble.com.

2 1

[Dovecot] Core dump in 2.0-beta4 and latest Mercurial
by B. Johannessen 06 Apr '10

06 Apr '10

I'm seeing core-dumps with both 2.0-beta4 and a fresh checkout from Mercurial. I'm very new to Dovecot, so there's a good chance this is caused by my limited experience with Dovecot configuration, but it's my understanding that any core-dump is considered a bug (nice policy by the way). The installation seemed to be working as expected until I added the two namespaces and tried to set up shared mailboxes. Timo: The installation is running on a KVM dedicated to testing Dovecot, so if you want to debug anything in my environment, just send me your SSH key, and I'll set it up. Attached files (from test with latest Mercurial): ------------------------------------------------- dialog.txt: IMAP dialogue to reproduce the core dump mail.info.txt: Resulting log entries debug.log.txt: Resulting debug-log entries bt-full.txt: br full for dumped core dovecot-n.txt: Output of dovecot -n sql.txt: passdb/userdb SQL configuration -- Regards B. Johannessen

2 1

[Dovecot] back soon / clang static analyzer
by Timo Sirainen 05 Apr '10

05 Apr '10

I had a flu (or something) last week and couldn't get almost anything done. I'm pretty much healed now, and today I spent some time fixing bugs already, but then I got stuck fixing issues reported by clang's static analyzer. The good thing is that it found several real bugs from error handling paths too. I'm now planning on getting the false positive list down to zero and maybe then "make distcheck" could also run the analyzer and fail if there are any warnings, so releases would be less buggy. (I guess I should make some kind of nightly check do that too and email me the results.) Anyway, I'll try to start answering some mails tomorrow. Although I'm also now lagged in my studies and there's an exam on Thursday, so it'll probably take a while to go through all the 100+ mails again..

2 1

[Dovecot] Dovecot+LDAP issues
by Daniel Gomes 05 Apr '10

05 Apr '10

Dear list members, I am having some problems with a LDAP passdb authentication on Dovecot. Before I forget, the specs: it's a Ubuntu 7.10 server running Dovecot 1.0.5 connecting to 2 different machines running LDAP servers: gold with OpenLDAP 2.4.19 and extra with OpenLDAP 2.4.9 (extra is a replication slave of gold). The initial setup of dovecot was with a MySQL passdb, which is still the first passdb, now followed by my new LDAP passdb, all with a static userdb. Here is my dovecot-ldap.conf (the LDAP passdb) (I switched the domain with example.com for privacy sake): ----------------------------------------------------------------- #Servidor hosts = gold.example.com extra.example.com tls = yes ldap_version = 3 base = ou=people,dc=example,dc=com scope = onelevel #uid/gid user_global_uid = 5000 user_global_gid = 5000 #Bind para ler coisas dn = cn=dovecot,ou=people,dc=example,dc=com dnpass = secret sasl_bind = no sasl_mech = #passdb: usar password lookups para autenticar utilizadores auth_bind = no pass_attrs = userPassword=password #, =userdb_home=/home/vmail/%d/%n pass_filter = (&(maildrop=%u)(mailacceptinguser=1)) default_pass_scheme = PLAIN-MD5 ----------------------------------------------------------------- This setup is currently working for some tests users (the others are still being auth'ed with the old MySQL passdb). Unfortunately, I seemed to have run into a big problem on an occasion when dovecot was unable to connect my first server (gold) and hence went to the second one (extra). Backtracking from the logs (starting with dovecot-error.log): Mar 31 13:11:50 bunker dovecot: auth(default): LDAP: ldap_result() failed: Can't contact LDAP server Mar 31 13:11:50 bunker dovecot: auth-worker(default): LDAP: ldap_result() failed: Can't contact LDAP server -------------------- This is when the users stopped being able to login via imap, with the following message being shown on dovecot-info.log: Mar 31 13:13:00 bunker dovecot: auth(default): ldap(user(a)domain.com,xxx.xxx.xxx.xxx): unknown user (I know, an auth_debug log would be handy here, but it wasn't activated at the time). I went on to investigate and from the slapd logs I noticed that the second LDAP server (extra) was being contacted for the passdb lookups, thus proving that dovecot considered the gold to be dead (it wasn't, but that's a different matter). Anyway, the problem is that dovecot doesn't seem to be able to retrieve the user information from extra. As the slapd log shows: Mar 31 13:41:37 extra slapd[31473]: conn=4 op=140 SRCH base="ou=people,dc=example,dc=com" scope=1 deref=0 filter="(&(?=undefined)(?=undefined))" Mar 31 13:41:37 extra slapd[31473]: conn=4 op=140 SRCH attr=userPassword Mar 31 13:41:37 extra slapd[31473]: conn=4 op=140 SEARCH RESULT tag=101 err=0 nentries=0 text= For some reason, dovecot sends an undefined filter to extra, even though the same filter works without issues with gold (and remember they are "clones"). I just can't see how this is caused by any of my configurations! Any ideas? Thanks in advance, -- Daniel Gomes

3 5

[Dovecot] POP3 how do I either retrieve spam or never put mail in spam?
by Tony Nelson 05 Apr '10

05 Apr '10

I retrieve my mail from dovecot over POP3. Sometimes dovecot delivers a message into the spam mailbox, even though I have no spam filtering enabled. I can't find anything in the wiki about "other" mailboxes and POP3. I want to either never deliver mail in any mailbox other than my default inbox, or be able to retrieve mail over POP3 from those other mailboxes. How do I do them? -- ____________________________________________________________________ TonyN.:' <mailto:tonynelson@georgeanelson.com> ' <http://www.georgeanelson.com/>

3 4

[Dovecot] dovecot + Active Directory + LDA
by Christian Lyra 04 Apr '10

04 Apr '10

Hi there, I´m working on a setup with postfix (2.5.5) + dovecot (1.2.11) using a Active Directory user backend. At first, I used the instructions found here[1] to do the base configuration. As I understand, I need to use dovecot as a LDA to be able to use the quota plugin and have a per-user quota configuration, and this led me to two distinct (and opposed) configuration options. It seems that the usual dovecot + AD configuration uses the "auth_bind = yes" option, where the dovecot tries to bind to AD using user credentials. *But* to be able to use LDA, dovecot cant rely on user credentials, as there´s none when a mail arrives, so one need to use "auth_bind = no" and choose a "user" to bind to AD, using the dn and dnpass options. Am I right until here? I could just use auth_bind=no *IF* the "dn" user has the necessary privileges to read other AD users passwords (like a administrator user). Is this correct? Well, antecipating that the AD sysadmin guy will not be happy with this, I thought that maybe I could "mix" the two configurations, since I dont need the user password to find user mailbox (while delivering), but I do while doing his authentication. I may use one configuration for userdb, and another for passdb. BUT (again!) there´s another problem, since delivering needs "email" (user@domain) and authentication needs "user" values (and, it´s perfectly valid that one should use "John Doe" as user, and foo@bar as email!). So, I messed a little with user filters and got this configuration: dovecot.conf: mail_uid = 1001 mail_gid = 1001 passdb ldap { args = /etc/dovecot/dovecot-ldap-pass.conf } userdb ldap { args = /etc/dovecot/dovecot-ldap.conf } dovecot-ldap-pass.conf: hosts = 10.x.x.x base = dc=mydomain,dc=com,dc=br ldap_version = 3 auth_bind = yes auth_bind_userdn = mydomain\%u dovecot-ldap-pass.conf: hosts = 10.x.x.x auth_bind = no dn = cn=Unprivleged User,cn=Users,dc=mydomain,dc=com,dc=br dnpass = 123456 ldap_version = 3 base = dc=mydomain,dc=com,dc=br deref = never scope = subtree user_attrs = sAMAccountName=mail=maildir:/var/vmail/%$/Maildir user_filter = (&(objectClass=person)(|(mail=%u)(sAMAccountName=%u))) pass_attrs = sAMAaccountName=user,userPassword=password pass_filter = (&(objectClass=person)(sAMAaccountName=%u)) The "pass_attrs and pass_filter" in dovecot-ldap-pass.conf is not used. The clever part, or the incredible stupid one, is the the filter (&(objectClass=person)(|(mail=%u)(sAMAccountName=%u))) which means "find some person with email=something OR some person with username=user". I´m not sure of the full implications this could have... Anyway, it´s working, as the system accepts emails and the user can retrieve it using pop3. Is there a better way to doing all this? Is it safe to bind dovecot to AD with the necessary privileges to read user passwords? I´m no AD expert, but can this special user be "read-only" ? thanks in advance [1] http://www.linuxmail.info/postfix-dovecot-ldap-centos-5/ -- Christian Lyra

1 0

[Dovecot] dovecot-2.0.beta4: compiler gets stuck making master-service-settings.o Mac OS X 10.6.2
by Giuliano Gavazzi 04 Apr '10

04 Apr '10

dovecot-2.0.beta4 Environment: MacOS X 10.6.2, Xcode 3.2.1 (gcc-4.2) Problem: ./configure --sysconfdir=/usr/local/conf/ make [...] /bin/sh ../../libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-settings -DPKG_RUNDIR=\""/usr/local/var/run/dovecot"\" -DSYSCONFDIR=\""/usr/local/conf/dovecot"\" -DBINDIR=\""/usr/local/bin"\" -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -MT master-service-settings.lo -MD -MP -MF .deps/master-service-settings.Tpo -c -o master-service-settings.lo master-service-settings.c libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-settings -DPKG_RUNDIR=\"/usr/local/var/run/dovecot\" -DSYSCONFDIR=\"/usr/local/conf/dovecot\" -DBINDIR=\"/usr/local/bin\" -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -MT master-service-settings.lo -MD -MP -MF .deps/master-service-settings.Tpo -c master-service-settings.c -fno-common -DPIC -o .libs/master-service-settings.o never ends (well, I let it take over 3 minutes of cpu on a Xserve 2.26GHz Xeon and over 5 minutes on a Core 2 Duo before killing it). Any ideas? Thanks Giuliano

2 2

[Dovecot] Question about SASL auth
by Mark Sapiro 03 Apr '10

03 Apr '10

I have recently upgraded from Dovecot 1.2.10 to 2.0.beta3. I have Postfix 2.3.3 and use Dovecot to provide SASL auth for Postfix. # dovecot -n # 2.0.beta3: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.18-8.1.14.el5 i686 CentOS release 5 (Final) auth_mechanisms = plain apop login auth_worker_max_count = 5 mail_location = mbox:~/Mail:INBOX=/var/spool/mail/%u mail_privileged_group = mail mbox_write_locks = fcntl dotlock passdb { args = /usr/local/etc/dovecot.passwd deny = no driver = passwd-file master = no pass = no } passdb { deny = no driver = pam master = no pass = no } protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } ssl_cert = </etc/postfix/sbh16-cert.pem ssl_key = </etc/postfix/sbh16-key.pem userdb { driver = passwd } Since upgrading to 2.0.beta3 I have started seeing notices like Mar 6 07:06:20 sbh16 postfix/smtpd[30273]: warning: SASL: Connect to private/auth failed: Resource temporarily unavailable Mar 6 07:06:20 sbh16 postfix/smtpd[30273]: fatal: no SASL authentication mechanisms in my maillog. I don't see them too often (an average of about 2 occurences per day), and they seem to be related to spam or some kind of attack. I am able to send using SASL authentication from my own client OK. The relevant postfix config settings are smtpd_sasl_auth_enable = yes smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot Postfix and its configuration haven't changed from what I used with Dovecot 1.2.10. With Dovecot 1.2.10, I rarely if ever saw these failures. Is this a case of the socket being in use when another auth request arrives or is it something else? And if it is the socket in use, is there some change in 2.0.beta that would cause the socket to be busy longer? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 7

[Dovecot] simple steps with sieve
by Gavin Hamill 03 Apr '10

03 Apr '10

Today is my first day with sieve, so be gentle :) I'm trying to set up a pretty webmail interface to our Dovecot 1.2.4 server using roundcube. The managesieve config + roundcube 'managesieve' plugin work fine, and I'm able to use roundcube's UI to generate .dovecot.sieve files. We use winbind + LDAP lookups to do some exotic mail rewriting... ultimately user.name(a)domain.com gets rewritten to 'ar-cloh@localhost', and in /home/AD/ar-cloh/.dovecot.sieve there is only this: require ["vacation"]; # rule:[gdh_test] if anyof (header :contains "Subject" "test") { vacation "test away"; } When I send an email to the user, I see this in the mail.log Oct 19 15:39:43 ar-smtp-1 dovecot: deliver(ar-cloh): sieve: msgid=<1255963176.14420.31.camel@gdh-work>: discarding vacation response for message implicitly delivered to <ar-cloh@ar-smtp-1> I don't understand; sending a vacation for implicitly-delivered messages sounds exactly like what I want - is there any way to say 'do this anyway' ? gdh

8 18

[Dovecot] Any info about 1.2->2.0 migration ?
by Michal Hlavinka 02 Apr '10

02 Apr '10

Hi, there are few documents on the wiki ( http://wiki.dovecot.org/Upgrading ) about migration between old versions. Is there any document for 1.2->2.0 or list of configuration changes (especially the missing ones) in 2.0? Regards, Michal Hlavinka

2 1

[Dovecot] IMAP extensions & their meanings
by Jerry 01 Apr '10

01 Apr '10

I know that is is not really a Dovecot problem; however, I was wondering where I could get a complete list of the terms used in the 'capability' line. I have not had any success in finding out what things like "XLIST" refer to. I don't believe that is one that Dovecot uses; however, I have seen it with other IMAP servers, plus lots of other flags that I do not understand. I tried Googling but only got a few sporadic and basically useless answers. Thanks! -- Jerry Dovecot.user(a)seibercom.net Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ The economy depends about as much on economists as the weather does on weather forecasters. Jean-Paul Kauffmann

3 2

Re: [Dovecot] New install authentication probs
by Andy Smith 01 Apr '10

01 Apr '10

Ola Daniel, thanks for the idea, but actually within the config file the settings are not within the auth default section, its just shown that way from the output of dovecot -n cheers Andy. Quoting Daniel Gomes <daniel.gomes(a)ist.utl.pt>: > Hey Andy, > > I might be way over my head here, but unlike you, in my setup I set > "auth_debug", "auth_verbose" and "auth_debug_password" to "yes" > outside the "auth default" section. Try that and see if you get the > verbose logging you're looking for! > > Cheers, > > On 31-03-2010 19:46, Andy Smith wrote: >> Hi Brad, >> >> thanks for the reply, here is the output: >> >> dovecot -n >> # 1.2.10: /usr/local/etc/dovecot.conf >> # OS: FreeBSD 6.1-RELEASE i386 nfs >> log_path: /tmp/dovecot.log >> protocols: imap >> ssl: no >> disable_plaintext_auth: no >> login_dir: /var/run/dovecot/login >> login_executable: /usr/local/libexec/dovecot/imap-login >> verbose_proctitle: yes >> first_valid_uid: 1000 >> first_valid_gid: 1000 >> mail_privileged_group: mail >> mail_location: maildir:/var/spool/mail/%d/%u >> mail_debug: yes >> imap_client_workarounds: delay-newmail netscape-eoh tb-extra-mailbox-sep >> lda: >> sendmail_path: /usr/sbin/sendmail >> auth default: >> mechanisms: plain digest-md5 cram-md5 >> username_format: %Lu >> verbose: yes >> debug: yes >> debug_passwords: yes >> passdb: >> driver: sql >> args: /usr/local/etc/dovecot-sql.conf >> userdb: >> driver: passwd >> args: blocking=yes >> userdb: >> driver: sql >> args: /usr/local/etc/dovecot-sql.conf >> socket: >> type: listen >> client: >> path: /var/run/dovecot/auth-client >> mode: 432 >> master: >> path: /var/run/dovecot/auth-master >> mode: 384 >> > > -- > Daniel Gomes, 55350 >

4 7

[Dovecot] doveadm {user,auth} {segfaults,hangs}
by Pascal Volk 01 Apr '10

01 Apr '10

Since the last changes from yesterday, there are at least two new problems in doveadm (4e527339da8b). doveadm user aaa doveadm(pvo): Error: userdb lookup: connect(/usr/local/dovecot20/var/run/dovecot/auth-userdb) failed: Permission denied (euid=1000(pvo) egid=1000(pvo) missing +r perm: /usr/local/dovecot20/var/run/dovecot/auth-userdb, euid is not dir owner) Segmentation fault (core dumped) doveadm auth xxxx Password: doveadm(pvo): Error: auth: connect(/usr/local/dovecot20/var/run/dovecot/auth-client) failed: Permission denied (euid=1000(pvo) egid=1000(pvo) missing +r perm: /usr/local/dovecot20/var/run/dovecot/auth-client, euid is not dir owner) [hang until]^C Backtraces are attached Regards, Pascal -- The trapper recommends today: beeffeed.1009120(a)localdomain.org (gdb) bt full: #0 0x00000000004063b7 in cmd_user_input (auth_socket_path=0x4117f8 "/usr/local/dovecot20/var/run/dovecot/auth-userdb", input=0x7fff41c65320) at doveadm-auth.c:41 conn = 0x998f50 pool = 0x997ac0 username = 0x0 fields = 0x0 p = 0x0 ret = -1 #1 0x0000000000406ab6 in auth_cmd_common (cmd=0x61a940, argc=2, argv=0x921048) at doveadm-auth.c:201 first = false auth_socket_path = 0x0 input = {username = 0x92107b "aaa", password = 0x0, info = {service = 0x4119da "doveadm", local_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0}} c = -1 #2 0x0000000000406b3e in cmd_user (argc=2, argv=0x921048) at doveadm-auth.c:214 No locals. #3 0x000000000040602f in doveadm_try_run (cmd_name=0x921076 "user", argc=2, argv=0x921048) at doveadm.c:83 cmd__foreach_end = 0x986650 cmd = 0x986590 #4 0x00000000004062da in main (argc=2, argv=0x921048) at doveadm.c:169 set_roots = {0x413860, 0x0} service_flags = 10 cmd_name = 0x921076 "user" error = 0x411685 "H\205\355t\034\061\333\017\037@" c = -1 (gdb) bt full #0 0x00007f114d21cc93 in __epoll_wait_nocancel () from /lib/libc.so.6 fstab_state = {fs_fp = 0x0, fs_buffer = 0x0, fs_mntres = {mnt_fsname = 0x0, mnt_dir = 0x0, mnt_type = 0x0, mnt_opts = 0x0, mnt_freq = 0, mnt_passno = 0}, fs_ret = {fs_spec = 0x0, fs_file = 0x0, fs_vfstype = 0x0, fs_mntops = 0x0, fs_type = 0x0, fs_freq = 0, fs_passno = 0}} __elf_set___libc_subfreeres_element_fstab_free__ = 0x7f114d254220 #1 0x00007f114dd90674 in io_loop_handler_run (ioloop=0x17aaf60) at ioloop-epoll.c:175 ctx = 0x17cdfc0 events = 0x17ce800 event = 0x17aaf60 list = 0x21 io = 0x1 tv = {tv_sec = 2147483, tv_usec = 0} events_count = 1 t_id = 4220376 msecs = 2147483647 ret = -1 i = 0 j = 1306179422 call = false #2 0x00007f114dd8f451 in io_loop_run (ioloop=0x17aaf60) at ioloop.c:350 No locals. #3 0x00000000004067c6 in cmd_auth_input (auth_socket_path=0x411950 "/usr/local/dovecot20/var/run/dovecot/auth-client", input=0x7fff059a42c0) at doveadm-auth.c:136 client = 0x17d0fc0 #4 0x0000000000406a79 in auth_cmd_common (cmd=0x61a920, argc=2, argv=0x175c048) at doveadm-auth.c:191 auth_socket_path = 0x0 input = {username = 0x175c07b "xxxx", password = 0x179d088 "sdfghjk", info = {service = 0x4119da "doveadm", local_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0}} c = -1 #5 0x0000000000406b1a in cmd_auth (argc=2, argv=0x175c048) at doveadm-auth.c:209 No locals. #6 0x000000000040602f in doveadm_try_run (cmd_name=0x175c076 "auth", argc=2, argv=0x175c048) at doveadm.c:83 cmd__foreach_end = 0x17c8650 cmd = 0x17c8570 #7 0x00000000004062da in main (argc=2, argv=0x175c048) at doveadm.c:169 set_roots = {0x413860, 0x0} service_flags = 10 cmd_name = 0x175c076 "auth" error = 0x411685 "H\205\355t\034\061\333\017\037@" c = -1 (gdb)

1 0

[Dovecot] Mbox limit the size
by Karthick G 01 Apr '10

01 Apr '10

Hi, I want to set size limit for the inbox of all users in my mail server. Please send me the steps to be followed or how to configure dovecot to enable limiting the inbox size. Thanks in advance. -- *Regards, Karthick.G *

2 1

[Dovecot] 2.0.beta3 imapd running hot
by Bernhard Schmidt 01 Apr '10

01 Apr '10

Hi, since a couple of weeks I occasionally have an imapd going crazy on me, using up 100% CPU. Current revision is 10962 29865 vmail 20 0 47820 3296 1708 R 99.7 0.9 131:07.85 imap vmail 29865 86.1 0.8 47820 3296 ? R Mar20 131:20 dovecot/imap [berni 2001:a60:f001:1:219:66ff:fe8b:a6e IDLE strace -p <pid> shows a repeating pattern of epoll_wait(8, {{EPOLLOUT, {u32=36560672, u64=36560672}}}, 5, 4872) = 1 gettimeofday({1269133967, 495298}, NULL) = 0 gettimeofday({1269133967, 495333}, NULL) = 0 gettimeofday({1269133967, 495370}, NULL) = 0 with the last argument of epoll_wait (4872) slowly decrementing and then wrapping around to ~30k. Attaching gdb shows the following backtrace: (gdb) bt full #0 array_idx_i (ioloop=0x22bd5f0) at array.h:189 No locals. #1 io_loop_handler_run (ioloop=0x22bd5f0) at ioloop-epoll.c:188 ctx = 0x22bd800 event = <value optimized out> list = <value optimized out> io = <value optimized out> tv = {tv_sec = 26, tv_usec = 307176} t_id = 2 msecs = 26308 ret = 1 i = <value optimized out> call = <value optimized out> #2 0x00007f8f682bc8e8 in io_loop_run (ioloop=0x22bd5f0) at ioloop.c:350 No locals. #3 0x00007f8f682acd63 in master_service_run (service=0x22bd4c0, callback=0x6590) at master-service.c:486 No locals. #4 0x0000000000418551 in main (argc=1, argv=0x22bd3a0) at main.c:313 set_roots = {0x41b840, 0x0} service_flags = <value optimized out> storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT postlogin_socket_path = 0x0 (gdb) c Continuing. ^C Program received signal SIGINT, Interrupt. 0x00007fffed1ff9ad in gettimeofday () (gdb) bt full #0 0x00007fffed1ff9ad in gettimeofday () No symbol table info available. #1 0x00007f8f6795f02a in gettimeofday () from /lib/libc.so.6 No symbol table info available. #2 0x00007f8f682bcb39 in io_loop_handle_timeouts_real (ioloop=0x22bd5f0) at ioloop.c:291 item = <value optimized out> tv = {tv_sec = 0, tv_usec = 36427248} tv_call = {tv_sec = 0, tv_usec = 140737170938560} t_id = <value optimized out> #3 io_loop_handle_timeouts (ioloop=0x22bd5f0) at ioloop.c:339 _data_stack_cur_id = 0 #4 0x00007f8f682bd70e in io_loop_handler_run (ioloop=0x22bd5f0) at ioloop-epoll.c:180 ctx = 0x22bd800 event = <value optimized out> list = <value optimized out> io = <value optimized out> tv = {tv_sec = 28, tv_usec = 267997} t_id = 2 msecs = 28268 ret = 1 i = <value optimized out> call = <value optimized out> #5 0x00007f8f682bc8e8 in io_loop_run (ioloop=0x22bd5f0) at ioloop.c:350 No locals. #6 0x00007f8f682acd63 in master_service_run (service=0x22bd4c0, callback=0) at master-service.c:486 No locals. #7 0x0000000000418551 in main (argc=1, argv=0x22bd3a0) at main.c:313 set_roots = {0x41b840, 0x0} service_flags = <value optimized out> storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT postlogin_socket_path = 0x0 doveconf -n: mail.svr02.mucip.net:~# doveconf -n # 2.0.beta3: /etc/dovecot/dovecot.conf # OS: Linux 2.6.33 x86_64 Debian squeeze/sid auth_mechanisms = plain login disable_plaintext_auth = no listen = 83.170.6.69, 2001:1b10:1000::110:1:1 mail_gid = 5000 mail_location = maildir:%h/:INDEX=/var/cache/dovecot/%1n/%n mail_uid = 5000 maildir_stat_dirs = yes maildir_very_dirty_syncs = yes passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { quota = dict:user::file:%h/dovecot-quota quota_rule = *:storage=500M sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)birkenwald.de protocols = imap pop3 lmtp managesieve quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix-mailout/private/auth { group = postfix mode = 0660 user = postfix } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener { port = 24 } } service managesieve-login { inet_listener sieve_deprecated { port = 2000 } process_min_avail = 1 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = </etc/ssl/private/pop3.mucip.net.crt ssl_key = </etc/ssl/private/pop3.mucip.net.key userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } verbose_proctitle = yes protocol pop3 { mail_plugins = quota pop3_uidl_format = %08Xu%08Xv } protocol lmtp { mail_plugins = sieve quota } protocol lda { mail_plugins = sieve quota } protocol imap { imap_idle_notify_interval = 600 s mail_plugins = quota imap_quota zlib imap_zlib } At the moment I have two suspects, the imap_zlib plugin and CONDSTORE (which I recently reenabled in Thunderbird after the fixed version got deployed). The client is always Thunderbird 3.0.3+, but from different systems. It does terminate without any error message in the logs when I exit Thunderbird. Now testing without zlib... Bernhard

4 5

Re: [Dovecot] New install authentication probs
by Andy Smith 31 Mar '10

31 Mar '10

Hi Brad, thanks for the reply, here is the output: dovecot -n # 1.2.10: /usr/local/etc/dovecot.conf # OS: FreeBSD 6.1-RELEASE i386 nfs log_path: /tmp/dovecot.log protocols: imap ssl: no disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_privileged_group: mail mail_location: maildir:/var/spool/mail/%d/%u mail_debug: yes imap_client_workarounds: delay-newmail netscape-eoh tb-extra-mailbox-sep lda: sendmail_path: /usr/sbin/sendmail auth default: mechanisms: plain digest-md5 cram-md5 username_format: %Lu verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: passwd args: blocking=yes userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384

1 0

[Dovecot] New install authentication probs
by Andy Smith 31 Mar '10

31 Mar '10

Hi, Im attempting to configure dovecot for the first time, Im trying to use a MySQL DB that is currently used by tpop3d as Ive read they support the same password format. My main prob currently, apart from that it doesnt work lol, is that Ive enabled the following debugging in dovecot.conf auth_debug = yes auth_debug_passwords = yes auth_verbose = yes But Im getting basically zero info on why my authentication is failing. In my log (which for testing Ive defined as a file in /tmp to make sure Im getting all the info logged to one place) I see just: Mar 31 19:00:17 dovecot: Info: Dovecot v1.2.10 starting up Mar 31 19:00:17 auth-worker(default): Info: mysql: Connected to localhost (ukgri d_vmail) Mar 31 19:00:18 auth(default): Info: new auth connection: pid=64188 Mar 31 19:00:18 auth(default): Info: new auth connection: pid=64186 Mar 31 19:00:18 auth(default): Info: new auth connection: pid=64187 each time I attempt to connect via IMAP it adds another new auth connection line to the log but doesnt tell me anything else :(. So Im stuck debugging my authentication due to lack of info. BTW Im testing IMAP via telnet, telnet to IMAP port and attempt LOGIN (I have this working to a courier IMAP installation). Have I done something wrong? Any help appreciated! thanks Andy.

2 1

[Dovecot] Can Dovecot do this...
by Robert Lopez 31 Mar '10

31 Mar '10

I need some experienced Dovecot and email administrators to give me some feed back on a project which has been assigned to me. First some background. What exists now at our college: Three email gateway systems that route email between the Internet and one of the student email system, the staff email system, or the email list server system. The gateway systems do not route email from an external system to another external system. The MTA on each gateway is Postfix. The MTA of the student email system is Luminis. The MUA of the student email system is a web interface to Luminis. The MTA of the staff email system is Exchange. There are two staff MUA. One is Outlook. The other is Outlook Web Access. Within our network we have a system (separate from above) that is a LDAP server used for implementing single sign on to many college systems including the student and staff email systems. At this time SASL is not used in any way. There is no authentication of the movement of email. Authentication is only for using a MUA. It is now proposed that certain staff members should be allowed to be at some remote location and compose an email which will be sent to SOMETHING at our college which will then cause two things to happen. First, the From: information and Reply-To: information will be re-written from what ever they may be to become that person's college email address. Second, the email will then be routed to an intended recipient be it within our community or outside of our community. For examples, if the college president were with a member of the state legislature trying to get information for the state governor, she could send an email via her personal phone system to a college financial person who would never see her personal address. Upon receiving a reply, she then could send the state governor an email and it would appear to the governor as if it came from her college account. I have been told by my management other colleges are doing this with Postfix and SASL. I posted a question about this to a Postfix list and I was told Dovecot was the best SASL to use for implementing this. So, the project as it has been described to me is this: We will make no changes to the three gateway systems. We will add a new gateway system to enable this. This new system will challenge all email being sent to it. It will collect the college account-name and the password which will then be used to see if there is a matching account in the LDAP system. If there is not then the email transfer conversation will quit. If there is a matching account then the header rewrites will occur and the email will be routed. There are many things I do not understand: Is if this senario is possible? Would postfix on the new system do the address re-writes or would Dovecot do it? What would store the information necessary for the reply routing? What would happen in one internal address to many external address situations? If the project was simplified by removing the ability to reply to an email; so it was only a way to route external to external with rewrite is is then possible? So, I would like some comment on if this is a common or know practice and if Dovecot is used in those situations (if any). Thank you. -- Robert Lopez Unix Systems Administrator Central New Mexico Community College (CNM) 525 Buena Vista SE Albuquerque, New Mexico 87106

3 2

[Dovecot] Get plugins configuration in dovecot 2.0
by Alex Baule 31 Mar '10

31 Mar '10

In 1.X to get configuration Timo said. In v1.x they're in environment variables. So if you have: plugin { foo = bar } getenv("FOO") returns "bar". But, in 2.0 ?! getenv dont work....

2 1

[Dovecot] Documentation error
by Robert Lopez 30 Mar '10

30 Mar '10

http://wiki.dovecot.org/Debugging/Authentication There appears to be an error in this line: The PLAIN mechanism's authentication format is: <authorization ID> NUL <authentication ID> NUL <password>. Authentication ID is the username who you want to log in as, and authentication ID is the username whose password you're giving. I suppose it should be: The PLAIN mechanism's authentication format is: <authorization ID> NUL <authentication ID> NUL <password>. Authorization ID is the username who you want to log in as, and authentication ID is the username whose password you're giving. -- Robert Lopez Unix Systems Administrator Central New Mexico Community College (CNM) 525 Buena Vista SE Albuquerque, New Mexico 87106

1 0

[Dovecot] Post Login Script in 2.0
by Mark Moseley 30 Mar '10

30 Mar '10

Been digging through the list archives but I didn't see anything about this specifically. I've been playing with trying to get the post-login script stuff working with 2.0 (tried with a mercurial checkout from today and one I had kicking around from a few days ago), mainly to run the courier conversion script after logins. I'm using the 'executable' arg in 'service pop' and 'service imap' and I've tried with and without "drop_priv_before_exec=yes". I've just been using the test script mentioned in the wiki that dumps the environment to a file in /tmp and then execs libexec/imap or libexec/pop. The script specified in 'executable' is definitely getting executed just fine and logins work just fine. When it executes though, they're getting just the basic environment, as opposed to the environment that shows up in 1.2.11 full of various MAIL*/NAMESPACE*/etc variables. And I see in strace output that there's no batch of env vars getting passed around anymore, even when dovecot invokes libexec/imap or libexec/pop directly. Is there a setting that tells the dovecot process to fork the post-login script with the fully populated set of environment variables? Or alternatively, in the 2.0 world, is the idea to get that info out of the /var/run/dovecot/config socket? If so, is there an example somewhere? I can post my configs, but I figured that since this is a conceptual problem, I might as well ask first without pasting a few pages of "dovecot -a" output :)

2 5

[Dovecot] Problem with IMAP on port 993
by Jerry 30 Mar '10

30 Mar '10

This is probably a misconfiguration of my MUA; however, I thought I would ask here first. I am using IMAP with Dovecot. Claws-mail is my MUA. Now, when fetching mail via port 143, everything works fine: Mar 29 10:33:00 imap-login: Info: Login: user=<user(a)domain.net>, method=CRAM-MD5, rip=127.0.0.1, lip=127.0.0.1, TLS However, when I attempt to fetch mail via port 993, I get this message in the log: Mar 29 10:28:35 imap-login: Info: Disconnected (no auth attempts): rip=127.0.0.1, lip=127.0.0.1, TLS handshaking: Disconnected I think I have everything set up correctly. # dovecot -n (portions obfuscated) # 1.2.10: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.3-STABLE i386 ufs log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot.log protocols: pop3 pop3s imap imaps managesieve listen(default): * listen(imap): * listen(pop3): * listen(managesieve): localhost:2000 login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_executable(managesieve): /usr/local/libexec/dovecot/managesieve-login login_greeting: Greetings From my-domain.net verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_privileged_group: mail mail_location(default): maildir:/var/mail/vhost/my-domain.net/user:INDEX=/var/mail/vhost/my-domain.… mail_location(imap): maildir:/var/mail/vhost/my-domain.net/user:INDEX=/var/mail/vhost/my-domain.… mail_location(pop3): maildir:/var/mail/vhost/my-domain.net/user:INDEX=/var/mail/vhost/my-domain.… mail_location(managesieve): maildir:/var/mail/vhost/my-domain.net/user mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_executable(managesieve): /usr/local/libexec/dovecot/managesieve mail_plugins(default): expire mail_plugins(imap): expire mail_plugins(pop3): expire mail_plugins(managesieve): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 mail_plugin_dir(managesieve): /usr/local/lib/dovecot/managesieve imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): dict_db_config: /usr/local/etc/dovecot-db.conf managesieve_logout_format(default): bytes=%i/%o managesieve_logout_format(imap): bytes=%i/%o managesieve_logout_format(pop3): bytes=%i/%o managesieve_logout_format(managesieve): bytes ( in=%i : out=%o ) lda: postmaster_address: postmaster(a)my-domain.net mail_plugins: expire mail_plugins: sieve sieve: /usr/local/etc/dovecot/sieve/user.sieve sieve_global_path: /usr/local/etc/dovecot/sieve/user.sieve sendmail_path: /usr/sbin/sendmail auth default: mechanisms: cram-md5 digest-md5 plain login username_chars: abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@+ username_format: %Lu passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 438 master: path: /var/run/dovecot/auth-master mode: 438 plugin: expire: Trash 1 Spam 30 Sent 10 expire_dict: proxy::expire dict: expire: mysql:/usr/local/etc/dovecot-dict-expire.conf -- Jerry Dovecot.user(a)seibercom.net Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ Have the courage to take your own thoughts seriously, for they will shape you. Albert Einstein

4 6

[Dovecot] Dovecot 2.0 zlib and dbox
by Renaud Allard 30 Mar '10

30 Mar '10

Hello, As per wiki instructions, I tried to enable zlib compression of mails by adding/modifying the following snippets of configuration: plugin { zlib_save_level = 6 zlib_save = gz } and protocol imap { mail_plugins = fts fts_squat autocreate zlib imap_zlib imap_id_log = * } I am using dbox format and delivering the mails via dovecot deliver, however mails don't seem compressed at all. It is not very clear if compression is available for something else than maildir and mbox, so is compression available with dbox format? I am using dovecot-2-0-aefa279e2c70 from hg. Best Regards

2 3

[Dovecot] Dovecot 2.0beta4 HG 11014: Crashes on parsing settings via LMTP service
by Thomas Leuxner 29 Mar '10

29 Mar '10

Hi, unfortunately no core was dumped. Let me know if you need more info to debug. ==> /var/log/dovecot.log <== Mar 27 08:13:38 spectre dovecot: lmtp(8362): Connect from local Mar 27 08:13:38 spectre dovecot: lmtp(8362): Panic: file settings-parser.c: line 1501 (settings_link_get_new): assertion failed: (diff + sizeof(*old_link->array) <= old_link->parent->info->struct_size) Mar 27 08:13:38 spectre dovecot: lmtp(8362): Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0x7f055dec6712] -> /usr/lib/dovecot/libdovecot.so.0 [0x7f055dec677a] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f055dec6b23] -> /usr/lib/dovecot/libdovecot.so.0 [0x7f055dea6993] -> /usr/lib/dovecot/libdovecot.so.0(settings_parser_dup+0x1d2) [0x7f055dea6be2] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_service_lookup+0x191) [0x7f055e1370c1] -> dovecot/lmtp(cmd_rcpt+0x4d4) [0x407924] -> dovecot/lmtp(client_input_handle+0x19b) [0x4066db] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xcb) [0x7f055ded144b] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x18) [0x7f055ded05c8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f055dec0323] -> dovecot/lmtp(main+0x123) [0x405bf3] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x7f055d74d1a6] -> dovecot/lmtp [0x4059f9] Mar 27 08:13:38 spectre dovecot: master: service(lmtp): child 8362 killed with signal 6 (core not dumped) Regards Thomas

3 6

[Dovecot] dovecot: auth(default): Fatal: Unknown database driver 'mysql'
by Glen Lee Edwards 29 Mar '10

29 Mar '10

I just tried upgrading from 1.1.rc6 to v1.2.11, and am getting the following error: dovecot: auth(default): Fatal: Unknown database driver 'mysql'. If I change the respective line in dovecot-sql.conf from driver = mysql to driver = pgsql the error message changes accordingly: dovecot: auth(default): Fatal: Unknown database driver 'pgsql'. I quit using 1.1.rc6 because it started choking on my Debian system, so I'm back to using the stable Debian version - 1:1.0.15-2.3+lenny1. Where are the drivers kept when I do a default build, and where in the configuration file does it tell dovecot to look for the drivers? Other suggestions on a fix? Glen

3 7

[Dovecot] Which Authentication Method Best Between FreeBSD and Macintosh?
by Martin McCormick 29 Mar '10

29 Mar '10

I recently discovered that I need to occasionally forward Email from a FreeBSD system to a Macintosh. Imap does look like the best solution to this problem. The mail program on the Mac lists several protocols such as pop (okay with me) and SSL certificates which I want to avoid if at all possible. Which of the several listed methods of authentication should I compile in as I build dovecot on the FreeBSD system? Options for dovecot 1.2.10 [X] KQUEUE kqueue(2) support [ ] SSL SSL support [ ] IPV6 IPv6 support [ ] MANAGESIEVE ManageSieve support [ ] GSSAPI GSSAPI support [ ] VPOPMAIL VPopMail support [ ] BDB BerkleyDB support [ ] LDAP OpenLDAP support [ ] PGSQL PostgreSQL support [ ] MYSQL MySQL support [ ] SQLITE SQLite support � � IPV6 is not used here and my laziness says to avoid creating any new data bases or data base servers to support something I will probably use once every 2 or 3 months for one or 2 messages. I just want to get on the Mac and read messages posted in a certain account on the FreeBSD system. Sorry if this all sounds a bit odd, but I usually read mail on the FreeBSD box. Occasionally, I get a message containing a 20-mile-long URL that works better when using the Mac's safari browser tools. Presently, I have succeeded in compiling dovecot on the freeBSD system which runs and looks like it is ready to work. The Mac contacts the freeBSD box and then both appear to get a death grip on each other and nothing much happens until I force a quit of mail on the Mac. Thanks for any suggestions. Martin McCormick WB5AGZ Stillwater, OK Systems Engineer OSU Information Technology Department Telecommunications Services Group

1 0

Re: [Dovecot] I stream read - stale NFS file handle (reboot of server)
by Damon Atkins 29 Mar '10

29 Mar '10

NFS Security 101 for NFSv2 and v3 (NOT NFSv4 a long time ago I was part of the discussion group for NFSv4 spec the short comings of v2 and v3 have been fixed) SRV: Server Exports File System /abc/123 access only to host=xyz.domain.com XYZ: Client Mount mount's SRV:/abc/123 SRV: "mountd" gets a request from SRV check access list, and if the client is allowed access, returns File Handle for the top of the mount point (I will call this the FileSystemHandle, this changes after every reboot) XYZ: Client talks to the SRV NFS Server "nfsd" using FileSystemHandle (which represents /abc/123), To find a FileHandle for a file the client sends the NFS server the FileSystemHandle, then finds the next File Handle (/mydir) and the next FileHandle (myfile) and the client has found the FileHandle for /abc/123/mydir/myfile NFSD (v2/v3) is stateless other than the information provided by mountd (mount requests) and lockd (file locking). When you share/export a file system, as part of this a FileSystemHandle is generated and stored somewhere for /abc/123 most likely store in the kernel. SRV: Reboots, a new FileSystemHandle is allocated XYZ: Reports Stale File Handle for everything (if not most things) which was mounted from SRV or the mount point on the client does not respond. A long time ago FileSystemHandle would stay the same between reboots and you wouldn't get this problem other than on an individual file. To handle deleted files which are in use by NFS clients some servers rename them to .nfs* because if one client deleted and other clients where accessing the file then they would get Stale NFS handle. Once in a while a NFS server will do find $dir -type f -name .nfs\* -mtime +7 -mount -exec rm -f {} \; to clean up. NFSv4 does not use mountd or lockd. My advice to anyone on old versions of NFS upgrade to NFSv4 as soon as possible and implement KerbV5 for improved authentication and disallow NFSv2/3 access. If you do not get the Stale File Handle error when the server reboots, it most likely means the FileSystemHandle is not changing between reboots, but then you may have more security issues. Software which Clusters NFS Servers ensures that the node which takes over, uses the same FileSystemHandle (which may only change if the whole Cluster is shutdown) Cheers Damon.

2 4

[Dovecot] failed: Too many open files
by Masaharu Kawada 29 Mar '10

29 Mar '10

Dear list, I have questions about content of the following error messages. ---</var/log/secure>--- dovecot-auth:　PAM　unable　todlopen(/lib/security/pam_nologin.so) dovecot-auth:　PAM　[error:/lib/security/pam_nologin.so:　cannot　open　shared　object　file:　Too　many　open　files] dovecot-auth:　PAM　adding　faulty　module:/lib/security/pam_nologin.so dovecot-auth:　PAM　_pam_load_conf_file:　unable　to　open　/etc/pam.d/system-auth dovecot-auth:　PAM　unable　to　dlopen(<*unknown　module　path*>) dovecot-auth:　PAM　[error:　*unknown　module　path*>:　cannot　open　shared　object　file:　Too　many　open　files] dovecot-auth:　PAM　adding　faulty　module:　<*unknown　module　path*> dovecot-auth:　PAM　_pam_load_conf_file:　unable　to　open　/etc/pam.d/system-auth dovecot-auth:　PAM　_pam_load_conf_file:　unable　to　open　/etc/pam.d/system-auth dovecot-auth:　PAM　unable　to　dlopen(/lib/security/pam_deny.so) dovecot-auth:　PAM　[error:/lib/security/pam_deny.so:　cannot　open　shared　object　file:　Too　many　open　files] dovecot-auth:　PAM　adding　faulty　module:/lib/security/pam_deny.so ---</var/log/maillog>--- dovecot: auth(default): pam(xxx(a)xxx.com,127.0.0.1): pipe() failed: Too many open files dovecot: auth(default): pam(xxx(a)xxx.com,127.0.0.1): pipe() failed: Too many open files It seems that this is due to that there are files existed to open beyond its limitation. Other information that could be relevant are as follows. # ulimit -n 1024 # cat /proc/`cat /var/run/dovecot/master.pid`/limits cat: /proc/7273/limits: No such file or directory # lsof -p `cat /var/run/dovecot/master.pid` | wc -l 29 # ls /proc/`pidof dovecot-auth`/fd | wc -l 1024 >From the above result, dovecot-auth proccess opened 10243 files, and that seems to be the limit. So I expect that adding following lines into /etc/init.d/dovecot could be fix this issue. # vi /etc/init.d/dovecot --- . /etc/init.d/functions ulimit -n 4098 <-add test -x /usr/sbin/dovecot || exit 0 <-add if [ -f /etc/sysconfig/dovecot ]; then . /etc/sysconfig/dovecot fi --- Is my understanding right? Even if so, how could I verify what files are opened by dovecot-auth? I would very much appreciate it if someone in this list could provide comments/suggestions. Sincerely,

3 6

[Dovecot] Improper use of IN-USE in case of a failed authentication
by Rainer Weikusat 29 Mar '10

29 Mar '10

RFC2449 defines the IN-USE extended POP3 response code as 8.1.2. The IN-USE response code This occurs on an -ERR response to an AUTH, APOP, or PASS command. It indicates the authentication was successful, but the user's maildrop is currently in use (probably by another POP3 client). http://www.faqs.org/rfcs/rfc2449.html In contrast to this, the POP3 login code in client_authenticate.c will send IN-USE whenever authentication was not successful because of some kind of internal failure[*]. [*] Noticed during experiments with a shell SQL database driver which only ever returns errors as reaction to any query. I happen to know of at least one (partial) client implementation (I happen to have written which is used by an iPhone application for POP3 user credential verification) which actually interprets IN-USE as it is defined by the RFC.

2 2

[Dovecot] dsync multiserver
by Renaud Allard 28 Mar '10

28 Mar '10

Hello, Maybe I am missing something obvious here (I would hope so), but is there any way to use dovecot deliver to spawn dsync to replicate changes. And dovecot to trigger dsync to sync mailboxes when a change has been done. Thanks

2 1

[Dovecot] permanent flags (are very permanent)
by Oliver Eales 28 Mar '10

28 Mar '10

Hello, first of all i am not sure wheter this is a correct behavior according to the RFC or not... Problem is, when i set a new custom permanent flag (e.g. testflag) and remove it afterwards, the flag still stays in the list of the permanent flags of this drawer even if there are no messages left with this flag set. So the keyword list gets "polluted" with unused flags. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN] uc.vodafone.de Mailservices ready. AA login user notmypass AA OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH QUOTA] Logged in A0 SELECT inbox * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk Junk) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk Junk \*)] Flags permitted. * 3805 EXISTS * 0 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1260979519] UIDs valid * OK [UIDNEXT 4465] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest A0 OK [READ-WRITE] Select completed. A1 STORE 1 +FLAGS (testflag) * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk Junk testflag) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk Junk testflag \*)] Flags permitted. * 1 FETCH (FLAGS (Junk testflag)) A1 OK Store completed. A2 SEARCH KEYWORD testflag * SEARCH 1 A2 OK Search completed (0.043 secs). A3 STORE 1 -FLAGS (testflag) * 1 FETCH (FLAGS (Junk)) A3 OK Store completed. A4 select inbox * OK [CLOSED] Previous mailbox closed. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk Junk testflag) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk Junk testflag \*)] Flags permitted. * 3805 EXISTS * 0 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1260979519] UIDs valid * OK [UIDNEXT 4465] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest A4 OK [READ-WRITE] Select completed. So the new testflag keyword is now in the list even across logins. Regards, Oliver Eales

2 3

[Dovecot] Fix for the consume_results leak
by Rainer Weikusat 28 Mar '10

28 Mar '10

I'm not really comfortable with making non-trivial changes to this code but here is at least a fix for the PGresult leak (verified to both apply to 1.2.11 and 2.0.beta4). ----- --- dovecot/src/lib-sql/driver-pgsql.c 15 Mar 2010 18:18:14 -0000 1.1.1.2 +++ dovecot/src/lib-sql/driver-pgsql.c 26 Mar 2010 14:13:18 -0000 1.1.1.2.4.1 @@ -247,6 +247,17 @@ return 0; } +static inline int more_results(PGconn *pg) +{ + PGresult *pgres; + + pgres = PQgetResult(pg); + if (!pgres) return 0; + + PQclear(pgres); + return 1; +} + static void consume_results(struct pgsql_db *db) { do { @@ -255,7 +266,7 @@ if (PQisBusy(db->pg)) return; - } while (PQgetResult(db->pg) != NULL); + } while (more_results(db->pg)); if (PQstatus(db->pg) == CONNECTION_BAD) io_remove_closed(&db->io);

2 2

[Dovecot] convert v1.2 config to v2.0
by Odhiambo Washington 27 Mar '10

27 Mar '10

How do I convert a version 1.2.x config into a v2.0 config? Some command? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254733744121/+254722743223 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ "If you have nothing good to say about someone, just shut up!." -- Lucky Dube

2 1

[Dovecot] INBOX. namespace
by Brian Candler 27 Mar '10

27 Mar '10

I am trying to configure dovecot-1.2.11 to have the same IMAP namespacing as courier-imap as per http://wiki.dovecot.org/Migration/Courier, but failing badly. I have a test maildir with INBOX and folder 'junk'. Without fiddling with namespaces, this works fine: there are 91 msgs in INBOX and 2 in junk. a namespace * NAMESPACE (("" ".")) NIL NIL a OK Namespace completed. a examine INBOX ... * 91 EXISTS ... a OK [READ-ONLY] Select completed. a examine junk ... * 2 EXISTS ... a OK [READ-ONLY] Select completed. Now I make the following addition to dovecot.conf: namespace private { separator = . prefix = INBOX. inbox = yes hidden = no } After this the inbox appears to be empty, and I cannot select the junk folder at all: a namespace * NAMESPACE (("INBOX." ".")) NIL NIL a OK Namespace completed. a examine INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS ()] Read-only mailbox. * 0 EXISTS * 0 RECENT * OK [UIDVALIDITY 1269605071] UIDs valid * OK [UIDNEXT 1] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest a OK [READ-ONLY] Select completed. a examine INBOX.junk * OK [CLOSED] Previous mailbox closed. a NO Mailbox doesn't exist: junk Furthermore I can select "INBOX.INBOX" (although that's empty as well) a examine INBOX.INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS ()] Read-only mailbox. * 0 EXISTS * 0 RECENT * OK [UIDVALIDITY 1269605071] UIDs valid * OK [UIDNEXT 1] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest a OK [READ-ONLY] Select completed. a examine INBOX.INBOX.INBOX * OK [CLOSED] Previous mailbox closed. a NO Mailbox doesn't exist: INBOX.INBOX a examine junk a NO Unknown namespace. Have I misunderstood what I'm supposed to be doing here? The other relevant setting is: mail_location: maildir:%h but I've not changed this; as I say, this works just fine without meddling with namespaces. Many thanks, Brian.

2 4

[Dovecot] Dovecot 2.0beta4 changset 11014 dict: Panic: file driver-mysql.c
by e-frog 27 Mar '10

27 Mar '10

Hi, With the latest hg version I see panics with dict process whenever a message is received via lmtp. This didn't happen with the original beta4 release. Mar 27 11:45:51 ubuntu-test dovecot: dict: mysql: Connected to localhost (mails) Mar 27 11:45:51 ubuntu-test postfix/lmtp[5261]: 0F22B27F0D: to=<test(a)ubuntu-test.localdomain>, orig_to=<test(a)ubuntu-test.localdomain>, relay=ubuntu-test.localdomain[dovecot-lmtp], delay=0.41, delays=0.06/0.01 /0.22/0.11, dsn=2.0.0, status=sent (250 2.0.0 <test(a)ubuntu-test.localdomain> WsNlE9/hrUuOFAAA7I0XzQ Saved) Mar 27 11:45:51 ubuntu-test dovecot: master: service(dict): child 5263 killed with signal 6 (core not dumped) Mar 27 11:45:51 ubuntu-test dovecot: master: service(dict): command startup failed, throttling Mar 27 11:45:51 ubuntu-test dovecot: lmtp(5262, test): WsNlE9/hrUuOFAAA7I0XzQ: sieve: msgid=<4BADE1E9.7000709(a)ubuntu-test.localdomain>: from=test(a)ubuntu-test.localdomain: stored mail into mailbox 'INBOX' Mar 27 11:45:51 ubuntu-test dovecot: dict: Panic: file driver-mysql.c: line 633 (transaction_send_query): assertion failed: (rows != (my_ulonglong)-1) Mar 27 11:45:51 ubuntu-test dovecot: dict: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0xb773dd92] -> /usr/lib/dovecot/libdovecot.so.0 [0xb773ddff] -> /usr/lib/dovecot/libdovecot.so.0(i_erro r+0) [0xb77198ee] -> dovecot/dict [0x80506aa] -> dovecot/dict [0x80506e6] -> dovecot/dict(sql_transaction_commit_s+0x20) [0x804f730] -> dovecot/dict [0x804de42] -> /usr/lib/dovecot/libdovecot.so. 0(dict_transaction_commit_async+0x2f) [0xb771e4ff] -> dovecot/dict [0x804c930] -> dovecot/dict [0x804c35d] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xe2) [0xb774a2d2] -> /usr/lib/d ovecot/libdovecot.so.0(io_loop_run+0x30) [0xb7749320] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x2a) [0xb7736dfa] -> dovecot/dict(main+0x19c) [0x804d00c] -> /lib/tls/i686/cmov/libc. so.6(__libc_start_main+0xe6) [0xb72dab56] -> dovecot/dict [0x804c051] Mar 27 11:45:51 ubuntu-test postfix/qmgr[2335]: 0F22B27F0D: removed Mar 27 11:45:51 ubuntu-test dovecot: lmtp(5262): read(/var/run/dovecot/dict) failed: Remote disconnected Mar 27 11:45:51 ubuntu-test dovecot: lmtp(5262): Disconnect from local: Client quit Thanks, e-frog ------------------------------------------------------------------------- # 2.0.beta4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.31-20-generic-pae i686 Ubuntu 9.10 auth_debug = yes auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %Ln deliver_log_format = msgid=%m: from=%f: %$ dict { dictionary = mysql:/etc/dovecot/dovecot-dict-sql.conf } disable_plaintext_auth = no lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_debug = yes namespace { hidden = no inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { location = virtual:/etc/dovecot/virtual:INDEX=~/.maildir/control prefix = virtual/ separator = / subscriptions = no type = private } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { fts = squat fts_squat = partial=4 full=10 quota = dict:user::proxy::dictionary sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve-global/ sieve_dir = ~/.sieve } postmaster_address = postmaster@ubuntu-test protocols = imap lmtp managesieve quota_full_tempfail = yes sendmail_path = /usr/lib/sendmail service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0666 } } service dict { unix_listener dict { mode = 0666 } } service lmtp { unix_listener /var/spool/postfix/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve_deprecated { port = 2000 } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol managesieve { mail_plugins = virtual } protocol lmtp { mail_plugins = virtual quota sieve } protocol lda { info_log_path = /var/log/deliver.log log_path = /var/log/deliver.log mail_plugins = virtual quota sieve } protocol imap { mail_plugins = quota imap_quota fts fts_squat virtual }

1 0

Re: [Dovecot] dovecot user
by Stan Hoeppner 27 Mar '10

27 Mar '10

Timo Sirainen put forth on 3/27/2010 2:18 AM: > On Sat, 2010-03-27 at 02:10 -0500, Stan Hoeppner wrote: >>> Maybe the native english speakers (and I'd think only a subset of them too). I had never heard of dovetail. >> >> I'm guessing that's because you're not a woodworker, or know any. ;) It's a >> great hobby if you ever found the spare time. > > Sure. But we're talking about UNIX admin kind people here. Somehow I > doubt they spent much attention to woodworking classes at school (we > actually had such classes, and I might know the Finnish word for > dovetail if someone told me it, but I doubt it's common knowledge in > either language). Probably depends on what city/state/province/country as well. I'm in the midwest USA, and alot of people in general, sysadmins or not, are DIY type folks. You grow up on a farm or in a small town and learn a whole lot of non computer stuff (including basic woodworking) before going to college and then to the big city for the sysadmin job. Then you visit mom/dad on the weekends, and they have you rebuilt the kitchen and bathroom. Then you decide to rebuild your own kitchen and bathroom. And then your neighbors find out you know how to do that kind of work and ... you lose a few more weekends. :( >>> I want something that's at least potentially understandable to people who understand english (and not just native speakers). I wouldn't know why some process is owned by user "dovel". That might not even make me realize it's a Dovecot process. >> >> How about "pigeon"? Dovecots house two kinds of birds, doves, and, far more >> often, pigeons. So, pigeon should be the new user name. No one knows what >> the heck a "dovecot" is until they look it up anyway (at least non Scots), >> so using "pigeon" is in keeping with naming your server Dovecot. There. >> Now that that's settled... > > But Dovecot is the name of the software, and admins know that, even if > they have no clue what it means. dove* as the username makes them think > of Dovecot regardless. You think anyone is going to add the user "pigeon" to any groups? I'm thinking that, as with "dovenull", that most would avoid touching "pigeon" at all costs. Then again, some may think their system was hacked, and want to remove the user "pigeon" lol. If your main goal is getting people to leave that user alone, I think pigeon would definitely fit the bill. And it adds a bit of humor to the mix since pigeons tend to crap all over everything. ;) >> dovecot dove-main >> dovecot-auth dove-auth >> imap-login dove-imaplgn >> pop3-login dove-poplgn >> imap dove-imap >> pop3 dove-pop3 >> >> Just a thought. But a nice thought at that. :) > > But you're talking about process names, right? That's already changed in > v2.0. You have one "dovecot" process and everything else is "dovecot/*". > For example: > > root 1840 0.0 0.0 43140 1328 pts/0 S+ 05:02 0:00 /usr/local/sbin/dovecot -F > dovecot 1841 0.0 0.0 30568 976 pts/0 S+ 05:02 0:00 dovecot/anvil > root 1842 0.0 0.0 30676 1120 pts/0 S+ 05:02 0:00 dovecot/log > root 2500 0.0 0.1 38524 2760 pts/0 S+ 08:59 0:00 dovecot/lmtp > root 2501 0.0 0.2 37684 4372 pts/0 S+ 08:59 0:00 dovecot/config > dovecot 2502 0.0 0.1 68500 3112 pts/0 S+ 08:59 0:00 dovecot/auth Ahh, sw333t! I haven't played with 2.0 yet so I hadn't seen this yet. That's precisely the kinda thing I had in mind. See? Great minds think alike. (most of the time anyway) ;) -- Stan

1 0

[Dovecot] dovecot user
by Stan Hoeppner 27 Mar '10

27 Mar '10

Sorry, meant this to go to the list. Timo Sirainen put forth on 3/27/2010 12:08 AM: > On 27.3.2010, at 6.49, Stan Hoeppner wrote: > >>> Tail just doesn't make much sense to me. Also it's not completely free >>> of pornographic associations either. :) >> >> No, no, totally free of pornographic connotation. Dovetail is a type of >> woodworking joint. That's what the vast majority of people on planet earth >> will associate "dovetail" with anyway. > > Maybe the native english speakers (and I'd think only a subset of them too). I had never heard of dovetail. I'm guessing that's because you're not a woodworker, or know any. ;) It's a great hobby if you ever found the spare time. >>> So my last idea: doveless. "It's less of a dovecot process." To me it >>> seems closer to perfect as anything I've seen so far. >> >> Or how about just "dovel", a crafty word smithing merge of dovecot+shovel? >> Although I'm unsure of any parallels between the work done by this thing and >> that performed by a shovel. ;) Still, it's catchy. > > I want something that's at least potentially understandable to people who understand english (and not just native speakers). I wouldn't know why some process is owned by user "dovel". That might not even make me realize it's a Dovecot process. How about "pigeon"? Dovecots house two kinds of birds, doves, and, far more often, pigeons. So, pigeon should be the new user name. No one knows what the heck a "dovecot" is until they look it up anyway (at least non Scots), so using "pigeon" is in keeping with naming your server Dovecot. There. Now that that's settled... Kinda related to the current subject, naming things, I personally believe renaming all of the processes with a "dove-" or similar at the start of the process name would be nice. I wish Wietse would do so with Postfix as well, although I've not mentioned it (yet). Something like this: dovecot dove-main dovecot-auth dove-auth imap-login dove-imaplgn pop3-login dove-poplgn imap dove-imap pop3 dove-pop3 Just a thought. But a nice thought at that. :) -- Stan

1 0

[Dovecot] corrupted mbox
by Jernej Porenta 27 Mar '10

27 Mar '10

Heya, we have two IMAP (UW-imap and dovecot) servers accessing the same mbox files for our users (don't ask why) and sometimes the UW-imap corrupts the mbox file. The mbox looks just like normal mbox except it does not have the proper 'From ' beginning of the file (usually there are some random tidbits in the begining of the file, which can be easily stripped to recover the working mbox). The problem is that if we use dovecot for POP3 server, the dovecot logs the mbox corruption just fine: POP3(username): Couldn't init INBOX: Mailbox isn't a valid mbox file But if we use IMAP for the same mailbox, dovecot opens the file and does not report any corruption, the user on the other hand sees just empty mailbox. So I was wondering if there are any possibilities to report mbox corruption with IMAP as well? thanks in advance, regards, Jernej

2 4

[Dovecot] shared mailboxes, mkdir_parents problem
by Leo Unglaub 27 Mar '10

27 Mar '10

Hi Friends, i have a little problem with my Dovecot installation. The normal installation works very well and now i have to configurate dovecot that all member from a domain can access all mailboxes from this domain. I configurate the shared namespace and set the IMAP ACL Flag but i can't abonement the other mailboxes. I get a error in the logs: > 2010-03-18 10:03:04 IMAP(unglaub): Info: maildir: > data=/var/mails/e-c-o.at/kirchmeir:INDEX=/var/mails/e-c-o.at/shared/mitarbeiter/kirchmeir > > 2010-03-18 10:03:04 IMAP(unglaub): Info: maildir++: > root=/var/mails/e-c-o.at/kirchmeir, > index=/var/mails/e-c-o.at/shared/mitarbeiter/kirchmeir, control=, > inbox=/var/mails/e-c-o.at/kirchmeir > 2010-03-18 10:03:04 IMAP(unglaub): Info: acl: initializing backend > with data: vfile:/etc/dovecot-acl > 2010-03-18 10:03:04 IMAP(unglaub): Info: acl: acl username = unglaub > 2010-03-18 10:03:04 IMAP(unglaub): Info: acl: owner = 0 > 2010-03-18 10:03:04 IMAP(unglaub): Info: acl vfile: Global ACL > directory: /etc/dovecot-acl > 2010-03-18 10:03:04 IMAP(unglaub): Info: acl vfile: file > /etc/dovecot-acl//.DEFAULT not found > 2010-03-18 10:03:04 IMAP(unglaub): Info: Namespace > shared/mitarbeiter/kirchmeir/: Permission lookup failed from > /var/mails/e-c-o.at/kirchmeir > 2010-03-18 10:03:04 IMAP(unglaub): Info: Namespace > shared/mitarbeiter/kirchmeir/: Using permissions from > /var/mails/e-c-o.at/kirchmeir: mode=0700 gid=-1 > 2010-03-18 10:03:04 IMAP(unglaub): Error: > mkdir_parents(/var/mails/e-c-o.at/kirchmeir) failed: Permission denied In this case the User unglaub(a)e-c-o.at try to access the mailbox kirchmeir(a)e-c-o.at. My config looks like this: > mail:~# dovecot -n > # 1.2.11: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.30-bpo.1-amd64 x86_64 Debian 5.0.4 ext3 > log_path: /var/log/dovecot/dovecot.log > log_timestamp: %Y-%m-%d %H:%M:%S > disable_plaintext_auth: no > login_dir: /var/run/dovecot/login > login_executable: /usr/lib/dovecot/imap-login > mail_privileged_group: mail > mail_uid: 501 > mail_gid: 501 > mail_location: maildir:/var/mail/%d/%n > mail_debug: yes > maildir_copy_preserve_filename: yes > mbox_write_locks: fcntl dotlock > mail_plugins: acl imap_acl > namespace: > type: private > separator: / > inbox: yes > list: yes > subscriptions: yes > namespace: > type: shared > separator: / > prefix: shared/mitarbeiter/%%n/ > location: maildir:/var/mails/e-c-o.at/%%n:INDEX=/tmp/%%n > list: children > lda: > postmaster_address: postmaster(a)e-c-o.at > mail_plugins: acl > auth_socket_path: /var/run/dovecot/auth-master > log_path: /var/log/dovecot/dovecot-deliver-errors.log > info_log_path: /var/log/dovecot/dovecot-deliver.log > auth default: > default_realm: e-c-o.at > passdb: > driver: ldap > args: /etc/dovecot/dovecot-ldap.conf > userdb: > driver: ldap > args: /etc/dovecot/dovecot-ldap.conf > socket: > type: listen > client: > path: /var/spool/postfix/private/auth > mode: 432 > user: postfix > group: postfix > master: > path: /var/run/dovecot/auth-master > mode: 384 > user: dovecot-data > group: dovecot-data > plugin: > acl: vfile:/etc/dovecot-acl > acl_shared_dict: file:/var/mail/%d/shared-mailboxes.db Do you have any idea why my setup isn't working correct? My users are stored in a LDAP (openLDAP) Server and the login works very well. For completion i post the LDAP-File to. > mail:~# grep -v '^ *$#.*$\?$' /etc/dovecot/dovecot-ldap.conf > hosts = 192.168.1.230 > dn = cn=ldapadmin,dc=e-c-o,dc=net > dnpass = xxxxxxxx > ldap_version = 3 > base = ou=smbUser,ou=dc,ou=at,dc=e-c-o,dc=net > scope = subtree > user_filter = (&(objectClass=posixAccount)(uid=%n)) > user_attrs = mail=mail > pass_filter = (&(objectClass=posixAccount)(uid=%n)) > pass_attrs = uid=user,userPassword=password,\ > homeDirectory=userdb_home,uidNumber=userdb_uid,gidNumber=userdb_gid > default_pass_scheme = CRYPT Thank you very much. Greetings from Austria Leo

4 3

[Dovecot] mail_save_crlf Semantics
by Sabahattin Gucukoglu 27 Mar '10

27 Mar '10

Hi, It's not clear from the configuration when CR/LF conversion happens with mail_save_crlf set. Does this only happen with appends, or do all mails handled by Dovecot always get converted when opened? Cheers, Sabahattin

2 1

[Dovecot] 2.0.beta4 compile errors
by Steven King 27 Mar '10

27 Mar '10

I am unable to get 2.0.beta4 to compile. I get the following errors: /usr/lib64/gcc/x86_64-slackware-linux/4.3.3/../../../../lib64/libwrap.a(hosts_access.o): In function `host_match': hosts_access.c:(.text+0x625): undefined reference to `yp_get_default_domain' collect2: ld returned 1 exit status make[3]: *** [tcpwrap] Error 1 make[3]: Leaving directory `/root/dovecot/dovecot-2.0.beta4/src/util' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/root/dovecot/dovecot-2.0.beta4/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/root/dovecot/dovecot-2.0.beta4' make: *** [all] Error 2 Any help would be appreciated. -- Steve King Senior Linux Engineer - Advance Internet, Inc. Cisco Certified Network Associate CompTIA Linux+ Certified Professional CompTIA A+ Certified Professional

2 1

[Dovecot] dovecot 2.0beta4 zlib
by Renaud Allard 27 Mar '10

27 Mar '10

Hello, When trying to enable the zlib and imap_zlib plugins, I get the following error: imap: dovecot/imap:/opt/dovecot/lib/dovecot/lib2 0_zlib_plugin.so: undefined symbol 'i_stream_create_bz2' I did not compile it using --with-bzlib though and bz2 libs are available on the system. Best Regards

2 1

[Dovecot] cmusieve auto-reply and quota
by Mauro Faccenda 27 Mar '10

27 Mar '10

Hi there, I'm quite new to Dovecot, but already can tell that it is a really great work, congrats to the developers! But I'm having a little problem and couldn't figure it out how to solve. First, let me talk about my setup: I'm running Debian 5 (Lenny) with it's default Dovecot (common, pop3 and imap) packages (version 1:1.0.15-2.3+lenny1), I really would like to keep it this way unless I haven't another option. All authentication is made through a MS Active Directory and messages delivered to a virtual mailbox (/var/vmail/<domain>/<mailbox>), using Postfix as SMTP, that uses procmail (just for filtering the messages, not to deliver) that calls Dovecot's deliver like this: -- :0 w | $DELIVER -d $RECIPIENT -e -- $DELIVER points to /usr/lib/dovecot/deliver and $RECIPIENT is fed by Postfix in it's master.cf All this work great. Then I needed to enable quotas it's working as well. Here is the section that show how I've set it up: -- protocol lda { mail_plugin_dir = /usr/lib/dovecot/modules/lda mail_plugins = cmusieve quota postmaster_address = postmaster(a)do.ma.in hostname = mybox.do.ma.in auth_socket_path = /var/run/dovecot/auth-master quota_full_tempfail = no } -- I also want to run some sieve scripts just to be able to do some auto-replies (i.e. Out of office), and also it works well. Here is an example of a sieve I was using in some tests: -- require ["fileinto", "vacation"]; if header :contains "X-DSPAM-Result" "Spam" { stop; } vacation :days 1 :subject "Out of office reply" :addresses ["john.doe(a)do.ma.in", "jd(a)do.ma.in"] "I'm out of office, please contact Joan Doe instead. Best regards John Doe"; -- And as I said it works. But when I send a message to this mailbox that could exceed it's quota I get this on my logs: -- Mar 25 14:02:25 mybox postfix/pickup[21407]: 68D1DA82F: uid=103 from=<> Mar 25 14:02:25 mybox deliver(john.doe(a)do.ma.in): msgid=<4BAB9728.6000601(a)other.do.ma.in>: sent vacation response to <faccenda(a)other.do.ma.in> Mar 25 14:02:25 mybox postfix/cleanup[22119]: 68D1DA82F: message-id=<dovecot-1269536545-332912-0(a)do.ma.in> Mar 25 14:02:25 mybox postfix/qmgr[17299]: 68D1DA82F: from=<>, size=623, nrcpt=1 (queue active) Mar 25 14:02:25 mybox deliver(john.doe(a)do.ma.in): msgid=<4BAB9728.6000601(a)other.do.ma.in>: save failed to INBOX: Quota exceeded Mar 25 14:02:25 mybox deliver(john.doe(a)do.ma.in): sieve runtime error: Keep: Generic Error Mar 25 14:02:25 mybox deliver(john.doe(a)do.ma.in): sieve_execute_bytecode(/var/vmail/do.ma.in/john.doe/.dovecot.sievec) failed Mar 25 14:02:25 mybox deliver(john.doe(a)do.ma.in): msgid=<4BAB9728.6000601(a)do.ma.in>: Rejected: Quota exceeded Mar 25 14:02:25 mybox postfix/pipe[22086]: 7C666A825: to=<john.doe(a)do.ma.in>, relay=procmail, delay=1.1, delays=0.39/0/0/0.68, dsn=4.3.0, status=deferred (temporary failure) -- And every time the server tries again to deliver that message it re-sends the auto-reply. Is it an undesirable behavior, isn't it? Does anyone knows how to address it? Also, I thought that that configuration (using the -e parameter to deliver) and the "quota_full_tempfail = yes" would make give an permanent error, not trying to deliver that message again. What is wrong about it? Thanks in advance,

2 1

[Dovecot] A questions about consume_results (driver-pgsql.c)
by Rainer Weikusat 27 Mar '10

27 Mar '10

Code -------------- static void consume_results(struct pgsql_db *db) { do { if (!PQconsumeInput(db->pg)) break; if (PQisBusy(db->pg)) return; } while (PQgetResult(db->pg) != NULL); if (PQstatus(db->pg) == CONNECTION_BAD) io_remove_closed(&db->io); else io_remove(&db->io); db->querying = FALSE; if (db->queue != NULL && db->connected) queue_send_next(db); } --------------- This is the only part of the driver-pgsql.c code where a CONNECTION_BAD does not result in driver_pgsql_close being called. This will likely happen after the next query (from queue or a new one) failed because the connection was bad. Is there a reason for this?

2 2

[Dovecot] v2.0.beta4 released
by Timo Sirainen 27 Mar '10

27 Mar '10

http://dovecot.org/releases/2.0/beta/dovecot-2.0.beta4.tar.gz http://dovecot.org/releases/2.0/beta/dovecot-2.0.beta4.tar.gz.sig I think this release is finally feature complete. There are still some bugs left to be fixed, but it's mainly in the dsync/mdbox area. v2.0.rc1 should hopefully be out in a couple of weeks. After that v2.0.0 will be released after no serious bugs have been found for a couple of weeks. Major changes since beta3: - auth process now runs as $dovecot_internal_user ("dovecot") by default. Auth worker processes still run as root by default, so this won't break PAM etc, but it could break passwd-file configurations. - It can now read v1.2's dovecot.conf file. If you find that it won't read your config, let me know and I'll see about adding code to fix it. It'll log warnings about each obsolete setting it sees. The easiest way to get rid of the warnings is to just translate your old config to v2.0: doveconf -n -c old.conf > new.conf - auth passdb/userdb configuration in example-config is now a bit different .. hopefully less confusing to new people than the old one. - added support for auth settings (including passdb/userdb) inside protocol sections, so it'll affect only those protocols - mail_plugins can now be set more easily. you can have a single global mail_plugins and then add more plugins to it like protocol imap { mail_plugins = $mail_plugins imap_quota } - doveconf finally shows all settings, including all protocol, local and remote sections - doveadm quota get|recalc command added. This is a plugin (yeah, doveadm now supports plugins!), so you must have a global mail_plugins=quota setting for the command to show up. - doveadm kick user/network to kick out logged in users (by sending TERM signal to processes). This was written by Pascal Volk. - and of course tons and tons of fixes all around

6 11

[Dovecot] dovecot 2.0 fails self-tests
by Michal Hlavinka 27 Mar '10

27 Mar '10

Hi, is it expected that dovecot 2.0.beta4 pass all of it's self-tests or some failures are normal? I've tried make check and everything passed up to this test: ... message_date_parse(7) ................................................ : ok 0 / 8 tests failed test-message-decoder.c:67: Assert failed: message_decoder_decode_next_block(ctx, &input, &output) test-message-decoder.c:78: Assert failed: output.size == 3 test-message-decoder.c:84: Assert failed: output.size == 14 test-message-decoder.c:85: Assert failed: memcmp(output.data, " bar", 14) == 0 message decoder ...................................................... : FAILED 1 / 1 tests failed Regards, Michal Hlavinka

2 3

[Dovecot] CentOS yum update causing died unexpectedly
by dovecot＠corwyn.net 26 Mar '10

26 Mar '10

Running CentOS 5.x running a postfix/dovecot implementation. Dovecot 1.1.8. I just ran a full system update in my dev environment, and now I'm occasionally getting: Mar 26 07:15:43 example dovecot: auth(default): worker-server(test222(a)int.example.com,127.0.0.1): Aborted: Worker process died unexpectedly in /var/log/maillog. Any suggestions on where to look to figure out what's causing this? I don't see that error at all in the past 4 weeks of logs in production. Thanks Rick Rick Steeves http://www.sinister.net In reality nothing is more damaging to the adventurous spirit within a man than a secure future - Alexander Supertramp

2 1

[Dovecot] quota dict with mysql 4.0
by Andre Hübner 26 Mar '10

26 Mar '10

Hello, i use successfully mysql-quotasystem with dovecot 1.2.11 on different servers except for mysql 4.0 servers dovecot internally uses sql: "ON DUPLICATE KEY UPDATE" which was introduced in mysql 4.1 Is there a chance to make this statement mysql 4.0 compatible or should i update mysql? i want to avoid updating mysql because some old software is running which is not compatible to higher mysql versions. Thanks, Andre

5 6

[Dovecot] test
by total＠example.com 25 Mar '10

25 Mar '10

test

4 3

[Dovecot] outgoing mails
by Ing. Hugo Ruiz de Huidobro 25 Mar '10

25 Mar '10

Hello, I need to restrict outgoing email. I am using RedHat CentOS 4.7 and Dovecot 0.99.11 Today all users can send emails to Internet. But some people should only be able to send email to other user in this mail server. Just a few persons can send emails to the Internet. How can I do that? THANKS! Hugo

2 1

[Dovecot] Dovecot 2.0beta4
by Renaud Allard 25 Mar '10

25 Mar '10

Hello, It seems dovecot 2.0 beta4 still behave strangely without tcpwrap. I still get the errors: 2010-03-25_17:26:59.33848 Fatal: service(tcpwrap) access(/opt/dovecot/libexec/dovecot/tcpwrap) failed: No such file or directory 2010-03-25_17:27:00.36108 Fatal: service(tcpwrap) access(/opt/dovecot/libexec/dovecot/tcpwrap) failed: Permission denied It's easy to solve by touching and chmodding 0755 that file, but prod version shouldn't exhibit that behavior. Best Regards

2 1

[Dovecot] 1.2.11 nfs_flush_file_handle_cache_dir problems
by Ade Fewings 25 Mar '10

25 Mar '10

Hi chaps We're using the mbox_snarf plugin to snarf mail from /var/mail/%U to ~%U/Mail/inbox and using dotlocking on all accesses. This is on Solaris with NFS mounted home directories. We're getting a few (very few) of these for just a couple of users: Error: nfs_flush_file_handle_cache_dir: rmdir(/var/mail) failed: Device busy Which, having searched, I see some discussion of in the past, but not with 1.2. We're using: mail_privileged_group = mail For the /var/mail 'inboxes', which I thought would tackle this problem. Couple of questions, if you don't mind: 1. Does dovecot user need to be a member of the mail group? 2. Does this error message represent a real problem that needs solving? It's very strange how rare it is and that only a few select users have encountered. Full dovecot.conf below: > # 1.2.11: /usr/local/dovecot-1.2.11-b/etc/dovecot.conf > # OS: SunOS 5.10 sun4v > log_path: /usr/local/dovecot/var/dovecot.log > protocols: imap imaps pop3 pop3s > listen(default): *:143 *:10143 *:20143 *:30143 *:40143 *:50143 > listen(imap): *:143 *:10143 *:20143 *:30143 *:40143 *:50143 > listen(pop3): *:110 > ssl_listen(default): *:993 *:10993 > ssl_listen(imap): *:993 *:10993 > ssl_listen(pop3): *:995 > ssl: no > ssl_cipher_list: MEDIUM:!LOW > disable_plaintext_auth: no > shutdown_clients: no > login_dir: /usr/local/dovecot-1.2.11-b/var/run/dovecot/login > login_executable(default): > /usr/local/dovecot-1.2.11-b/libexec/dovecot/imap-login > login_executable(imap): > /usr/local/dovecot-1.2.11-b/libexec/dovecot/imap-login > login_executable(pop3): > /usr/local/dovecot-1.2.11-b/libexec/dovecot/pop3-login > max_mail_processes: 1024 > verbose_proctitle: yes > mail_privileged_group: mail > mail_location: mbox:~/Mail:INBOX=/var/mail/%u > mail_debug: yes > mmap_disable: yes > mail_nfs_storage: yes > mail_nfs_index: yes > lock_method: dotlock > mbox_read_locks: dotlock > mbox_write_locks: dotlock > mail_executable(default): /usr/local/dovecot-1.2.11-b/libexec/dovecot/imap > mail_executable(imap): /usr/local/dovecot-1.2.11-b/libexec/dovecot/imap > mail_executable(pop3): /usr/local/dovecot-1.2.11-b/libexec/dovecot/pop3 > mail_plugins: mbox_snarf > mail_plugin_dir(default): /usr/local/dovecot-1.2.11-b/lib/dovecot/imap > mail_plugin_dir(imap): /usr/local/dovecot-1.2.11-b/lib/dovecot/imap > mail_plugin_dir(pop3): /usr/local/dovecot-1.2.11-b/lib/dovecot/pop3 > auth default: > verbose: yes > debug: yes > passdb: > driver: pam > passdb: > driver: passwd > args: blocking=yes > userdb: > driver: passwd > args: blocking=yes > plugin: > mbox_snarf: ~/Mail/inbox Much appreciate your time, it has made an amazing difference here, I'm just seeking absolute perfection I think (well, mbox perfection anyway). ~~ Ade -- Centre for Advanced Software Technology Limited is a limited company registered in England and Wales. Postal Address: C.A.S.T. Limited, Technium CAST, Ffordd Penlan, Parc Menai, Bangor, Gwynedd. LL57 4HJ. Registered Number: 04473521. Registered Office: Finance Office, Bangor University, College Road, Bangor, Gwynedd. LL57 2DG. www.techniumcast.com

2 4

[Dovecot] Dovecot-1.2 + Sieve + Managesieve on Debian
by Proskurin Kirill 25 Mar '10

25 Mar '10

Hello! I think about migrate from FreeBSD to Linux because I need DRBD for clustering. I want to use Debian Lenny but run on some problems. I want near latest Dovecot packages. Native repos are too old. Backports seems to don`t have a Sieve&Managesieve support and we need it(am I wrong?). Stephan Bosch auto packeges is not for production. How could I solve this without make own packages? What Debian folk`s do in this situation? P.S. I don`t want to use RedHat like OS because I not familiar with it. -- Best regards, Proskurin Kirill

10 20

[Dovecot] can Dovecot do VERP?
by Rick Graves 25 Mar '10

25 Mar '10

Hey, I have several thousand email addresses, the vast majority of which are definitely no good, and I want to figure out which are good. So I will send out an email to all the email addresses. By making a list of the ones that bounced, and comparing that list with the full list, I can determine which are still good. This is for a non-profit association -- I am not in the spam business. Knowing exactly which emails bounced would be much easier if I could set up an in box implementing VERP. http://en.wikipedia.org/wiki/Variable_envelope_return_path In other words, I want an in box accepting all mail where the email addresses match a wildcard pattern like this: mail_admin_??????(a)domain.org, where ?????? are 6 digits. The digits would be a scrambled contact ID. Since they will be digits only, here is the regular expression: mail_admin_\d{6}. (We will pick a wildcard pattern that does not conflict with any existing address on the server.) Sending the outgoing emails, each with a different "From" address matching the wildcard pattern, is not a problem -- I have a working python script for this. The challenge is getting one in box to accept emails with different "From" addresses (matching the wildcard pattern). We are running IMAP server Dovecot 1.0.7. How do I set this up in the IMAP server to accept emails to addresses matching the wildcard pattern? Thanks, Rick Graves

4 4

Re: [Dovecot] quota dict with mysql 4.0
by Andre Hübner 25 Mar '10

25 Mar '10

(sorry, i only read the digest version of list and always create i new thread by "fake-Re") Hello, >> Perhaps you can implement some updating procedure that >> would only involve a percentage of your users at one time. no way, i want to fix this! but i need help because i have no idea of c-programming. i can read the code a little bit, but never lerned it. solution is to edit dovecot-1.2.11/src/lib-dict/dict-sql.c i can avoid using ON DUPLICATE KEY UPDATE by changing line 91 to: orig: dict->has_on_duplicate_key = strcmp(driver->name, "mysql") == 0; changed: dict->has_on_duplicate_key = strcmp(driver->name, "mysqlXXX") == 0; this works only 50%. if a user has no entry in quotatable, dovecot is updating his quota with 2 queries: INSERT INTO quota (bytes,username) VALUES ('2456','myuser') INSERT INTO quota (messages,username) VALUES ('2','myuser') The first query works, the second throws an error because username-field is uniqe. Duplicate entry 'myuser' for key 1 So i have to find a way to make this query in one step: INSERT INTO quota (bytes,messages, username) VALUES ('2456','2','myuser') or turn the second insert into an update update quota SET messages='2' where username='myuser' But iam afraid this is too much for my c-skills. I need help of an C-Crack or timo as developer. if timo could create a switch for mysql 4.0 would surely be the best. Thanks, Andre

1 0

Re: [Dovecot] quota dict with mysql 4.0
by Andre Hübner 25 Mar '10

25 Mar '10

Hello, >> I am somewhat surprised that the older software is not compatible with >> the newer version of MySQL. Usually, it is the other way around. Have >> you checked to see if newer versions of the incompatible software >> exist? I would be willing to wager that they have been updated to >> accommodate the newer MySQL versions. Syntax changed a litte bit and also there are some new protected words which are used by older software in sql without backticks etc. I agree updating would be the better way but we talking about a big number of servers and customers still using it. this is not changed over night.... I looked into dovecot-1.2.11/src/lib-dict/dict-sql.c, there seems to be a check for "ON DUPLICATE KEY UPDATE" on line 588. I recompiled dovecot on mysql 4.0 machine and tried again but there was no change. SQL is successful when dataset in quotatable is existing. in this case dovecot triggers an update of the data. But if no line for user is existing in quotatable and an insert is needed there is still the error: sql dict: commit failed: You have an error in your SQL syntax. Check the manual that corresponds to your MySQL server version for the right syntax to use near 'ON DUPLICATE KEY UPDATE bytes='12525'' at line why is the mysql 4.0-recompiled dovecot thinking my mysql is able to do "ON DUPLICATE KEY UPDATE"? How to avoid this? Thanks, Andre

2 1

[Dovecot] What is the difference between the plugin zlib and imap-zlib ?
by Alex Baule 24 Mar '10

24 Mar '10

What is the difference between the plugin zlib and imap-zlib ? in dovecot 1.2.X the zlib plugin works with imap....imap-zlib is a complement to zlib ?

2 1

[Dovecot] Question howto wiki.dovecot.org about quotas using dict
by Ricardo Barbosa 24 Mar '10

24 Mar '10

Hi, I am configuring a server with postfix and dovecot with virtual domains and using quota. To implement quota followed the documentation of the link http://wiki.dovecot.org/Quota/Dict, did not understand what you mean the field "where_field = path" would be the path on the filesystem of your mailbox? I would have to create the table that he says in the documentation or can I force a value with concat and using the AS (ie select '/var/vmail/domain/user' as path from table) ? Regards. __________________________________________________ Faça ligações para outros computadores com o novo Yahoo! Messenger http://br.beta.messenger.yahoo.com/

2 3

[Dovecot] Is it possible to prevent users from ever deleting anything?
by Snaky Love 24 Mar '10

24 Mar '10

Hi, dear dovecot-users, is it possible to make dovecot ignore the DELETE command for some accounts? Basically what I want to achieve is: users shall not be able to delete their emails - but they still should be able write emails. This is meant for a setup where different users are sending and receiving emails for a "support" account. I looked into IMAP virtual folders and ACL but I did not see a way of totally disabling the possibility to delete emails and share the whole account. I realize there may be race conditions with a setup like this and a web based ticket system might be a better solution, but it is only a very small team and we can always talk to each others to resolve conflicts - so using only one mail account for support seems practical and could keep the overhead small - but we do not want to delete anything from it (accidentaly). Of course, at one point in future somebody has to delete some mails from this accounts to get rid of old stuff - so I would like to implement a super-user that is able to do that kind of mailbox maintanance. How would I use ACL to setup such a scenario? Is it even possible? Or did I misunderstand IMAP shared folders completely??? Thank you very much for your attention! Have a nice day, Snaky

4 3