- dovecot - dovecot.org

[Dovecot] managesieve does call a wrong chown
by Wolfgang.Friebel＠desy.de 07 Feb '10

07 Feb '10

After upgrading from dovecot 1.2.3, managesieve 0.11.8, sieve 0.1.11 to dovecot 1.2.9, managesieve 0.11.10 and sieve 0.1.14 users who do not have sieve rules yet and use managesieve for the first time do trigger error messages in the log file (for the authenticated user ggg in group syspr): Jan 4 17:35:26 apollo dovecot: MANAGESIEVE(ggg): chown(/var/spool/sieve/ggg, -1, 0(root)) failed: Operation not permitted (egid=203(syspr)) Jan 4 17:35:26 apollo dovecot: MANAGESIEVE(ggg): sieve-storage: sieve_storage_verify_dir(/var/spool/sieve/ggg/tmp) failed: Operation not permitted Jan 4 17:35:26 apollo dovecot: MANAGESIEVE(ggg): Fatal: Failed to create sieve storage with data: /var/spool/sieve/ggg Anyway the filter rules get created (used avelsieve) and the filter does get compiled when the first mail hits the rule. Subsequent invocations of managesieve do not try to change the group ownership of the directory. Looks like an annoyance only, but I would feel more comfortable w.o. the error messages. the dovecot -n output: # 1.2.9: /etc/dovecot.conf # OS: Linux 2.6.18-164.6.1.el5 x86_64 Scientific Linux SL release 5.4 (Boron) protocols: imap imaps managesieve listen(default): * listen(imap): * listen(managesieve): *:2009 shutdown_clients: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login login_processes_count: 5 login_max_processes_count: 512 verbose_proctitle: yes mail_location: maildir:~/Maildir mmap_disable: yes fsync_disable: yes lock_method: dotlock maildir_copy_with_hardlinks: no mbox_read_locks: dotlock flock mbox_write_locks: dotlock flock mail_drop_priv_before_exec: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_plugins(default): quota imap_quota zlib acl imap_acl listescape mail_plugins(imap): quota imap_quota zlib acl imap_acl listescape mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(managesieve): /usr/lib64/dovecot/managesieve imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep outlook-idle imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep outlook-idle imap_client_workarounds(managesieve): namespace: type: private separator: / location: maildir:~/Maildir inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: #mbox/ location: mbox:~/mail:CONTROL=~/mboxctrl hidden: yes list: no subscriptions: yes lda: postmaster_address: postmaster(a)ifh.de mail_plugins: sieve quota acl sieve_global_path: /var/spool/sieve/default.sieve quota_full_tempfail: yes auth_socket_path: /var/run/dovecot/auth-master fsync_disable: no auth default: mechanisms: gssapi gss-spnego login plain realms: IFH.DE DESY.DE cache_size: 32 passdb: driver: pam args: max_requests=1 cache_key=%u userdb: driver: passwd-file args: /etc/userdb socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 438 plugin: quota: maildir:User Quota quota_rule: *:storage=1000MB quota_rule2: INBOX:storage=1000MB quota_rule3: Trash:ignore acl: vfile:/etc/dovecot-acls:cache_secs=300 acl_shared_dict: file:/var/spool/shared/shared-mailboxes.db sieve_storage: /var/spool/sieve/%u sieve: /var/spool/sieve/%u.sieve quota_warning: storage=95%% /usr/local/bin/mailquota-warning.sh 95 quota_warning2: storage=80%% /usr/local/bin/mailquota-warning.sh 80 quota_warning3: storage=60%% /usr/local/bin/mailquota-warning.sh 60 -- Wolfgang Friebel Deutsches Elektronen-Synchrotron DESY Phone/Fax: +49 33762 77372/216 Platanenallee 6 Mail: Wolfgang.Friebel AT desy.de D-15738 Zeuthen Germany

3 5

[Dovecot] LMTP in 2.0: concurrency, inet sockets
by Stefan Foerster 07 Feb '10

07 Feb '10

I didn't really have much time to look at the beta versions of dovecot 2.0 (apart from installing it once and migrating most of my current configuration, purely for testing purposes). An exciting new feature is the LMTP support. In the default configuration I have seen, that one only listened on a Unix socket - will it support network (inet) sockets, too? What about concurrent deliviers? As of now, when using the deliver LDA together with Postfix, you have to make sure that only one recipient is passed to deliver at a time, so for multi-recipient mail, the system might spawn a large number of processes (two per recipient, therefore two forks/execve calls). Is that limit still imposed with the new LMTP server? Stefan

3 4

Re: [Dovecot] LMTP in 2.0: concurrency, inet sockets
by Timo Sirainen 07 Feb '10

07 Feb '10

On Sun, 2010-02-07 at 13:40 +0100, Stefan Foerster wrote: > For 100k messages, delivery to a Maildir store using Postifx's pipe(8) > and Dovecot's deliver took 4319s, which equals 23.15 delivieries per > second - and that's with the pipe(8) delivery agent haning around for > up to 100 seconds, being reused for multiple transactions. > > Dovecot 2.0, with LMTP, was finished after 4007s, which equals 24.96 > deliveries per second. You could also try if maildir_very_dirty_syncs=yes affects it.

1 0

[Dovecot] blocked for xx secs
by Andrew Hearn 06 Feb '10

06 Feb '10

Hello, Occasionally (a few times a day) we get batches of Warnings in the log such as: dovecot: Warning: chdir(/maildir/x.co.uk/users/y) blocked for 18 secs This tends to last a minute or so for different users. /maildir is a NFS mount, and I'm suspecting it's the NFS server being busy and dovecot having to wait. Other than replacing the NFS server with faster hardware is there anything else we can do? Indexes are local, and Maildir is on the NFS. Dovecot 1.2.5 using: mail_nfs_storage = yes mmap_disable = no NFS mounted as; /maildir on /.automount/a.diskless/root/mail type nfs (nosuid,nodev,noatime,vers=3,proto=tcp) TIA -- Andrew

2 1

[Dovecot] Compressing Maildir mails on delivery
by Timo Sirainen 06 Feb '10

06 Feb '10

Now supported by v2.0. Also as a patch to v1.2: http://dovecot.org/patches/1.2/zlib-compress.diff I'm not really sure if I should commit it to v1.2 code tree. The code contains ugly copy&pasted io_stream_copy() and v1.2 is supposed to be feature complete..

3 5

[Dovecot] Also - is there a reliable way for TB to know it is connecting to a dovecot server?
by Charles Marcus 06 Feb '10

06 Feb '10

This would be so it could auto-disable GLODA - its new 'Global Search and Indexing' scheme - for that account - assuming they accept (and implement) my bug request to be able to do that: https://bugzilla.mozilla.org/show_bug.cgi?id=544100

2 6

[Dovecot] upgrade 1.0.x -> 1.2.x
by maximatt 06 Feb '10

06 Feb '10

its posible upgrade from dovecot 1.0.x to 1.2.x? i only see upgrades over micro versions.. thanks! -- Salu2 ;)

2 1

[Dovecot] v2.0: tcp-wrappers support
by Timo Sirainen 06 Feb '10

06 Feb '10

Some people have been requesting this forever. So finally this works: service tcpwrap { unix_listener login/tcpwrap { mode = 0666 } } login_access_sockets = tcpwrap There can also be more sockets listed, in case someone wants to build their own access checking service.

1 0

[Dovecot] pop3 quick question
by Nikita Koshikov 06 Feb '10

06 Feb '10

Hello list, I have found imap_allowed option in dovecot which do exactly what I need, for imap. Is there something similar for pop3 protocol? The main goal for it - is to enable pop3 access to specific users. Or maybe dovecot have some 'pop3=yes' or 'imap=no' args to userdb/passdb sections ? I know future dovecot 2.* versions will support rewriting for protocols, but this is required for 1.2 branch.

2 2

Re: [Dovecot] mdbox compression
by Damon Atkins 06 Feb '10

06 Feb '10

ZFS has support for compression on the file system ( lzjb | gzip | gzip-N | zle ). gzip eats CPU even at levels as low as 3. From the zfs man page The lzjb compression algorithm is optimized for performance while providing decent data compression. You can specify the gzip level by using the value gzip-N where N is an integer from 1 (fastest) to 9 (best compression ratio). The cost of CPU to support compression (gzip) vs the Cost of Disk if mboxes are not compressed? The other interesting feature ZFS (OpenSolaris) has is de-duplication, it detects if the block which is about to be written, is the same as another block and instead of writing the block it puts a pointer to the already existing block, saving disk space. Only problem with this is you would need to filter out headers which are different even when the to/body is the same. Cheers

1 0

[Dovecot] mdbox compression
by Timo Sirainen 06 Feb '10

06 Feb '10

I was wondering if I should add compression support to mdbox one mail at a time or one file (~2MB) at a time. The tradeoffs are: * one mail at a time allows quickly seeking to wanted mail inside the file, but it can't compress mails as well * one file at a time compresses better, but seeking is slow because it can only be done by uncompressing all the data until the wanted offset is reached I did a quick test for this with 27 MB of my old INBOX mails: (note the -b option, so it doesn't count wasted fs space) mdbox/storage% du -sb . 15120350 . Maildir/cur% du -sb . 16517320 . % echo 1-15120350/16517320|bc -l .08457606924125705623 So, compressed mdboxes take 8.5% less space. This was with regular gzip compression with default level. With bzip2 -9 compression the difference was 10%. Any thoughts on if 8-10% is significant enough improvement to make seeking performance worse? Or perhaps I should just implement both ways.. :)

4 6

[Dovecot] Dovecote does'nt start - no log ?
by Jean-Francois 06 Feb '10

06 Feb '10

Hi All, Actually, I installed Dovecot on an OpenBSD server, however, after properly setting (assumed) the confs, Dovecot does'nt start. I don't know the reason but don't know how to debug. Where is the log about reason for not starting ? Thank you for helping. Regards

4 11

[Dovecot] Forcibly emptying a POP3 mailbox
by Răzvan Sandu 05 Feb '10

05 Feb '10

Hello, I've recently saw a discussion on this list, about a standardised way of emptying POP3 mailboxes on the server - but no solution came up. Please provide a suggestion for the following situation: - I am running a stock POP3 dovecot server, on Fedora 12 (dovecot version 1.2.9) - passwd-file authentication via /etc/imap.passwd - users are virtual, sharing the same UID/GID; - storage is in MailDir system; - for remote users, server is POP3-only, since the administrative policy says that every user should download his messages on the local workstation, then delete them from server immediately after succesful download. - IMAP is allowed only locally, in order to be used together via stock squirrelmail Web interface (for emergencies only) However, there are users that check the infamous „Leave a copy on the server” checkbox (or equivalent) in their mail clients, eventually adding „Delete messages after X days”. Since I have no direct administrative control on the clients, I absolutely need a way to forbid the above behaviour at server level, in order to enforce the policy. The server's HDD is meant to store received messages from reception to the first access only. Filesystem quotas are not an option in this scenario, since the UID/GID is the same for all virtual users. What I need is way to make sure that "cur" and "tmp" subdirectories are perfectly empty after the user downloads his mail. (I will also need a way to make sure that users using squirrelmail leave no populated "Sent" and "Trash" folders on server's HDD, but that's offtopic here). Could you please suggest a way to solve this ? Thanks a lot, Răzvan

5 5

Re: [Dovecot] Forcibly emptying a POP3 mailbox
by Răzvan Sandu 05 Feb '10

05 Feb '10

Hello, Thanks a lot, but the problem here are not the IMAP users accessing the server via squirrelmail. Few people use this. What I mainly want to avoid are *POP3* users checking the „Leave a copy on the server” checkmark. I need a way of automatically performing the DELE command at server level, just after a POP3 user *succesfully* downloaded his messages via POP3... Thanks again, Răzvan

5 4

[Dovecot] postfix and dovecot on different systems - sasl request
by thomas polnik 05 Feb '10

05 Feb '10

Hello, until now I have use postfix and dovecot on the same server. Now I want/must split this both systems (server1 - postfix, server2 - dovecot). I used dovecot auth system for postfix ## snip ## smtpd_sasl_type = dovecot smtpd_sasl_path = private/auth ## snap ## but this does not work, if dovecot is not running on the same server. I did not find any information in postfix/dovecot documentation, how I could solve this problem smart. My only idea, but it looks like quick and dirty solution: On the postfix system a small dovecot systems runs only for postfix sasl via /var/spool/postfix/private/auth. (Or I use saslauthd with sql or imap) The postfix system (on server 1) delivers mails via transport map to the dovecot system. On the dovecot system postfix delivers this mails i.e. via ## snip ## dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -d ${recipient} ## snip ## to the mail boxes. Are there other ways, how I could solve this problem? My wish configuration: postfix sends the auth request via tcp/ip to the dovecot auth system and not via a socket. I use postfix 2.6 and dovecot 1.2.6. Best regards, thomas polnik.

2 1

[Dovecot] dovecot-auth stops responding
by Jonathan Siegle 05 Feb '10

05 Feb '10

Running dovecot 1.2.4(imap only) on AIX out of inetd. I accept passwords(PAM for auth) and kerberos tickets. Occasionally we see dovecot-auth stop responding. I just kill it off and another process is spawned which works fine. It doesn't look like it is hitting any ulimits(11MB for memory). I issued a kill -11 and ran it through the debugger. Here is what it says: dbx dovecot-auth core Type 'help' for help. [using memory image in core] reading symbolic information ... Segmentation fault in __fd_poll at 0x900000000117634 ($t1) 0x900000000117634 (__fd_poll+0x98) e8410028 ld r2,0x28(r1) (dbx) where __fd_poll(??, ??, ??) at 0x900000000117634 ioloop-poll.poll(__listptr = 0x00000001104dd330, __nfds = 145, __timeout = 1051), line 121 in "poll.h" io_loop_handler_run(ioloop = 0x000000011001bfb0), line 157 in "ioloop- poll.c" io_loop_run(ioloop = 0x000000011001bfb0), line 335 in "ioloop.c" main(argc = 1, argv = 0x0ffffffffffffad8), line 347 in "main.c" Here are my ulimits: ulimit -a time(seconds) unlimited file(blocks) 2097151 data(kbytes) 1048576 stack(kbytes) 65536 memory(kbytes) 65536 coredump(blocks) 2097151 nofiles(descriptors) 32768 Any help would be appreciated. Thanks, Jonathan

3 12

[Dovecot] Fatal: chdir( ) failed: Permission denied
by Vallo Kallaste 05 Feb '10

05 Feb '10

Hi Dovecot fails to chdir() into users home directory giving the following error: Oct 9 16:43:49 jura dovecot: dovecot: Fatal: chdir(/a/home/mina) failed: Permission denied (euid=1118 0(mina) egid=11332(devel) missing +x perm: /a/home) Oct 9 16:43:49 jura dovecot: dovecot: child 14441 (imap) returned error 89 (Fatal failure) The reason seems to be that user primary group is "devel" and directory /a/home has ACL which gives execute permission only to the users in "domain users" group. Now the catch is that the user _is_ member of "domain users" group and is happily accessing his home directory over CIFS(Samba) for long time. Also, the user has no problem entering his home directory when using shell access. It just seems like the user lost membership of a bunch of supplementary groups. The group membership info is coming from M$ PDC via winbind and NSS. We have few users and can change the users primary group and/or relax the /a/home directory ACL, but overall this is not right. Shall I shut up or can we hope for a fix or at least explanation? Thanks jura:/a # ls -la drwxrws--T+ 3 root domain admins 18 Oct 8 15:10 home jura:/a # getfacl home/ # file: home # owner: root # group: domain\040admins user::rwx group::rwx group:domain\040users:--x mask::rwx other::--- -- Vallo

4 8

[Dovecot] Question re: storing non mail files via IMAP
by Charles Marcus 04 Feb '10

04 Feb '10

Hey Timo, I have a question regarding how dovecot might behave if a mail client (like, for example, Thunderbird) decided to store some of its config files on the IMAP server itself. Would there be a decent way of doing this with dovecot that wouldn't cause problems for other clients that didn't know about these files? Maybe there's a way to define a special folder that dovecot knows about at the top level of each users mail location that can be used for this kind of thing? All I'm thinking of are certain config related files, so they would be small, and would only be downloaded when they didn't already exist - ie, when someone adds their existing account to a new PC, the first time they logged in, TB could simply download all of the config files, restart itself, and voila, your pre-configured TB is ready to go...

5 6

[Dovecot] mailutil question re: translating mbox folders to maildir
by Stewart Dean 04 Feb '10

04 Feb '10

I need mailutil in order to use the mbox to maildir translation routines that are posted in the Dovecot wiki, but there is no mailutil with the AIX image... mailutil is apparently built as part of Pine, and indeed I can see it in the build tree from my V4.6.1 Pine build, which I still have....OTOH, my version of Pine is not patched for maildir. Will the native pine mailutil work with mb2md or does it have be a mailutil built in a patched Pine :) tree? Oh Tannebaum, oh Tannebaum........ -- ==== Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows.... ==== Stewart Dean, Unix System Admin, Bard College, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

1 0

[Dovecot] dovecot and AFS
by Per-Erik Persson 04 Feb '10

04 Feb '10

Scrolling thru the archives gives me a hint that there might be troubles with AFS together with dovecot and maildir especially the LDA Is this still an issue or should I prepare for spending time to solve it? If someone successfully got it to work in a small or large scale environment I would be happy to know about it. /Per-Erik Persson

3 6

[Dovecot] LMTP-Server: missing headers
by Andreas Schulze 04 Feb '10

04 Feb '10

Hello, I just installed dovecot2-beta2 and configured the lmtp-server + postfix (no virtual users) postfix: mail_version = 2.7-20100117 mailbox_transport = lmtp:unix:lmtp-server lmtp_assume_final = yes dovecot: service lmtp { executable = lmtp protocol = lmtp unix_listener /var/spool/postfix/lmtp-server { group = postfix mode = 0660 user = postfix } } Mail gets delivered to ~user/Maildir/ Feb 1 06:57:39 testhost dovecot: lmtp(8238): Connect from local Feb 1 06:57:39 testhost postfix/lmtp[8237]: 07108A3608: to=<sca(a)testhost.example.org>, orig_to=<root>, relay=testhost.example.org[lmtp-server], delay=0.67, delays=0.22/0.03/0.22/0.2, dsn=2.0.0, status=sent (250 2.0.0 <sca(a)testhost.example.org> lwjfEVNtZksuIAAA4eG3hw Saved) Feb 1 06:57:39 testhost dovecot: lmtp(8238, sca(a)testhost.example.org) lwjfEVNtZksuIAAA4eG3hw: msgid=<20100201055739.07108A3608(a)testhost.example.org>: saved mail to INBOX Second try: postfix using deliver postfix: mailbox_command = /usr/lib/dovecot/deliver log: Feb 1 07:21:08 testhost dovecot: lda(sca): msgid=<20100201062108.0D6D6A3608(a)testhost.example.org>: saved mail to INBOX Feb 1 07:21:08 testhost postfix/local[10039]: 0D6D6A3608: to=<sca(a)testhost.example.org>, orig_to=<sca>, relay=local, delay=0.13, delays=0.04/0.01/0/0.08, dsn=2.0.0, status=sent (delivered to command: /usr/lib/dovecot/deliver) In the first case there are *no* Return-Path and Delivered-To Headers. In the (most common) second case the *are* present. Why these Headers are not included while using the LMTP-Server? -- Andreas Schulze Internetdienste | P532 DATEV eG 90329 Nürnberg | Telefon +49 911 319-0 | Telefax +49 911 319-3196 E-Mail info @datev.de | Internet www.datev.de Sitz: 90429 Nürnberg, Paumgartnerstr. 6-14 | Registergericht Nürnberg, GenReg Nr.70 Vorstand Prof. Dieter Kempf (Vorsitzender) Dipl.-Kfm. Wolfgang Stegmann (stellvertretender Vorsitzender) Dipl.-Kfm. Michael Leistenschneider Jörg Rabe v. Pappenheim Dipl.-Vw. Eckhard Schwarzer Vorsitzender des Aufsichtsrates: Reinhard Verholen

11 13

Re: [Dovecot] Forcibly emptying a POP3 mailbox
by Răzvan Sandu 04 Feb '10

04 Feb '10

Steffen Kaiser wrote: > Well, I know that the client knows it has *successfully* downloaded > messages, but how does the server know? Just to sent down some > packets through the wire does not mean success. Thanks, I see... so the server knows nothing about the success or insuccess of retrieving messages. Only client knows, so only client may act. In that case, the only possibility is to have some automatic script that periodically "cleans" the "cur" subdirectories, as you suggested. However, not being a programmer at all, I'm far from being able to write an industrial-grade solution for this. ;-) Best regards, Răzvan

1 0

[Dovecot] Create New Plugin
by Alex Baule 04 Feb '10

04 Feb '10

i have a Little question.... I dont know to much the autoconf/automake...there is a command or something to do, to include my plugin in the Makefile for dovecot compile them when i compile the hole package ?? or i shoud go to the configure and makefile.am and put by hand ? I put my plugin in the plugins directory source tree.

2 4

Re: [Dovecot] [RFE] A way to encode passwords in the /etc/imap.passwd file
by Răzvan Sandu 04 Feb '10

04 Feb '10

@Pascal Volk Thanks for the algorithm you've provided ! Unfortuantely, I'm not a programmer myself and I don't feel confident to code such an utility (even if I perfectly understand your pseudocode). ;-) What I'm looking for is not even a hand-made script, but a production solution included in the stock dovecot RPM package itself - i.e a new, better form of the dovecotpw utility. Best regards, Răzvan

1 0

[Dovecot] Execute mailfilter after message move
by Kārlis Repsons 04 Feb '10

04 Feb '10

Hi, came here to ask, if there are any ideas about a possible Dovecot feature, which would allow execution of a specific mailfilter or other program after new message is *moved* in specified mail location? The practical benefit on my side would be, that there wouldn't be any need to do getmail cronjobs, which unnecessarily fill up logfiles... (primarily for easy spam learning and reporting)

2 1