January 2013 - dovecot

[Dovecot] environment for dovecot auth
by Emmanuel Dreyfus 22 Feb '13

22 Feb '13

Hi Is there a way to set environment variables for the auth process? All I found for now is to replace it by a shell script that sets variables and then launch the real auth, but I wonder if there is a better way. -- Emmanuel Dreyfus manu(a)netbsd.org

2 1

[Dovecot] [PATCH] support for NetBSD 6.0 libquota
by manu＠netbsd.org 22 Feb '13

22 Feb '13

Hi NetBSD 6.0 introduced a new improved quota subsystem and an unified API (libquota) to handle the new and old quota implementation. dovecot is unable to use the new quota implementation right now, and will even fail to build with the old quota API on NetBSD 6.0: Here are dovecot patches to support NetBSD libquota: http://ftp.espci.fr/shadow/manu/dovecot-libquota.tgz -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz manu(a)netbsd.org

2 1

[Dovecot] Trouble with expire plugin
by Gedalya 22 Feb '13

22 Feb '13

Hi all, Maybe someone here can help me with this problem, not sure if this is a configuration issue or an actual bug. my daily cron job says: #!/bin/sh doveadm expunge -A mailbox Junk savedbefore 14d doveadm expunge -A mailbox Trash savedbefore 30d doveadm expunge -A mailbox "Trash.*" savedbefore 30d But it hasn't been deleting any messages in a long time, I'm not sure when it stopped working. I've also noticed that it does delete matching rows in the expires database (expire_stamp < savedbefore days). Furthermore, rows are deleted even when running doveadm search, and regardless of the mailbox column, i.e. even when != the mailbox name being searched! Anyway why should doveadm search delete rows in the expires database? The database is mysql. ---- dovecot -n ---- # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-0.bpo.3-amd64 x86_64 Debian 6.0.6 auth_default_realm = xxxxxxx.com auth_mechanisms = plain login cram-md5 auth_verbose = yes auth_verbose_passwords = plain default_client_limit = 8096 dict { expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no mail_gid = vmail mail_plugins = quota expire listescape mail_uid = vmail managesieve_sieve_capability = fileinto envelope encoded-character subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { antispam_backend = pipe antispam_pipe_program = /usr/bin/ssh antispam_pipe_program_args = -l;spamd;-i;/etc/dovecot/sareport.key;mx1.xxxxxxx.com antispam_pipe_program_notspam_arg = revoke antispam_pipe_program_spam_arg = report antispam_pipe_tmpdir = /tmp antispam_spam = Junk antispam_trash_pattern_ignorecase = trash;Deleted * autocreate = Trash autocreate2 = Junk autocreate3 = Drafts autocreate4 = Sent autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Drafts autosubscribe4 = Sent expire = Trash expire2 = Trash.* expire3 = Junk expire_dict = proxy::expire quota = dict:user::proxy::quota quota_rule = *:storage=2G quota_rule2 = Trash:storage=+250M quota_rule3 = Junk:ignore quota_warning = storage=99%% quota-warning 99 %u quota_warning2 = storage=95%% quota-warning 95 %u sieve = ~/.dovecot.sieve sieve_before = /var/local/lib/dovecot/sieve/global/fileinto-spam.sieve sieve_dir = ~/sieve sieve_extensions = -vacation -body -reject -enotify -environment -virustest -spamtest sieve_max_actions = 32 sieve_max_redirects = 4 sieve_max_script_size = 10K sieve_quota_max_scripts = 10 } postmaster_address = postmaster(a)xxxxxxx.com protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { client_limit = 20480 unix_listener auth-userdb { group = root mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { process_min_avail = 4 service_count = 0 vsz_limit = 128 M } service imap { process_limit = 10240 } service lmtp { inet_listener lmtp { address = 0.0.0.0 port = 7025 } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 0 vsz_limit = 128 M } service pop3-login { process_min_avail = 4 service_count = 0 vsz_limit = 128 M } service pop3 { process_limit = 4096 } service quota-warning { executable = script /usr/local/bin/quota-warning unix_listener quota-warning { user = vmail } user = vmail } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = quota expire listescape sieve } protocol lda { mail_plugins = quota expire listescape sieve } protocol imap { mail_max_userip_connections = 25 mail_plugins = quota expire listescape autocreate imap_quota antispam ssl_cert = </etc/dovecot/imap.xxxxxxx.com.crt ssl_key = </etc/dovecot/imap.xxxxxxx.com.key } protocol sieve { mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 10 mail_plugins = quota expire listescape pop3_fast_size_lookups = yes pop3_lock_session = no pop3_no_flag_updates = yes pop3_reuse_xuidl = yes pop3_save_uidl = no pop3_uidl_format = %08Xu%08Xv ssl_cert = </etc/dovecot/pop.xxxxxxx.com.crt ssl_key = </etc/dovecot/pop.xxxxxxx.com.key } in dovecot-sql.conf.ext I have: iterate_query = SELECT userid as user, domain FROM email where deleted=0 ---- dovecot-dict-sql.conf.ext ---- connect = host=localhost dbname=email user=email map { pattern = priv/quota/storage table = quota username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota username_field = username value_field = messages } map { pattern = shared/expire/$user/$mailbox table = expires value_field = expire_stamp fields { username = $user mailbox = $mailbox } }

3 5

[Dovecot] Userdb passwd and 'nologin' users
by Ben Morrow 22 Feb '13

22 Feb '13

I am running Dovecot with system users (userdb passwd), but some of those users don't have shell accounts on the IMAP server so their shell on that machine is set to /usr/sbin/nologin. Currently I am using maildirs and this is not a problem, but I am in the process of switching to dbox which means I will need a cronjob running 'doveadm purge -A'. During testing I found that those users with a 'nologin' shell are not included in the list returned by the userdb iterator, and that the iterator doesn't honour the first/last_valid_uid settings. This inconsistency seems undesirable, so the attached patch - makes lookup perform the same checks as iteration, - makes the 'nologin' check configurable, - adds a new optional check that the user owns their home directory. The last check was the one performed by qmail, and seems to me to be a more reliable 'is this a real user' check than a nologin shell. If this patch is applied, the release notes for the next release should probably mention that system users with a 'nologin' shell will no longer be allowed to log in to IMAP until the 'auth_check_nologin' setting is changed from true to false. Also, there seem to be two first/last_valid_uid settings: first_valid_uid itself, which is honoured by the storage subsystem, and auth_first_valid_uid, which is honoured by the 'passwd' userdb. Is this intentional? Ben

3 5

[Dovecot] Bug: empty m-files
by Peer Heinlein 22 Feb '13

22 Feb '13

Having an empty m-File, doveadm force-resync isn't able to detect and repair this: -rw------- 1 vmail vmail 4948043 8. Jan 20:32 m.634 -rw------- 1 vmail vmail 5237411 8. Jan 20:32 m.635 -rw------- 1 vmail vmail 0 9. Jan 16:23 m.636 mail1:~ # doveadm force-resync -u user mailbox INBOX doveadm(user): Warning: fscking index file /vmail/example.com/user//mdbox/storage/dovecot.map.index doveadm(user): Warning: mdbox /vmail/example.com/user//mdbox/storage: rebuilding indexes doveadm(user): Error: Corrupted dbox file /vmail/example.com/user//mdbox/storage/m.636 (around offset=0): EOF while reading file header doveadm(user): Error: mdbox rebuild: Failed to fix file /vmail/example.com/user//mdbox/storage/m.636 doveadm(user): Error: mdbox /vmail/example.com/user//mdbox/storage: Duplicate GUID 2cafdd2f0224ec50773c0000085c1439 in m.627:16 and m.638:16 Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

[Dovecot] Marking messages read / retaining date with Sieve
by Bret Martin 13 Feb '13

13 Feb '13

I'm trying to mark several hundred thousand messages as read as they are delivered via dovecot-lda(1). (I'm importing some mail from another format for migration purposes.) I've been able to do this with Sieve, but it has the side effect that the messages' received and saved dates are set to the current date, and Apple Mail (at least) uses one of these to display the message date. Without the Sieve filter in place, the dates are retained based on the From_ line as I would like. Does anyone know of any way I can either - retain the date when delivering using Sieve? - systematically mark a specific set of messages as read *after* delivery instead, perhaps with doveadm(1)? (even marking *everything* read would work in this particular case. I couldn't find any way to set flags with doveadm) Thanks, --Bret

2 5

[Dovecot] POLL: v2.2 to allow one mail over quota?
by Timo Sirainen 12 Feb '13

12 Feb '13

Currently if user is 1MB under quota and someone tries to deliver mail that is over 1MB, Dovecot rejects the mail. But smaller mails aren't rejected probably for days. So user might not even realize that they didn't receive one of the mails. Also having a user "almost over quota" is a rather strange state I think. So what do you think about v2.2 allowing delivery of one last mail even if it brings the user over quota? Except add a limit that if the message size is as much as the user's entire quota limit it wouldn't be added (or 50% or ..?). Also IMAP wouldn't allow this, since user would get an error anyway. I could make this also optional, but if nobody really wants to keep the old behavior there's really no point in adding the option.

20 27

[Dovecot] dsync timeout?
by Micah Anderson 08 Feb '13

08 Feb '13

I'm using dsync for a regular backup. The backup system flocks so that two cannot run at the same time, which is generally a good thing. The problem is that it seems like dsync sometimes goes off into the weeds and never comes back, leaving a process running and doing nothing forever, hogging the lock and causing my backups never to run again. I just finally figured out that was what was causing the backups not to run on this system was this process: root 17836 0.0 0.0 40888 1600 ? S 2012 0:00 ssh -i /root/.ssh/backmaildir_id_rsa backmaildir@arg /usr/bin/dsync -u foobar server yeah, that has been running since 2012 :( root:/tmp# strace -p 17836 Process 17836 attached - interrupt to quit select(8, [4], [], NULL, NULL very exciting... There doesn't seem to be a timeout in dsync, but perhaps there should be? At this point my only option is to write a cronjob that will look for dsync processes that are over a certain amount of time old and then kill them, after I do that I will need to take a shower because that is a very dirty solution :P thanks for any ideas, or help! micah --

4 6

[Dovecot] saving to imap folders and namespace settings
by Gustavo Sansone 06 Feb '13

06 Feb '13

hello everyone, i'm new to this list im running dovecot as imap+pop (2.1.12) and roundcube (0.8.4) as client. having problems on saving to imap folders, with errors on some accounts my folder structure is as follow: /home/user/.maildir /home/user/.maildir/.Drafts /home/user/.maildir/.Junk /home/user/.maildir/.Sent /home/user/.maildir/.Trash /home/user/.maildir/.Archives /home/user/.maildir/.Archives.2010 ... i'm very confused with the namespace settings. i don't understand what is the correct way to configure it. don't need public or shared folders. on dovecot.log i can see this error with my account (and all the others), but it seems to work ok using roundcube: imap(gsansone): Error: autocreate: No namespace found for mailbox: Junk with a few accounts, i have this on roundcube log: IMAP Error: Could not save message in Drafts in /var/www/localhost/htdocs/mail/program/steps/mail/sendmail.inc with error on saving to imap folder in roundcube UI send you attached the output of 'dovecot -n' and the roundcube configuration related to folders. does anyone have any suggestion? thanks in advance. -- G. Sansone

2 4

[Dovecot] Overloading IMAP Server
by Harford, Ken 04 Feb '13

04 Feb '13

Hi All, I am having an issue with dovecot IMAP reading and writing to one specific mailbox. I have a check email delivery script that sends out a email and then logs into dovecot to check if the mailbox that the message has been delivered to. However, the servers that send these messages send them in bunches depending on how many postfix spools it is checking. So I could get 60 messages all being sent to 1 mailbox and then having to read that same mailbox to check if the message actually got delivered. I am using postfix as the MTA and dovecot is actually delivering the message to the mailbox I am getting a lot of errors such as the following: Could not connect to IMAP server imap failed: IMAP RECEIVE CRITICAL - Could not select INBOX Any ideas as to what I can tweak in dovecot to allow these messages to be verified. Thanks for any information or help you could provide!! Ken

3 5