- dovecot - dovecot.org

[Dovecot] [OT] cool bash script for cron with seconds resolution
by Marc Perkel 13 Jan '14

13 Jan '14

Short bash script to run a program 30 20 15 12 10 6 5 4 3 2 executions per minute. http://wiki.junkemailfilter.com/index.php/How_to_run_a_Linux_script_every_f…

2 1

[Dovecot] dsync error: gz trailer has wrong CRC value
by Joe Beaubien 13 Jan '14

13 Jan '14

A few days ago by dovecot installation started behaving weirdly. First it was doveadm fts optimize which would fail (a thread running about that) and now it's dsync, which means my backups are not working. This all started a few days ago, which I find a little weird, because I haven't messed around with the dovecot setup in months. I've been searching the internet, but didn't find anything useful yet. Would anyone know how to fix the errors in the log below? Thanks, -Joe dovecot version is 2.1.7 Here is the log: dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): gz trailer has wrong CRC value at 16966298 dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Error: read(msg input) failed: Invalid argument dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Panic: file mail-index-transaction-update.c: line 906 (mail_index_update_ext): assertion failed: (seq > 0 && (seq <= mail_index_view_get_messages_count(t->view) || seq <= t->last_new_seq)) dsync(archive): Error: Raw backtrace: /opt/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(+0x4203a) [0x7f3a5150503a] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f3a515050fa] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f3a514dc3f0] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mail_index_update_ext+0x1c7) [0x7f3a51804927] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(+0xa8746) [0x7f3a517f7746] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mail_cache_transaction_commit+0x4c) [0x7f3a517f7a2c] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(+0xa8af3) [0x7f3a517f7af3] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(+0xa2cea) [0x7f3a517f1cea] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x84) [0x7f3a51800754] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(index_transaction_commit+0x8a) [0x7f3a517f209a] -> /opt/dovec ot/lib/d ovecot/lib20_zlib_plugin.so(+0x3b7a) [0x7f3a4fe8cb7a] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xb481) [0x7f3a5009b481] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x3d) [0x7f3a517c9c4d] -> /opt/dovecot/bin/dsync() [0x4297e6] -> /opt/dovecot/bin/dsync() [0x42b222] -> /opt/dovecot/bin/dsync(dsync_worker_select_mailbox+0x2e) [0x4291be] -> /opt/dovecot/bin/dsync() [0x424c75] -> /opt/dovecot/bin/dsync() [0x424db7] -> /opt/dovecot/bin/dsync(dsync_brain_msg_sync_more+0x22c) [0x4245ec] -> /opt/dovecot/bin/dsync(dsync_brain_sync+0x459) [0x422fc9] -> /opt/dovecot/bin/dsync() [0x423e61] -> /opt/dovecot/bin/dsync(dsync_brain_sync+0x7f1) [0x423361] -> /opt/dovecot/bin/dsync() [0x423cdc] -> /opt/dovecot/bin/dsync(dsync_brain_sync+0x832) [0x4233a2] -> /opt/dovecot/bin/dsync(dsync_brain_sync_all+0x18) [0x423ee8] -> /opt/dovecot/bin/dsync() [0x420f36] -> /opt/dovecot/bin/dsync() [0x4215b2] -> /opt/dovecot/bin/dsync() [0x40e798]

1 0

[Dovecot] Panic: file buffer.c: line 307 (buffer_set_used_size): assertion failed: (used_size <= buf->alloc)
by Maciej Uhlig 11 Jan '14

11 Jan '14

This is log from dovecot 2.2.10: 2014-01-11T09:55:14+01:00 server/a.b.c.d dovecot: imap(user@domain): Error: Corrupted transaction log file /pracmail/domain/user/mail/.sent-mail/dovecot.index.log seq 16777216: log file shrank (868 < 6144) (sync_offset=6144) 2014-01-11T09:55:14+01:00 server/a.b.c.d dovecot: imap(user@domain): Panic: file buffer.c: line 307 (buffer_set_used_size): assertion failed: (used_size <= buf->alloc) 2014-01-11T09:55:14+01:00 server/a.b.c.d dovecot: imap(user@domain): Error: Raw backtrace: /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(+0x6c2fa) [0x7f0704fa22fa] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(+0x6c366) [0x7f0704fa2366] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f0704f5802f] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(+0x67489) [0x7f0704f9d489] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_file_open+0x2c0) [0x7f07052ed120] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_open+0xb8) [0x7f07052e99b8] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(+0xc1784) [0x7f07052cf784] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mail_index_open+0xf0) [0x7f07052cfac0] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_open+0xac) [0x7f07052c0fac] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(+0x4d43a) [0x7f070525b43a] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(+0x4d50f) [0x7f070525b50f] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(+0x84054) [0x7f0705292054] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0xf) [0x7f070529220f] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x4a) [0x7f07052bfc2a] -> /usr/local/dovecot/lib/dovecot/lib10_quota_plugin.so(+0xb8ac) [0x7f0704d1c8ac] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x8c) [0x7f0705291ebc] -> dovecot/imap(imap_status_get+0x7a) [0x42058a] -> dovecot/imap(cmd_status+0x15d) [0x413a0d] -> dovecot/imap(command_exec+0x3d) [0x418acd] -> dovecot/imap() [0x417b10] -> dovecot/imap() [0x417c25] -> dovecot/imap(client_handle_input+0x125) [0x4180b5] -> dovecot/imap(client_input+0x6f) [0x41892f] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f0704fb2c66] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x95) [0x7f0704fb3fd5] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f0704fb2bd8] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f0704f5d483] -> dovecot/imap(main+0x2a7) [0x422807] 2014-01-11T09:55:14+01:00 server/a.b.c.d dovecot: imap(user@domain): Fatal: master: service(imap): child 25125 killed with signal 6 (core dumped) 2014-01-11T09:55:15+01:00 server/a.b.c.d dovecot: imap(user@domain): Error: Transaction log file /pracmail/us.edu.pl/user/mail/.sent-mail/dovecot.index.log: marked corrupted Unfortunately I'm not able to find core file although 'core dumped' is written to the log. MU

1 0

[Dovecot] Dovecot quota with MySQL - username issue
by michael 11 Jan '14

11 Jan '14

Hi all, I'm using Dovecot 2.2.8 with quota using a MySQL backend. The Quota plugin is listed for POP3, IMAP and LDA. When it is enabled for LDA, it populates the "username" field in the MySQL table with e mail addresses. I end up with a mixture of email addresses and usernames, which causes things to not fully work. It *should* be just usernames. the LDA SQL statement is: user_query = \ SELECT mailboxes.username, accounts.uid, accounts.uid AS gid, \ concat('/home/',mailboxes.username) AS home, \ (SELECT IF(accounts.new_mail_fmt=1, \ CONCAT('Maildir:',home,'/Maildir'), \ CONCAT('mbox:',home,'/Maildir:INBOX=/var/spool/mail/',mailboxes.username))) AS mail_location \ FROM mailboxes JOIN accounts ON accounts.username=mailboxes.username \ WHERE (mailboxes.email='%u' || \ (mailboxes.email=CONCAT('@','%d') AND (SELECT COUNT(email) FROM mailboxes \ WHERE email='%u') = 0) AND mailboxes.active IS TRUE) It clearly knows the username. Usernames on this system are just names, not full email addresses. The configuration of Quota Dict is: dovecot.conf dict/quotadict = mysql:/etc/dovecot/dovecot-dict-sql.conf ... quota = dict:user::proxy::quotadict dovecot-dict-sql.conf map { pattern = priv/quota/storage table = quota username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota username_field = username value_field = messages } Can this be fixed? Michael

2 1

[Dovecot] error when running fts optimize
by Joe Beaubien 11 Jan '14

11 Jan '14

Since yesterday, when I run "fts optimize", I get an error. Command: doveadm -v fts optimize -u formulaire Error: Jan 10 18:05:20 mba dovecot: indexer-worker(formulaire): Error: lucene index /mba_data/emails/formulaire/lucene-indexes: IndexWriter::optimize() failed (#9): bit out of range Does anyone have any idea what causes this and how to fix it? Thanks, Joe Beaubien

1 0

[Dovecot] Possible to force cipher order?
by Matthias Rieber 10 Jan '14

10 Jan '14

Hi, is it possible to force the server cipher order instead of the clients preferences? When I connect with openssl using these ciphers: 'RC4-SHA:DHE-RSA-AES256-GCM-SHA384' -> RC4-SHA will be selected and with 'DHE-RSA-AES256-GCM-SHA384:RC4-SHA' -> DHE-RSA-AES256-GCM-SHA384 It seems to be recommended for webservers to override that due to bad clients choices and increasing knowledge, like RC4 vs. BEAST, AES128 better (theoretical) than AES256. Regards, Matthias

1 1

[Dovecot] Message filtering capability at IMAP proxy
by CM Reddy 10 Jan '14

10 Jan '14

Hi, I would like process the messages at Dovecot IMAP proxy. In one of the documents, it was mentioned that Dovecot proxy currently supports on the fly message filtering in latest releases. Will it it possible to extend the filtering feature to handle the following requirements. 1. Parse the email at IMAP proxy. 2. Replace the links with some other secure links. 3. Replace the attachments with some other document. It would be great, if any one can provide some pointers to move forward. - Thanks in advance CM Reddy

2 1

Re: [Dovecot] imap auto create mailbox: we're not in group 8(mail)
by Joseph Tam 10 Jan '14

10 Jan '14

Adrian Zaugg writes: > How can I configure the auto create mailbox feature that it works and > let run LMTP and IMAP process as user %u and group mail and let create > the mailboxes in /var/mail as (example user tester) with the following > permissions: > > /var/mail: > > drwxrwx--x root mail 3072 Dec 18 01:43 . > drwx------ tester tester 1024 Jan 09 12:53 tester This is probably what you need: # Group to enable temporarily for privileged operations. Currently this is # used only with INBOX when either its initial creation or dotlocking fails. # Typically this is set to "mail" to give access to /var/mail. mail_privileged_group = mail > ...or do I need a different approach? You could also chmod 1777 /var/mail but this will allow arbitrary uses who have filesystem access to create their own files here, and maybe DoS a new user from being created (or maybe even anticipate a new mailbox, create one with mode 0777 and wait to intercept mail?). Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] LDA quota rejection
by Davide 09 Jan '14

09 Jan '14

Hi to all, i have dovecot 2.2.5 and i have implemented lda rejection through quota full this is my dovecot conf protocol lda { mail_fsync = optimized auth_socket_path = /usr/local/var/run/dovecot/auth-userdb deliver_log_format = msgid=<%f>-<%s>-%m: %$ hostname = mail.cgilfe.it info_log_path = /var/log/dovecot/dovecot-deliver.log log_path = /var/log/dovecot/dovecot-deliver.log mail_plugin_dir = /usr/local/lib/dovecot mail_plugins = $mail_plugins mail_log sieve postmaster_address = postmaster(a)mail.cgilfe.it rejection_subject = Rifiutato: %s rejection_reason = Messaggio a <%t> automaticamente rifiutato:%n%r submission_host = 192.16X.XXX.XX0 } If user over quota receive a messagge internally all is ok but if the user receive a mail from external domains nothing to the sender is sentback. Thanks in advance to all for possible help. -- *Davide Marchi* *T*eorema *F*errara *Srl* Via Spronello, 7 - Ferrara - 44121 Tel. *0532783161* Fax. *0532783368* E-m@il: *davide.marchi(a)mail.cgilfe.it* Skype: *davide.marchi73* Web: *http://www.cgilfe.it* *CONFIDENZIALITA'* *Ai sensi del D.Lgs. 196/2003 si precisa che le informazioni contenute in questo messaggio sono riservate ed a uso esclusivo del destinatario/dei destinatari. Qualora il messaggio in parola Le fosse pervenuto per errore, La invitiamo ad eliminarlo senza copiarlo e a non inoltrarlo a terzi, dandocene gentilmente comunicazione.* *Per favore, pensa all'ambiente. Stampa questa email solo se necessario.*

4 3

[Dovecot] imap auto create mailbox: we're not in group 8(mail)
by Adrian Zaugg 09 Jan '14

09 Jan '14

Dear List Somehow I don't understand the intended work flow to have new mailboxes auto created. On login of a new user with no mailbox, I get 2014-01-09 12:53:06 imap(tester): Error: user tester: Initialization failed: Namespace '': mkdir(/var/mail/tester) failed: Permission denied (euid=1016(tester) egid=1016(tester) missing +w perm: /var/mail, we're not in group 8(mail), dir owned by 0:8 mode=0771) The imap process runs as the user the login performed and thus it has only the privileges of that user. This is good and desired, when a mailbox already exists. I do not want to allow all users to write to /var/mail, only they should write to their dirs inside /var/mail. Same story for LMTP, if no mailbox exists yet: 2014-01-09 13:01:47 lmtp(20416, tester): Error: user tester: Initialization failed: Namespace '': mkdir(/var/mail/tester) failed: Permission denied (euid=1016(tester) egid=1016(tester) missing +w perm: /var/mail, we're not in group 8(mail), dir owned by 0:8 mode=0771) How can I configure the auto create mailbox feature that it works and let run LMTP and IMAP process as user %u and group mail and let create the mailboxes in /var/mail as (example user tester) with the following permissions: /var/mail: drwxrwx--x root mail 3072 Dec 18 01:43 . drwx------ tester tester 1024 Jan 09 12:53 tester ...or do I need a different approach? Thank you for helping me. Best regards, Adrian. My setup: ======== * Exim delivers to LMTP socket as user %u, group mail * maildir storage in /var/mail doveconf -n: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.3 ext3 auth_cache_negative_ttl = 0 auth_cache_size = 5 M auth_cache_ttl = 4 hours auth_failure_delay = 3 secs auth_mechanisms = plain login digest-md5 cram-md5 apop rpa auth_username_format = %n auth_verbose = yes auth_worker_max_count = 128 first_valid_gid = 1000 first_valid_uid = 1000 last_valid_gid = 60000 last_valid_uid = 60000 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_location = maildir:/var/mail/./%u/:INDEX=MEMORY mail_prefetch_count = 1024 maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vacation-seconds namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = type = private } passdb { args = scheme=SHA512-CRYPT username_format=%u /etc/cram-md5.pwd driver = passwd-file } plugin { sieve = /var/mail/%u/sieve/.dovecot.sieve sieve_before = /var/mail/%u/sieve/vacation.sieve sieve_dir = /var/mail/%u/sieve sieve_extensions = +vacation +vacation-seconds sieve_max_actions = 1024 sieve_vacation_default_period = 12d sieve_vacation_max_period = 0 sieve_vacation_min_period = 1d } postmaster_address = postmaster@XXXX protocols = " imap lmtp sieve pop3" service auth-worker { user = $default_login_user } service auth { group = mail-security unix_listener auth-client { mode = 0660 user = Debian-exim } unix_listener auth-userdb { mode = 0666 } user = $default_internal_user } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 5 } service lmtp { process_min_avail = 10 unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } service_count = 1 vsz_limit = 64 M } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { process_limit = 256 } ssl_cert = </etc/ssl/XXXX ssl_cipher_list = DHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES256-SHA256:DHE-RSA-AES256-SHA:DHE-RSA-CAMELLIA256-SHA:DHE-RSA-AES256-SHA:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES128-SHA256:+TLSv1:!RC4:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!CBC:!PSK:!SRP:!SSLv2:!3DES:!DSS ssl_key = </etc/ssl/XXXX ssl_parameters_regenerate = 128 hours userdb { args = blocking=no driver = passwd override_fields = home=/var/mail/%u mail=maildir:/var/mail/%u } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } protocol imap { mail_max_userip_connections = 64 } protocol pop3 { mail_max_userip_connections = 32 pop3_client_workarounds = oe-ns-eoh pop3_save_uidl = yes }

2 2