- dovecot - dovecot.org

[Dovecot] 2.2.10 - core dumps
by Jernej Porenta 13 Jan '14

13 Jan '14

Heya, We are occasionally seeing core dumps with dovecot 2.2.10, which are mostly like this: Jan 11 18:31:08 hostname dovecot: imap(username): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) Jan 11 18:31:08 hostname dovecot: imap(username): Error: Raw backtrace: /opt/dovecot-2.2.10/lib/dovecot/libdovecot.so.0 [0x2b657523aa3a] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot.so.0 [0x2b657523aaa6] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot.so.0 [0x2b6575239b83] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 [0x2b6574f83458] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 [0x2b6574f86458] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xbe) [0x2b6574f7605e] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x87) [0x2b6574f77ba7] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 [0x2b6574f64919] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x50) [0x2b6574f64e80] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 [0x2b6574f5fda1] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 [0x2b6574f5fee9] -> /opt/dovecot-2.2.10/lib/dovecot/libdove Jan 11 18:31:08 hostname dovecot: imap(username): Fatal: master: service(imap): child 13548 killed with signal 6 (core dumps disabled) # dovecot -n is available here: http://pastebin.com/RE91aRi5 other raw traces are available here: http://pastebin.com/M1S33NYn Would you recommend deleting all the index files or rather capturing core dump file for further analysis? Or maybe something completely different ;) thank you in advance, cheers, Jernej

1 0

[Dovecot] [OT] cool bash script for cron with seconds resolution
by Marc Perkel 13 Jan '14

13 Jan '14

Short bash script to run a program 30 20 15 12 10 6 5 4 3 2 executions per minute. http://wiki.junkemailfilter.com/index.php/How_to_run_a_Linux_script_every_f…

2 1

[Dovecot] dsync error: gz trailer has wrong CRC value
by Joe Beaubien 13 Jan '14

13 Jan '14

A few days ago by dovecot installation started behaving weirdly. First it was doveadm fts optimize which would fail (a thread running about that) and now it's dsync, which means my backups are not working. This all started a few days ago, which I find a little weird, because I haven't messed around with the dovecot setup in months. I've been searching the internet, but didn't find anything useful yet. Would anyone know how to fix the errors in the log below? Thanks, -Joe dovecot version is 2.1.7 Here is the log: dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): gz trailer has wrong CRC value at 16966298 dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Error: read(msg input) failed: Invalid argument dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Panic: file mail-index-transaction-update.c: line 906 (mail_index_update_ext): assertion failed: (seq > 0 && (seq <= mail_index_view_get_messages_count(t->view) || seq <= t->last_new_seq)) dsync(archive): Error: Raw backtrace: /opt/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(+0x4203a) [0x7f3a5150503a] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f3a515050fa] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f3a514dc3f0] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mail_index_update_ext+0x1c7) [0x7f3a51804927] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(+0xa8746) [0x7f3a517f7746] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mail_cache_transaction_commit+0x4c) [0x7f3a517f7a2c] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(+0xa8af3) [0x7f3a517f7af3] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(+0xa2cea) [0x7f3a517f1cea] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x84) [0x7f3a51800754] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(index_transaction_commit+0x8a) [0x7f3a517f209a] -> /opt/dovec ot/lib/d ovecot/lib20_zlib_plugin.so(+0x3b7a) [0x7f3a4fe8cb7a] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xb481) [0x7f3a5009b481] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x3d) [0x7f3a517c9c4d] -> /opt/dovecot/bin/dsync() [0x4297e6] -> /opt/dovecot/bin/dsync() [0x42b222] -> /opt/dovecot/bin/dsync(dsync_worker_select_mailbox+0x2e) [0x4291be] -> /opt/dovecot/bin/dsync() [0x424c75] -> /opt/dovecot/bin/dsync() [0x424db7] -> /opt/dovecot/bin/dsync(dsync_brain_msg_sync_more+0x22c) [0x4245ec] -> /opt/dovecot/bin/dsync(dsync_brain_sync+0x459) [0x422fc9] -> /opt/dovecot/bin/dsync() [0x423e61] -> /opt/dovecot/bin/dsync(dsync_brain_sync+0x7f1) [0x423361] -> /opt/dovecot/bin/dsync() [0x423cdc] -> /opt/dovecot/bin/dsync(dsync_brain_sync+0x832) [0x4233a2] -> /opt/dovecot/bin/dsync(dsync_brain_sync_all+0x18) [0x423ee8] -> /opt/dovecot/bin/dsync() [0x420f36] -> /opt/dovecot/bin/dsync() [0x4215b2] -> /opt/dovecot/bin/dsync() [0x40e798]

1 0

[Dovecot] Panic: file buffer.c: line 307 (buffer_set_used_size): assertion failed: (used_size <= buf->alloc)
by Maciej Uhlig 11 Jan '14

11 Jan '14

This is log from dovecot 2.2.10: 2014-01-11T09:55:14+01:00 server/a.b.c.d dovecot: imap(user@domain): Error: Corrupted transaction log file /pracmail/domain/user/mail/.sent-mail/dovecot.index.log seq 16777216: log file shrank (868 < 6144) (sync_offset=6144) 2014-01-11T09:55:14+01:00 server/a.b.c.d dovecot: imap(user@domain): Panic: file buffer.c: line 307 (buffer_set_used_size): assertion failed: (used_size <= buf->alloc) 2014-01-11T09:55:14+01:00 server/a.b.c.d dovecot: imap(user@domain): Error: Raw backtrace: /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(+0x6c2fa) [0x7f0704fa22fa] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(+0x6c366) [0x7f0704fa2366] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f0704f5802f] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(+0x67489) [0x7f0704f9d489] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_file_open+0x2c0) [0x7f07052ed120] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_open+0xb8) [0x7f07052e99b8] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(+0xc1784) [0x7f07052cf784] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mail_index_open+0xf0) [0x7f07052cfac0] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_open+0xac) [0x7f07052c0fac] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(+0x4d43a) [0x7f070525b43a] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(+0x4d50f) [0x7f070525b50f] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(+0x84054) [0x7f0705292054] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0xf) [0x7f070529220f] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x4a) [0x7f07052bfc2a] -> /usr/local/dovecot/lib/dovecot/lib10_quota_plugin.so(+0xb8ac) [0x7f0704d1c8ac] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x8c) [0x7f0705291ebc] -> dovecot/imap(imap_status_get+0x7a) [0x42058a] -> dovecot/imap(cmd_status+0x15d) [0x413a0d] -> dovecot/imap(command_exec+0x3d) [0x418acd] -> dovecot/imap() [0x417b10] -> dovecot/imap() [0x417c25] -> dovecot/imap(client_handle_input+0x125) [0x4180b5] -> dovecot/imap(client_input+0x6f) [0x41892f] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f0704fb2c66] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x95) [0x7f0704fb3fd5] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f0704fb2bd8] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f0704f5d483] -> dovecot/imap(main+0x2a7) [0x422807] 2014-01-11T09:55:14+01:00 server/a.b.c.d dovecot: imap(user@domain): Fatal: master: service(imap): child 25125 killed with signal 6 (core dumped) 2014-01-11T09:55:15+01:00 server/a.b.c.d dovecot: imap(user@domain): Error: Transaction log file /pracmail/us.edu.pl/user/mail/.sent-mail/dovecot.index.log: marked corrupted Unfortunately I'm not able to find core file although 'core dumped' is written to the log. MU

1 0

[Dovecot] Dovecot quota with MySQL - username issue
by michael 11 Jan '14

11 Jan '14

Hi all, I'm using Dovecot 2.2.8 with quota using a MySQL backend. The Quota plugin is listed for POP3, IMAP and LDA. When it is enabled for LDA, it populates the "username" field in the MySQL table with e mail addresses. I end up with a mixture of email addresses and usernames, which causes things to not fully work. It *should* be just usernames. the LDA SQL statement is: user_query = \ SELECT mailboxes.username, accounts.uid, accounts.uid AS gid, \ concat('/home/',mailboxes.username) AS home, \ (SELECT IF(accounts.new_mail_fmt=1, \ CONCAT('Maildir:',home,'/Maildir'), \ CONCAT('mbox:',home,'/Maildir:INBOX=/var/spool/mail/',mailboxes.username))) AS mail_location \ FROM mailboxes JOIN accounts ON accounts.username=mailboxes.username \ WHERE (mailboxes.email='%u' || \ (mailboxes.email=CONCAT('@','%d') AND (SELECT COUNT(email) FROM mailboxes \ WHERE email='%u') = 0) AND mailboxes.active IS TRUE) It clearly knows the username. Usernames on this system are just names, not full email addresses. The configuration of Quota Dict is: dovecot.conf dict/quotadict = mysql:/etc/dovecot/dovecot-dict-sql.conf ... quota = dict:user::proxy::quotadict dovecot-dict-sql.conf map { pattern = priv/quota/storage table = quota username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota username_field = username value_field = messages } Can this be fixed? Michael

2 1

[Dovecot] error when running fts optimize
by Joe Beaubien 11 Jan '14

11 Jan '14

Since yesterday, when I run "fts optimize", I get an error. Command: doveadm -v fts optimize -u formulaire Error: Jan 10 18:05:20 mba dovecot: indexer-worker(formulaire): Error: lucene index /mba_data/emails/formulaire/lucene-indexes: IndexWriter::optimize() failed (#9): bit out of range Does anyone have any idea what causes this and how to fix it? Thanks, Joe Beaubien

1 0

[Dovecot] Possible to force cipher order?
by Matthias Rieber 10 Jan '14

10 Jan '14

Hi, is it possible to force the server cipher order instead of the clients preferences? When I connect with openssl using these ciphers: 'RC4-SHA:DHE-RSA-AES256-GCM-SHA384' -> RC4-SHA will be selected and with 'DHE-RSA-AES256-GCM-SHA384:RC4-SHA' -> DHE-RSA-AES256-GCM-SHA384 It seems to be recommended for webservers to override that due to bad clients choices and increasing knowledge, like RC4 vs. BEAST, AES128 better (theoretical) than AES256. Regards, Matthias

1 1

[Dovecot] Message filtering capability at IMAP proxy
by CM Reddy 10 Jan '14

10 Jan '14

Hi, I would like process the messages at Dovecot IMAP proxy. In one of the documents, it was mentioned that Dovecot proxy currently supports on the fly message filtering in latest releases. Will it it possible to extend the filtering feature to handle the following requirements. 1. Parse the email at IMAP proxy. 2. Replace the links with some other secure links. 3. Replace the attachments with some other document. It would be great, if any one can provide some pointers to move forward. - Thanks in advance CM Reddy

2 1

Re: [Dovecot] imap auto create mailbox: we're not in group 8(mail)
by Joseph Tam 10 Jan '14

10 Jan '14

Adrian Zaugg writes: > How can I configure the auto create mailbox feature that it works and > let run LMTP and IMAP process as user %u and group mail and let create > the mailboxes in /var/mail as (example user tester) with the following > permissions: > > /var/mail: > > drwxrwx--x root mail 3072 Dec 18 01:43 . > drwx------ tester tester 1024 Jan 09 12:53 tester This is probably what you need: # Group to enable temporarily for privileged operations. Currently this is # used only with INBOX when either its initial creation or dotlocking fails. # Typically this is set to "mail" to give access to /var/mail. mail_privileged_group = mail > ...or do I need a different approach? You could also chmod 1777 /var/mail but this will allow arbitrary uses who have filesystem access to create their own files here, and maybe DoS a new user from being created (or maybe even anticipate a new mailbox, create one with mode 0777 and wait to intercept mail?). Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] LDA quota rejection
by Davide 09 Jan '14

09 Jan '14

Hi to all, i have dovecot 2.2.5 and i have implemented lda rejection through quota full this is my dovecot conf protocol lda { mail_fsync = optimized auth_socket_path = /usr/local/var/run/dovecot/auth-userdb deliver_log_format = msgid=<%f>-<%s>-%m: %$ hostname = mail.cgilfe.it info_log_path = /var/log/dovecot/dovecot-deliver.log log_path = /var/log/dovecot/dovecot-deliver.log mail_plugin_dir = /usr/local/lib/dovecot mail_plugins = $mail_plugins mail_log sieve postmaster_address = postmaster(a)mail.cgilfe.it rejection_subject = Rifiutato: %s rejection_reason = Messaggio a <%t> automaticamente rifiutato:%n%r submission_host = 192.16X.XXX.XX0 } If user over quota receive a messagge internally all is ok but if the user receive a mail from external domains nothing to the sender is sentback. Thanks in advance to all for possible help. -- *Davide Marchi* *T*eorema *F*errara *Srl* Via Spronello, 7 - Ferrara - 44121 Tel. *0532783161* Fax. *0532783368* E-m@il: *davide.marchi(a)mail.cgilfe.it* Skype: *davide.marchi73* Web: *http://www.cgilfe.it* *CONFIDENZIALITA'* *Ai sensi del D.Lgs. 196/2003 si precisa che le informazioni contenute in questo messaggio sono riservate ed a uso esclusivo del destinatario/dei destinatari. Qualora il messaggio in parola Le fosse pervenuto per errore, La invitiamo ad eliminarlo senza copiarlo e a non inoltrarlo a terzi, dandocene gentilmente comunicazione.* *Per favore, pensa all'ambiente. Stampa questa email solo se necessario.*

4 3