- dovecot - dovecot.org

doveadm throws Panic: file dsync-mailbox-tree-fill.c: line 65
by Cassidy Larson 28 Oct '14

28 Oct '14

Running 2.2.15 on FreeBSD 10.0. Forcing replication with: doveadm replicator replicate -f user(a)host.com on one user that I've seen some syslogs show up to see what's going on. Other users are fine. When I run the above command on the one user it produces a core dump. See below for syslog output and full backtrace: syslog output: Oct 26 22:44:09 d3cstorage dovecot: dsync-server(user(a)host.com): Panic: file dsync-mailbox-tree-fill.c: line 65 (dsync_mailbox_tree_get_selectable): assertion failed: (status_r->uidvalidity != 0) Oct 26 22:44:09 d3cstorage dovecot: dsync-server(user(a)host.com): Fatal: master: service(doveadm): child 67571 killed with signal 6 (core dumped) Oct 26 22:44:09 d3cstorage kernel: pid 67571 (doveadm-server), uid 127: exited on signal 6 (core dumped) bt full: #0 0x0000000040f73e1a in kill () from /lib/libc.so.7 #1 0x0000000040f72ac9 in abort () from /lib/libc.so.7 #2 0x0000000040bd6fa4 in default_fatal_handler () from /usr/local/lib/dovecot/libdovecot.so.0 #3 0x0000000040bd7ca1 in i_set_failure_internal () from /usr/local/lib/dovecot/libdovecot.so.0 #4 0x0000000040bd7249 in i_panic () from /usr/local/lib/dovecot/libdovecot.so.0 #5 0x0000000000428014 in dsync_mailbox_tree_fill () #6 0x000000000041e0e6 in dsync_brain_mailbox_trees_init () #7 0x000000000041bb27 in dsync_brain_run () #8 0x000000000041b41f in dsync_brain_master_init () #9 0x000000000042ac54 in dsync_ibc_init_stream () #10 0x0000000040be9443 in io_loop_call_io () from /usr/local/lib/dovecot/libdovecot.so.0 #11 0x0000000040beaafd in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 #12 0x0000000040be9688 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 #13 0x000000000040ec49 in doveadm_dsync_main () #14 0x0000000000410fe9 in doveadm_mail_single_user () #15 0x000000000041a89c in client_connection_create () #16 0x0000000040be9443 in io_loop_call_io () from /usr/local/lib/dovecot/libdovecot.so.0 #17 0x0000000040beaafd in io_loop_handler_run_internal () from /usr/local/lib/dovecot/libdovecot.so.0 #18 0x0000000040be9688 in io_loop_run () from /usr/local/lib/dovecot/libdovecot.so.0 #19 0x0000000040b90a58 in master_service_run () from /usr/local/lib/dovecot/libdovecot.so.0 #20 0x000000000041ae15 in main () Config snippets: service doveadm { drop_priv_before_exec = yes inet_listener { port = 12345 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = mailsys mode = 0666 user = mailsys } unix_listener replicator { group = mailsys mode = 0666 user = mailsys } } Anything else I can provide? Thanks! Cassidy

2 4

dsync-server throwing Resource temporarily available
by Cassidy Larson 28 Oct '14

28 Oct '14

Running 2.2.15 on FreeBSD 10.0 with two back end storage boxes using TCP to sync. Seeing a couple of users that always seem to be throwing these kind of errors in the logs: dovecot: dsync-server(user(a)host.com): Error: write(/var/run/dovecot/replicator-doveadm) failed: Resource temporarily unavailable Just wondering what's the proper course of action to fix it? Thanks.

2 1

An easy fix for "dovecot.map.index corrupted: map_uid=xxxx refcount too low"?
by Ralf Hildebrandt 28 Oct '14

28 Oct '14

Is there an easy way of "fixing" these? Oct 26 13:24:52 imap(account@domain): Error: mdbox map /var/mail/domain/account/mdbox/storage/dovecot.map.index corrupted: map_uid=2700 refcount too low (dovecot 2.1.17) -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

2 1

Sieve: carry global variables from sieve_before to user sieve scripts
by Alexander 'Leo' Bergolth 26 Oct '14

26 Oct '14

Hi! Is there a way to initialize global variables with default values in sieve_before scripts that can be used in the sieve_default script or in user scripts? I've tried the following code but this doesn't work.. before.d/10-set-defaults.sieve: -------------------- 8< -------------------- require ["variables", "include"]; require "vnd.dovecot.debug"; set "global.S_TESTVAR leo"; debug_log "LEO SIEVE: in before.d/10-set-defaults, S_TESTVAR: ${global.S_TESTVAR}"; -------------------- 8< -------------------- default.sieve: -------------------- 8< -------------------- require ["variables", "include"]; require "vnd.dovecot.debug"; global "S_TESTVAR"; debug_log "LEO SIEVE: in default.sieve: S_TESTVAR: ${global.S_TESTVAR}, ${S_TESTVAR}"; -------------------- 8< -------------------- Is there any other way to set up defaults in a global sieve script? Cheers, --leo -- e-mail ::: Leo.Bergolth (at) wu.ac.at fax ::: +43-1-31336-906050 location ::: IT-Services | Vienna University of Economics | Austria

2 2

imap-postlogin and doveadm
by Hans Morten Kind 26 Oct '14

26 Oct '14

We are configuring location= running a bash-script during imap-postlogin setting $MAIL in $USERDB_KEYS, as described in wiki/PostLoginScripting.txt This works fine. However, running a command like 'dovadm index [-u user] folder' only works for users with settings that match the default in mail_location= Would it be possible to make the location available for doveadm in a similar way, either with command line arguments or in the enviroment? hmk

3 4

master: Error: service(log): command startup failed, throttling for 2 secs
by Reindl Harald 26 Oct '14

26 Oct '14

master: Error: service(log): command startup failed, throttling for 2 secs i see that due restart on any machine acting as IMAP/POP3 proxy why?

2 7

Dovecote 1.2.17 poodle
by Marc Rantanen 26 Oct '14

26 Oct '14

Hi, how do I protect dovecot 1.2.17 against poodle? Br /Marc

5 8

Dynamic tags in email address
by Felix Gustavsson 25 Oct '14

25 Oct '14

I'm trying to get dynamic tagging (user+sometag(a)example.com) to work on a mail server I'm setting up, however it only works as long as it's sent to the main user and not to aliases. virtual-alias-maps query: SELECT get_email_alias_dyn('%s') virtual-mailbox-domains query: SELECT 1 FROM domain WHERE name='%s' virtual-mailbox-maps query: SELECT 1 FROM user_alias INNER JOIN domain ON user_alias.domainID = domain.id WHERE user_alias.primary = 1 AND CONCAT(user_alias.name, '@', domain.name)='%s' "get_email_alias_dyn()" is a stored function which returns the destination email, so alias+tag(a)example.com returns user(a)example.com, alias(a)example.com returns user(a)example.com and so on. It works perfectly fine when the mail does not contain any tags (alias(a)example.com or user(a)example.com) or if it's the primary email which contains tags (user+sometag(a)example.com) but when it's tags on an alias the mail is bounced due to "user unknown". I tried modifying the dovecot service in master.cf so the addresses can be filtered with Sieve (http://wiki2.dovecot.org/LDA/Postfix) but that did not solve the issue either, so I have not idea where it goes wrong or how to solve it. I have included the logs from when I sent to alias+tag(a)example.com below: Oct 25 19:54:20 xx postfix/smtpd[10987]: connect from mail-wg0-f50.google.com[74.125.82.50] Oct 25 19:54:21 xx postfix/smtpd[10987]: 10585DFA63: client=mail-wg0-f50.google.com[74.125.82.50] Oct 25 19:54:21 xx postfix/cleanup[10995]: 10585DFA63: message-id=<CAGPeO-YcJwbRJb-Gfga+G_vKqj9cm80rMZf9LAfENRCFfxLVAg(a)mail.gmail.com> Oct 25 19:54:25 xx postfix/qmgr[9945]: 10585DFA63: from=<xx(a)gmail.com>, size=1743, nrcpt=1 (queue active) Oct 25 19:54:25 xx postfix/smtpd[10987]: disconnect from mail-wg0-f50.google.com[74.125.82.50] Oct 25 19:54:25 xx dovecot: auth-worker(11000): mysql(127.0.0.1): Connected to database mailcp Oct 25 19:54:25 xx postfix/pipe[10998]: 10585DFA63: to=<xx+test(a)xx.com>, relay=dovecot, delay=5.4, delays=5.4/0/0/0.03, dsn=5.1.1, status=bounced (user unknown) Oct 25 19:54:25 xx postfix/cleanup[10995]: D39B2DFC7D: message-id=<20141025175425.D39B2DFC7D(a)xx.com> Oct 25 19:54:25 xx postfix/bounce[11002]: 10585DFA63: sender non-delivery notification: D39B2DFC7D Oct 25 19:54:25 xx postfix/qmgr[9945]: D39B2DFC7D: from=<>, size=3937, nrcpt=1 (queue active) Oct 25 19:54:25 xx postfix/qmgr[9945]: 10585DFA63: removed Oct 25 19:54:26 xx postfix/smtp[11004]: D39B2DFC7D: to=<xx(a)gmail.com>, relay=gmail-smtp-in.l.google.com[74.125.195.27]:25, delay=0.24, delays=0/0/0.16/0.07, dsn=2.0.0, status=sent (250 2.0.0 OK 1414259666 d8si5463492wiv.41 - gsmtp) Oct 25 19:54:26 xx postfix/qmgr[9945]: D39B2DFC7D: removed The dovecot-sql.conf.ext file looks like this: driver = mysql connect = host=127.0.0.1 dbname=mailcp user=mailcp password=xxx default_pass_scheme = SHA512-CRYPT password_query = SELECT CONCAT(user_alias.name, '@', domain.name) as user, user.password as password, concat('*:bytes=', (CASE WHEN user.quota -1 THEN user.quota ELSE domain.quota END)*1000000) AS userdb_quota_rule FROM user INNER JOIN user_alias ON user.id = user_alias.userID AND user_alias.primary = 1 INNER JOIN domain ON user_alias.domainID = domain.id WHERE CONCAT(user_alias.name, '@', domain.name) ='%u' AND user.status = 1 user_query = SELECT CONCAT('/var/mail/vmail/', domain.name, '/', user_alias.name) as home, 5000 AS uid, 5000 AS gid, concat('*:bytes=', (CASE WHEN user.quota != -1 THEN user.quota ELSE domain.quota END)*1000000) AS userdb_quota_rule FROM user INNER JOIN user_alias ON user.id = user_alias.userID AND user_alias.primary = 1 INNER JOIN domain ON user_alias.domainID = domain.id WHERE CONCAT(user_alias.name, '@', domain.name) ='%u' AND user.status = 1

2 2

Sieve duplicate detection
by Bruce Bodger 25 Oct '14

25 Oct '14

Good day, Gents. We are running: dovecot 1.2.17 dovecot-1.2-sieve-0.1.19 dovecot-1.2-managesieve-0.11.13 postfix 2.4.3 on OS X 10.5.8 server. Only about 15 users access the server. No problems. My question is... what would I have to upgrade, and to what version, in order to take advantage of pigeonhole sieve's duplicate detection (vnd.dovecot.duplicate) functionality? Thank you very much. Bruce

1 0

Invoking the spam checker on the sieve script
by Alejandro Exojo 25 Oct '14

25 Oct '14

Hi. TL/DR version: Is it advisable to invoke an spam checker from the sieve script, and then, once the message is filtered, decide if should be moved to a certain spam folder? A bit more context on why I'm considering this: I'm just a geek who wants to handle his own mail, but not a great experience as a system administrator. I don't have any corporate setup, just a simple VPS with me as the only user. Previously I fetched all my mail through POP, and in the client of my PC I moved (lots of) mailing list traffic to its folders. Then, for those remaining messages (and only those remaining) I passed the spam filter and moved to spam folder. That's a significant saving since I have many mailing list subscriptions, and now I'm even using rss2email, so I have lots of email that is not spam. I moved to IMAP and my filters are server side with sieve, but I don't have spam filtering yet. I thought I could replicate the setup easily, but it seems nobody is doing that, and everyone has the mail already scored when it reaches sieve. Seems like the "extprograms" extension would be a fit, but again, nobody seems to mention on documentation, so I'm fearing I'm probably wrong. Suggestions? Thank you very much! -- Alex (a.k.a. suy) | GPG ID 0x0B8B0BC2 http://barnacity.net/ | http://disperso.net

5 8

Multiple user attributes in LDAP
by CARDENAS Eduardo SIDOR 25 Oct '14

25 Oct '14

Hello, I have an issue with dovecot and Ldap… Any help will be grateful… I have dovecot 1.2.15 and i want to know if in that version can i use two values returned from LDAP in the user_attrs template? Thanking you in anticipation… -- " Notificación Automática: Este mensaje y cualquier archivo que se adjunte contiene información privilegiada y confidencial. Es para uso exclusivo del destinatario. Si usted ha recibido esta comunicación por error, por favor avísenos inmediatamente. Automatic notification: This e-mail and any file transmitted with it are confidential and may be legally privileged. It is intended solely for the addressee and may not be disclosed to or used by anyone other than the addressee. If you have received this e-mail by mistake , please advise the sender immediately"

3 3

Where can I find change logs/release notes for Dovecot EE releases?
by deoren 25 Oct '14

25 Oct '14

I searched for them and haven't come across them yet. Could any point me in the right direction? Specifically the Ubuntu 12.04 package notes if they're split out. Thanks!

4 4

2.2.14 Panic in sync_expunge_range()
by Hans Morten Kind 25 Oct '14

25 Oct '14

I am getting some panics after upgrading from 2.2.13 to 2.2.14 This panic happens for one user only, he is subscribed to 86 folders, on two of them this panic happens quite often - several times a day. The mbox folders seems OK, less than 30M with 30 and 200 messages. Panic: file mail-index-sync-update.c: line 250 (sync_expunge_range): assertion failed: (count > 0) hmk GNU gdb 6.8 Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i386-pc-solaris2.10"... Reading symbols from /datapool/local/dovecot-2.2.14/lib/dovecot/libdovecot-storage.so.0...done. Loaded symbols for /local/dovecot-2.2.14/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /datapool/local/dovecot-2.2.14/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /local/dovecot-2.2.14/lib/dovecot/libdovecot.so.0 Reading symbols from /datapool/local/program/lib/libssl.so.1.0.0...done. Loaded symbols for /local/program/lib/libssl.so.1.0.0 Reading symbols from /datapool/local/program/lib/libcrypto.so.1.0.0...done. Loaded symbols for /local/program/lib/libcrypto.so.1.0.0 Reading symbols from /datapool/local/program/lib/libz.so...done. Loaded symbols for /local/program/lib/libz.so Reading symbols from /lib/libm.so.2...done. Loaded symbols for /lib/libm.so.2 Reading symbols from /datapool/local/program/lib/libiconv.so.2...done. Loaded symbols for /local/program/lib/libiconv.so.2 Reading symbols from /lib/librt.so.1...done. Loaded symbols for /lib/librt.so.1 Reading symbols from /lib/libnsl.so.1...done. Loaded symbols for /lib/libnsl.so.1 Reading symbols from /lib/libsocket.so.1...done. Loaded symbols for /lib/libsocket.so.1 Reading symbols from /lib/libsendfile.so.1...done. Loaded symbols for /lib/libsendfile.so.1 Reading symbols from /lib/libc.so.1...done. Loaded symbols for /lib/libc.so.1 Reading symbols from /lib/libdl.so.1...done. Loaded symbols for /lib/libdl.so.1 Reading symbols from /usr/lib/libz.so...done. Loaded symbols for /usr/lib/libz.so Reading symbols from /lib/libaio.so.1...done. Loaded symbols for /lib/libaio.so.1 Reading symbols from /lib/libmd.so.1...done. Loaded symbols for /lib/libmd.so.1 Reading symbols from /lib/ld.so.1...done. Loaded symbols for /lib/ld.so.1 Core was generated by `dovecot/imap imap-postlogin'. Program terminated with signal 6, Aborted. [New process 76621 ] #0 0xfe7fc8e5 in _lwp_kill () from /lib/libc.so.1 #0 0xfe7fc8e5 in _lwp_kill () from /lib/libc.so.1 No symbol table info available. #1 0xfe7f7765 in thr_kill () from /lib/libc.so.1 No symbol table info available. #2 0xfe7a376f in raise () from /lib/libc.so.1 No symbol table info available. #3 0xfe7829e1 in abort () from /lib/libc.so.1 No symbol table info available. #4 0xfeda13ba in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:152 backtrace = 0x8093660 "0xfeda22d7 -> 0xfeda15d3 -> 0xfef31e5f -> 0xfef32d65 -> 0xfef3349e -> 0xfef33b77 -> 0xfef1dcbd -> 0xfef170e4 -> 0xfef173a4 -> 0xfef1767d -> 0xfef03e09 -> 0xfeea5540 -> 0xfeea5714 -> 0xfeea5857 -> 0xfe"... #5 0xfeda22d7 in i_internal_fatal_handler (ctx=0x8047400, format=0xfef5ebc8 "file %s: line %d (%s): assertion failed: (%s)", args=0x8047424 ".ìõþú") at failures.c:152 status = 0 #6 0xfeda15d3 in i_panic (format=0xfef5ebc8 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:152 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = 0x8047424 ".ìõþú" #7 0xfef31e5f in sync_expunge_range (ctx=0x8047600, seqs=0x80474d8) at ../../src/lib/array.h:197 map = (struct mail_index_map *) 0x80c5d90 range = (const struct seq_range *) 0x8093430 i = 134509780 count = 0 dest_seq1 = 562 prev_seq2 = 562 orig_rec_count = 4277606968 __FUNCTION__ = "sync_expunge_range" #8 0xfef32d65 in mail_index_sync_record_real (ctx=0x8047600, hdr=0x80b5d28, data=0x80b5df8) at ../../src/lib/array.h:197 rec = (const struct mail_transaction_expunge_guid *) 0x80b8968 end = (const struct mail_transaction_expunge_guid *) 0x80b8968 seqs = {arr = {buffer = 0x8093410, element_size = 8}, v = 0x8093410, v_modifiable = 0x8093410} seq = 0 modseq = 32612 ret = 0 __FUNCTION__ = "mail_index_sync_record_real" #9 0xfef3349e in mail_index_sync_record (ctx=0x8047600, hdr=0x80b5d28, data=0x80b5df8) at ../../src/lib/array.h:197 _data_stack_cur_id = 5 ret = 1 #10 0xfef33b77 in mail_index_sync_map (_map=0x80b5400, type=MAIL_INDEX_SYNC_HANDLER_HEAD, force=true) at ../../src/lib/array.h:197 map = (struct mail_index_map *) 0x0 index = (struct mail_index *) 0x80b53b0 view = (struct mail_index_view *) 0x80ab8b0 sync_map_ctx = {view = 0x80ab8b0, modseq_ctx = 0x809ca50, cur_ext_map_idx = 0, ext_intro_seq = 5, ext_intro_offset = 52, ext_intro_end_offset = 84, expunge_handlers = {arr = { buffer = 0x0, element_size = 0}, v = 0x0, v_modifiable = 0x0}, extra_contexts = {arr = { buffer = 0x809c348, element_size = 4}, v = 0x809c348, v_modifiable = 0x809c348}, unknown_extensions = 0x0, type = MAIL_INDEX_SYNC_HANDLER_HEAD, sync_handlers_initialized = 0, expunge_handlers_set = 0, expunge_handlers_used = 0, cur_ext_ignore = 0, internal_update = 0, errors = 0} thdr = (const struct mail_transaction_header *) 0x80b5d28 tdata = (const void *) 0x80b5df8 prev_seq = 5 start_offset = 0 prev_offset = 144 ret = 1 had_dirty = false reset = true __FUNCTION__ = "mail_index_sync_map" #11 0xfef1dcbd in mail_index_map (index=0x80b53b0, type=MAIL_INDEX_SYNC_HANDLER_HEAD) at mail-index-map-read.c:35 ret = 1 __FUNCTION__ = "mail_index_map" #12 0xfef170e4 in mail_index_try_open (index=0x80b53b0) at ../../src/lib/array.h:197 ret = 134919688 __FUNCTION__ = "mail_index_try_open" #13 0xfef173a4 in mail_index_open_files (index=0x80b53b0, flags=21) at ../../src/lib/array.h:197 ret = 1 #14 0xfef1767d in mail_index_open (index=0x80b53b0, flags=21) at ../../src/lib/array.h:197 ret = 134960048 __FUNCTION__ = "mail_index_open" #15 0xfef03e09 in index_storage_mailbox_open (box=0x80b47c8, move_to_memory=false) at index-storage.c:39 ibox = (struct index_mailbox_context *) 0x80b4a80 index_flags = 21 ret = 0 __FUNCTION__ = "index_storage_mailbox_open" #16 0xfeea5540 in mbox_mailbox_open_finish (mbox=0x80b47c8, move_to_memory=false) at mbox-storage.c:77 No locals. #17 0xfeea5714 in mbox_mailbox_open_existing (mbox=0x80b47c8) at mbox-storage.c:77 box = (struct mailbox *) 0x80b47c8 rootdir = 0xfeea581f "\215\225`ÿÿÿ\211T$\004\211\004$è\023¨ûÿ\211Eð\203}ð" box_path = 0x80b4b78 "/Home/USER/mail/pro/triad" move_to_memory = false #18 0xfeea5857 in mbox_mailbox_open (box=0x80b47c8) at mbox-storage.c:77 mbox = (struct mbox_mailbox *) 0x80b47c8 st = {st_dev = 82051096, st_pad1 = {0, 0, 0}, st_ino = 4141941, st_mode = 33152, st_nlink = 1, st_uid = 32440, st_gid = 4601, st_rdev = 0, st_pad2 = {0, 0}, st_size = 16826589, st_atim = { tv_sec = 1411034237, tv_nsec = 0}, st_mtim = {tv_sec = 1413152136, tv_nsec = 0}, st_ctim = { tv_sec = 1413659956, tv_nsec = 975959000}, st_blksize = 8192, st_blocks = 33016, st_fstype = "nfs", '\0' <repeats 12 times>, st_pad4 = {0, 0, 0, 0, 0, 0, 0, 0}} ret = 0 #19 0xfeec94cc in mailbox_open_full (box=0x80b47c8, input=0x0) at ../../src/lib/array.h:197 _data_stack_cur_id = 4 ret = 143 #20 0xfeec9807 in mailbox_open (box=0x80b47c8) at ../../src/lib/array.h:197 No locals. #21 0xfef024ec in index_storage_get_status (box=0x80b47c8, items=23, status_r=0x8047a04) at index-status.c:23 No locals. #22 0xfeeca8ac in mailbox_get_status (box=0x80b47c8, items=23, status_r=0x8047a04) at ../../src/lib/array.h:197 __FUNCTION__ = "mailbox_get_status" #23 0x08073ddb in imap_status_get (cmd=0x80b1fb8, ns=0x80ab1b0, mailbox=0x8093318 "pro/triad", items=0x8047a70, result_r=0x8047a04) at imap-status.c:23 client = (struct client *) 0x80b17b0 box = (struct mailbox *) 0x80b47c8 errstr = 0x8064d84 "\205Àu\034\213\205hÿÿÿÇD$\004\005" ret = 0 #24 0x08064e65 in cmd_status (cmd=0x80b1fb8) at cmd-status.c:23 client = (struct client *) 0x80b17b0 args = (const struct imap_arg *) 0x80ab240 list_args = (const struct imap_arg *) 0x80ab328 items = {status = 23, metadata = 0} result = {status = {messages = 0, recent = 0, unseen = 0, uidvalidity = 0, uidnext = 0, first_unseen_seq = 0, first_recent_uid = 0, last_cached_seq = 0, highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 1, have_save_guids = 0, have_only_guid128 = 0}, metadata = { guid = "\000\000\000\000\001\000\000\000\r\000\000\000\033\000\000", virtual_size = 2199023255593, cache_fields = 0xfe7a67f2, precache_fields = 134861792, backend_ns_prefix = 0x80921a8 "0(\t\b\030", backend_ns_type = 134511236}, error = 134654712, errstr = 0x80b2038 "STATUS"} ns = (struct mail_namespace *) 0x80ab1b0 mailbox = 0x8093318 "pro/triad" orig_mailbox = 0x80ab2f8 "pro/triad" selected_mailbox = false #25 0x0806aa61 in command_exec (cmd=0x80b1fb8) at imap-commands.c:101 hook = (const struct command_hook *) 0x809bfd8 ret = 8 #26 0x080699d2 in client_command_input (cmd=0x80b1fb8) at imap-client.c:130 client = (struct client *) 0x80b17b0 command = (struct command *) 0x3 __FUNCTION__ = "client_command_input" #27 0x08069cb7 in client_command_input (cmd=0x80b1fb8) at imap-client.c:130 client = (struct client *) 0x80b17b0 command = (struct command *) 0x809d3d4 __FUNCTION__ = "client_command_input" #28 0x08069dba in client_handle_next_command (client=0x80b17b0, remove_io_r=0x8047b9d) at imap-client.c:130 No locals. #29 0x08069e57 in client_handle_input (client=0x80b17b0) at imap-client.c:130 _data_stack_cur_id = 3 ret = 10 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #30 0x08069fe0 in client_input (client=0x80b17b0) at imap-client.c:130 cmd = (struct client_command_context *) 0x80aa9a4 output = (struct ostream *) 0x80abe08 bytes = 55 __FUNCTION__ = "client_input" #31 0xfedba96d in io_loop_call_io (io=0x80abe70) at ioloop.c:28 ioloop = (struct ioloop *) 0x809bf20 t_id = 2 __FUNCTION__ = "io_loop_call_io" #32 0xfedbc0cc in io_loop_handler_run_internal (ioloop=0x809bf20) at ioloop-poll.c:96 ctx = (struct ioloop_handler_context *) 0x809ca10 pollfd = (struct pollfd *) 0x809e0a8 tv = {tv_sec = 1799, tv_usec = 999672} io = (struct io_file *) 0x80abe70 msecs = 1800000 ret = 0 call = true #33 0xfedbab06 in io_loop_handler_run (ioloop=0x809bf20) at ioloop.c:28 No locals. #34 0xfedbaa5d in io_loop_run (ioloop=0x809bf20) at ioloop.c:28 __FUNCTION__ = "io_loop_run" #35 0xfed41db1 in master_service_run (service=0x809be68, callback=0x80771da <client_connected>) at master-service.c:75 No locals. #36 0x08077577 in main (argc=2, argv=0x809bc78) at main.c:72 set_roots = {0x8092fe0, 0x0} login_set = {auth_socket_path = 0x80930e8 "", postlogin_socket_path = 0x8093120 "", postlogin_timeout_secs = 60, callback = 0x8076f4e <login_client_connected>, failure_callback = 0x807715d <login_client_failed>, request_auth_token = 1} service_flags = MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = -1

2 1

Properly "locking" a useraccount (on a proxy)
by Ralf Hildebrandt 25 Oct '14

25 Oct '14

I'm preparing a migration of several mailboxes to another machine. The different useraccounts are distributed to different backend machines by means of a dovecot LMTP/IMAP/POP proxy. Proxying is working really well (now that the kernel does as it should). But how can I "lock" a user during migration? The plan is: ============ * lock the user * kick the user (doveadm kick) * migrate mailbox (some rsync magic) * unlock the user again But how would I lock the user? What locking needs to achieve: 1) Disallow IMAP/POP login (that's easy!) 2) defer LMTP delivery somehow (Postfix is talking to dovecot's LMTP server) Because currently, we're seeing dovecot trying local delivery on the proxy machine once an account is locked (probably because LMTP proxying uses passdb lookups, and since that one is failing it's using the userdb lookup?): Oct 21 20:15:27 lmtp(87892): Error: user sys4(a)test.invalid: Initialization failed: Namespace '': mkdir(/var/mail/test.invalid/sys4/mdbox/mailboxes) failed: Permission denied (euid=10000(vmail) egid=10000(vmail) missing +w perm: /var/mail, we're not in group 8(mail), dir owned by 0:8 mode=0775) Admittedly, this is somehow working. But it's not very elegant to use a side-effect. Is the a reserved userdb/passwd return value which will let dovecot "tempfail" in a n elegant fashion? -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

5 7

Dovecot Master/Master Replication Problem
by Felix Amler 25 Oct '14

25 Oct '14

Hi, I've set up 2 servers with dovecot 2.2.9 using maildir using structure: /var/maildir/domain/localpart Server A: mx1.xxx.de Server B: mx2.xxx.de Mails are delivered to dovecot only on server A by exim4/dovecot deliver replication to Server B works immediatelly: mark mail as read on server A, mail is marked as read on server B. BUT: when i mark a mail as read on Server B, noting happens. On Server A I get messages like this in dovecot-error.log: 2014-10-22 22:35:05 dsync-server(localpart(a)domain.de): Error: stat(/var/maildir/domain.de/localpart/.dovecot-sync.lock/tmp) failed: Not a directory 2014-10-22 22:35:05 dsync-server(localpart(a)domain.de): Error: Failed to access mailbox dovecot-sync.lock: Internal error occurred. Refer to server log for more information. [2014-10-22 22:35:05] I googled a bit, this could habben if there is a file ".dovecot-sync.lock" in the maildir, but I've double checked that, there is no such file... Why does it work in one direction, but not in the other? Please help best regards Felix

2 1

Replication .dovecot-sync.lock
by Hans-Werner Paulsen 25 Oct '14

25 Oct '14

Hello all, I have set up two servers with dovecot and replication. The mail location is mail_location = sdbox:/var/spool/mail/%u Everything works fine when I override the homedirectories userdb { driver = passwd override_fields = home=/var/spool/mail/%u } But, when I do not override the homedirectories, replication does not work, and the following error is logged: Oct 24 14:40:45 dsync-local(hans): Error: Couldn't create lock /afs/mpa/home/hans/.dovecot-sync.lock: Permission denied With a self-written module an IMAP user can get access to his homedirectory: protocol imap { mail_plugins = afsToken } The user has to type in his password. Obviously this does not work for replication. Is there a way to specify a different location for the lockfile? Isn't better to use the maildirectory but the homedirectory? Is there a way to set the homedirectory differently for replication? Thank you for any help. HW -- Hans-Werner Paulsen hans(a)MPA-Garching.MPG.DE MPI für Astrophysik Tel 089-30000-2602 Karl-Schwarzschild-Str. 1 Fax 089-30000-2235 D-85741 Garching

2 1

2.2.14 and "Panic: file virtual-sync.c"
by Michael Köhler 25 Oct '14

25 Oct '14

Hi, after upgrading to 2.2.14 (debian wheezy with apt source from rename-it.nl) I´ve got from time to time a panic in virtual plugin. Here are an excerpt from the log file: ---------------------------------- Oct 21 20:44:15 mailserver dovecot: imap(michael@DOMAIN): flag_change: box=Virtual.Ungelesen, uid=1, msgid=<54466F71.3050702(a)makomi.de>, size=1661, flags=(\Seen \Draft \Recent) Oct 21 20:44:15 mailserver dovecot: imap(michael@DOMAIN): Panic: file virtual-sync.c: line 1115 (virtual_sync_backend_box): assertion failed: (array_count(&bbox->sync_pending_removes) == 0) Oct 21 20:44:15 mailserver dovecot: imap(michael@DOMAIN): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x752af) [0x7f5f2630e2af] -> /usr/lib/dovecot/libdovecot .so.0(+0x7530e) [0x7f5f2630e30e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f5f262c05de] -> /usr/lib/dovecot/modules/lib20_virtual_plugin.so(virtual_storage_sync_init+0x266c ) [0x7f5f24abb9cc] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x35) [0x7f5f26601195] -> dovecot/imap(imap_sync_init+0x7a) [0x41faaa] -> dovecot/imap(cmd_sync_dela yed+0x190) [0x420710] -> dovecot/imap(client_handle_input+0x1d5) [0x417a35] -> dovecot/imap(client_input+0x72) [0x417d22] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) [ 0x7f5f263200fb] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xbb) [0x7f5f2632117b] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f5f26320189] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f5f26320208] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f5f262c5ab3] -> dovecot/imap(main+0x2a1) [0x 40c311] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f5f25f2bead] -> dovecot/imap() [0x40c475] Oct 21 20:44:15 mailserver dovecot: imap(michael@DOMAIN): Fatal: master: service(imap): child 31075 killed with signal 6 (core dumps disabled) ————————————————— Are the problem well-known? And what could I do? Thanks, Michael

2 1

dovecot-lda from postfix on remote dovecot server
by nik600 25 Oct '14

25 Oct '14

Dear all i've got many SMTP front-end that filter the mail and do some custom stuff... then when i've decided the final destination i'd like to call /usr/lib/dovecot/dovecot-lda to deliver the mail. Actually i have in master.cf: #####################à dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail null_sender= argv=/usr/lib/dovecot/dovecot-lda -f ${sender} -d ${recipient} #####################à I'd like to know if is possible to use some other command or some additional parameter to deliver the mail to a remote dovecot server. Thanks -- /*************/ nik600 http://www.kumbe.it

3 3

Replication only sporadic
by Lucas Rothamel - Eye Catching Webdesign 24 Oct '14

24 Oct '14

Hello dear Dovecot Gurus, I am setting up two servers with Dovecot replication as hot-standby servers for a small high availability cluster, switch-over through DNS-redirect. For testing purposes, both servers are generating a small test mail every few minutes and delivering to the local dovecot each. In my mail client, I added both servers through IMAP to watch how the replication is working. However, I noted that replication is very sporadic: sometimes a new email is received "instantaneous" by both servers, then no replication updates are visible for hours, and suddenly all missing mail appear in the other server. Why is this? Can this be changed to be more realtime? Thank you! Lucas doveconf -n: # 2.2.14: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.7 ext4 auth_mechanisms = plain login cram-md5 disable_plaintext_auth = no info_log_path = /var/log/dovecot-info.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_debug = yes mail_location = maildir:/home/%d/%n/Maildir mail_plugins = " notify replication" mail_privileged_group = mail passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { mail_replica = remote:vmail@... quota = maildir:User quota quota_rule = *:storage=1GB replication_full_sync_interval = 1 hours } protocols = imap pop3 service aggregator { fifo_listener replication-notify-fifo { mode = 0600 user = vmail } unix_listener replication-notify { mode = 0600 user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service config { unix_listener config { user = vmail } } service doveadm { user = vmail } service replicator { process_min_avail = 1 } ssl_cert = ... ssl_key = ... userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol imap { mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota pop3_uidl_format = %08Xu%08Xv } protocol lda { info_log_path = /var/log/dovecot-lda.log mail_plugins = quota postmaster_address = ... } -- Lucas Rothamel Eye Catching Webdesign info(a)eye-catching-webdesign.de - www.eye-catching-webdesign.de You know, we go to the gym to keep the body fit. Similarly the mind needs some rest. The mind is bombarded with so many impressions. Our mind has been bombarded by impressions the whole time. It needs a different kind of rest other than sleep. And meditation is such a rest. It calms the mind. energizes the spirit and makes the body more strong and vibrant. improves the immune system. The immune cells, the T-cell count go higher through Sudarshan Kriya and meditation. And you feel so nice inside. - Sri Sri Ravi Shankar I love deadlines. I like the whooshing sound they make as they fly by. -- Douglas Adams

1 0

Sieve Advice Needed, Please
by Casey Bralla 24 Oct '14

24 Oct '14

Anybody here familiar with the Sieve language? I'm rebuilding my mail server, and I am working with the sieve language to automatically filter spam into a separate account. However, I've hit a snag that I can't get around. BTW, I'm using a clean install of dovecot, postfix, spamassassin on Debian 7.5. I want to do server-side spam filtering, so I've got spamasassin identifying spam, and then have sieve sorting the mail to a special spam folder. I can easily send spam to special folder in the inbox for each mail user, but I wanted to have a single mail account for spam. I can use the "redirect" sieve command to send anything with the X-spam-flag set, but this triggers an error and bounces the offending mail. The bounce message is: From: MAILER-DAEMON(a)NerdWorld.org (Mail Delivery System) To: casey(a)vmailservertest.nerdworld.org Subject: Undelivered Mail Returned to Sender Date: Sun, 19 Oct 2014 16:41:49 -0400 (EDT) This is the mail system at host VMailServerTest.NerdWorld.org. I'm sorry to have to inform you that your message could not be delivered to one or more recipients. It's attached below. For further assistance, please send mail to postmaster. If you do so, please include this problem report. You can delete your own text from the attached returned message. The mail system <spam(a)vmailservertest.nerdworld.org>: mail forwarding loop for spam(a)vmailservertest.nerdworld.org From: casey(a)vmailservertest.nerdworld.org Date: Sun, 19 Oct 2014 16:41:20 -0400 (EDT) viagra!!!! www.viagra.com I think this is a recursion problem, since the redirected mail has to go through the spamassassin check and sieve again. I tried to get clever and prevent the recursion, but I'm not clever enough. Here is my sieve rule file. # # # A rule to move spam to the spam user # based on spamassassin setting the spam flag # # # require ["redirect"]; (Not needed, since it is part of the basis sieve spec) # # rule:[SPAM] if header :contains "X-Spam-Flag" ["YES"] { if address :is "to" "Spam(a)VMailServerTest.NerdWorld.org" { keep; } else { redirect "spam(a)VMailServerTest.NerdWorld.org"; } } # # # Anybody able to give me any advice? TIA -- Casey Bralla Chief Nerd in Residence The NerdWorld Organisation www.NerdWorld.org

3 2

Re: special "what's my ip" pop account
by Joseph Tam 24 Oct '14

24 Oct '14

Steffen Kaiser writes: > let's put aside the question, if this way is sensible or not. [... continuing in nonsensible mode ...] > And if you are at it, maybe a dummy server with a self-made script that > returns "+OK POP3 your IP is ....", then return +FAIL for any further > command. Been there, done that (for a different problem). Not all mail readers will show you banners; to make this really work, you have to implement USER and PASS (accepts anything), STAT and LIST (one message available), RETR (dump your informational message payload), QUIT (disconnect), maybe TOP, and everything else is an +OK no-op. I patched Qualcomm's qpopper to do this. As to whether the OP *should* do this, definitely not. Find a better solution. Joseph Tam <jtam.home(a)gmail.com>

1 0

Public root folder is \Noselect
by G H 23 Oct '14

23 Oct '14

I am utilizing a public namespace via http://wiki2.dovecot.org/SharedMailboxes/Public and using sdbox storage format. How can I get rid of the \Noselect flag that is set by default for this folder? IMAP output: b LIST "" "*" * LIST (\HasNoChildren \Sent) "/" Sent * LIST (\HasNoChildren \Trash) "/" Trash * LIST (\Noselect \HasNoChildren) "/" Public * LIST (\HasNoChildren) "/" INBOX If this is not possible, what is the best way to create a sub-folder in here upon system setup (one w/o a \Noselect flag)? Thanks, G H

1 0

special "what's my ip" pop account
by A. Schulze 23 Oct '14

23 Oct '14

Hello, I like to enable the allow_nets Feature (http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/AllowNets) for my customers. To help them knowing there own IP I imagine a special mailbox/loginuser at the pop3 server. That user could give a valid pop3 answer from a dummy pop3 server or simply throw a login error with customised answer containing the IP information. Has anybody done something similar or ideas to build such a system? Thanks for ideas Andreas

4 6

What is the correct way to configure the mail_location option for Mailidr format?
by deoren 23 Oct '14

23 Oct '14

Short version: What is the correct way to configure the mail_location option for Mailidr format? I've long had it setup this way: mail_location = maildir:/var/vmail/%d/%n based on this guide: https://www.linode.com/docs/email/postfix/email-with-postfix-dovecot-and-my… Is that correct? Longer version: After upgrading from Dovecot v2.0.x to v2.2.x yesterday I'm coming to the conclusion that I've got it configured wrong. This is probably compounded by my bright idea of explicitly setting the path separator prior to the upgrade like so: separator = . Because we're using Maildir I thought it would be useful to explicitly set the separator value to what the default is for Maildir. I figured this would be a good way to remind myself what the separator is by default. I also figured while I was merging the conf changes between v2.0 and v2.2 I could roll that additional change in also. Looks like that was a bad idea to include unnecessary changes until things had stabilized. I should know better; I was too optimistic for my own good. Here is an example error message I ran into: stat(/var/vmail/example.com/username/.dovecot.lda-dupes/tmp) failed: Not a directory which is nearly identical (other than leading path) to what is shown here: http://www.dovecot.org/list/dovecot/2010-April/048227.html Steffen Kaiser responded with, "You should not (must not) have home == maildir root." That is when I double-checked the guide that I mentioned above and found that I had followed their directions exactly for that conf setting. Looking at some other guides/tutorials shows something more like: mail_location = maildir:/var/vmail/%d/%n/Maildir I assume the latter is how it's supposed to be done? If so, that would explain the problems I've had with Sieve scripts in the past until I explicitly set 'sieve_dir' like so: sieve_dir = /var/vmail/sieve/%d/%n/sieve_dir I did review the official docs here: http://wiki2.dovecot.org/MailLocation/Maildir but I didn't find where it explicitly warns against setting home == maildir root. It should probably be apparent, but it wasn't to me when I first configured that setting. Thanks in advance for your help. If it turns out that the linode.com guide is wrong I'll create a Pull request to have that guide updated.

3 6

Re: dictionary attack defense
by Joseph Tam 23 Oct '14

23 Oct '14

Cliff Hayes writes: > a) I read about auth_failure_delay even before I posted my question and > I could not figure out the one-line explanation in the dovecot wiki: > "Number of seconds to delay before replying to failed authentications." > It's delaying a reply. Does that mean the hacker can keep asking as > fast as he wants? As Reindl states, authentication is a synchronous operation so the BFD attacker must wait for a reply before continuing. An attacker can get around this by running a botnet against you or opening up many concurrent connections (I think the latter can be capped), but I've rarely seen this. A botnet attack will defeat IP based blocking anyways. > Is it per user or per IP? Irrelevant -- there is no tracking. It's simply pauses the reply to bad auth attempts and tarpits the session. auth_failure_delay does not block BFD attacks, but makes it infeasable for reasonable strength passwords. It's simpler to implement, robust, and fault tolerant (e.g. a user cannot accidentally lock themselves out requiring administrative intervention to restore immediate access, or repeated failures from a NAT'd network does not DoS everything within the NAT'd network). Joseph Tam <jtam.home(a)gmail.com>

1 0