December 2016 - dovecot

Fwd: Re: making a plugin encrypt index data
by Aki Tuomi 16 Dec '16

16 Dec '16

> ---------- Original Message ---------- > From: Aki Tuomi <aki.tuomi(a)dovecot.fi> > To: micah anderson <micah(a)riseup.net> > Date: December 16, 2016 at 11:25 PM > Subject: Re: making a plugin encrypt index data > > When we released our encryption plugin, mail-crypt, it's capabilities include fs-crypt. This can be used to encrypt things like FTS indexes and attachments, and with suitable mail storage, such as obox, you can also encrypt indexes. > > To extend this support to dbox or maildir, does require rather involved changes in dovecot core, which currently has no support for fs-api in index handling. This might happen on v2.3 or v2.4, depending. > > I somehow suspect that the work estimate would exceed your budget. But it is going to happen, it's just matter of time. Can't give you any timeline though, since we have not decided on one yet. > > Aki > > > On December 16, 2016 at 9:53 PM micah anderson <micah(a)riseup.net> wrote: > > > > > > > > Hi Aki, > > > > Do you have any idea approximately when this would be planned for? > > > > We are also interested potentially paying for the ability to encrypt our > > indexes, as this is a major concern for us. We don't have a lot of money > > as a non-profit, but if there is a possibility of contract work, we > > would be interested to know what it would cost to do it. > > > > thanks, > > micah > > > > Aki Tuomi <aki.tuomi(a)dovecot.fi> writes: > > > > >> On December 16, 2016 at 6:48 PM micah anderson <micah(a)riseup.net> wrote: > > >> > > >> > > >> > > >> Hello, > > >> > > >> I'm encrypting mail on disk using a plugin[0], but the index files are > > >> not encrypted (specifically the dovecot.index.cache can be read). > > >> > > >> I want to do is encrypt index on disk, so I'm looking for how a plugin > > >> can achieve that by hooking into the right locations. Is that easily > > >> possible in a plugin? > > >> > > >> I can turn off those indexes by passing INDEX=MEMORY, but that isn't > > >> possible if I use sdbox/mdbox. > > >> > > >> thanks for any suggestions! > > >> micah > > >> > > >> 0. https://0xacab.org/riseuplabs/tofu-scrambler > > > > > > Hi! > > > > > > At the moment it's not possible without making new storage class. We are planning to add support for fs drivers for indexes at some point. > > > > > > Aki Tuomi > > > Dovecot Oy

1 0

service(indexer-worker): child 18977 killed with signal 11 (core dumped)
by Matteo Biagini 16 Dec '16

16 Dec '16

Hello to everybody, first of all: thanks a lot for your hard work and for this nice piece of software! After many search about the following SIGSEGV, I decide to post the backtrace and I hope to have avoided duplicated thread. The problem arise after I enable clucene fts. I tryed the clucene ports version (I am using OpenBSD) and a fixed version from github (Blue-Rocket/clucene::feature/pod) which contains FreeBSD fixes and others memory leak patches, but the problem persists. I built either dovecot-* and clucene-core with -g and the following logs are taken from that version. Maybe, I can do more debugging but I don't know how; some ideas? thanks a lot == LOG == Dec 16 12:30:34 mail02 dovecot: indexer-worker(user@hostname): Indexed 1 messages in Trash Dec 16 12:31:16 mail02 dovecot: imap-login: Login: user=<user@hostname>, method=PLAIN, rip=10.244.3.101, lip=10.244.3.200, mpid=90234, TLS, session=<68Ny6MRDml8K9ANl> Dec 16 12:31:16 mail02 dovecot: imap-login: Login: user=<user@hostname>, method=PLAIN, rip=10.244.3.101, lip=10.244.3.200, mpid=59810, TLS, session=<c7xz6MRDzV4K9ANl> Dec 16 12:31:16 mail02 dovecot: imap-login: Login: user=<user@hostname>, method=PLAIN, rip=10.244.3.101, lip=10.244.3.200, mpid=66756, TLS, session=<UtNz6MRDiJwK9ANl> Dec 16 12:31:16 mail02 dovecot: imap-login: Login: user=<user@hostname>, method=PLAIN, rip=10.244.3.101, lip=10.244.3.200, mpid=81959, TLS, session=<gJZ06MRD9HQK9ANl> Dec 16 12:31:16 mail02 dovecot: imap-login: Login: user=<user@hostname>, method=PLAIN, rip=10.244.3.101, lip=10.244.3.200, mpid=14099, TLS, session=<BL116MRD3DgK9ANl> Dec 16 12:31:16 mail02 dovecot: indexer-worker(user@hostname): Indexed 1 messages in INBOX Dec 16 12:32:18 mail02 dovecot: indexer-worker: Fatal: master: service(indexer-worker): child 18977 killed with signal 11 (core dumped) == GDB == (gdb) bt #0 strlen () at /usr/src/lib/libc/arch/amd64/string/strlen.S:152 #1 0x0000093434d7c120 in __vfprintf (fp=0x7f7fffff96c0, fmt0=0x9343cef79ae "Timeout leak: %p (%s:%u)", ap=Variable "ap" is not available. ) at /usr/src/lib/libc/stdio/vfprintf.c:885 #2 0x0000093434d9b068 in *_libc_vsnprintf (str=0x933ab0940b8 "Timeout leak: 0x9342f652300", n=120, fmt=0x9343cef79ae "Timeout leak: %p (%s:%u)", ap=0x7f7fffff9870) at /usr/src/lib/libc/stdio/vsnprintf.c:61 #3 0x000009343cdd4aa5 in str_vprintfa (str=0x933ab094078, fmt=0x9343cef79ae "Timeout leak: %p (%s:%u)", args=0x7f7fffff9870) at str.c:129 #4 0x000009343cdaacd1 in internal_handler (ctx=0x9343d22fab0, format=0x9343cef79ae "Timeout leak: %p (%s:%u)", args=0x7f7fffff9870) at failures.c:602 #5 0x000009343cdab839 in i_internal_error_handler (ctx=Variable "ctx" is not available. ) at failures.c:677 #6 0x000009343cdab3f4 in i_warning (format=0x9343cef79ae "Timeout leak: %p (%s:%u)") at failures.c:325 #7 0x000009343cdc107b in io_loop_destroy (_ioloop=Variable "_ioloop" is not available. ) at ioloop.c:741 #8 0x000009343cd485bd in master_service_deinit (_service=Variable "_service" is not available. ) at master-service.c:876 #9 0x0000093193802642 in main (argc=1, argv=0x7f7fffff9b28) at indexer-worker.c:83 (gdb) bt full #0 strlen () at /usr/src/lib/libc/arch/amd64/string/strlen.S:152 No locals. #1 0x0000093434d7c120 in __vfprintf (fp=0x7f7fffff96c0, fmt0=0x9343cef79ae "Timeout leak: %p (%s:%u)", ap=Variable "ap" is not available. ) at /usr/src/lib/libc/stdio/vfprintf.c:885 mbs = { __mbstate8 = "{\t\000\000\000\000\000\000\000\000\000\000r3\t\000\000\000\000\000\000\000\000\000\0004\t\000\000\001\000\000\000\000\000\000\000223\177\177\000\000\001\000\000\000\000\000\000\000\002\000\000\000\000\000\000\000\t216U\035\rP", '\0' <repeats 47 times>, __mbstateL = 10118011532464} mbseqlen = Variable "mbseqlen" is not available. == DOVECONF == # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: OpenBSD 6.0 amd64 auth_master_user_separator = * auth_mechanisms = PLAIN LOGIN base_dir = /var/run/dovecot dict { acl = mysql:/etc/dovecot/dovecot-share-folder.conf quotadict = mysql:/etc/dovecot/dovecot-used-quota.conf } first_valid_uid = 2000 last_valid_uid = 2000 listen = * [::] login_greeting = Welcome mail_gid = 2000 mail_location = mdbox:%Lh/Maildir/:INDEX=%Lh/Maildir/ mail_plugins = quota mailbox_alias acl zlib fts fts_lucene trash mail_uid = 2000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mdbox_rotate_size = 60 M namespace { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } mailbox "Deleted Messages" { auto = no special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox "Junk E-mail" { auto = no special_use = \Junk } mailbox SPAM { auto = no special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { auto = no special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = separator = / type = private } namespace { list = children location = mdbox:%%Lh/Maildir/:INDEX=%%Lh/Maildir/Shared/%%Ld/%%Ln prefix = Shared/%%u/ separator = / subscriptions = yes type = shared } passdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } passdb { args = /etc/dovecot/dovecot-master-users driver = passwd-file master = yes } plugin { acl = vfile acl_shared_dict = proxy::acl antispam_backend = MAILTRAIN antispam_mail_notspam = --ham antispam_mail_sendmail = /usr/local/bin/sa-learn-pipe.sh antispam_mail_spam = --spam antispam_signature = X-Spam-Flag antispam_signature_missing = move antispam_spam = Spam;Junk antispam_spam_pattern = spam;Spam;junk;Junk antispam_spam_pattern_ignorecase = SPAM;JUNK antispam_trash = trash;Trash;Deleted Items;Deleted Messages antispam_trash_pattern = trash;Trash;Deleted * antispam_trash_pattern_ignorecase = TRASH auth_socket_path = /var/run/dovecot/auth-master fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@. mailbox_alias_new = Sent Messages mailbox_alias_new2 = Sent Items mailbox_alias_new3 = SPAM mailbox_alias_new4 = Spam mailbox_alias_old = Sent mailbox_alias_old2 = Sent mailbox_alias_old3 = Junk mailbox_alias_old4 = Junk quota = dict:user::proxy::quotadict quota_grace = 10%% quota_rule = *:storage=1G quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u sieve = %Lh/sieve/dovecot.sieve sieve_before = /var/vmail/sieve/dovecot.sieve sieve_dir = %Lh/sieve sieve_global_dir = /var/vmail/sieve sieve_max_redirects = 30 trash = /etc/dovecot/dovecot-trash.conf.ext zlib_save = lz4 zlib_save_level = 6 } protocols = pop3 imap sieve lmtp service auth { inet_listener { address = 127.0.0.1 port = 12345 } unix_listener /var/spool/postfix/private/dovecot-auth { group = _postfix mode = 0666 user = _postfix } unix_listener auth-master { group = vmail mode = 0666 user = vmail } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { process_limit = 500 service_count = 1 } service lmtp { executable = lmtp -L inet_listener lmtp { address = 127.0.0.1 port = 24 } process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = _postfix mode = 0600 user = _postfix } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { service_count = 1 } service quota-status { client_limit = 2 executable = quota-status -p postfix inet_listener { address = 127.0.0.1 port = 12340 } } service quota-warning { executable = script /usr/local/bin/dovecot-quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } } ssl = required ssl_cert = </etc/ssl/dovecot.crt ssl_cipher_list = EECDH+AESGCM:EDH+AESGCM:AES256+EECDH:AES256+EDH ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 syslog_facility = local5 userdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } protocol lda { auth_socket_path = /var/run/dovecot/auth-master lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_plugins = quota mailbox_alias acl zlib fts fts_lucene trash sieve notify push_notification postmaster_address = root } protocol lmtp { lmtp_save_to_detail_mailbox = yes log_path = syslog mail_plugins = quota sieve notify push_notification postmaster_address = postmaster recipient_delimiter = + } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep imap_idle_notify_interval = 29 mins imap_max_line_length = 4 M mail_max_userip_connections = 30 mail_plugins = quota mailbox_alias acl zlib fts fts_lucene trash imap_quota imap_acl imap_zlib antispam } protocol pop3 { mail_max_userip_connections = 30 mail_plugins = quota mailbox_alias acl zlib fts fts_lucene trash pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv }

2 1

making a plugin encrypt index data
by micah anderson 16 Dec '16

16 Dec '16

Hello, I'm encrypting mail on disk using a plugin[0], but the index files are not encrypted (specifically the dovecot.index.cache can be read). I want to do is encrypt index on disk, so I'm looking for how a plugin can achieve that by hooking into the right locations. Is that easily possible in a plugin? I can turn off those indexes by passing INDEX=MEMORY, but that isn't possible if I use sdbox/mdbox. thanks for any suggestions! micah 0. https://0xacab.org/riseuplabs/tofu-scrambler

2 1

v2.2.27 Debian packages on xi.dovecot.fi
by Markus Schönhaber 16 Dec '16

16 Dec '16

Hi, at the moment I see only packages named *2.2.26* on xi.dovecot.fi. Can we expect packages for v2.2.27 to appear there? -- Regards mks

2 2

public folder subscriptions sync issue with ldap user/group in dovecot-acl
by Mike Fröhner 16 Dec '16

16 Dec '16

Hello people, I am having an issue with 'doveadm sync'. I am currently trying to have two dovecots behind an haproxy (works fine). Therefore I configured these two dovecot server (imap-1/imap-2) to sync throught dsync. This works just partly. The sync of the maiboxes is fine, but the sync of the subscriptions file just works partly. It works for private folder subscription, but not completly for public folder subscription. I found two issues, if I am using LDAP (user/groups) in dovecot ACLs. 1. I would like to subscribe 2 public folder (public/test/test1 and public/test/test2). My user (ldaptestuser) is an ldap user and this user is member of the ldap group (ldaptestgroup) which does have all dovecot-acl rights on these folders. imap-1 # cat /opt/mail/_public/publictest/.test*/dovecot-acl group=ldaptestgroup akxeilprwts group=ldaptestgroup akxeilprwts I am now connecting with my mail client to imap-1 (throught haproxy) and the subscription to this folder works. The file which is written looks like: imap-1 # cat /opt/mail/ldaptestuser/Mails/subscriptions Sent publictest/test/test1 publictest/test/test2 Now I am awaiting the synch to imap-2, but the file which it written looks like: imap-2 # cat /opt/mail/ldaptestuser/Mails/subscriptions Sent If I modify the dovecot-acl for .test1 to imap-1 # cat /opt/mail/_public/publictest/.test1/dovecot-acl group=ldaptestgroup akxeilprwts user=ldaptestuser akxeilprwts and execute the subscription again - the synced file looks like: imap-2 # cat /opt/mail/ldaptestuser/Mails/subscriptions Sent publictest/test/test1 The subscription of public folder test2 will also been synced, if I add my ldaptestuser to the acl file for this folder. 2. Another issue is to unsubscribe a public folder. If I unsubscribe folder test1, it is written to subscriptions file on the imap where I am connected, but it is NOT synced even if my user and group are configured at the dovecot-acl file. If I then unsubscribe a not public folder (like Sent), the former unsubscribed folder test1 is (faulty) subscribed again. But both imap do have the same subscriptions for my ldaptestuser user. I do have the behavior with dovecot-2.2.26 and dovecot-2.2.27 on CentOS-7 (selinux disabled). If you need more information like the dovecot -n or some other stuff give me a short notice. Mike;

2 4

autoexpunge=30d does not works :(
by Peter Hodur 16 Dec '16

16 Dec '16

Hello, just upgraded to Dovecot 2.2.27 and altered dovecot.conf to contain autoexpunge directive for Spam mailbox (yes it's migrated from Courier 3 years ago): namespace inbox { prefix = INBOX. separator = . inbox = yes mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Spam { auto = subscribe special_use = \Junk autoexpunge = 30d } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } } As I hope, when user logout (POP3 or IMAP) or after Postfix delivers mail via LMTP, Dovecot should check Spam folder for emails, which have ctime older than 30 days and deletes this emails. Recently I have tried this. I have tried login / logout and nothing happend. I have tried turning log verbosity to debug but I can not find any note in debug.log according to this. I would like to kindly ask someone for which this directive works to help me, what is wrong with my config or how can I debug it and find error. Thanks Pete

2 1

Possible solr and indexing bug
by Netfront Customer Service 16 Dec '16

16 Dec '16

Bug Report: We had one of our solr server down for a while, then observed a lot of "Warning: fscking index file " actions. Version 2.2.27 with auto fsck. A follow up investigation shows direct one to one relationship between solr error and subsequent fscking. The fscking lasts for quite a long time (for at least an hour) when the mailbox is concurrently accessed. Thank you. Netfront Hong Kong Dec 16 07:48:14 dovecot: pop3(glhk44): Disconnected: Logged out top=0/0, retr=0/0, del=0/221, size=143216382 Dec 16 08:13:20 dovecot: pop3-login: Login: user=<glhk44>, method=PLAIN, rip=4.5.6.7, lip=1.2.3.4, mpid=99633, TLS, session=<JzQEcLtDEooqYqt/> Dec 16 08:13:23 dovecot: pop3(glhk44): Disconnected: Logged out top=0/0, retr=0/0, del=0/221, size=143216382 Dec 16 08:39:10 dovecot: indexer-worker(glhk44): Indexed 1 messages in INBOX Dec 16 08:46:01 dovecot: indexer-worker(glhk44): Indexed 1 messages in INBOX Dec 16 08:53:33 dovecot: indexer-worker(glhk44): Indexed 1 messages in INBOX Dec 16 08:57:53 dovecot: indexer-worker(glhk44): Indexed 1 messages in INBOX Dec 16 09:00:39 dovecot: indexer-worker(glhk44): Indexed 1 messages in INBOX Dec 16 09:05:00 dovecot: indexer-worker(glhk44): Indexed 1 messages in INBOX Dec 16 09:09:32 dovecot: indexer-worker(glhk44): Indexed 1 messages in INBOX Dec 16 09:21:44 dovecot: indexer-worker(glhk44): Indexed 1 messages in INBOX Dec 16 09:24:59 dovecot: indexer-worker(glhk44): Indexed 1 messages in INBOX Dec 16 09:29:52 dovecot: indexer-worker(glhk44): Indexed 1 messages in INBOX Dec 16 09:31:08 dovecot: indexer-worker(glhk44): Indexed 1 messages in INBOX Dec 16 09:44:18 dovecot: imap-login: Login: user=<glhk44>, method=PLAIN, rip=6.7.8.9, lip=1.2.3.4, mpid=22866, session=<0yNKtbxDwuTaZxfh> Dec 16 09:44:18 dovecot: imap-login: Login: user=<glhk44>, method=PLAIN, rip=6.7.8.9, lip=1.2.3.4, mpid=22867, session=<GWJLtbxDw+TaZxfh> Dec 16 09:44:18 dovecot: imap-login: Login: user=<glhk44>, method=PLAIN, rip=6.7.8.9, lip=1.2.3.4, mpid=22868, session=<WBtOtbxDxOTaZxfh> Dec 16 09:44:18 dovecot: imap-login: Login: user=<glhk44>, method=PLAIN, rip=6.7.8.9, lip=1.2.3.4, mpid=22869, session=<ueZOtbxDxeTaZxfh> Dec 16 09:44:29 dovecot: pop3-login: Login: user=<glhk44>, method=PLAIN, rip=6.7.8.9, lip=1.2.3.4, mpid=23090, TLS, session=<iGL6tbxDsGDaZxfh> Dec 16 09:44:30 dovecot: imap-login: Login: user=<glhk44>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=23093, secured, session=<wOkJtrxDpkl/AAAB> Dec 16 09:44:31 dovecot: imap(glhk44): Connection closed in=0 out=404 Dec 16 09:45:34 dovecot: pop3(glhk44): Disconnected: Logged out top=0/0, retr=11/3587310, del=0/232, size=146803474 Dec 16 09:45:38 dovecot: imap(glhk44): Logged out in=202 out=4336 Dec 16 09:46:17 dovecot: imap-login: Login: user=<glhk44>, method=PLAIN, rip=6.7.8.9, lip=1.2.3.4, mpid=27449, session=<zLltvLxD0OTaZxfh> Dec 16 09:46:19 dovecot: imap-login: Login: user=<glhk44>, method=PLAIN, rip=6.7.8.9, lip=1.2.3.4, mpid=27550, session=<FtiHvLxD0eTaZxfh> Dec 16 09:46:20 dovecot: imap(glhk44): copy from INBOX: box=Deleted Messages, uid=1690, msgid=<RkJNAAAAAAqAgMEKAAAACoAA7m1Hw9Fq0(a)ShawsCrabHouse.fbmta.com>, size=6759 Dec 16 09:46:20 dovecot: imap(glhk44): delete: box=INBOX, uid=124159, msgid=<20161215164627444789108(a)sensioinc.cn>, size=127611 Dec 16 09:46:20 dovecot: imap(glhk44): expunge: box=INBOX, uid=124159, msgid=<20161215164627444789108(a)sensioinc.cn>, size=127611 Dec 16 09:46:28 dovecot: imap(glhk44): Error: fts_solr: Indexing failed: 503 Service Unavailable < ----------------------- solr error Dec 16 09:46:28 dovecot: indexer-worker(glhk44): Error: fts_solr: Indexing failed: 503 Service Unavailable Dec 16 09:46:28 dovecot: indexer-worker(glhk44): Error: Mailbox Deleted Messages: Transaction commit failed: FTS transaction commit failed: backend deinit Dec 16 09:46:28 dovecot: imap(glhk44): copy from INBOX: box=Deleted Messages, uid=1691, msgid=<20161215003910.C4439ABB653(a)smtp3.mthai.in.th>, size=17896 Dec 16 09:46:29 dovecot: indexer-worker(glhk44): Indexed 1 messages in Deleted Messages Dec 16 09:46:30 dovecot: imap(glhk44): delete: box=INBOX, uid=124164, msgid=<00c701d256b1$3bbbcfd0$b3336f70$@com>, size=107064 Dec 16 09:46:30 dovecot: imap(glhk44): expunge: box=INBOX, uid=124164, msgid=<00c701d256b1$3bbbcfd0$b3336f70$@com>, size=107064 Dec 16 09:46:31 dovecot: imap(glhk44): delete: box=INBOX, uid=124175, msgid=<00f201d256c2$a4db5f10$ee921d30$@com>, size=3518208 Dec 16 09:46:31 dovecot: imap(glhk44): expunge: box=INBOX, uid=124175, msgid=<00f201d256c2$a4db5f10$ee921d30$@com>, size=3518208 Dec 16 09:46:31 dovecot: imap(glhk44): copy from INBOX: box=Deleted Messages, uid=1692, msgid=<1616393.344200011xAAAAA(a)enterprisecommunicationnetwork.com>, size=47100 Dec 16 09:46:31 dovecot: imap(glhk44): Error: Corrupted transaction log file /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.log seq 1268: file size shrank (28960 < 29056) (sync_offset=29056) <-------- fscking starts Dec 16 09:46:31 dovecot: imap(glhk44): Error: Index /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: Lost log for seq=1268 offset=24900: Failed to map file seq=1268 offset=24900..18446744073709551615 (ret=0) (initial_mapped=1, reason=Index mapped) Dec 16 09:46:31 dovecot: imap(glhk44): Warning: fscking index file /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index Dec 16 09:46:31 dovecot: imap(glhk44): Error: Index /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: Lost log for seq=1268 offset=24900: Failed to map file seq=1268 offset=24900..18446744073709551615 (ret=0) (initial_mapped=1, reason=Index mapped) Dec 16 09:46:31 dovecot: imap(glhk44): Warning: fscking index file /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index Dec 16 09:46:31 dovecot: imap(glhk44): Error: Index /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: Lost log for seq=1268 offset=24900: Failed to map file seq=1268 offset=24900..18446744073709551615 (ret=0) (initial_mapped=1, reason=Index mapped) Dec 16 09:46:31 dovecot: imap(glhk44): Warning: fscking index file /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index Dec 16 09:46:31 dovecot: imap(glhk44): Error: Index /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: Lost log for seq=1268 offset=24900: Failed to map file seq=1268 offset=24900..18446744073709551615 (ret=0) (initial_mapped=1, reason=Index mapped) Dec 16 09:46:31 dovecot: imap(glhk44): Warning: fscking index file /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index Dec 16 09:46:31 dovecot: imap(glhk44): Error: Index /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: Lost log for seq=1268 offset=24900: Failed to map file seq=1268 offset=24900..18446744073709551615 (ret=0) (initial_mapped=1, reason=Index mapped) Dec 16 09:46:31 dovecot: imap(glhk44): Warning: fscking index file /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index Dec 16 09:46:31 dovecot: imap(glhk44): Error: Index /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: Lost log for seq=1268 offset=24900: Failed to map file seq=1268 offset=24900..18446744073709551615 (ret=0) (initial_mapped=1, reason=Index mapped) Dec 16 09:46:31 dovecot: imap(glhk44): Warning: fscking index file /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index Dec 16 09:46:31 dovecot: indexer-worker(glhk44): Indexed 1 messages in Deleted Messages Dec 16 09:46:31 dovecot: imap(glhk44): Error: Index /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: Lost log for seq=1268 offset=24900: Failed to map file seq=1268 offset=24900..18446744073709551615 (ret=0) (initial_mapped=1, reason=Index mapped) Dec 16 09:46:31 dovecot: imap(glhk44): Warning: fscking index file /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index Dec 16 09:46:31 dovecot: imap(glhk44): Error: Index /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: Lost log for seq=1268 offset=24900: Failed to map file seq=1268 offset=24900..18446744073709551615 (ret=0) (initial_mapped=1, reason=Index mapped) Dec 16 09:46:31 dovecot: imap(glhk44): Warning: fscking index file /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index Dec 16 09:46:31 dovecot: imap(glhk44): Logged out in=833 out=13350 Dec 16 09:46:31 dovecot: imap(glhk44): copy from INBOX: box=Deleted Messages, uid=1693, msgid=<1616408.344200011xAAAAA(a)enterprisecommunicationnetwork.com>, size=44739 Dec 16 09:46:31 dovecot: indexer-worker(glhk44): Error: Transaction log file /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.log: marked corrupted Dec 16 09:46:32 dovecot: indexer-worker(glhk44): Indexed 1 messages in Deleted Messages Dec 16 09:46:32 dovecot: imap(glhk44): Error: Corrupted transaction log file /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.log seq 1268: Invalid transaction log size (28960 vs 24900): /home/glhk44/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.log (sync_offset=289 60)

1 0

Configuration problem for secure virtual server
by Karsten Malcher 15 Dec '16

15 Dec '16

Hello, i want to configure a virtual mailsystem on an debian server with exim and dovecot. Because it is running on a V-Server, i want to store everythink in a LUKS encrypted contrainer. So i created a group crypt with the members Debian-exim (107), dovecot, (other users with encrypted content) All mails should be stored in /mail in the mounted container. Dovecot has this configuration: ======================================= passdb { driver = sql args = /etc/dovecot/dovecot-sql.conf } userdb { driver = static args = uid=Debian-exim gid=mail home=/mountpoint/mail/%d/%n } mail_uid = Debian-exim first_valid_uid = 107 last_valid_uid = 107 first_valid_gid = 8 last_valid_gid = 9 mail_location = maildir:/mountpoint/mail/%d/%n ======================================= The /mountpoint has the following rights: drwxrwx--- 5 root crypt 4,0K Dez 13 19:05 mountpoint The subdirectories are all owned by Debian-exim: drwxrwx--- 4 Debian-exim mail 4,0K Okt 23 17:05 mail The group mail has id 8 and the group crypt has id 9 The Problem is that dovecot will not go into the directory with group crypt! I always get the following error message: Dec 15 18:03:25 pop3(karsten@server): Error: user karsten@server: Initialization failed: Initializing mail storage from mail_location setting failed: stat(/mountpoint/mail/server/karsten) failed: Permission denied (euid=107(Debian-exim) egid=8(mail) missing +x perm: /mnt, we're not in group 9(crypt), dir owned by 0:9 mode=0770) Dec 15 18:03:25 pop3(karsten@server): Error: Invalid user settings. Refer to server log for more information. But dovecot is definitely in the group crypt! What i am doing wrong? Regards Karsten

2 3

imap Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 on Fedora 24
by Robert Kudyba 15 Dec '16

15 Dec '16

Seems to be related to https://bugzilla.redhat.com/show_bug.cgi?id=1189198 <https://bugzilla.redhat.com/show_bug.cgi?id=1189198>. Separate note the link to Overview of all dovecot.org mailing lists <http://dovecot.org/mailman/listinfo> http://dovecot.org/mailman/listinfo <http://dovecot.org/mailman/listinfo> is broken as are the images on the page. Here’s the backtrace. dovecot[12438]: imap(username): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x91ab2) [0x7ff01e98cab2] -> /usr/lib64/dovecot/libdovecot.so.0(+0x91bad) [0x7ff01e98cbad] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7ff01e925f41] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xaa1ed) [0x7ff01ecc01ed] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0xd2) [0x7ff01ecc0652] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_get_first_header+0x3d) [0x7ff01ec4c88d] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xbe717) [0x7ff01ecd4717] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xbe952) [0x7ff01ecd4952] -> /usr/lib64/dovecot/libdovecot.so.0(i_stream_read+0x53) [0x7ff01e997653] -> /usr/lib64/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7ff01e99807d] -> /usr/lib64/dovecot/libdovecot.so.0(message_parse_header_next+0x72) [0x7ff01e9748e2] -> /usr/lib64/dovecot/libdovecot.so.0(+0x73d91) [0x7ff01e96ed91] -> /usr/lib64/dovecot/libdovecot.so.0(i_stream_read+0x53) [0x7ff01e997653] -> /usr/lib64/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7ff01e99807d] -> /usr/lib64/dovecot/libdovecot.so.0(message_parse_header_next+0x72) [0x7ff01e9748e2] -> /usr/lib64/dovecot/libdovecot.so.0(message_parse_header+0x4f) [0x7ff01e97527f] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xb0d4b) [0x7ff01ecc6d4b] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xb2e63) [0x7ff01ecc8e63] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x114) [0x7ff01ecc9574] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x22) [0x7ff01ec56d52] -> dovecot/imap(+0x221ff) [0x559b559541ff] -> dovecot/imap(imap_search_start+0xd1) [0x559b559545c1] -> dovecot/imap(cmd_search+0xd3) [0x559b55946063] -> dovecot/imap(command_exec+0xa5) [0x559b5594d5d5] -> dovecot/imap(+0x19852) [0x559b5594b852] -> dovecot/imap(+0x198de) [0x559b5594b8de] -> dovecot/imap(client_handle_input+0x1b5) [0x559b5594bce5] -> dovecot/imap(client_input+0x82) [0x559b5594c262] dovecot[12438]: imap(username): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x91ab2) [0x7f77a0cd7ab2] -> /usr/lib64/dovecot/libdovecot.so.0(+0x91bad) [0x7f77a0cd7bad] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f77a0c70f41] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xaa1ed) [0x7f77a100b1ed] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0xd2) [0x7f77a100b652] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_get_first_header+0x3d) [0x7f77a0f9788d] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xbe717) [0x7f77a101f717] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xbe952) [0x7f77a101f952] -> /usr/lib64/dovecot/libdovecot.so.0(i_stream_read+0x53) [0x7f77a0ce2653] -> /usr/lib64/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7f77a0ce307d] -> /usr/lib64/dovecot/libdovecot.so.0(message_parse_header_next+0x72) [0x7f77a0cbf8e2] -> /usr/lib64/dovecot/libdovecot.so.0(+0x73d91) [0x7f77a0cb9d91] -> /usr/lib64/dovecot/libdovecot.so.0(i_stream_read+0x53) [0x7f77a0ce2653] -> /usr/lib64/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7f77a0ce307d] -> /usr/lib64/dovecot/libdovecot.so.0(message_parse_header_next+0x72) [0x7f77a0cbf8e2] -> /usr/lib64/dovecot/libdovecot.so.0(message_parse_header+0x4f) [0x7f77a0cc027f] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xb0d4b) [0x7f77a1011d4b] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xb2e63) [0x7f77a1013e63] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x114) [0x7f77a1014574] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x22) [0x7f77a0fa1d52] -> dovecot/imap(+0x221ff) [0x563492d1d1ff] -> dovecot/imap(imap_search_start+0xd1) [0x563492d1d5c1] -> dovecot/imap(cmd_search+0xd3) [0x563492d0f063] -> dovecot/imap(command_exec+0xa5) [0x563492d165d5] -> dovecot/imap(+0x19852) [0x563492d14852] -> dovecot/imap(+0x198de) [0x563492d148de] -> dovecot/imap(client_handle_input+0x1b5) [0x563492d14ce5] -> dovecot/imap(client_input+0x82) [0x563492d15262] dovecot --version 2.2.26.0 (23d1de6) dovecot -n # 2.2.26.0 (23d1de6): /etc/dovecot/dovecot.conf # OS: Linux 4.8.4-200.fc24.x86_64 x86_64 Fedora release 24 (Twenty Four) mail_fsync = always mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u mail_nfs_index = yes mail_nfs_storage = yes mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_cipher_list = PROFILE=SYSTEM ssl_key = # hidden, use -P to show it userdb { driver = passwd }

1 0

Maildir: do message files need to have a unique name across all directories?
by Gerben Wierda 15 Dec '16

15 Dec '16

While testing a new mail server I created a temporary account and filled its mailbox (Milder, dovecot) with the contents of another account. That means the actual message files in each account have identical names. Is that a problem? (I’m asking because I see some weird behaviour of visible/invisible messages and I wonder if this could have been the reason). G

2 1