December 2018 - dovecot

Random issue on mailbox "assertion failed"
by Thomas Durand 05 Dec '18

05 Dec '18

Hi, Since few weeks, I have regularly the issue below with some mailboxes - This is happening randomly. Users are complaining emails are not visible. The situation is recovered by removing indexes but I would like to have it fix permanently. Ruuning dovecot 2.2.10 - Anyone to advise me what is wrong ? Thanks. Dec 05 08:03:37 justyna.rezoo.org dovecot[18684]: imap(XXX): Panic: file mail-index-sync-keywords.c: line 227 (keywords_update_records): assertion failed: (data_offset >= sizeof(struct mail_index_record)) Dec 05 08:03:37 justyna.rezoo.org dovecot[18684]: imap(xxx: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x6a06e) [0x7fb890be706e] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6a14e) [0x7fb890be714e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7fb890b9f52c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_keywords+0x808) [0x7fb890f205c8] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_record+0xfd) [0x7fb890f20eed] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x21e) [0x7fb890f21e8e] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_map+0x3e7) [0x7fb890f12b77] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xb937d) [0x7fb890f0e37d] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xb9990) [0x7fb890f0e990] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_open+0x8c) [0x7fb890f0ea7c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_storage_mailbox_open+0x87) [0x7fb890eff9c7] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x4d882) [0x7fb890ea2882] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x4d963) [0x7fb890ea2963] -> /usr/lib64/dovecot/lib20_zlib_plugin.so(+0x2a4c) [0x7fb89018fa4c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x802b4) [0x7fb890ed52b4] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_open+0x20) [0x7fb890ed5430] -> dovecot/imap(cmd_select_full+0x172) [0x7fb8913b0432] -> dovecot/imap(command_exec+0x3c) [0x7fb8913b601c] -> dovecot/imap(+0x17f1f) [0x7fb8913b4f1f] -> dovecot/imap(+0x18005) [0x7fb8913b5005] -> dovecot/imap(client_handle_input+0x14d) [0x7fb8913b52fd] -> dovecot/imap(client_input+0x85) [0x7fb8913b56c5] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7fb890bf7a87] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0xff) [0x7fb890bf890f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fb890bf75d8] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fb890ba49e3] -> dovecot/imap(main+0x2c4) [0x7fb8913a9324] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7fb8907cf3d5] Thomas Durand +336 12 07 31 87 thomas.durand(a)rezoo.org

1 0

Re: Re[2]: BUG: sieve does not set seen-Flag
by Tuomi, Aki 05 Dec '18

05 Dec '18

please send mail to dovecot-unsubscribe(a)dovecot.org Sent from my Samsung Galaxy smartphone. -------- Original message --------From: "Сергей . via dovecot" <dovecot(a)dovecot.org> Date: 05/12/2018 08:26 (GMT+02:00) To: dovecot(a)dovecot.org Subject: Re[2]: BUG: sieve does not set seen-Flag Unsubscribe me please. I've been seeing these messages for several days and don't want anymore. Please. Среда, 5 декабря 2018, 3:22 +03:00 от Ralph Seichter <m16+dovecot(a)monksofcool.net>: * Jakobus Schürz: > 1543935543.M447415P13997.mymail,S=726,W=748:2,Sa > > Then i move this email to another IMAP-Folder, and then there is the > filename > > 1543935543.M447415P13997.mymail,S=726,W=748:2, > > As expected, the seen-flag disappeared... the same as thunderbird > shows. And what about the "dovecot-keywords" files in both folders? Do they match? The letter "a" seems to indicates that there is at least one non-standard flag defined in the source folder's keywords. By the way, can I assume you move messages only by using Thunderbird/IMAP and not by manipulating the file system? Here's how things look on my server: # On arrival (UNSEEN) 1543968031.M941319P5841.foo,S=1390,W=1422:2, # After reading (SEEN) 1543968031.M941319P5841.foo,S=1390,W=1422:2,S # After being moved to another folder (SEEN) 1543968031.M941319P5841.foo,S=1390,W=1422:2,S I can use IMAP search terms SEEN and UNSEEN as indicated above, and I see the same message state displayed in Notmuch mail (my default, it accesses Dovecot's Maildir storage directly) and various IMAP clients connecting to Dovecot. Things are working just fine here. -Ralph -- Сергей .

2 1

Lda fatal: setgid (102 from userdb lookup) failed
by James Brown 05 Dec '18

05 Dec '18

Sorry if this is a nubbie question, but I’m getting: lda(jlbrown(a)bordo.com.au)<4444><QFg5KRHVBBxcEQAAYBwt+A>: Fatal: setgid(102 from userdb lookup) failed with euid=501(jlbrown), gid=20(staff), egid=20(staff): Operation not permitted (This binary should probably be called with process group set to 102 instead of 20(staff)) How can I fix this? (macOS Mojave, Dovecot 2.3.4) Thanks, James.

2 2

Compilation error
by Joan Moreau 04 Dec '18

04 Dec '18

Hi USing git, I reach the following error (below). Here is my configure parameters : CPPFLAGS="-I/include -I/usr/include/tirpc/" LDFLAGS="-L/lib -ltirpc" ./configure --prefix=/usr --sysconfdir=/etc --localstatedir=/var --libexec=/usr/libexec --with-sql=yes --without-sqlite --with-mysql --with-ssl --without-shadow --without-nss --without-pam --without-ldap --with-zlib --with-bzlib --with-libwrap --with-libcap --without-solr --without-gssapi --without-docs --without-sia --without-pgsql --without-lucene --without-stemmer THanks libtool: link: gcc -std=gnu99 -g -O2 -fstack-protector-strong -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -mfunction-return=thunk -mindirect-branch=thunk -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -Wl,--as-needed -o test-lib test_lib-test-lib.o test_lib-test-array.o test_lib-test-aqueue.o test_lib-test-base32.o test_lib-test-base64.o test_lib-test-bits.o test_lib-test-bsearch-insert-pos.o test_lib-test-buffer.o test_lib-test-byteorder.o test_lib-test-crc32.o test_lib-test-data-stack.o test_lib-test-event-filter.o test_lib-test-event-log.o test_lib-test-failures.o test_lib-test-file-create-locked.o test_lib-test-guid.o test_lib-test-hash.o test_lib-test-hash-format.o test_lib-test-hash-method.o test_lib-test-hmac.o test_lib-test-hex-binary.o test_lib-test-imem.o test_lib-test-ioloop.o test_lib-test-iso8601-date.o test_lib-test-iostream-pump.o test_lib-test-iostream-proxy.o test_lib-test-iostream-temp.o test_lib-test-istream.o test_lib-test-istream-base64-decoder.o test_lib-test-istream-base64-encoder.o test_lib-test-istream-chain.o test_lib-test-istream-concat.o test_lib-test-istream-crlf.o test_lib-test-istream-failure-at.o test_lib-test-istream-jsonstr.o test_lib-test-istream-multiplex.o test_lib-test-istream-seekable.o test_lib-test-istream-sized.o test_lib-test-istream-tee.o test_lib-test-istream-try.o test_lib-test-istream-unix.o test_lib-test-json-parser.o test_lib-test-json-tree.o test_lib-test-lib-signals.o test_lib-test-llist.o test_lib-test-log-throttle.o test_lib-test-malloc-overflow.o test_lib-test-memarea.o test_lib-test-mempool.o test_lib-test-mempool-allocfree.o test_lib-test-mempool-alloconly.o test_lib-test-pkcs5.o test_lib-test-net.o test_lib-test-numpack.o test_lib-test-ostream-buffer.o test_lib-test-ostream-failure-at.o test_lib-test-ostream-file.o test_lib-test-ostream-multiplex.o test_lib-test-multiplex.o test_lib-test-path-util.o test_lib-test-primes.o test_lib-test-printf-format-fix.o test_lib-test-priorityq.o test_lib-test-random.o test_lib-test-seq-range-array.o test_lib-test-stats-dist.o test_lib-test-str.o test_lib-test-strescape.o test_lib-test-strfuncs.o test_lib-test-strnum.o test_lib-test-str-find.o test_lib-test-str-sanitize.o test_lib-test-str-table.o test_lib-test-time-util.o test_lib-test-unichar.o test_lib-test-utc-mktime.o test_lib-test-uri.o test_lib-test-var-expand.o test_lib-test-wildcard-match.o -L/lib ../lib-test/.libs/libtest.a ./.libs/liblib.a -ltirpc -lm /usr/bin/ld: test_lib-test-lib.o:(.data.rel.ro+0x108): undefined reference to `test_connection' collect2: error: ld returned 1 exit status make[4]: *** [Makefile:1211: test-lib] Error 1 make[4]: Leaving directory '/usr/src/dovecot/src/lib' make[3]: *** [Makefile:1152: all] Error 2 make[3]: Leaving directory '/usr/src/dovecot/src/lib' make[2]: *** [Makefile:564: all-recursive] Error 1 make[2]: Leaving directory '/usr/src/dovecot/src' make[1]: *** [Makefile:682: all-recursive] Error 1 make[1]: Leaving directory '/usr/src/dovecot' make: *** [Makefile:526: all] Error 2

2 2

dovecot and argon2 encryption
by Jerry 04 Dec '18

04 Dec '18

I am using a FreeBSD 11-2 amd/64 system with dovecot version 2.3.4 installed. I was playing around with different encryption schemes. doveadm pw -l SHA1 SSHA512 BLF-CRYPT PLAIN HMAC-MD5 OTP SHA512 SHA RPA DES-CRYPT CRYPT SSHA MD5-CRYPT SKEY PLAIN-MD4 PLAIN-MD5 SCRAM-SHA-1 LANMAN SHA512-CRYPT CLEAR CLEARTEXT SSHA256 NTLM MD5 PBKDF2 SHA256 CRAM-MD5 PLAIN-TRUNC SHA256-CRYPT SMD5 DIGEST-MD5 LDAP-MD5 There is no mention of "argon2" shown. Now, from the command line I can enter this command: ~ $ echo -n "Secret-Password" | argon2 somesalt Type: Argon2i Iterations: 3 Memory: 4096 KiB Parallelism: 1 Hash: e6432f595e999988c7c54c30d530b0fc7d9953510e5ccf295359258f4ea22a3d Encoded: $argon2i$v=19$m=4096,t=3,p=1$c29tZXNhbHQ$5kMvWV6ZmYjHxUww1TCw/H2ZU1EOXM8pU1klj06iKj0 0.039 seconds Verification ok However, this fails: doveadm pw -p "Secret-Password" -s argon2 Fatal: Unknown scheme: ARGON2 I have tried different ways to enter "argon2", but nothing works. Can someone tell me what I am doing wrong? Thanks :) -- Jerry

3 3

Panic: file dsync-brain-mailbox-tree.c: line 448: unreached
by Marc Weustink 04 Dec '18

04 Dec '18

Hi all, To backup our imap folders I've a cronjob running in the night: /usr/bin/doveadm -o stats_writer_socket_path= backup -R -A -N tcp:xxx.yyy.zzz:4191 This ran successful when I set it up and didn't look at it anymore. Recently I noticed errors: dsync-local(administration)<uO/qHjXS6FteLAAA3i05xw>: Panic: file dsync-mailbox-tree-sync.c: line 1253 (sync_create_mailboxes): assertion failed: (node->ns == other_node->ns) dsync-local(administration)<uO/qHjXS6FteLAAA3i05xw>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xcceca) [0x7f7029099eca] -> /usr/lib/dovecot/libdovecot.so.0(+0xccf21) [0x7f7029099f21] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f7029006f44] -> /usr/bin/doveadm(+0x5206c) [0x558ba9fec06c] -> /usr/bin/doveadm(dsync_mailbox_trees_sync_init+0x2a2) [0x558ba9fedba2] -> /usr/bin/doveadm(dsync_brain_recv_mailbox_tree_deletes+0x246) [0x558ba9fdf6d6] -> /usr/bin/doveadm(dsync_brain_run+0x5b8) [0x558ba9fdbec8] -> /usr/bin/doveadm(+0x42260) [0x558ba9fdc260] -> /usr/bin/doveadm(+0x585bf) [0x558ba9ff25bf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f70290b2029] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7f70290b3959] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f70290b2132] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f70290b2348] -> /usr/bin/doveadm(+0x27e39) [0x558ba9fc1e39] -> /usr/bin/doveadm(+0x2a3c7) [0x558ba9fc43c7] -> /usr/bin/doveadm(+0x2b1f6) [0x558ba9fc51f6] -> /usr/bin/doveadm(doveadm_mail_try_run+0x1fa) [0x558ba9fc597a] -> /usr/bin/doveadm(main+0x45b) [0x558ba9fb4ceb] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7f702891a830] -> /usr/bin/doveadm(_start+0x29) [0x558ba9fb4e69] Aborted (core dumped) I've added the dovecot repo to get dovecot automatically updated, so I cannot tell with which version it started. my doveconf -n: [sudo] password for infraadmin: # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.3 (f018bbab) # OS: Linux 4.4.0-137-generic x86_64 Ubuntu 16.04.5 LTS autofs # Hostname: xxx.xxx.xxx dict { acl = pgsql:/etc/dovecot/dovecot-dict-sql-local.conf.ext } doveadm_password = # hidden, use -P to show it mail_debug = yes mail_gid = vmail mail_home = /home/mail/backup/%n mail_location = maildir:/home/mail/backup/%n/mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } namespace public { location = maildir:/home/mail/backup/Common/mail:INDEXPVT=/home/mail/backup/%n/mail/common prefix = Common/ separator = / subscriptions = no type = public } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = " sieve" service auth { unix_listener auth-userdb { mode = 0777 } } service dict { unix_listener dict { group = vmail user = vmail } } ssl = no userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql }

1 1

Sieve scripts not backed up
by Marc Weustink 04 Dec '18

04 Dec '18

(now from my subscribed account) Hi all. I try to backup out sieve scripts through doveadm -o stats_writer_socket_path= backup -R -u marc -N tcp:<remote.host>:4191 All mail is backed up but no scripts. What am I doing wrong ? Thanks Marc doveconf -n # 2.3.4 (0ecbaf23d): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 (60b0f48d) # OS: Linux 4.4.0-137-generic x86_64 Ubuntu 16.04.5 LTS autofs # Hostname: xxx dict { acl = pgsql:/etc/dovecot/dovecot-dict-sql-local.conf.ext } doveadm_password = # hidden, use -P to show it mail_debug = yes mail_gid = vmail mail_home = /home/mail/backup/%n mail_location = maildir:/home/mail/backup/%n/mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace Shared { location = maildir:/home/mail/backup/Common/mail:INDEXPVT=/home/mail/backup/%n/mail/common prefix = Shared/ separator = / subscriptions = no type = public } namespace Users { list = children location = maildir:/home/mail/backup/%%n/mail:INDEXPVT=/home/mail/backup/%n/mail/shared/%%n prefix = Users/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = sieve service auth { unix_listener auth-userdb { mode = 0777 } } service dict { unix_listener dict { group = vmail user = vmail } } ssl = no userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql }

1 0

Log synchronization error
by Jakobus Schürz 04 Dec '18

04 Dec '18

Hi there! I've installed dovecot for debian from the dovecot-repo in the latest Version 2:2.3.4-2~stretch And i still get this error-messages. dovecot[5817]: imap(user.name)<26484><nzUgti58YaEuffpZ>: Error: Log synchronization error at seq=4,offset=5748 for /var/lib/dovecot/db/indexes/Maildir/user.name/Trash/dovecot.index: Append with UID 202, but next_uid = 203 I read in the release-notes, that doveadm force-resync can solve this problem... But it didn't I ran the command on all Mailboxes, but deleting a message in Thunderbird (= moving it into Trash) causes the error above. Do you need further informations? BG jakob

1 0

Mailing list address harvested for spamming
by dovecot-e51＠deemzed.uk 03 Dec '18

03 Dec '18

Not to stir the pot, but I notice my email address has recently been harvested from this list for spamming purposes. This email address is unique and not used for anything else. I'd distinguish this from spam sent to the mailing list itself, which is obviously different. Is there anything further that could be done to prevent this? -- Dave

10 19

Relocate subfolders to different mount point
by Marc Roos 03 Dec '18

03 Dec '18

I would like to relocate the subfolders of the Sent folder to a different location. Now send messages mail is stored in mbox format at the location /home/users/testuser/mail/.Sent. I would like to store the subfolders Sent/2017 and Sent/2018 at the location /home/archive/users/testuser/.Sent.2017 and /home/archive/users/testuser/.Sent.2018 Is this even possible? I am using currently using this mail_location: mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u:CONTROL=~/mail/control:INDEX=/var/d ovecot/%u/index:LAYOUT=maildir++ /var/dovecot is on a ssd /var/spool/mail is on sda ~/mail is on sdb with these folders [@mail]# ls -ac1 .folderc .Drafts .foldera control .Trash.folderc .folderb .Sent .Sent.2018 .Trash

2 3