- dovecot - dovecot.org

sql delete problem
by Tóth Csaba 24 Jan '16

24 Jan '16

Dear List! I have a dovecot installment with postgresql based user management. My problem is i see this in postgresql's log file: root@c13:/var/lib/postgresql/9.4/main/pg_log# cat postgresql-2016-01-24_12.log | grep 26105 2016-01-24 16:34:43 CET [26105-1] maildata@mail ERROR: permission denied for relation i3sysadm_email_account 2016-01-24 16:34:43 CET [26105-2] maildata@mail STATEMENT: DELETE FROM i3sysadm_email_account WHERE userid = 'account(a)mydomain.com' This is the error message from dovecot side (i have a lot, so this is from another date): root@c10:/var/log/dovecot# cat mail.log | grep "Jan 24 17:41:29" Jan 24 17:41:29 dict: Info: pgsql(127.0.0.1): Disconnected from database, retrying commit Jan 24 17:41:29 dict: Error: sql dict: commit failed: ERROR: permission denied for relation i3sysadm_email_account (query: DELETE FROM i3sysadm_email_account WHERE userid = 'account(a)mydomain.com') Why the hack dovecot want to delete my e-mail account? Luckily it don't have the permission.. I tried to look in the source code for "delete from", but founded just a general sql handle method. One possiblity is dovecot try to delete a cascaded information, but what can it be? Please help, how can i fix this. Thanks in advance, Csaba root@c10:/var/log/dovecot# dovecot --version 2.2.9 root@c10:/var/log/dovecot# dovecot -n # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-44-generic x86_64 Ubuntu 14.10 auth_cache_negative_ttl = 0 auth_failure_delay = 3 secs auth_master_user_separator = * auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb base_dir = /var/run/dovecot/ dict { expire = sqlite:/etc/dovecot/dovecot-dict-sql.conf.ext quota = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_uid = 5000 hostname = mail.mydomain.com lda_mailbox_autocreate = yes listen = 87.229.104.6, :: lmtp_rcpt_check_quota = yes log_path = /var/log/dovecot/mail.log login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c login_trusted_networks = 192.168.0.0/24 mail_access_groups = dovenull mail_gid = dovenull mail_location = sdbox:~/sdbox mail_plugins = quota mail_uid = dovenull managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes quota = dict:User quota::proxy::quota quota_grace = 10%% quota_rule = *:storage=100M recipient_delimiter = + sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve pop3" service auth-postlogin { executable = script-login /etc/dovecot/update_date_smtp.sh user = $default_internal_user } service auth-worker { unix_listener auth-worker { group = $default_internal_user mode = 0660 user = dovecot } user = $default_internal_user } service auth { executable = auth auth-postlogin unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } user = $default_internal_user } service dict { unix_listener dict { group = $default_internal_user mode = 0666 user = $default_internal_user } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service imap-postlogin { executable = script-login /etc/dovecot/update_date_imap.sh user = $default_internal_user } service imap { executable = imap imap-postlogin } service lmtp { executable = lmtp -L inet_listener lmtp { address = 127.0.0.1 port = 24 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3-postlogin { executable = script-login /etc/dovecot/update_date_pop3.sh user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin } shutdown_clients = no ssl_cert = </etc/dovecot/dovecot.pem ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM ssl_key = </etc/dovecot/private/dovecot.pem ssl_protocols = !SSLv2 !SSLv3 submission_host = 127.0.0.1:25 userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { info_log_path = /var/log/dovecot/lmtp.log mail_plugins = quota quota sieve postmaster_address = postmaster(a)mydomain.com } protocol lda { mail_plugins = quota sieve } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 mail_plugins = quota imap_quota } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } root@c10:/etc/dovecot# grep -v '^ *$#.*$\?$' dovecot-sql.conf.ext driver = pgsql connect = host=127.0.0.1 port=5432 dbname=mail user=maildata password=* default_pass_scheme = SSHA512 user_query = SELECT userdb_home AS home, userdb_uid AS uid, userdb_gid AS gid, \ mail_location AS mail, quota_rule \ FROM i3sysadm_email_account WHERE userid = '%Lu' AND active is true AND active_domain is true password_query = SELECT userid AS user, password, \ userdb_home, userdb_uid, userdb_gid, \ mail_location, quota_rule \ FROM i3sysadm_email_account WHERE userid = '%Lu' \ and active IS true AND active_domain IS true iterate_query = SELECT userid FROM i3sysadm_email_account \ WHERE active IS true AND active_domain IS true

2 1

How to skip errors on doveadm backup for migration ?
by Christoph Adomeit 24 Jan '16

24 Jan '16

Hi there, I have to migrate data out of a very old (debian 4) and buggy cyrus mailserver. About 40 Users with 200000 Messages each. Doveadm backup works quite well and gives me most of the mails. About every 100.000 Mail cannot be exported by cyrus. I do not want to bother about these errors. Maybe it is filesystem, maybe it is memory leak, or cyrus bug or whatever. My problem is that doveadm backup exits with an error if it cannot read a mail. Is there some way or option to make doveadm backup just skip the errors and continue with the next message ? I want to use doveadm sync because it preserves the uids of the mails. Imapsync works great but does not prserve uids. cyrus2dovecot is not an option because it does not work incremental and conversion would take far too long. Any ideas what I can do ? Thanks Christoph

3 5

Sieve "foreverypart" and "mime" extensions (RFC 5703) now implemented
by Stephan Bosch 24 Jan '16

24 Jan '16

Hi, I have finally managed to implement the Sieve "foreverypart" and "mime" extensions (RFC 5703). These are now included in the main Mercurial repository and will be included in the next release. I will be fixing a few minor details in the coming week; e.g., interaction with "include" and "editheader" extensions needs more work. Still, in the mean time, those of you who are interested can already test this feature a bit. It is not a small feature, so knowing bugs early is helpful. You can install it from the Mercurial repository or get the latest Debian packages from Xi. When I finish the last details (probably next week), I will release a first RC version of Pigeonhole v0.4.10 right away. Regards, Stephan.

2 2

Segfault in acl_mailbox_get_aclobj w/ dovecot
by D[r]eadlock M 23 Jan '16

23 Jan '16

Hello, I've being trying to play with shared mailboxes but experienced a segfault: [New LWP 9611] Core was generated by `dovecot/imap'. Program terminated with signal SIGSEGV, Segmentation fault. (gdb) bt f #0 0x00007f5b72f429b2 in acl_mailbox_get_aclobj (box=<optimized out>) at acl-mailbox.c:31 abox = 0x0 #1 0x00007f5b72d30fcc in cmd_myrights (cmd=0x7f5b75c97480) at imap-acl-plugin.c:331 ns = <optimized out> box = 0x7f5b75ca4520 mailbox = 0x7f5b75c752a8 "shared" orig_mailbox = 0x7f5b75c80be0 "shared" rights = 0x7f5b75c75108 str = <optimized out> #2 0x00007f5b73f2e09c in command_exec (cmd=cmd@entry=0x7f5b75c97480) at imap-commands.c:158 hook = 0x7f5b75c7e0f0 ret = <optimized out> #3 0x00007f5b73f2cfb2 in client_command_input (cmd=0x7f5b75c97480) at imap-client.c:778 client = 0x7f5b75c96880 command = <optimized out> __FUNCTION__ = "client_command_input" #4 0x00007f5b73f2d066 in client_command_input (cmd=0x7f5b75c97480) at imap-client.c:839 client = 0x7f5b75c96880 command = <optimized out> __FUNCTION__ = "client_command_input" #5 0x00007f5b73f2d39d in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x7f5b75c96880) at imap-client.c:877 No locals. #6 client_handle_input (client=0x7f5b75c96880) at imap-client.c:889 _data_stack_cur_id = 3 remove_io = false handled_commands = true client = 0x7f5b75c96880 #7 0x00007f5b73f2d745 in client_input (client=0x7f5b75c96880) at imap-client.c:931 cmd = 0x9f3f2 output = 0x7f5b75c972c0 bytes = 95 __FUNCTION__ = "client_input" #8 0x00007f5b73773d0f in io_loop_call_io (io=0x7f5b75c97390) at ioloop.c:441 ioloop = 0x7f5b75c7d740 t_id = 2 __FUNCTION__ = "io_loop_call_io" #9 0x00007f5b73774d09 in io_loop_handler_run_internal (ioloop=ioloop@entry=0x7f5b75c7d740) at ioloop-epoll.c:220 ctx = 0x7f5b75c7e3d0 io = <optimized out> tv = {tv_sec = 1799, tv_usec = 999014} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 j = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #10 0x00007f5b73773d79 in io_loop_handler_run (ioloop=ioloop@entry=0x7f5b75c7d740) at ioloop.c:488 No locals. #11 0x00007f5b73773df8 in io_loop_run (ioloop=0x7f5b75c7d740) at ioloop.c:465 __FUNCTION__ = "io_loop_run" #12 0x00007f5b7371edc3 in master_service_run (service=0x7f5b75c7d5d0, callback=<optimized out>) at master-service.c:566 No locals. #13 0x00007f5b73f21254 in main (argc=1, argv=0x7f5b75c7d390) at main.c:400 set_roots = {0x7f5b74145980 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0x7f5b75c75048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x7f5b73f371f0 <login_client_connected>, failure_callback = 0x7f5b73f36ed0 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> It happens when my client (mutt) tries to enter the shared/ folder. A filtered strace shows (note the 7 seconds between write and read, presumely the command sent by mutt): 8704 00:40:51.420843 open("/var/vmail/domain.tld/marc/Maildir/.Sent/dovecot-acl", O_RDONLY) = -1 ENOENT (No such file or directory) 8704 00:40:51.420978 stat("/var/vmail/domain.tld/marc/Maildir/dovecot-acl", 0x7fffc618dcb0) = -1 ENOENT (No such file or directory) 8704 00:40:51.421100 open("/var/vmail/domain.tld/shared-mailboxes", O_RDONLY) = 4 8704 00:40:51.421800 openat(AT_FDCWD, "/var/vmail/domain.tld/marc/Maildir", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 12 8704 00:40:51.422217 write(7, "* LIST (\\HasNoChildren \\Sent) \"/\" Sent\r\n* LIST (\\Noselect \\HasNoChildren) \"/\" shared\r\n* LIST (\\HasNoChildren) \"/\" INBOX\r\na0005 OK List completed.\r\n", 147) = 147 8704 00:40:58.235762 <... read resumed> "a0006 MYRIGHTS \"shared\"\r\na0007 STATUS \"Drafts\" (MESSAGES)\r\na0008 SELECT \"shared\"\r\n", 8137) = 82 I admit I've played a little with directories in /var/vmail/ and got a few 'permission denied' but I think I fixed them correctly (move /var/mail/domain.tld/marc into .../Maildir, who ended being root:root) To finish, my dovecot -n: # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.2 mail_location = maildir:~/Maildir mail_plugins = acl namespace { location = maildir:%%h/Maildir:INDEXPVT=~/Maildir/shared/%%n prefix = shared/%%n/ separator = / type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = scheme=SHA512-CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { acl = vfile acl_shared_dict = file:/var/vmail/%d/shared-mailboxes } protocols = " imap lmtp" service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } ssl = required ssl_cert = </etc/letsencrypt/live/domain.tld/fullchain.pem ssl_key = </etc/letsencrypt/live/domain.tld/privkey.pem userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/%n driver = static } userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/shared/%n driver = static } protocol imap { mail_plugins = acl imap_acl } Thanks, Marc

2 1

2.2.21 imap crash - autoexpunge related?
by Robert Blayzor 22 Jan '16

22 Jan '16

dovecot --version 2.2.21 (5345f22) FreeBSD 10.2-RELEASE-p10 FreeBSD 10.2-RELEASE-p10 #0 r294322M: having repeated core dumps on imap process… autoexpunge issue? GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Core was generated by `imap'. Program terminated with signal 11, Segmentation fault. Reading symbols from /usr/local/lib/dovecot/libdovecot-storage.so.0...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /usr/local/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot.so.0 Reading symbols from /lib/libc.so.7...done. Loaded symbols for /lib/libc.so.7 Reading symbols from /usr/local/lib/dovecot/lib10_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/lib10_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/lib11_imap_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/lib11_imap_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/lib20_zlib_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/lib20_zlib_plugin.so Reading symbols from /lib/libz.so.6...done. Loaded symbols for /lib/libz.so.6 Reading symbols from /usr/lib/libbz2.so.4...done. Loaded symbols for /usr/lib/libbz2.so.4 Reading symbols from /usr/lib/liblzma.so.5...done. Loaded symbols for /usr/lib/liblzma.so.5 Reading symbols from /libexec/ld-elf.so.1...done. Loaded symbols for /libexec/ld-elf.so.1 #0 0x0000000010cf9730 in o_stream_get_buffer_used_size (stream=0x0) at ostream.c:198 198 ostream.c: No such file or directory. in ostream.c (gdb) bt full #0 0x0000000010cf9730 in o_stream_get_buffer_used_size (stream=0x0) at ostream.c:198 _stream = (const struct ostream_private *) 0xd #1 0x0000000000435ac9 in notify_ok (mailbox=0x118e1c40, text=0x118063a8 "Stale mailbox lock file detected, will override in 0 seconds", context=0x11845840) at mail-storage-callbacks.c:13 client = (struct client *) 0x11845840 #2 0x000000001096f4e4 in index_storage_lock_notify (box=0x118e1c40, notify_type=MAILBOX_LOCK_NOTIFY_MAILBOX_OVERRIDE, secs_left=0) at index-storage.c:137 ibox = (struct index_mailbox_context *) 0x118e20b0 storage = (struct mail_storage *) 0x11873640 str = 0x118063a8 "Stale mailbox lock file detected, will override in 0 seconds" now = 1453427588 #3 0x00000000108fbedd in dotlock_callback (secs_left=0, stale=true, context=0x118e1c40) at maildir-uidlist.c:250 box = (struct mailbox *) 0x118e1c40 #4 0x0000000010ccba7c in dotlock_create (dotlock=0x118a8140, flags=DOTLOCK_CREATE_FLAG_NONBLOCK, write_pid=true, lock_path_r=0x7fffffffe4e0) at file-dotlock.c:549 secs_left = 0 set = (const struct dotlock_settings *) 0x118a8140 lock_path = 0x11806220 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist.lock" lock_info = {set = 0x118a8140, path = 0x118b59c0 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist", lock_path = 0x11806220 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist.lock", temp_path = 0x0, fd = -1, lock_info = {dev = 0, ino = 0, size = 0, ctime = 0, mtime = 0}, file_info = {dev = 0, ino = 0, size = 0, ctime = 0, mtime = 0}, last_pid_check = 0, last_change = 0, wait_usecs = 0, have_pid = 0, pid_read = 0, use_io_notify = 1, lock_stated = 1} st = {st_dev = 1, st_ino = 32767, st_mode = 0, st_nlink = 0, st_uid = 0, st_gid = 0, st_rdev = 0, st_atim = {tv_sec = 140737488348216, tv_nsec = 140737488347840}, st_mtim = {tv_sec = 12884901898, tv_nsec = 140737488348320}, st_ctim = {tv_sec = 167, tv_nsec = 0}, st_size = 275162112, st_blocks = 140737488348192, st_blksize = 275046283, st_flags = 0, st_gen = 4294960312, st_lspare = 32767, st_birthtim = {tv_sec = 140737488348216, tv_nsec = 277283844}} stale_notify_threshold = 60 change_secs = 1453427588 wait_left = 2841539708 now = 1453427588 max_wait_time = 0 last_notify = 1453427588 prev_last_change = 0 prev_wait_update = 0 tmp_path = (string_t *) 0x11806270 ret = 0 do_wait = false #5 0x0000000010ccaf87 in file_dotlock_create_real (dotlock=0x118a8140, flags=DOTLOCK_CREATE_FLAG_NONBLOCK) at file-dotlock.c:629 lock_path = 0x11806220 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist.lock" st = {st_dev = 284562744, st_ino = 0, st_mode = 58544, st_nlink = 65535, st_uid = 32767, st_gid = 282105456, st_rdev = 0, st_atim = {tv_sec = 140737488290687, tv_nsec = 50}, st_mtim = {tv_sec = 294345152, tv_nsec = 293746112}, st_ctim = {tv_sec = 284562744, tv_nsec = 294345152}, st_size = 140737488348368, st_blocks = 281883903, st_blksize = 96, st_flags = 0, st_gen = 293746112, st_lspare = 0, st_birthtim = {tv_sec = 140737488348416, tv_nsec = 281819373}} fd = 0 ret = 50 #6 0x0000000010ccae76 in file_dotlock_create (set=0x118dd138, path=0x118235c0 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist", flags=DOTLOCK_CREATE_FLAG_NONBLOCK, dotlock_r=0x118dd168) at file-dotlock.c:673 _data_stack_cur_id = 5 dotlock = (struct dotlock *) 0x118a8140 ret = 0 #7 0x00000000108fb891 in maildir_uidlist_lock_timeout (uidlist=0x118dd100, nonblock=true, refresh=true, refresh_when_locked=true) at maildir-uidlist.c:160 box = (struct mailbox *) 0x118e1c40 perm = (const struct mailbox_permissions *) 0x118e1e10 path = 0x118235c0 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist" old_mask = 63 dotlock_flags = DOTLOCK_CREATE_FLAG_NONBLOCK i = 0 ---Type <return> to continue, or q <return> to quit--- ret = -5216 #8 0x00000000108fe066 in maildir_uidlist_sync_lock (uidlist=0x118dd100, sync_flags=MAILDIR_UIDLIST_SYNC_TRYLOCK, locked_r=0x7fffffffe617) at maildir-uidlist.c:1608 nonblock = true refresh = true ret = -5184 #9 0x00000000108fdd86 in maildir_uidlist_sync_init (uidlist=0x118dd100, sync_flags=MAILDIR_UIDLIST_SYNC_TRYLOCK, sync_ctx_r=0x118061b8) at maildir-uidlist.c:1638 ctx = (struct maildir_uidlist_sync_ctx *) 0x118061b8 locked = false ret = 4 #10 0x00000000108fa021 in maildir_sync_context (ctx=0x11806188, forced=false, find_uid=0x0, lost_files_r=0x7fffffffe71f) at maildir-sync.c:871 sync_flags = MAILDIR_UIDLIST_SYNC_TRYLOCK flags = 4294960816 new_changed = true cur_changed = true lock_failure = false fname = 0x7fffffffe5a0 "àåÿÿÿ\177" why = 36 ret = 1 #11 0x00000000108f9400 in maildir_sync_run (mbox=0x118e1c40, flags=68, force_resync=false, uid=0x0, lost_files_r=0x7fffffffe71f) at maildir-sync.c:1023 _data_stack_cur_id = 4 ctx = (struct maildir_sync_context *) 0x11806188 retry = false lost_files = false ret = 294526016 #12 0x00000000108f96b0 in maildir_storage_sync_init (box=0x118e1c40, flags=68) at maildir-sync.c:1096 mbox = (struct maildir_mailbox *) 0x118e1c40 lost_files = false force_resync = false ret = 0 #13 0x00000000108b75b9 in mailbox_sync_init (box=0x118e1c40, flags=68) at mail-storage.c:1657 _data_stack_cur_id = 3 ctx = (struct mailbox_sync_context *) 0xc #14 0x00000000108b6891 in mailbox_sync (box=0x118e1c40, flags=68) at mail-storage.c:1705 ctx = (struct mailbox_sync_context *) 0x206 status = {sync_delayed_expunges = 1} #15 0x00000000108a6e65 in mailbox_autoexpunge (box=0x118e1c40, expire_time=1450835588) at mail-autoexpunge.c:29 t = (struct mailbox_transaction_context *) 0x11873640 mail = (struct mail *) 0x118e1c40 metadata = {guid = '\0' <repeats 15 times>, virtual_size = 0, physical_size = 0, first_save_date = 1450835021, cache_fields = 0x0, precache_fields = 0, backend_ns_prefix = 0x0, backend_ns_type = 0} hdr = (const struct mail_index_header *) 0x118b7f10 seq = 0 timestamp = 140737488349168 ret = 0 #16 0x00000000108a6d54 in mail_namespace_autoexpunge (ns=0x118a6020) at mail-autoexpunge.c:76 box_set__foreach_end = (const void *) 0x118b73f0 box_set = (struct mailbox_settings * const *) 0x118b73d8 box = (struct mailbox *) 0x118e1c40 ---Type <return> to continue, or q <return> to quit--- expire_time = 1450835588 #17 0x00000000108a6c54 in mail_user_autoexpunge (user=0x118b6040) at mail-autoexpunge.c:91 ns = (struct mail_namespace *) 0x118a6020 #18 0x00000000108c1b62 in mail_user_unref (_user=0x118458d0) at mail-user.c:167 user = (struct mail_user *) 0x118b6040 #19 0x00000000004216b4 in client_default_destroy (client=0x11845840, reason=0x0) at imap-client.c:390 cmd = (struct client_command_context *) 0x435c47 #20 0x000000000041f53d in client_destroy (client=0x11845840, reason=0x0) at imap-client.c:263 No locals. #21 0x000000000041eccb in client_input (client=0x11845840) at imap-client.c:1121 cmd = (struct client_command_context *) 0x2118401a0 output = (struct ostream *) 0x0 bytes = 11 #22 0x0000000010ce738f in io_loop_call_io (io=0x1187c240) at ioloop.c:559 ioloop = (struct ioloop *) 0x11821080 t_id = 2 #23 0x0000000010cea343 in io_loop_handler_run_internal (ioloop=0x11821080) at ioloop-kqueue.c:151 ctx = (struct ioloop_handler_context *) 0x118190a0 events = (struct kevent *) 0x1187d000 event = (const struct kevent *) 0x1187d000 tv = {tv_sec = 1799, tv_usec = 999920} ts = {tv_sec = 1799, tv_nsec = 999920000} io = (struct io_file *) 0x1187c240 events_count = 5 ret = 1 i = 0 #24 0x0000000010ce791e in io_loop_handler_run (ioloop=0x11821080) at ioloop.c:607 No locals. #25 0x0000000010ce773f in io_loop_run (ioloop=0x11821080) at ioloop.c:583 No locals. #26 0x0000000010c41aab in master_service_run (service=0x1181b140, callback=0x436ab0 <client_connected>) at master-service.c:640 No locals. #27 0x00000000004363c3 in main (argc=2, argv=0x7fffffffeba8) at main.c:442 set_roots = {0x441248, 0x0} login_set = {auth_socket_path = 0x11806040 "x`\200\021", postlogin_socket_path = 0x11806078 "", postlogin_timeout_secs = 60, callback = 0x436760 <login_client_connected>, failure_callback = 0x436a20 <login_client_failed>, request_auth_token = 1} service_flags = MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = -1 (gdb) For comparison crash on another server, similar: GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Core was generated by `imap'. Program terminated with signal 11, Segmentation fault. Reading symbols from /usr/local/lib/dovecot/libdovecot-storage.so.0...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /usr/local/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot.so.0 Reading symbols from /lib/libc.so.7...done. Loaded symbols for /lib/libc.so.7 Reading symbols from /usr/local/lib/dovecot/lib10_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/lib10_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/lib11_imap_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/lib11_imap_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/lib20_zlib_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/lib20_zlib_plugin.so Reading symbols from /lib/libz.so.6...done. Loaded symbols for /lib/libz.so.6 Reading symbols from /usr/lib/libbz2.so.4...done. Loaded symbols for /usr/lib/libbz2.so.4 Reading symbols from /usr/lib/liblzma.so.5...done. Loaded symbols for /usr/lib/liblzma.so.5 Reading symbols from /libexec/ld-elf.so.1...done. Loaded symbols for /libexec/ld-elf.so.1 #0 0x0000000010cf9730 in o_stream_get_buffer_used_size (stream=0x0) at ostream.c:198 198 ostream.c: No such file or directory. in ostream.c (gdb) bt full #0 0x0000000010cf9730 in o_stream_get_buffer_used_size (stream=0x0) at ostream.c:198 _stream = (const struct ostream_private *) 0xd #1 0x0000000000435ac9 in notify_ok (mailbox=0x118e1c40, text=0x118063a8 "Stale mailbox lock file detected, will override in 0 seconds", context=0x11845840) at mail-storage-callbacks.c:13 client = (struct client *) 0x11845840 #2 0x000000001096f4e4 in index_storage_lock_notify (box=0x118e1c40, notify_type=MAILBOX_LOCK_NOTIFY_MAILBOX_OVERRIDE, secs_left=0) at index-storage.c:137 ibox = (struct index_mailbox_context *) 0x118e20b0 storage = (struct mail_storage *) 0x11873640 str = 0x118063a8 "Stale mailbox lock file detected, will override in 0 seconds" now = 1453448110 #3 0x00000000108fbedd in dotlock_callback (secs_left=0, stale=true, context=0x118e1c40) at maildir-uidlist.c:250 box = (struct mailbox *) 0x118e1c40 #4 0x0000000010ccba7c in dotlock_create (dotlock=0x118a8140, flags=DOTLOCK_CREATE_FLAG_NONBLOCK, write_pid=true, lock_path_r=0x7fffffffe4e0) at file-dotlock.c:549 secs_left = 0 set = (const struct dotlock_settings *) 0x118a8140 lock_path = 0x11806220 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist.lock" lock_info = {set = 0x118a8140, path = 0x118b59c0 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist", lock_path = 0x11806220 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist.lock", temp_path = 0x0, fd = -1, lock_info = {dev = 0, ino = 0, size = 0, ctime = 0, mtime = 0}, file_info = {dev = 0, ino = 0, size = 0, ctime = 0, mtime = 0}, last_pid_check = 0, last_change = 0, wait_usecs = 0, have_pid = 0, pid_read = 0, use_io_notify = 1, lock_stated = 1} st = {st_dev = 1, st_ino = 32767, st_mode = 0, st_nlink = 0, st_uid = 0, st_gid = 0, st_rdev = 0, st_atim = {tv_sec = 140737488348216, tv_nsec = 140737488347840}, st_mtim = {tv_sec = 12884901898, tv_nsec = 140737488348320}, st_ctim = {tv_sec = 167, tv_nsec = 0}, st_size = 275162112, st_blocks = 140737488348192, st_blksize = 275046283, st_flags = 0, st_gen = 4294960312, st_lspare = 32767, st_birthtim = {tv_sec = 140737488348216, tv_nsec = 277283844}} stale_notify_threshold = 60 change_secs = 1453448110 wait_left = 2841519186 now = 1453448110 max_wait_time = 0 last_notify = 1453448110 prev_last_change = 0 prev_wait_update = 0 tmp_path = (string_t *) 0x11806270 ret = 0 do_wait = false #5 0x0000000010ccaf87 in file_dotlock_create_real (dotlock=0x118a8140, flags=DOTLOCK_CREATE_FLAG_NONBLOCK) at file-dotlock.c:629 lock_path = 0x11806220 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist.lock" st = {st_dev = 284562744, st_ino = 0, st_mode = 58544, st_nlink = 65535, st_uid = 32767, st_gid = 282105456, st_rdev = 0, st_atim = {tv_sec = 140737488290687, tv_nsec = 50}, st_mtim = {tv_sec = 294345152, tv_nsec = 293746112}, st_ctim = {tv_sec = 284562744, tv_nsec = 294345152}, st_size = 140737488348368, st_blocks = 281883903, st_blksize = 96, st_flags = 0, st_gen = 293746112, st_lspare = 0, st_birthtim = {tv_sec = 140737488348416, tv_nsec = 281819373}} fd = 0 ret = 50 #6 0x0000000010ccae76 in file_dotlock_create (set=0x118dd138, path=0x118235c0 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist", flags=DOTLOCK_CREATE_FLAG_NONBLOCK, dotlock_r=0x118dd168) at file-dotlock.c:673 _data_stack_cur_id = 5 dotlock = (struct dotlock *) 0x118a8140 ret = 0 #7 0x00000000108fb891 in maildir_uidlist_lock_timeout (uidlist=0x118dd100, nonblock=true, refresh=true, refresh_when_locked=true) at maildir-uidlist.c:160 box = (struct mailbox *) 0x118e1c40 perm = (const struct mailbox_permissions *) 0x118e1e10 path = 0x118235c0 "/var/mail/mbox1/0/2/Maildir/.Junk/dovecot-uidlist" old_mask = 63 dotlock_flags = DOTLOCK_CREATE_FLAG_NONBLOCK i = 0 ---Type <return> to continue, or q <return> to quit--- ret = -5216 #8 0x00000000108fe066 in maildir_uidlist_sync_lock (uidlist=0x118dd100, sync_flags=MAILDIR_UIDLIST_SYNC_TRYLOCK, locked_r=0x7fffffffe617) at maildir-uidlist.c:1608 nonblock = true refresh = true ret = -5184 #9 0x00000000108fdd86 in maildir_uidlist_sync_init (uidlist=0x118dd100, sync_flags=MAILDIR_UIDLIST_SYNC_TRYLOCK, sync_ctx_r=0x118061b8) at maildir-uidlist.c:1638 ctx = (struct maildir_uidlist_sync_ctx *) 0x118061b8 locked = false ret = 4 #10 0x00000000108fa021 in maildir_sync_context (ctx=0x11806188, forced=false, find_uid=0x0, lost_files_r=0x7fffffffe71f) at maildir-sync.c:871 sync_flags = MAILDIR_UIDLIST_SYNC_TRYLOCK flags = 4294960816 new_changed = true cur_changed = true lock_failure = false fname = 0x7fffffffe5a0 "àåÿÿÿ\177" why = 36 ret = 1 #11 0x00000000108f9400 in maildir_sync_run (mbox=0x118e1c40, flags=68, force_resync=false, uid=0x0, lost_files_r=0x7fffffffe71f) at maildir-sync.c:1023 _data_stack_cur_id = 4 ctx = (struct maildir_sync_context *) 0x11806188 retry = false lost_files = false ret = 294526016 #12 0x00000000108f96b0 in maildir_storage_sync_init (box=0x118e1c40, flags=68) at maildir-sync.c:1096 mbox = (struct maildir_mailbox *) 0x118e1c40 lost_files = false force_resync = false ret = 0 #13 0x00000000108b75b9 in mailbox_sync_init (box=0x118e1c40, flags=68) at mail-storage.c:1657 _data_stack_cur_id = 3 ctx = (struct mailbox_sync_context *) 0xc #14 0x00000000108b6891 in mailbox_sync (box=0x118e1c40, flags=68) at mail-storage.c:1705 ctx = (struct mailbox_sync_context *) 0x206 status = {sync_delayed_expunges = 1} #15 0x00000000108a6e65 in mailbox_autoexpunge (box=0x118e1c40, expire_time=1450856110) at mail-autoexpunge.c:29 t = (struct mailbox_transaction_context *) 0x11873640 mail = (struct mail *) 0x118e1c40 metadata = {guid = '\0' <repeats 15 times>, virtual_size = 0, physical_size = 0, first_save_date = 1450855115, cache_fields = 0x0, precache_fields = 0, backend_ns_prefix = 0x0, backend_ns_type = 0} hdr = (const struct mail_index_header *) 0x118b7f10 seq = 0 timestamp = 140737488349168 ret = 0 #16 0x00000000108a6d54 in mail_namespace_autoexpunge (ns=0x118a6020) at mail-autoexpunge.c:76 box_set__foreach_end = (const void *) 0x118b73f0 box_set = (struct mailbox_settings * const *) 0x118b73d8 box = (struct mailbox *) 0x118e1c40 ---Type <return> to continue, or q <return> to quit--- expire_time = 1450856110 #17 0x00000000108a6c54 in mail_user_autoexpunge (user=0x118b6040) at mail-autoexpunge.c:91 ns = (struct mail_namespace *) 0x118a6020 #18 0x00000000108c1b62 in mail_user_unref (_user=0x118458d0) at mail-user.c:167 user = (struct mail_user *) 0x118b6040 #19 0x00000000004216b4 in client_default_destroy (client=0x11845840, reason=0x0) at imap-client.c:390 cmd = (struct client_command_context *) 0x435c47 #20 0x000000000041f53d in client_destroy (client=0x11845840, reason=0x0) at imap-client.c:263 No locals. #21 0x000000000041eccb in client_input (client=0x11845840) at imap-client.c:1121 cmd = (struct client_command_context *) 0x2118401a0 output = (struct ostream *) 0x0 bytes = 11 #22 0x0000000010ce738f in io_loop_call_io (io=0x1187c240) at ioloop.c:559 ioloop = (struct ioloop *) 0x11821080 t_id = 2 #23 0x0000000010cea343 in io_loop_handler_run_internal (ioloop=0x11821080) at ioloop-kqueue.c:151 ctx = (struct ioloop_handler_context *) 0x118190a0 events = (struct kevent *) 0x1187d000 event = (const struct kevent *) 0x1187d000 tv = {tv_sec = 1799, tv_usec = 999858} ts = {tv_sec = 1799, tv_nsec = 999858000} io = (struct io_file *) 0x1187c240 events_count = 5 ret = 1 i = 0 #24 0x0000000010ce791e in io_loop_handler_run (ioloop=0x11821080) at ioloop.c:607 No locals. #25 0x0000000010ce773f in io_loop_run (ioloop=0x11821080) at ioloop.c:583 No locals. #26 0x0000000010c41aab in master_service_run (service=0x1181b140, callback=0x436ab0 <client_connected>) at master-service.c:640 No locals. #27 0x00000000004363c3 in main (argc=2, argv=0x7fffffffeba8) at main.c:442 set_roots = {0x441248, 0x0} login_set = {auth_socket_path = 0x11806040 "x`\200\021", postlogin_socket_path = 0x11806078 "", postlogin_timeout_secs = 60, callback = 0x436760 <login_client_connected>, failure_callback = 0x436a20 <login_client_failed>, request_auth_token = 1} service_flags = MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = -1 Current language: auto; currently minimal dovecot -n # 2.2.21 (5345f22): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.11 (6ddf62b87f60+) # OS: FreeBSD 10.2-RELEASE-p10 amd64 doveconf: Warning: Dovecot was last started using /etc/dovecot/dovecot.conf, but this config is /usr/local/etc/dovecot/dovecot.conf auth_cache_size = 10 M auth_cache_ttl = 5 mins auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb auth_verbose = yes auth_worker_max_count = 10 base_dir = /var/run/dovecot/ default_client_limit = 2000 default_process_limit = 200 disable_plaintext_auth = no first_valid_uid = 25 imap_idle_notify_interval = 4 mins log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = Ready to serve. mail_fsync = always mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = zlib quota mail_temp_dir = /var/tmp mailbox_list_index = yes maildir_very_dirty_syncs = yes managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body environment mailbox date index ihave duplicate mime foreverypart mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 2 weeks special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { quota = maildir:User quota quota_exceeded_message = Quota exceeded (Mailbox is full) quota_rule = *:storage=1G quota_rule2 = Trash:ignore sieve = ~/.dovecot.sieve sieve_default = /etc/dovecot/sieve/global/JunkFolder.sieve sieve_dir = ~/.sieve sieve_extensions = -enotify sieve_global_dir = /etc/dovecot/sieve/global/ zlib_save = xz zlib_save_level = 6 } pop3_fast_size_lookups = yes pop3_save_uidl = yes protocols = imap pop3 lmtp sieve rejection_reason = Your message to <%t> was rejected:%n%n %r%n rejection_subject = [BOUNCE] %s service imap-login { inet_listener imap { port = 143 } process_min_avail = 4 service_count = 100 } service imap { executable = imap last-login } service last-login { user = mailnull } service lmtp { process_min_avail = 4 unix_listener lmtp { mode = 0666 } user = mailnull } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 } service managesieve { process_limit = 100 } service pop3-login { inet_listener pop3 { port = 110 } process_min_avail = 4 service_count = 100 } service pop3 { executable = pop3 last-login } ssl = no ssl_cipher_list = ALL:!SSLv2:!LOW:!ADH:!NULL:!DES:@STRENGTH ssl_protocols = !SSLv2 !SSLv3 submission_host = localhost:25 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol lmtp { mail_plugins = zlib quota sieve } protocol lda { mail_plugins = zlib quota } protocol imap { mail_max_userip_connections = 8 mail_plugins = zlib quota imap_quota } protocol pop3 { mail_max_userip_connections = 2 mail_plugins = zlib quota } protocol sieve { mail_max_userip_connections = 3 managesieve_implementation_string = Dovecot managesieve_max_line_length = 65536 }

2 1

how do I get the version of the pigeonhole-sieve plugin
by Heiko Schlittermann 22 Jan '16

22 Jan '16

Hello, as may parts of the dovecot configuration docs refer to sieve and it's specific versions, like NOTE: Pigeonhole versions before v0.3.1 do not support the lo … how do I get the Pigeonhole version my local dovecot uses? The package version number of the ubuntu package dovecot-sieve isn't telling me anything here, because it's bound to the dovecot version number. What do I miss here? Thank you. Best regards from Dresden/Germany Viele Grüße aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ -

2 2

dovecot director redirect some user to always same backend
by Tobi 22 Jan '16

22 Jan '16

Hello list I have a question on how to enforce certain user(s) always to the same backend in a dovecot setup with director. So I changed my passdb-mysql query SELECT password AS password, username AS destuser, 'Y' as proxy, (CASE username WHEN LIKE 'user' THEN '10.66.99.6' ELSE null END) as host from mailbox WHERE username = '%u' AND active = 1; But then I saw in the dovecot manual that the director does nothing if the passdb query already returns a host field. So I'm quite unsure whether a host field with value NULL means that the host field is not present and therefore the director should insert it into the result or not. Thanks tobi

2 1

Hypothetical feature suggestion
by Stephen Feyrer 21 Jan '16

21 Jan '16

Hi, Assuming one sends an E-mail which in turn requires either an update or correction. The current practise is to send a subsequent E-mail with the new or corrected info. I would like to suggest a small feature. I recognise that this would require that the sending application would need to support this same feature. The sender should be able to edit a sent email, transmit a diff of the original and then the receiving mail store composite the changes into a new email. This could be with or without features to allow the review historic versions of said E-mail. Alternatively, regular expressions could be employed to achieve this effect (albeit, a more complex approach). This would provide a kind of Web 2 look on E-mail. -- Kind regards Stephen Feyrer

2 1

Help with sieve
by Joy 21 Jan '16

21 Jan '16

Dear Experts, I am having following script which is working perfectly on 3 server but not working as expected on new server. I have updated latest sieve software compiled from source, In case i use fileinto to move mail to other folder it works perfectly .. require ["fileinto","imap4flags","envelope","body"]; #1 if allof (header :contains ["Subject"] ["test"] ){ setflag "\\Seen"; addflag "\\Flagged"; addflag "BUG"; }

2 1

Multiple Domains
by Doug Hardie 20 Jan '16

20 Jan '16

I have Dovecot 2.2.19 running. However, one client has a rather unusual need. There are multiple domains that currently access their mail on the server. However, this on domain/client wants to use a different port for their users to access mail. Anyone on the standard port trying to download mail would receive an invalid user error (or whatever the proper error for that is). Likewise, only this clients users could access their mail on the new port. Is this possible? — Doug

2 2