From anmeyer at anup.de Mon Apr 1 13:03:57 2013 From: anmeyer at anup.de (Andreas Meyer) Date: Mon, 1 Apr 2013 12:03:57 +0200 Subject: [Dovecot] loop when I enable quota_warning In-Reply-To: References: <20130321155546.1a57a4c5@itxnew.bitcorner.intern> Message-ID: <20130401120357.495f6676@itxnew.bitcorner.intern> Hello! Timo Sirainen wrote: > On 21.3.2013, at 16.55, Andreas Meyer wrote: > > > The problem occurs when I add the following to dovecot.conf: > > > > quota_warning = storage=95%% quota-warning 95 %u > > quota_warning2 = storage=80%% quota-warning 80 %u > > quota_warning3 = -storage=100%% quota-warning below %u # user is no longer over quota > > > > The script executed looks like this: > > > > #!/bin/sh > > PERCENT=$1 > > USER=$2 > > cat << EOF | /usr/libexec/dovecot/dovecot-lda -d $USER -o "plugin/quota=maildir:User quota:noenforcing" > > Just because quota isn't enforced, it doesn't mean that the quota warnings aren't executed. You need to disable quota entirely (e.g. -o plugin/quota= might work, although it requires a somewhat new version). > Now I have -o plugin/quota= in the script. That seems to avoid the loop, but the user also does not get a quota-warning. plugin { quota = maildir:User quota quota_rule = *:storage=500MB quota_rule2 = Trash:storage=+10%% quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = -storage=100%% quota-warning below %u # user is no longer over quota autocreate = Trash autocreate2 = Drafts autocreate3 = Sent autosubscribe = Trash autosubscribe2 = Drafts autosubscribe3 = Sent sieve_extensions = +vacation-seconds sieve_vacation_min_period = 1h sieve_vacation_default_period = 10d sieve_vacation_max_period = 30d } # doveadm -D quota get -u miles at anup.de doveadm(mail1): Debug: Loading modules from directory: /usr/lib/dovecot doveadm(mail1): Debug: Module loaded: /usr/lib/dovecot/lib10_quota_plugin.so doveadm(mail1): Debug: Loading modules from directory: /usr/lib/dovecot/doveadm doveadm(mail1): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(mail1): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_lookup (this is usually intentional, so just ignore this message) doveadm(mail1): Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so doveadm(mail1): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib/dovecot/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(mail1): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(miles at anup.de): Debug: Added userdb setting: mail=maildir:~/ doveadm(miles at anup.de): Debug: Added userdb setting: plugin/quota_rule=*:bytes=30M doveadm(miles at anup.de): Debug: Effective uid=5000, gid=5000, home=/var/spool/vhosts/anup.de/miles doveadm(miles at anup.de): Debug: Quota root: name=User quota backend=maildir args= doveadm(miles at anup.de): Debug: Quota rule: root=User quota mailbox=* bytes=31457280 messages=0 doveadm(miles at anup.de): Debug: Quota rule: root=User quota mailbox=Trash bytes=+3145728 (10%) messages=0 doveadm(miles at anup.de): Debug: Quota warning: bytes=29884416 (95%) messages=0 reverse=no command=quota-warning 95 miles at anup.de doveadm(miles at anup.de): Debug: Quota warning: bytes=25165824 (80%) messages=0 reverse=no command=quota-warning 80 miles at anup.de doveadm(miles at anup.de): Debug: Quota warning: bytes=31457280 (100%) messages=0 reverse=yes command=quota-warning below miles at anup.de doveadm(miles at anup.de): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/ doveadm(miles at anup.de): Debug: maildir++: root=/var/spool/vhosts/anup.de/miles, index=, control=, inbox=/var/spool/vhosts/anup.de/miles, alt= Quota name Type Value Limit % User quota STORAGE 30715 30720 99 User quota MESSAGE 189 - Andreas From mastertoilet at netzero.net Tue Apr 2 06:51:08 2013 From: mastertoilet at netzero.net (mastertoilet at netzero.net) Date: Tue, 2 Apr 2013 03:51:08 GMT Subject: [Dovecot] about maildirsize not updating Message-ID: <20130401.205108.28808.0@webmail05.dca.untd.com> Hi sorry for the delay. My configuration is using Centos 6.dovecot 2.1.1.and i have configure the quota plugin.but i am not sure what you mean by dovecot-lda.i just follow the guides on the internet and skim through dovecots documentation.i am using the local unix account for mail account not using virtual users.here is my configuration: [root at mail ~]# dovecot -n # 2.1.1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.el6.x86_64 x86_64 CentOS release 6.3 (Final) base_dir = /var/run/dovecot/ mail_debug = yes mail_location = maildir:~/Maildir mail_plugins = " quota" maildir_broken_filename_sizes = yes mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { quota = maildir:User quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } ssl = required ssl_cert = i am currently using roundcube my webmail and configure using dovecot quota plugins. but it seems to not be updating the maildirsize when new mails comes.Deleting the maildirsize will recreate the files correctly.Is there any solutions to this problem with dovecot. Either you're not using dovecot-lda to deliver the mails, or you haven't configured quota plugin correctly for it. dovecot -n output and logs about a mail delivery would help. ____________________________________________________________ How to Sleep Like a Rock Obey this one natural trick to fall asleep and stay asleep all night. http://thirdpartyoffers.netzero.net/TGL3231/515a5604dea5456046511st03duc From ws+dovecot at iai.uni-bonn.de Tue Apr 2 12:45:06 2013 From: ws+dovecot at iai.uni-bonn.de (Walter Steiner) Date: Tue, 2 Apr 2013 11:45:06 +0200 Subject: [Dovecot] v2.2 getting NULL pointer reference with shared namespace in mailbox_tree? In-Reply-To: <1364745089.32610.4.camel@hurina> References: <20130322143510.GA28803@uran.iai.uni-bonn.de> <78A5903C-AFD6-42BE-BE2F-445E47EAD392@iki.fi> <20130322152953.GB3485@uran.iai.uni-bonn.de> <34BEEEBD-DA8C-45CC-A9A4-6E676F6A9D56@iki.fi> <20130322173450.GA623@uran.iai.uni-bonn.de> <1364745089.32610.4.camel@hurina> Message-ID: <20130402094506.GA3291@uran.iai.uni-bonn.de> > > With todays nightly: > > > > dsync(wsunpriv at iai.uni-bonn.de): Panic: file imapc-list.c: line 199 (imapc_list_get_vname): assertion failed: (strncmp(prefix, storage_name, prefix_len) == 0 && storage_name[prefix_len] == list->sep) > > Oh, and this would be good to solve too. What does it say with gdb: > > gdb dsync core > fr 5 > p prefix > p storage_name > p prefix_len > p list.sep > p list.ns.prefix Thank you very much for your support! [ 20130401 nightly ] The p commands say No symbol ... in current context. Maybe it is "fr 7"? (I'm no gdb user but most of the symbols are defined here) (gdb) fr 7 #7 0xffff80ffb74bc606 in imapc_list_get_vname (_list=0x4b9840, storage_name=0xffff80ffb71d656c "") at imapc-list.c:77 77 if (!imap_arg_get_list(&args[0], &flags) || (gdb) p storage_name $2 = 0xffff80ffb71d656c "" (gdb) p prefix $3 = 0x4c17a0 "INBOX" (gdb) p prefix_len $4 = 5 (gdb) p list.sep $5 = 46 '.' (gdb) p list.ns.prefix There is no member named ns. [ `fr 12` and `p ns.prefix` => $6 = 0x498780 "" ] (gdb) bt full #0 0xffff80ffbc18aaaa in _lwp_kill () from /lib/64/libc.so.1 No symbol table info available. #1 0xffff80ffbc17f2a1 in thr_kill () from /lib/64/libc.so.1 No symbol table info available. #2 0xffff80ffbc12feb9 in raise () from /lib/64/libc.so.1 No symbol table info available. #3 0xffff80ffbc106632 in abort () from /lib/64/libc.so.1 No symbol table info available. #4 0xffff80ffb7694b6f in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:142 backtrace = 0x4920f8 "/m/sw/dc/20130401/lib/dovecot/libdovecot.so.0.0.0'default_fatal_finish+0x26 [0xffff80ffb7694b48] -> /m/sw/dc/20130401/lib/dovecot/libdovecot.so.0.0.0'default_error_handler+0x0 [0xffff80ffb7694bd7] -> "... #5 0xffff80ffb7694bd7 in default_fatal_handler (ctx=0xffff80ffbfffee90, format=0xffff80ffb7560590 "file %s: line %d (%s): assertion failed: (%s)", args=0xffff80ffbfffee70) at failures.c:142 status = 0 #6 0xffff80ffb7694eb8 in i_panic (format=0xffff80ffb7560590 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:142 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = 0xffff80ffbfffef70, reg_save_area = 0xffff80ffbfffeea0}} #7 0xffff80ffb74bc606 in imapc_list_get_vname (_list=0x4b9840, storage_name=0xffff80ffb71d656c "") at imapc-list.c:77 list = (struct imapc_mailbox_list *) 0x4b9840 prefix = 0x4c17a0 "INBOX" prefix_len = 5 __FUNCTION__ = "imapc_list_get_vname" #8 0xffff80ffb74e603b in mailbox_list_get_vname (list=0x4b9840, name=0xffff80ffb71d656c "") at ../../src/lib/array.h:197 No locals. #9 0xffff80ffb71cd0fa in acl_backend_vfile_object_init (_backend=0x4cad10, name=0xffff80ffb71d656c "") at ../../../src/lib/array.h:197 _data_stack_cur_id = 4 backend = (struct acl_backend_vfile *) 0x4cad10 aclobj = (struct acl_object_vfile *) 0x49b520 dir = 0xffff80ffbffff010 "0????\200??\210?\034??\200??le\035??\200??\020?L" vname = 0x8
#10 0xffff80ffb71cad88 in acl_object_init_from_name (backend=0x4cad10, name=0xffff80ffb71d656c "") at ../../../src/lib/array.h:197 No locals. #11 0xffff80ffb71cc9b4 in acl_backend_get_default_rights (backend=0x4cad10, mask_r=0xffff80ffbffff0b8) at acl-backend.c:68 No locals. #12 0xffff80ffb71d4ba7 in acl_mailbox_try_list_fast (ctx=0x4fcdb0) at acl-mailbox-list.c:63 alist = (struct acl_mailbox_list *) 0x4b9ad0 backend = (struct acl_backend *) 0x4cad10 idxp = (const unsigned int *) 0x4b9ba0 acl_mask = (const struct acl_mask *) 0xffff80ffb76717e7 nonowner_list_ctx = (struct acl_mailbox_list_context *) 0xffff80ffbffff100 ns = (struct mail_namespace *) 0x4b9770 update_ctx = {iter_ctx = 0x4fce60, tree_ctx = 0x4fce40, glob = 0xffff80ffbffff0b0, leaf_flags = 3077123268, parent_flags = 4294934783, update_only = 0, match_parents = 0} name = 0x2bffff0d0
ret = 1 #13 0xffff80ffb71d4f2a in acl_mailbox_list_iter_init (list=0x4b9840, patterns=0xffff80ffbffff200, flags=12) at acl-mailbox-list.c:63 _data_stack_cur_id = 3 alist = (struct acl_mailbox_list *) 0x4b9ad0 ctx = (struct acl_mailbox_list_iterate_context *) 0x4fcdb0 pool = (pool_t) 0x4fcd90 p = 0x474a44 "*" i = 1 inboxcase = true #14 0xffff80ffb74fabb4 in mailbox_list_iter_init_multiple (list=0x4b9840, patterns=0xffff80ffbffff200, flags=12) at mailbox-list-iter.c:98 ctx = (struct mailbox_list_iterate_context *) 0x400 ret = 0 __FUNCTION__ = "mailbox_list_iter_init_multiple" #15 0xffff80ffb74fa72a in mailbox_list_iter_init (list=0x4b9840, pattern=0x474a44 "*", flags=12) at mailbox-list-iter.c:68 patterns = {0x474a44 "*", 0x0} #16 0x0000000000457d20 in dsync_mailbox_tree_fill (tree=0x51af50, ns=0x4b9770, box_name=0x0, box_guid=0x518768 "") at dsync-mailbox-tree-fill.c:23 list_flags = 12 subs_list_flags = 4356 iter = (struct mailbox_list_iterate_context *) 0x2f00002f004b335f node = (struct dsync_mailbox_node *) 0x1bffff348 dup_node1 = (struct dsync_mailbox_node *) 0x455eaa dup_node2 = (struct dsync_mailbox_node *) 0xffff80ffbffff280 info = (const struct mailbox_info *) 0x51bf60 list_pattern = 0x474a44 "*" ret = 0 __FUNCTION__ = "dsync_mailbox_tree_fill" #17 0x000000000044b060 in dsync_brain_mailbox_trees_init (brain=0x518740) at dsync-brain-mailbox-tree.c:31 ns = (struct mail_namespace *) 0x4b9770 #18 0x00000000004487ae in dsync_brain_slave_recv_handshake (brain=0x518740) at dsync-brain.c:99 ibc_set = (const struct dsync_ibc_settings *) 0x4b34a0 __FUNCTION__ = "dsync_brain_slave_recv_handshake" #19 0x0000000000448af7 in dsync_brain_run_real (brain=0x518740, changed_r=0xffff80ffbffff386) at dsync-brain.c:99 changed = false ret = true #20 0x0000000000448ca1 in dsync_brain_run (brain=0x518740, changed_r=0xffff80ffbffff386) at dsync-brain.c:99 _data_stack_cur_id = 2 ret = true #21 0x0000000000445a7e in cmd_dsync_run_local (ctx=0x4a1fe0, user=0x4aab80, brain=0x4b3720, ibc2=0x4b3390) at ../../../src/lib/array.h:197 brain2 = (struct dsync_brain *) 0x518740 user2 = (struct mail_user *) 0x4c03e0 set_parser = (struct setting_parser_context *) 0x4a89f0 set_line = 0x490f60 "mail_location=imapc:" location = 0xffff80ffbffff96b "imapc:" brain1_running = true brain2_running = true changed1 = true changed2 = false ret = 0 __FUNCTION__ = "cmd_dsync_run_local" #22 0x00000000004460ae in cmd_dsync_run (_ctx=0x4a1fe0, user=0x4aab80) at ../../../src/lib/array.h:197 ctx = (struct dsync_cmd_context *) 0x4a1fe0 ibc = (struct dsync_ibc *) 0x4a1400 ibc2 = (struct dsync_ibc *) 0x4b3390 brain = (struct dsync_brain *) 0x4b3720 sync_ns = (struct mail_namespace *) 0x0 brain_flags = 13 remote_errors_logged = false status = 0 ret = 0 #23 0x0000000000429a9a in doveadm_mail_next_user (ctx=0x4a1fe0, input=0xffff80ffbffff520, error_r=0xffff80ffbffff588) at doveadm-mail.c:73 error = 0xffff80ffbffff6a8 "k????\200??" ret = 0 __FUNCTION__ = "doveadm_mail_next_user" #24 0x0000000000429c60 in doveadm_mail_single_user (ctx=0x4a1fe0, input=0xffff80ffbffff520, error_r=0xffff80ffbffff588) at doveadm-mail.c:73 __FUNCTION__ = "doveadm_mail_single_user" #25 0x000000000042a504 in doveadm_mail_cmd (cmd=0x4a1808, argc=5, argv=0xffff80ffbffff6a8) at doveadm-mail.c:73 input = {module = 0x0, service = 0x46b752 "doveadm", username = 0xffff80ffbffff968 "ws", session_id = 0x0, local_ip = {family = 0, u = {ip6 = { _S6_un = {_S6_u8 = '\0' , _S6_u32 = {0, 0, 0, 0}, __S6_align = 0}}, ip4 = {S_un = {S_un_b = {s_b1 = 0 '\0', s_b2 = 0 '\0', s_b3 = 0 '\0', s_b4 = 0 '\0'}, S_un_w = {s_w1 = 0, s_w2 = 0}, S_addr = 0}}}}, remote_ip = {family = 0, u = {ip6 = {_S6_un = { _S6_u8 = '\0' , _S6_u32 = {0, 0, 0, 0}, __S6_align = 0}}, ip4 = {S_un = {S_un_b = {s_b1 = 0 '\0', s_b2 = 0 '\0', s_b3 = 0 '\0', s_b4 = 0 '\0'}, S_un_w = {s_w1 = 0, s_w2 = 0}, S_addr = 0}}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = 0, flags_override_remove = 0, no_userdb_lookup = 0} ctx = (struct doveadm_mail_cmd_context *) 0x4a1fe0 getopt_args = 0x48edb8 "+dEfg:l:m:n:Nr:Rs:RAS:u:" wildcard_user = 0x0 error = 0x0 ret = 0 c = -1 #26 0x000000000042a77b in doveadm_mail_try_run (cmd_name=0xffff80ffbffff95b "backup", argc=5, argv=0xffff80ffbffff688) at doveadm-mail.c:73 cmd__foreach_end = (const void *) 0x4a1940 cmd = (const struct doveadm_mail_cmd *) 0x4a1808 cmd_name_len = 6 __FUNCTION__ = "doveadm_mail_try_run" #27 0x000000000043489c in main (argc=5, argv=0xffff80ffbffff688) at doveadm.c:63 service_flags = 10 cmd_name = 0xffff80ffbffff95b "backup" i = 16 quick_init = false c = -1 # doveadm ... output: dsync(ws at iai.uni-bonn.de): Debug: brain M: in state=recv_handshake dsync(ws at iai.uni-bonn.de): Debug: brain M: out state=send_mailbox_tree_deletes changed=1 dsync(ws at iai.uni-bonn.de): Panic: file imapc-list.c: line 199 (imapc_list_get_vname): assertion failed: (strncmp(prefix, storage_name, prefix_len) == 0 && storage_name[prefix_len] == list->sep) dsync(ws at iai.uni-bonn.de): Error: Raw backtrace: /m/sw/dc/20130401/lib/dovecot/libdovecot.so.0.0.0'default_fatal_finish+0x26 [0xffff80ffb7694b48] -> /m/sw/dc/20130401/lib/dovecot/libdovecot.so.0.0.0'default_error_handler+0x0 [0xffff80ffb7694bd7] -> /m/sw/dc/20130401/lib/dovecot/libdovecot.so.0.0.0'i_fatal+0x0 [0xffff80ffb7694eb8] -> /m/sw/dc/20130401/lib/dovecot/libdovecot-storage.so.0.0.0'imapc_list_get_vname+0xdb [0xffff80ffb74bc606] -> /m/sw/dc/20130401/lib/dovecot/libdovecot-storage.so.0.0.0'mailbox_list_get_vname+0x28 [0xffff80ffb74e603b] -> /m/sw/dc/20130401/lib/dovecot/lib01_acl_plugin.so'acl_backend_vfile_object_init+0x92 [0xffff80ffb71cd0fa] -> /m/sw/dc/20130401/lib/dovecot/lib01_acl_plugin.so'acl_object_init_from_name+0x2b [0xffff80ffb71cad88] -> /m/sw/dc/20130401/lib/dovecot/lib01_acl_plugin.so'acl_backend_get_default_rights+0x30 [0xffff80ffb71cc9b4] -> /m/sw/dc/20130401/lib/dovecot/lib01_acl_plugin.so'acl_mailbox_try_list_fast+0xb2 [0xffff80ffb71d4ba7] -> /m/sw/dc/20130401/lib/dovecot/lib01_acl_plugin.so'acl_mailbox_list_iter_init+0x188 [0xffff80ffb71d4f2a] -> /m/sw/dc/20130401/lib/dovecot/libdovecot-storage.so.0.0.0'mailbox_list_iter_init_multiple+0x91 [0xffff80ffb74fabb4] -> /m/sw/dc/20130401/lib/dovecot/libdovecot-storage.so.0.0.0'mailbox_list_iter_init+0x39 [0xffff80ffb74fa72a] -> /m/sw/dc/20130401/bin/doveadm'dsync_mailbox_tree_fill+0x107 [0x457d20] -> /m/sw/dc/20130401/bin/doveadm'dsync_brain_mailbox_trees_init+0x128 [0x44b060] -> /m/sw/dc/20130401/bin/doveadm'dsync_brain_slave_recv_handshake+0x1ad [0x4487ae] -> /m/sw/dc/20130401/bin/doveadm'dsync_brain_run_real+0xe7 [0x448af7] -> /m/sw/dc/20130401/bin/doveadm'dsync_brain_run+0x61 [0x448ca1] -> /m/sw/dc/20130401/bin/doveadm'cmd_dsync_run_local+0x335 [0x445a7e] -> /m/sw/dc/20130401/bin/doveadm'cmd_dsync_run+0x26a [0x4460ae] -> /m/sw/dc/20130401/bin/doveadm'doveadm_mail_next_user+0x189 [0x429a9a] -> /m/sw/dc/20130401/bin/doveadm'doveadm_mail_single_user+0x157 [0x429c60] -> /m/sw/dc/20130401/bin/doveadm'doveadm_mail_cmd+0x3bc [0x42a504] -> /m/sw/dc/20130401/bin/doveadm'doveadm_mail_try_run+0xac [0x42a77b] -> /m/sw/dc/20130401/bin/doveadm'main+0x28b [0x43489c] -> /m/sw/dc/20130401/bin/doveadm'_start+0x6c [0x42906c] Abort (core dumped) # doveconf -n # 20130401 (c75b26e1d17f+): /m/sw/dc/20130401/etc/dovecot/dovecot.conf # OS: SunOS 5.11 i86pc zfs auth_debug = yes auth_debug_passwords = yes auth_default_realm = iai.uni-bonn.de auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = sha1 base_dir = /var/run/dovecot/ debug_log_path = /tmp/dcd imapc_features = rfc822.size imapc_host = mailbox.iai.uni-bonn.de imapc_list_prefix = INBOX imapc_master_user = ... imapc_password = ... imapc_port = 993 imapc_ssl = imaps imapc_ssl_verify = no imapc_user = %n log_path = /tmp/dce mail_debug = yes mail_gid = dovemail mail_location = sdbox:/m/d/imap/mbox/m/%n mail_plugins = notify mail_log acl quota mail_uid = dovemail namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } namespace user { hidden = no list = children location = sdbox:/m/d/imap/mbox/m/%%n prefix = user/%%u/ separator = / type = shared } passdb { args = scheme=CRYPT username_format=%u /m/d/etc/user/pw driver = passwd-file } passdb { args = username_format=%n /m/d/etc/user/global/pw-master-giat driver = passwd-file master = yes pass = yes } passdb { args = username_format=%n /m/d/etc/user/global/pw-master-top driver = passwd-file master = yes pass = yes } passdb { args = username_format=%n /m/d/etc/user/global/pw-master-top driver = passwd-file } plugin { acl = vfile:/m/d/etc/acl:cache_secs=300 acl_shared_dict = file:/m/d/etc/shared/mailboxes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mailbox_create save flag_change mail_log_fields = uid box msgid size } protocols = imap pop3 service auth-worker { user = doveauth } service auth { user = doveauth } service imap-login { process_min_avail = 4 service_count = 1 } service imap { executable = imap process_limit = 1024 } service pop3 { executable = pop3 process_limit = 64 } ssl_cert = References: <20130226154031.GH6073@uran.iai.uni-bonn.de> <1361968244.27458.30.camel@hurina> <20130227132749.GC28069@uran.iai.uni-bonn.de> <20130314100529.GA18113@uran.iai.uni-bonn.de> <265F0ADB-759E-4ACA-BDD3-C570D090F247@iki.fi> <98F7A42B-A5E9-46A8-BE58-B5AB1ADBCC85@iki.fi> <20130322084721.GA21212@uran.iai.uni-bonn.de> Message-ID: <20130402095045.GB3291@uran.iai.uni-bonn.de> On Sun, Mar 31, 2013 at 18:47:11 +0300, Timo Sirainen wrote: > On 22.3.2013, at 10.47, Walter Steiner wrote: > > > doveadm backup -R -u ... imapc: > > => mailboxes are created and some/many messages but not all messages > > are copied from the origin cyrus mailbox to the dovecot box. > > (i.e. the first consecutive 233 out of 523 are okay) > > > > All of the missing messages are logged: > > => dsync(...): Error: Mailbox ...: Remote didn't send mail UID=... > > (references to this error seen on the list in Jan. with older versions) > > Finally fixed: http://hg.dovecot.org/dovecot-2.2/rev/800836bd8f2e > > Also if there are any similar bugs left, it no longer exits with success: http://hg.dovecot.org/dovecot-2.2/rev/0eef38d78069 Great! At first sight (3 different users tested for now) it seems to work! All of the messages in my cyrus INBOX and subfolders are in the dovecot! Thank you very very much, Timo! From ya.mwork at yandex.ru Tue Apr 2 15:14:30 2013 From: ya.mwork at yandex.ru (Evgeny Basov) Date: Tue, 02 Apr 2013 16:14:30 +0400 Subject: [Dovecot] LDAP: error with iterate_query Message-ID: <515ACBA6.5000901@yandex.ru> Hello. Used 2.2.rc3. Try LDAP search: # ldapsearch -LLL -D "uid=dovecot,ou=Services,o=m" -b "ou=C,o=m" -w 1 -s subtree "(objectClass=mailUser)" mail dn: uid=test,dc=m.u,ou=C,o=m mail: test at m.u dn: uid=basov,dc=m.u,ou=C,o=m mail: basov at m.u mail: wow at m.u dn: uid=postmaster,dc=m.u,ou=C,o=m mail: postmaster at m.u dn: uid=ogo,dc=rest.com,ou=C,o=m mail: ogo at rest.com All is fine. Dovecot's config file: uris = ldapi://%2fvar%2frun%2fopenldap%2fslapd.sock dn = uid=dovecot,ou=Services,o=m dnpass = 1 debug_level = 128 auth_bind = yes auth_bind_userdn = uid=%n,dc=%d,ou=C,o=m ldap_version = 3 base = ou=C,o=m deref = never scope = subtree user_attrs = \ =home=/var/vmail/%d/%n/, \ =proxy_maybe=y, \ =nodelay=y, \ =host=%{ldap:mailHost}, \ =quota_rule=*:storage=%{ldap:mailQuota}M user_filter = (&(objectClass=mailUser)(uid=%n)) iterate_attrs = mail=user iterate_filter = (objectClass=mailUser) Request for one user: # doveadm user -u basov at mega.ru userdb: basov at m.u home : /var/vmail/m.u/basov/ proxy_maybe: y nodelay : y host : mailsys quota_rule: *:storage=20M log file: dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth dovecot: auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat dovecot: auth: Debug: master in: USER#0111#011basov at m.u#011service=doveadm dovecot: auth: Debug: ldap(basov at m.u): user search: base=ou=C,o=m scope=subtree filter=(&(objectClass=mailUser)(uid=basov)) fields=mailHost,mailQuota dovecot: auth: Debug: ldap(basov at m.u): result: mailHost=mailsys mailQuota=20; mailQuota,mailHost unused dovecot: auth: Debug: ldap(basov at m.u): result: mailHost=mailsys mailQuota=20 dovecot: auth: Debug: userdb out: USER#0111#011basov at m.u#011home=/var/vmail/m.u/basov/#011proxy_maybe=y#011nodelay=y#011host=mailsys#011quota_rule=*:storage=20M dovecot: auth: Fatal: master: service(auth): child 4156 killed with signal 11 (core dumps disabled) all looks good. Try iterate query for all users: # doveadm user *@* doveadm(root): Error: User listing returned failure doveadm(root): Fatal: user listing failed log file: dovecot: auth: Debug: master in: LIST#0111#011user=*@*#011service=doveadm dovecot: auth-worker(4185): Debug: ldap: iterate: base=ou=C,o=m scope=subtree filter=(objectClass=mailUser) fields=mail dovecot: auth-worker(4185): Error: ldap(*@*): LDAP search returned multiple entries dovecot: auth-worker(4185): Fatal: master: service(auth-worker): child 4185 killed with signal 11 (core dumps disabled) dovecot: auth-worker(4187): Debug: Loading modules from directory: /usr/lib64/dovecot/auth Is it error of rc3 release or somebody wrong in my configuration? From Lutz.Pressler at SerNet.DE Tue Apr 2 15:37:19 2013 From: Lutz.Pressler at SerNet.DE (Lutz =?iso-8859-1?Q?Pre=DFler?=) Date: Tue, 2 Apr 2013 14:37:19 +0200 Subject: [Dovecot] doveadm mailbox list/stats etc. and shared mailboxes/ACLs Message-ID: Hello, 2.2.0rc3: host:~# doveadm mailbox list -u testuser INBOX INBOX.test INBOX.bla INBOX.bla.blubb INBOX.shared INBOX.virtual INBOX.shared.user1 INBOX.shared.user1.privat INBOX.shared.user1.test INBOX.shared.user1.test.test2 INBOX.shared.user1.Trash INBOX.shared.user1.in2009 [... all mailboxes of user1] Only user1.test and user1.test.test2 have ACLs that allow testuser to access them. host:~# doveadm mailbox status -u testuser all INBOX.shared.user1.privat INBOX.shared.user1.privat messages=37 recent=0 uidnext=70 uidvalidity=1060291494 unseen=7 highestmodseq=1 vsize=1618757 guid=9a71cb399c249d4ce10e0000c93908ca Access with search and fetch (and probably any other doveadm command) is possible, too. Is this how it's supposed to work? Commands in testuser IMAP session respects ACLs. Lutz From lbinotto at sidor.com Tue Apr 2 18:11:10 2013 From: lbinotto at sidor.com (BINOTTO Luis SIDOR) Date: Tue, 2 Apr 2013 10:41:10 -0430 Subject: [Dovecot] Active Directory and Dovecot NTLM Authentication problem Message-ID: Hello everyone... I have a problem when I use NTLM authentication with dovecot. The authentication is made only in PLAIN TEXT. The scenario is: Debian Squeeze 6.0.6 Dovecot 2.1.7 Samba 3.5.6. Samba is correctly configured into the domain. The error: (extract from syslog) Apr 2 09:47:41 sirprdsvcmsg02 dovecot: auth: Error: Login for user []\[test2]@ [SIRP00000733] failed due to [winbind client not authorized to use winbindd_pam _auth_crap. Ensure permissions on /var/run/samba/winbindd_privileged are set cor rectly.] Apr 2 09:47:41 sirprdsvcmsg02 dovecot: auth: Error: [2013/04/02 09:47:41.832579 , 0] utils/ntlm_auth.c:888(manage_squid_ntlmssp_request) Apr 2 09:47:41 sirprdsvcmsg02 dovecot: auth: Error: NTLMSSP BH: NT_STATUS_ACC ESS_DENIED Apr 2 09:47:41 sirprdsvcmsg02 dovecot: auth: Error: winbind: ntlm_auth exited w ith exit code 0 Dovecot configuration: (dovecot -n) # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.6 ext3 auth_mechanisms = plain login ntlm auth_use_winbind = yes disable_plaintext_auth = no mail_location = maildir:/mailboxes/Administrativos/%Lu namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = " imap pop3" ssl_cert = , method= PLAIN, rip=10.50.2.150, lip=10.50.30.90, mpid=23706, session= PLAIN, rip=10.50.2.150, lip=10.50.30.90, mpid=23706, session= Apr 2 09:47:47 sirprdsvcmsg02 dovecot: auth: Error: [2013/04/02 09:47:47.408887 , 0] utils/ntlm_auth.c:598(winbind_pw_check) Apr 2 09:47:47 sirprdsvcmsg02 dovecot: auth: Error: Login for user []\[test2] @[SIRP00000733] failed due to [winbind client not authorized to use winbindd_pam _auth_crap. Ensure permissions on /var/run/samba/winbindd_privileged are set cor rectly.] Apr 2 09:47:47 sirprdsvcmsg02 dovecot: auth: Error: [2013/04/02 09:47:47.409203 , 0] utils/ntlm_auth.c:888(manage_squid_ntlmssp_request) Apr 2 09:47:47 sirprdsvcmsg02 dovecot: auth: Error: NTLMSSP BH: NT_STATUS_ACC ESS_DENIED Apr 2 09:47:47 sirprdsvcmsg02 dovecot: auth: Error: winbind: ntlm_auth exited w ith exit code 0 Apr 2 09:47:48 sirprdsvcmsg02 postfix/postfix-script[23819]: the Postfix mail s ystem is running: PID: 2390 Apr 2 09:47:53 sirprdsvcmsg02 dovecot: imap-login: Login: user=, method= PLAIN, rip=10.50.2.150, lip=10.50.30.90, mpid=23820, session= Auth.log Apr 2 09:52:35 sirprdsvcmsg02 auth: pam_krb5(dovecot:auth): user test2 authenti cated as test2 at SIDOR.NET I hope someone could help me. Thanks in advance, Best Regards, Luis " Notificacion Automatica: Este mensaje y cualquier archivo que se adjunte contiene informacion privilegiada y confidencial. Es para uso exclusivo del destinatario. Si usted ha recibido esta comunicacion por error, por favor avisenos inmediatamente. Automatic notification: This e-mail and any file transmitted with it are confidential and may be legally privileged. It is intended solely for the addressee and may not be disclosed to or used by anyone other than the addressee. If you have received this e-mail by mistake , please advise the sender immediately" From tss at iki.fi Tue Apr 2 18:14:16 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 2 Apr 2013 18:14:16 +0300 Subject: [Dovecot] LDAP: error with iterate_query In-Reply-To: <515ACBA6.5000901@yandex.ru> References: <515ACBA6.5000901@yandex.ru> Message-ID: <18D414D5-EBD0-40EE-83AC-B6365346A8FC@iki.fi> On 2.4.2013, at 15.14, Evgeny Basov wrote: > Used 2.2.rc3. .. > dovecot: auth: Fatal: master: service(auth): child 4156 killed with > signal 11 (core dumps disabled) I'm pretty sure I fixed this already. I definitely did several LDAP fixes. Try the latest nightly snapshot? I was also planning on releasing rc4 soon (tomorrow?) From Lutz.Pressler at SerNet.DE Wed Apr 3 00:25:30 2013 From: Lutz.Pressler at SerNet.DE (Lutz =?iso-8859-1?Q?Pre=DFler?=) Date: Tue, 2 Apr 2013 23:25:30 +0200 Subject: [Dovecot] replicator process Message-ID: Hello Timo, 2.2rc3: replication unconfigured (no "replica" in doveconf -n output), # doveadm replicator status starts the dovecot/replicator process, which keeps running, leading to "sync: User has no mail_replica in userdb" errors for each user every 5 minutes. Same after "doveadm replicator replicate some-even-nonexisting-user". Lutz From chibi at gol.com Wed Apr 3 10:59:22 2013 From: chibi at gol.com (Christian Balzer) Date: Wed, 3 Apr 2013 16:59:22 +0900 Subject: [Dovecot] Proxying, pertinent values and features, SNI Message-ID: <20130403165922.33300812@batzmaru.gol.ad.jp> Hello, I'm looking into deploying dovecot as a proxy, currently using perdition. Have been using dovecot on the actual servers for years, nearly a decade. So far just 1.x, but for the proxy it will have to be 2.x (2.1.7 is the current Debian version), as the trigger for this change is the need to support multiple SSL certificates. All that happens on the proxy seems to be handled by the login processes, so that is why we're not seeing anything useful in the process titles or with doveadm, right? And from past comments by Timo I guess that adding such functionality isn't on his to-do list at all. A configurable capabilities string for POP would be quite welcome, but at least nothing is different between the 1.x backends and the 2.x proxy in that protocol. Speaking of 1.x versus 2.x, the feature to pass on the remote IP from the proxy to the backend is a 2.x thing only, correct? So I suppose any parameters really affecting this setup are default_process_limit and default_client_limit as well as the settings in service-imap-login and service pop-login. In particular mail_max_userip_connections never is looked at on the proxy as this check happens in the respective protocol AFTER login, rite? I presume to best support all(?) clients out there is to have "local_name" sections for SNI first and then "local" sections for IP address based certs. It is my understanding that SNI needs to be requested by the client, so aside from client bugs (nah, those don't exist ^o^) every client should get an appropriate response for TLS. Has anybody done a setup like that already? Regards, Christian -- Christian Balzer Network/Systems Engineer chibi at gol.com Global OnLine Japan/Fusion Communications http://www.gol.com/ From ewald.lists at fun.de Wed Apr 3 12:01:46 2013 From: ewald.lists at fun.de (Ewald Dieterich) Date: Wed, 03 Apr 2013 11:01:46 +0200 Subject: [Dovecot] Separate log file for Sieve In-Reply-To: <51582F73.8070500@rename-it.nl> References: <515308E7.30302@fun.de> <1737C450-3E98-4190-B70E-3EDCD8011383@iki.fi> <51582F73.8070500@rename-it.nl> Message-ID: <515BEFFA.7030205@fun.de> On 03/31/13 14:43, Stephan Bosch wrote: > Op 3/31/2013 10:34 AM, Timo Sirainen schreef: >> On 27.3.2013, at 16.57, Ewald Dieterich wrote: >> >>> Is it possible to configure a separate log file for Sieve? >> No, unless you use some syslog feature. There are some plans to reduce >> the number of errors that Sieve logs though. > > Some of which is already implemented, but still pending release. I merged with the trunk and like the changes you did, thanks! Ewald From ivanb.dsol at gmail.com Wed Apr 3 12:49:16 2013 From: ivanb.dsol at gmail.com (Ivan Bogdanovic) Date: Wed, 3 Apr 2013 11:49:16 +0200 Subject: [Dovecot] Sieve vacation issue - Dovecot + Postfix + LDA Message-ID: Hi to all, I have an issue with Dovecot Sieve on sending vacation message... Actually Sieve is working and I can use all the filters but just vacation is causing a problem and only in specific case... I have Dovecot + Postfix + LDA running on Ubuntu 11 without MySql database for users but I'm using virtusertable instead. The problem is when linux user ( mail user ) is different from mail allias in virtusertable... Example: ivan at domain.com > ivan1 ( from virtusertable ). When alias and user are the same sieve vacation works just fine but when it's not the sieve script collects the user(ivan1)@domain.com in from instead ivan at domain.com and this is when mail log shows like "discarded message because of implicitily no known envelope in message header etc... Is there a way to adjust sieve to pickup the recipient address from mail header or whatever and not to collect the user...? I was trying to play with postfix master.cf using dovecot-lda switches -f ${sender} -a (or -d ) ${recipient} but without success... Did anyone had this kind of problem? I would really appreciate some hints on fixing this issue... Thanks, Ivan From stephan at rename-it.nl Wed Apr 3 13:11:06 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 03 Apr 2013 12:11:06 +0200 Subject: [Dovecot] Sieve vacation issue - Dovecot + Postfix + LDA In-Reply-To: References: Message-ID: <515C003A.8030504@rename-it.nl> On 4/3/2013 11:49 AM, Ivan Bogdanovic wrote: > Hi to all, > > I have an issue with Dovecot Sieve on sending vacation message... Actually > Sieve is working and I can use all the filters but just vacation is causing > a problem and only in specific case... > > I have Dovecot + Postfix + LDA running on Ubuntu 11 without MySql database > for users but I'm using virtusertable instead. The problem is when linux > user ( mail user ) is different from mail allias in virtusertable... > Example: ivan at domain.com > ivan1 ( from virtusertable ). > > When alias and user are the same sieve vacation works just fine but when > it's not the sieve script collects the user(ivan1)@domain.com in from > instead ivan at domain.com and this is when mail log shows like "discarded > message because of implicitily no known envelope in message header etc... > > Is there a way to adjust sieve to pickup the recipient address from mail > header or whatever and not to collect the user...? > > I was trying to play with postfix master.cf using dovecot-lda switches -f > ${sender} -a (or -d ) ${recipient} but without success... > > Did anyone had this kind of problem? I would really appreciate some hints > on fixing this issue... With a recent enough Pigeonhole you can try using the original recipient: http://hg.rename-it.nl/dovecot-2.1-pigeonhole/raw-file/tip/doc/extensions/vacation.txt http://wiki2.dovecot.org/LDA#Parameters (-a and -r) Regards, Stephan. From lists at wildgooses.com Wed Apr 3 13:13:41 2013 From: lists at wildgooses.com (Ed W) Date: Wed, 03 Apr 2013 11:13:41 +0100 Subject: [Dovecot] Proxying, pertinent values and features, SNI In-Reply-To: <20130403165922.33300812@batzmaru.gol.ad.jp> References: <20130403165922.33300812@batzmaru.gol.ad.jp> Message-ID: <515C00D5.9010008@wildgooses.com> Hi > I presume to best support all(?) clients out there is to have "local_name" > sections for SNI first and then "local" sections for IP address based > certs. It is my understanding that SNI needs to be requested by the > client, so aside from client bugs (nah, those don't exist ^o^) every > client should get an appropriate response for TLS. > Has anybody done a setup like that already? > Although not what you asked for, just so you are aware, Godaddy (boo hiss, etc) offer reasonably inexpensive multi subject alt name based certs. This means you can have a single cert which is valid for lots of completely different domain names. The mild benefit is that this doesn't require SNI support for SSL (which I'm unsure is supported by many mail clients?) Although it's more expensive, I think it's a good solution (I'm using it for a small 5 domain installation) Good luck Ed W From stephan at rename-it.nl Wed Apr 3 13:21:31 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 03 Apr 2013 12:21:31 +0200 Subject: [Dovecot] sieve-filter ignoring separator In-Reply-To: <1363961862597-41000.post@n4.nabble.com> References: <514AB932.7060808@rename-it.nl> <1363961862597-41000.post@n4.nabble.com> Message-ID: <515C02AB.9050206@rename-it.nl> On 3/22/2013 3:17 PM, isakrubin wrote: > Stephan Bosch-2 wrote >> On 3/4/2013 9:21 PM, Isak Rubin wrote: >>> # dovecot --version >>> 2.1.9 >> This Dovecot is very old, so is probably your Pigeonhole version. Recent >> versions should work fine in this regard. >> >> Regards, >> >> Stephan. > Upgraded to > # dovecot --version > 2.2.rc3 > > > still same issue :/ Could you show me your `dovecot -n` output? Regards, Stephan. From hajo.locke at gmx.de Wed Apr 3 14:24:41 2013 From: hajo.locke at gmx.de (Hajo Locke) Date: Wed, 3 Apr 2013 13:24:41 +0200 Subject: [Dovecot] Outlook 2013 - mounting folders with XLIST References: <9F7FF84F91BA4164A1C07DF0143799DD@ai.local><51503291.5070008@sys4.de><51503FF4.8080409@sys4.de><17A6BDEBDD0C4C6EB4D0D2545E33B842@ai.local> Message-ID: On Sun, 2013-03-31 at 17:40 +0300, Timo Sirainen wrote: >> > >> > namespace/inbox/mailbox=hallohallo^Atnamespace/inbox/mailbox/hallohallo/auto=subscribe >> > >> > same line occurs when querying ...userdb_import as userdb_import... in >> > place of ...userdb_import as userdb_userdb_import. >> >> http://hg.dovecot.org/dovecot-2.1/rev/cd919c490ea6 makes >> userdb_userdb_import work. > Ugh. Not really. OK, latest v2.1 hg has passdb_import, userdb_import and > userdb_userdb_import and they all work. In addition, here's a list of > settings that are required for adding two new mailboxes without them > being in the configuration: > /usr/local/libexec/dovecot/imap -o 'namespace/inbox/mailbox=foo bar' -o > namespace/inbox/mailbox/foo/name=foo -o > namespace/inbox/mailbox/bar/name=bar -o > namespace/inbox/mailbox/foo/auto=create -o > namespace/inbox/mailbox/bar/auto=create -o > namespace/inbox/mailbox/foo/special_use=\\sent -o > namespace/inbox/mailbox/bar/special_use=\\drafts > That way you can easily test them. They work just the same (without -o > parameter of course) in userdb_import. thanks, this is working. now it is possible to let the single user choose his favorite foldernames if client is not very helpful. it results in some more configuration, but is helpful in some situations. but i only achieved this without userdb prefetching. latest patch i added latest patch http://hg.dovecot.org/dovecot-2.1/rev/cd919c490ea6 is included this is the old combined query: password_query = SELECT `inbox` as `user`, `password`, `home` as userdb_home, `uid` AS userdb_uid, `gid` AS userdb_gid,userdb_import AS userdb_userdb_import FROM `mail_users` WHERE `login` = '%u' AND `active`='Y' i had to edit the conf and split this query into user and pwd query to make it work password_query = SELECT `inbox` as `user`, `password` FROM `mail_users` WHERE `login` = '%u' AND `active`='Y' user_query = SELECT `inbox` as `user`, `password`, `home`, `uid`, `gid`, userdb_import FROM `mail_users` WHERE `login` = '%u' AND `active`='Y' i would like to save one query at loginprocess, but its not existentially needed. Thanks, Hajo From dot5productions at gmail.com Wed Apr 3 14:57:34 2013 From: dot5productions at gmail.com (Isak Rubin) Date: Wed, 3 Apr 2013 14:57:34 +0300 Subject: [Dovecot] sieve-filter ignoring separator In-Reply-To: <515C02AB.9050206@rename-it.nl> References: <514AB932.7060808@rename-it.nl> <1363961862597-41000.post@n4.nabble.com> <515C02AB.9050206@rename-it.nl> Message-ID: Here you go, http://pastebin.com/LA0kJteM Regards, Isak 2013/4/3 Stephan Bosch > On 3/22/2013 3:17 PM, isakrubin wrote: > >> Stephan Bosch-2 wrote >> >>> On 3/4/2013 9:21 PM, Isak Rubin wrote: >>> >>>> # dovecot --version >>>> 2.1.9 >>>> >>> This Dovecot is very old, so is probably your Pigeonhole version. Recent >>> versions should work fine in this regard. >>> >>> Regards, >>> >>> Stephan. >>> >> Upgraded to >> # dovecot --version >> 2.2.rc3 >> >> >> still same issue :/ >> > > Could you show me your `dovecot -n` output? > > Regards, > > Stephan. > From stephan at rename-it.nl Wed Apr 3 15:17:18 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 03 Apr 2013 14:17:18 +0200 Subject: [Dovecot] sieve-filter ignoring separator In-Reply-To: References: <514AB932.7060808@rename-it.nl> <1363961862597-41000.post@n4.nabble.com> <515C02AB.9050206@rename-it.nl> Message-ID: <515C1DCE.2010109@rename-it.nl> Op 4/3/2013 1:56 PM, Isak Rubin schreef: > Here you go You're using the listescape plugin. Try putting that in the global mail_plugins setting, e.g.: # usually located in /etc/dovecot/conf.d/10-mail.conf mail_plugins = listescape protocol lda { mail_plugins = $mail_plugins sieve autocreate } protocol imap { mail_plugins = $mail_plugins autocreate } Regards, Stephan. From dot5productions at gmail.com Wed Apr 3 15:40:09 2013 From: dot5productions at gmail.com (Isak Rubin) Date: Wed, 3 Apr 2013 15:40:09 +0300 Subject: [Dovecot] sieve-filter ignoring separator In-Reply-To: <515C1DCE.2010109@rename-it.nl> References: <514AB932.7060808@rename-it.nl> <1363961862597-41000.post@n4.nabble.com> <515C02AB.9050206@rename-it.nl> <515C1DCE.2010109@rename-it.nl> Message-ID: Thanks :) Solved the filtering problem but got a new problem. Filtering now works as expected, but only to existing folders. I tried moving the autocreate plugin to a global level but still does not seem to work. http://pastebin.com/ykvWQg3w Regards Isak 2013/4/3 Stephan Bosch > Op 4/3/2013 1:56 PM, Isak Rubin schreef: > >> Here you go >> > > You're using the listescape plugin. Try putting that in the global > mail_plugins setting, e.g.: > > # usually located in /etc/dovecot/conf.d/10-mail.**conf > mail_plugins = listescape > > protocol lda { > mail_plugins = $mail_plugins sieve autocreate > } > protocol imap { > mail_plugins = $mail_plugins autocreate > } > > > Regards, > > Stephan. > From rs at sys4.de Wed Apr 3 15:53:45 2013 From: rs at sys4.de (Robert Schetterer) Date: Wed, 03 Apr 2013 14:53:45 +0200 Subject: [Dovecot] sieve-filter ignoring separator In-Reply-To: References: <514AB932.7060808@rename-it.nl> <1363961862597-41000.post@n4.nabble.com> <515C02AB.9050206@rename-it.nl> <515C1DCE.2010109@rename-it.nl> Message-ID: <515C2659.7070504@sys4.de> Am 03.04.2013 14:40, schrieb Isak Rubin: > Thanks :) > Solved the filtering problem > > but got a new problem. > > Filtering now works as expected, but only to existing folders. > > I tried moving the autocreate plugin to a global level but still does not > seem to work. > > > http://pastebin.com/ykvWQg3w > > > > Regards > Isak > die you use fileinto :create in the sieve rule ? what is lda_mailbox_autocreate set ? else read i.e http://wiki2.dovecot.org/LDA -m : Destination mailbox (default is INBOX). If the mailbox doesn't exist, it will not be created (unless the lda_mailbox_autocreate setting is set to yes). If message couldn't be saved to the mailbox for any reason, it's delivered to INBOX instead. If Sieve plugin is used, this mailbox is used as the "keep" action's mailbox. It's also used if there is no Sieve script or if the script fails for some reason. Deliveries to namespace prefix will result in saving the mail to INBOX instead. For example if you have "Mail/" namespace, this allows you to specify dovecot-lda -m Mail/$mailbox where mail is stored to Mail/$mailbox or to INBOX if $mailbox is empty. The mailbox name is specified the same as it's visible in IMAP client. For example if you've a Maildir with .box.sub/ directory and your namespace configuration is prefix=INBOX/, separator=/, the correct way to deliver mail there is to use -m INBOX/box/sub > > > > 2013/4/3 Stephan Bosch > >> Op 4/3/2013 1:56 PM, Isak Rubin schreef: >> >>> Here you go >>> >> >> You're using the listescape plugin. Try putting that in the global >> mail_plugins setting, e.g.: >> >> # usually located in /etc/dovecot/conf.d/10-mail.**conf >> mail_plugins = listescape >> >> protocol lda { >> mail_plugins = $mail_plugins sieve autocreate >> } >> protocol imap { >> mail_plugins = $mail_plugins autocreate >> } >> >> >> Regards, >> >> Stephan. >> > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From dot5productions at gmail.com Wed Apr 3 15:59:50 2013 From: dot5productions at gmail.com (Isak Rubin) Date: Wed, 3 Apr 2013 15:59:50 +0300 Subject: [Dovecot] sieve-filter ignoring separator In-Reply-To: <515C2659.7070504@sys4.de> References: <514AB932.7060808@rename-it.nl> <1363961862597-41000.post@n4.nabble.com> <515C02AB.9050206@rename-it.nl> <515C1DCE.2010109@rename-it.nl> <515C2659.7070504@sys4.de> Message-ID: # egrep -rn lda_mailbox_autocreate /etc/dovecot/conf.d/ /etc/dovecot/conf.d/15-lda.conf:41:lda_mailbox_autocreate = yes if header :regex "From" "([a-zA-Z0-9._%+-]+)(@)([a-zA-Z0-9._%+-]+)" { set :lower "person" "${1}"; set :lower "domain" "${3}"; fileinto "INBOX/bydomain/${domain}/${person}"; stop; } Robert: Autocreate works fine using lda, the issue here is when running sieve filters manually using sieve-filter When receiving mails they are sorted and created and everything works fine, but I need to be able to manually execute sieve scripts on some folders, and that's when it seems unable to autocreate. But i guess lda_mailbox_autocreate is not used at all when running sieve-filter manually, as i assume it just bypass the lda all together Regards Isak 2013/4/3 Robert Schetterer > Am 03.04.2013 14:40, schrieb Isak Rubin: > > Thanks :) > > Solved the filtering problem > > > > but got a new problem. > > > > Filtering now works as expected, but only to existing folders. > > > > I tried moving the autocreate plugin to a global level but still does not > > seem to work. > > > > > > http://pastebin.com/ykvWQg3w > > > > > > > > Regards > > Isak > > > > die you use > > fileinto :create in the sieve rule ? > > what is lda_mailbox_autocreate set ? > > else read i.e > > http://wiki2.dovecot.org/LDA > > -m : Destination mailbox (default is INBOX). If the mailbox > doesn't exist, it will not be created (unless the lda_mailbox_autocreate > setting is set to yes). If message couldn't be saved to the mailbox for > any reason, it's delivered to INBOX instead. > > If Sieve plugin is used, this mailbox is used as the "keep" action's > mailbox. It's also used if there is no Sieve script or if the script > fails for some reason. > > Deliveries to namespace prefix will result in saving the mail to > INBOX instead. For example if you have "Mail/" namespace, this allows > you to specify dovecot-lda -m Mail/$mailbox where mail is stored to > Mail/$mailbox or to INBOX if $mailbox is empty. > > The mailbox name is specified the same as it's visible in IMAP > client. For example if you've a Maildir with .box.sub/ directory and > your namespace configuration is prefix=INBOX/, separator=/, the correct > way to deliver mail there is to use -m INBOX/box/sub > > > > > > > > > > 2013/4/3 Stephan Bosch > > > >> Op 4/3/2013 1:56 PM, Isak Rubin schreef: > >> > >>> Here you go > >>> > >> > >> You're using the listescape plugin. Try putting that in the global > >> mail_plugins setting, e.g.: > >> > >> # usually located in /etc/dovecot/conf.d/10-mail.**conf > >> mail_plugins = listescape > >> > >> protocol lda { > >> mail_plugins = $mail_plugins sieve autocreate > >> } > >> protocol imap { > >> mail_plugins = $mail_plugins autocreate > >> } > >> > >> > >> Regards, > >> > >> Stephan. > >> > > > > > > Best Regards > MfG Robert Schetterer > > -- > [*] sys4 AG > > http://sys4.de, +49 (89) 30 90 46 64 > Franziskanerstra?e 15, 81669 M?nchen > > Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 > Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer > Aufsichtsratsvorsitzender: Joerg Heidrich > From rs at sys4.de Wed Apr 3 16:12:20 2013 From: rs at sys4.de (Robert Schetterer) Date: Wed, 03 Apr 2013 15:12:20 +0200 Subject: [Dovecot] sieve-filter ignoring separator In-Reply-To: References: <514AB932.7060808@rename-it.nl> <1363961862597-41000.post@n4.nabble.com> <515C02AB.9050206@rename-it.nl> <515C1DCE.2010109@rename-it.nl> <515C2659.7070504@sys4.de> Message-ID: <515C2AB4.3070408@sys4.de> Am 03.04.2013 14:59, schrieb Isak Rubin: > # egrep -rn lda_mailbox_autocreate /etc/dovecot/conf.d/ > /etc/dovecot/conf.d/15-lda.conf:41:lda_mailbox_autocreate = yes > > if header :regex "From" "([a-zA-Z0-9._%+-]+)(@)([a-zA-Z0-9._%+-]+)" { > set :lower "person" "${1}"; > set :lower "domain" "${3}"; > fileinto "INBOX/bydomain/${domain}/${person}"; > stop; > } > > Robert: Autocreate works fine using lda, the issue here is when running > sieve filters manually using sieve-filter > When receiving mails they are sorted and created and everything works fine, > but I need to be able to manually execute sieve scripts on some folders, > and that's when it seems unable to autocreate. > > But i guess lda_mailbox_autocreate is not used at all when running > sieve-filter manually, as i assume it just bypass the lda all together > try fileinto :create ..... http://wiki2.dovecot.org/Pigeonhole/Sieve/Examples i.e like require ["variables","date","fileinto","mailbox"]; # Extract date info if currentdate :matches "year" "*" { set "year" "${1}"; } if currentdate :matches "month" "*" { set "month" "${1}"; } # Archive Dovecot mailing list items by year and month. # Create folder when it does not exist. if header :is "list-id" "dovecot.dovecot.org" { fileinto :create "INBOX.Lists.${year}.${month}.dovecot"; } > > Regards > Isak > > > > 2013/4/3 Robert Schetterer > >> Am 03.04.2013 14:40, schrieb Isak Rubin: >>> Thanks :) >>> Solved the filtering problem >>> >>> but got a new problem. >>> >>> Filtering now works as expected, but only to existing folders. >>> >>> I tried moving the autocreate plugin to a global level but still does not >>> seem to work. >>> >>> >>> http://pastebin.com/ykvWQg3w >>> >>> >>> >>> Regards >>> Isak >>> >> >> die you use >> >> fileinto :create in the sieve rule ? >> >> what is lda_mailbox_autocreate set ? >> >> else read i.e >> >> http://wiki2.dovecot.org/LDA >> >> -m : Destination mailbox (default is INBOX). If the mailbox >> doesn't exist, it will not be created (unless the lda_mailbox_autocreate >> setting is set to yes). If message couldn't be saved to the mailbox for >> any reason, it's delivered to INBOX instead. >> >> If Sieve plugin is used, this mailbox is used as the "keep" action's >> mailbox. It's also used if there is no Sieve script or if the script >> fails for some reason. >> >> Deliveries to namespace prefix will result in saving the mail to >> INBOX instead. For example if you have "Mail/" namespace, this allows >> you to specify dovecot-lda -m Mail/$mailbox where mail is stored to >> Mail/$mailbox or to INBOX if $mailbox is empty. >> >> The mailbox name is specified the same as it's visible in IMAP >> client. For example if you've a Maildir with .box.sub/ directory and >> your namespace configuration is prefix=INBOX/, separator=/, the correct >> way to deliver mail there is to use -m INBOX/box/sub >> >> >>> >>> >>> >>> 2013/4/3 Stephan Bosch >>> >>>> Op 4/3/2013 1:56 PM, Isak Rubin schreef: >>>> >>>>> Here you go >>>>> >>>> >>>> You're using the listescape plugin. Try putting that in the global >>>> mail_plugins setting, e.g.: >>>> >>>> # usually located in /etc/dovecot/conf.d/10-mail.**conf >>>> mail_plugins = listescape >>>> >>>> protocol lda { >>>> mail_plugins = $mail_plugins sieve autocreate >>>> } >>>> protocol imap { >>>> mail_plugins = $mail_plugins autocreate >>>> } >>>> >>>> >>>> Regards, >>>> >>>> Stephan. >>>> >>> >> >> >> >> Best Regards >> MfG Robert Schetterer >> >> -- >> [*] sys4 AG >> >> http://sys4.de, +49 (89) 30 90 46 64 >> Franziskanerstra?e 15, 81669 M?nchen >> >> Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 >> Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer >> Aufsichtsratsvorsitzender: Joerg Heidrich >> > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From damoxc at gmail.com Wed Apr 3 16:23:51 2013 From: damoxc at gmail.com (Damien Churchill) Date: Wed, 3 Apr 2013 14:23:51 +0100 Subject: [Dovecot] Mongo backend for userdb and passdb In-Reply-To: References: <1363775990.10326.240.camel@innu> <1363776852.10326.243.camel@innu> Message-ID: On 20 March 2013 10:59, Damien Churchill wrote: > On 20 March 2013 10:54, Timo Sirainen wrote: > > On Wed, 2013-03-20 at 10:40 +0000, Damien Churchill wrote: > >> On 20 March 2013 10:39, Timo Sirainen wrote: > >> > On Wed, 2013-03-20 at 10:29 +0000, Damien Churchill wrote: > >> > > >> >> I've been messing about with this and I think a similar configuration > >> >> format to the sql dict driver would be handy, although I imagine the > >> >> same could also be achieved with just lots of uri arguments. Mongo > >> >> isn't really a key/value store so you'd want to be able to specify > >> >> fields within the document to query upon/fetch. > >> >> > >> >> I'm still getting to grips with the architecture of things so not > >> >> entirely sure what the best course of action would be here. If using > >> >> the map style config would be desirable then creating some shared > >> >> parser that sql and mongodb can use would be good. > >> > > >> > I've been planning on having one generic dict sql-like configuration > for > >> > all dict backends, so you could map different dict paths to different > >> > backends. So the idea is good, but probably quite a lot of work. > >> > > >> > >> Would it not be just some bastardised version of dict-sql-settings? > > > > I guess you could do that for now. The grand plans of how to put > > everything nicely together can wait. :) > > > > For now I think I can get away with just tacking on uri arguments. > Seems silly duplicating effort, although if you'd like me to give it a > shot I'm happy to do so! > Hi, I've pushed an initial copy of what I've got so far to bitbucket[0]. I'm in two minds currently about how to correctly handle returning the json object that the userdb/passdb backend expects. Currently the config file is copying mostly what dict-sql does: connect = host=localhost:port=27017:db=mail map { pattern = shared/passdb/$user collection = users username_field = email value_field = password fields { email = $user } } map { pattern = shared/userdb/$user collection = users username_field = email value_field = password fields { email = $user } values { home = /home/vmail uid = 5000 gid = 5000 } } value_field isn't currently used at all, and the values map just provides some default values that will be replaced if they exist in the returned document. The part I'm wondering is how to allow the object you end returning as flexible as what is currently possible with the sql passdb/userdb queries. May have to ultimately bite the bullet and accept that it won't be. Primarily it would be good to be able to concat strings with fields returned for building the quota rule or something similar. Just wondered what your thoughts were on this? [0] https://bitbucket.org/damoxc/dovecot-2.2-mongodb/commits/0dee37209ff9f4b2f84979beb29a1315a0ba00a9 From dot5productions at gmail.com Wed Apr 3 16:28:17 2013 From: dot5productions at gmail.com (Isak Rubin) Date: Wed, 3 Apr 2013 16:28:17 +0300 Subject: [Dovecot] sieve-filter ignoring separator In-Reply-To: <515C2AB4.3070408@sys4.de> References: <514AB932.7060808@rename-it.nl> <1363961862597-41000.post@n4.nabble.com> <515C02AB.9050206@rename-it.nl> <515C1DCE.2010109@rename-it.nl> <515C2659.7070504@sys4.de> <515C2AB4.3070408@sys4.de> Message-ID: Thanks! I had :create on 90% of the filters but it was missing on a few, added it on the rest and now everything is working perfectly. Thanks a lot for the help Regards Isak 2013/4/3 Robert Schetterer > Am 03.04.2013 14:59, schrieb Isak Rubin: > > # egrep -rn lda_mailbox_autocreate /etc/dovecot/conf.d/ > > /etc/dovecot/conf.d/15-lda.conf:41:lda_mailbox_autocreate = yes > > > > if header :regex "From" "([a-zA-Z0-9._%+-]+)(@)([a-zA-Z0-9._%+-]+)" { > > set :lower "person" "${1}"; > > set :lower "domain" "${3}"; > > fileinto "INBOX/bydomain/${domain}/${person}"; > > stop; > > } > > > > Robert: Autocreate works fine using lda, the issue here is when running > > sieve filters manually using sieve-filter > > When receiving mails they are sorted and created and everything works > fine, > > but I need to be able to manually execute sieve scripts on some folders, > > and that's when it seems unable to autocreate. > > > > But i guess lda_mailbox_autocreate is not used at all when running > > sieve-filter manually, as i assume it just bypass the lda all together > > > > > try fileinto :create ..... > > http://wiki2.dovecot.org/Pigeonhole/Sieve/Examples > > i.e like > > require ["variables","date","fileinto","mailbox"]; > > # Extract date info > if currentdate :matches "year" "*" { set "year" "${1}"; } > if currentdate :matches "month" "*" { set "month" "${1}"; } > > # Archive Dovecot mailing list items by year and month. > # Create folder when it does not exist. > if header :is "list-id" "dovecot.dovecot.org" { > fileinto :create "INBOX.Lists.${year}.${month}.dovecot"; > } > > > > > Regards > > Isak > > > > > > > > 2013/4/3 Robert Schetterer > > > >> Am 03.04.2013 14:40, schrieb Isak Rubin: > >>> Thanks :) > >>> Solved the filtering problem > >>> > >>> but got a new problem. > >>> > >>> Filtering now works as expected, but only to existing folders. > >>> > >>> I tried moving the autocreate plugin to a global level but still does > not > >>> seem to work. > >>> > >>> > >>> http://pastebin.com/ykvWQg3w > >>> > >>> > >>> > >>> Regards > >>> Isak > >>> > >> > >> die you use > >> > >> fileinto :create in the sieve rule ? > >> > >> what is lda_mailbox_autocreate set ? > >> > >> else read i.e > >> > >> http://wiki2.dovecot.org/LDA > >> > >> -m : Destination mailbox (default is INBOX). If the mailbox > >> doesn't exist, it will not be created (unless the lda_mailbox_autocreate > >> setting is set to yes). If message couldn't be saved to the mailbox for > >> any reason, it's delivered to INBOX instead. > >> > >> If Sieve plugin is used, this mailbox is used as the "keep" action's > >> mailbox. It's also used if there is no Sieve script or if the script > >> fails for some reason. > >> > >> Deliveries to namespace prefix will result in saving the mail to > >> INBOX instead. For example if you have "Mail/" namespace, this allows > >> you to specify dovecot-lda -m Mail/$mailbox where mail is stored to > >> Mail/$mailbox or to INBOX if $mailbox is empty. > >> > >> The mailbox name is specified the same as it's visible in IMAP > >> client. For example if you've a Maildir with .box.sub/ directory and > >> your namespace configuration is prefix=INBOX/, separator=/, the correct > >> way to deliver mail there is to use -m INBOX/box/sub > >> > >> > >>> > >>> > >>> > >>> 2013/4/3 Stephan Bosch > >>> > >>>> Op 4/3/2013 1:56 PM, Isak Rubin schreef: > >>>> > >>>>> Here you go > >>>>> > >>>> > >>>> You're using the listescape plugin. Try putting that in the global > >>>> mail_plugins setting, e.g.: > >>>> > >>>> # usually located in /etc/dovecot/conf.d/10-mail.**conf > >>>> mail_plugins = listescape > >>>> > >>>> protocol lda { > >>>> mail_plugins = $mail_plugins sieve autocreate > >>>> } > >>>> protocol imap { > >>>> mail_plugins = $mail_plugins autocreate > >>>> } > >>>> > >>>> > >>>> Regards, > >>>> > >>>> Stephan. > >>>> > >>> > >> > >> > >> > >> Best Regards > >> MfG Robert Schetterer > >> > >> -- > >> [*] sys4 AG > >> > >> http://sys4.de, +49 (89) 30 90 46 64 > >> Franziskanerstra?e 15, 81669 M?nchen > >> > >> Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 > >> Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer > >> Aufsichtsratsvorsitzender: Joerg Heidrich > >> > > > > > > Best Regards > MfG Robert Schetterer > > -- > [*] sys4 AG > > http://sys4.de, +49 (89) 30 90 46 64 > Franziskanerstra?e 15, 81669 M?nchen > > Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 > Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer > Aufsichtsratsvorsitzender: Joerg Heidrich > From dan.clovis1 at gmail.com Wed Apr 3 16:41:22 2013 From: dan.clovis1 at gmail.com (Dan Clovis) Date: Wed, 03 Apr 2013 14:41:22 +0100 Subject: [Dovecot] Username and Email Message-ID: <515C3182.3040403@gmail.com> Ave Maria! I'm completely new to Dovecot, I was just wondering if the username (POP3) can be completely different to the POP3 email? God Bless Dan From gedalya at gedalya.net Wed Apr 3 18:16:37 2013 From: gedalya at gedalya.net (Gedalya) Date: Wed, 03 Apr 2013 11:16:37 -0400 Subject: [Dovecot] Username and Email In-Reply-To: <515C3182.3040403@gmail.com> References: <515C3182.3040403@gmail.com> Message-ID: <515C47D5.60109@gedalya.net> No reason why not. Just set it up so that the given login gets the right home/mail location http://wiki2.dovecot.org/PasswordDatabase http://wiki2.dovecot.org/UserDatabase On 04/03/2013 09:41 AM, Dan Clovis wrote: > Ave Maria! > > I'm completely new to Dovecot, I was just wondering if the username > (POP3) can be completely different to the POP3 email? > > God Bless > > Dan From hummel at pasteur.fr Wed Apr 3 18:42:20 2013 From: hummel at pasteur.fr (Thomas Hummel) Date: Wed, 3 Apr 2013 17:42:20 +0200 Subject: [Dovecot] Maildirs location migration Message-ID: <20130403154220.GA25793@parmesan.sis.pasteur.fr> Hello Timo, I'm using dovecot-2.1.15 with Maildir mailboxes located on an NFS filer. Postfix is used to deliver mail through procmail ("mailbox_command) as LDA. Our team has bought another filer and everything is meant to go on it, so we're planning to migrate those mailboxes to the new filer. To test it only on a subset of users, I ended up to the following solution : 1. keep new messages in postfix mailqueue for those users (via a service and a transport) 2. prevent new dovecot authentication for those users (via the "auth-deny" passwd-file type passdb) 3. doveadm kick those users 4. copy or rsync the mailboxes 5. symlink maildir, control and indexes directories to the new filer (nfs mounted on the mail server) 6. re-enable mail delivery and imap authentication I was wondering if such a migration could be done differently in order to be seamless to the user : - for the postfix part, it would be easy, I guess, to create a new service (and a new transport map using this service) to deliver to the new location - but for the imap part, I'm not sure if it can be done. My guess is that, if feasible, it would involve some namespace settings and a dsync copy but I cannot figure out how exactly. What do you think ? Thanks -- Thomas Hummel | Institut Pasteur | Groupe Exploitation et Infrastructure From kavish.karkera at yahoo.com Wed Apr 3 19:32:51 2013 From: kavish.karkera at yahoo.com (Kavish Karkera) Date: Thu, 4 Apr 2013 00:32:51 +0800 (SGT) Subject: [Dovecot] Error : File too large Message-ID: <1365006771.52191.YahooMailNeo@web193505.mail.sg3.yahoo.com> Hi , When accessing mails through webmail(roundcube), we were getting below error's in huge Please help to know .. what this error is related to.. dovecot version , we are using is 2.1.15 Mar 28 15:37:47 imapserver dovecot: imap(cel_default): Error: rename(/mail/mailstore/linoquery.com/lino_default/Maildir/new/1364463180.M563166P30867.imapserver,S=3263,W=3309, /mail/mailstore/linoquery.com/lino_default/Maildir/cur/1364463180.M563166P30867.imapserver,S=3263,W=3309:2,) failed: File too large Thanks, Kavish Karkera From kjonca at o2.pl Wed Apr 3 19:44:27 2013 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Wed, 03 Apr 2013 18:44:27 +0200 Subject: [Dovecot] Error : File too large References: <1365006771.52191.YahooMailNeo@web193505.mail.sg3.yahoo.com> Message-ID: <87ppybmums.fsf@alfa.kjonca> Kavish Karkera writes: > Hi , > > > When accessing mails through webmail(roundcube), we were getting below error's in huge > > Please help to know .. what this error is related to.. > > dovecot version , we are using is 2.1.15 > > > Mar 28 15:37:47 imapserver dovecot: imap(cel_default): Error: > rename(/mail/mailstore/linoquery.com/lino_default/Maildir/new/1364463180.M563166P30867.imapserver,S=3263,W=3309, > /mail/mailstore/linoquery.com/lino_default/Maildir/cur/1364463180.M563166P30867.imapserver,S=3263,W=3309:2,) > failed: File too large What filesystem? And how many files in /mail/mailstore/linoquery.com/lino_default/Maildir/cur/ so far? It sounds than you reached files-per-dir limit (~32K for ext3, 64K for ext4, for example) -- http://modnebzdury.wordpress.com/2009/10/01/niewiarygodny-list-prof-majewskiej-wprowadzenie/ Made with real ingredients. From kavish.karkera at yahoo.com Wed Apr 3 19:55:51 2013 From: kavish.karkera at yahoo.com (Kavish Karkera) Date: Thu, 4 Apr 2013 00:55:51 +0800 (SGT) Subject: [Dovecot] Error : File too large In-Reply-To: <87ppybmums.fsf@alfa.kjonca> References: <1365006771.52191.YahooMailNeo@web193505.mail.sg3.yahoo.com> <87ppybmums.fsf@alfa.kjonca> Message-ID: <1365008151.57089.YahooMailNeo@web193503.mail.sg3.yahoo.com> Thanks Kamil for your instant reply :) Our /mail partion is nfs mounted.(NetApp) There are about 1,70,000 files in Maildir Regards, Kavish Karkera ________________________________ From: Kamil Jo?ca To: dovecot at dovecot.org Sent: Wednesday, 3 April 2013 10:14 PM Subject: Re: [Dovecot] Error : File too large Kavish Karkera writes: > Hi , > > > When accessing mails through webmail(roundcube), we were getting below error's in huge > > Please help to know .. what this error is related to.. > > dovecot version , we are using is 2.1.15 > > > Mar 28 15:37:47 imapserver dovecot: imap(cel_default): Error: > rename(/mail/mailstore/linoquery.com/lino_default/Maildir/new/1364463180.M563166P30867.imapserver,S=3263,W=3309, > /mail/mailstore/linoquery.com/lino_default/Maildir/cur/1364463180.M563166P30867.imapserver,S=3263,W=3309:2,) > failed: File too large What filesystem? And how many files in /mail/mailstore/linoquery.com/lino_default/Maildir/cur/ so far? It sounds than you reached files-per-dir limit (~32K for ext3, 64K for ext4, for example) -- http://modnebzdury.wordpress.com/2009/10/01/niewiarygodny-list-prof-majewskiej-wprowadzenie/ Made with real ingredients. From kjonca at o2.pl Wed Apr 3 20:04:04 2013 From: kjonca at o2.pl (Kamil =?iso-8859-2?Q?Jo=F1ca?=) Date: Wed, 03 Apr 2013 19:04:04 +0200 Subject: [Dovecot] Error : File too large References: <1365006771.52191.YahooMailNeo@web193505.mail.sg3.yahoo.com> <87ppybmums.fsf@alfa.kjonca> Message-ID: <87ehermtq3.fsf@alfa.kjonca> kjonca at o2.pl (Kamil Jo?ca) writes: [...] > > What filesystem? And how many files in > /mail/mailstore/linoquery.com/lino_default/Maildir/cur/ so far? > It sounds than you reached files-per-dir limit (~32K for ext3, 64K for > ext4, for example) Sorry for that noise. These limits in ext3/4 are for subdir count. KJ -- http://sporothrix.wordpress.com/2011/01/16/usa-sie-krztusza-kto-nastepny/ Keyboard error press F1 continue From delrio at mie.utoronto.ca Wed Apr 3 22:57:31 2013 From: delrio at mie.utoronto.ca (Oscar del Rio) Date: Wed, 03 Apr 2013 15:57:31 -0400 Subject: [Dovecot] Error : File too large In-Reply-To: <1365008151.57089.YahooMailNeo@web193503.mail.sg3.yahoo.com> References: <1365006771.52191.YahooMailNeo@web193505.mail.sg3.yahoo.com> <87ppybmums.fsf@alfa.kjonca> <1365008151.57089.YahooMailNeo@web193503.mail.sg3.yahoo.com> Message-ID: <515C89AB.8060200@mie.utoronto.ca> On 04/ 3/13 12:55 PM, Kavish Karkera wrote: > Our /mail partion is nfs mounted.(NetApp) > > There are about 1,70,000 files in Maildir Probably reached NetApp's "maxdirsize" limit... From mastertoilet at netzero.net Thu Apr 4 05:27:19 2013 From: mastertoilet at netzero.net (mastertoilet at netzero.net) Date: Thu, 4 Apr 2013 02:27:19 GMT Subject: [Dovecot] maildirsize problem Message-ID: <20130403.192719.27464.0@webmail05.dca.untd.com> i am currently using roundcube my webmail and configure using dovecot quota plugins. but it seems to not be updating the maildirsize when new mails comes.Deleting the maildirsize will recreate the files correctly.Is there any solutions to this problem with dovecot. Either you're not using dovecot-lda to deliver the mails, or you haven't configured quota plugin correctly for it. dovecot -n output and logs about a mail delivery would help. My configuration is using Centos 6.dovecot 2.1.1.and i have configure the quota plugin.but i am not sure what you mean by dovecot-lda.i just follow the guides on the internet and skim through dovecots documentation.i am using the local unix account for mail account not using virtual users.here is my configuration: [root at mail ~]# dovecot -n # 2.1.1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.el6.x86_64 x86_64 CentOS release 6.3 (Final) base_dir = /var/run/dovecot/ mail_debug = yes mail_location = maildir:~/Maildir mail_plugins = " quota" maildir_broken_filename_sizes = yes mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { quota = maildir:User quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } ssl = required ssl_cert = References: <20130403165922.33300812@batzmaru.gol.ad.jp> <515C00D5.9010008@wildgooses.com> Message-ID: <20130404115609.07cb3739@batzmaru.gol.ad.jp> On Wed, 03 Apr 2013 11:13:41 +0100 Ed W wrote: > Hi > > > I presume to best support all(?) clients out there is to have > > "local_name" sections for SNI first and then "local" sections for IP > > address based certs. It is my understanding that SNI needs to be > > requested by the client, so aside from client bugs (nah, those don't > > exist ^o^) every client should get an appropriate response for TLS. > > Has anybody done a setup like that already? > > > > Although not what you asked for, just so you are aware, Godaddy (boo > hiss, etc) offer reasonably inexpensive multi subject alt name based > certs. This means you can have a single cert which is valid for lots of > completely different domain names. The mild benefit is that this > doesn't require SNI support for SSL (which I'm unsure is supported by > many mail clients?) > Yeah, I'm aware of multi-domain (SAN) certs, however there are 2 gotchas with those that our support and the OEMs this is for might not approve of: 1. Only the primary host will actually be validated/authenticated, which at least with some browsers will result in this being pointed out to the user when they connect to a SAN. Not sure about mail clients, but webmail is also in that overall deal, so support is probably not going to like the potential "concerned you got hacked" phone calls from customers. 2. Despite the fact that it will be trivial for anybody to determine that OEM A is now hosted with us, a SAN SSL makes all the SANs visible in one go, something they probably don't want. We're talking a small (10ish) number of OEMs here, so I'm happy and willing to throw some IP addresses at this particular problem and have everybody use (and deal with!) their own certs. As for SNI, supposedly most PC clients will support it, while most mobile ones don't. In my scenario it doesn't matter either way, the idea is to hand the correct cert to a client that requests it via SNI and for all the others based on the IP address they connected to. If everybody can be taught to use only TLS (not IMAPS/POP3S) and all the clients do support SNI, we can do away with the dedicated IP addresses. Might even happen before the heat death of the universe. ^o^ Regards, Christian -- Christian Balzer Network/Systems Engineer chibi at gol.com Global OnLine Japan/Fusion Communications http://www.gol.com/ From noel.butler at ausics.net Thu Apr 4 07:05:49 2013 From: noel.butler at ausics.net (Noel Butler) Date: Thu, 04 Apr 2013 14:05:49 +1000 Subject: [Dovecot] maildirsize problem In-Reply-To: <20130403.192719.27464.0@webmail05.dca.untd.com> References: <20130403.192719.27464.0@webmail05.dca.untd.com> Message-ID: <1365048349.9630.2.camel@tardis> On Thu, 2013-04-04 at 02:27 +0000, mastertoilet at netzero.net wrote: > passdb { > driver = pam > } > > i am still not sure why maildirsize is not updating.thanks > _______ Because dovecot (dovecot-lda) is not delivering the mails to the maildir, postfix is. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From kadafax at gmail.com Thu Apr 4 10:07:40 2013 From: kadafax at gmail.com (kadafax at gmail.com) Date: Thu, 04 Apr 2013 09:07:40 +0200 Subject: [Dovecot] Crash while moving mail between private folder and shared folder In-Reply-To: References: <514D6FFD.8000808@taunusstein.net> <515317E3.8090402@gmail.com> Message-ID: <515D26BC.6090803@gmail.com> Le 31/03/13 16:26, Timo Sirainen a ?crit : > On 27.3.2013, at 18.01, kadafax at gmail.com wrote: > >> Just to bump the OP message as I experience the exact same symptom with the same configuration. That is: when moving an email to a virtual mailboxes, dovecot crash (and sometime the email disappears from the real mailbox). > I'm guessing your error was different though. These should fix them: > > http://hg.dovecot.org/dovecot-2.2/rev/12136db6e31f > http://hg.dovecot.org/dovecot-2.2/rev/9a8119326bd0 > > (not sure if http://hg.dovecot.org/dovecot-2.2/rev/f31d241d5371 is also required) Thanks Timo, this fixed my issue (yesterday's pull of the mercurial repo). You are the internet IMAP Hero. Have a nice day, kfx From piotr.rotter at active24.pl Thu Apr 4 21:08:32 2013 From: piotr.rotter at active24.pl (Piotr Rotter) Date: Thu, 04 Apr 2013 20:08:32 +0200 Subject: [Dovecot] problem with dovecot lmtp via director Message-ID: <515DC1A0.1080907@active24.pl> Hello, I have strange problem with delivering mails via dovecot lmtp via director and i have not idea what is wrong. After server restart bigger mails does not delivered. Postfix servers log that: 2013-04-04T19:55:38.919624+02:00 kurier9 postfix/lmtp[16620]: 3ZhWF337X5z89h3: to=, relay=192.168.67.1[192.168.67.1]:24, delay=1987, delays=1987/0/0/0.04, dsn=4.3.0, status=deferred (host 192.168.67.1[192.168.67.1] said: 451 4.3.0 Temporary internal failure (in reply to end of DATA command)) 2013-04-04T19:58:41.238926+02:00 kurier9 postfix/lmtp[16620]: 3ZhWF337X5z89h3: to=, relay=192.168.67.1[192.168.67.1]:24, delay=2170, delays=1990/0/0/180, dsn=4.4.2, status=deferred (conversation with 192.168.67.1[192.168.67.1] timed out while sending message body) Director server log something like that: 2013-04-04T20:00:45+02:00 r1 dovecot: lmtp(18447): Disconnect from 192.168.67.24: Temporary internal failure (in DATA) Dovecot servers log that: 2013-04-04T20:03:37.347279+02:00 k1 dovecot: lmtp(9380): Disconnect from 192.168.111.1: Connection closed (in RCPT TO) Please help because I have not idea what is wrong and queue growing up. Best regards Piotr Rotter From tss at iki.fi Thu Apr 4 21:10:21 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 04 Apr 2013 21:10:21 +0300 Subject: [Dovecot] problem with dovecot lmtp via director In-Reply-To: <515DC1A0.1080907@active24.pl> References: <515DC1A0.1080907@active24.pl> Message-ID: <1365099021.11047.90.camel@innu> On Thu, 2013-04-04 at 20:08 +0200, Piotr Rotter wrote: > I have strange problem with delivering mails via dovecot lmtp via > director and i have not idea what is wrong. What Dovecot version in director and in backend? doveconf -n output from them? If director is v2.0, upgrade to v2.1 which has several LMTP proxy fixes. From piotr.rotter at active24.pl Thu Apr 4 21:18:09 2013 From: piotr.rotter at active24.pl (Piotr Rotter) Date: Thu, 04 Apr 2013 20:18:09 +0200 Subject: [Dovecot] problem with dovecot lmtp via director In-Reply-To: <1365099021.11047.90.camel@innu> References: <515DC1A0.1080907@active24.pl> <1365099021.11047.90.camel@innu> Message-ID: <515DC3E1.4070008@active24.pl> W dniu 04.04.2013 20:10, Timo Sirainen pisze: > On Thu, 2013-04-04 at 20:08 +0200, Piotr Rotter wrote: > >> I have strange problem with delivering mails via dovecot lmtp via >> director and i have not idea what is wrong. > > What Dovecot version in director and in backend? doveconf -n output from > them? If director is v2.0, upgrade to v2.1 which has several LMTP proxy > fixes. > > Hello, Thanks for super fast respond. Sorry I forgot paste dovecot configs. I use v2.1.13 in all servers Director config: ############################################################################### ############################################################################### dovecot -n # 2.1.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.39-gentoo-r3 x86_64 Gentoo Base System release 2.0.3 auth_mechanisms = plain login digest-md5 cram-md5 ntlm apop auth_verbose = yes default_client_limit = 100000 default_process_limit = 10000 default_vsz_limit = 512 M deliver_log_format = from=%f, msgid=%m, psize=%p: %$ director_mail_servers = 192.168.111.21 192.168.111.22 192.168.111.23 192.168.111.24 192.168.111.25 192.168.111.26 director_servers = 192.168.67.1 director_user_expire = 30 mins disable_plaintext_auth = no lmtp_proxy = yes login_greeting = Active24 Sp. z o.o. passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = box msgid from size } service auth-worker { user = root } service auth { client_limit = 100000 unix_listener auth-userdb { group = dovecot mode = 0600 user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9090 } unix_listener director-userdb { group = vmail mode = 0600 user = vmail } unix_listener login/director { mode = 0666 } } service imap-login { client_limit = 1000 executable = imap-login director process_limit = 1000 service_count = 1000 } service lmtp { inet_listener lmtp { address = 192.168.67.1 port = 24 } process_limit = 1000 process_min_avail = 5 user = vmail } service pop3-login { client_limit = 1000 executable = pop3-login director process_limit = 1000 service_count = 1000 } ssl_ca = References: <515DC1A0.1080907@active24.pl> <1365099021.11047.90.camel@innu> <515DC3E1.4070008@active24.pl> Message-ID: <515DC653.6060809@active24.pl> W dniu 04.04.2013 20:18, Piotr Rotter pisze: > W dniu 04.04.2013 20:10, Timo Sirainen pisze: >> On Thu, 2013-04-04 at 20:08 +0200, Piotr Rotter wrote: >> >>> I have strange problem with delivering mails via dovecot lmtp via >>> director and i have not idea what is wrong. >> >> What Dovecot version in director and in backend? doveconf -n output from >> them? If director is v2.0, upgrade to v2.1 which has several LMTP proxy >> fixes. >> >> > > Hello, > > Thanks for super fast respond. > Sorry I forgot paste dovecot configs. > I use v2.1.13 in all servers > > Director config: > > ############################################################################### > > ############################################################################### > > > dovecot -n > # 2.1.13: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.39-gentoo-r3 x86_64 Gentoo Base System release 2.0.3 > auth_mechanisms = plain login digest-md5 cram-md5 ntlm apop > auth_verbose = yes > default_client_limit = 100000 > default_process_limit = 10000 > default_vsz_limit = 512 M > deliver_log_format = from=%f, msgid=%m, psize=%p: %$ > director_mail_servers = 192.168.111.21 192.168.111.22 192.168.111.23 > 192.168.111.24 192.168.111.25 192.168.111.26 > director_servers = 192.168.67.1 > director_user_expire = 30 mins > disable_plaintext_auth = no > lmtp_proxy = yes > login_greeting = Active24 Sp. z o.o. > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > plugin { > mail_log_events = delete undelete expunge copy mailbox_delete > mailbox_rename > mail_log_fields = box msgid from size > } > service auth-worker { > user = root > } > service auth { > client_limit = 100000 > unix_listener auth-userdb { > group = dovecot > mode = 0600 > user = dovecot > } > } > service director { > fifo_listener login/proxy-notify { > mode = 0666 > } > inet_listener { > port = 9090 > } > unix_listener director-userdb { > group = vmail > mode = 0600 > user = vmail > } > unix_listener login/director { > mode = 0666 > } > } > service imap-login { > client_limit = 1000 > executable = imap-login director > process_limit = 1000 > service_count = 1000 > } > service lmtp { > inet_listener lmtp { > address = 192.168.67.1 > port = 24 > } > process_limit = 1000 > process_min_avail = 5 > user = vmail > } > service pop3-login { > client_limit = 1000 > executable = pop3-login director > process_limit = 1000 > service_count = 1000 > } > ssl_ca = ssl_cert = ssl_key = userdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > protocol imap { > mail_max_userip_connections = 20 > } > protocol lmtp { > auth_socket_path = director-userdb > } > > ############################################################################### > > ############################################################################### > > > dovecot servers config: > > # 2.1.13: /etc/dovecot/dovecot.conf > # OS: Linux 3.5.2-hardened-r4 x86_64 Gentoo Base System release 2.2 > auth_mechanisms = plain login digest-md5 cram-md5 ntlm apop > auth_verbose = yes > default_client_limit = 10000 > default_process_limit = 1000 > default_vsz_limit = 512 M > deliver_log_format = from=%f, msgid=%m, psize=%p: %$ > disable_plaintext_auth = no > dotlock_use_excl = no > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > login_greeting = Active24 Sp. z o.o. > mail_access_groups = vmail > mail_fsync = always > mail_gid = 502 > mail_location = maildir:~/ > mail_nfs_index = yes > mail_nfs_storage = yes > mail_plugins = mail_log notify quota > mail_uid = 502 > mmap_disable = yes > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > plugin { > autocreate = Trash > autocreate2 = Spam > autocreate3 = Sent > autocreate4 = Drafts > autosubscribe = Trash > autosubscribe2 = Spam > autosubscribe3 = Sent > autosubscribe4 = Drafts > mail_log_events = delete undelete expunge copy mailbox_delete > mailbox_rename > mail_log_fields = box msgid from size > quota = maildir > quota2 = maildir:user quota > quota_rule = *:storage=10GB > quota_rule2 = *:messages=10000 > quota_rule3 = Trash:storage=+10M > quota_rule4 = Trash:messages=+100 > quota_warning = storage=80%% quota-warning 80 %u > quota_warning2 = storage=90%% quota-warning 90 %u > quota_warning3 = storage=100%% quota-warning 100 %u > sieve_global_path = /etc/dovecot/sieve/default.sieve > } > sendmail_path = /usr/sbin/postfix > service auth { > client_limit = 12000 > unix_listener auth-userdb { > group = vmail > mode = 0600 > user = vmail > } > } > service imap-login { > process_limit = 1024 > process_min_avail = 6 > service_count = 100 > } > service imap { > process_limit = 4096 > process_min_avail = 6 > service_count = 100 > } > service lmtp { > inet_listener lmtp { > address = 0.0.0.0 > port = 24 > } > process_limit = 100 > process_min_avail = 6 > user = vmail > } > service pop3-login { > process_limit = 1024 > process_min_avail = 6 > service_count = 100 > } > service pop3 { > process_limit = 4096 > process_min_avail = 6 > service_count = 100 > } > service quota-warning { > executable = script /opt/bin/quota-warning > unix_listener quota-warning { > mode = 0600 > user = vmail > } > user = vmail > } > ssl_ca = ssl_cert = ssl_key = userdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > protocol lmtp { > mail_plugins = quota sieve > syslog_facility = mail > } > protocol lda { > info_log_path = > log_path = > mail_plugins = sieve quota > syslog_facility = mail > } > protocol imap { > mail_max_userip_connections = 20 > mail_plugins = mail_log notify quota autocreate imap_quota > } > protocol pop3 { > mail_plugins = mail_log notify quota quota > pop3_save_uidl = yes > } > > $%*# I make panic with simple issue. Too small /tmp directory in tmpfs mount -o remount,size=200M /tmp solve mistake -- Pozdrawiam! / Best regards! ------------------ Piotr Rotter Konsultant IT / IT Consultant =========================================== http://www.ACTIVE24.pl - Powerful hosting - surprisingly easy =========================================== ul. Barkoci?ska 6, 03-543 Warszawa PL Email: bok at active24.pl Tel: +48 22 423 33 22 GSM: +48 503 10 40 50 Skype: active24pl From tss at iki.fi Thu Apr 4 22:21:43 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 4 Apr 2013 22:21:43 +0300 Subject: [Dovecot] Proxying, pertinent values and features, SNI In-Reply-To: <20130403165922.33300812@batzmaru.gol.ad.jp> References: <20130403165922.33300812@batzmaru.gol.ad.jp> Message-ID: On 3.4.2013, at 10.59, Christian Balzer wrote: > I'm looking into deploying dovecot as a proxy, currently using perdition. > Have been using dovecot on the actual servers for years, nearly a decade. > So far just 1.x, but for the proxy it will have to be 2.x (2.1.7 is the > current Debian version), as the trigger for this change is the need to > support multiple SSL certificates. > > All that happens on the proxy seems to be handled by the login processes, > so that is why we're not seeing anything useful in the process titles or > with doveadm, right? > And from past comments by Timo I guess that adding such functionality > isn't on his to-do list at all. doveadm proxy list > A configurable capabilities string for POP would be quite welcome, but at > least nothing is different between the 1.x backends and the 2.x proxy in > that protocol. v2.2 backends actually add some new POP3 capabilities. I guess there could be such a setting, although it's a bit annoying to develop.. > Speaking of 1.x versus 2.x, the feature to pass on the remote IP from the > proxy to the backend is a 2.x thing only, correct? Right. > So I suppose any parameters really affecting this setup are > default_process_limit and default_client_limit as well as the settings > in service-imap-login and service pop-login. > In particular mail_max_userip_connections never is looked at on the proxy > as this check happens in the respective protocol AFTER login, rite? Right. > I presume to best support all(?) clients out there is to have "local_name" > sections for SNI first and then "local" sections for IP address based > certs. It is my understanding that SNI needs to be requested by the > client, so aside from client bugs (nah, those don't exist ^o^) every > client should get an appropriate response for TLS. > Has anybody done a setup like that already? If you have separate IPs for each sertificate, you don't need to support/configure SNI, so local {} blocks are enough. From tss at iki.fi Thu Apr 4 22:27:57 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 4 Apr 2013 22:27:57 +0300 Subject: [Dovecot] Maildirs location migration In-Reply-To: <20130403154220.GA25793@parmesan.sis.pasteur.fr> References: <20130403154220.GA25793@parmesan.sis.pasteur.fr> Message-ID: <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> On 3.4.2013, at 18.42, Thomas Hummel wrote: > I'm using dovecot-2.1.15 with Maildir mailboxes located on an NFS filer. > Postfix is used to deliver mail through procmail ("mailbox_command) as LDA. > > Our team has bought another filer and everything is meant to go on it, so we're > planning to migrate those mailboxes to the new filer. .. > I was wondering if such a migration could be done differently in order to be > seamless to the user : > > - for the postfix part, it would be easy, I guess, to create a new service (and > a new transport map using this service) to deliver to the new location > > - but for the imap part, I'm not sure if it can be done. My guess is that, if > feasible, it would involve some namespace settings and a dsync copy but I > cannot figure out how exactly. http://wiki2.dovecot.org/Tools/Dsync#example_converting works for moving mailboxes as well as converting. It works even while procmail is used to deliver mails. From tss at iki.fi Thu Apr 4 23:04:07 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 4 Apr 2013 23:04:07 +0300 Subject: [Dovecot] v2.2 getting NULL pointer reference with shared namespace in mailbox_tree? In-Reply-To: <20130402094506.GA3291@uran.iai.uni-bonn.de> References: <20130322143510.GA28803@uran.iai.uni-bonn.de> <78A5903C-AFD6-42BE-BE2F-445E47EAD392@iki.fi> <20130322152953.GB3485@uran.iai.uni-bonn.de> <34BEEEBD-DA8C-45CC-A9A4-6E676F6A9D56@iki.fi> <20130322173450.GA623@uran.iai.uni-bonn.de> <1364745089.32610.4.camel@hurina> <20130402094506.GA3291@uran.iai.uni-bonn.de> Message-ID: On 2.4.2013, at 12.45, Walter Steiner wrote: >>> With todays nightly: >>> >>> dsync(wsunpriv at iai.uni-bonn.de): Panic: file imapc-list.c: line 199 (imapc_list_get_vname): assertion failed: (strncmp(prefix, storage_name, prefix_len) == 0 && storage_name[prefix_len] == list->sep) Fixed this and some other stuff in hg. From tss at iki.fi Thu Apr 4 23:11:36 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 4 Apr 2013 23:11:36 +0300 Subject: [Dovecot] Outlook 2013 - mounting folders with XLIST In-Reply-To: References: <9F7FF84F91BA4164A1C07DF0143799DD@ai.local><51503291.5070008@sys4.de><51503FF4.8080409@sys4.de><17A6BDEBDD0C4C6EB4D0D2545E33B842@ai.local> Message-ID: <3EDB602B-33CF-4047-B035-BBDE5DF307D7@iki.fi> On 3.4.2013, at 14.24, Hajo Locke wrote: >> Ugh. Not really. OK, latest v2.1 hg has passdb_import, userdb_import and >> userdb_userdb_import and they all work. .. > thanks, this is working. now it is possible to let the single user choose his favorite foldernames if client is not very helpful. it results in some more configuration, but is helpful in some situations. > > but i only achieved this without userdb prefetching. latest patch i added latest patch http://hg.dovecot.org/dovecot-2.1/rev/cd919c490ea6 is included There are 3 more patches related to the userdb_import stuff since that one. From tss at iki.fi Thu Apr 4 23:13:51 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 4 Apr 2013 23:13:51 +0300 Subject: [Dovecot] doveadm mailbox list/stats etc. and shared mailboxes/ACLs In-Reply-To: References: Message-ID: On 2.4.2013, at 15.37, Lutz Pre?ler wrote: > Only user1.test and user1.test.test2 have ACLs that allow testuser to access > them. > > host:~# doveadm mailbox status -u testuser all INBOX.shared.user1.privat > INBOX.shared.user1.privat messages=37 recent=0 uidnext=70 uidvalidity=1060291494 unseen=7 highestmodseq=1 vsize=1618757 guid=9a71cb399c249d4ce10e0000c93908ca > > Access with search and fetch (and probably any other doveadm command) is > possible, too. > Is this how it's supposed to work? Commands in testuser IMAP session > respects ACLs. My guess: You have acl plugin enabled in protocol imap {}, but not globally? From tss at iki.fi Thu Apr 4 23:36:38 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 4 Apr 2013 23:36:38 +0300 Subject: [Dovecot] replicator process In-Reply-To: References: Message-ID: <9685EFE7-F9D2-40C2-8FCB-44A0720D55C7@iki.fi> On 3.4.2013, at 0.25, Lutz Pre?ler wrote: > 2.2rc3: replication unconfigured (no "replica" in doveconf -n output), > # doveadm replicator status > starts the dovecot/replicator process, which keeps running, leading > to "sync: User has no mail_replica in userdb" errors for each user every > 5 minutes. Hmh. OK, fixed in hg. It now requires that service replicator { process_min_avail=1 } or it won't start. > Same after "doveadm replicator replicate some-even-nonexisting-user". First I thought you meant that the nonexistent user would be left lying around in replicator's memory and attempted to be replicated again, but that doesn't happen with me. From felipe at cpanel.net Thu Apr 4 21:23:33 2013 From: felipe at cpanel.net (Felipe Gasper (cPanel)) Date: Thu, 04 Apr 2013 13:23:33 -0500 Subject: [Dovecot] manually updating dovecot 1 config to dovecot 2 Message-ID: <515DC525.7020409@cpanel.net> Is there documentation somewhere on how to update a dovecot 1 configuration file to dovecot 2?s preferred formats? We?re looking to provide Dovecot 2 with cPanel; having that documentation would help us update the config file templates that we ship. Thank you! -- Felipe Gasper cPanel, Inc. From tss at iki.fi Fri Apr 5 00:16:17 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 05 Apr 2013 00:16:17 +0300 Subject: [Dovecot] v2.1.16 released Message-ID: <1365110177.11047.92.camel@innu> http://dovecot.org/releases/2.1/dovecot-2.1.16.tar.gz http://dovecot.org/releases/2.1/dovecot-2.1.16.tar.gz.sig + Added quota-status policy service for Postfix + Added "doveadm batch" command to run multiple commands before moving onto the next user (useful only with -A and -u ) + Added forwards compatibility for v2.2 index files - mdbox: Index rebuilding crashed in some situations - Fixed a race condition with setting \Recent flags - Fixed a crash when decoding a specific message (decoding is done for SEARCH TEXT/BODY and with full text search indexing, so this couldn't fully DoS a user) From tss at iki.fi Fri Apr 5 00:33:24 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 05 Apr 2013 00:33:24 +0300 Subject: [Dovecot] v2.2.rc4 released Message-ID: <1365111204.11047.100.camel@innu> http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc4.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc4.tar.gz.sig A lot of small random fixes. Some last minute major cleanups/fixes to lib-http and lib-ssl-iostream error handling, which makes them much easier to debug if something goes wrong (so e.g. if https site has invalid certificate, the caller gets error message saying that, including the part of the cert that couldn't be validated). I don't have anything important left in my v2.2 TODO. It passes all my tests. So I'm hoping for v2.2.0 release any day now. + Added "doveadm replicator" commands - Larger changes to lib-http and lib-ssl-iostream error handling. The API caller can now get the exact error message as a string. - Various bugfixes to LDAP changes in rc3 From Lutz.Pressler at SerNet.DE Fri Apr 5 00:48:39 2013 From: Lutz.Pressler at SerNet.DE (Lutz =?iso-8859-1?Q?Pre=DFler?=) Date: Thu, 4 Apr 2013 23:48:39 +0200 Subject: [Dovecot] doveadm mailbox list/stats etc. and shared mailboxes/ACLs In-Reply-To: References: Message-ID: Hello Timo, On Thu, 04 Apr 2013, Timo Sirainen wrote: > On 2.4.2013, at 15.37, Lutz Pre?ler wrote: > > > Only user1.test and user1.test.test2 have ACLs that allow testuser to access > > them. > > > > host:~# doveadm mailbox status -u testuser all INBOX.shared.user1.privat > > INBOX.shared.user1.privat messages=37 recent=0 uidnext=70 uidvalidity=1060291494 unseen=7 highestmodseq=1 vsize=1618757 guid=9a71cb399c249d4ce10e0000c93908ca > > > > Access with search and fetch (and probably any other doveadm command) is > > possible, too. > > Is this how it's supposed to work? Commands in testuser IMAP session > > respects ACLs. > > My guess: You have acl plugin enabled in protocol imap {}, but not globally? No. It's enabled in global mail_plugins: mail_plugins = " virtual acl zlib notify mail_log quota listescape stats fts fts_lucene mailbox_alias" imap_acl only in protocol imap, of course. Lutz From tss at iki.fi Fri Apr 5 01:16:17 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 5 Apr 2013 01:16:17 +0300 Subject: [Dovecot] doveadm mailbox list/stats etc. and shared mailboxes/ACLs In-Reply-To: References: Message-ID: <6A164A27-320E-4081-981E-983747A78D25@iki.fi> On 5.4.2013, at 0.48, Lutz Pre?ler wrote: >>> Only user1.test and user1.test.test2 have ACLs that allow testuser to access >>> them. >>> >>> host:~# doveadm mailbox status -u testuser all INBOX.shared.user1.privat >>> INBOX.shared.user1.privat messages=37 recent=0 uidnext=70 uidvalidity=1060291494 unseen=7 highestmodseq=1 vsize=1618757 guid=9a71cb399c249d4ce10e0000c93908ca >>> >>> Access with search and fetch (and probably any other doveadm command) is >>> possible, too. >>> Is this how it's supposed to work? Commands in testuser IMAP session >>> respects ACLs. >> >> My guess: You have acl plugin enabled in protocol imap {}, but not globally? > No. It's enabled in global mail_plugins: Oh. Hmm. Yeah, looks like doveadm nowadays ignores ACLs when listing mailboxes. It probably shouldn't.. I'll need to think about this. Wonder why I added the RAW_LIST flag in the first place.. From daniel.parthey at informatik.tu-chemnitz.de Fri Apr 5 02:28:21 2013 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Fri, 5 Apr 2013 01:28:21 +0200 Subject: [Dovecot] manually updating dovecot 1 config to dovecot 2 In-Reply-To: <515DC525.7020409@cpanel.net> References: <515DC525.7020409@cpanel.net> Message-ID: <20130404232821.GA11242@daniel.localdomain> Hi Felipe, Felipe Gasper (cPanel) wrote: > Is there documentation somewhere on how to update a dovecot 1 > configuration file to dovecot 2?s preferred formats? > > We?re looking to provide Dovecot 2 with cPanel; having that > documentation would help us update the config file templates that we > ship. http://wiki2.dovecot.org/Tools/Doveconf doveconf can be used to convert v1.x configuration files into v2.x format: doveconf -n -c dovecot1.conf > dovecot2.conf Regards Daniel -- https://plus.google.com/103021802792276734820 From felipe at cpanel.net Fri Apr 5 02:37:53 2013 From: felipe at cpanel.net (Felipe Gasper (cPanel)) Date: Thu, 04 Apr 2013 18:37:53 -0500 Subject: [Dovecot] manually updating dovecot 1 config to dovecot 2 In-Reply-To: <20130404232821.GA11242@daniel.localdomain> References: <515DC525.7020409@cpanel.net> <20130404232821.GA11242@daniel.localdomain> Message-ID: <515E0ED1.500@cpanel.net> I mean without using doveconf. Manually going in, with a text editor, and changing the settings to the new formats. Is there anything that describes how to do this? -FG On 4/4/13 6:28 PM, Daniel Parthey wrote: > Hi Felipe, > > Felipe Gasper (cPanel) wrote: >> Is there documentation somewhere on how to update a dovecot 1 >> configuration file to dovecot 2?s preferred formats? >> >> We?re looking to provide Dovecot 2 with cPanel; having that >> documentation would help us update the config file templates that we >> ship. > > http://wiki2.dovecot.org/Tools/Doveconf > > doveconf can be used to convert v1.x configuration files into v2.x format: > > doveconf -n -c dovecot1.conf > dovecot2.conf > > Regards > Daniel > -- Felipe Gasper User interface development cPanel, Inc. 3131 W. Alabama St. Houston, TX 77098 office 713-529-0800 x4096 cell 832-633-8092 fax 713-559-3206 From dbenfell at gmail.com Fri Apr 5 02:43:50 2013 From: dbenfell at gmail.com (David Benfell) Date: Thu, 04 Apr 2013 16:43:50 -0700 Subject: [Dovecot] not showing subfolders on INBOX Message-ID: <515E1036.8040105@gmail.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi all, Apologies if a duplicate message. I initially sent the following from a non-subscribed email address (my usual address, but not the one that works when I'm having trouble with mail). First, I'm pretty sure I screwed up something with dovecot. The symptom appears in both thunderbird and mutt. I'm moving my server from a VPS to a dedicated server. *Both* are Arch Linux systems. Here's the dovecot -n output: # 2.1.15: /etc/dovecot/dovecot.conf # OS: Linux 3.8.4-1-ARCH x86_64 base_dir = /var/run/dovecot/ default_client_limit = 3000 default_process_limit = 1000 login_trusted_networks = 10.8.0.0/16 127.0.0.0/8 mail_location = maildir:~/Maildir mail_max_userip_connections = 30 passdb { args = failure_show_msg=yes driver = pam } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } ssl_cert = References: <515DC525.7020409@cpanel.net> <20130404232821.GA11242@daniel.localdomain> <515E0ED1.500@cpanel.net> Message-ID: <3F49809E-6705-42FF-A876-8E048ECEFB05@iki.fi> See src/config/old-set-parser.c for how doveconf does it. It doesn't convert some (more rarely used) settings that are also difficult to convert. http://wiki2.dovecot.org/Upgrading/2.0 lists those things. On 5.4.2013, at 2.37, Felipe Gasper (cPanel) wrote: > I mean without using doveconf. > > Manually going in, with a text editor, and changing the settings to the new formats. > > Is there anything that describes how to do this? > > -FG > > On 4/4/13 6:28 PM, Daniel Parthey wrote: >> Hi Felipe, >> >> Felipe Gasper (cPanel) wrote: >>> Is there documentation somewhere on how to update a dovecot 1 >>> configuration file to dovecot 2?s preferred formats? >>> >>> We?re looking to provide Dovecot 2 with cPanel; having that >>> documentation would help us update the config file templates that we >>> ship. >> >> http://wiki2.dovecot.org/Tools/Doveconf >> >> doveconf can be used to convert v1.x configuration files into v2.x format: >> >> doveconf -n -c dovecot1.conf > dovecot2.conf >> >> Regards >> Daniel >> > > -- > Felipe Gasper > User interface development > > cPanel, Inc. > 3131 W. Alabama St. > Houston, TX 77098 > office 713-529-0800 x4096 > cell 832-633-8092 > fax 713-559-3206 > From daniel.parthey at informatik.tu-chemnitz.de Fri Apr 5 03:47:28 2013 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Fri, 5 Apr 2013 02:47:28 +0200 Subject: [Dovecot] manually updating dovecot 1 config to dovecot 2 In-Reply-To: <515E0ED1.500@cpanel.net> References: <515DC525.7020409@cpanel.net> <20130404232821.GA11242@daniel.localdomain> <515E0ED1.500@cpanel.net> Message-ID: <20130405004728.GA12602@daniel.localdomain> Felipe Gasper (cPanel) wrote: > I mean without using doveconf. > > Manually going in, with a text editor, and changing the settings to the new formats. > > Is there anything that describes how to do this? http://wiki2.dovecot.org/Upgrading http://wiki2.dovecot.org/Upgrading/2.0 http://wiki2.dovecot.org/Upgrading/2.1 http://wiki2.dovecot.org/Upgrading/2.2 Regards Daniel -- https://plus.google.com/103021802792276734820 From daniel.parthey at informatik.tu-chemnitz.de Fri Apr 5 04:05:17 2013 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Fri, 5 Apr 2013 03:05:17 +0200 Subject: [Dovecot] not showing subfolders on INBOX In-Reply-To: <515E1036.8040105@gmail.com> References: <515E1036.8040105@gmail.com> Message-ID: <20130405010517.GA13041@daniel.localdomain> David Benfell wrote: > First, I'm pretty sure I screwed up something with dovecot. The > symptom appears in both thunderbird and mutt. > > Linux munich.parts-unknown.org 3.8.4-1-ARCH #1 SMP PREEMPT Wed Mar 20 > 22:10:25 CET 2013 x86_64 GNU/Linux > > Linux atlanta.parts-unknown.org 3.6.10-1-ARCH #1 SMP PREEMPT Tue Dec > 11 09:40:17 CET 2012 x86_64 GNU/Linux > > I literally copied this configuration, so it's the same on both > systems. But on the new system, I'm not seeing subfolders in INBOX. I > also copied my Maildir from the old system to the new system, so it > should--I thought, anyway--be okay. > > What did I do wrong? And how should I fix it? Possibly a filesystem permission issue or userid mismatch? How did you copy the Maildir from the old system to the new system and has the affected sufficient access to the Maildir? Can you find any errors in dovecot logfile? Regards Daniel -- https://plus.google.com/103021802792276734820 From me at junc.eu Fri Apr 5 09:19:58 2013 From: me at junc.eu (Benny Pedersen) Date: Fri, 05 Apr 2013 08:19:58 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: <1365110177.11047.92.camel@innu> References: <1365110177.11047.92.camel@innu> Message-ID: Timo Sirainen skrev den 2013-04-04 23:16: > + Added quota-status policy service for Postfix so now postfix can use dovecot as a qouta policy daemon ? (via check_policy_service) if so super duper, but i still keep dovecot 1.x for now, will have to redo another server to go with dovecot 2.x, hopefully it will be my first mac mini server not running in an f16 with afterburner :) From dbenfell at gmail.com Fri Apr 5 10:39:19 2013 From: dbenfell at gmail.com (David Benfell) Date: Fri, 05 Apr 2013 00:39:19 -0700 Subject: [Dovecot] SOLVED: Re: not showing subfolders on INBOX In-Reply-To: <20130405010517.GA13041@daniel.localdomain> References: <515E1036.8040105@gmail.com> <20130405010517.GA13041@daniel.localdomain> Message-ID: <515E7FA7.9050803@gmail.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 04/04/2013 06:05 PM, Daniel Parthey wrote: I had just done an scp -r, with a chown. It turns out all I had to do--I eventually found this after looking for *hours*--was to "recreate" the folders under Thunderbird. These are maildirs, so it is apparently important to put a slash at the end of the mailbox name when creating it, which is probably why my earlier attempt doing this failed. Fortunately, "recreating" the folders does not erase them. But apparently it clues dovecot into their existence. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJRXn+nAAoJELJhbl/uPb4SaM8QAKL9ZSw2fw6Xml7PJjpS9L1Y 66ToLhMRLL0Uv8/nP0qYkc8IMDGNsJv5muLzqEpzCiJRxF0nMQKybT3KQoTnlMiv sfLLZbpZQklPB9xarOEOnrFxOdyZ4H5ZuBWURAXDCJbxQ6SnwnvMGoaDwrB55fJZ 7ickm17u01ZbfAq6tXWH5BvuF4wTWJ6py0duOl/pYfD8GhwpaXyhs6Zz5cNTGkol 6ukJEPZ2bbHt7ucPJcTRamnerhzpUvIu0vS5bfV1abSVwMRMAU4LgppRHyRhoESB X50WHXkIEYaykXtJjFk+YimVvmKkqZqY4YfMtTavZ58uAYIO/F5yR1LkKxEnFSqg WbJ7PuYuhyVnBghqWoImlvvuEV4ofNvRBAXiYTFZ2KN1FvuXvk804cnJynuO4vL3 FkUnsCfM1aS7wPrQxv2UA1PXeeBt82RSaj+24ELzm4pevojSXIdB8b8nrkKsmDY+ 0iuWqK+CiikVElM1FaC9jix3PZSZvOLmCyNmaDcirxMjKNo/1B/uu8qabxO3eUhu 5tWYdh6I9leYAEeRwhQ9/aTAD/rWMoZMP23fTKPFld6jeyGF8JSp7Lqqjomlp7Mn EAIp6HJxSJTscCrWVxmJzc5Ripk89wE6egqX9JwNmfc8BQZyp0d5I3IyZIgB5hJ9 camhXOMtTsXo9/zayyaF =7O61 -----END PGP SIGNATURE----- From zhbmaillistonly at gmail.com Fri Apr 5 12:00:46 2013 From: zhbmaillistonly at gmail.com (Zhang Huangbin) Date: Fri, 5 Apr 2013 17:00:46 +0800 Subject: [Dovecot] v2.1.16 released In-Reply-To: <1365110177.11047.92.camel@innu> References: <1365110177.11047.92.camel@innu> Message-ID: On Friday, April 5, 2013 at 5:16 AM, Timo Sirainen wrote: > + Added quota-status policy service for Postfix > Found quota-status related settings in Dovecot-2.2 commit log here: http://hg.dovecot.org/dovecot-2.2/rev/980be1dc80c2 From anmeyer at anup.de Fri Apr 5 12:30:42 2013 From: anmeyer at anup.de (Andreas Meyer) Date: Fri, 5 Apr 2013 11:30:42 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: References: <1365110177.11047.92.camel@innu> Message-ID: <20130405113042.7b8e70e8@itxnew.bitcorner.intern> Zhang Huangbin wrote: > > > On Friday, April 5, 2013 at 5:16 AM, Timo Sirainen wrote: > > > + Added quota-status policy service for Postfix > > > > > Found quota-status related settings in Dovecot-2.2 commit log here: > http://hg.dovecot.org/dovecot-2.2/rev/980be1dc80c2 yes, great work! Apr 05 11:26:20 master: Info: Dovecot v2.1.16 starting up (core dumps disabled) Had to recompile dovecot-2.1-pigeonhole-0.3.1. Everything is fine now. Andreas From gilles.chauvin at univ-rouen.fr Fri Apr 5 13:06:07 2013 From: gilles.chauvin at univ-rouen.fr (Gilles CHAUVIN) Date: Fri, 05 Apr 2013 12:06:07 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: <1365110177.11047.92.camel@innu> References: <1365110177.11047.92.camel@innu> Message-ID: <1875494.stkFW8AgrI@dgs-13-322c> Hi, On Friday 05 April 2013 00:16:17 Timo Sirainen wrote: > + Added "doveadm batch" command to run multiple commands before moving > onto the next user (useful only with -A and -u ) As I understand this new command, it permits to run several doveadm commands in one shot? If this is correct, could you provide an example showing how to execute those two commands at the same time: - doveadm quota get -A - doveadm mailbox status -A -t all '*' Thanks. Regards, Gilles. From tss at iki.fi Fri Apr 5 14:08:30 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 05 Apr 2013 14:08:30 +0300 Subject: [Dovecot] v2.1.16 released In-Reply-To: <1875494.stkFW8AgrI@dgs-13-322c> References: <1365110177.11047.92.camel@innu> <1875494.stkFW8AgrI@dgs-13-322c> Message-ID: <1365160110.11047.115.camel@innu> On Fri, 2013-04-05 at 12:06 +0200, Gilles CHAUVIN wrote: > Hi, > > > On Friday 05 April 2013 00:16:17 Timo Sirainen wrote: > > + Added "doveadm batch" command to run multiple commands before moving > > onto the next user (useful only with -A and -u ) > > As I understand this new command, it permits to run several doveadm commands > in one shot? > > > If this is correct, could you provide an example showing how to execute those > two commands at the same time: > > - doveadm quota get -A > - doveadm mailbox status -A -t all '*' doveadm batch -A : quota get : mailbox status -t all '*' Except looks like subcommand parameters don't work. Fixed: http://hg.dovecot.org/dovecot-2.2/rev/2918bfacf565 Also those commands crash now because it tries to use "table" formatter.. Giving doveadm -f tab for example fixes the crash. Anyway, it's not really meant for those types of commands, most importantly the idea was to run: doveadm batch -A : altmove savedbefore 1w : purge And maybe some expunge commands to delete old mails from Trash/Spam. From gilles.chauvin at univ-rouen.fr Fri Apr 5 14:30:35 2013 From: gilles.chauvin at univ-rouen.fr (Gilles CHAUVIN) Date: Fri, 05 Apr 2013 13:30:35 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: <1365160110.11047.115.camel@innu> References: <1365110177.11047.92.camel@innu> <1875494.stkFW8AgrI@dgs-13-322c> <1365160110.11047.115.camel@innu> Message-ID: <2219023.Eg0CKGPcPS@dgs-13-322c> On Friday 05 April 2013 14:08:30 Timo Sirainen wrote: > doveadm batch -A : quota get : mailbox status -t all '*' > > Except looks like subcommand parameters don't work. Fixed: > http://hg.dovecot.org/dovecot-2.2/rev/2918bfacf565 > > Also those commands crash now because it tries to use "table" > formatter.. Giving doveadm -f tab for example fixes the crash. Anyway, > it's not really meant for those types of commands, most importantly the > idea was to run: > > doveadm batch -A : altmove savedbefore 1w : purge > > And maybe some expunge commands to delete old mails from Trash/Spam. Hi Timo, In fact, I need to run those 2 commands from a Python script once a day (to gather data and make some stats about our mailstore usage). We are slowly migrating from an old cyrus server and currently, with only ~7500 users, running these commands takes a while. At the end of the migration we'll have ~34000 users using the mailstore... I fear gathering these infos will take a very long time ;). BTW, thanks for your reply and for the fix ;). Gilles. From tss at iki.fi Fri Apr 5 14:36:18 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 5 Apr 2013 14:36:18 +0300 Subject: [Dovecot] v2.1.16 released In-Reply-To: <2219023.Eg0CKGPcPS@dgs-13-322c> References: <1365110177.11047.92.camel@innu> <1875494.stkFW8AgrI@dgs-13-322c> <1365160110.11047.115.camel@innu> <2219023.Eg0CKGPcPS@dgs-13-322c> Message-ID: On 5.4.2013, at 14.30, Gilles CHAUVIN wrote: > On Friday 05 April 2013 14:08:30 Timo Sirainen wrote: >> doveadm batch -A : quota get : mailbox status -t all '*' > > Hi Timo, > > In fact, I need to run those 2 commands from a Python script once a day (to > gather data and make some stats about our mailstore usage). > > We are slowly migrating from an old cyrus server and currently, with only > ~7500 users, running these commands takes a while. At the end of the migration > we'll have ~34000 users using the mailstore... I fear gathering these infos > will take a very long time ;). Try with mailbox_list_index=yes. It should make the status command faster. And if you're using Maildir, set maildir_very_dirty_syncs=yes. From gilles.chauvin at univ-rouen.fr Fri Apr 5 15:01:00 2013 From: gilles.chauvin at univ-rouen.fr (Gilles CHAUVIN) Date: Fri, 05 Apr 2013 14:01 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: References: <1365110177.11047.92.camel@innu> <2219023.Eg0CKGPcPS@dgs-13-322c> Message-ID: <6727794.uga4sJ92XS@dgs-13-322c> On Friday 05 April 2013 14:36:18 Timo Sirainen wrote: > Try with mailbox_list_index=yes. It should make the status command faster. > And if you're using Maildir, set maildir_very_dirty_syncs=yes. We're using mdbox so I tried mailbox_list_index = yes (wasn't aware of this command) and once activated got a huge amount of these in the logs :-/ 2013-04-05T13:54:55.505235+02:00 host dovecot: imap(xxxxxx): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x4636a) [0x7f2dfaab936a] - > /usr/local/lib/dovecot/libdovecot.s o.0(+0x463b6) [0x7f2dfaab93b6] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f2dfaa8cc0f] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xbc3e0) [0x7f2dfadc13e0] -> /usr/loca l/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_begin_to+0x4f) [0x7f2dfadc145f] -> /usr/local/lib/dovecot/libdovecot- storage.so.0(mail_index_sync_begin+0x1e) [0x7f2dfadc14de] -> /usr/l ocal/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync+0xd4) [0x7f2dfad920e4] -> /usr/local/lib/dovecot/libdovecot- storage.so.0(mailbox_list_index_refresh+0x9a) [0x7f2dfad90a7a] -> /usr/local/lib/dovecot/libdovecot- storage.so.0(mailbox_list_index_iter_init+0xf6) [0x7f2dfad90f96] -> /usr/local/lib/dovecot/libdovecot- storage.so.0(mailbox_list_iter_init_multiple+0xf3) [0 x7f2dfad884f3] -> /usr/local/lib/dovecot/libdovecot- storage.so.0(mailbox_list_iter_init+0x19) [0x7f2dfad88c39] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xbd24) [0x7f2df850fd24] -> /usr /local/lib/dovecot/lib01_acl_plugin.so(+0xc65a) [0x7f2df851065a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync+0x1cd) [0x7f2dfad921dd] -> /usr/local/lib/dovecot/l ibdovecot-storage.so.0(mailbox_list_index_refresh+0x9a) [0x7f2dfad90a7a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x8c32b) [0x7f2dfad9132b] -> /usr/local/lib/dovecot/libdovecot-sto rage.so.0(+0x8c960) [0x7f2dfad91960] -> /usr/local/lib/dovecot/libdovecot- storage.so.0(mailbox_sync_deinit+0x2a) [0x7f2dfad7fc6a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sy nc+0x3b) [0x7f2dfad7fd2b] -> dovecot/imap [xxxxxx 10.193.97.50 SELECT] (cmd_select_full+0x16e) [0x40d4fe] -> dovecot/imap [xxxxxx 10.193.97.50 SELECT](command_exec+0x3d) [0x41150d] -> dovec ot/imap [xxxxxx 10.193.97.50 SELECT]() [0x41045e] -> dovecot/imap [xxxxxx 10.193.97.50 SELECT]() [0x41053d] -> dovecot/imap [xxxxxx 10.193.97.50 SELECT] (client_handl Dovecot was upgraded to v2.1.16 this morning. Gilles From tss at iki.fi Fri Apr 5 15:03:19 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 5 Apr 2013 15:03:19 +0300 Subject: [Dovecot] v2.1.16 released In-Reply-To: <6727794.uga4sJ92XS@dgs-13-322c> References: <1365110177.11047.92.camel@innu> <2219023.Eg0CKGPcPS@dgs-13-322c> <6727794.uga4sJ92XS@dgs-13-322c> Message-ID: <406FF666-A648-49D8-B994-6EE981050332@iki.fi> On 5.4.2013, at 15.01, Gilles CHAUVIN wrote: > On Friday 05 April 2013 14:36:18 Timo Sirainen wrote: > > Try with mailbox_list_index=yes. It should make the status command faster. > > And if you're using Maildir, set maildir_very_dirty_syncs=yes. > > We're using mdbox so I tried mailbox_list_index = yes (wasn't aware of this command) and once activated got a huge amount of these in the logs :-/ > > 2013-04-05T13:54:55.505235+02:00 host dovecot: imap(xxxxxx): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x4636a) [0x7f2dfaab936a] -> /usr/local/lib/dovecot/libdovecot.s You're missing the error message before this one, that actually shows where it crashed. Anyway, I was somehow thinking you were using v2.2. mailbox_list_index=yes is somewhat buggy in v2.1, but should work great in v2.2. From gilles.chauvin at univ-rouen.fr Fri Apr 5 15:07:58 2013 From: gilles.chauvin at univ-rouen.fr (Gilles CHAUVIN) Date: Fri, 05 Apr 2013 14:07:58 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: <406FF666-A648-49D8-B994-6EE981050332@iki.fi> References: <1365110177.11047.92.camel@innu> <6727794.uga4sJ92XS@dgs-13-322c> <406FF666-A648-49D8-B994-6EE981050332@iki.fi> Message-ID: <3063757.xHLI2FyjZ6@dgs-13-322c> On Friday 05 April 2013 15:03:19 Timo Sirainen wrote: > On 5.4.2013, at 15.01, Gilles CHAUVIN wrote: > > On Friday 05 April 2013 14:36:18 Timo Sirainen wrote: > > > Try with mailbox_list_index=yes. It should make the status command > > > faster. > > > And if you're using Maildir, set maildir_very_dirty_syncs=yes. > > > > We're using mdbox so I tried mailbox_list_index = yes (wasn't aware of > > this command) and once activated got a huge amount of these in the logs > > :-/ > > > > 2013-04-05T13:54:55.505235+02:00 host dovecot: imap(xxxxxx): Error: Raw > > backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x4636a) > > [0x7f2dfaab936a] -> /usr/local/lib/dovecot/libdovecot.s > You're missing the error message before this one, that actually shows where > it crashed. Anyway, I was somehow thinking you were using v2.2. > mailbox_list_index=yes is somewhat buggy in v2.1, but should work great in > v2.2. Oops... The 2 lines before says: 2013-04-05T13:54:55.503668+02:00 host dovecot: master: Error: service(imap): child 3825 killed with signal 6 (core dumps disabled) 2013-04-05T13:54:55.504496+02:00 host dovecot: imap(xxxxxx): Panic: file mail- index-sync.c: line 440 (mail_index_sync_begin_to2): assertion failed: (!index- >syncing) Gilles From tss at iki.fi Fri Apr 5 15:13:58 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 5 Apr 2013 15:13:58 +0300 Subject: [Dovecot] v2.1.16 released In-Reply-To: <3063757.xHLI2FyjZ6@dgs-13-322c> References: <1365110177.11047.92.camel@innu> <6727794.uga4sJ92XS@dgs-13-322c> <406FF666-A648-49D8-B994-6EE981050332@iki.fi> <3063757.xHLI2FyjZ6@dgs-13-322c> Message-ID: On 5.4.2013, at 15.07, Gilles CHAUVIN wrote: > > You're missing the error message before this one, that actually shows where > > it crashed. Anyway, I was somehow thinking you were using v2.2. > > mailbox_list_index=yes is somewhat buggy in v2.1, but should work great in > > v2.2. > > Oops... The 2 lines before says: > > 2013-04-05T13:54:55.503668+02:00 host dovecot: master: Error: service(imap): child 3825 killed with signal 6 (core dumps disabled) > 2013-04-05T13:54:55.504496+02:00 host dovecot: imap(xxxxxx): Panic: file mail-index-sync.c: line 440 (mail_index_sync_begin_to2): assertion failed: (!index->syncing) Probably too much trouble to fix this in v2.1. v2.2 should have it working though. From gilles.chauvin at univ-rouen.fr Fri Apr 5 15:19:53 2013 From: gilles.chauvin at univ-rouen.fr (Gilles CHAUVIN) Date: Fri, 05 Apr 2013 14:19:53 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: References: <1365110177.11047.92.camel@innu> <3063757.xHLI2FyjZ6@dgs-13-322c> Message-ID: <6727799.1i6Kj5vJ1r@dgs-13-322c> On Friday 05 April 2013 15:13:58 Timo Sirainen wrote: > Probably too much trouble to fix this in v2.1. v2.2 should have it working > though. So we'll wait till the first 2.2 stable releases are published :). Thanks, Gilles From me at junc.eu Fri Apr 5 16:00:22 2013 From: me at junc.eu (Benny Pedersen) Date: Fri, 05 Apr 2013 15:00:22 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: References: <1365110177.11047.92.camel@innu> Message-ID: Zhang Huangbin skrev den 2013-04-05 11:00: > On Friday, April 5, 2013 at 5:16 AM, Timo Sirainen wrote: >> + Added quota-status policy service for Postfix > Found quota-status related settings in Dovecot-2.2 commit log here: > http://hg.dovecot.org/dovecot-2.2/rev/980be1dc80c2 neat, it could be done with dovecot qouta dict, and then let postfix sql/ldap query it, but the above is more strong solotion From bruce+dovecot at bmts.us Fri Apr 5 17:27:32 2013 From: bruce+dovecot at bmts.us (Bruce Marriner) Date: Fri, 05 Apr 2013 09:27:32 -0500 Subject: [Dovecot] v2.1.16 released (metadata plugin) In-Reply-To: <1365110177.11047.92.camel@innu> Message-ID: <2843-515edf80-37-1d51e320@36557639> Also, with 2.1.16 the metadata plugin by Dennis Schridde now compiles just fine without any modification to Dovecot or the plugin itself. I've updated my documentation on compiling and installing it to reflect these changes. Thanks for adding that small patch Timo I appreciate it. This will give me something to toy with while the native metadata support is hashed out. Plugin : http://hg.dovecot.org/dovecot-metadata-plugin My install notes (Still partly unfinished) : http://bmts.us/wiki/doku.php?id=article:kolab:dovecot On Thursday, April 4, 2013 04:16 PM CDT, Timo Sirainen wrote: > http://dovecot.org/releases/2.1/dovecot-2.1.16.tar.gz > http://dovecot.org/releases/2.1/dovecot-2.1.16.tar.gz.sig > > + Added quota-status policy service for Postfix > + Added "doveadm batch" command to run multiple commands before moving > onto the next user (useful only with -A and -u ) > + Added forwards compatibility for v2.2 index files > - mdbox: Index rebuilding crashed in some situations > - Fixed a race condition with setting \Recent flags > - Fixed a crash when decoding a specific message (decoding is done > for SEARCH TEXT/BODY and with full text search indexing, so this > couldn't fully DoS a user) > > From pyz at brama.com Fri Apr 5 18:19:46 2013 From: pyz at brama.com (Max Pyziur) Date: Fri, 5 Apr 2013 11:19:46 -0400 (EDT) Subject: [Dovecot] Configuring dovecot to use tcp wrappers Message-ID: Greetings, I am looking to implement tcp wrappers with dovecot; I am using the following two links as guides to configuration: http://blog.acsystem.sk/linux/brute-force-attack-dovecot-imap-server-blocking-ip-with-tcp-wrappers http://wiki2.dovecot.org/LoginProcess (you need to go to the very bottom) I'm concerned in making the configuration correctly. If you set login_access_sockets = tcpwrap in /etc/dovecot/dovecot.conf Then everything accessing ports controlled by dovecot (and open by iptables) is blocked. So my question relates to the second part of the configuration examples in the links above: service tcpwrap { unix_listener login/tcpwrap { group = $default_login_user mode = 0600 user = $default_login_user } } Where does this code get placed (in dovecot.conf or in one of the files in /etc/dovecot/conf.d)? And regarding $default_login_user, it appears in a comment line in /etc/dovecot/conf.d/10-master.conf Should that line be uncommented? Much thanks. Max Pyziur pyz at brama.com Report of dovecot -n: pyz at pangea ~> dovecot -n # 2.1.1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.2.1.el6.x86_64 x86_64 CentOS release 6.4 (Final) disable_plaintext_auth = no mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } ssl = no ssl_cert = I'm moving/converting email from one system to another The source system is: Dual core x86_64 6GB memory 180 GB raid1 disks ext4 Fedora 9 Dovecot 1.0.15 Maildir format The destination system is: Dual core x86_64 2GB memory 1TB raid1 disks ext4 Fedora 18 Dovecot 2.1.15 sdbox format I am moving mail in a series of steps: 0) cd ( to mail user home directory ) mkdir Maildir 1) # rsync mail from source system (hoho4) to current (hoho0) time rsync -arv --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir/ This step takes about 37 minutes the first time 2) # dsync mirror/convert to sdbox format on current system time dsync mirror maildir:~/Maildir This step takes about 858 minutes (!!) Looking at -D messages indicates that dsync is deciding between duplicates much of the time. Looking at the results in a mail browser (Evolution), it seems fine, although the latest mails are not there. 3) # pick up more current mail - use same script as in 1) time rsync -arv --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir/ This step takes about 5 minutes although this varies depending on the amount of new mail. 4) # repeat the 2) dsync step time dsync mirror maildir:~/Maildir This is where things look peculiar. When I look at the directory of sdbox/mailboxes, I see duplicated directories [bobgus at hoho0 sdbox]$ cd mailboxes [bobgus at hoho0 mailboxes]$ ls Apple Mail To Do Apple Mail To Do_2a47983780615e5179600000ba55d82c Deleted Messages Deleted Messages_2847983780615e5179600000ba55d82c Drafts Drafts_2447983780615e5179600000ba55d82c Important Important_2947983780615e5179600000ba55d82c INBOX INBOX_1547983780615e5179600000ba55d82c Sent Sent_2547983780615e5179600000ba55d82c Trash Trash_2747983780615e5179600000ba55d82c The 2nd dsync step has not completed yet. I'm wondering whether the extra directory will be magically moved into the older directory. (This is unlikely because the file names are duplicated in the new directory) ------- Is this expected behavior? Are there command changes I can make to speed up the process? Eliminate the duplicate directories? From tss at iki.fi Fri Apr 5 21:07:21 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 05 Apr 2013 21:07:21 +0300 Subject: [Dovecot] v2.2.rc5 released Message-ID: <1365185241.11047.130.camel@innu> http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc5.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc5.tar.gz.sig One more API change that required also a Pigeonhole modification. A few other random fixes. I'm planning on making v2.2.0 release on Monday. Please test before that. :) From ya.mwork at yandex.ru Fri Apr 5 21:15:19 2013 From: ya.mwork at yandex.ru (=?UTF-8?B?0JHQsNGB0L7QsiDQldCy0LPQtdC90LjQuQ==?=) Date: Fri, 05 Apr 2013 22:15:19 +0400 Subject: [Dovecot] v2.2.rc5 released In-Reply-To: <1365185241.11047.130.camel@innu> References: <1365185241.11047.130.camel@innu> Message-ID: <515F14B7.7080001@yandex.ru> Hello, Timo. Do you implemented dsync tcp server for replication? If do so how to configure it? From tss at iki.fi Fri Apr 5 21:36:25 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 5 Apr 2013 21:36:25 +0300 Subject: [Dovecot] v2.2.rc5 released In-Reply-To: <515F14B7.7080001@yandex.ru> References: <1365185241.11047.130.camel@innu> <515F14B7.7080001@yandex.ru> Message-ID: On 5.4.2013, at 21.15, ????? ??????? wrote: > Hello, Timo. > > Do you implemented dsync tcp server for replication? If do so how to > configure it? Yes. http://wiki2.dovecot.org/Replication From ka at pacific.net Fri Apr 5 21:48:20 2013 From: ka at pacific.net (Ken A) Date: Fri, 05 Apr 2013 13:48:20 -0500 Subject: [Dovecot] repeating dsync - questions In-Reply-To: <1365176449.21402.96.camel@hoho6.chidig.com> References: <1365176449.21402.96.camel@hoho6.chidig.com> Message-ID: <515F1C74.6070602@pacific.net> I've found that when going in one direction, using "backup -R" rather than mirror, works better. I'm going from mbox to sdbox, but doing roughly the same thing you are, rsync and then dsync. Ken A. On 4/5/2013 10:40 AM, Bob Gustafson wrote: > > I'm moving/converting email from one system to another > > The source system is: > Dual core x86_64 > 6GB memory > 180 GB raid1 disks ext4 > Fedora 9 > Dovecot 1.0.15 > Maildir format > > The destination system is: > Dual core x86_64 > 2GB memory > 1TB raid1 disks ext4 > Fedora 18 > Dovecot 2.1.15 > sdbox format > > I am moving mail in a series of steps: > > 0) cd ( to mail user home directory ) > mkdir Maildir > > 1) # rsync mail from source system (hoho4) to current (hoho0) > time rsync -arv --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir/ > > This step takes about 37 minutes the first time > > 2) # dsync mirror/convert to sdbox format on current system > time dsync mirror maildir:~/Maildir > > This step takes about 858 minutes (!!) > > Looking at -D messages indicates that dsync is deciding between > duplicates much of the time. > > Looking at the results in a mail browser (Evolution), it seems fine, > although the latest mails are not there. > > 3) # pick up more current mail - use same script as in 1) > time rsync -arv --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir/ > > This step takes about 5 minutes although this varies depending on the > amount of new mail. > > 4) # repeat the 2) dsync step > time dsync mirror maildir:~/Maildir > > This is where things look peculiar. When I look at the directory of > sdbox/mailboxes, I see duplicated directories > > [bobgus at hoho0 sdbox]$ cd mailboxes > [bobgus at hoho0 mailboxes]$ ls > Apple Mail To Do > Apple Mail To Do_2a47983780615e5179600000ba55d82c > Deleted Messages > Deleted Messages_2847983780615e5179600000ba55d82c > Drafts > Drafts_2447983780615e5179600000ba55d82c > Important > Important_2947983780615e5179600000ba55d82c > INBOX > INBOX_1547983780615e5179600000ba55d82c > Sent > Sent_2547983780615e5179600000ba55d82c > Trash > Trash_2747983780615e5179600000ba55d82c > > The 2nd dsync step has not completed yet. I'm wondering whether the > extra directory will be magically moved into the older directory. > > (This is unlikely because the file names are duplicated in the new > directory) > > ------- > > Is this expected behavior? Are there command changes I can make to speed > up the process? Eliminate the duplicate directories? > > > > -- Ken Anderson Pacific Internet - http://www.pacific.net From bobgus at rcn.com Fri Apr 5 21:54:36 2013 From: bobgus at rcn.com (Bob Gustafson) Date: Fri, 5 Apr 2013 13:54:36 -0500 Subject: [Dovecot] repeating dsync - questions In-Reply-To: <515F1C74.6070602@pacific.net> References: <1365176449.21402.96.camel@hoho6.chidig.com> <515F1C74.6070602@pacific.net> Message-ID: <8AD72A37-9764-4E71-B6C6-D54B0DD0E624@chidig.com> I tried that a week or so ago, with a 'dsync -R backup', but got the funny named directories, so I read more and am trying the 'dsync mirror' which doesn't require the -R. How long does the sync step take for you? (Normalize to # of messages..) Bob G On Apr 5, 2013, at 13:48, Ken A wrote: > I've found that when going in one direction, using "backup -R" rather > than mirror, works better. I'm going from mbox to sdbox, but doing > roughly the same thing you are, rsync and then dsync. > > Ken A. > > On 4/5/2013 10:40 AM, Bob Gustafson wrote: >> >> I'm moving/converting email from one system to another >> >> The source system is: >> Dual core x86_64 >> 6GB memory >> 180 GB raid1 disks ext4 >> Fedora 9 >> Dovecot 1.0.15 >> Maildir format >> >> The destination system is: >> Dual core x86_64 >> 2GB memory >> 1TB raid1 disks ext4 >> Fedora 18 >> Dovecot 2.1.15 >> sdbox format >> >> I am moving mail in a series of steps: >> >> 0) cd ( to mail user home directory ) >> mkdir Maildir >> >> 1) # rsync mail from source system (hoho4) to current (hoho0) >> time rsync -arv --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir/ >> >> This step takes about 37 minutes the first time >> >> 2) # dsync mirror/convert to sdbox format on current system >> time dsync mirror maildir:~/Maildir >> >> This step takes about 858 minutes (!!) >> >> Looking at -D messages indicates that dsync is deciding between >> duplicates much of the time. >> >> Looking at the results in a mail browser (Evolution), it seems fine, >> although the latest mails are not there. >> >> 3) # pick up more current mail - use same script as in 1) >> time rsync -arv --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir/ >> >> This step takes about 5 minutes although this varies depending on the >> amount of new mail. >> >> 4) # repeat the 2) dsync step >> time dsync mirror maildir:~/Maildir >> >> This is where things look peculiar. When I look at the directory of >> sdbox/mailboxes, I see duplicated directories >> >> [bobgus at hoho0 sdbox]$ cd mailboxes >> [bobgus at hoho0 mailboxes]$ ls >> Apple Mail To Do >> Apple Mail To Do_2a47983780615e5179600000ba55d82c >> Deleted Messages >> Deleted Messages_2847983780615e5179600000ba55d82c >> Drafts >> Drafts_2447983780615e5179600000ba55d82c >> Important >> Important_2947983780615e5179600000ba55d82c >> INBOX >> INBOX_1547983780615e5179600000ba55d82c >> Sent >> Sent_2547983780615e5179600000ba55d82c >> Trash >> Trash_2747983780615e5179600000ba55d82c >> >> The 2nd dsync step has not completed yet. I'm wondering whether the >> extra directory will be magically moved into the older directory. >> >> (This is unlikely because the file names are duplicated in the new >> directory) >> >> ------- >> >> Is this expected behavior? Are there command changes I can make to speed >> up the process? Eliminate the duplicate directories? >> >> >> >> > > -- > Ken Anderson > Pacific Internet - http://www.pacific.net From delrio at mie.utoronto.ca Fri Apr 5 22:22:39 2013 From: delrio at mie.utoronto.ca (Oscar del Rio) Date: Fri, 05 Apr 2013 15:22:39 -0400 Subject: [Dovecot] v2.2.rc5 released In-Reply-To: <1365185241.11047.130.camel@innu> References: <1365185241.11047.130.camel@innu> Message-ID: <515F247F.3060603@mie.utoronto.ca> On 04/ 5/13 02:07 PM, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc5.tar.gz > http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc5.tar.gz.sig > > One more API change that required also a Pigeonhole modification. A few > other random fixes. I'm planning on making v2.2.0 release on Monday. > Please test before that. :) so far so good, on Solaris 11.1 :) Thanks! From pigi at frumar.it Fri Apr 5 22:59:25 2013 From: pigi at frumar.it (Pigi) Date: Fri, 5 Apr 2013 21:59:25 +0200 Subject: [Dovecot] Problem with fts lucene, on solaris 10 Message-ID: <201304052159.25835.pigi@frumar.it> Hi all, I'm planning to migrate my courier-imap imap server to dovecot, but I'm experiencing a strange issue with fts-lucene plugin. Basically, every time I start a search, the log starts to write: Apr 05 19:30:53 indexer: Error: Indexer worker disconnected, discarding 1 requests for XXXXXX Apr 05 19:30:53 indexer-worker(XXXXX): Fatal: master: service(indexer-worker): child 809 killed with signal 11 (core not dumped) Apr 05 19:30:53 imap(XXXXXX): Error: indexer failed to index mailbox INBOX Apr 05 19:30:56 indexer-worker(XXXXX): Error: lucene index /home/XXXXX/Maildir/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out When trussing the indexer-worker pid I can see it ends with: ...SNIP... 527: brk(0x005A7840) = 0 527: brk(0x005AD840) = 0 527: pread64(16, " I G E N E R I C I < /".., 8170, 24514) = 8170 527: brk(0x005AD840) = 0 527: brk(0x005B3840) = 0 527: Incurred fault #5, FLTACCESS %pc = 0xFEBD6DDC 527: siginfo: SIGBUS BUS_ADRALN addr=0x005B50BA 527: Received signal #10, SIGBUS [default] 527: siginfo: SIGBUS BUS_ADRALN addr=0x005B50BA I cannot get a core, but either root ( user that is starting the dovecot ) than the user XXXXX have unlimited coresize XXXXX /home/XXXXXXX > ulimit -a time(seconds) unlimited file(blocks) unlimited data(kbytes) unlimited stack(kbytes) 8192 coredump(blocks) unlimited nofiles(descriptors) 256 vmemory(kbytes) unlimited root # ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited file size (blocks, -f) unlimited open files (-n) 1024 pipe size (512 bytes, -p) 10 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 29995 virtual memory (kbytes, -v) unlimited The mailbox for user XXXXXX ( Maildir stile, for speed-up migration ) has ~ 4000 messages. The search ends, but I think it don't use the lucene plugin ( it crashes ). I'm sure I'm missing something, but I can't really find what. All stuff have been self compiled, using standard flags as per "configure" scripts. Thanks for any hint. Pigi here the environment: uname -a SunOS puma 5.10 Generic_137137-09 sun4u sparc SUNW,Sun-Fire-V240 ( yes, I know, it's quite old ;) ) ======= dovecot --version 2.1.15 ======= doveconf -n # 2.1.15: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: SunOS 5.10 sun4u debug_log_path = /usr/local/dovecot/var/log/dovecot-debug.log disable_plaintext_auth = no first_valid_uid = 100 info_log_path = /usr/local/dovecot/var/log/dovecot-info.log log_path = /usr/local/dovecot/var/log/dovecot.log mail_location = maildir:~/Maildir mail_plugins = " fts fts_lucene" namespace { inbox = yes location = prefix = INBOX. separator = . } passdb { driver = pam } plugin { fts = lucene fts_lucene = whitespace_chars=@. } service imap-login { inet_listener imap { port = 144 } } service indexer-worker { drop_priv_before_exec = yes } service pop3-login { inet_listener pop3 { port = 112 } } ssl = no userdb { driver = passwd } ============= gcc -v Reading specs from /usr/sfw/lib/gcc/sparc-sun-solaris2.10/3.4.3/specs Configured with: /sfw10/builds/build/sfw10-patch/usr/src/cmd/gcc/gcc-3.4.3/configure --prefix=/usr/sfw --with-as=/usr/ccs/bin/as --without-gnu-as --with-ld=/usr/ccs/bin/ld --without-gnu-ld --enable-languages=c,c++ --enable-shared Thread model: posix gcc version 3.4.3 (csl-sol210-3_4-branch+sol_rpath) ============= clucene clucene-core-2.3.3.4 libstemmer_c libtextcat-2.2 openssl-1.0.1e From dbenfell at gmail.com Fri Apr 5 23:05:59 2013 From: dbenfell at gmail.com (David Benfell) Date: Fri, 05 Apr 2013 13:05:59 -0700 Subject: [Dovecot] client limit and STARTTLS Message-ID: <515F2EA7.9020804@gmail.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi all, I'm migrating from one system to another. Both are Arch Linux, but copying the configurations and just modifying them for IP addresses and hostnames didn't work. Here's doveconf -n # 2.1.15: /etc/dovecot/dovecot.conf doveconf: Warning: service auth { client_limit=256 } is lower than required under max. load (3072) doveconf: Warning: service anvil { client_limit=256 } is lower than required under max. load (2051) # OS: Linux 3.8.4-1-ARCH x86_64 base_dir = /var/run/dovecot/ default_client_limit = 256 default_process_limit = 1024 login_trusted_networks = 10.8.0.0/16 127.0.0.0/8 mail_location = maildir:~/Maildir mail_max_userip_connections = 30 passdb { args = failure_show_msg=yes driver = pam } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } ssl_cert = We are currently running dovecot 2.2.rc3. I am trying to 'dsync mirror' old Qpopper/mbox inboxes to our new Dovecot/mdbox servers. For most of the several thousand accounts, it works without issue. But there are a handful of accounts that are generating the following errors. dsync(joe): Error: Sync failed for mbox file /var/opt/migrate/users/joe/inbox: seq=981 uid=981 uid_broken=0 originally needed 9 bytes, now needs 11 bytes dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=115028 uid=115028 uid_broken=0 originally needed 34 bytes, now needs 35 bytes dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=114779 uid=114779 uid_broken=0 originally needed 34 bytes, now needs 35 bytes dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=114778 uid=114778 uid_broken=0 originally needed 34 bytes, now needs 35 bytes dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=114621 uid=114621 uid_broken=0 originally needed 34 bytes, now needs 35 bytes dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=114610 uid=114610 uid_broken=0 originally needed 34 bytes, now needs 35 bytes dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=114607 uid=114607 uid_broken=0 originally needed 34 bytes, now needs 35 bytes dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=113993 uid=113993 uid_broken=0 originally needed 34 bytes, now needs 35 bytes dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=113868 uid=113868 uid_broken=0 originally needed 34 bytes, now needs 35 bytes dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=113855 uid=113855 uid_broken=0 originally needed 34 bytes, now needs 35 bytes dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=46725 uid=46725 uid_broken=0 originally needed 32 bytes, now needs 34 bytes What exactly is this error indicating and how can I fix it? From noel.butler at ausics.net Sat Apr 6 05:43:02 2013 From: noel.butler at ausics.net (Noel Butler) Date: Sat, 06 Apr 2013 12:43:02 +1000 Subject: [Dovecot] client limit and STARTTLS In-Reply-To: <515F2EA7.9020804@gmail.com> References: <515F2EA7.9020804@gmail.com> Message-ID: <1365216182.3833.9.camel@tardis> Hi David, On Fri, 2013-04-05 at 13:05 -0700, David Benfell wrote: > doveconf: Warning: service auth { client_limit=256 } is lower than > required under max. load (3072) > doveconf: Warning: service anvil { client_limit=256 } is lower than > required under max. load (2051) > service auth { > unix_listener /var/spool/postfix/private/auth { > mode = 0666 > } client_limit = 3072 > } service anvil { client_limit = 2051 } (That's kinda interesting my anvil values need to be higher than auth values, yours is opposite, but, if thats what dovecot says...) > Second question: STARTTLS isn't working. What am I missing? Sorry if > this is something that should be obvious; I'm fighting a similar > battle with postfix and I'm being pushed around the bend while I > really need to be working on other things. > Are your certificate chains valid? Simply saying "isn't working" is almost a requirement for a *sigh* log output please, or a better description than "isn't working" ;) -------------- next part -------------- A non-text attachment was scrubbed... Name: face-wink.png Type: image/png Size: 876 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From ka at pacific.net Sat Apr 6 06:45:22 2013 From: ka at pacific.net (Ken A) Date: Fri, 05 Apr 2013 22:45:22 -0500 Subject: [Dovecot] repeating dsync - questions In-Reply-To: <8AD72A37-9764-4E71-B6C6-D54B0DD0E624@chidig.com> References: <1365176449.21402.96.camel@hoho6.chidig.com> <515F1C74.6070602@pacific.net> <8AD72A37-9764-4E71-B6C6-D54B0DD0E624@chidig.com> Message-ID: <515F9A52.5090806@pacific.net> It's about 300GB of mboxes (I don't know how many messages) and dsync took about 3 hours from scratch in the destination. But, when I sync more frequently, it's much quicker, and depends on the number of changes. With no changes it runs in about 15 min. Ken A. On 4/5/2013 1:54 PM, Bob Gustafson wrote: > I tried that a week or so ago, with a 'dsync -R backup', but got the > funny named directories, so I read more and am trying the 'dsync > mirror' which doesn't require the -R. > > How long does the sync step take for you? (Normalize to # of > messages..) > > Bob G > > On Apr 5, 2013, at 13:48, Ken A wrote: > >> I've found that when going in one direction, using "backup -R" >> rather than mirror, works better. I'm going from mbox to sdbox, but >> doing roughly the same thing you are, rsync and then dsync. >> >> Ken A. >> >> On 4/5/2013 10:40 AM, Bob Gustafson wrote: >>> >>> I'm moving/converting email from one system to another >>> >>> The source system is: Dual core x86_64 6GB memory 180 GB raid1 >>> disks ext4 Fedora 9 Dovecot 1.0.15 Maildir format >>> >>> The destination system is: Dual core x86_64 2GB memory 1TB raid1 >>> disks ext4 Fedora 18 Dovecot 2.1.15 sdbox format >>> >>> I am moving mail in a series of steps: >>> >>> 0) cd ( to mail user home directory ) mkdir Maildir >>> >>> 1) # rsync mail from source system (hoho4) to current (hoho0) >>> time rsync -arv --times hoho4:/home/bobgus/Maildir/ >>> /home/bobgus/Maildir/ >>> >>> This step takes about 37 minutes the first time >>> >>> 2) # dsync mirror/convert to sdbox format on current system time >>> dsync mirror maildir:~/Maildir >>> >>> This step takes about 858 minutes (!!) >>> >>> Looking at -D messages indicates that dsync is deciding between >>> duplicates much of the time. >>> >>> Looking at the results in a mail browser (Evolution), it seems >>> fine, although the latest mails are not there. >>> >>> 3) # pick up more current mail - use same script as in 1) time >>> rsync -arv --times hoho4:/home/bobgus/Maildir/ >>> /home/bobgus/Maildir/ >>> >>> This step takes about 5 minutes although this varies depending on >>> the amount of new mail. >>> >>> 4) # repeat the 2) dsync step time dsync mirror >>> maildir:~/Maildir >>> >>> This is where things look peculiar. When I look at the directory >>> of sdbox/mailboxes, I see duplicated directories >>> >>> [bobgus at hoho0 sdbox]$ cd mailboxes [bobgus at hoho0 mailboxes]$ ls >>> Apple Mail To Do Apple Mail To >>> Do_2a47983780615e5179600000ba55d82c Deleted Messages Deleted >>> Messages_2847983780615e5179600000ba55d82c Drafts >>> Drafts_2447983780615e5179600000ba55d82c Important >>> Important_2947983780615e5179600000ba55d82c INBOX >>> INBOX_1547983780615e5179600000ba55d82c Sent >>> Sent_2547983780615e5179600000ba55d82c Trash >>> Trash_2747983780615e5179600000ba55d82c >>> >>> The 2nd dsync step has not completed yet. I'm wondering whether >>> the extra directory will be magically moved into the older >>> directory. >>> >>> (This is unlikely because the file names are duplicated in the >>> new directory) >>> >>> ------- >>> >>> Is this expected behavior? Are there command changes I can make >>> to speed up the process? Eliminate the duplicate directories? >>> >>> >>> >>> >> >> -- Ken Anderson Pacific Internet - http://www.pacific.net > -- Ken Anderson Pacific Internet - http://www.pacific.net From ya.mwork at yandex.ru Sat Apr 6 08:35:14 2013 From: ya.mwork at yandex.ru (Evgeny Basov) Date: Sat, 06 Apr 2013 09:35:14 +0400 Subject: [Dovecot] v2.2.rc5 released In-Reply-To: References: <1365185241.11047.130.camel@innu> <515F14B7.7080001@yandex.ru> Message-ID: <515FB412.4010501@yandex.ru> Thank you. From bobgus at rcn.com Sat Apr 6 09:09:01 2013 From: bobgus at rcn.com (Bob Gustafson) Date: Sat, 06 Apr 2013 01:09:01 -0500 Subject: [Dovecot] repeating dsync - questions In-Reply-To: <515F9A52.5090806@pacific.net> References: <1365176449.21402.96.camel@hoho6.chidig.com> <515F1C74.6070602@pacific.net> <8AD72A37-9764-4E71-B6C6-D54B0DD0E624@chidig.com> <515F9A52.5090806@pacific.net> Message-ID: <1365228541.21402.113.camel@hoho6.chidig.com> Something must be wrong with my setup. It took 14+ hours for the first dsync pass and it hasn't finished yet on the rerun to pick up the latest mail (around 12+ hours). I have about 9 GB of mail! The destination system is not fast, but.. Maybe I will wait for the 2.2 release.. Thanks for your response. Bob G On Fri, 2013-04-05 at 22:45 -0500, Ken A wrote: > It's about 300GB of mboxes (I don't know how many messages) and dsync > took about 3 hours from scratch in the destination. But, when I sync > more frequently, it's much quicker, and depends on the number of > changes. With no changes it runs in about 15 min. > Ken A. > > > On 4/5/2013 1:54 PM, Bob Gustafson wrote: > > I tried that a week or so ago, with a 'dsync -R backup', but got the > > funny named directories, so I read more and am trying the 'dsync > > mirror' which doesn't require the -R. > > > > How long does the sync step take for you? (Normalize to # of > > messages..) > > > > Bob G > > > > On Apr 5, 2013, at 13:48, Ken A wrote: > > > >> I've found that when going in one direction, using "backup -R" > >> rather than mirror, works better. I'm going from mbox to sdbox, but > >> doing roughly the same thing you are, rsync and then dsync. > >> > >> Ken A. > >> > >> On 4/5/2013 10:40 AM, Bob Gustafson wrote: > >>> > >>> I'm moving/converting email from one system to another > >>> > >>> The source system is: Dual core x86_64 6GB memory 180 GB raid1 > >>> disks ext4 Fedora 9 Dovecot 1.0.15 Maildir format > >>> > >>> The destination system is: Dual core x86_64 2GB memory 1TB raid1 > >>> disks ext4 Fedora 18 Dovecot 2.1.15 sdbox format > >>> > >>> I am moving mail in a series of steps: > >>> > >>> 0) cd ( to mail user home directory ) mkdir Maildir > >>> > >>> 1) # rsync mail from source system (hoho4) to current (hoho0) > >>> time rsync -arv --times hoho4:/home/bobgus/Maildir/ > >>> /home/bobgus/Maildir/ > >>> > >>> This step takes about 37 minutes the first time > >>> > >>> 2) # dsync mirror/convert to sdbox format on current system time > >>> dsync mirror maildir:~/Maildir > >>> > >>> This step takes about 858 minutes (!!) > >>> > >>> Looking at -D messages indicates that dsync is deciding between > >>> duplicates much of the time. > >>> > >>> Looking at the results in a mail browser (Evolution), it seems > >>> fine, although the latest mails are not there. > >>> > >>> 3) # pick up more current mail - use same script as in 1) time > >>> rsync -arv --times hoho4:/home/bobgus/Maildir/ > >>> /home/bobgus/Maildir/ > >>> > >>> This step takes about 5 minutes although this varies depending on > >>> the amount of new mail. > >>> > >>> 4) # repeat the 2) dsync step time dsync mirror > >>> maildir:~/Maildir > >>> > >>> This is where things look peculiar. When I look at the directory > >>> of sdbox/mailboxes, I see duplicated directories > >>> > >>> [bobgus at hoho0 sdbox]$ cd mailboxes [bobgus at hoho0 mailboxes]$ ls > >>> Apple Mail To Do Apple Mail To > >>> Do_2a47983780615e5179600000ba55d82c Deleted Messages Deleted > >>> Messages_2847983780615e5179600000ba55d82c Drafts > >>> Drafts_2447983780615e5179600000ba55d82c Important > >>> Important_2947983780615e5179600000ba55d82c INBOX > >>> INBOX_1547983780615e5179600000ba55d82c Sent > >>> Sent_2547983780615e5179600000ba55d82c Trash > >>> Trash_2747983780615e5179600000ba55d82c > >>> > >>> The 2nd dsync step has not completed yet. I'm wondering whether > >>> the extra directory will be magically moved into the older > >>> directory. > >>> > >>> (This is unlikely because the file names are duplicated in the > >>> new directory) > >>> > >>> ------- > >>> > >>> Is this expected behavior? Are there command changes I can make > >>> to speed up the process? Eliminate the duplicate directories? > >>> > >>> > >>> > >>> > >> > >> -- Ken Anderson Pacific Internet - http://www.pacific.net > > > From dovecot at paz.bz Sat Apr 6 09:36:41 2013 From: dovecot at paz.bz (Jim Pazarena) Date: Fri, 05 Apr 2013 23:36:41 -0700 Subject: [Dovecot] password encryption Message-ID: <515FC279.7040407@paz.bz> I have just come to the realization that password encryption using the crypt function in linux, ONLY USES THE FIRST 8 CHARS. I have written routines using crypt allowing 16+ chars, and find that anything past 8 is ignored. Wow. Is there a way around this that can be used in dovecot, as well as encryption routines for an email front end? (not system users). It's the integration with dovecot which is the most important. From trashcan at odo.in-berlin.de Sat Apr 6 10:17:21 2013 From: trashcan at odo.in-berlin.de (Michael Grimm) Date: Sat, 6 Apr 2013 09:17:21 +0200 Subject: [Dovecot] v2.2.rc5 released In-Reply-To: <515F247F.3060603@mie.utoronto.ca> References: <1365185241.11047.130.camel@innu> <515F247F.3060603@mie.utoronto.ca> Message-ID: <7DFC13C8-26B0-45BA-86F2-ADCBD0D978E4@odo.in-berlin.de> Oscar del Rio wrote: > On 04/ 5/13 02:07 PM, Timo Sirainen wrote: >> Please test before that. :) > > so far so good, on Solaris 11.1 :) +FreeBSD 9-STABLE Regards, Michael From noel.butler at ausics.net Sat Apr 6 10:57:54 2013 From: noel.butler at ausics.net (Noel Butler) Date: Sat, 06 Apr 2013 17:57:54 +1000 Subject: [Dovecot] password encryption In-Reply-To: <515FC279.7040407@paz.bz> References: <515FC279.7040407@paz.bz> Message-ID: <1365235074.7436.4.camel@tardis> On Fri, 2013-04-05 at 23:36 -0700, Jim Pazarena wrote: > I have just come to the realization that password encryption using the > crypt function in linux, ONLY USES THE FIRST 8 CHARS. I have written > routines using crypt allowing 16+ chars, and find that anything past 8 > is ignored. Wow. > this was true in decades of old, but has not been the case for many, many, years - upgrade your system. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From professa at dementianati.com Sat Apr 6 11:37:36 2013 From: professa at dementianati.com (Professa Dementia) Date: Sat, 06 Apr 2013 01:37:36 -0700 Subject: [Dovecot] password encryption In-Reply-To: <515FC279.7040407@paz.bz> References: <515FC279.7040407@paz.bz> Message-ID: <515FDED0.1080707@dementianati.com> On 4/5/2013 11:36 PM, Jim Pazarena wrote: > I have just come to the realization that password encryption using the > crypt function in linux, ONLY USES THE FIRST 8 CHARS. I have written > routines using crypt allowing 16+ chars, and find that anything past 8 > is ignored. Wow. > > Is there a way around this that can be used in dovecot, as well as > encryption routines for an email front end? (not system users). > > It's the integration with dovecot which is the most important. > Dovecot supports *many* password hashing algorithms. Switch to SHA512 if you want good security. Generally the system figures out what hash a password is stored in, so you can mix and match. Set a default and all new passwords plus whenever a user changes their password, will generate a hash in the new format. Dem From dovecot at r.paypc.com Sat Apr 6 11:50:23 2013 From: dovecot at r.paypc.com (Robin) Date: Sat, 06 Apr 2013 01:50:23 -0700 Subject: [Dovecot] password encryption In-Reply-To: <515FC279.7040407@paz.bz> References: <515FC279.7040407@paz.bz> Message-ID: <515FE1CF.7040906@r.paypc.com> On 4/5/2013 11:36 PM, Jim Pazarena wrote: > I have just come to the realization that password encryption using the > crypt function in linux, ONLY USES THE FIRST 8 CHARS. I have written > routines using crypt allowing 16+ chars, and find that anything past 8 > is ignored. Wow. > > Is there a way around this that can be used in dovecot, as well as > encryption routines for an email front end? (not system users). Remember that most Linux distros offer a way to configure the default password salt/encryption scheme. Look in /etc/login.defs or equivalent on your distro. With any semi-recent glibc + contemporaneous toolchain, you'll see options like: # # Only works if compiled with ENCRYPTMETHOD_SELECT defined: # If set to MD5 , MD5-based algorithm will be used for encrypting password # If set to SHA256, SHA256-based algorithm will be used for encrypting password # If set to SHA512, SHA512-based algorithm will be used for encrypting password # If set to DES, DES-based algorithm will be used for encrypting password (default) # Overrides the MD5_CRYPT_ENAB option # ENCRYPT_METHOD SHA512 # # Only works if ENCRYPT_METHOD is set to SHA256 or SHA512. # # Define the number of SHA rounds. # With a lot of rounds, it is more difficult to brute forcing the password. # But note also that it more CPU resources will be needed to authenticate # users. # SHA_CRYPT_MIN_ROUNDS 400000 SHA_CRYPT_MAX_ROUNDS 4000000 Tune the values on your system so the authentication delay isn't too bad. I'm surprised your distro has defaulted to the ancient crypt(). Even slackware, not noted for being "bleeding edge" has defaulted to MD5 for a very very long time now. Of course, if you've been running the same system or one where you migrated shadow files from old ones, you may still be using those ancient shadow password formats. (No system changes those in-place for you until you explicitly change the password with new login.defs defaults in effect.) =R= From h.reindl at thelounge.net Sat Apr 6 14:18:29 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 06 Apr 2013 13:18:29 +0200 Subject: [Dovecot] script to detect dictionary attacks Message-ID: <51600485.2060503@thelounge.net> Hi has someone a script which can filter out dictionary attacks from /var/log/maillog and notify about the source-IPs? i know about fail2ban and so on, but i would like to have a mail with the IP address for two reasons and avoid fail2ban at all because it does not match in the way we maintain firewalls * add the IP to a distributed "iptables-block.sh" and distribute it to any server with a comment and timestamp * write a abuse-mail to the ISP -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From marcin at mejor.pl Sat Apr 6 15:14:34 2013 From: marcin at mejor.pl (=?ISO-8859-2?Q?Marcin_Miros=B3aw?=) Date: Sat, 06 Apr 2013 14:14:34 +0200 Subject: [Dovecot] script to detect dictionary attacks In-Reply-To: <51600485.2060503@thelounge.net> References: <51600485.2060503@thelounge.net> Message-ID: <516011AA.2030304@mejor.pl> W dniu 2013-04-06 13:18, Reindl Harald pisze: > Hi Hi! > has someone a script which can filter out dictionary attacks > from /var/log/maillog and notify about the source-IPs? > > i know about fail2ban and so on, but i would like to have > a mail with the IP address for two reasons and avoid fail2ban > at all because it does not match in the way we maintain firewalls > > * add the IP to a distributed "iptables-block.sh" and distribute > it to any server with a comment and timestamp > * write a abuse-mail to the ISP > What about ...fail2ban?:) You can define to run any script when fail2ban detects bruteforce. You can pass as parameter to script. Fail2ban can also send email to proper abuse. Maybe I'm wrong but reading what you wrote about needings it looks fail2ban can do it. Marcin From rs at sys4.de Sat Apr 6 15:15:51 2013 From: rs at sys4.de (Robert Schetterer) Date: Sat, 06 Apr 2013 14:15:51 +0200 Subject: [Dovecot] script to detect dictionary attacks In-Reply-To: <51600485.2060503@thelounge.net> References: <51600485.2060503@thelounge.net> Message-ID: <516011F7.2050102@sys4.de> Am 06.04.2013 13:18, schrieb Reindl Harald: > Hi > > has someone a script which can filter out dictionary attacks > from /var/log/maillog and notify about the source-IPs? > > i know about fail2ban and so on, but i would like to have > a mail with the IP address for two reasons and avoid fail2ban > at all because it does not match in the way we maintain firewalls > > * add the IP to a distributed "iptables-block.sh" and distribute > it to any server with a comment and timestamp > * write a abuse-mail to the ISP > Hi Harald, not exactly but i have written some blog to detect and alarm via xymon by brute force dovecot http://sys4.de/de/blog/2013/01/29/howto-monitor-brute-force-attacks-on-dovecot/ as well i have some blog about using iptables out of rsyslog pipe recent to drop ips http://sys4.de/de/blog/2012/12/28/botnets-mit-rsyslog-und-iptables-recent-modul-abwehren/ mix it up somekind in scripts and produce some mail to abuse mail account found by whois, to me alarming is enough, at my servers it looks like most alarms are comming from users with wrong login data etc , real brute force are rare Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From trashcan at odo.in-berlin.de Sat Apr 6 15:20:28 2013 From: trashcan at odo.in-berlin.de (Michael Grimm) Date: Sat, 6 Apr 2013 14:20:28 +0200 Subject: [Dovecot] replicator/dsync over tcp In-Reply-To: <71A7D3A9-0D9B-4018-861E-9439F84E5C47@iki.fi> References: <71A7D3A9-0D9B-4018-861E-9439F84E5C47@iki.fi> Message-ID: Timo Sirainen wrote: > On 24.3.2013, at 23.07, Michael Grimm wrote: > >> First of all I did need to extend http://wiki2.dovecot.org/Replication to get dsync over tcp running without ssl: > .. >> | dovecot: doveadm(test): Error: doveadm_password not set, can't authenticate to remote server > > Updated http://master.wiki2.dovecot.org/Replication with it. My point has been, that I needed to add ... | local 1.2.3.4 { | doveadm_password = secret | } ... besides ... | service doveadm { | inet_listener { | address = 1.2.3.4 | port = 12345 | } | } ... which I cannot find at http://master.wiki2.dovecot.org/Replication if I am not mistaken. >> 1. Question: may one include "secret" from a file? > > name = > Now, I did try to add ssl by activating "ssl = yes" in 'service doveadm' (see above) and adding ... >> >> | # used by replicator/dsync over tcp >> | # >> | ssl_client_ca_dir = //ssl/certs >> >> ... and ... >> >> | mail_replica = tcps:SERVER-A.TLD >> >> But, this didn't work (logfile at remote server): >> >> | dovecot: doveadm(test): Invalid certificate: self signed certificate: /OU=dovecot server/CN=OTHER-NAME.TLD/emailAddress=postmaster at OTHER-NAME.TLD >> | dovecot: doveadm(test): Error: SERVER-A.TLD: Received invalid SSL certificate >> | dovecot: doveadm(test): Error: sync: Disconnected from remote >> >> The OTHER-NAME.TLD is served by my additional settings used by my MUAs: >> >> | ssl_cert = /ssl/certs/OTHER-NAME.TLD.pem >> | ssl_key = /ssl/private/OTHER-NAME.TLD.pem >> >> I did supply SERVER-A.TLD certs and private certificates at both servers as well, but dovecot seems to use those of OTHER-NAME.TLD for replicator/dsync instead :-( > > The SERVER-A.TLD needs to have a certificate that is signed by one of the CAs in ssl_client_ca_dir. ssl_cert/key settings are irrelevant here. You can't use a self-signed cert, unless you put it into the CA dir (I don't know how exactly that works). I did get tcps running in the meantime following: 1. http://www.zytrax.com/tech/survival/ssl.html ("Method 3" plus "Multi-Server Certificates") 2. postfix' documentation at http://www.postfix.org/TLS_README.html#server_cert_key (here I had to reverse order, meaning CA first) 3. pointing ssl_cert, ssl_key to relevant files in //ssl/ca/certs and //ssl/ca/private, respectively 4. ssl_client_ca_dir = //ssl/ca/certs Question: Why is it neccessary to use ssl_cert/key settings from my CA although you state: > ssl_cert/key settings are irrelevant here. Besides dovecot is synchronising as expected, I do get a lot of logfile entries like ... | dovecot: dsync-local(test): Warning: I/O leak: 0x10b8cf20 (line 341, fd 14) ... and in addition if "verbose_ssl = yes" is set: | dsync-remote(test): Warning: SSL alert: where=0x4004, ret=256: warning close notify Hmm, I do have to admit that I do not understand SSL/TLS/CA/...! Thus, I am uncertain whether to ignore those warnings or if my setup is broken in the first place? All hints are highly appreciated, Michael From me at junc.eu Sat Apr 6 15:24:13 2013 From: me at junc.eu (Benny Pedersen) Date: Sat, 06 Apr 2013 14:24:13 +0200 Subject: [Dovecot] script to detect dictionary attacks In-Reply-To: <51600485.2060503@thelounge.net> References: <51600485.2060503@thelounge.net> Message-ID: <5fbbd7f5c2a11b70a125eb3074de92cf@junc.eu> Reindl Harald skrev den 2013-04-06 13:18: > has someone a script which can filter out dictionary attacks > from /var/log/maillog and notify about the source-IPs? yes i have :) pflogsumm > i know about fail2ban and so on, but i would like to have > a mail with the IP address for two reasons and avoid fail2ban > at all because it does not match in the way we maintain firewalls its simple to make a filter that checks unknown user in postfix logs, its even more simple if one make syslog to sql, then postfix can live block that ip that sends to unknown users > * add the IP to a distributed "iptables-block.sh" and distribute > it to any server with a comment and timestamp > * write a abuse-mail to the ISP that would be cool, lol :) From h.reindl at thelounge.net Sat Apr 6 15:43:42 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 06 Apr 2013 14:43:42 +0200 Subject: [Dovecot] script to detect dictionary attacks In-Reply-To: <5fbbd7f5c2a11b70a125eb3074de92cf@junc.eu> References: <51600485.2060503@thelounge.net> <5fbbd7f5c2a11b70a125eb3074de92cf@junc.eu> Message-ID: <5160187E.2080408@thelounge.net> Am 06.04.2013 14:24, schrieb Benny Pedersen: > Reindl Harald skrev den 2013-04-06 13:18: > >> has someone a script which can filter out dictionary attacks >> from /var/log/maillog and notify about the source-IPs? > > yes i have :) > > pflogsumm has to do what with IMAP/POP3 Logins? >> i know about fail2ban and so on, but i would like to have >> a mail with the IP address for two reasons and avoid fail2ban >> at all because it does not match in the way we maintain firewalls > > its simple to make a filter that checks unknown user in postfix logs, its even more simple if one make syslog to > sql, then postfix can live block that ip that sends to unknown users but nobody speaks about postfix >> * add the IP to a distributed "iptables-block.sh" and distribute >> it to any server with a comment and timestamp >> * write a abuse-mail to the ISP > > that would be cool, lol :) what would be cool? what *lol*? i speak about a simple way to get a notify of the brute-forcing IP and the both are MANUAL tasks i do since virtually forever -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From me at junc.eu Sat Apr 6 15:52:15 2013 From: me at junc.eu (Benny Pedersen) Date: Sat, 06 Apr 2013 14:52:15 +0200 Subject: [Dovecot] script to detect dictionary attacks In-Reply-To: <5160187E.2080408@thelounge.net> References: <51600485.2060503@thelounge.net> <5fbbd7f5c2a11b70a125eb3074de92cf@junc.eu> <5160187E.2080408@thelounge.net> Message-ID: Reindl Harald skrev den 2013-04-06 14:43: > has to do what with IMAP/POP3 Logins? patch / hack it to dovecot > but nobody speaks about postfix and nobody use sql logs > i speak about a simple way to get a notify of the brute-forcing IP > and the both are MANUAL tasks i do since virtually forever if it was simple, others have writed it already http://wiki.dovecot.org/HowTo/Fail2Ban note that it works on dovecot 1.x aswell, no need to upgrade :) From h.reindl at thelounge.net Sat Apr 6 15:59:24 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 06 Apr 2013 14:59:24 +0200 Subject: [Dovecot] script to detect dictionary attacks In-Reply-To: References: <51600485.2060503@thelounge.net> <5fbbd7f5c2a11b70a125eb3074de92cf@junc.eu> <5160187E.2080408@thelounge.net> Message-ID: <51601C2C.7050406@thelounge.net> Am 06.04.2013 14:52, schrieb Benny Pedersen: > Reindl Harald skrev den 2013-04-06 14:43: > >> has to do what with IMAP/POP3 Logins? > > patch / hack it to dovecot f**k yourself >> but nobody speaks about postfix > and nobody use sql logs are you drunken or what has this to do with sql logs? i am using both, so what the question was a already present script instead write my own so if you have nothing to say better shut up >> i speak about a simple way to get a notify of the brute-forcing IP >> and the both are MANUAL tasks i do since virtually forever > > if it was simple, others have writed it already and that was the question > http://wiki.dovecot.org/HowTo/Fail2Ban the question was a script to parse maillog and sim?ply notify and NOT fail2ban or whatever long-living process and NOT directly touch iptables, iptables-config is distributed with a inhosue solution accros the whole infrastructure > note that it works on dovecot 1.x aswell, no need to upgrade :) keep your silly smilies for yourself [root at mail:~]$ rpm -q dovecot dovecot-2.1.16-4.fc17.20130405.rh.x86_64 -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From voytek at sbt.net.au Sat Apr 6 16:01:20 2013 From: voytek at sbt.net.au (voytek at sbt.net.au) Date: Sun, 7 Apr 2013 00:01:20 +1100 Subject: [Dovecot] script to detect dictionary attacks In-Reply-To: References: <51600485.2060503@thelounge.net> <5fbbd7f5c2a11b70a125eb3074de92cf@junc.eu> <5160187E.2080408@thelounge.net> Message-ID: > > http://wiki.dovecot.org/HowTo/Fail2Ban not sure if relevant, apologize if not: fwiw, I think csf/lfd (that came on my server) does similar job, detecting login failures and blocking offenders/suspects v From CMarcus at Media-Brokers.com Sat Apr 6 16:52:18 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sat, 06 Apr 2013 09:52:18 -0400 Subject: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot In-Reply-To: References: Message-ID: <51602892.1010905@Media-Brokers.com> On 2013-04-05 5:10 PM, Michael Smith wrote: > We are currently running dovecot 2.2.rc3. > > I am trying to 'dsync mirror' old Qpopper/mbox inboxes to our new Dovecot/mdbox servers. For most of the several thousand accounts, it works without issue. But there are a handful of accounts that are generating the following errors. First rule of thumb when running PRE-RELEASE software: If you run into a problem, and there are newer releases of the PRE-RELEASE software available (Timo just released rc5 yesterday), update before asking any questions. -- Best regards, Charles From me at junc.eu Sat Apr 6 17:04:04 2013 From: me at junc.eu (Benny Pedersen) Date: Sat, 06 Apr 2013 16:04:04 +0200 Subject: [Dovecot] script to detect dictionary attacks In-Reply-To: <51601C2C.7050406@thelounge.net> References: <51600485.2060503@thelounge.net> <5fbbd7f5c2a11b70a125eb3074de92cf@junc.eu> <5160187E.2080408@thelounge.net> <51601C2C.7050406@thelounge.net> Message-ID: <609d708b0f0dfb4cd1c25af007347280@junc.eu> Reindl Harald skrev den 2013-04-06 14:59: > keep your silly smilies for yourself haha > [root at mail:~]$ rpm -q dovecot > dovecot-2.1.16-4.fc17.20130405.rh.x86_64 you live in a precompiled problem learn grep, cut, sort, and more on how to use fail2ban, just ignore my help will not solve it for you From h.reindl at thelounge.net Sat Apr 6 17:14:39 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 06 Apr 2013 16:14:39 +0200 Subject: [Dovecot] script to detect dictionary attacks In-Reply-To: <609d708b0f0dfb4cd1c25af007347280@junc.eu> References: <51600485.2060503@thelounge.net> <5fbbd7f5c2a11b70a125eb3074de92cf@junc.eu> <5160187E.2080408@thelounge.net> <51601C2C.7050406@thelounge.net> <609d708b0f0dfb4cd1c25af007347280@junc.eu> Message-ID: <51602DCF.6000907@thelounge.net> Am 06.04.2013 16:04, schrieb Benny Pedersen: > Reindl Harald skrev den 2013-04-06 14:59: > >> keep your silly smilies for yourself > haha what haha? you are a young boy with no knowledge proven many times >> [root at mail:~]$ rpm -q dovecot >> dovecot-2.1.16-4.fc17.20130405.rh.x86_64 > you live in a precompiled problem idiot guess what the "rh" in "20130405.rh" means > learn grep, cut, sort, and more boy i am developer and use them all the day a lot > on how to use fail2ban > just ignore my help will not solve it for you to help you would need to understand the question what did you idiot not undersatnd in the inital post that fail2ban does not interest me because i do NOT want shorewall and whatever piece of crap on the infrastrcuture? gamin-python, python-inotify, shorewall, shorewall-core are not neeeded here PERIOD [root at buildserver:~]$ LANG=C; yum install fail2ban Loaded plugins: etckeeper, presto, protectbase, security 0 packages excluded due to repository protections Resolving Dependencies --> Running transaction check ---> Package fail2ban.noarch 0:0.8.8-2.fc17 will be installed --> Processing Dependency: shorewall for package: fail2ban-0.8.8-2.fc17.noarch --> Processing Dependency: python-inotify for package: fail2ban-0.8.8-2.fc17.noarch --> Processing Dependency: gamin-python for package: fail2ban-0.8.8-2.fc17.noarch --> Running transaction check ---> Package gamin-python.x86_64 0:0.1.10-12.fc17 will be installed ---> Package python-inotify.noarch 0:0.9.4-1.fc17 will be installed ---> Package shorewall.noarch 0:4.5.7.1-2.fc17 will be installed --> Processing Dependency: shorewall-core = 4.5.7.1-2.fc17 for package: shorewall-4.5.7.1-2.fc17.noarch --> Running transaction check ---> Package shorewall-core.noarch 0:4.5.7.1-2.fc17 will be installed --> Finished Dependency Resolution --> Finding unneeded leftover dependencies -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From arnaud.abelard at univ-nantes.fr Sat Apr 6 18:18:36 2013 From: arnaud.abelard at univ-nantes.fr (=?ISO-8859-1?Q?Arnaud_Ab=E9lard?=) Date: Sat, 06 Apr 2013 17:18:36 +0200 Subject: [Dovecot] autocreate mailbox but no sub folders Message-ID: <51603CCC.70204@univ-nantes.fr> Hello, We have been using lda_mailbox_autocreate to avoid to intialize empty mailboxes upon account creations. This does the job allright except that dovecot-lda is also allowed to autocreate sub folders which is a problem when using addresses extensions (adress+folder at domain.tld). It's easy for a malicious user to flood a mailbox with tons of subfolders. Is there a way to tell dovecot-lda it can only create the initial mailbox and maybe some special folders but nothing else? Thanks, Arnaud -- Arnaud Ab?lard jabber: arnaud.abelard at univ-nantes.fr / twitter: ArnY Administrateur Syst?me DSI Universit? de Nantes - From ka at pacific.net Sat Apr 6 18:19:47 2013 From: ka at pacific.net (Ken A) Date: Sat, 06 Apr 2013 10:19:47 -0500 Subject: [Dovecot] repeating dsync - questions In-Reply-To: <1365228541.21402.113.camel@hoho6.chidig.com> References: <1365176449.21402.96.camel@hoho6.chidig.com> <515F1C74.6070602@pacific.net> <8AD72A37-9764-4E71-B6C6-D54B0DD0E624@chidig.com> <515F9A52.5090806@pacific.net> <1365228541.21402.113.camel@hoho6.chidig.com> Message-ID: <51603D13.10806@pacific.net> Maybe take a look at "vmstat 2" and see if i/o is blocking a lot or you are hitting swap space? Someone else may be more informed about the inner workings of dsync and how it handles maildir as opposed to mbox. Best of luck, Ken On 4/6/2013 1:09 AM, Bob Gustafson wrote: > Something must be wrong with my setup. It took 14+ hours for the first > dsync pass and it hasn't finished yet on the rerun to pick up the latest > mail (around 12+ hours). I have about 9 GB of mail! The destination > system is not fast, but.. > > Maybe I will wait for the 2.2 release.. > > Thanks for your response. > > Bob G > > On Fri, 2013-04-05 at 22:45 -0500, Ken A wrote: >> It's about 300GB of mboxes (I don't know how many messages) and dsync >> took about 3 hours from scratch in the destination. But, when I sync >> more frequently, it's much quicker, and depends on the number of >> changes. With no changes it runs in about 15 min. >> Ken A. >> >> >> On 4/5/2013 1:54 PM, Bob Gustafson wrote: >>> I tried that a week or so ago, with a 'dsync -R backup', but got the >>> funny named directories, so I read more and am trying the 'dsync >>> mirror' which doesn't require the -R. >>> >>> How long does the sync step take for you? (Normalize to # of >>> messages..) >>> >>> Bob G >>> >>> On Apr 5, 2013, at 13:48, Ken A wrote: >>> >>>> I've found that when going in one direction, using "backup -R" >>>> rather than mirror, works better. I'm going from mbox to sdbox, but >>>> doing roughly the same thing you are, rsync and then dsync. >>>> >>>> Ken A. >>>> >>>> On 4/5/2013 10:40 AM, Bob Gustafson wrote: >>>>> >>>>> I'm moving/converting email from one system to another >>>>> >>>>> The source system is: Dual core x86_64 6GB memory 180 GB raid1 >>>>> disks ext4 Fedora 9 Dovecot 1.0.15 Maildir format >>>>> >>>>> The destination system is: Dual core x86_64 2GB memory 1TB raid1 >>>>> disks ext4 Fedora 18 Dovecot 2.1.15 sdbox format >>>>> >>>>> I am moving mail in a series of steps: >>>>> >>>>> 0) cd ( to mail user home directory ) mkdir Maildir >>>>> >>>>> 1) # rsync mail from source system (hoho4) to current (hoho0) >>>>> time rsync -arv --times hoho4:/home/bobgus/Maildir/ >>>>> /home/bobgus/Maildir/ >>>>> >>>>> This step takes about 37 minutes the first time >>>>> >>>>> 2) # dsync mirror/convert to sdbox format on current system time >>>>> dsync mirror maildir:~/Maildir >>>>> >>>>> This step takes about 858 minutes (!!) >>>>> >>>>> Looking at -D messages indicates that dsync is deciding between >>>>> duplicates much of the time. >>>>> >>>>> Looking at the results in a mail browser (Evolution), it seems >>>>> fine, although the latest mails are not there. >>>>> >>>>> 3) # pick up more current mail - use same script as in 1) time >>>>> rsync -arv --times hoho4:/home/bobgus/Maildir/ >>>>> /home/bobgus/Maildir/ >>>>> >>>>> This step takes about 5 minutes although this varies depending on >>>>> the amount of new mail. >>>>> >>>>> 4) # repeat the 2) dsync step time dsync mirror >>>>> maildir:~/Maildir >>>>> >>>>> This is where things look peculiar. When I look at the directory >>>>> of sdbox/mailboxes, I see duplicated directories >>>>> >>>>> [bobgus at hoho0 sdbox]$ cd mailboxes [bobgus at hoho0 mailboxes]$ ls >>>>> Apple Mail To Do Apple Mail To >>>>> Do_2a47983780615e5179600000ba55d82c Deleted Messages Deleted >>>>> Messages_2847983780615e5179600000ba55d82c Drafts >>>>> Drafts_2447983780615e5179600000ba55d82c Important >>>>> Important_2947983780615e5179600000ba55d82c INBOX >>>>> INBOX_1547983780615e5179600000ba55d82c Sent >>>>> Sent_2547983780615e5179600000ba55d82c Trash >>>>> Trash_2747983780615e5179600000ba55d82c >>>>> >>>>> The 2nd dsync step has not completed yet. I'm wondering whether >>>>> the extra directory will be magically moved into the older >>>>> directory. >>>>> >>>>> (This is unlikely because the file names are duplicated in the >>>>> new directory) >>>>> >>>>> ------- >>>>> >>>>> Is this expected behavior? Are there command changes I can make >>>>> to speed up the process? Eliminate the duplicate directories? >>>>> >>>>> >>>>> >>>>> >>>> >>>> -- Ken Anderson Pacific Internet - http://www.pacific.net >>> >> > > -- Ken Anderson Pacific Internet - http://www.pacific.net From bobgus at rcn.com Sat Apr 6 19:58:01 2013 From: bobgus at rcn.com (Bob Gustafson) Date: Sat, 6 Apr 2013 11:58:01 -0500 Subject: [Dovecot] repeating dsync - questions In-Reply-To: <51603D13.10806@pacific.net> References: <1365176449.21402.96.camel@hoho6.chidig.com> <515F1C74.6070602@pacific.net> <8AD72A37-9764-4E71-B6C6-D54B0DD0E624@chidig.com> <515F9A52.5090806@pacific.net> <1365228541.21402.113.camel@hoho6.chidig.com> <51603D13.10806@pacific.net> Message-ID: <3D7EEAD5-D23D-4174-8A0D-261B3FE6B081@chidig.com> I whacked Maildir and sdbox and started over. Tweek of rsync script - removed trailing / on destination. Did yum update, restart Avoided running Firefox on that machine.. It is now running the 1st pass of dsync - estimated finish is about 4.3 hours on 14G of mails vmstat 2 shows no swapping (now..) Thanks for your suggestion. Bob G On Apr 6, 2013, at 10:19, Ken A wrote: > Maybe take a look at "vmstat 2" and see if i/o is blocking a lot or you > are hitting swap space? Someone else may be more informed about the > inner workings of dsync and how it handles maildir as opposed to mbox. > Best of luck, > Ken > > > On 4/6/2013 1:09 AM, Bob Gustafson wrote: >> Something must be wrong with my setup. It took 14+ hours for the first >> dsync pass and it hasn't finished yet on the rerun to pick up the latest >> mail (around 12+ hours). I have about 9 GB of mail! The destination >> system is not fast, but.. >> >> Maybe I will wait for the 2.2 release.. >> >> Thanks for your response. >> >> Bob G >> >> On Fri, 2013-04-05 at 22:45 -0500, Ken A wrote: >>> It's about 300GB of mboxes (I don't know how many messages) and dsync >>> took about 3 hours from scratch in the destination. But, when I sync >>> more frequently, it's much quicker, and depends on the number of >>> changes. With no changes it runs in about 15 min. >>> Ken A. >>> >>> >>> On 4/5/2013 1:54 PM, Bob Gustafson wrote: >>>> I tried that a week or so ago, with a 'dsync -R backup', but got the >>>> funny named directories, so I read more and am trying the 'dsync >>>> mirror' which doesn't require the -R. >>>> >>>> How long does the sync step take for you? (Normalize to # of >>>> messages..) >>>> >>>> Bob G >>>> >>>> On Apr 5, 2013, at 13:48, Ken A wrote: >>>> >>>>> I've found that when going in one direction, using "backup -R" >>>>> rather than mirror, works better. I'm going from mbox to sdbox, but >>>>> doing roughly the same thing you are, rsync and then dsync. >>>>> >>>>> Ken A. >>>>> >>>>> On 4/5/2013 10:40 AM, Bob Gustafson wrote: >>>>>> >>>>>> I'm moving/converting email from one system to another >>>>>> >>>>>> The source system is: Dual core x86_64 6GB memory 180 GB raid1 >>>>>> disks ext4 Fedora 9 Dovecot 1.0.15 Maildir format >>>>>> >>>>>> The destination system is: Dual core x86_64 2GB memory 1TB raid1 >>>>>> disks ext4 Fedora 18 Dovecot 2.1.15 sdbox format >>>>>> >>>>>> I am moving mail in a series of steps: >>>>>> >>>>>> 0) cd ( to mail user home directory ) mkdir Maildir >>>>>> >>>>>> 1) # rsync mail from source system (hoho4) to current (hoho0) >>>>>> time rsync -arv --times hoho4:/home/bobgus/Maildir/ >>>>>> /home/bobgus/Maildir/ >>>>>> >>>>>> This step takes about 37 minutes the first time >>>>>> >>>>>> 2) # dsync mirror/convert to sdbox format on current system time >>>>>> dsync mirror maildir:~/Maildir >>>>>> >>>>>> This step takes about 858 minutes (!!) >>>>>> >>>>>> Looking at -D messages indicates that dsync is deciding between >>>>>> duplicates much of the time. >>>>>> >>>>>> Looking at the results in a mail browser (Evolution), it seems >>>>>> fine, although the latest mails are not there. >>>>>> >>>>>> 3) # pick up more current mail - use same script as in 1) time >>>>>> rsync -arv --times hoho4:/home/bobgus/Maildir/ >>>>>> /home/bobgus/Maildir/ >>>>>> >>>>>> This step takes about 5 minutes although this varies depending on >>>>>> the amount of new mail. >>>>>> >>>>>> 4) # repeat the 2) dsync step time dsync mirror >>>>>> maildir:~/Maildir >>>>>> >>>>>> This is where things look peculiar. When I look at the directory >>>>>> of sdbox/mailboxes, I see duplicated directories >>>>>> >>>>>> [bobgus at hoho0 sdbox]$ cd mailboxes [bobgus at hoho0 mailboxes]$ ls >>>>>> Apple Mail To Do Apple Mail To >>>>>> Do_2a47983780615e5179600000ba55d82c Deleted Messages Deleted >>>>>> Messages_2847983780615e5179600000ba55d82c Drafts >>>>>> Drafts_2447983780615e5179600000ba55d82c Important >>>>>> Important_2947983780615e5179600000ba55d82c INBOX >>>>>> INBOX_1547983780615e5179600000ba55d82c Sent >>>>>> Sent_2547983780615e5179600000ba55d82c Trash >>>>>> Trash_2747983780615e5179600000ba55d82c >>>>>> >>>>>> The 2nd dsync step has not completed yet. I'm wondering whether >>>>>> the extra directory will be magically moved into the older >>>>>> directory. >>>>>> >>>>>> (This is unlikely because the file names are duplicated in the >>>>>> new directory) >>>>>> >>>>>> ------- >>>>>> >>>>>> Is this expected behavior? Are there command changes I can make >>>>>> to speed up the process? Eliminate the duplicate directories? >>>>>> >>>>>> >>>>>> >>>>>> >>>>> >>>>> -- Ken Anderson Pacific Internet - http://www.pacific.net >>>> >>> >> >> > > -- > Ken Anderson > Pacific Internet - http://www.pacific.net From richw at richw.org Sat Apr 6 23:51:43 2013 From: richw at richw.org (Rich Wales) Date: Sat, 06 Apr 2013 13:51:43 -0700 Subject: [Dovecot] mdbox and folders containing both messages and sub-folders Message-ID: <51608ADF.50801@liberation.richw.org> I've got Dovecot 2.2r5 (Ubuntu package version 2:2.2.0~rc5-0~auto+1 from the "testing-auto/dovecot-2.2" repository on xi.rename-it.nl) running on a brand-new Ubuntu 12.04.2 server. I'm trying to configure Dovecot (using the "mdbox" mailbox format) to allow folders to contain both messages and sub-folders. However, it's not working consistently. I need to have folders with both messages and sub-folders because I'm trying to migrate mail from an existing (but soon-to-be-retired) Cyrus server, and the existing body of mail has folders of this sort. I'm currently using the following configuration line: mail_location = mdbox:~/mdbox:DIRNAME=.indexes:INDEX=~/mdbox/indexes and am using the Larch program to do an IMAP-to-IMAP copy of one of my family member's mail from the old Cyrus server to the new Dovecot server. When I examine the "mailboxes" directory tree, I see some directories that (correctly) contain both the renamed ".indexes" directory and also directories for IMAP subfolders. However, the Larch output is showing many errors of the form "mailbox cannot contain messages", and some of the messages could not be migrated because of this problem. Am I doing something wrong? Or is the "folders containing both messages and sub-folders" feature simply broken for the "mdbox" format -- meaning presumably that I'll be forced either to use the Maildir format, or else abandon Dovecot entirely and install Cyrus on my new mail server instead? Rich Wales richw at richw.org From pyz at brama.com Sat Apr 6 23:55:11 2013 From: pyz at brama.com (Max Pyziur) Date: Sat, 6 Apr 2013 16:55:11 -0400 (EDT) Subject: [Dovecot] script to detect dictionary attacks In-Reply-To: <51600485.2060503@thelounge.net> References: <51600485.2060503@thelounge.net> Message-ID: On Sat, 6 Apr 2013, Reindl Harald wrote: > Hi > > has someone a script which can filter out dictionary attacks > from /var/log/maillog and notify about the source-IPs? > > i know about fail2ban and so on, but i would like to have > a mail with the IP address for two reasons and avoid fail2ban > at all because it does not match in the way we maintain firewalls > > * add the IP to a distributed "iptables-block.sh" and distribute > it to any server with a comment and timestamp > * write a abuse-mail to the ISP Thinking tangentially to this proposal, are there blacklists (BLs) maintained regarding known IPs perpetrating attempts at pop/imap intrusions, much in the same way CBL does for spam, and OpenBL (http://www.openbl.org/lists.html) does for ssh (primarily)? That way, you leave your iptables configuration status quo, and create a mechanism to use the resource (the BLs) to populate your /etc/hosts.deny file, using tcp_wrappers to prevent intrusion/brute force attacks on service that have open ports in the firewall. Thanks, Max Pyziur pyz at brama.com From stephan at rename-it.nl Sat Apr 6 23:55:17 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 06 Apr 2013 22:55:17 +0200 Subject: [Dovecot] Released Pigeonhole v0.3.4 for Dovecot v2.1.16 Message-ID: <51608BB5.4010209@rename-it.nl> Hello Dovecot users, Much time passed since I last released a new Pigeonhole, so quite a few unreleased fixes were pending until now. Development of new features is shifted to the upcoming Pigeonhole v0.4 for Dovecot v2.2. I intend to release v0.4.0 shortly after Dovecot v2.2.0. Changelog v0.3.4: * Changed error handling to be less of a nuisance for administrators. Strictly user-caused errors are only reported in user log. Some errors are logged as info instead. * Sieve: Changed behavior of redirect in case of a duplicate message delivery or a mail loop. If a duplicate is detected the implicit keep is canceled, as though the redirect was successful. This prevents getting local deliveries. The original SMTP recipient is used when it is available to augment the entry in the LDA duplicate database. This way, duplicates are only detected when (initially) addressed to the same recipient. + Sieve vnd.dovecot.duplicate extension: added new features to the duplicate test, making it possible to manually compose the key value for duplicate checking. This extension is in the process of being standardized: https://tools.ietf.org/html/draft-bosch-sieve-duplicate-01 + Sieve date extension: generate warning when invalid date part is specified. - Sieve editheader extension: fixed crash occurring when addheader :last was used. - Sieve include extension: fixed missing error cleanup that caused a resource leak. - Sieve vacation extension: fixed determination of From: address for when sieve_vacation_dont_check_recipient is active. - Sieve tools: the -D option wasn't enabled and documented for all tools. - Sieve dict script storage: fixed potential segfault occurring when dict initialization fails. - ManageSieve: fixed bug in skipping of CRLF at end of AUTHENTICATE command. - ManageSieve: fixed handling of unknown commands pre-login. - Fixed compile on Mageia Linux. The release is available as follows: http://www.rename-it.nl/dovecot/2.1/dovecot-2.1-pigeonhole-0.3.4.tar.gz http://www.rename-it.nl/dovecot/2.1/dovecot-2.1-pigeonhole-0.3.4.tar.gz.sig Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this new release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan at rename-it.nl From h.reindl at thelounge.net Sun Apr 7 00:00:49 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sat, 06 Apr 2013 23:00:49 +0200 Subject: [Dovecot] script to detect dictionary attacks In-Reply-To: References: <51600485.2060503@thelounge.net> Message-ID: <51608D01.8090307@thelounge.net> Am 06.04.2013 22:55, schrieb Max Pyziur: > On Sat, 6 Apr 2013, Reindl Harald wrote: >> has someone a script which can filter out dictionary attacks >> from /var/log/maillog and notify about the source-IPs? >> >> i know about fail2ban and so on, but i would like to have >> a mail with the IP address for two reasons and avoid fail2ban >> at all because it does not match in the way we maintain firewalls >> >> * add the IP to a distributed "iptables-block.sh" and distribute >> it to any server with a comment and timestamp >> * write a abuse-mail to the ISP > > Thinking tangentially to this proposal, are there blacklists (BLs) maintained regarding known IPs perpetrating > attempts at pop/imap intrusions, much in the same way CBL does for spam, and OpenBL > (http://www.openbl.org/lists.html) does for ssh (primarily)? > > That way, you leave your iptables configuration status quo, and create a mechanism to use the resource (the BLs) to > populate your /etc/hosts.deny file, using tcp_wrappers to prevent intrusion/brute force attacks on service that > have open ports in the firewall i don't know but in fact i want not rely on automatisms and blacklists sometimes i recognize a dictionary attack because "tail -f" on the mailserver is running in background and after come back from a cigarette break i look a minute in the output and if i see attacks i add the IP after a whois to "iptables-block.sh" so i do not want to rely on automagic and if some IP is added to whatever blacklist hours or days later, i want simply a one-time mail notify to look NOW in maillog and take action or ignore it depending on the count and source if it is some ISP from a country far away -> block it if it is the fivth attempt from this ISP -> block the whole subnet if it is a major ISP of the country i live (asutria) -> only absue mail to the ISP -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From pyz at brama.com Sun Apr 7 00:13:19 2013 From: pyz at brama.com (Max Pyziur) Date: Sat, 6 Apr 2013 17:13:19 -0400 (EDT) Subject: [Dovecot] script to detect dictionary attacks In-Reply-To: <51608D01.8090307@thelounge.net> References: <51600485.2060503@thelounge.net> <51608D01.8090307@thelounge.net> Message-ID: On Sat, 6 Apr 2013, Reindl Harald wrote: > > > Am 06.04.2013 22:55, schrieb Max Pyziur: >> On Sat, 6 Apr 2013, Reindl Harald wrote: >>> has someone a script which can filter out dictionary attacks >>> from /var/log/maillog and notify about the source-IPs? >>> >>> i know about fail2ban and so on, but i would like to have >>> a mail with the IP address for two reasons and avoid fail2ban >>> at all because it does not match in the way we maintain firewalls >>> >>> * add the IP to a distributed "iptables-block.sh" and distribute >>> it to any server with a comment and timestamp >>> * write a abuse-mail to the ISP >> >> Thinking tangentially to this proposal, are there blacklists (BLs) maintained regarding known IPs perpetrating >> attempts at pop/imap intrusions, much in the same way CBL does for spam, and OpenBL >> (http://www.openbl.org/lists.html) does for ssh (primarily)? >> >> That way, you leave your iptables configuration status quo, and create a mechanism to use the resource (the BLs) to >> populate your /etc/hosts.deny file, using tcp_wrappers to prevent intrusion/brute force attacks on service that >> have open ports in the firewall > > i don't know but in fact i want not rely on automatisms and blacklists CBL is fairly reliable; you can screen it based on originating countries (I use ip2cc available from perl-IP-Country-2.27-1.el6.noarch to find the originating country for particular ips). I'm tentatively using OpenBL to block dictionary attacks by way of ssh. By way of logwatch, I see enough dictionary attacks on dovecot; I take those ips and hope to use them soon to block dovecot attacks. The problem is the "aging": there needs to be a mechanism that determines whether or not an ip continues to be a threat. The BLs are good for that - once an ip or, say, the first three octets, diminish in frequency of attacks, then based on some threshold that you set, you can remove that ip (or set of ips) as a hostile threat to a particular service that you are running on your server/servers. > sometimes i recognize a dictionary attack because "tail -f" on the mailserver > is running in background and after come back from a cigarette break i look > a minute in the output and if i see attacks i add the IP after a whois to > "iptables-block.sh" > > so i do not want to rely on automagic and if some IP is added to whatever > blacklist hours or days later, i want simply a one-time mail notify to > look NOW in maillog and take action or ignore it depending on the > count and source > > if it is some ISP from a country far away -> block it > if it is the fivth attempt from this ISP -> block the whole subnet > > if it is a major ISP of the country i live (asutria) -> only absue mail to the ISP I understand the logic; I set a low threshold to label something being a threat for anything originating in China; the threshold is higher for things closer to home, since most of the traffic to the one server I control is from there. MP pyz at brama.com From professa at dementianati.com Sun Apr 7 00:48:00 2013 From: professa at dementianati.com (Professa Dementia) Date: Sat, 06 Apr 2013 14:48:00 -0700 Subject: [Dovecot] script to detect dictionary attacks In-Reply-To: References: <51600485.2060503@thelounge.net> <51608D01.8090307@thelounge.net> Message-ID: <51609810.8030406@dementianati.com> On 4/6/2013 2:13 PM, Max Pyziur wrote: > On Sat, 6 Apr 2013, Reindl Harald wrote: >> if it is some ISP from a country far away -> block it >> if it is the fivth attempt from this ISP -> block the whole subnet >> >> if it is a major ISP of the country i live (asutria) -> only absue >> mail to the ISP > > I understand the logic; I set a low threshold to label something being a > threat for anything originating in China; the threshold is higher for > things closer to home, since most of the traffic to the one server I > control is from there. > The problem with a non-automated system, such as manually blocking China, is that it does not easily and quickly adapt. Both of the following I have experienced: 1) Excessive spam and hacking from China. I blocked China. Then I got a client that did business in China and had a branch office there. Suddenly I cannot block login attempts from China. And the users complains loudly about the excessive reject rate of legitimate emails from Chinese customers due to the spam filters. Also, legitimate users in China pick weak passwords which get hacked. Convincing the customer to improve passwords, security, use a VPN for Chinese users to access email so I can block China again were unsuccessful. While this is a bit beyond the scope of this list, the underlying problem is that in many far east countries, hacking is not illegal and thus there is no fear of getting caught, since there is no punishment. The real solution is to change those laws and have those countries enforce the laws. Good luck with that, however. 2) I tried compiling a list of IPs used for hacking. As a test, I manually put them into the firewall to see if that stops anything. Results were that a single IP will attempt to brute force several hundred passwords, but then I never hear from that IP again, so the firewall block was pointless. However another, seemingly unrelated IP, takes up the brute force attack. Without an automated system, like fail2ban, I am just playing Whack-A-Mole and never actually manage to block any attempts. In a different scenario, I also see 1-2 attempts from each IP in a group of thousands of IPs. These IPs do have legitimate users within them, so I cannot block whole IP ranges. All these indicate that the brute force attacks are being implemented on zombie nets. I do not see a perfect solution, or even a good one. A mediocre solution is a combination of fail2ban (which I have implemented), and enforcing strong passwords. A feature that would be nice is if Dovecot could detect that X bad attempts for a given User ID happen in Y time, then that User ID is blocked (always gives back a bad authentication, even if the correct password is entered) for Z time. Also, Dovecot could slow down its reply, much like a tarpit. These would be configurable. For example, if 3 bad password attempts are received for user at domain.com within 2 minutes, then the user is blocked for 10 minutes. That with strong passwords will make the system reasonably safe from zombie net attacks. Also, the tarpit feature would slow down the attacks and ease the bandwidth issue. I am very willing to work with anyone on a solution that works better than these methods. As I see it, in order for a blacklist to work, it has to be large and distributed, like the spam blacklists are. Dovecot would need to report to the blacklist cloud, any IPs that it detects are being used to launch attacks. This is a big undertaking. Dem From h.reindl at thelounge.net Sun Apr 7 01:18:07 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sun, 07 Apr 2013 00:18:07 +0200 Subject: [Dovecot] script to detect dictionary attacks In-Reply-To: <51609810.8030406@dementianati.com> References: <51600485.2060503@thelounge.net> <51608D01.8090307@thelounge.net> <51609810.8030406@dementianati.com> Message-ID: <51609F1F.3000907@thelounge.net> Am 06.04.2013 23:48, schrieb Professa Dementia: > Both of the following I have experienced: > > 1) Excessive spam and hacking from China. I blocked China. Then I got a client that did business in China and had > a branch office there. Suddenly I cannot block login attempts from China. And the users complains loudly about the > excessive reject rate of legitimate emails from Chinese customers due to the spam filters. again: * i am on the dovecot list * i speak about dictionary attacks on POP3/IMAP * reject rate is not a topic here well, even if i would speak about the MTA it would not be a topic the MTA is a commercial spam-appliance and postfix not directly the MX -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From sdavies at sdc.com.au Sun Apr 7 02:40:05 2013 From: sdavies at sdc.com.au (Stephen Davies) Date: Sun, 7 Apr 2013 09:10:05 +0930 Subject: [Dovecot] script to detect dictionary attacks Message-ID: <201304070910.05948.sdavies@sdc.com.au> Here is the simplex script that I use to filter attacking sites. I should be easy to add your extra bits (email etc). Cheers, Stephen #! /bin/sh d=`date +"%b %d"` grep "$d" /var/log/mail/info.log|grep ruleset=check_rcp | gawk '{split($0,q,/[\[\]]/);print "/sbin/iptables -A INPUT -s " q[4] "/32 -j DROP"}' | sort -u > /tmp/fw$$ #reset iptable to base /etc/rc.d/rc.fw > /dev/null 2>&1 #add new filter(s) . /tmp/fw$$ rm -f /tmp/fw$$ -- ============================================================================= Stephen Davies Consulting P/L Phone: 08-8177 1595 Adelaide, South Australia. Mobile:040 304 0583 Records & Collections Management. From stephan at rename-it.nl Sun Apr 7 03:35:20 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Sun, 07 Apr 2013 02:35:20 +0200 Subject: [Dovecot] The sieve_extprograms plugin included in main Pigeonhole 0.4 source tree Message-ID: <5160BF48.2030804@rename-it.nl> Hi, I think the sieve_extprograms is mature enough for an initial release and that is why I've included the sieve_extprograms plugin into the main Pigeonhole v0.4 source tree. It is still a plugin, but is no longer provided as a separate package. This should make things easier. It will be released along with Pigeonhole v0.4.0. Regards, Stephan. From anmeyer at anup.de Sun Apr 7 12:05:39 2013 From: anmeyer at anup.de (Andreas Meyer) Date: Sun, 7 Apr 2013 11:05:39 +0200 Subject: [Dovecot] IDLE and inactivity Message-ID: <20130407110539.59610cf5@itxnew.bitcorner.intern> Good day! Apr 07 10:59:40 imap(anmeyer at anup.de): Info: Disconnected: Disconnected in IDLE in=725 out=2546 Apr 07 10:59:59 imap(anmeyer at anup.de): Info: Disconnected for inactivity in=952 out=25789 Please someone explain to me the IDLE state and the inactivity state an what the numbers at in= and out= means! Andreas From benfell at parts-unknown.org Sat Apr 6 11:09:45 2013 From: benfell at parts-unknown.org (David Benfell) Date: Sat, 6 Apr 2013 01:09:45 -0700 Subject: [Dovecot] MOSTLY SOLVED: Re: client limit and STARTTLS In-Reply-To: <1365216182.3833.9.camel@tardis> References: <515F2EA7.9020804@gmail.com> <1365216182.3833.9.camel@tardis> Message-ID: <20130406080908.GA1627@graton2.parts-unknown.org> Hi Noel, On Sat, Apr 06, 2013 at 12:43:02PM +1000, Noel Butler wrote: > > > Second question: STARTTLS isn't working. What am I missing? Sorry if > > this is something that should be obvious; I'm fighting a similar > > battle with postfix and I'm being pushed around the bend while I > > really need to be working on other things. > > > > Are your certificate chains valid? Simply saying "isn't working" is > almost a requirement for a *sigh* > log output please, or a better description than "isn't working" ;) > Clearly this had been wrong at the previous installation as well. I don't know why I had seen it differently before. Yes, the certificate chains were screwed up. And you hit the nail on the head when you pointed to chains. It's a StartSSL cert and I've had trouble getting this straight from the beginning. Thanks! Now if we can sort out how to set the client and process limits. I changed the settings like thus: default_process_limit = 1024 default_client_limit = 4096 Now it tells me something different, but much less urgently, at startup: Apr 06 00:13:42 munich.parts-unknown.org dovecot[1816]: Warning: fd limit (ulimit -n) is lower than required under max. load (1024 < 4096), because of default_client_count The truth is, I can't imagine having 4096 clients. I mean, it's true, I like my toys, but..... So I changed it again: default_process_limit = 128 default_client_limit = 512 And now it seems to be fine. But I'm mystified because what you say is the case on your system, that is, that the process limit needs to be greater than the client limit, is what I would expect: wouldn't each client require at least one process? Thanks! -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 836 bytes Desc: not available URL: From h.reindl at thelounge.net Sun Apr 7 13:15:13 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sun, 07 Apr 2013 12:15:13 +0200 Subject: [Dovecot] MOSTLY SOLVED: Re: client limit and STARTTLS In-Reply-To: <20130406080908.GA1627@graton2.parts-unknown.org> References: <515F2EA7.9020804@gmail.com> <1365216182.3833.9.camel@tardis> <20130406080908.GA1627@graton2.parts-unknown.org> Message-ID: <51614731.50900@thelounge.net> Am 06.04.2013 10:09, schrieb David Benfell: > So I changed it again: > > default_process_limit = 128 > default_client_limit = 512 > > And now it seems to be fine. But I'm mystified because what you say is > the case on your system, that is, that the process limit needs to be > greater than the client limit, is what I would expect: wouldn't each > client require at least one process? no, 512x128 = 65536 connections each process can serve default_client_limit clients -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From h.reindl at thelounge.net Sun Apr 7 13:44:41 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sun, 07 Apr 2013 12:44:41 +0200 Subject: [Dovecot] MOSTLY SOLVED: Re: client limit and STARTTLS In-Reply-To: <51614C30.5000109@parts-unknown.org> References: <515F2EA7.9020804@gmail.com> <1365216182.3833.9.camel@tardis> <20130406080908.GA1627@graton2.parts-unknown.org> <51614731.50900@thelounge.net> <51614C30.5000109@parts-unknown.org> Message-ID: <51614E19.1000808@thelounge.net> Am 07.04.2013 12:36, schrieb David Benfell: > On 04/07/2013 03:15 AM, Reindl Harald wrote: >> Am 06.04.2013 10:09, schrieb David Benfell: >>> So I changed it again: >>> >>> default_process_limit = 128 default_client_limit = 512 >>> >>> And now it seems to be fine. But I'm mystified because what you >>> say is the case on your system, that is, that the process limit >>> needs to be greater than the client limit, is what I would >>> expect: wouldn't each client require at least one process? > >> no, 512x128 = 65536 connections each process can serve >> default_client_limit clients > > Thanks a million! I had no idea that was how it worked. I would think > that 65536 would be enough. ;-) http://wiki2.dovecot.org/LoginProcess High-performance mode: It works by using a number of long running login processes, each handling a number of connections. This loses much of the security benefits of the login process design, because in case of a security hole (in Dovecot or SSL library) the attacker is now able to see other users logging in and steal their passwords, read their mails, etc. Default client_limit * process_limit = 1000*100 = 100k connections vsz_limit should be increased to avoid out of memory errors, especially if you're using SSL/TLS. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From dovecot.pkoch at dfgh.net Sun Apr 7 14:19:04 2013 From: dovecot.pkoch at dfgh.net (dovecot.pkoch at dfgh.net) Date: Sun, 7 Apr 2013 13:19:04 +0200 Subject: [Dovecot] ssl_require_crl does not work as expected Message-ID: Hi I'm trying to use dovecot with client certificates. We produce our certificates with our on CA and we do NOT use certificate revocation lists. So I put "ssl_require_crl = no" into 10-ssl.conf. I did not find a solution neither in the wiki nor somewhere else, so I finally started to read the source. My impression is that openssl will always try to use CRLs. If "ssl_require_crl = no" dovecot will use CRLs but tries to ignore openssl error codes X509_V_ERR_UNABLE_TO_GET_CRL and X509_V_ERR_CRL_HAS_EXPIRED. This is done in ssl_verify_client_cert() in ssl-proxy-openssl.c line 871, namely i_info("proxy=%d, require_crl=%d, error=%d", proxy->client_proxy, proxy->set->ssl_require_crl, ctx->error ); if (proxy->client_proxy && !proxy->set->ssl_require_crl && (ctx->error == X509_V_ERR_UNABLE_TO_GET_CRL || ctx->error == X509_V_ERR_CRL_HAS_EXPIRED)) { /* no CRL given with the CA list. don't worry about it. */ preverify_ok = 1; } With my setup proxy->client_proxy is 0. I added the i_info() to check this and with this modification my syslog shows: Apr 7 13:01:16 d600 dovecot: master: Dovecot v2.1.15 starting up (core dumps disabled) Apr 7 13:01:21 d600 dovecot: auth: Debug: Loading modules from directory: /usr/dovecot/lib/dovecot/auth Apr 7 13:01:21 d600 dovecot: auth: Debug: auth client connected (pid=26175) Apr 7 13:01:22 d600 dovecot: imap-login: proxy=0, require_crl=0, error=3 Apr 7 13:01:22 d600 dovecot: imap-login: Invalid certificate: unable to get certificate CRL: /CN=...user cert.../C=DE Apr 7 13:01:22 d600 dovecot: imap-login: proxy=0, require_crl=0, error=3 Apr 7 13:01:22 d600 dovecot: imap-login: Invalid certificate: unable to get certificate CRL: /CN=...intermedieate cert.../C=DE Apr 7 13:01:22 d600 dovecot: imap-login: proxy=0, require_crl=0, error=3 Apr 7 13:01:22 d600 dovecot: imap-login: Invalid certificate: unable to get certificate CRL: /CN=Root-CA.../C=DE I dont know what the proxy-stuff is about so instead of ignoring CRL-related errors I tried to disable CRL-checking. I therefore commented out two lines in ssl_proxy_ctx_verify_client() in ssl-proxy-openssl.c line 1004, namely: // X509_STORE_set_flags(store, X509_V_FLAG_CRL_CHECK | // X509_V_FLAG_CRL_CHECK_ALL); This tells OpenSSL not to check CRLs. Of course in production code this should be done only if "ssl_require_crl = no". Similar code is contained in iostream-openssl-context.c, namely in routine ssl_iostream_ctx_verify_remote_cert() Is this a bug? Peter From dovecot.pkoch at dfgh.net Sun Apr 7 14:30:41 2013 From: dovecot.pkoch at dfgh.net (dovecot.pkoch at dfgh.net) Date: Sun, 7 Apr 2013 13:30:41 +0200 Subject: [Dovecot] checkpassword protocol Message-ID: Hi, I'm writing a checkpassword script in order to support our OTP token as a fallback for client certificate authentication. Here are two questions: 1) It seems to me that the username and the password will be delivered to my script both on file descriptor 3 and via the environment variables AUTH_USER and AUTH_PASSWORD. May I ignore file descriptor 3 and use the environment variables or may it happen that these variables will have differnet content from what is sent via fd 3? 2) There seems to be some undocumented interaction between dovecot and my script via file descriptor 4. Seems that whatever I write to fd 4 will show up in syslog (unless it contains newlines). Can I use this "feature" to send error messages from my script to dovecot? What data does dovecot expect on fd 4? Peter From anmeyer at anup.de Sun Apr 7 17:07:30 2013 From: anmeyer at anup.de (Andreas Meyer) Date: Sun, 7 Apr 2013 16:07:30 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: <1365110177.11047.92.camel@innu> References: <1365110177.11047.92.camel@innu> Message-ID: <20130407160730.6079a3e1@itxnew.bitcorner.intern> Hello! Timo Sirainen wrote: > http://dovecot.org/releases/2.1/dovecot-2.1.16.tar.gz > http://dovecot.org/releases/2.1/dovecot-2.1.16.tar.gz.sig > > + Added quota-status policy service for Postfix Got a problem with the quota-status. I added it using the howto from Ralf Hildebrand at http://sys4.de/de/blog/2013/04/05/dovecot-quota-mit-postfix-abfragen/ # netstat -pantu |grep 12340 tcp 0 0 127.0.0.1:12340 0.0.0.0:* LISTEN 19666/dovecot plugin { quota = maildir:User quota quota_grace = 10%% quota_rule = *:storage=500MB quota_rule2 = Trash:storage=+10%% quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full / Mailbox ist voll autocreate = Trash autocreate2 = Drafts autocreate3 = Sent autosubscribe = Trash autosubscribe2 = Drafts autosubscribe3 = Sent } service quota-status { executable = quota-status -p postfix inet_listener { port = 12340 } client_limit = 1 } and in der main.cf of postfix warn_if_reject check_policy_service inet:127.0.0.1:12340 I get this in the logfile of postfix: Apr 7 15:52:51 delta postfix/smtpd[19988]: warning: access table inet:127.0.0.1:12340 entry has empty value What's wrong? Postfis does not seem to get the quota-status from dovecot. Andreas From bobgus at rcn.com Sun Apr 7 17:12:38 2013 From: bobgus at rcn.com (Bob Gustafson) Date: Sun, 07 Apr 2013 09:12:38 -0500 Subject: [Dovecot] repeating dsync - questions In-Reply-To: <3D7EEAD5-D23D-4174-8A0D-261B3FE6B081@chidig.com> References: <1365176449.21402.96.camel@hoho6.chidig.com> <515F1C74.6070602@pacific.net> <8AD72A37-9764-4E71-B6C6-D54B0DD0E624@chidig.com> <515F9A52.5090806@pacific.net> <1365228541.21402.113.camel@hoho6.chidig.com> <51603D13.10806@pacific.net> <3D7EEAD5-D23D-4174-8A0D-261B3FE6B081@chidig.com> Message-ID: <1365343958.21402.157.camel@hoho6.chidig.com> I am still on my quest for a quick way to move mail from a live Maildir system to a 'soon to be live' sdbox system. I copy Maildir to new system using: rsync -ar --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir Then I convert from Maildir to sdbox with: dsync mirror maildir:~/Maildir Then I copy more messages from live system using rsync Then I do the 'dsync mirror maildir:~/Maildir' again There were only a few messages that were copied over in the 2nd rsync pass and it went quickly, but the 2nd dsync pass is taking a long time. Also, I see strange directories in the sdbox directory (see below) Is this normal? Why is it taking a long time? (debug is set..?) See dovecot -n below Thanks for your time Bob G [bobgus at hoho0 ~]$ du -h sdbox 4.5G sdbox/mailboxes/Sent_09e4633955496151c51a0000ba55d82c/dbox-Mails 4.5G sdbox/mailboxes/Sent_09e4633955496151c51a0000ba55d82c 8.0K sdbox/mailboxes/Apple Mail To Do_0ee4633955496151c51a0000ba55d82c/dbox-Mails 12K sdbox/mailboxes/Apple Mail To Do_0ee4633955496151c51a0000ba55d82c 358M sdbox/mailboxes/Drafts/dbox-Mails 358M sdbox/mailboxes/Drafts 4.5G sdbox/mailboxes/INBOX_f9e3633955496151c51a0000ba55d82c/dbox-Mails 4.5G sdbox/mailboxes/INBOX_f9e3633955496151c51a0000ba55d82c 88K sdbox/mailboxes/Important/dbox-Mails 92K sdbox/mailboxes/Important ... ... ===== [bobgus at hoho0 ~]$ dovecot -n # 2.1.15: /etc/dovecot/dovecot.conf # OS: Linux 3.8.5-201.fc18.x86_64 x86_64 Fedora release 18 (Spherical Cow) auth_debug = yes auth_mechanisms = plain login cram-md5 auth_verbose = yes disable_plaintext_auth = no first_valid_gid = 1000 first_valid_uid = 1000 mail_debug = yes mail_location = sdbox:~/sdbox managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap service auth { unix_listener auth-userdb { mode = 0777 } user = root } service imap-login { vsz_limit = 128 M } service imap { vsz_limit = 768 M } service managesieve-login { vsz_limit = 128 M } service managesieve { vsz_limit = 768 M } ssl = required ssl_cert = References: <1365185241.11047.130.camel@innu> <515F247F.3060603@mie.utoronto.ca> <7DFC13C8-26B0-45BA-86F2-ADCBD0D978E4@odo.in-berlin.de> Message-ID: <51618460.6090500@perkel.com> Testing under OpenVZ and it's all good here. +1 From rs at sys4.de Sun Apr 7 17:52:42 2013 From: rs at sys4.de (Robert Schetterer) Date: Sun, 07 Apr 2013 16:52:42 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: <20130407160730.6079a3e1@itxnew.bitcorner.intern> References: <1365110177.11047.92.camel@innu> <20130407160730.6079a3e1@itxnew.bitcorner.intern> Message-ID: <5161883A.5070802@sys4.de> Am 07.04.2013 16:07, schrieb Andreas Meyer: > Hello! > > Timo Sirainen wrote: > >> http://dovecot.org/releases/2.1/dovecot-2.1.16.tar.gz >> http://dovecot.org/releases/2.1/dovecot-2.1.16.tar.gz.sig >> >> + Added quota-status policy service for Postfix > > Got a problem with the quota-status. I added it using the howto > from Ralf Hildebrand at > http://sys4.de/de/blog/2013/04/05/dovecot-quota-mit-postfix-abfragen/ > > # netstat -pantu |grep 12340 > tcp 0 0 127.0.0.1:12340 0.0.0.0:* LISTEN 19666/dovecot > > plugin { > quota = maildir:User quota > quota_grace = 10%% > quota_rule = *:storage=500MB > quota_rule2 = Trash:storage=+10%% > > quota_status_success = DUNNO > quota_status_nouser = DUNNO > quota_status_overquota = 552 5.2.2 Mailbox is full / Mailbox ist voll > > autocreate = Trash > autocreate2 = Drafts > autocreate3 = Sent > > autosubscribe = Trash > autosubscribe2 = Drafts > autosubscribe3 = Sent > } > > service quota-status { > executable = quota-status -p postfix > inet_listener { > port = 12340 > } > client_limit = 1 > } > > and in der main.cf of postfix > warn_if_reject check_policy_service inet:127.0.0.1:12340 > > I get this in the logfile of postfix: > Apr 7 15:52:51 delta postfix/smtpd[19988]: warning: access table inet:127.0.0.1:12340 entry has empty value > > What's wrong? Postfis does not seem to get the quota-status from dovecot. > > Andreas > not sure what this means and in hurry ,but i.e try alternate setup service quota-status { executable = quota-status -p postfix unix_listener /var/spool/postfix/private/quota-status { group = postfix mode = 0660 user = postfix } client_limit = 1 } smtpd_recipient_restrictions = reject_non_fqdn_recipient, reject_unknown_recipient_domain, permit_mynetworks, ... reject_unauth_destination, check_policy_service unix:private/quota-status Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From anmeyer at anup.de Sun Apr 7 18:28:20 2013 From: anmeyer at anup.de (Andreas Meyer) Date: Sun, 7 Apr 2013 17:28:20 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: <5161883A.5070802@sys4.de> References: <1365110177.11047.92.camel@innu> <20130407160730.6079a3e1@itxnew.bitcorner.intern> <5161883A.5070802@sys4.de> Message-ID: <20130407172820.71715448@itxnew.bitcorner.intern> Robert Schetterer wrote: > Am 07.04.2013 16:07, schrieb Andreas Meyer: > > Hello! > > > > Timo Sirainen wrote: > > > >> http://dovecot.org/releases/2.1/dovecot-2.1.16.tar.gz > >> http://dovecot.org/releases/2.1/dovecot-2.1.16.tar.gz.sig > >> > >> + Added quota-status policy service for Postfix > > > > Got a problem with the quota-status. I added it using the howto > > from Ralf Hildebrand at > > http://sys4.de/de/blog/2013/04/05/dovecot-quota-mit-postfix-abfragen/ > > > > # netstat -pantu |grep 12340 > > tcp 0 0 127.0.0.1:12340 0.0.0.0:* LISTEN 19666/dovecot > > > > plugin { > > quota = maildir:User quota > > quota_grace = 10%% > > quota_rule = *:storage=500MB > > quota_rule2 = Trash:storage=+10%% > > > > quota_status_success = DUNNO > > quota_status_nouser = DUNNO > > quota_status_overquota = 552 5.2.2 Mailbox is full / Mailbox ist voll > > > > autocreate = Trash > > autocreate2 = Drafts > > autocreate3 = Sent > > > > autosubscribe = Trash > > autosubscribe2 = Drafts > > autosubscribe3 = Sent > > } > > > > service quota-status { > > executable = quota-status -p postfix > > inet_listener { > > port = 12340 > > } > > client_limit = 1 > > } > > > > and in der main.cf of postfix > > warn_if_reject check_policy_service inet:127.0.0.1:12340 > > > > I get this in the logfile of postfix: > > Apr 7 15:52:51 delta postfix/smtpd[19988]: warning: access table inet:127.0.0.1:12340 entry has empty value > > > > What's wrong? Postfis does not seem to get the quota-status from dovecot. > > > > Andreas > > > > not sure what this means and in hurry ,but > i.e try alternate setup > > service quota-status { > executable = quota-status -p postfix > unix_listener /var/spool/postfix/private/quota-status { > group = postfix > mode = 0660 > user = postfix > } > client_limit = 1 > } > > smtpd_recipient_restrictions = reject_non_fqdn_recipient, > reject_unknown_recipient_domain, > permit_mynetworks, > ... > reject_unauth_destination, > check_policy_service unix:private/quota-status Tried that already with the same behaviour. Postfix does not get the quota-status. Andreas From rs at sys4.de Sun Apr 7 18:57:09 2013 From: rs at sys4.de (Robert Schetterer) Date: Sun, 07 Apr 2013 17:57:09 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: <20130407172820.71715448@itxnew.bitcorner.intern> References: <1365110177.11047.92.camel@innu> <20130407160730.6079a3e1@itxnew.bitcorner.intern> <5161883A.5070802@sys4.de> <20130407172820.71715448@itxnew.bitcorner.intern> Message-ID: <51619755.8030706@sys4.de> Am 07.04.2013 17:28, schrieb Andreas Meyer: > Robert Schetterer wrote: > >> Am 07.04.2013 16:07, schrieb Andreas Meyer: >>> Hello! >>> >>> Timo Sirainen wrote: >>> >>>> http://dovecot.org/releases/2.1/dovecot-2.1.16.tar.gz >>>> http://dovecot.org/releases/2.1/dovecot-2.1.16.tar.gz.sig >>>> >>>> + Added quota-status policy service for Postfix >>> >>> Got a problem with the quota-status. I added it using the howto >>> from Ralf Hildebrand at >>> http://sys4.de/de/blog/2013/04/05/dovecot-quota-mit-postfix-abfragen/ >>> >>> # netstat -pantu |grep 12340 >>> tcp 0 0 127.0.0.1:12340 0.0.0.0:* LISTEN 19666/dovecot >>> >>> plugin { >>> quota = maildir:User quota >>> quota_grace = 10%% >>> quota_rule = *:storage=500MB >>> quota_rule2 = Trash:storage=+10%% >>> >>> quota_status_success = DUNNO >>> quota_status_nouser = DUNNO >>> quota_status_overquota = 552 5.2.2 Mailbox is full / Mailbox ist voll >>> >>> autocreate = Trash >>> autocreate2 = Drafts >>> autocreate3 = Sent >>> >>> autosubscribe = Trash >>> autosubscribe2 = Drafts >>> autosubscribe3 = Sent >>> } >>> >>> service quota-status { >>> executable = quota-status -p postfix >>> inet_listener { >>> port = 12340 >>> } >>> client_limit = 1 >>> } >>> >>> and in der main.cf of postfix >>> warn_if_reject check_policy_service inet:127.0.0.1:12340 >>> >>> I get this in the logfile of postfix: >>> Apr 7 15:52:51 delta postfix/smtpd[19988]: warning: access table inet:127.0.0.1:12340 entry has empty value >>> >>> What's wrong? Postfis does not seem to get the quota-status from dovecot. >>> >>> Andreas >>> >> >> not sure what this means and in hurry ,but >> i.e try alternate setup >> >> service quota-status { >> executable = quota-status -p postfix >> unix_listener /var/spool/postfix/private/quota-status { >> group = postfix >> mode = 0660 >> user = postfix >> } >> client_limit = 1 >> } >> >> smtpd_recipient_restrictions = reject_non_fqdn_recipient, >> reject_unknown_recipient_domain, >> permit_mynetworks, >> ... >> reject_unauth_destination, >> check_policy_service unix:private/quota-status > > Tried that already with the same behaviour. Postfix does not get > the quota-status. > > Andreas > Hi Andreas, i should clean up my eyes the dovecot policy daemon code really is in 2.1.16 but there is no quota_grace Parameter, without this service make small sense i.e if you allready have lmtp quota enabled, cause mostly this will bounce mail before the mailbox gets overquota in real if you want to test dove quota feature it only make sense if using dove 2.2 ( as written in the blog by Ralf) speculation , i dont think that Timo will backport quota_grace to 2.1 Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From anmeyer at anup.de Sun Apr 7 20:02:15 2013 From: anmeyer at anup.de (Andreas Meyer) Date: Sun, 7 Apr 2013 19:02:15 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: <51619755.8030706@sys4.de> References: <1365110177.11047.92.camel@innu> <20130407160730.6079a3e1@itxnew.bitcorner.intern> <5161883A.5070802@sys4.de> <20130407172820.71715448@itxnew.bitcorner.intern> <51619755.8030706@sys4.de> Message-ID: <20130407190215.7f9ed602@itxnew.bitcorner.intern> Robert Schetterer wrote: > >> not sure what this means and in hurry ,but > >> i.e try alternate setup > >> > >> service quota-status { > >> executable = quota-status -p postfix > >> unix_listener /var/spool/postfix/private/quota-status { > >> group = postfix > >> mode = 0660 > >> user = postfix > >> } > >> client_limit = 1 > >> } > >> > >> smtpd_recipient_restrictions = reject_non_fqdn_recipient, > >> reject_unknown_recipient_domain, > >> permit_mynetworks, > >> ... > >> reject_unauth_destination, > >> check_policy_service unix:private/quota-status > > > > Tried that already with the same behaviour. Postfix does not get > > the quota-status. > Hi Andreas, i should clean up my eyes > the dovecot policy daemon code really is in > 2.1.16 but there is no quota_grace Parameter, without > this service make small sense i.e if you allready have lmtp quota > enabled, cause mostly this will bounce mail before the mailbox gets > overquota in real Didn't know the thing with the quota_grace. Yes, I use dovecot-lda as transport from postfix. So postfix hands over the mail to the virtual_transport = dovecot and the check with the inet_listener isn't done then? B) I guess dovecot-lda should report the quota-status and do the check. > if you want to test dove quota feature it only make sense > if using dove 2.2 ( as written in the blog by Ralf) I testet this in a productive environment. If I get the time I'll setup a testmachine for 2.2 > speculation , i dont think that Timo will backport quota_grace to 2.1 > > Best Regards > MfG Robert Schetterer Greetings Andreas From mark at msapiro.net Sun Apr 7 20:19:44 2013 From: mark at msapiro.net (Mark Sapiro) Date: Sun, 07 Apr 2013 10:19:44 -0700 Subject: [Dovecot] v2.2.rc5 released In-Reply-To: <51618460.6090500@perkel.com> References: <1365185241.11047.130.camel@innu> <515F247F.3060603@mie.utoronto.ca> <7DFC13C8-26B0-45BA-86F2-ADCBD0D978E4@odo.in-berlin.de> <51618460.6090500@perkel.com> Message-ID: <5161AAB0.4030005@msapiro.net> On 4/7/2013 7:36 AM, Marc Perkel wrote: > Testing under OpenVZ and it's all good here. > > +1 And It's been running here over 40 hours on CentOS 5 with no problems. +1 -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan From delrio at mie.utoronto.ca Sun Apr 7 20:25:44 2013 From: delrio at mie.utoronto.ca (Oscar del Rio) Date: Sun, 07 Apr 2013 13:25:44 -0400 Subject: [Dovecot] mdbox and folders containing both messages and sub-folders In-Reply-To: <51608ADF.50801@liberation.richw.org> References: <51608ADF.50801@liberation.richw.org> Message-ID: <5161AC18.7010901@mie.utoronto.ca> On 06/04/2013 4:51 PM, Rich Wales wrote: > Am I doing something wrong? Or is the "folders containing both messages > and sub-folders" feature simply broken for the "mdbox" format -- meaning > presumably that I'll be forced either to use the Maildir format, or else > abandon Dovecot entirely and install Cyrus on my new mail server instead? mdbox folders with messages and subfolders work very well. I migrated from another imap server using imapsync without problems. From tss at iki.fi Sun Apr 7 20:42:39 2013 From: tss at iki.fi (Timo Sirainen) Date: Sun, 7 Apr 2013 20:42:39 +0300 Subject: [Dovecot] v2.1.16 released In-Reply-To: <20130407160730.6079a3e1@itxnew.bitcorner.intern> References: <1365110177.11047.92.camel@innu> <20130407160730.6079a3e1@itxnew.bitcorner.intern> Message-ID: <011E56B6-E579-4A26-B5E4-31D0B32BEE09@iki.fi> On 7.4.2013, at 17.07, Andreas Meyer wrote: > Got a problem with the quota-status. I added it using the howto > from Ralf Hildebrand at > http://sys4.de/de/blog/2013/04/05/dovecot-quota-mit-postfix-abfragen/ .. > I get this in the logfile of postfix: > Apr 7 15:52:51 delta postfix/smtpd[19988]: warning: access table inet:127.0.0.1:12340 entry has empty value I wonder if that really means that it's getting an empty value or if it's something else. I don't know why it would be getting an empty value. Do you see an anything in Dovecot's error log? I know there's a bug in 2.1.16 where it crashes if you try to ask quota status for a nonexistent user.. http://hg.dovecot.org/dovecot-2.1/rev/c6b4a639cae1 fixes that. From tss at iki.fi Sun Apr 7 20:45:30 2013 From: tss at iki.fi (Timo Sirainen) Date: Sun, 7 Apr 2013 20:45:30 +0300 Subject: [Dovecot] mdbox and folders containing both messages and sub-folders In-Reply-To: <51608ADF.50801@liberation.richw.org> References: <51608ADF.50801@liberation.richw.org> Message-ID: <05ACD4AD-E732-43B0-99AE-B05BC6E96004@iki.fi> On 6.4.2013, at 23.51, Rich Wales wrote: > and am using the Larch program to do an IMAP-to-IMAP copy of one of my > family member's mail from the old Cyrus server to the new Dovecot server. > When I examine the "mailboxes" directory tree, I see some directories > that (correctly) contain both the renamed ".indexes" directory and also > directories for IMAP subfolders. However, the Larch output is showing > many errors of the form "mailbox cannot contain messages", and some of > the messages could not be migrated because of this problem. What is the error message exactly? I'm wondering if the error is coming from Dovecot or if Larch is somehow confused internally and giving bogus errors. > Am I doing something wrong? Or is the "folders containing both messages > and sub-folders" feature simply broken for the "mdbox" format -- meaning > presumably that I'll be forced either to use the Maildir format, or else > abandon Dovecot entirely and install Cyrus on my new mail server instead? It works fine in mdbox, you can't disable it even if you tried. From anmeyer at anup.de Sun Apr 7 20:45:41 2013 From: anmeyer at anup.de (Andreas Meyer) Date: Sun, 7 Apr 2013 19:45:41 +0200 Subject: [Dovecot] [Dovecot-de] Dovecot Quota via policy service abfragen In-Reply-To: <20130407172840.GA29177@charite.de> References: <20130405212057.GB30252@sys4.de> <20130407142236.25a20362@itxnew.bitcorner.intern> <20130407172840.GA29177@charite.de> Message-ID: <20130407194541.1cb8f96d@itxnew.bitcorner.intern> Hallo Waffenmeister! Ralf Hildebrandt wrote: > > Apr 7 14:07:52 delta postfix/qmgr[19078]: 1D8921B31260: from=, size=1492149, nrcpt=1 (queue active) > > Apr 7 14:07:53 delta postfix/pipe[19091]: 1D8921B31260: to=, relay=dovecot, delay=2542, delays=2542/0.01/0/0.29, dsn=4.3.0, status=deferred (temporary failure) > > Ich sehe hier nur einen Fehler vom transport "dovecot". > > > plugin { > > quota = maildir:User quota > > quota_grace = 10%% > > quota_rule = *:storage=500MB > > quota_rule2 = Trash:storage=+10%% > > > > quota_status_success = DUNNO > > quota_status_nouser = DUNNO > > quota_status_overquota = 552 5.2.2 Mailbox is full / Mailbox ist voll > > Lass mal das quota_status_overquota feld weg. Habe ich jetzt neben quota_grace = 10%% auch rausgenommen. Apr 7 19:38:35 delta postfix/smtpd[23037]: connect from p54B32BC9.dip.t-dialin.net[84.179.43.201] Apr 7 19:38:36 delta postfix/smtpd[23037]: setting up TLS connection from p54B32BC9.dip.t-dialin.net[84.179.43.201] Apr 7 19:38:36 delta postfix/smtpd[23037]: TLS connection established from p54B32BC9.dip.t-dialin.net[84.179.43.201]: TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits) Apr 7 19:38:37 delta postfix/smtpd[23037]: NOQUEUE: client=p54B32BC9.dip.t-dialin.net[84.179.43.201], sasl_method=CRAM-MD5, sasl_username=anmeyer at anup.de Apr 7 19:39:01 delta postfix/smtpd[23139]: connect from localhost[127.0.0.1] Apr 7 19:39:01 delta postfix/smtpd[23139]: 9C1BA1B30FB0: client=localhost[127.0.0.1] Apr 7 19:39:01 delta postfix/cleanup[23142]: 9C1BA1B30FB0: message-id=<20130407193818.62d8c328 at itxnew.bitcorner.intern> Apr 7 19:39:01 delta postfix/qmgr[22234]: 9C1BA1B30FB0: from=, size=1492149, nrcpt=1 (queue active) Apr 7 19:39:01 delta postfix/smtpd[23139]: disconnect from localhost[127.0.0.1] Apr 7 19:39:02 delta postfix/smtpd[23037]: disconnect from p54B32BC9.dip.t-dialin.net[84.179.43.201] Apr 7 19:39:02 delta postfix/pipe[23143]: 9C1BA1B30FB0: to=, relay=dovecot, delay=0.56, delays=0.33/0/0/0.23, dsn=4.3.0, status=deferred (temporary failure) > > Also ich vermisse das reject-warning von postfix und es hat auch nicht den > > Anschein, dass postfix den Status der Quota bei dovecot ?ber port 12340 > > abfr?gt. > > Naja, vielleicht steht es an der falschen Stelle in den Restrictions! > Das muss passieren BEVOR irgendwas ein OK zur?ckgibt. Ich habe warn_if_reject check_policy_service inet:127.0.0.1:12340 ziemlich am Anfang der recipient_restrictions gesetzt nachdem ich den check am Ende hatte noch nach postgrey. smtpd_recipient_restrictions = check_sender_access hash:/etc/postfix/access_sender, permit_mynetworks, permit_sasl_authenticated, reject_invalid_helo_hostname, reject_unlisted_recipient, warn_if_reject check_policy_service inet:127.0.0.1:12340 reject_unknown_sender_domain, check_sender_access pcre:/etc/postfix/umlaute.pcre, check_recipient_access pcre:/etc/postfix/umlaute.pcre, reject_unauth_destination, reject_rbl_client bl.spamcop.net, reject_rbl_client zen.spamhaus.org, check_client_access cidr:/etc/postfix/client.cidr, check_policy_service inet:127.0.0.1:10023 Andreas From tss at iki.fi Sun Apr 7 20:50:44 2013 From: tss at iki.fi (Timo Sirainen) Date: Sun, 7 Apr 2013 20:50:44 +0300 Subject: [Dovecot] repeating dsync - questions In-Reply-To: <1365343958.21402.157.camel@hoho6.chidig.com> References: <1365176449.21402.96.camel@hoho6.chidig.com> <515F1C74.6070602@pacific.net> <8AD72A37-9764-4E71-B6C6-D54B0DD0E624@chidig.com> <515F9A52.5090806@pacific.net> <1365228541.21402.113.camel@hoho6.chidig.com> <51603D13.10806@pacific.net> <3D7EEAD5-D23D-4174-8A0D-261B3FE6B081@chidig.com> <1365343958.21402.157.camel@hoho6.chidig.com> Message-ID: <2160081B-1673-4466-9F00-12F58E384AB2@iki.fi> On 7.4.2013, at 17.12, Bob Gustafson wrote: > I am still on my quest for a quick way to move mail from a live Maildir > system to a 'soon to be live' sdbox system. > > I copy Maildir to new system using: > rsync -ar --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir > > Then I convert from Maildir to sdbox with: > dsync mirror maildir:~/Maildir > > Then I copy more messages from live system using rsync ^^ that is the mistake > Then I do the 'dsync mirror maildir:~/Maildir' again > > There were only a few messages that were copied over in the 2nd rsync > pass and it went quickly, but the 2nd dsync pass is taking a long time. The second rsync is overwriting all the metadata changes (mailbox GUIDs most importantly) that the first dsync run did. > Also, I see strange directories in the sdbox directory (see below) Also caused by the same thing. v2.2 dsync should be able to handle this much better, but in general you shouldn't be mixing rsync and dsync in that way. You could for example install Dovecot v2.1 dsync to the source server (could even be under /tmp by compiling from sources) and then do the conversion directly from source server maildir to destination server sdbox. From tss at iki.fi Sun Apr 7 20:55:26 2013 From: tss at iki.fi (Timo Sirainen) Date: Sun, 7 Apr 2013 20:55:26 +0300 Subject: [Dovecot] IDLE and inactivity In-Reply-To: <20130407110539.59610cf5@itxnew.bitcorner.intern> References: <20130407110539.59610cf5@itxnew.bitcorner.intern> Message-ID: On 7.4.2013, at 12.05, Andreas Meyer wrote: > Apr 07 10:59:40 imap(anmeyer at anup.de): Info: Disconnected: Disconnected in IDLE in=725 out=2546 > Apr 07 10:59:59 imap(anmeyer at anup.de): Info: Disconnected for inactivity in=952 out=25789 > > Please someone explain to me the IDLE state IMAP clients often start IDLE command while they aren't doing anything. Server is then free to send any mailbox changes to the client. The above simply means that client had started IDLE command and the TCP connection got disconnected (maybe intentionally by the client). > and the inactivity state The client didn't issue IDLE command and didn't send anything at all for 30 minutes. Dovecot disconnected the client since it wasn't doing anything. > an what the numbers at in= and out= means! Number of bytes in the TCP connection, input/output. From anmeyer at anup.de Sun Apr 7 20:58:56 2013 From: anmeyer at anup.de (Andreas Meyer) Date: Sun, 7 Apr 2013 19:58:56 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: <011E56B6-E579-4A26-B5E4-31D0B32BEE09@iki.fi> References: <1365110177.11047.92.camel@innu> <20130407160730.6079a3e1@itxnew.bitcorner.intern> <011E56B6-E579-4A26-B5E4-31D0B32BEE09@iki.fi> Message-ID: <20130407195856.373dad2a@itxnew.bitcorner.intern> Hello! Timo Sirainen wrote: > On 7.4.2013, at 17.07, Andreas Meyer wrote: > > > Got a problem with the quota-status. I added it using the howto > > from Ralf Hildebrand at > > http://sys4.de/de/blog/2013/04/05/dovecot-quota-mit-postfix-abfragen/ > .. > > I get this in the logfile of postfix: > > Apr 7 15:52:51 delta postfix/smtpd[19988]: warning: access table inet:127.0.0.1:12340 entry has empty value > > I wonder if that really means that it's getting an empty value or if it's something else. I don't know why it would be getting an empty value. Do you see an anything in Dovecot's error log? Apr 7 19:55:53 delta postfix/smtpd[23362]: connect from dovecot.org[193.210.130.67] Apr 7 19:55:53 delta postfix/smtpd[23362]: warning: access table inet:127.0.0.1:12340 entry has empty value Apr 7 19:55:53 delta postfix/smtpd[23362]: NOQUEUE: client=dovecot.org[193.210.130.67] Apr 7 19:55:54 delta postfix/smtpd[23234]: 727161B31260: client=localhost[127.0.0.1] Apr 7 19:55:54 delta postfix/cleanup[23369]: 727161B31260: message-id= Apr 7 19:55:54 delta postfix/smtpd[23234]: disconnect from localhost[127.0.0.1] Apr 7 19:55:54 delta postfix/qmgr[22234]: 727161B31260: from=, size=2764, nrcpt=1 (queue active) Apr 7 19:55:54 delta postfix/smtpd[23362]: disconnect from dovecot.org[193.210.130.67] Apr 7 19:55:54 delta postfix/pipe[23370]: 727161B31260: to=, relay=dovecot, delay=0.24, delays=0.07/0/0/0.17, dsn=2.0.0, status=sent (delivered via dovecot service) Apr 7 19:55:54 delta postfix/qmgr[22234]: 727161B31260: removed > > I know there's a bug in 2.1.16 where it crashes if you try to ask quota status for a nonexistent user.. http://hg.dovecot.org/dovecot-2.1/rev/c6b4a639cae1 fixes that. The user exists. This is what I find in the dovecot-lda-errors.log Apr 07 19:48:13 lda(miles at anup.de): Error: sieve: msgid=<20130407193818.62d8c328 at itxnew.bitcorner.intern>: failed to store into mailbox 'INBOX': Quota exceeded (mailbox for user is full) Apr 07 19:48:13 lda(miles at anup.de): Error: sieve: script /var/spool/vhosts/anup.de/miles/.dovecot.sieve failed with unsuccessful implicit keep (user logfile /var/spool/vhosts/anup.de/miles/.dov ecot.sieve.log may reveal additional details) Nothing special in the dovecot.log Apr 07 19:47:15 imap-login: Info: Login: user=, method=CRAM-MD5, rip=84.179.43.201, lip=213.239.207.165, mpid=23264, session= Andreas From richw at richw.org Sun Apr 7 21:08:00 2013 From: richw at richw.org (Rich Wales) Date: Sun, 07 Apr 2013 11:08:00 -0700 Subject: [Dovecot] mdbox and folders containing both messages and sub-folders In-Reply-To: <05ACD4AD-E732-43B0-99AE-B05BC6E96004@iki.fi> References: <51608ADF.50801@liberation.richw.org> <05ACD4AD-E732-43B0-99AE-B05BC6E96004@iki.fi> Message-ID: <5161B600.8000405@liberation.richw.org> Repying to Timo Sirainen: > What is the error message exactly? I'm wondering if the error is coming from > Dovecot or if Larch is somehow confused internally and giving bogus errors. Certainly a reasonable question. I tried to enable full debugging output in both Dovecot and Larch, but I couldn't get anything helpful. Is there a way to make Dovecot report all IMAP commands and responses, so I can see exactly what the client is asking for, and exactly why Dovecot is refusing to do it? Alternatively, does anyone here know Ruby (the language Larch is written in) well enough to say how to make its low-level IMAP module give a full logging of all commands and responses? For what it may or may not be worth, I'm trying my same mail migration test using Maildir instead of mdbox, and it appears to be working fine. Rich Wales richw at richw.org From rs at sys4.de Sun Apr 7 21:17:21 2013 From: rs at sys4.de (Robert Schetterer) Date: Sun, 07 Apr 2013 20:17:21 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: <20130407195856.373dad2a@itxnew.bitcorner.intern> References: <1365110177.11047.92.camel@innu> <20130407160730.6079a3e1@itxnew.bitcorner.intern> <011E56B6-E579-4A26-B5E4-31D0B32BEE09@iki.fi> <20130407195856.373dad2a@itxnew.bitcorner.intern> Message-ID: <5161B831.3040201@sys4.de> Am 07.04.2013 19:58, schrieb Andreas Meyer: > Hello! > > Timo Sirainen wrote: > >> On 7.4.2013, at 17.07, Andreas Meyer wrote: >> >>> Got a problem with the quota-status. I added it using the howto >>> from Ralf Hildebrand at >>> http://sys4.de/de/blog/2013/04/05/dovecot-quota-mit-postfix-abfragen/ >> .. >>> I get this in the logfile of postfix: >>> Apr 7 15:52:51 delta postfix/smtpd[19988]: warning: access table inet:127.0.0.1:12340 entry has empty value >> >> I wonder if that really means that it's getting an empty value or if it's something else. I don't know why it would be getting an empty value. Do you see an anything in Dovecot's error log? > > Apr 7 19:55:53 delta postfix/smtpd[23362]: connect from dovecot.org[193.210.130.67] > Apr 7 19:55:53 delta postfix/smtpd[23362]: warning: access table inet:127.0.0.1:12340 entry has empty value > Apr 7 19:55:53 delta postfix/smtpd[23362]: NOQUEUE: client=dovecot.org[193.210.130.67] > Apr 7 19:55:54 delta postfix/smtpd[23234]: 727161B31260: client=localhost[127.0.0.1] > Apr 7 19:55:54 delta postfix/cleanup[23369]: 727161B31260: message-id= > Apr 7 19:55:54 delta postfix/smtpd[23234]: disconnect from localhost[127.0.0.1] > Apr 7 19:55:54 delta postfix/qmgr[22234]: 727161B31260: from=, size=2764, nrcpt=1 (queue active) > Apr 7 19:55:54 delta postfix/smtpd[23362]: disconnect from dovecot.org[193.210.130.67] > Apr 7 19:55:54 delta postfix/pipe[23370]: 727161B31260: to=, relay=dovecot, delay=0.24, delays=0.07/0/0/0.17, dsn=2.0.0, status=sent (delivered via dovecot service) > Apr 7 19:55:54 delta postfix/qmgr[22234]: 727161B31260: removed > >> >> I know there's a bug in 2.1.16 where it crashes if you try to ask quota status for a nonexistent user.. http://hg.dovecot.org/dovecot-2.1/rev/c6b4a639cae1 fixes that. > > The user exists. This is what I find in the dovecot-lda-errors.log > > Apr 07 19:48:13 lda(miles at anup.de): Error: sieve: msgid=<20130407193818.62d8c328 at itxnew.bitcorner.intern>: failed to store into mailbox 'INBOX': Quota exceeded (mailbox for user is full) > Apr 07 19:48:13 lda(miles at anup.de): Error: sieve: script /var/spool/vhosts/anup.de/miles/.dovecot.sieve failed with unsuccessful implicit keep (user logfile /var/spool/vhosts/anup.de/miles/.dov > ecot.sieve.log may reveal additional details) as i wrote, without quota_grace , which not exist in 2.1.16 lda or lmtp will bounce by overquota mailbox, so you mostly never reach a level where the quota policy server is needed however the existing policy code should work ( it did with my last small tests 2.1.15...), but for real testing you need upgrade 2.2 > > Nothing special in the dovecot.log > Apr 07 19:47:15 imap-login: Info: Login: user=, method=CRAM-MD5, rip=84.179.43.201, lip=213.239.207.165, mpid=23264, session= > > Andreas > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From rs at sys4.de Sun Apr 7 21:20:41 2013 From: rs at sys4.de (Robert Schetterer) Date: Sun, 07 Apr 2013 20:20:41 +0200 Subject: [Dovecot] mdbox and folders containing both messages and sub-folders In-Reply-To: <5161B600.8000405@liberation.richw.org> References: <51608ADF.50801@liberation.richw.org> <05ACD4AD-E732-43B0-99AE-B05BC6E96004@iki.fi> <5161B600.8000405@liberation.richw.org> Message-ID: <5161B8F9.4070809@sys4.de> Am 07.04.2013 20:08, schrieb Rich Wales: > Repying to Timo Sirainen: > >> What is the error message exactly? I'm wondering if the error is coming from >> Dovecot or if Larch is somehow confused internally and giving bogus errors. > > Certainly a reasonable question. I tried to enable full debugging output in > both Dovecot and Larch, but I couldn't get anything helpful. > > Is there a way to make Dovecot report all IMAP commands and responses, so I > can see exactly what the client is asking for, and exactly why Dovecot is > refusing to do it? verbose logging and mail logger plugin http://wiki2.dovecot.org/Logging http://wiki2.dovecot.org/Plugins/MailLog > > Alternatively, does anyone here know Ruby (the language Larch is written in) > well enough to say how to make its low-level IMAP module give a full logging > of all commands and responses? no , perhaps try imapsync, it ever worked for me > > For what it may or may not be worth, I'm trying my same mail migration test > using Maildir instead of mdbox, and it appears to be working fine. show dovecot conf and log > > Rich Wales > richw at richw.org > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From anmeyer at anup.de Sun Apr 7 21:36:58 2013 From: anmeyer at anup.de (Andreas Meyer) Date: Sun, 7 Apr 2013 20:36:58 +0200 Subject: [Dovecot] [Dovecot-de] Dovecot Quota via policy service abfragen In-Reply-To: <20130407180959.GD29177@charite.de> References: <20130405212057.GB30252@sys4.de> <20130407142236.25a20362@itxnew.bitcorner.intern> <20130407172840.GA29177@charite.de> <20130407194541.1cb8f96d@itxnew.bitcorner.intern> <20130407180959.GD29177@charite.de> Message-ID: <20130407203658.20cd364e@itxnew.bitcorner.intern> Ralf Hildebrandt wrote: > * Andreas Meyer : > > > Habe ich jetzt neben quota_grace = 10%% auch rausgenommen. > > Gut. > > > Apr 7 19:38:35 delta postfix/smtpd[23037]: connect from p54B32BC9.dip.t-dialin.net[84.179.43.201] > > Apr 7 19:38:36 delta postfix/smtpd[23037]: setting up TLS connection from p54B32BC9.dip.t-dialin.net[84.179.43.201] > > Apr 7 19:38:36 delta postfix/smtpd[23037]: TLS connection established from p54B32BC9.dip.t-dialin.net[84.179.43.201]: TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits) > > Apr 7 19:38:37 delta postfix/smtpd[23037]: NOQUEUE: client=p54B32BC9.dip.t-dialin.net[84.179.43.201], sasl_method=CRAM-MD5, sasl_username=anmeyer at anup.de > > Apr 7 19:39:01 delta postfix/smtpd[23139]: connect from localhost[127.0.0.1] > > Apr 7 19:39:01 delta postfix/smtpd[23139]: 9C1BA1B30FB0: client=localhost[127.0.0.1] > > Apr 7 19:39:01 delta postfix/cleanup[23142]: 9C1BA1B30FB0: message-id=<20130407193818.62d8c328 at itxnew.bitcorner.intern> > > Apr 7 19:39:01 delta postfix/qmgr[22234]: 9C1BA1B30FB0: from=, size=1492149, nrcpt=1 (queue active) > > Apr 7 19:39:01 delta postfix/smtpd[23139]: disconnect from localhost[127.0.0.1] > > Apr 7 19:39:02 delta postfix/smtpd[23037]: disconnect from p54B32BC9.dip.t-dialin.net[84.179.43.201] > > Apr 7 19:39:02 delta postfix/pipe[23143]: 9C1BA1B30FB0: to=, relay=dovecot, delay=0.56, delays=0.33/0/0/0.23, dsn=4.3.0, status=deferred (temporary failure) > > Na dann sind deine Restrictions falsch und die Mail wird "OK"'ed bevor > der Policy Server gefragt wird. > > > Ich habe warn_if_reject check_policy_service inet:127.0.0.1:12340 > > ziemlich am Anfang der recipient_restrictions gesetzt nachdem ich > > den check am Ende hatte noch nach postgrey. > > > > smtpd_recipient_restrictions = > > ---> hier einbauen <--- > ist ja nur zum Test > > > check_sender_access hash:/etc/postfix/access_sender, > > permit_mynetworks, > > permit_sasl_authenticated, > > reject_invalid_helo_hostname, > > reject_unlisted_recipient, > > warn_if_reject check_policy_service inet:127.0.0.1:12340 > > reject_unknown_sender_domain, > > check_sender_access pcre:/etc/postfix/umlaute.pcre, > > check_recipient_access pcre:/etc/postfix/umlaute.pcre, > > reject_unauth_destination, > > reject_rbl_client bl.spamcop.net, > > reject_rbl_client zen.spamhaus.org, > > check_client_access cidr:/etc/postfix/client.cidr, > > check_policy_service inet:127.0.0.1:10023 That did the trick! The order of the recipient_restricitons was wrong. Apr 7 20:24:55 delta postfix/smtpd[23806]: connect from p54B32BC9.dip.t-dialin.net[84.179.43.201] Apr 7 20:24:55 delta postfix/smtpd[23806]: setting up TLS connection from p54B32BC9.dip.t-dialin.net[84.179.43.201] Apr 7 20:24:56 delta postfix/smtpd[23806]: TLS connection established from p54B32BC9.dip.t-dialin.net[84.179.43.201]: TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits) Apr 7 20:24:56 delta postfix/smtpd[23806]: NOQUEUE: reject: RCPT from p54B32BC9.dip.t-dialin.net[84.179.43.201]: 552 5.2.2 : Recipient address rejected: Quota exceeded (mailbox for user is full); from= to= proto=ESMTP helo= Apr 7 20:24:56 delta postfix/smtpd[23806]: lost connection after RCPT from p54B32BC9.dip.t-dialin.net[84.179.43.201] Apr 7 20:24:56 delta postfix/smtpd[23806]: disconnect from p54B32BC9.dip.t-dialin.net[84.179.43.201] The MUA does not get rid of the mail, when it would exceed the quota. But now the next problem. I cannot send this mail and get the following with smtpd_recipient_restrictions = check_policy_service inet:127.0.0.1:12340 check_sender_access hash:/etc/postfix/access_sender, permit_mynetworks, permit_sasl_authenticated, .... Apr 7 20:31:43 delta postfix/smtpd[23820]: connect from p54B32BC9.dip.t-dialin.net[84.179.43.201] Apr 7 20:31:44 delta postfix/smtpd[23820]: setting up TLS connection from p54B32BC9.dip.t-dialin.net[84.179.43.201] Apr 7 20:31:45 delta postfix/smtpd[23820]: TLS connection established from p54B32BC9.dip.t-dialin.net[84.179.43.201]: TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits) Apr 7 20:31:46 delta postfix/smtpd[23820]: warning: problem talking to server 127.0.0.1:12340: Success Apr 7 20:31:46 delta postfix/smtpd[23820]: NOQUEUE: reject: RCPT from p54B32BC9.dip.t-dialin.net[84.179.43.201]: 451 4.3.5 Server configuration problem; from= to= proto=ESMTP helo= Apr 7 20:31:46 delta postfix/smtpd[23820]: lost connection after RCPT from p54B32BC9.dip.t-dialin.net[84.179.43.201] Apr 7 20:31:46 delta postfix/smtpd[23820]: disconnect from p54B32BC9.dip.t-dialin.net[84.179.43.201] the mail is not sent out. I deactivated the check to get sent mail sent. Andreas From tss at iki.fi Sun Apr 7 22:10:33 2013 From: tss at iki.fi (Timo Sirainen) Date: Sun, 7 Apr 2013 22:10:33 +0300 Subject: [Dovecot] v2.1.16 released In-Reply-To: <20130407195856.373dad2a@itxnew.bitcorner.intern> References: <1365110177.11047.92.camel@innu> <20130407160730.6079a3e1@itxnew.bitcorner.intern> <011E56B6-E579-4A26-B5E4-31D0B32BEE09@iki.fi> <20130407195856.373dad2a@itxnew.bitcorner.intern> Message-ID: <8E023870-856C-45A9-868A-73FB17AF17E8@iki.fi> On 7.4.2013, at 20.58, Andreas Meyer wrote: >>> Apr 7 15:52:51 delta postfix/smtpd[19988]: warning: access table inet:127.0.0.1:12340 entry has empty value >> >> I wonder if that really means that it's getting an empty value or if it's something else. I don't know why it would be getting an empty value. Do you see an anything in Dovecot's error log? > > Apr 7 19:55:53 delta postfix/smtpd[23362]: connect from dovecot.org[193.210.130.67] > Apr 7 19:55:53 delta postfix/smtpd[23362]: warning: access table inet:127.0.0.1:12340 entry has empty value Oh, notice the two spaces there between "entry has"? It's looking up an empty key (instead of email at address), so it's getting back an empty value. Although Dovecot's reply should still be DUNNO then. Anyway, looks to me like Postfix config isn't correct somehow. From tss at iki.fi Sun Apr 7 22:12:47 2013 From: tss at iki.fi (Timo Sirainen) Date: Sun, 7 Apr 2013 22:12:47 +0300 Subject: [Dovecot] mdbox and folders containing both messages and sub-folders In-Reply-To: <5161B600.8000405@liberation.richw.org> References: <51608ADF.50801@liberation.richw.org> <05ACD4AD-E732-43B0-99AE-B05BC6E96004@iki.fi> <5161B600.8000405@liberation.richw.org> Message-ID: <6550206C-866A-4FC9-ACBB-60A4EC788BE3@iki.fi> On 7.4.2013, at 21.08, Rich Wales wrote: > Repying to Timo Sirainen: > >> What is the error message exactly? I'm wondering if the error is coming from >> Dovecot or if Larch is somehow confused internally and giving bogus errors. > > Certainly a reasonable question. I tried to enable full debugging output in > both Dovecot and Larch, but I couldn't get anything helpful. But didn't you say Larch was giving some errors already? > Is there a way to make Dovecot report all IMAP commands and responses, so I > can see exactly what the client is asking for, and exactly why Dovecot is > refusing to do it? http://wiki2.dovecot.org/Debugging/Rawlog > For what it may or may not be worth, I'm trying my same mail migration test > using Maildir instead of mdbox, and it appears to be working fine. Maybe Larch has some mbox-specific code and it thinks that dbox looks similar.. From anmeyer at anup.de Sun Apr 7 22:21:34 2013 From: anmeyer at anup.de (Andreas Meyer) Date: Sun, 7 Apr 2013 21:21:34 +0200 Subject: [Dovecot] v2.1.16 released In-Reply-To: <8E023870-856C-45A9-868A-73FB17AF17E8@iki.fi> References: <1365110177.11047.92.camel@innu> <20130407160730.6079a3e1@itxnew.bitcorner.intern> <011E56B6-E579-4A26-B5E4-31D0B32BEE09@iki.fi> <20130407195856.373dad2a@itxnew.bitcorner.intern> <8E023870-856C-45A9-868A-73FB17AF17E8@iki.fi> Message-ID: <20130407212134.0e47a155@itxnew.bitcorner.intern> Timo Sirainen wrote: > On 7.4.2013, at 20.58, Andreas Meyer wrote: > > >>> Apr 7 15:52:51 delta postfix/smtpd[19988]: warning: access table inet:127.0.0.1:12340 entry has empty value > >> > >> I wonder if that really means that it's getting an empty value or if it's something else. I don't know why it would be getting an empty value. Do you see an anything in Dovecot's error log? > > > > Apr 7 19:55:53 delta postfix/smtpd[23362]: connect from dovecot.org[193.210.130.67] > > Apr 7 19:55:53 delta postfix/smtpd[23362]: warning: access table inet:127.0.0.1:12340 entry has empty value > > > Oh, notice the two spaces there between "entry has"? It's looking up an empty key (instead of email at address), so it's getting back an empty value. Although Dovecot's reply should still be DUNNO then. Anyway, looks to me like Postfix config isn't correct somehow. > Yes I saw the space between "entry has". ;). And yes, like posted in my other email, I set the check for the inet_listener to the beginning of the recipient_restrictions in Postfix and the thing worked and the MTA refused to take the mail over. But thereby got the problem not beeing able to send any email to the mailserver. Don't know why at the moment. Something is wrong with the order of the checks in postfix. Andreas From richw at richw.org Sun Apr 7 22:42:41 2013 From: richw at richw.org (Rich Wales) Date: Sun, 07 Apr 2013 12:42:41 -0700 Subject: [Dovecot] mdbox and folders containing both messages and sub-folders In-Reply-To: <5161B8F9.4070809@sys4.de> References: <51608ADF.50801@liberation.richw.org> <05ACD4AD-E732-43B0-99AE-B05BC6E96004@iki.fi> <5161B600.8000405@liberation.richw.org> <5161B8F9.4070809@sys4.de> Message-ID: <5161CC31.3050203@liberation.richw.org> Replying to Timo Sirainen: > But didn't you say Larch was giving some errors already? Yes, but the Larch error message said only "mailbox cannot contain messages", followed by the name of the folder into which it couldn't store a message. I looked at the Larch source code (written in Ruby, a language I have never used and don't really know at all), and this particular error message appears to be generated when Larch is unable to select or create a given mailbox. Exactly what the IMAP rejection response from Dovecot is, I can't tell; it's not being reported anywhere as far as I can see. > Maybe Larch has some mbox-specific code and it thinks that dbox looks > similar.. Larch isn't accessing Dovecot's internal mailbox structure at all -- it's just talking to the IMAP server. I'm not sure what sort of "mbox-specific code" could be involved in such a scenario. Is there anything about mbox vs. dbox that would be reflected in the way a Dovecot server behaves when using IMAP? I think what I really need here is a way to look at the actual, literal IMAP commands and responses (not just abstract interpretations of the errors from Dovecot, Larch, or any other program). Without that information, I don't see how I can tell what the problem is, or whether it's in Dovecot or Larch. =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Replying to Robert Schetterer: >> Is there a way to make Dovecot report all IMAP commands and responses, so I >> can see exactly what the client is asking for, and exactly why Dovecot is >> refusing to do it? > > verbose logging and mail logger plugin > > http://wiki2.dovecot.org/Logging > http://wiki2.dovecot.org/Plugins/MailLog I enabled these -- at least, I think I did; see my "doveconf -n" output below -- but I'm still not getting a full description of the IMAP commands and responses. Is there any way to see the actual, literal IMAP dialogue? >> Alternatively, does anyone here know Ruby (the language Larch is written in) >> well enough to say how to make its low-level IMAP module give a full logging >> of all commands and responses? > > no, perhaps try imapsync, it [has always] worked for me I'm confused by the licensing status of Imapsync. The "official" web site for Imapsync says it is a commercial product (50 EUR). I found another web site (fedorahosted.org) that claims to have the latest Imapsync as a free download, but I'm unsure as to whether this copy is legitimate or pirated. Can anyone clear this up for me? I had originally preferred to use Imapsync, but I'm not prepared to pay 50 EUR for it, and I don't want to use a pirated "free" copy. > show dovecot conf and log OK, see below for my current output of "doveconf -n". Note that I'm trying out Maildir right now; when I was using mdbox, my "mail_location" configuration line read as follows: mail_location = mdbox:~/mdbox:DIRNAME=.indexes:INDEX=~/mdbox/indexes or like this: mail_location = mdbox:~/mdbox:DIRNAME=.indexes As for the log output (in /var/log/mail.log), there were no error messages of any kind. There were a bunch of "Debug: Namespace" messages saying " doesn't exist yet, using default permissions", but that's all. I'm including (see below) an excerpt from my log output, showing the results of one session. Again, I'm assuming at this point that I'm going to need to see the literal, low-level IMAP commands and responses before I can tell if this is a bug in Dovecot, a bug in Larch, or something else. Rich Wales richw at richw.org =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= # 2.2.rc5 (c24783148d78): /etc/dovecot/dovecot.conf # OS: Linux 3.5.0-26-generic x86_64 Ubuntu 12.04.2 LTS auth_verbose = yes mail_debug = yes mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . } passdb { driver = pam } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap" ssl_cert = , method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=29976, secured, session= imap(randerzo): Debug: Effective uid=5006, gid=5006, home=/home/mail/randerzo imap(randerzo): Debug: Namespace inbox: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mdbox:DIRNAME=.indexes imap(randerzo): Debug: fs: root=/home/mail/randerzo/mdbox, index=, indexpvt=, control=, inbox=, alt= imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox doesn't exist yet, using default permissions imap(randerzo): Debug: Namespace : Using permissions from /home/mail/randerzo/mdbox: mode=0700 gid=default imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox/mailboxes/INBOX/Trash/Hamumu doesn't exist yet, using default permissions imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox/mailboxes/INBOX/Trash doesn't exist yet, using default permissions imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox/mailboxes/INBOX doesn't exist yet, using default permissions imap(randerzo): Debug: Namespace : Using permissions from /home/mail/randerzo/mdbox: mode=0700 gid=default imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox/mailboxes/INBOX/Drafts doesn't exist yet, using default permissions imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox/mailboxes/INBOX/Trash/Big Fish Games doesn't exist yet, using default permissions imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox/mailboxes/INBOX/Archives doesn't exist yet, using default permissions imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox/mailboxes/INBOX/Sent doesn't exist yet, using default permissions imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox/mailboxes/INBOX/Trash/Photobucket doesn't exist yet, using default permissions imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox/mailboxes/INBOX/Junk doesn't exist yet, using default permissions imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox/mailboxes/INBOX/Archives/2012 doesn't exist yet, using default permissions imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox/mailboxes/INBOX/Archives/2011 doesn't exist yet, using default permissions imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox/mailboxes/INBOX/Trash/DragonFable doesn't exist yet, using default permissions imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox/mailboxes/INBOX/Trash/2008 doesn't exist yet, using default permissions imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox/mailboxes/INBOX/Trash/2007 doesn't exist yet, using default permissions imap(randerzo): Debug: Namespace : /home/mail/randerzo/mdbox/mailboxes/INBOX/Trash/2006 doesn't exist yet, using default permissions imap(randerzo): Connection closed in=115500468 out=136980 =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Rich Wales richw at richw.org From tonio at starbridge.org Sun Apr 7 22:47:30 2013 From: tonio at starbridge.org (tonio at starbridge.org) Date: Sun, 07 Apr 2013 21:47:30 +0200 Subject: [Dovecot] crash with dovecot 2.2: Panic: Buffer full In-Reply-To: <6E5E2CD1-FD6F-4374-8D64-585E49128EC0@starbridge.org> References: <51446ACC.4060900@starbridge.org> <1363614474.10326.173.camel@innu> <6E5E2CD1-FD6F-4374-8D64-585E49128EC0@starbridge.org> Message-ID: <5161CD52.2070504@starbridge.org> Le 19/03/2013 07:24, Tonio a ?crit : > > > > Le 18 mars 2013 ? 14:47, Timo Sirainen a ?crit : > >> On Sat, 2013-03-16 at 13:51 +0100, tonio at starbridge.org wrote: >>> Hi Timo, >>> I've got a crash with dovecot 2.2 >>> >>> dovecot --version >>> 2.2.rc2 (69c26a9e3be5) >>> >>> It's occured when accessing with imap on a large mailbox (around 50k >>> messages) >>> >>> imap(clean-quarantine at spamguard.fr): Panic: Buffer full (4254 > 4248, >>> pool ) >> These should fix it: http://hg.dovecot.org/dovecot-2.2/rev/689dbeadf168 >> http://hg.dovecot.org/dovecot-2.2/rev/ee7352f46d1e >> >> >> > Thx Timo > It's ok now > > Regards > Tonio > > Hi Timo, since I've upgraded to 2.2.rc5 (c24783148d78), I've got the previous error again: It's happening on a large mailbox on almost every emails, with Horde 5 webmail client (works fine with thunderbird so far) Thanks for your help Apr 7 21:30:58 mx2 dovecot: imap(clean-quarantine at spamguard.fr): Panic: Buffer full (8206 > 8192, pool ) Apr 7 21:30:58 mx2 dovecot: imap(clean-quarantine at spamguard.fr): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x608ea) [0x7f29866848ea] -> /usr/lib/dovecot/libdovecot.so.0(+0x6092e) [0x7f298668492e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f2986646385] -> /usr/lib/dovecot/libdovecot.so.0(+0x5d198) [0x7f2986681198] -> /usr/lib/dovecot/libdovecot.so.0(+0x56d90) [0x7f298667ad90] -> /usr/lib/dovecot/libdovecot.so.0(+0x4fc1f) [0x7f2986673c1f] -> /usr/lib/dovecot/libdovecot.so.0(+0x4fc92) [0x7f2986673c92] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x69) [0x7f298668ce39] -> /usr/lib/dovecot/libdovecot.so.0(+0x6ddac) [0x7f2986691dac] -> /usr/lib/dovecot/libdovecot.so.0(+0x6df59) [0x7f2986691f59] -> /usr/lib/dovecot/libdovecot.so.0(+0x6e04b) [0x7f298669204b] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x69) [0x7f298668ce39] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7f298668d6bd] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9b524) [0x7f298697b524] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_binary_stream+0x77) [0x7f298697b9b7] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_binary_stream+0x60) [0x7f2986954590] -> /usr/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0x9f) [0x7f29869b0a3f] -> dovecot/imap() [0x418f35] -> dovecot/imap() [0x4175dd] -> dovecot/imap(imap_fetch_more+0x34) [0x418534] -> dovecot/imap(cmd_fetch+0x309) [0x40e2c9] -> dovecot/imap(command_exec+0x3c) [0x41621c] -> dovecot/imap() [0x415280] -> dovecot/imap() [0x41533a] -> dovecot/imap(client_handle_input+0x115) [0x4155f5] -> dovecot/imap(client_input+0x72) [0x4159a2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f2986694186] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7f2986694fd7] Apr 7 21:30:58 mx2 dovecot: imap(clean-quarantine at spamguard.fr): Fatal: master: service(imap): child 23573 killed with signal 6 (core dumped) #0 0x00007f29862cc475 in raise () from /lib/x86_64-linux-gnu/libc.so.6 (gdb) bt full #0 0x00007f29862cc475 in raise () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #1 0x00007f29862cf6f0 in abort () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #2 0x00007f29866848f8 in default_fatal_finish (type=, status=status at entry=0) at failures.c:191 backtrace = 0x62d6b0 "/usr/lib/dovecot/libdovecot.so.0(+0x608ea) [0x7f29866848ea] -> /usr/lib/dovecot/libdovecot.so.0(+0x6092e) [0x7f298668492e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f2986646385] -> /usr/lib/d"... #3 0x00007f298668492e in i_internal_fatal_handler (ctx=0x7fffe230f150, format=, args=) at failures.c:652 status = 0 #4 0x00007f2986646385 in i_panic (format=format at entry=0x7f29866b3890 "Buffer full (%lu > %lu, pool %s)") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 32, fp_offset = 48, overflow_arg_area = 0x7fffe230f240, reg_save_area = 0x7fffe230f180}} #5 0x00007f2986681198 in buffer_check_limits (data_size=38, pos=8168, buf=) at buffer.c:65 extra = new_size = 8206 #6 buffer_write (_buf=0x7fffe230f300, pos=8168, data=0x688beb, data_size=38) at buffer.c:178 buf = #7 0x00007f298667ad90 in quoted_printable_decode_full ( src=src at entry=0x686c20 ' ' , "
\n", ' ' , "\n", ' ' , "\n", ' ' , "\n", ' ' , "\n", ' ' , "\n", ' ' ..., src_size=8192, src_pos_r=src_pos_r at entry=0x7fffe230f2f8, dest=dest at entry=0x7fffe230f300, eof=eof at entry=false) at quoted-printable.c:61 hexbuf = "3D" src_pos = pos = next = errors = #8 0x00007f298667af28 in quoted_printable_decode ( src=src at entry=0x686c20 ' ' , "
\n", ' ' , "\n", ' ' , "\n", ' ' , "\n", ' ' , "\n", ' ' , "\n", ' ' ..., src_size=, src_pos_r=src_pos_r at entry=0x7fffe230f2f8, dest=dest at entry=0x7fffe230f300) at quoted-printable.c:109 No locals. #9 0x00007f2986673c1f in i_stream_qp_try_decode_input (bstream=bstream at entry=0x9f9e90, eof=eof at entry=false) at istream-qp-decoder.c:63 stream = 0x9f9e90 data = 0x686c20 ' ' , "
\n", ' ' , "\n", ' ' , "\n", ' ' , "\n", ' ' , "\n", ' ' , "\n", ' ' ... size = 8192 avail = 8192 buffer_avail = pos = buf = {data = 0xa08590, used = 8168, priv = {0xa08590, 0x0, 0x2000, 0x0, 0x0}} ret = #10 0x00007f2986673c92 in i_stream_qp_decoder_read (stream=0x9f9e90) at istream-qp-decoder.c:103 bstream = 0x9f9e90 pre_count = 0 post_count = ret = prev_size = 8192 __FUNCTION__ = "i_stream_qp_decoder_read" #11 0x00007f298668ce39 in i_stream_read (stream=0x9f9ef0) at istream.c:135 _stream = 0x9f9e90 old_size = 0 ret = __FUNCTION__ = "i_stream_read" #12 0x00007f2986691dac in read_more (sstream=0x9fa360) at istream-seekable.c:140 size = ret = #13 0x00007f2986691f59 in read_from_buffer (sstream=sstream at entry=0x9fa360, ret_r=ret_r at entry=0x7fffe230f418) at istream-seekable.c:182 stream = 0x9fa360 data = size = 0 pos = offset = __FUNCTION__ = "read_from_buffer" #14 0x00007f298669204b in i_stream_seekable_read (stream=0x9fa360) at istream-seekable.c:240 sstream = 0x9fa360 data = size = pos = ret = __FUNCTION__ = "i_stream_seekable_read" #15 0x00007f298668ce39 in i_stream_read (stream=stream at entry=0x9fa3c0) at istream.c:135 _stream = 0x9fa360 old_size = 0 ret = __FUNCTION__ = "i_stream_read" #16 0x00007f298668d6bd in i_stream_read_data (stream=stream at entry=0x9fa3c0, data_r=data_r at entry=0x7fffe230f500, size_r=size_r at entry=0x7fffe230f508, threshold=threshold at entry=0) at istream.c:465 ret = read_more = false __FUNCTION__ = "i_stream_read_data" #17 0x00007f298697b524 in blocks_count_lines (full_input=0x9fa3c0, ctx=0x7fffe230f510) at index-mail-binary.c:319 block_idx = 5 p = size = 0 data = 0x0 ret = cur_block = 0x62d488 block_count = 7 cur_offset = 3718 skip = #18 index_mail_read_binary_to_cache (_mail=_mail at entry=0x66d5b0, part=part at entry=0x672050, include_hdr=include_hdr at entry=false, binary_r=binary_r at entry=0x7fffe230f5c6, converted_r=converted_r at entry=0x7fffe230f5c7) at index-mail-binary.c:393 mail = 0x66d5b0 cache = 0x657b30 ctx = {mail = 0x66d5b0, input = 0x685ac0, has_nuls = false, converted = true, blocks = {arr = {buffer = 0x62d3d8, element_size = 24}, v = 0x62d3d8, v_modifiable = 0x62d3d8}, copy_start_offset = 16849} __FUNCTION__ = "index_mail_read_binary_to_cache" #19 0x00007f298697b9b7 in index_mail_get_binary_stream (_mail=0x66d5b0, part=0x672050, include_hdr=false, size_r=0x7fffe230f688, lines_r=, binary_r=0x7fffe230f67e, stream_r=0x7fffe230f750) at index-mail-binary.c:556 mail = 0x66d5b0 cache = 0x657b30 input = binary = converted = __FUNCTION__ = "index_mail_get_binary_stream" #20 0x00007f2986954590 in mail_get_binary_stream (mail=mail at entry=0x66d5b0, part=part at entry=0x672050, include_hdr=include_hdr at entry=false, size_r=size_r at entry=0x7fffe230f688, binary_r=binary_r at entry=0x7fffe230f67e, stream_r=stream_r at entry=0x7fffe230f750) at mail.c:243 _data_stack_cur_id = 5 p = 0x66d5b0 ret = #21 0x00007f29869b0a3f in imap_msgpart_open (mail=mail at entry=0x66d5b0, msgpart=0x669a30, result_r=result_r at entry=0x7fffe230f750) at imap-msgpart.c:645 part = 0x672050 part_size = {physical_size = 6681872, virtual_size = 0, lines = 6685192} size = include_hdr = false binary = use_partial_cache = ret = 0 #22 0x0000000000418f35 in fetch_body_msgpart (ctx=0x660208, mail=0x66d5b0, body=0x660838) at imap-fetch-body.c:164 result = {input = 0x0, size = 0, size_field = 0, binary_decoded_input_has_nuls = false} str = #23 0x00000000004175dd in imap_fetch_more_int (ctx=ctx at entry=0x660208, cancel=false) at imap-fetch.c:504 h = _data_stack_cur_id = 4 state = 0x660258 client = 0x65f510 handlers = 0x660538 count = 2 ret = __FUNCTION__ = "imap_fetch_more_int" #24 0x0000000000418534 in imap_fetch_more (ctx=0x660208, cmd=cmd at entry=0x6600f0) at imap-fetch.c:556 ret = __FUNCTION__ = "imap_fetch_more" #25 0x000000000040e2c9 in cmd_fetch (cmd=0x6600f0) at cmd-fetch.c:279 client = 0x65f510 ctx = 0x660208 args = 0x638a08 next_arg = list_arg = 0x8661fe60 search_args = 0x0 qresync_args = {qresync_sample_seqset = 0x638b68, qresync_sample_uidset = 0x0} messageset = 0x638b70 "1330796" send_vanished = ret = #26 0x000000000041621c in command_exec (cmd=cmd at entry=0x6600f0) at imap-commands.c:156 hook = 0x636d60 ret = #27 0x0000000000415280 in client_command_input (cmd=0x6600f0) at imap-client.c:775 client = 0x65f510 command = __FUNCTION__ = "client_command_input" #28 0x000000000041533a in client_command_input (cmd=0x6600f0) at imap-client.c:836 client = 0x65f510 command = __FUNCTION__ = "client_command_input" #29 0x00000000004155f5 in client_handle_next_command (remove_io_r=, client=0x65f510) at imap-client.c:874 No locals. #30 client_handle_input (client=client at entry=0x65f510) at imap-client.c:886 _data_stack_cur_id = 3 ret = false remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #31 0x00000000004159a2 in client_input (client=0x65f510) at imap-client.c:928 cmd = output = 0x65ff28 bytes = 37 __FUNCTION__ = "client_input" #32 0x00007f2986694186 in io_loop_call_io (io=0x65fff0) at ioloop.c:387 ioloop = 0x635700 t_id = 2 #33 0x00007f2986694fd7 in io_loop_handler_run (ioloop=ioloop at entry=0x635700) at ioloop-epoll.c:215 ctx = 0x635a70 events = 0x0 event = 0x635ae0 list = 0x660040 io = tv = {tv_sec = 1799, tv_usec = 999263} events_count = msecs = ret = 1 i = call = __FUNCTION__ = "io_loop_handler_run" #34 0x00007f2986693cc8 in io_loop_run (ioloop=0x635700) at ioloop.c:406 No locals. #35 0x00007f298664b513 in master_service_run (service=0x635590, callback=callback at entry=0x41e770 ) at master-service.c:560 No locals. #36 0x000000000040b940 in main (argc=1, argv=0x635390) at main.c:400 set_roots = {0x425a20, 0x0} login_set = {auth_socket_path = 0x62d040 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x41e5e0 , failure_callback = 0x41e710 , request_auth_token = 1} service_flags = storage_service_flags = username = 0x0 c = From e-frog at gmx.de Sun Apr 7 22:55:36 2013 From: e-frog at gmx.de (e-frog) Date: Sun, 07 Apr 2013 21:55:36 +0200 Subject: [Dovecot] mdbox and folders containing both messages and sub-folders In-Reply-To: <5161B600.8000405@liberation.richw.org> References: <51608ADF.50801@liberation.richw.org> <05ACD4AD-E732-43B0-99AE-B05BC6E96004@iki.fi> <5161B600.8000405@liberation.richw.org> Message-ID: <5161CF38.1080000@gmx.de> On 07.04.2013 20:08, wrote Rich Wales: > Repying to Timo Sirainen: > >> What is the error message exactly? I'm wondering if the error is coming from >> Dovecot or if Larch is somehow confused internally and giving bogus errors. > > Certainly a reasonable question. I tried to enable full debugging output in > both Dovecot and Larch, but I couldn't get anything helpful. > > Is there a way to make Dovecot report all IMAP commands and responses, so I > can see exactly what the client is asking for, and exactly why Dovecot is > refusing to do it? http://wiki2.dovecot.org/Debugging/Rawlog > > Alternatively, does anyone here know Ruby (the language Larch is written in) > well enough to say how to make its low-level IMAP module give a full logging > of all commands and responses? > > For what it may or may not be worth, I'm trying my same mail migration test > using Maildir instead of mdbox, and it appears to be working fine. > > Rich Wales > richw at richw.org > From CMarcus at Media-Brokers.com Sun Apr 7 23:13:17 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 07 Apr 2013 16:13:17 -0400 Subject: [Dovecot] Imapsync - WAS: Re: mdbox and folders containing both messages and sub-folders In-Reply-To: <5161CC31.3050203@liberation.richw.org> References: <51608ADF.50801@liberation.richw.org> <05ACD4AD-E732-43B0-99AE-B05BC6E96004@iki.fi> <5161B600.8000405@liberation.richw.org> <5161B8F9.4070809@sys4.de> <5161CC31.3050203@liberation.richw.org> Message-ID: <5161D35D.1000206@Media-Brokers.com> On 2013-04-07 3:42 PM, Rich Wales wrote: > I'm confused by the licensing status of Imapsync. The "official" web site for > Imapsync says it is a commercial product (50 EUR). I found another web site > (fedorahosted.org) that claims to have the latest Imapsync as a free download, > but I'm unsure as to whether this copy is legitimate or pirated. Can anyone > clear this up for me? I had originally preferred to use Imapsync, but I'm not > prepared to pay 50 EUR for it, and I don't want to use a pirated "free" copy. https://github.com/imapsync/imapsync Note the contents of the license file: NO LIMIT PUBLIC LICENSE Version 0, June 2012 Gilles LAMIRAL La Billais 35580 Baulon France NO LIMIT PUBLIC LICENSE Terms and conditions for copying, distribution, modification or anything else. 0 No limit to do anything with this work and this license. 1 GOTO 0 -- Best regards, Charles From richw at richw.org Sun Apr 7 23:49:55 2013 From: richw at richw.org (Rich Wales) Date: Sun, 07 Apr 2013 13:49:55 -0700 Subject: [Dovecot] Imapsync - WAS: Re: mdbox and folders containing both messages and sub-folders In-Reply-To: <5161D35D.1000206@Media-Brokers.com> References: <51608ADF.50801@liberation.richw.org> <05ACD4AD-E732-43B0-99AE-B05BC6E96004@iki.fi> <5161B600.8000405@liberation.richw.org> <5161B8F9.4070809@sys4.de> <5161CC31.3050203@liberation.richw.org> <5161D35D.1000206@Media-Brokers.com> Message-ID: <5161DBF3.2000108@liberation.richw.org> Replying to Charles Marcus: > https://github.com/imapsync/imapsync > Note the contents of the license file: Quite bizarre. So the author of the program is selling it for 50 EUR, but at the same time he has released the latest version of the source (the same as what he's selling) via a free licence. (!?!) OK, thanks for setting my mind at ease. Rich Wales richw at richw.org From paveldimow at gmail.com Sun Apr 7 23:51:50 2013 From: paveldimow at gmail.com (Pavel Dimow) Date: Sun, 7 Apr 2013 22:51:50 +0200 Subject: [Dovecot] dovecot 2 variables Message-ID: Hi, I am trying to use separate configurations for ldap authentication thus providing users with the ability to only use username without domain part. Now according to documentation this should be possible http://wiki2.dovecot.org/AuthDatabase/PasswdFile but I keep getting error in my dovecot.log like this auth: Error: Can't open configuration file /etc/dovecot/%l/dovecot-ldap.conf: No such file or directory Why does dovecot does not expand %l to local ip address? From richw at richw.org Sun Apr 7 23:52:19 2013 From: richw at richw.org (Rich Wales) Date: Sun, 07 Apr 2013 13:52:19 -0700 Subject: [Dovecot] mdbox and folders containing both messages and sub-folders In-Reply-To: <5161CF38.1080000@gmx.de> References: <51608ADF.50801@liberation.richw.org> <05ACD4AD-E732-43B0-99AE-B05BC6E96004@iki.fi> <5161B600.8000405@liberation.richw.org> <5161CF38.1080000@gmx.de> Message-ID: <5161DC83.8020703@liberation.richw.org> Replying to e-frog: > http://wiki2.dovecot.org/Debugging/Rawlog Thanks. I'll try this and (hopefully) be able to tell what's going on. Rich Wales richw at richw.org From tss at iki.fi Sun Apr 7 23:56:41 2013 From: tss at iki.fi (Timo Sirainen) Date: Sun, 07 Apr 2013 23:56:41 +0300 Subject: [Dovecot] crash with dovecot 2.2: Panic: Buffer full In-Reply-To: <5161CD52.2070504@starbridge.org> References: <51446ACC.4060900@starbridge.org> <1363614474.10326.173.camel@innu> <6E5E2CD1-FD6F-4374-8D64-585E49128EC0@starbridge.org> <5161CD52.2070504@starbridge.org> Message-ID: <1365368201.11047.138.camel@innu> On Sun, 2013-04-07 at 21:47 +0200, tonio at starbridge.org wrote: > since I've upgraded to 2.2.rc5 (c24783148d78), I've got the previous > error again: > It's happening on a large mailbox on almost every emails, with Horde 5 > webmail client (works fine with thunderbird so far) > Thanks for your help > > Apr 7 21:30:58 mx2 dovecot: imap(clean-quarantine at spamguard.fr): Panic: > Buffer full (8206 > 8192, pool ) Thanks, this should fix it: http://hg.dovecot.org/dovecot-2.2/rev/bb25fa35d887 From slusarz at curecanti.org Sun Apr 7 23:58:27 2013 From: slusarz at curecanti.org (Michael M Slusarz) Date: Sun, 07 Apr 2013 14:58:27 -0600 Subject: [Dovecot] Imapsync - WAS: Re: mdbox and folders containing both messages and sub-folders In-Reply-To: <5161DBF3.2000108@liberation.richw.org> References: <51608ADF.50801@liberation.richw.org> <05ACD4AD-E732-43B0-99AE-B05BC6E96004@iki.fi> <5161B600.8000405@liberation.richw.org> <5161B8F9.4070809@sys4.de> <5161CC31.3050203@liberation.richw.org> <5161D35D.1000206@Media-Brokers.com> <5161DBF3.2000108@liberation.richw.org> Message-ID: <20130407145827.Horde.HmQ3msdnP57qJKfG7eQYFQ2@bigworm.curecanti.org> Quoting Rich Wales : > Replying to Charles Marcus: > >> https://github.com/imapsync/imapsync >> Note the contents of the license file: > > Quite bizarre. So the author of the program is selling it for 50 EUR, > but at the same time he has released the latest version of the source > (the same as what he's selling) via a free licence. (!?!) 1) There's no guarantee that what's on github is the most recent version of the software. 2) There's no guarantee that any future improvements will be released as open source (as opposed to guaranteed lifetime updates). 3) Looks like at least a windows compiled version of the script is provided. These are all common tactics for releasing open source code while maintaining value-added perks to aid in funding the software development. michael From bobgus at rcn.com Mon Apr 8 00:10:20 2013 From: bobgus at rcn.com (Bob Gustafson) Date: Sun, 07 Apr 2013 16:10:20 -0500 Subject: [Dovecot] repeating dsync - questions In-Reply-To: <2160081B-1673-4466-9F00-12F58E384AB2@iki.fi> References: <1365176449.21402.96.camel@hoho6.chidig.com> <515F1C74.6070602@pacific.net> <8AD72A37-9764-4E71-B6C6-D54B0DD0E624@chidig.com> <515F9A52.5090806@pacific.net> <1365228541.21402.113.camel@hoho6.chidig.com> <51603D13.10806@pacific.net> <3D7EEAD5-D23D-4174-8A0D-261B3FE6B081@chidig.com> <1365343958.21402.157.camel@hoho6.chidig.com> <2160081B-1673-4466-9F00-12F58E384AB2@iki.fi> Message-ID: <1365369020.21402.176.camel@hoho6.chidig.com> On Sun, 2013-04-07 at 20:50 +0300, Timo Sirainen wrote: > On 7.4.2013, at 17.12, Bob Gustafson wrote: > > > I am still on my quest for a quick way to move mail from a live Maildir > > system to a 'soon to be live' sdbox system. > > > > I copy Maildir to new system using: > > rsync -ar --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir > > > > Then I convert from Maildir to sdbox with: > > dsync mirror maildir:~/Maildir > > > > Then I copy more messages from live system using rsync > > ^^ that is the mistake I guess I have a basic misunderstanding of what 'dsync mirror' is doing. My understanding is that going from Maildir to sdbox, dsync does not mess with the data in Maildir. The Maildir metadata is in one form and the sdbox metadata is in another form (in the sdbox directory). No new email messages enter the sdbox system to be 'mirrored' to the Maildir system. I thought of using the 'dsync backup' command, but the sentence "Any changes done in destination are discarded." seems to indicate that each time 'dsync backup' is done, it starts from the beginning. No incremental backup (but this is done in 2.2 ?) > > > Then I do the 'dsync mirror maildir:~/Maildir' again > > > > There were only a few messages that were copied over in the 2nd rsync > > pass and it went quickly, but the 2nd dsync pass is taking a long time. > > The second rsync is overwriting all the metadata changes (mailbox GUIDs > most importantly) that the first dsync run did. Why does dsync mess with the Maildir metadata? Won't that just confuse the dovecot running on the Maildir system? > > > Also, I see strange directories in the sdbox directory (see below) > > Also caused by the same thing. > > v2.2 dsync should be able to handle this much better, but in general > you shouldn't be mixing rsync and dsync in that way. You could for > example install Dovecot v2.1 dsync to the source server (could even be > under /tmp by compiling from sources) and then do the conversion > directly from source server maildir to destination server sdbox. > I used rsync because I really don't want the source system messed with. This has been a learning experience with the possibility (and reality) of starting over on the destination system by doing 'rm -rf Maildir' and 'rm -rf sdbox'. Until I figure it all out, I want that option. This also means that the 2nd (and nth) spin of (rsync; dsync) needs to take less time, approaching the mean time between emails (although I can disconnect from ISP to do the last batch and then switch dovecots) From tss at iki.fi Mon Apr 8 00:26:53 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 00:26:53 +0300 Subject: [Dovecot] dovecot 2 variables In-Reply-To: References: Message-ID: <5E6DF44C-9045-4CA0-97B1-7106257599CF@iki.fi> On 7.4.2013, at 23.51, Pavel Dimow wrote: > I am trying to use separate configurations for ldap authentication thus > providing users > with the ability to only use username without domain part. Now according to > documentation this should be possible > http://wiki2.dovecot.org/AuthDatabase/PasswdFile > > but I keep getting error in my dovecot.log like this > > auth: Error: Can't open configuration file > /etc/dovecot/%l/dovecot-ldap.conf: No such file or directory > > Why does dovecot does not expand %l to local ip address? That expansion works only with passwd-file, not with anything else (such as ldap). From tss at iki.fi Mon Apr 8 00:32:52 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 00:32:52 +0300 Subject: [Dovecot] checkpassword protocol In-Reply-To: References: Message-ID: <2ADFEB99-AA95-40F7-8B63-3A7B7A0A755C@iki.fi> On 7.4.2013, at 14.30, dovecot.pkoch at dfgh.net wrote: > I'm writing a checkpassword script in order to support our OTP token > as a fallback for client certificate authentication. Here are two > questions: > > 1) It seems to me that the username and the password will be > delivered to my script both on file descriptor 3 and via the > environment variables AUTH_USER and AUTH_PASSWORD. > May I ignore file descriptor 3 and use the environment variables > or may it happen that these variables will have differnet content > from what is sent via fd 3? Hmm. The AUTH_PASSWORD wasn't really an intentional addition .. but I guess it can stay there. Some 10 years ago that might not have been such a good idea since there were still some systems where process environment variables were readable to all users in the system, but I doubt there exist such systems anymore (at least where people would want to run Dovecot). > 2) There seems to be some undocumented interaction between > dovecot and my script via file descriptor 4. Seems that whatever > I write to fd 4 will show up in syslog (unless it contains newlines). > Can I use this "feature" to send error messages from my script > to dovecot? What data does dovecot expect on fd 4? I'm not sure why that happens instead of a complete failure .. but you shouldn't be doing that. If you write to fd 2, it should also go to syslog, right? (If it doesn't, it's a bug.) From tss at iki.fi Mon Apr 8 00:35:31 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 00:35:31 +0300 Subject: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot In-Reply-To: References: Message-ID: <62CA7D02-69DA-47C4-9CE7-4A8D9518670F@iki.fi> On 6.4.2013, at 0.10, Michael Smith wrote: > I am trying to 'dsync mirror' old Qpopper/mbox inboxes to our new Dovecot/mdbox servers. For most of the several thousand accounts, it works without issue. But there are a handful of accounts that are generating the following errors. > > dsync(joe): Error: Sync failed for mbox file /var/opt/migrate/users/joe/inbox: seq=981 uid=981 uid_broken=0 originally needed 9 bytes, now needs 11 bytes > > dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=115028 uid=115028 uid_broken=0 originally needed 34 bytes, now needs 35 bytes These are some generic mbox bugs. I think the error goes away if you just repeat the run? > dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=114779 uid=114779 uid_broken=0 originally needed 34 bytes, now needs 35 bytes > dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=114778 uid=114778 uid_broken=0 originally needed 34 bytes, now needs 35 bytes .. or are these all separate dsync runs giving different errors? Anyway, if you can send me an mbox file where I can reproduce this, I could fix it. You can use http://dovecot.org/tools/mbox-anonymize.pl script to replace all the actual data in the mbox file with 'x' chars. From tss at iki.fi Mon Apr 8 00:40:08 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 00:40:08 +0300 Subject: [Dovecot] replicator/dsync over tcp In-Reply-To: References: <71A7D3A9-0D9B-4018-861E-9439F84E5C47@iki.fi> Message-ID: <7B57D3DF-B74E-4645-817C-497CCB5A62DF@iki.fi> On 6.4.2013, at 15.20, Michael Grimm wrote: > My point has been, that I needed to add ... > > | local 1.2.3.4 { > | doveadm_password = secret > | } > > ... besides ... > > | service doveadm { > | inet_listener { > | address = 1.2.3.4 > | port = 12345 > | } > | } > > ... which I cannot find at http://master.wiki2.dovecot.org/Replication if I am not mistaken. doveadm_password is there as a global setting, which works too. > I did get tcps running in the meantime following: > > 1. http://www.zytrax.com/tech/survival/ssl.html ("Method 3" plus "Multi-Server Certificates") > 2. postfix' documentation at http://www.postfix.org/TLS_README.html#server_cert_key (here I had to reverse order, meaning CA first) > 3. pointing ssl_cert, ssl_key to relevant files in //ssl/ca/certs and //ssl/ca/private, respectively > 4. ssl_client_ca_dir = //ssl/ca/certs > > > Question: Why is it neccessary to use ssl_cert/key settings from my CA although you state: >> ssl_cert/key settings are irrelevant here. Oh, yeah, for doveadm server you need ssl_cert/key of course. > Besides dovecot is synchronising as expected, I do get a lot of logfile entries like ... > > | dovecot: dsync-local(test): Warning: I/O leak: 0x10b8cf20 (line 341, fd 14) Seems like a bug. A bit difficult to debug though. Do you see any errors before those warnings (or any errors at all)? > ... and in addition if "verbose_ssl = yes" is set: > > | dsync-remote(test): Warning: SSL alert: where=0x4004, ret=256: warning close notify I think that's normal. From tss at iki.fi Mon Apr 8 00:42:12 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 00:42:12 +0300 Subject: [Dovecot] Configuring dovecot to use tcp wrappers In-Reply-To: References: Message-ID: On 5.4.2013, at 18.19, Max Pyziur wrote: > So my question relates to the second part of the configuration examples in the links above: > > service tcpwrap { > unix_listener login/tcpwrap { > group = $default_login_user > mode = 0600 > user = $default_login_user > } > } > > Where does this code get placed (in dovecot.conf or in one of the files in /etc/dovecot/conf.d)? Doesn't really matter. I'd put it into conf.d/10-master.conf which has other services. > And regarding $default_login_user, it appears in a comment line in > /etc/dovecot/conf.d/10-master.conf > > Should that line be uncommented? Just leave it uncommented and it'll use the default value (which it has been using so far already). From tss at iki.fi Mon Apr 8 00:45:46 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 00:45:46 +0300 Subject: [Dovecot] Problem with fts lucene, on solaris 10 In-Reply-To: <201304052159.25835.pigi@frumar.it> References: <201304052159.25835.pigi@frumar.it> Message-ID: <7FB8546A-7378-40E9-8FA0-991B7610AB47@iki.fi> On 5.4.2013, at 22.59, Pigi wrote: > I'm planning to migrate my courier-imap imap server to dovecot, but I'm experiencing a strange issue > with fts-lucene plugin. > > Basically, every time I start a search, the log starts to write: > > Apr 05 19:30:53 indexer: Error: Indexer worker disconnected, discarding 1 requests for XXXXXX > Apr 05 19:30:53 indexer-worker(XXXXX): Fatal: master: service(indexer-worker): child 809 killed with signal 11 (core not dumped) > Apr 05 19:30:53 imap(XXXXXX): Error: indexer failed to index mailbox INBOX > Apr 05 19:30:56 indexer-worker(XXXXX): Error: lucene index /home/XXXXX/Maildir/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out > > When trussing the indexer-worker pid I can see it ends with: If you can truss it, you can also gdb it, which is much more helpful: gdb -p cont bt full > 527: siginfo: SIGBUS BUS_ADRALN addr=0x005B50BA > 527: Received signal #10, SIGBUS [default] > 527: siginfo: SIGBUS BUS_ADRALN addr=0x005B50BA That says it's a SIGBUS, but the Dovecot log said it's a SIGSEGV. Wonder what's the difference, or maybe you're getting both. Anyway I'd guess this is a clucene bug related to CPU alignment with Sparc CPU. gdb would confirm and could help with fixing it. From tss at iki.fi Mon Apr 8 00:46:47 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 00:46:47 +0300 Subject: [Dovecot] autocreate mailbox but no sub folders In-Reply-To: <51603CCC.70204@univ-nantes.fr> References: <51603CCC.70204@univ-nantes.fr> Message-ID: <40369FCF-83EB-4A5A-959F-8096EAAC552E@iki.fi> On 6.4.2013, at 18.18, Arnaud Ab?lard wrote: > We have been using lda_mailbox_autocreate to avoid to intialize empty mailboxes upon account creations. This does the job allright except that dovecot-lda is also allowed to autocreate sub folders which is a problem when using addresses extensions (adress+folder at domain.tld). It's easy for a malicious user to flood a mailbox with tons of subfolders. > > Is there a way to tell dovecot-lda it can only create the initial mailbox and maybe some special folders but nothing else? INBOX is autocreated regardless of lda_mailbox_autocreate setting. So just set it to "no". From paveldimow at gmail.com Mon Apr 8 00:51:20 2013 From: paveldimow at gmail.com (Pavel Dimow) Date: Sun, 7 Apr 2013 23:51:20 +0200 Subject: [Dovecot] dovecot 2 variables In-Reply-To: <5E6DF44C-9045-4CA0-97B1-7106257599CF@iki.fi> References: <5E6DF44C-9045-4CA0-97B1-7106257599CF@iki.fi> Message-ID: Thank you Timo, can you please correct me if I am wrong, but this means that only way to have one dovecot server authenticating users from ldap without domain part is to use %l in ldap query? That imply to have tree like ou=people,o=x.x.x.x.o=mail,dc=acme,dc=com Or there is a better way to do it? On Sun, Apr 7, 2013 at 11:26 PM, Timo Sirainen wrote: > On 7.4.2013, at 23.51, Pavel Dimow wrote: > > > I am trying to use separate configurations for ldap authentication thus > > providing users > > with the ability to only use username without domain part. Now according > to > > documentation this should be possible > > http://wiki2.dovecot.org/AuthDatabase/PasswdFile > > > > but I keep getting error in my dovecot.log like this > > > > auth: Error: Can't open configuration file > > /etc/dovecot/%l/dovecot-ldap.conf: No such file or directory > > > > Why does dovecot does not expand %l to local ip address? > > That expansion works only with passwd-file, not with anything else (such > as ldap). > > From paveldimow at gmail.com Mon Apr 8 00:53:00 2013 From: paveldimow at gmail.com (Pavel Dimow) Date: Sun, 7 Apr 2013 23:53:00 +0200 Subject: [Dovecot] dovecot 2 variables In-Reply-To: References: <5E6DF44C-9045-4CA0-97B1-7106257599CF@iki.fi> Message-ID: Just to be clear my goal is to have multiple domains on multiple addresses but use one dovecot instance and to let users logging without @domain part. On Sun, Apr 7, 2013 at 11:51 PM, Pavel Dimow wrote: > Thank you Timo, can you please correct me if I am wrong, but this means > that only way to have one dovecot server authenticating users from ldap > without domain part is to use %l in ldap query? That imply to have tree > like ou=people,o=x.x.x.x.o=mail,dc=acme,dc=com > Or there is a better way to do it? > > > > On Sun, Apr 7, 2013 at 11:26 PM, Timo Sirainen wrote: > >> On 7.4.2013, at 23.51, Pavel Dimow wrote: >> >> > I am trying to use separate configurations for ldap authentication thus >> > providing users >> > with the ability to only use username without domain part. Now >> according to >> > documentation this should be possible >> > http://wiki2.dovecot.org/AuthDatabase/PasswdFile >> > >> > but I keep getting error in my dovecot.log like this >> > >> > auth: Error: Can't open configuration file >> > /etc/dovecot/%l/dovecot-ldap.conf: No such file or directory >> > >> > Why does dovecot does not expand %l to local ip address? >> >> That expansion works only with passwd-file, not with anything else (such >> as ldap). >> >> > From tss at iki.fi Mon Apr 8 00:53:11 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 00:53:11 +0300 Subject: [Dovecot] repeating dsync - questions In-Reply-To: <1365369020.21402.176.camel@hoho6.chidig.com> References: <1365176449.21402.96.camel@hoho6.chidig.com> <515F1C74.6070602@pacific.net> <8AD72A37-9764-4E71-B6C6-D54B0DD0E624@chidig.com> <515F9A52.5090806@pacific.net> <1365228541.21402.113.camel@hoho6.chidig.com> <51603D13.10806@pacific.net> <3D7EEAD5-D23D-4174-8A0D-261B3FE6B081@chidig.com> <1365343958.21402.157.camel@hoho6.chidig.com> <2160081B-1673-4466-9F00-12F58E384AB2@iki.fi> <1365369020.21402.176.camel@hoho6.chidig.com> Message-ID: <332CD7C7-8A3D-4FDF-BAF7-80FB49BE033E@iki.fi> On 8.4.2013, at 0.10, Bob Gustafson wrote: >>> I am still on my quest for a quick way to move mail from a live Maildir >>> system to a 'soon to be live' sdbox system. >>> >>> I copy Maildir to new system using: >>> rsync -ar --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir >>> >>> Then I convert from Maildir to sdbox with: >>> dsync mirror maildir:~/Maildir >>> >>> Then I copy more messages from live system using rsync >> >> ^^ that is the mistake > > I guess I have a basic misunderstanding of what 'dsync mirror' is doing. > > My understanding is that going from Maildir to sdbox, dsync does not > mess with the data in Maildir. The Maildir metadata is in one form and > the sdbox metadata is in another form (in the sdbox directory). dsync does mess with metadata in the maildir. also with dsync mirror (as opposed to dsync backup) it can also modify the contents. The main problem here is: 1. dsync sees that a folder A in maildir doesn't have a GUID (because dsync is just about the only tool that uses it right now), and assigns the mailbox a new GUID 2. dsync syncs the mailbox to sdbox with that GUID 3. rsync comes and wipes out the maildir-uidlist that contained the GUID 4. second dsync sees that folder A in maildir doesn't have a GUID, and assigns a new GUID to it - now maildir has folder A with GUID 1, and sdbox has folder A with GUID 2 - dsync thinks they are two different folders, and duplicates them as A and A_2. the A_2 gets also copied back to maildir, because you're using dsync mirror. This is why the second dsync is slow, it's actually doing all the work again, and actually doing twice the work since it's copying the mails from sdbox to maildir as well. v2.2 dsync is somewhat smarter and can figure out that they are actually the same folder A and it simply changes the other's GUID instead of duplicating all data. > No new email messages enter the sdbox system to be 'mirrored' to the > Maildir system. > > I thought of using the 'dsync backup' command, but the sentence "Any > changes done in destination are discarded." seems to indicate that each > time 'dsync backup' is done, it starts from the beginning. No > incremental backup (but this is done in 2.2 ?) dsync backup is incremental. it just wipes out any changes done at the other side (if there happens to be any). >>> Then I do the 'dsync mirror maildir:~/Maildir' again >>> >>> There were only a few messages that were copied over in the 2nd rsync >>> pass and it went quickly, but the 2nd dsync pass is taking a long time. >> >> The second rsync is overwriting all the metadata changes (mailbox GUIDs >> most importantly) that the first dsync run did. > > Why does dsync mess with the Maildir metadata? Won't that just confuse > the dovecot running on the Maildir system? Incremental dsync doesn't work (well) without additional metadata. From pyz at brama.com Mon Apr 8 01:31:20 2013 From: pyz at brama.com (Max Pyziur) Date: Sun, 7 Apr 2013 18:31:20 -0400 Subject: [Dovecot] Configuring dovecot to use tcp wrappers In-Reply-To: References: Message-ID: <535b335cfba0dc23c5c7c62b8d36b3c0.squirrel@webmail.brama.com> > On 5.4.2013, at 18.19, Max Pyziur wrote: > >> So my question relates to the second part of the configuration examples >> in the links above: >> >> service tcpwrap { >> unix_listener login/tcpwrap { >> group = $default_login_user >> mode = 0600 >> user = $default_login_user >> } >> } >> >> Where does this code get placed (in dovecot.conf or in one of the files >> in /etc/dovecot/conf.d)? > > Doesn't really matter. I'd put it into conf.d/10-master.conf which has > other services. > >> And regarding $default_login_user, it appears in a comment line in >> /etc/dovecot/conf.d/10-master.conf >> >> Should that line be uncommented? > > Just leave it uncommented and it'll use the default value (which it has > been using so far already). Much thanks for your reply. However, once I make the changes to the configuration files, I get the following error when restarting dovecot: root at brama /etc/dovecot/conf.d> service dovecot restart Stopping Dovecot Imap: [ OK ] Starting Dovecot Imap: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: service(tcpwrap): executable is empty [FAILED] Any advice on how to proceed? Thank you again, Max Pyziur pyz at brama.com From bobgus at rcn.com Mon Apr 8 01:32:34 2013 From: bobgus at rcn.com (Bob Gustafson) Date: Sun, 07 Apr 2013 17:32:34 -0500 Subject: [Dovecot] repeating dsync - questions In-Reply-To: <332CD7C7-8A3D-4FDF-BAF7-80FB49BE033E@iki.fi> References: <1365176449.21402.96.camel@hoho6.chidig.com> <515F1C74.6070602@pacific.net> <8AD72A37-9764-4E71-B6C6-D54B0DD0E624@chidig.com> <515F9A52.5090806@pacific.net> <1365228541.21402.113.camel@hoho6.chidig.com> <51603D13.10806@pacific.net> <3D7EEAD5-D23D-4174-8A0D-261B3FE6B081@chidig.com> <1365343958.21402.157.camel@hoho6.chidig.com> <2160081B-1673-4466-9F00-12F58E384AB2@iki.fi> <1365369020.21402.176.camel@hoho6.chidig.com> <332CD7C7-8A3D-4FDF-BAF7-80FB49BE033E@iki.fi> Message-ID: <1365373954.21402.198.camel@hoho6.chidig.com> Ok, see interspersed. On Mon, 2013-04-08 at 00:53 +0300, Timo Sirainen wrote: > On 8.4.2013, at 0.10, Bob Gustafson wrote: > > >>> I am still on my quest for a quick way to move mail from a live Maildir > >>> system to a 'soon to be live' sdbox system. > >>> > >>> I copy Maildir to new system using: > >>> rsync -ar --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir > >>> > >>> Then I convert from Maildir to sdbox with: > >>> dsync mirror maildir:~/Maildir > >>> > >>> Then I copy more messages from live system using rsync > >> > >> ^^ that is the mistake > > > > I guess I have a basic misunderstanding of what 'dsync mirror' is doing. > > > > My understanding is that going from Maildir to sdbox, dsync does not > > mess with the data in Maildir. The Maildir metadata is in one form and > > the sdbox metadata is in another form (in the sdbox directory). > > dsync does mess with metadata in the maildir. also with dsync mirror (as opposed to dsync backup) it can also modify the contents. The main problem here is: > > 1. dsync sees that a folder A in maildir doesn't have a GUID (because dsync is just about the only tool that uses it right now), and assigns the mailbox a new GUID > 2. dsync syncs the mailbox to sdbox with that GUID > 3. rsync comes and wipes out the maildir-uidlist that contained the GUID > 4. second dsync sees that folder A in maildir doesn't have a GUID, and assigns a new GUID to it > - now maildir has folder A with GUID 1, and sdbox has folder A with GUID 2 > - dsync thinks they are two different folders, and duplicates them as A and A_2. the A_2 gets also copied back to maildir, because you're using dsync mirror. This is why the second dsync is slow, it's actually doing all the work again, and actually doing twice the work since it's copying the mails from sdbox to maildir as well. > > v2.2 dsync is somewhat smarter and can figure out that they are actually the same folder A and it simply changes the other's GUID instead of duplicating all data. > Ok, how is this for a scheme: 1) Initially rsync Maildir to destination system 2) Do initial 'dsync backup' from Maildir to sdbox on destination system 3) Do a 2nd rsync of new Maildir data from live system to destination system, but don't copy the old maildir-uidlist still in the Maildir of the live system. rsync -ar --times --exclude=dovecot-uidlist I could also use the --ignore-existing option In theory, rsync would not touch the dovecot-uidlist file, would not touch the existing message files, but would copy over the new messages received during the time 'dsync backup' was doing its previous run. 4) Do a 2nd 'dsync backup' from the Maildir to the sdbox (which hasn't changed since the 1st 'dsync backup') > > No new email messages enter the sdbox system to be 'mirrored' to the > > Maildir system. > > > > I thought of using the 'dsync backup' command, but the sentence "Any > > changes done in destination are discarded." seems to indicate that each > > time 'dsync backup' is done, it starts from the beginning. No > > incremental backup (but this is done in 2.2 ?) > > dsync backup is incremental. it just wipes out any changes done at the other side (if there happens to be any). From daniel.parthey at informatik.tu-chemnitz.de Mon Apr 8 01:36:07 2013 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Mon, 8 Apr 2013 00:36:07 +0200 Subject: [Dovecot] dovecot 2 variables In-Reply-To: References: <5E6DF44C-9045-4CA0-97B1-7106257599CF@iki.fi> Message-ID: <20130407223607.GA8249@daniel.localdomain> Pavel Dimow wrote: > Just to be clear my goal is to have multiple domains on multiple addresses > but use one dovecot instance and to let users logging without @domain part. You might try to use several passdb/userdb sections with driver ldap, one for each domain: http://wiki2.dovecot.org/Authentication/MultipleDatabases Regards Daniel -- https://plus.google.com/103021802792276734820 From richw at richw.org Mon Apr 8 01:51:08 2013 From: richw at richw.org (Rich Wales) Date: Sun, 07 Apr 2013 15:51:08 -0700 Subject: [Dovecot] mdbox and folders containing both messages and sub-folders In-Reply-To: <5161DC83.8020703@liberation.richw.org> References: <51608ADF.50801@liberation.richw.org> <05ACD4AD-E732-43B0-99AE-B05BC6E96004@iki.fi> <5161B600.8000405@liberation.richw.org> <5161CF38.1080000@gmx.de> <5161DC83.8020703@liberation.richw.org> Message-ID: <5161F85C.2090400@liberation.richw.org> I retried my test with raw IMAP logging in effect. Each test involved importing about 900 messages into an empty account on my Dovecot server, using the Larch program. =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= When I use the mdbox format, there are a bunch of LIST and LSUB commands whose responses mention INBOX.Trash with the \Noselect and \HasChildren flags (the Trash folder for this particular account happens to contain subfolders). Before trying to save a message in the Trash folder, the client did a "SUBSCRIBE INBOX.Trash" (which succeeded) followed by a "STATUS INBOX.Trash" (which failed with "NO Mailbox doesn't exist"). =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= When I use the Maildir format, the raw log never mentions the \Noselect flag in connection with the INBOX.Trash folder. Before trying to save a message in the Trash folder, the client did a "CREATE INBOX.Trash", "SUBSCRIBE INBOX.Trash", "STATUS INBOX.Trash", and "SELECT INBOX.Trash" -- all of which succeeded -- and then an "APPEND INBOX.Trash" command was given, which also succeeded. =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= So, with the mdbox format, Larch did not CREATE the folder before trying to SELECT it. And Dovecot was flagging INBOX.Trash with a \Noselect flag (which was not the case with the Maildir format). I'm not familiar enough with Dovecot or IMAP to know exactly what this difference means, but hopefully it will reveal something to someone here. Let me know if you need to see other stuff in these raw logs that I didn't mention here. Rich Wales richw at richw.org From tss at iki.fi Mon Apr 8 01:53:36 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 01:53:36 +0300 Subject: [Dovecot] Configuring dovecot to use tcp wrappers In-Reply-To: <535b335cfba0dc23c5c7c62b8d36b3c0.squirrel@webmail.brama.com> References: <535b335cfba0dc23c5c7c62b8d36b3c0.squirrel@webmail.brama.com> Message-ID: On 8.4.2013, at 1.31, "Max Pyziur" wrote: > However, once I make the changes to the configuration files, I get the > following error when restarting dovecot: > root at brama /etc/dovecot/conf.d> service dovecot restart > Stopping Dovecot Imap: [ OK ] > Starting Dovecot Imap: doveconf: Fatal: Error in configuration file > /etc/dovecot/dovecot.conf: service(tcpwrap): executable is empty > [FAILED] You most likely didn't compile Dovecot with tcpwrap support. See if you have /usr/lib*/dovecot/tcpwrap binary? From tss at iki.fi Mon Apr 8 02:13:15 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 08 Apr 2013 02:13:15 +0300 Subject: [Dovecot] v2.2.rc6 released Message-ID: <1365376395.11047.143.camel@innu> http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc6.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc6.tar.gz.sig Some more fixes to bugs I noticed today while trying out some new things in production. Note especially the replicator-doveadm socket change, see http://wiki2.dovecot.org/Replication for how to configure it. This change allowed local replicator to notify the remote replicator about user being synced. * replicator: Don't create replicator-doveadm socket by default. This way doveadm replicator commands don't accidentally start an unconfigured replicator server. + replicator: Have remote dsync notify the remote replicator that a user was just synced. This way the replicators are kept roughly in sync. + Added ssl_client_ca_file to specify the CA certs as a file. This is needed (instead of ssl_client_ca_dir) in RedHat-based systems. + Added "doveadm fs" commands, mainly to debug lib-fs backends. - Mailbox list indexes weren't using proper file permissions based on the root directory. From pyz at brama.com Mon Apr 8 03:40:51 2013 From: pyz at brama.com (Max Pyziur) Date: Sun, 7 Apr 2013 20:40:51 -0400 (EDT) Subject: [Dovecot] Configuring dovecot to use tcp wrappers In-Reply-To: References: <535b335cfba0dc23c5c7c62b8d36b3c0.squirrel@webmail.brama.com> Message-ID: On Mon, 8 Apr 2013, Timo Sirainen wrote: > On 8.4.2013, at 1.31, "Max Pyziur" wrote: > >> However, once I make the changes to the configuration files, I get the >> following error when restarting dovecot: >> root at brama /etc/dovecot/conf.d> service dovecot restart >> Stopping Dovecot Imap: [ OK ] >> Starting Dovecot Imap: doveconf: Fatal: Error in configuration file >> /etc/dovecot/dovecot.conf: service(tcpwrap): executable is empty >> [FAILED] > > You most likely didn't compile Dovecot with tcpwrap support. See if you have /usr/lib*/dovecot/tcpwrap binary? Any idea, then, as to where those CentOS dovecot src.rpms are kept? Max Pyziur pyz at brama.com From pyz at brama.com Mon Apr 8 04:06:42 2013 From: pyz at brama.com (Max Pyziur) Date: Sun, 7 Apr 2013 21:06:42 -0400 (EDT) Subject: [Dovecot] Configuring dovecot to use tcp wrappers In-Reply-To: References: <535b335cfba0dc23c5c7c62b8d36b3c0.squirrel@webmail.brama.com> Message-ID: On Sun, 7 Apr 2013, Max Pyziur wrote: > On Mon, 8 Apr 2013, Timo Sirainen wrote: > >> On 8.4.2013, at 1.31, "Max Pyziur" wrote: >> >>> However, once I make the changes to the configuration files, I get the >>> following error when restarting dovecot: >>> root at brama /etc/dovecot/conf.d> service dovecot restart >>> Stopping Dovecot Imap: [ OK ] >>> Starting Dovecot Imap: doveconf: Fatal: Error in configuration file >>> /etc/dovecot/dovecot.conf: service(tcpwrap): executable is empty >>> [FAILED] >> >> You most likely didn't compile Dovecot with tcpwrap support. See if you >> have /usr/lib*/dovecot/tcpwrap binary? > > Any idea, then, as to where those CentOS dovecot src.rpms are kept? Yanking my own chain: http://vault.centos.org/6.4/updates/Source/SPackages/ > Max Pyziur > pyz at brama.com [...recycle ...] From rs at sys4.de Mon Apr 8 09:40:24 2013 From: rs at sys4.de (Robert Schetterer) Date: Mon, 08 Apr 2013 08:40:24 +0200 Subject: [Dovecot] Imapsync - WAS: Re: mdbox and folders containing both messages and sub-folders In-Reply-To: <5161DBF3.2000108@liberation.richw.org> References: <51608ADF.50801@liberation.richw.org> <05ACD4AD-E732-43B0-99AE-B05BC6E96004@iki.fi> <5161B600.8000405@liberation.richw.org> <5161B8F9.4070809@sys4.de> <5161CC31.3050203@liberation.richw.org> <5161D35D.1000206@Media-Brokers.com> <5161DBF3.2000108@liberation.richw.org> Message-ID: <51626658.5000705@sys4.de> Am 07.04.2013 22:49, schrieb Rich Wales: > Replying to Charles Marcus: > >> https://github.com/imapsync/imapsync >> Note the contents of the license file: > > Quite bizarre. So the author of the program is selling it for 50 EUR, > but at the same time he has released the latest version of the source > (the same as what he's selling) via a free licence. (!?!) > > OK, thanks for setting my mind at ease. > > Rich Wales > richw at richw.org > my Last info is ,that you have to pay for the windows version only Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From dovecot-l at fu-berlin.de Mon Apr 8 10:00:48 2013 From: dovecot-l at fu-berlin.de (Heiko Schlichting) Date: Mon, 8 Apr 2013 09:00:48 +0200 Subject: [Dovecot] checkpassword protocol In-Reply-To: <2ADFEB99-AA95-40F7-8B63-3A7B7A0A755C@iki.fi> References: <2ADFEB99-AA95-40F7-8B63-3A7B7A0A755C@iki.fi> Message-ID: <20130408070048.GA366941@zedat.fu-berlin.de> > Hmm. The AUTH_PASSWORD wasn't really an intentional addition .. but > I guess it can stay there. Some 10 years ago that might not have been > such a good idea since there were still some systems where process > environment variables were readable to all users in the system, but > I doubt there exist such systems anymore (at least where people would > want to run Dovecot). Very optimistic assumption. Wouldn't it be safer to remove the password from the environment? Anyone using checkpassword should use FD 3 and 4 for this purpose. Environment variables and command line arguments are not safe to transport passwords. Heiko Heiko Schlichting Freie Universit?t Berlin heiko.schlichting at fu-berlin.de Zentraleinrichtung f?r Datenverarbeitung Telefon +49 30 838-54327 Fabeckstra?e 32 Telefax +49 30 838454327 14195 Berlin From tss at iki.fi Mon Apr 8 11:04:03 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 11:04:03 +0300 Subject: [Dovecot] mdbox and folders containing both messages and sub-folders In-Reply-To: <5161F85C.2090400@liberation.richw.org> References: <51608ADF.50801@liberation.richw.org> <05ACD4AD-E732-43B0-99AE-B05BC6E96004@iki.fi> <5161B600.8000405@liberation.richw.org> <5161CF38.1080000@gmx.de> <5161DC83.8020703@liberation.richw.org> <5161F85C.2090400@liberation.richw.org> Message-ID: On 8.4.2013, at 1.51, Rich Wales wrote: > When I use the mdbox format, there are a bunch of LIST and LSUB commands > whose responses mention INBOX.Trash with the \Noselect and \HasChildren > flags (the Trash folder for this particular account happens to contain > subfolders). Before trying to save a message in the Trash folder, the > client did a "SUBSCRIBE INBOX.Trash" (which succeeded) followed by a > "STATUS INBOX.Trash" (which failed with "NO Mailbox doesn't exist"). > > =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= > > When I use the Maildir format, the raw log never mentions the \Noselect > flag in connection with the INBOX.Trash folder. Yeah, this is the difference between Dovecot's LAYOUT=fs and LAYOUT=maildir++ backends, which is also exposed to IMAP clients. With maildir++ there are no \Noselect folders possible. Whether that's a good or a bad thing I'm not entirely sure. I've been wondering earlier also if I should change the behavior somewhat, or make it configurable. > So, with the mdbox format, Larch did not CREATE the folder before trying > to SELECT it. And Dovecot was flagging INBOX.Trash with a \Noselect flag > (which was not the case with the Maildir format). I'd say this is a Larch bug. It's relying on some specific way that some IMAP servers work. From dovecot at lists.wgwh.ch Mon Apr 8 11:22:38 2013 From: dovecot at lists.wgwh.ch (Oli Schacher) Date: Mon, 8 Apr 2013 10:22:38 +0200 Subject: [Dovecot] v2.2.rc6 released In-Reply-To: <1365376395.11047.143.camel@innu> References: <1365376395.11047.143.camel@innu> Message-ID: <20130408102238.0e4b9100@lists.wgwh.ch> Hi Timo In my dsync replication test setup I now get Permission denied errors: Apr 8 10:04:33 fumailsynctest2 dovecot: dsync-remote(): Error: net_connect_unix(/var/run/dovecot/replicator-doveadm) failed: Permission denied I haven't noticed them before rc6. Bug or something wrong with my config? Thanks Oli # 2.2.rc6: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.2.1.el6.x86_64 x86_64 CentOS release 6.4 (Final) auth_master_user_separator = * auth_mechanisms = plain login dict { acl = mysql:/etc/dovecot/dovecot-dict-shares.conf quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf } disable_plaintext_auth = no doveadm_password = listen = * login_greeting = Fumail Dovecot ready. mail_max_userip_connections = 50 mail_plugins = " quota notify replication" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { acl = vfile:/etc/dovecot/acls acl_shared_dict = proxy::acl mail_replica = tcp:1..ch:1337 quota = dict:::proxy::quotadict quota_rule = *:storage=10M:messages=1000 quota_rule2 = Spam:ignore quota_rule3 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = pop3 imap lmtp sieve service aggregator { fifo_listener replication-notify-fifo { user = fumail } unix_listener replication-notify { user = fumail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = fumail mode = 0660 user = fumail } user = root } service dict { unix_listener dict { mode = 0600 user = fumail } } service doveadm { inet_listener { port = 1337 } } service imap { vsz_limit = 2 G } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } process_min_avail = 5 unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve { vsz_limit = 2 G } service pop3 { vsz_limit = 2 G } service quota-warning { executable = script /usr/local/bin/quotawarning.py unix_listener quota-warning { mode = 0666 user = fumail } user = fumail } service replicator { process_min_avail = 1 } ssl_cert = .crt ssl_key = .key userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol imap { imap_client_workarounds = mail_plugins = " quota notify replication acl imap_acl quota imap_quota" } protocol pop3 { mail_plugins = " quota notify replication quota" pop3_uidl_format = %08Xu%08Xv } protocol sieve { managesieve_logout_format = bytes ( in=%i : out=%o ) } protocol lmtp { deliver_log_format = from=<%f> msgid=%m action=<%$> subject=%s mail_plugins = " quota notify replication sieve quota" postmaster_address = postmaster@ quota_full_tempfail = yes } From tss at iki.fi Mon Apr 8 11:27:39 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 11:27:39 +0300 Subject: [Dovecot] v2.2.rc6 released In-Reply-To: <20130408102238.0e4b9100@lists.wgwh.ch> References: <1365376395.11047.143.camel@innu> <20130408102238.0e4b9100@lists.wgwh.ch> Message-ID: <193AD08F-BB97-40A3-918D-36A38F0F26F3@iki.fi> On 8.4.2013, at 11.22, Oli Schacher wrote: > In my dsync replication test setup I now get Permission denied errors: > > Apr 8 10:04:33 fumailsynctest2 dovecot: dsync-remote(): Error: net_connect_unix(/var/run/dovecot/replicator-doveadm) failed: Permission denied > > I haven't noticed them before rc6. Bug or something wrong with my config? dsync is trying to notify the replicator that a user was synced. I could maybe just hide that error message, since it's not a real problem. But keeping the two replicators somewhat updated about what users are synced is better, so you could also change the socket's permissions so that dsync has access to it (http://wiki2.dovecot.org/Replication). From noel.butler at ausics.net Mon Apr 8 11:27:44 2013 From: noel.butler at ausics.net (Noel Butler) Date: Mon, 08 Apr 2013 18:27:44 +1000 Subject: [Dovecot] MOSTLY SOLVED: Re: client limit and STARTTLS In-Reply-To: <20130406080908.GA1627@graton2.parts-unknown.org> References: <515F2EA7.9020804@gmail.com> <1365216182.3833.9.camel@tardis> <20130406080908.GA1627@graton2.parts-unknown.org> Message-ID: <1365409664.4021.46.camel@tardis> On Sat, 2013-04-06 at 01:09 -0700, David Benfell wrote: > > Are your certificate chains valid? Simply saying "isn't working" is > > almost a requirement for a *sigh* > > log output please, or a better description than "isn't working" ;) > Yes, the certificate chains were screwed up. And you hit the nail on the > head when you pointed to chains. It's a StartSSL cert and I've had > trouble getting this straight from the beginning. > no problems, it's the main culprit for most SSL issues > Thanks! > > Now if we can sort out how to set the client and process limits. I > changed the settings like thus: > > default_process_limit = 1024 > default_client_limit = 4096 > I see Harald has explained this already (I dont use high performance mode, I prefer security, but you wont notice any performance hit anyway, we never have) But if you can't see yourself with that many concurrent users, remove them and stick with defaults, unless you do need to increase them, wich you'll soon learn from your users, worry about it then. > The truth is, I can't imagine having 4096 clients. I mean, it's true, I > like my toys, but..... > When you see this, just set a ulimit in dovecots startup script #!/bin/sh # rc.dovecot # Start/stop/restart dovecot. ulimit -n 8192 ...dovecot stuff... Cheers -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From pigi at frumar.it Mon Apr 8 11:54:47 2013 From: pigi at frumar.it (Pigi) Date: Mon, 8 Apr 2013 10:54:47 +0200 Subject: [Dovecot] Problem with fts lucene, on solaris 10 In-Reply-To: <7FB8546A-7378-40E9-8FA0-991B7610AB47@iki.fi> References: <201304052159.25835.pigi@frumar.it> <7FB8546A-7378-40E9-8FA0-991B7610AB47@iki.fi> Message-ID: <201304081054.47145.pigi@frumar.it> I haven't had too much luck with gdb: 0xfec4c554 in ?? () (gdb) cont Continuing. Program received signal SIGSEGV, Segmentation fault. 0xfebd710c in ?? () (gdb) bt full #0 0xfebd710c in ?? () No symbol table info available. (gdb) quit The program is running. Quit anyway (and detach it)? (y or n) y Detaching from program: , process 16400 That's rather strange, as : root# file /usr/local/dovecot/sbin/dovecot dovecot: ELF 32-bit MSB executable SPARC Version 1, dynamically linked, not stripped root# file /usr/local/clucene/lib/lib* /usr/local/clucene/lib/libclucene-core.so: ELF 32-bit MSB dynamic lib SPARC Version 1, dynamically linked, not stripped /usr/local/clucene/lib/libclucene-core.so.1: ELF 32-bit MSB dynamic lib SPARC Version 1, dynamically linked, not stripped /usr/local/clucene/lib/libclucene-core.so.2.3.3.4: ELF 32-bit MSB dynamic lib SPARC Version 1, dynamically linked, not stripped /usr/local/clucene/lib/libclucene-shared.so: ELF 32-bit MSB dynamic lib SPARC Version 1, dynamically linked, not stripped /usr/local/clucene/lib/libclucene-shared.so.1: ELF 32-bit MSB dynamic lib SPARC Version 1, dynamically linked, not stripped /usr/local/clucene/lib/libclucene-shared.so.2.3.3.4: ELF 32-bit MSB dynamic lib SPARC Version 1, dynamically linked, not stripped root # Thus, every binary, or lib, is not stripped. If I invoke gdb on those binary I can get every simbol: root # gdb /usr/local/dovecot/sbin/dovecot ... SNIP ... (gdb) list 736 "\n", IO_BLOCK_SIZE); 737 } 738 739 int main(int argc, char *argv[]) 740 { 741 struct master_settings *set; 742 const char *error, *doveconf_arg = NULL; 743 failure_callback_t *orig_info_callback, *orig_debug_callback; 744 bool foreground = FALSE, ask_key_pass = FALSE; 745 bool doubleopts[argc]; or even root # gdb /usr/local/clucene/lib/libclucene-core.so ... SNIP ... (gdb) list 1 /*------------------------------------------------------------------------------ 2 * Copyright (C) 2003-2006 Ben van Klinken and the CLucene Team 3 * 4 * Distributable under the terms of either the Apache License (Version 2.0) or 5 * the GNU Lesser General Public License, as specified in the COPYING file. 6 ------------------------------------------------------------------------------*/ 7 #include "CLucene/_ApiHeader.h" 8 #include "CLucene/util/Misc.h" 9 10 #include "CLucene/search/Sort.h" (gdb) Should I compile with -g (and in case, how do I pass this flag to cmake ) ? Thanks. Pigi On Sunday 07 April 2013, Timo Sirainen wrote: > On 5.4.2013, at 22.59, Pigi wrote: > > > I'm planning to migrate my courier-imap imap server to dovecot, but I'm experiencing a strange issue > > with fts-lucene plugin. > > > > Basically, every time I start a search, the log starts to write: > > > > Apr 05 19:30:53 indexer: Error: Indexer worker disconnected, discarding 1 requests for XXXXXX > > Apr 05 19:30:53 indexer-worker(XXXXX): Fatal: master: service(indexer-worker): child 809 killed with signal 11 (core not dumped) > > Apr 05 19:30:53 imap(XXXXXX): Error: indexer failed to index mailbox INBOX > > Apr 05 19:30:56 indexer-worker(XXXXX): Error: lucene index /home/XXXXX/Maildir/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out > > > > When trussing the indexer-worker pid I can see it ends with: > > If you can truss it, you can also gdb it, which is much more helpful: > > gdb -p > cont > > bt full > > > 527: siginfo: SIGBUS BUS_ADRALN addr=0x005B50BA > > 527: Received signal #10, SIGBUS [default] > > 527: siginfo: SIGBUS BUS_ADRALN addr=0x005B50BA > > That says it's a SIGBUS, but the Dovecot log said it's a SIGSEGV. Wonder what's the difference, or maybe you're getting both. Anyway I'd guess this is a clucene bug related to CPU alignment with Sparc CPU. gdb would confirm and could help with fixing it. > > From tss at iki.fi Mon Apr 8 12:01:59 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 12:01:59 +0300 Subject: [Dovecot] Problem with fts lucene, on solaris 10 In-Reply-To: <201304081054.47145.pigi@frumar.it> References: <201304052159.25835.pigi@frumar.it> <7FB8546A-7378-40E9-8FA0-991B7610AB47@iki.fi> <201304081054.47145.pigi@frumar.it> Message-ID: <08EACBAD-9A0E-4E07-9128-DBE6D8AFFE3B@iki.fi> On 8.4.2013, at 11.54, Pigi wrote: > I haven't had too much luck with gdb: > > 0xfec4c554 in ?? () > (gdb) cont > Continuing. > > Program received signal SIGSEGV, Segmentation fault. > 0xfebd710c in ?? () > (gdb) bt full > #0 0xfebd710c in ?? () > No symbol table info available. > (gdb) quit > The program is running. Quit anyway (and detach it)? (y or n) y > Detaching from program: , process 16400 gdb is just confused. Try another way if it works: gdb /usr/local/libexec/dovecot/imap 16400 cont bt full From pigi at frumar.it Mon Apr 8 12:19:05 2013 From: pigi at frumar.it (Pigi) Date: Mon, 8 Apr 2013 11:19:05 +0200 Subject: [Dovecot] Problem with fts lucene, on solaris 10 In-Reply-To: <08EACBAD-9A0E-4E07-9128-DBE6D8AFFE3B@iki.fi> References: <201304052159.25835.pigi@frumar.it> <201304081054.47145.pigi@frumar.it> <08EACBAD-9A0E-4E07-9128-DBE6D8AFFE3B@iki.fi> Message-ID: <201304081119.05217.pigi@frumar.it> On Monday 08 April 2013, Timo Sirainen wrote: > On 8.4.2013, at 11.54, Pigi wrote: > > > gdb is just confused. Try another way if it works: > > gdb /usr/local/libexec/dovecot/imap 16400 > cont > bt full > > Timo, I took a sligtly different approach: gdb /usr/local/dovecot/libexec/dovecot/indexer-worker `ps -ef | grep indexer-worker | grep -v grep |awk '{print $2}' ` thus attaching to indexer-worker, which I think ( but not sure ) it should be fine. Here the result: GNU gdb 6.6 Copyright (C) 2006 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "sparc-sun-solaris2.10"... Attaching to program `/usr/local/dovecot/libexec/dovecot/indexer-worker', process 21672 Reading symbols from /usr/local/dovecot/lib/dovecot/libdovecot-storage.so.0...done. Loaded symbols for /usr/local/dovecot/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /usr/local/dovecot/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /usr/local/dovecot/lib/dovecot/libdovecot.so.0 Reading symbols from /usr/local/openssl-1.0.1e/lib/libssl.so.1.0.0...done. Loaded symbols for /usr/local/openssl-1.0.1e/lib//libssl.so.1.0.0 Reading symbols from /usr/local/openssl-1.0.1e/lib/libcrypto.so.1.0.0...done. Loaded symbols for /usr/local/openssl-1.0.1e/lib//libcrypto.so.1.0.0 Reading symbols from /lib/libdl.so.1... warning: Lowest section in /lib/libdl.so.1 is .hash at 000000b4 done. Loaded symbols for /lib/libdl.so.1 Reading symbols from /usr/local/lib/libiconv.so.2...done. Loaded symbols for /usr/local/lib/libiconv.so.2 Reading symbols from /lib/libnsl.so.1...done. Loaded symbols for /lib/libnsl.so.1 Reading symbols from /lib/libsocket.so.1...done. Loaded symbols for /lib/libsocket.so.1 Reading symbols from /lib/librt.so.1...done. Loaded symbols for /lib/librt.so.1 Reading symbols from /lib/libsendfile.so.1...done. Loaded symbols for /lib/libsendfile.so.1 Reading symbols from /lib/libc.so.1...done. Loaded symbols for /lib/libc.so.1 Reading symbols from /usr/sfw/lib/libgcc_s.so.1...done. Loaded symbols for /usr/sfw/lib/libgcc_s.so.1 Reading symbols from /lib/libaio.so.1...done. Loaded symbols for /lib/libaio.so.1 Reading symbols from /lib/libmd.so.1...done. Loaded symbols for /lib/libmd.so.1 Reading symbols from /platform/SUNW,Sun-Fire-V240/lib/libc_psr.so.1...done. Loaded symbols for /platform/SUNW,Sun-Fire-V240/lib/libc_psr.so.1 Reading symbols from /usr/local/dovecot/lib/dovecot/lib20_fts_plugin.so...done. Loaded symbols for /usr/local/dovecot/lib/dovecot/lib20_fts_plugin.so Reading symbols from /lib/libscf.so.1...done. Loaded symbols for /lib/libscf.so.1 Reading symbols from /lib/libdoor.so.1...done. Loaded symbols for /lib/libdoor.so.1 Reading symbols from /lib/libuutil.so.1...done. Loaded symbols for /lib/libuutil.so.1 Reading symbols from /lib/libgen.so.1...done. Loaded symbols for /lib/libgen.so.1 Reading symbols from /platform/SUNW,Sun-Fire-V240/lib/libmd_psr.so.1...done. Loaded symbols for /platform/SUNW,Sun-Fire-V240/lib/libmd_psr.so.1 Reading symbols from /lib/libmp.so.2...done. Loaded symbols for /lib/libmp.so.2 Reading symbols from /usr/local/dovecot/lib/dovecot/lib21_fts_lucene_plugin.so...done. Loaded symbols for /usr/local/dovecot/lib/dovecot/lib21_fts_lucene_plugin.so Reading symbols from /usr/local/clucene/lib/libclucene-shared.so.1...done. Loaded symbols for /usr/local/clucene/lib//libclucene-shared.so.1 Reading symbols from /usr/local/clucene/lib/libclucene-core.so.1...done. Loaded symbols for /usr/local/clucene/lib//libclucene-core.so.1 Reading symbols from /usr/sfw/lib/libstdc++.so.6...done. Loaded symbols for /usr/sfw/lib/libstdc++.so.6 Reading symbols from /lib/libm.so.2...done. Loaded symbols for /lib/libm.so.2 Reading symbols from /usr/lib/libz.so...done. Loaded symbols for /usr/lib/libz.so Reading symbols from /lib/ld.so.1...done. Loaded symbols for /lib/ld.so.1 sol-thread active. Retry #1: Retry #2: Retry #3: Retry #4: [New LWP 1 ] [New Thread 1 (LWP 1)] Symbols already loaded for /usr/local/dovecot/lib/dovecot/libdovecot-storage.so.0 Symbols already loaded for /usr/local/dovecot/lib/dovecot/libdovecot.so.0 Symbols already loaded for /usr/local/openssl-1.0.1e/lib//libssl.so.1.0.0 Symbols already loaded for /usr/local/openssl-1.0.1e/lib//libcrypto.so.1.0.0 Symbols already loaded for /lib/libdl.so.1 Symbols already loaded for /usr/local/lib/libiconv.so.2 Symbols already loaded for /lib/libnsl.so.1 Symbols already loaded for /lib/libsocket.so.1 Symbols already loaded for /lib/librt.so.1 Symbols already loaded for /lib/libsendfile.so.1 Symbols already loaded for /lib/libc.so.1 Symbols already loaded for /usr/sfw/lib/libgcc_s.so.1 Symbols already loaded for /lib/libaio.so.1 Symbols already loaded for /lib/libmd.so.1 Symbols already loaded for /platform/SUNW,Sun-Fire-V240/lib/libc_psr.so.1 Symbols already loaded for /usr/local/dovecot/lib/dovecot/lib20_fts_plugin.so Symbols already loaded for /lib/libscf.so.1 Symbols already loaded for /lib/libdoor.so.1 Symbols already loaded for /lib/libuutil.so.1 Symbols already loaded for /lib/libgen.so.1 Symbols already loaded for /platform/SUNW,Sun-Fire-V240/lib/libmd_psr.so.1 Symbols already loaded for /lib/libmp.so.2 Symbols already loaded for /usr/local/dovecot/lib/dovecot/lib21_fts_lucene_plugin.so Symbols already loaded for /usr/local/clucene/lib//libclucene-shared.so.1 Symbols already loaded for /usr/local/clucene/lib//libclucene-core.so.1 Symbols already loaded for /usr/sfw/lib/libstdc++.so.6 Symbols already loaded for /lib/libm.so.2 Symbols already loaded for /usr/lib/libz.so Symbols already loaded for /lib/ld.so.1 [Switching to Thread 1 (LWP 1)] 0xfec4c554 in _pread64 () from /lib/libc.so.1 (gdb) cont Continuing. Program received signal SIGSEGV, Segmentation fault. 0xfebd65dc in _malloc_unlocked () from /lib/libc.so.1 (gdb) bt full #0 0xfebd65dc in _malloc_unlocked () from /lib/libc.so.1 No symbol table info available. #1 0xfebd66e4 in realloc () from /lib/libc.so.1 No symbol table info available. #2 0xff1d9a70 in pool_system_realloc (pool=0xff21576c, mem=0xff21576c, old_size=0, new_size=8192) at mempool-system.c:115 No locals. #3 0xff1cda28 in i_realloc (mem=0x0, old_size=0, new_size=8192) at imem.c:14 No locals. #4 0xff1cf268 in i_stream_grow_buffer (stream=0x1df318, bytes=0) at istream.c:482 old_size = 0 __FUNCTION__ = "i_stream_grow_buffer" #5 0xff1cf33c in i_stream_get_buffer_space (stream=0x1df318, wanted_size=1, size_r=0xffbff35c) at istream.c:500 __FUNCTION__ = "i_stream_get_buffer_space" #6 0xff1d11c8 in i_stream_file_read (stream=0x1df318) at istream-file.c:58 size = 89 ret = 1962776 __FUNCTION__ = "i_stream_file_read" #7 0xff1ce8e4 in i_stream_read (stream=0x1df348) at istream.c:130 _stream = (struct istream_private *) 0x1df318 old_size = 0 ret = 1962824 __FUNCTION__ = "i_stream_read" #8 0xff1ceb9c in i_stream_read_copy_from_parent (istream=0x0) at istream.c:172 stream = (struct istream_private *) 0x194da8 pos = 0 ret = 0 __FUNCTION__ = "i_stream_read_copy_from_parent" #9 0xff30e258 in i_stream_mail_read (stream=0x194da8) at istream-mail.c:67 size = 4281606432 ret = 0 #10 0xff1ce9ac in i_stream_read (stream=0x194dd8) at istream.c:130 _stream = (struct istream_private *) 0x194da8 old_size = 0 ret = 1658328 __FUNCTION__ = "i_stream_read" #11 0xff1cf094 in i_stream_read_data (stream=0x194dd8, data_r=0xffbff614, size_r=0xffbff610, threshold=1) at istream.c:428 ret = -14592148 read_more = false __FUNCTION__ = "i_stream_read_data" #12 0xff1ad9e4 in message_parse_header_next (ctx=0x2a0c88, hdr_r=0xffbff694) at message-header-parser.c:89 msg = (const unsigned char *) 0x0 i = 4279949788 size = 0 startpos = 0 colon_pos = 4294967295 parse_size = 1 ret = 1658328 continued = false continues = false no_newline = false crlf_newline = false __FUNCTION__ = "message_parse_header_next" #13 0xff1af2a4 in parse_next_header (ctx=0x203cf8, block_r=0xffbff810) at message-parser.c:478 part = (struct message_part *) 0x245c0 hdr = (struct message_header_line *) 0x0 size = 0 ret = 2112760 __FUNCTION__ = "parse_next_header" #14 0xff1aff10 in message_parser_parse_next_block (ctx=0x203cf8, block_r=0xffbff810) at message-parser.c:784 ret = 2112760 eof = false full = false __FUNCTION__ = "message_parser_parse_next_block" #15 0xfecd5a4c in fts_build_mail (update_ctx=0x818a8, mail=0x7d0b8) at fts-build-mail.c:295 _data_stack_cur_id = 5 #16 0xfecda9cc in fts_mail_precache (_mail=0x7d0b8) at fts-storage.c:443 _data_stack_cur_id = 4 fmail = (struct fts_mail *) 0xfecee4cc ft = (struct fts_transaction_context *) 0x2bc00 #17 0xff2eff30 in mail_precache (mail=0x7d0b8) at mail.c:281 No locals. #18 0x00011cd0 in master_connection_input (conn=0x2baa0) at master-connection.c:86 _data_stack_cur_id = 3 line = 0xdea8
#19 0xff1d5090 in io_loop_call_io (io=0x30be8) at ioloop.c:379 ioloop = (struct ioloop *) 0x2c8f0 t_id = 2 #20 0xff1d5a9c in io_loop_handler_run (ioloop=0x2c8f0) at ioloop-poll.c:211 ctx = (struct ioloop_handler_context *) 0x2ba60 pollfd = (struct pollfd *) 0x2fc38 tv = {tv_sec = 2147483, tv_usec = 0} io = (struct io_file *) 0x30be8 msecs = -1 ret = 0 call = true #21 0xff1d4a84 in io_loop_run (ioloop=0x2c8f0) at ioloop.c:398 No locals. #22 0xff1bd98c in master_service_run (service=0x2c240, callback=0x117c0 ) at master-service.c:544 No locals. #23 0x000118d8 in main (argc=1, argv=0xffbffde4) at indexer-worker.c:78 storage_service_flags = 547 c = 180800 In case I need to attach to imap, let me know. Thanks Pigi From tss at iki.fi Mon Apr 8 12:26:02 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 12:26:02 +0300 Subject: [Dovecot] Problem with fts lucene, on solaris 10 In-Reply-To: <201304081119.05217.pigi@frumar.it> References: <201304052159.25835.pigi@frumar.it> <201304081054.47145.pigi@frumar.it> <08EACBAD-9A0E-4E07-9128-DBE6D8AFFE3B@iki.fi> <201304081119.05217.pigi@frumar.it> Message-ID: <3812A9F0-8531-4F25-974F-5A6ED087C555@iki.fi> On 8.4.2013, at 12.19, Pigi wrote: >> gdb /usr/local/libexec/dovecot/imap 16400 .. > I took a sligtly different approach: > gdb /usr/local/dovecot/libexec/dovecot/indexer-worker `ps -ef | grep indexer-worker | grep -v grep |awk '{print $2}' ` > > thus attaching to indexer-worker, which I think ( but not sure ) it should be fine. Oh, right, I forgot which process you were gdbing :) > Program received signal SIGSEGV, Segmentation fault. > 0xfebd65dc in _malloc_unlocked () from /lib/libc.so.1 > (gdb) bt full > #0 0xfebd65dc in _malloc_unlocked () from /lib/libc.so.1 > No symbol table info available. > #1 0xfebd66e4 in realloc () from /lib/libc.so.1 > No symbol table info available. > #2 0xff1d9a70 in pool_system_realloc (pool=0xff21576c, mem=0xff21576c, old_size=0, new_size=8192) at mempool-system.c:115 > No locals. > #3 0xff1cda28 in i_realloc (mem=0x0, old_size=0, new_size=8192) at imem.c:14 > No locals. Looks to me like memory corruption, which is just about impossible to debug if you don't have valgrind or a similar tool (and I don't think Solaris has any such free tools). Do you happen to get any other crashes where it doesn't crash in malloc code? You showed previously that it was crashing with SIGBUS somewhere. From dovecot at lists.wgwh.ch Mon Apr 8 13:05:27 2013 From: dovecot at lists.wgwh.ch (Oli Schacher) Date: Mon, 8 Apr 2013 12:05:27 +0200 Subject: [Dovecot] dsync replication: quota counted twice Message-ID: <20130408120527.22d37a83@lists.wgwh.ch> Hi I enabled quota + warnings in my replication test setup and now whenever a mail gets delivered the quota is counted twice (probably due to both servers using the same mysql quota backend) and quota warnings are fired too early. After a doveadm quota recalc -u the quota is correct again. How do I make dovecot only count the quota on the server where the mail was added originally? dovecot -n is the same as in my previous message to the list today http://www.dovecot.org/list/dovecot/2013-April/089558.html (thanks Timo for the hint in this thread btw, changing the permissions made the errors go away) Thanks Oli -- message transmitted on 100% recycled electrons From paveldimow at gmail.com Mon Apr 8 13:07:24 2013 From: paveldimow at gmail.com (Pavel Dimow) Date: Mon, 8 Apr 2013 12:07:24 +0200 Subject: [Dovecot] dovecot 2 variables In-Reply-To: <20130407223607.GA8249@daniel.localdomain> References: <5E6DF44C-9045-4CA0-97B1-7106257599CF@iki.fi> <20130407223607.GA8249@daniel.localdomain> Message-ID: Well that is not very scalable as we always ask first database no matter what. What if I have the same user in both databases (ldap)? On Mon, Apr 8, 2013 at 12:36 AM, Daniel Parthey < daniel.parthey at informatik.tu-chemnitz.de> wrote: > Pavel Dimow wrote: > > Just to be clear my goal is to have multiple domains on multiple > addresses > > but use one dovecot instance and to let users logging without @domain > part. > > You might try to use several passdb/userdb sections with driver ldap, > one for each domain: > > http://wiki2.dovecot.org/Authentication/MultipleDatabases > > Regards > Daniel > -- > https://plus.google.com/103021802792276734820 > From tss at iki.fi Mon Apr 8 13:14:02 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 13:14:02 +0300 Subject: [Dovecot] dovecot 2 variables In-Reply-To: References: <5E6DF44C-9045-4CA0-97B1-7106257599CF@iki.fi> <20130407223607.GA8249@daniel.localdomain> Message-ID: <0A784532-EFF5-4B25-97E9-2E07D6294A00@iki.fi> You could put (%l=1.2.3.4) in the ldap filter. But I guess it still gets sent to the LDAP server. The best solution would be: local 1.2.3.4 { userdb { .. } } But that doesn't work yet. With v2.2 you can do multiple queries. So you could have one query to translate IP address to the domain, and then a second lookup to lookup the user at domain. http://wiki2.dovecot.org/AuthDatabase/LDAP/Userdb -> subqueries. On 8.4.2013, at 13.07, Pavel Dimow wrote: > Well that is not very scalable as we always ask first database no matter > what. What if I have the same user in both databases (ldap)? > > > On Mon, Apr 8, 2013 at 12:36 AM, Daniel Parthey < > daniel.parthey at informatik.tu-chemnitz.de> wrote: > >> Pavel Dimow wrote: >>> Just to be clear my goal is to have multiple domains on multiple >> addresses >>> but use one dovecot instance and to let users logging without @domain >> part. >> >> You might try to use several passdb/userdb sections with driver ldap, >> one for each domain: >> >> http://wiki2.dovecot.org/Authentication/MultipleDatabases >> >> Regards >> Daniel >> -- >> https://plus.google.com/103021802792276734820 >> From tss at iki.fi Mon Apr 8 13:15:54 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 13:15:54 +0300 Subject: [Dovecot] dsync replication: quota counted twice In-Reply-To: <20130408120527.22d37a83@lists.wgwh.ch> References: <20130408120527.22d37a83@lists.wgwh.ch> Message-ID: <38CD66EF-DFBF-4238-BB96-F10E20AB7FB7@iki.fi> On 8.4.2013, at 13.05, Oli Schacher wrote: > I enabled quota + warnings in my replication test setup and now > whenever a mail gets delivered the quota is counted twice (probably due > to both servers using the same mysql quota backend) Yes. Dovecot doesn't know that they are the same quota backend. > and quota warnings > are fired too early. After a doveadm quota recalc -u the > quota is correct again. How do I make dovecot only count the quota on > the server where the mail was added originally? There's no way to make quota work reliably that way. You need to use different quota backends. Either two mysql databases (or tables), or the other Dovecot could simply be using a dict file quota. From tss at iki.fi Mon Apr 8 13:26:36 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 13:26:36 +0300 Subject: [Dovecot] checkpassword protocol In-Reply-To: <20130408070048.GA366941@zedat.fu-berlin.de> References: <2ADFEB99-AA95-40F7-8B63-3A7B7A0A755C@iki.fi> <20130408070048.GA366941@zedat.fu-berlin.de> Message-ID: <7D26E8EE-FE65-4B14-832A-D62A6E7DD072@iki.fi> On 8.4.2013, at 10.00, Heiko Schlichting wrote: >> Hmm. The AUTH_PASSWORD wasn't really an intentional addition .. but >> I guess it can stay there. Some 10 years ago that might not have been >> such a good idea since there were still some systems where process >> environment variables were readable to all users in the system, but >> I doubt there exist such systems anymore (at least where people would >> want to run Dovecot). > > Very optimistic assumption. Wouldn't it be safer to remove the password > from the environment? Anyone using checkpassword should use FD 3 and 4 for > this purpose. Environment variables and command line arguments are not safe > to transport passwords. All the OSes made the environment private 10-15 years ago. I think it's pretty safe to assume that older multiuser systems won't be running Dovecot with checkpassword backend. But .. eh. I guess: http://hg.dovecot.org/dovecot-2.2/rev/9feb2986945c From paveldimow at gmail.com Mon Apr 8 13:40:37 2013 From: paveldimow at gmail.com (Pavel Dimow) Date: Mon, 8 Apr 2013 12:40:37 +0200 Subject: [Dovecot] dovecot 2 variables In-Reply-To: <0A784532-EFF5-4B25-97E9-2E07D6294A00@iki.fi> References: <5E6DF44C-9045-4CA0-97B1-7106257599CF@iki.fi> <20130407223607.GA8249@daniel.localdomain> <0A784532-EFF5-4B25-97E9-2E07D6294A00@iki.fi> Message-ID: Thank you Timo, then I guess I will runing two instances of dovecot one for each domain until local 1.2.3.4 { userdb { .. } } becomes ready :) On Mon, Apr 8, 2013 at 12:14 PM, Timo Sirainen wrote: > You could put (%l=1.2.3.4) in the ldap filter. But I guess it still gets > sent to the LDAP server. The best solution would be: > > local 1.2.3.4 { > userdb { > .. > } > } > > But that doesn't work yet. > > With v2.2 you can do multiple queries. So you could have one query to > translate IP address to the domain, and then a second lookup to lookup the > user at domain. http://wiki2.dovecot.org/AuthDatabase/LDAP/Userdb -> > subqueries. > > On 8.4.2013, at 13.07, Pavel Dimow wrote: > > > Well that is not very scalable as we always ask first database no matter > > what. What if I have the same user in both databases (ldap)? > > > > > > On Mon, Apr 8, 2013 at 12:36 AM, Daniel Parthey < > > daniel.parthey at informatik.tu-chemnitz.de> wrote: > > > >> Pavel Dimow wrote: > >>> Just to be clear my goal is to have multiple domains on multiple > >> addresses > >>> but use one dovecot instance and to let users logging without @domain > >> part. > >> > >> You might try to use several passdb/userdb sections with driver ldap, > >> one for each domain: > >> > >> http://wiki2.dovecot.org/Authentication/MultipleDatabases > >> > >> Regards > >> Daniel > >> -- > >> https://plus.google.com/103021802792276734820 > >> > > From dovecot-l at fu-berlin.de Mon Apr 8 13:42:49 2013 From: dovecot-l at fu-berlin.de (Heiko Schlichting) Date: Mon, 8 Apr 2013 12:42:49 +0200 Subject: [Dovecot] checkpassword protocol In-Reply-To: <7D26E8EE-FE65-4B14-832A-D62A6E7DD072@iki.fi> References: <2ADFEB99-AA95-40F7-8B63-3A7B7A0A755C@iki.fi> <20130408070048.GA366941@zedat.fu-berlin.de> <7D26E8EE-FE65-4B14-832A-D62A6E7DD072@iki.fi> Message-ID: <20130408104249.GD499611@zedat.fu-berlin.de> Timo wrote: > All the OSes made the environment private 10-15 years ago. I think it's > pretty safe to assume that older multiuser systems won't be running > Dovecot with checkpassword backend. The checkpassword interface is used in many different ways: I found checkpassword the easiest way to implement authentication against FreeRADIUS. Using a perl script with $input = IO::Handle->new_from_fd(3, "r"); and my $output = IO::Handle->new_from_fd(4, "w"); and skipping the checkpassword-reply binary. This works fine on our server for many years now but every time when I read some related questions on the list, it seems that a more generic, not so crude interface would be a good idea for a future version of dovecot. > But .. eh. I guess: http://hg.dovecot.org/dovecot-2.2/rev/9feb2986945c Great. Thank you. Heiko Heiko Schlichting Freie Universit?t Berlin heiko.schlichting at fu-berlin.de Zentraleinrichtung f?r Datenverarbeitung Telefon +49 30 838-54327 Fabeckstra?e 32 Telefax +49 30 838454327 14195 Berlin From tss at iki.fi Mon Apr 8 13:44:39 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 13:44:39 +0300 Subject: [Dovecot] ssl_require_crl does not work as expected In-Reply-To: References: Message-ID: On 7.4.2013, at 14.19, dovecot.pkoch at dfgh.net wrote: > My impression is that openssl will always try to use CRLs. If > "ssl_require_crl = no" > dovecot will use CRLs but tries to ignore openssl error codes > X509_V_ERR_UNABLE_TO_GET_CRL and X509_V_ERR_CRL_HAS_EXPIRED. > > This is done in ssl_verify_client_cert() in ssl-proxy-openssl.c line 871, > namely > > if (proxy->client_proxy && !proxy->set->ssl_require_crl && > (ctx->error == X509_V_ERR_UNABLE_TO_GET_CRL || > ctx->error == X509_V_ERR_CRL_HAS_EXPIRED)) { > /* no CRL given with the CA list. don't worry about it. */ > preverify_ok = 1; > } After thinking enough about this, I kind of see what's happening: The ssl_require_crl setting wasn't intended to do what you want it to do. It was meant for Dovecot proxying code where it needs to act as an SSL client to remote server. So the setting should instead have been named ssl_require_client_crl. For server's client cert checks you should be able to simply generate an empty CRL I think? > I dont know what the proxy-stuff is about so instead of ignoring CRL-related > errors I tried to disable CRL-checking. I therefore commented out two lines > in > ssl_proxy_ctx_verify_client() in ssl-proxy-openssl.c line 1004, namely: > > // X509_STORE_set_flags(store, X509_V_FLAG_CRL_CHECK | > // X509_V_FLAG_CRL_CHECK_ALL); If you remove the "proxy->client_proxy &&" check it should work just as well, I think? > Similar code is contained in iostream-openssl-context.c, > namely in routine ssl_iostream_ctx_verify_remote_cert() Now I'm wondering why this code works as SSL client even though I'm not reading CRLs anywhere.. I guess I should spend some time looking into how exactly CRLs should work. From tss at iki.fi Mon Apr 8 13:47:36 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 13:47:36 +0300 Subject: [Dovecot] checkpassword protocol In-Reply-To: <20130408104249.GD499611@zedat.fu-berlin.de> References: <2ADFEB99-AA95-40F7-8B63-3A7B7A0A755C@iki.fi> <20130408070048.GA366941@zedat.fu-berlin.de> <7D26E8EE-FE65-4B14-832A-D62A6E7DD072@iki.fi> <20130408104249.GD499611@zedat.fu-berlin.de> Message-ID: On 8.4.2013, at 13.42, Heiko Schlichting wrote: > The checkpassword interface is used in many different ways: > > I found checkpassword the easiest way to implement authentication against > FreeRADIUS. Using a perl script with > > $input = IO::Handle->new_from_fd(3, "r"); > > and > > my $output = IO::Handle->new_from_fd(4, "w"); > > and skipping the checkpassword-reply binary. This works fine on our server > for many years now but every time when I read some related questions on the > list, it seems that a more generic, not so crude interface would be a good > idea for a future version of dovecot. For executing scripts/binaries I think checkpassword will stay the only way. Other than that, you could talk to Dovecot-auth via UNIX socket by using dict-proxy protocol with passdb/userdb dict. Although that way you'd need some way to keep your server running and it's not that easy yet to create a new Dovecot service without using libdovecot. From tss at iki.fi Mon Apr 8 13:57:38 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 13:57:38 +0300 Subject: [Dovecot] repeating dsync - questions In-Reply-To: <1365373954.21402.198.camel@hoho6.chidig.com> References: <1365176449.21402.96.camel@hoho6.chidig.com> <515F1C74.6070602@pacific.net> <8AD72A37-9764-4E71-B6C6-D54B0DD0E624@chidig.com> <515F9A52.5090806@pacific.net> <1365228541.21402.113.camel@hoho6.chidig.com> <51603D13.10806@pacific.net> <3D7EEAD5-D23D-4174-8A0D-261B3FE6B081@chidig.com> <1365343958.21402.157.camel@hoho6.chidig.com> <2160081B-1673-4466-9F00-12F58E384AB2@iki.fi> <1365369020.21402.176.camel@hoho6.chidig.com> <332CD7C7-8A3D-4FDF-BAF7-80FB49BE033E@iki.fi> <1365373954.21402.198.camel@hoho6.chidig.com> Message-ID: On 8.4.2013, at 1.32, Bob Gustafson wrote: > Ok, how is this for a scheme: > > 1) Initially rsync Maildir to destination system > 2) Do initial 'dsync backup' from Maildir to sdbox on destination system > 3) Do a 2nd rsync of new Maildir data from live system to destination > system, but don't copy the old maildir-uidlist still in the Maildir of > the live system. > rsync -ar --times --exclude=dovecot-uidlist system Maildir> > > I could also use the --ignore-existing option > > In theory, rsync would not touch the dovecot-uidlist file, would not > touch the existing message files, but would copy over the new messages > received during the time 'dsync backup' was doing its previous run. > > 4) Do a 2nd 'dsync backup' from the Maildir to the sdbox (which hasn't > changed since the 1st 'dsync backup') Without rsync --delete you may end up with duplicates if message flags had changed during it. There's also another potential problem. Since you don't now update the dovecot-uidlist, the message UIDs may change. Some clients cache messages by their UID. These clients may lose messages or show wrong messages to users. So for example if: 0. rsync + dsync is run to sdbox. dovecot-uidlist now says that next_uid=123 1. Maildir receives mail A that gets assigned UID 123 2. Maildir receives mail B that gets assigned UID 124 3. User deletes mail A 4. rsync is run, which copies the new mail B 5. dsync is run, which notices a new mail B, and assigns it the a new UID 123 6. You switch user to new Dovecot 7. dbox receives a new mail C, and gets assigned UID 124 8. User's client is now pretty much completely confused about what UIDs 123 and 124 contain. User may see different mails as subject and body. User may not even see the mail B anymore without a client cache rebuild. Yet another possibility would be to use dsync to migrate the mails using IMAP protocol rather than from Maildir directly: http://wiki2.dovecot.org/Migration/Dsync From me at junc.eu Mon Apr 8 14:18:42 2013 From: me at junc.eu (Benny Pedersen) Date: Mon, 08 Apr 2013 13:18:42 +0200 Subject: [Dovecot] dovecot 2 variables In-Reply-To: References: Message-ID: <6b9d557591cd56b3ba5c57539a14c7bf@junc.eu> On 2013-04-07 22:51, Pavel Dimow wrote: > Why does dovecot does not expand %l to local ip address? what it it does not contain an ip address ?, like "rm -f /" -- senders that put my email into body content will deliver it to my own trashcan, so if you like to get reply, dont do it From h.reindl at thelounge.net Mon Apr 8 14:39:08 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Mon, 08 Apr 2013 13:39:08 +0200 Subject: [Dovecot] dovecot 2 variables In-Reply-To: <6b9d557591cd56b3ba5c57539a14c7bf@junc.eu> References: <6b9d557591cd56b3ba5c57539a14c7bf@junc.eu> Message-ID: <5162AC5C.7090401@thelounge.net> Am 08.04.2013 13:18, schrieb Benny Pedersen: > On 2013-04-07 22:51, Pavel Dimow wrote: > >> Why does dovecot does not expand %l to local ip address? > > what it it does not contain an ip address ?, like "rm -f /" what is your f**ing problem? -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From dovecot at lists.wgwh.ch Mon Apr 8 14:56:48 2013 From: dovecot at lists.wgwh.ch (Oli Schacher) Date: Mon, 8 Apr 2013 13:56:48 +0200 Subject: [Dovecot] dsync replication: quota counted twice In-Reply-To: <38CD66EF-DFBF-4238-BB96-F10E20AB7FB7@iki.fi> References: <20130408120527.22d37a83@lists.wgwh.ch> <38CD66EF-DFBF-4238-BB96-F10E20AB7FB7@iki.fi> Message-ID: <20130408135648.0cedf25d@lists.wgwh.ch> On Mon, 8 Apr 2013 13:15:54 +0300 Timo Sirainen wrote: > There's no way to make quota work reliably that way. You need to use > different quota backends. Either two mysql databases (or tables), or > the other Dovecot could simply be using a dict file quota. > ok, thanks for the clarification. Using two different tables does the trick. I'll probably also have to disable the quota-warning scripts on one of the servers. Currently, both servers run the script when a account goes overquota -> two hate-mails in the user's Inbox. From tss at iki.fi Mon Apr 8 15:14:18 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 8 Apr 2013 15:14:18 +0300 Subject: [Dovecot] dsync replication: quota counted twice In-Reply-To: <20130408135648.0cedf25d@lists.wgwh.ch> References: <20130408120527.22d37a83@lists.wgwh.ch> <38CD66EF-DFBF-4238-BB96-F10E20AB7FB7@iki.fi> <20130408135648.0cedf25d@lists.wgwh.ch> Message-ID: <0A97621A-7BB9-4629-862B-61426ACDAA86@iki.fi> On 8.4.2013, at 14.56, Oli Schacher wrote: > On Mon, 8 Apr 2013 13:15:54 +0300 > Timo Sirainen wrote: > > >> There's no way to make quota work reliably that way. You need to use >> different quota backends. Either two mysql databases (or tables), or >> the other Dovecot could simply be using a dict file quota. >> > > ok, thanks for the clarification. Using two different tables does the > trick. I'll probably also have to disable the quota-warning > scripts on one of the servers. Currently, both servers run the script > when a account goes overquota -> two hate-mails in the user's Inbox. Ah. Hmm. This should solve it: http://hg.dovecot.org/dovecot-2.2/rev/54cdc5b6727c From asmarre at ull.edu.es Mon Apr 8 15:05:21 2013 From: asmarre at ull.edu.es (ADRIAN SANTOS MARRERO) Date: Mon, 8 Apr 2013 13:05:21 +0100 Subject: [Dovecot] "No such file or directory" error setting up dict quota for mdbox Message-ID: Hi, I've some troubles setting up the dict based quota plugin for mdbox, it always returns a error when lmtp tries to deliver an e-mail: Apr 8 12:40:16 mb07 dovecot: lmtp(3001, asmarre at ull.es): Error: fstat(/sharedfs/10.4.1.107/ull.es/54/asmarre/dovecot-quota.lock) failed: No such file or directory Apr 8 12:40:16 mb07 dovecot: lmtp(3001, asmarre at ull.es): Error: file dict commit: file_dotlock_open(/sharedfs/ 10.4.1.107/ull.es/54/asmarre/dovecot-quota) failed: No such file or directory Apr 8 12:40:16 mb07 dovecot: lmtp(3001, asmarre at ull.es): Error: dict quota: Quota update failed, it's now desynced In fact lmtp does create the dovecot-quota.lock file but it does not update the dovecot-quota file. If I run "doveadm quota recalc -u asmarre" it works and updates the dovecot-quota file. The version of dovecot that I'm using is 2.0.19 and the configuration is: # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-32-generic x86_64 Ubuntu 12.04.2 LTS mail_debug = yes mail_location = mdbox:%h mail_plugins = quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { quota = dict:User quota::file:%h/dovecot-quota quota_rule = *:storage=1G quota_warning = storage=95%% quota-warning 95 quota_warning2 = storage=85%% quota-warning 85 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at ull.es protocols = " imap lmtp sieve pop3" service lmtp { inet_listener lmtp { port = 24 } } service managesieve-login { inet_listener sieve_deprecated { port = 2000 } } service quota-warning { executable = script /opt/ccti/correo/buzones/quota_warning.sh unix_listener quota-warning { user = dovecot } user = dovecot } ssl_cert = References: <5E6DF44C-9045-4CA0-97B1-7106257599CF@iki.fi> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sun, 7 Apr 2013, Pavel Dimow wrote: > Just to be clear my goal is to have multiple domains on multiple addresses > but use one dovecot instance and to let users logging without @domain part. If %l is expanded in the LDAP query, you could add an attribute with the local IP address, e.g.: pass_filter = (&(objectClass=mailUser)(|(mail=%Lu)(&(localPart=%Lu)(localIP=%l)))) (check if parenthesis are balanced) Same with user_filter The idea: mailUserLDAPItem && ( nameWithDomain || ( nameWithoutDomain && localIP ) ) So the user could login with domain on any local port and without domain on one or more local interfaces. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUWK5PV3r2wJMiz2NAQKNMAgAovEJQY0nhBwT0E/d9tEd6wokF5XlVjpc 15vvc3zbJ9AaQVMz4LHAx1N4Secx+BP+UrJLiPPIegGAPbExA4gjI2oC31sEUcJB 8iBtRlbVHLn+pV0DnlG5FBn0KQgIyX1ml+AafcFrVOq/PcCTQzdWqO0oyLR6PN8a SGpArMTweVjMpbhiYdR1fqtc5iYEI2MefO4OjEG0Xxc2KfqzDZqUSZ1H4+ftPT9a oA59e2sc3PRjCrjpeA4UbWNC/ZEDSJFtt01mX3WZ00HVI/+gMiPZVY7NTeaCC9W4 rq0dI2J1O/zP2+yY40KtuZrSt7Kw4b61LXO8Yp/fJVpGoZzf6HvuWA== =/+hu -----END PGP SIGNATURE----- From pigi at frumar.it Mon Apr 8 16:20:08 2013 From: pigi at frumar.it (Pigi) Date: Mon, 8 Apr 2013 15:20:08 +0200 Subject: [Dovecot] Problem with fts lucene, on solaris 10 In-Reply-To: <3812A9F0-8531-4F25-974F-5A6ED087C555@iki.fi> References: <201304052159.25835.pigi@frumar.it> <201304081119.05217.pigi@frumar.it> <3812A9F0-8531-4F25-974F-5A6ED087C555@iki.fi> Message-ID: <201304081520.08190.pigi@frumar.it> On Monday 08 April 2013, Timo Sirainen wrote: > On 8.4.2013, at 12.19, Pigi wrote: > > > Program received signal SIGSEGV, Segmentation fault. > > 0xfebd65dc in _malloc_unlocked () from /lib/libc.so.1 > > (gdb) bt full > > #0 0xfebd65dc in _malloc_unlocked () from /lib/libc.so.1 > > No symbol table info available. > > #1 0xfebd66e4 in realloc () from /lib/libc.so.1 > > No symbol table info available. > > #2 0xff1d9a70 in pool_system_realloc (pool=0xff21576c, mem=0xff21576c, old_size=0, new_size=8192) at mempool-system.c:115 > > No locals. > > #3 0xff1cda28 in i_realloc (mem=0x0, old_size=0, new_size=8192) at imem.c:14 > > No locals. > > Looks to me like memory corruption, which is just about impossible to debug if you don't have valgrind or a similar tool (and I don't think Solaris has any such free tools). Yes, you're right. There aren't ( already packaged ) tool for valgrinding or similar. > Do you happen to get any other crashes where it doesn't crash in malloc code? You showed previously that it was crashing with SIGBUS somewhere. For what I can see, form dovecot.log I have a couple of error: Apr 08 12:02:18 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx Apr 08 12:02:18 imap(xxxx): Error: indexer failed to index mailbox INBOX Apr 08 12:02:18 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 27242 killed with signal 11 (core not dumped) Apr 08 12:02:19 indexer-worker(xxxx): Error: lucene index /home/xxxx/Maildir/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out Apr 08 12:03:46 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx Apr 08 12:03:46 imap(xxxx): Error: indexer failed to index mailbox INBOX Apr 08 12:03:46 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 27445 killed with signal 10 (core not dumped) Apr 08 12:06:57 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx Apr 08 12:06:57 imap(xxxx): Error: indexer failed to index mailbox INBOX Apr 08 12:06:57 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 27761 killed with signal 11 (core not dumped) Apr 08 12:08:33 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx Here a couple or more of gdb"ed" process, but tied to SEGV ( I almost suspect that when gdbing I always catch a SEGV ) : ============================================================== First gdb ============================================================== No symbol table info available. #1 0xfebd6884 in realloc () from /lib/libc.so.1 No symbol table info available. #2 0xfe83d270 in lucene::util::StringReader::init (this=0x8d328, _value=0x2bb288, _length=3958, copyData=true) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/util/Reader.cpp:48 tmp = (TCHAR *) 0x2051e0 length = 3958 #3 0xfe8837f0 in lucene::index::DocumentsWriter::ThreadState::FieldData::invertField (this=0x92df8, field=0x8d238, analyzer=0x2cb60, maxFieldLength=10000) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriterThreadState.cpp:887 stringValue = (const TCHAR *) 0x2bb288 stringValueLength = 3958 stream = (class lucene::analysis::TokenStream *) 0x0 streamValue = (class lucene::analysis::TokenStream *) 0x8d328 #4 0xfe883a58 in lucene::index::DocumentsWriter::ThreadState::FieldData::processField (this=0x92df8, analyzer=0x2cb60) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriterThreadState.cpp:798 field = (class lucene::document::Field *) 0x8d238 #5 0xfe883d6c in lucene::index::DocumentsWriter::ThreadState::processDocument (this=0x8c0a8, analyzer=0x2cb60) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/util/Array.h:90 i = 6 #6 0xfe87ea00 in lucene::index::DocumentsWriter::updateDocument (this=0x84790, doc=0x8b838, analyzer=0x2cb60, delTerm=0x0) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriter.cpp:946 state = (class lucene::index::DocumentsWriter::ThreadState *) 0x8c0a8 #7 0xfe87eb5c in lucene::index::DocumentsWriter::addDocument (this=0x84790, doc=0x8b838, analyzer=0x2cb60) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriter.cpp:930 No locals. #8 0xfe8b1ea0 in lucene::index::IndexWriter::addDocument (this=0x8cc18, doc=0x8b838, analyzer=0x2cb60) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/IndexWriter.cpp:682 No locals. #9 0xfea18e04 in lucene_index_build_flush (index=0x37ba8) at lucene-wrapper.cc:484 ret = 0 #10 0xfea18f88 in lucene_index_build_more (index=0x37ba8, uid=2995, data=0x185d18 "", size=23, hdr_name=0x8ba60 "Return-Path") at lucene-wrapper.cc:507 id = {4, 0, 0, 0, -4196824, -15011172, 534768, -4196336, 516256, 0, 11560, -20155708, 9, 10, 36, 2727408, 516256, 148, 0, 441, 148864, 534768, 3} namesize = 9216 datasize = 9216 dest = Cannot access memory at address 0xbb3 (gdb) quit ============================================================== Second gdb ============================================================== gdb) bt full #0 0xfebd6b24 in realfree () from /lib/libc.so.1 No symbol table info available. #1 0xfebd7354 in cleanfree () from /lib/libc.so.1 No symbol table info available. #2 0xfebd64ac in _malloc_unlocked () from /lib/libc.so.1 No symbol table info available. #3 0xfebd639c in malloc () from /lib/libc.so.1 No symbol table info available. #4 0xfe737b38 in operator new () from /usr/sfw/lib/libstdc++.so.6 No symbol table info available. #5 0xfe8613f4 in Document (this=0x8b838) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Document.cpp:57 No locals. #6 0xfea18fa8 in lucene_index_build_more (index=0x37ba8, uid=2995, data=0x8d7b0 "", size=23, hdr_name=0x8b9d0 "Return-Path") at lucene-wrapper.cc:511 id = {4, 0, 0, 0, -4196824, -15011172, 1605360, -4196336, 516256, 0, 11560, -20155708, 9, 10, 36, 2122656, 516256, 148, 0, 441, 148864, 1605360, 3} namesize = 9216 datasize = 9216 dest = Cannot access memory at address 0xbb3 (gdb) quit =============================================== third gdb ===================================================== (gdb) cont Continuing. Program received signal SIGSEGV, Segmentation fault. 0xfebd710c in t_splay () from /lib/libc.so.1 (gdb) bt full #0 0xfebd710c in t_splay () from /lib/libc.so.1 No symbol table info available. #1 0xfebd6eb8 in t_delete () from /lib/libc.so.1 No symbol table info available. #2 0xfebd6acc in realfree () from /lib/libc.so.1 No symbol table info available. #3 0xfebd72c8 in _free_unlocked () from /lib/libc.so.1 No symbol table info available. #4 0xfebd7204 in free () from /lib/libc.so.1 No symbol table info available. #5 0xfe862144 in lucene::document::Field::_resetValue (this=0x71e288) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Field.cpp:300 No locals. #6 0xfe862248 in ~Field (this=0x71e288) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Field.cpp:103 No locals. #7 0xfe90dcc8 in ~CLVector (this=0x23c248) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/util/Equators.h:227 itr = {_M_current = 0x71eb00} #8 0xfe860dfc in ~Document (this=0x832e0) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Document.cpp:69 No locals. #9 0xfea18e30 in lucene_index_build_flush (index=0x8adc0) at lucene-wrapper.cc:493 ret = 0 #10 0xfea18f88 in lucene_index_build_more (index=0x8adc0, uid=4128, data=0x6b2b00 "", size=23, hdr_name=0x1b6508 "Return-Path") at lucene-wrapper.cc:507 id = {4, 0, 0, 0, -4196824, -15011172, 3114656, -4196336, 584416, 0, 11560, 0, 0, 0, 36, 7697128, 584416, 845, 0, 2382, 148880, 3114656, 3} namesize = 9216 datasize = 9216 dest = Cannot access memory at address 0x1020 (gdb) Here a couple of ( probably ) interesting stuff : root # grep "signal 10" /usr/local/dovecot/var/log/dovecot.log |wc 33 284 2308 root # grep "signal 11" /usr/local/dovecot/var/log/dovecot.log |wc 69 549 4457 root # grep "Lock obtain timed out" /usr/local/dovecot/var/log/dovecot.log |wc 74 420 3976 Thus, 74 times of 102 seems to be tied to "IndexWriter() failed (#1): Lock obtain timed out" ( which I don't really understand, or at least I have not enough comprehension of code to understand). The path where lucene try to get a lock is not NFS, but is an automount on the same machine ( no NFS then ). It seems that the "Lock obtain timed out" happens every time I read a message with the MUA. This error ("Lock obtain") happens every time I read a message from my MUA, I think it's due to the indexing process running on READ imap command: Apr 08 15:18:13 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx Apr 08 15:18:13 imap(xxxx): Error: indexer failed to index mailbox INBOX Apr 08 15:18:13 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 18171 killed with signal 11 (core not dumped) Apr 08 15:18:15 indexer-worker(xxxx): Error: lucene index /home/xxxx/Maildir/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out When searching, instead, get the "Lock timeout" followed by another error: Apr 08 15:11:37 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx Apr 08 15:11:37 imap(xxxx): Error: indexer failed to index mailbox INBOX Apr 08 15:11:37 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 17438 killed with signal 10 (core not dumped) Apr 08 15:11:38 indexer-worker(xxxx): Error: lucene index /home/xxxx/Maildir/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out Apr 08 15:11:51 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx Apr 08 15:11:51 imap(xxxx): Error: indexer failed to index mailbox INBOX In both case the signal ( 11 or 10, SEGV or SIGBUS ) it's indifferent ( sometimes is 10 sometimes is 11 ). Hope I've been able to explain, as my english seems to get worst every time ;) Pigi From andreas at cymail.eu Mon Apr 8 16:21:48 2013 From: andreas at cymail.eu (Andreas K.) Date: Mon, 08 Apr 2013 16:21:48 +0300 Subject: [Dovecot] Dovecot Configuration Message-ID: <3511b008d14ce13266fba71074d05947@cymail.eu> Can somebody, please, point me in the right direction in finding a COMPLETE and EXACT definition of the Dovecot configuration hierarchy. In other words what configuration options exist both at the top level but also at each subconfiguration elements (ex. sections etc). While my C is a bit rusty, I can still make sense of source code and with a bit of effort I will figure it out. I have been going through the src/config/all-settings.c but still have large gaps. A hint in the right direction on how the config works might help clarify and speed things up. Thanks Andreas Kasenides From dovecot at lists.wgwh.ch Mon Apr 8 16:25:51 2013 From: dovecot at lists.wgwh.ch (Oli Schacher) Date: Mon, 8 Apr 2013 15:25:51 +0200 Subject: [Dovecot] dsync replication: quota counted twice In-Reply-To: <0A97621A-7BB9-4629-862B-61426ACDAA86@iki.fi> References: <20130408120527.22d37a83@lists.wgwh.ch> <38CD66EF-DFBF-4238-BB96-F10E20AB7FB7@iki.fi> <20130408135648.0cedf25d@lists.wgwh.ch> <0A97621A-7BB9-4629-862B-61426ACDAA86@iki.fi> Message-ID: <20130408152551.1f64a4f1@lists.wgwh.ch> On Mon, 8 Apr 2013 15:14:18 +0300 Timo Sirainen wrote: > > ok, thanks for the clarification. Using two different tables does > > the trick. I'll probably also have to disable the quota-warning > > scripts on one of the servers. Currently, both servers run the > > script when a account goes overquota -> two hate-mails in the > > user's Inbox. > > Ah. Hmm. This should solve it: > http://hg.dovecot.org/dovecot-2.2/rev/54cdc5b6727c > Thanks a lot..this seems to work, only server1 sends a quota warning now. maillog shows an (empty) error, but the script runs anyway: Apr 8 15:16:38 fumailsynctest1 dovecot: quota-warning: Error: close failed in file object destructor: Apr 8 15:16:38 fumailsynctest1 dovecot: quota-warning: Error: Error in sys.excepthook: Apr 8 15:16:38 fumailsynctest1 dovecot: quota-warning: Error: Apr 8 15:16:38 fumailsynctest1 dovecot: quota-warning: Error: Original exception was: From bobgus at rcn.com Mon Apr 8 18:35:47 2013 From: bobgus at rcn.com (Bob Gustafson) Date: Mon, 08 Apr 2013 10:35:47 -0500 Subject: [Dovecot] repeating dsync - questions In-Reply-To: References: <1365176449.21402.96.camel@hoho6.chidig.com> <515F1C74.6070602@pacific.net> <8AD72A37-9764-4E71-B6C6-D54B0DD0E624@chidig.com> <515F9A52.5090806@pacific.net> <1365228541.21402.113.camel@hoho6.chidig.com> <51603D13.10806@pacific.net> <3D7EEAD5-D23D-4174-8A0D-261B3FE6B081@chidig.com> <1365343958.21402.157.camel@hoho6.chidig.com> <2160081B-1673-4466-9F00-12F58E384AB2@iki.fi> <1365369020.21402.176.camel@hoho6.chidig.com> <332CD7C7-8A3D-4FDF-BAF7-80FB49BE033E@iki.fi> <1365373954.21402.198.camel@hoho6.chidig.com> Message-ID: <1365435347.21402.218.camel@hoho6.chidig.com> My need at the moment is only a *one* time deal. I just need to copy/convert all of the messages over to the new system and new (sdbox) format *once*. Then all of the clients can start from zero to build their caches based on the new mail box (not that many clients). --- I will take a look at the Imap copy process - maybe that would be simpler in the long run. No rsync needed (as long as the source system is not changed by the Imap copy process) Thanks much for your comments and suggestions Bob G On Mon, 2013-04-08 at 13:57 +0300, Timo Sirainen wrote: > On 8.4.2013, at 1.32, Bob Gustafson wrote: > > > Ok, how is this for a scheme: > > > > 1) Initially rsync Maildir to destination system > > 2) Do initial 'dsync backup' from Maildir to sdbox on destination system > > 3) Do a 2nd rsync of new Maildir data from live system to destination > > system, but don't copy the old maildir-uidlist still in the Maildir of > > the live system. > > rsync -ar --times --exclude=dovecot-uidlist > system Maildir> > > > > I could also use the --ignore-existing option > > > > In theory, rsync would not touch the dovecot-uidlist file, would not > > touch the existing message files, but would copy over the new messages > > received during the time 'dsync backup' was doing its previous run. > > > > 4) Do a 2nd 'dsync backup' from the Maildir to the sdbox (which hasn't > > changed since the 1st 'dsync backup') > > Without rsync --delete you may end up with duplicates if message flags had changed during it. > > There's also another potential problem. Since you don't now update the dovecot-uidlist, the message UIDs may change. Some clients cache messages by their UID. These clients may lose messages or show wrong messages to users. So for example if: > > 0. rsync + dsync is run to sdbox. dovecot-uidlist now says that next_uid=123 > 1. Maildir receives mail A that gets assigned UID 123 > 2. Maildir receives mail B that gets assigned UID 124 > 3. User deletes mail A > 4. rsync is run, which copies the new mail B > 5. dsync is run, which notices a new mail B, and assigns it the a new UID 123 > 6. You switch user to new Dovecot > 7. dbox receives a new mail C, and gets assigned UID 124 > 8. User's client is now pretty much completely confused about what UIDs 123 and 124 contain. User may see different mails as subject and body. User may not even see the mail B anymore without a client cache rebuild. > > Yet another possibility would be to use dsync to migrate the mails using IMAP protocol rather than from Maildir directly: http://wiki2.dovecot.org/Migration/Dsync > From skraw at ithnet.com Mon Apr 8 18:51:09 2013 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Mon, 8 Apr 2013 17:51:09 +0200 Subject: [Dovecot] How to see folders/subfolders/emails through imap Message-ID: <20130408175109.201510e1.skraw@ithnet.com> Hello all, I am trying to do something very simple - at least thats what I thought. I have some fs, it contains folders and subfolders with email files ordered like maildir. Now I try to set up dovecot on top simply to let some imap account watch these email files. But I cannot see any folders at all. I can create new folders and see them, but I cannot create subfolders as subdirs like "folder/subfolder". Instead I get "folder.subfolder" dirs on the fs. I tried to set the separator to "/", but that does not help at all. Is there some easy way to configure dovecot to display: ///new/files... /new/files... /new/files... according to fs layout on some imap-client (like thunderbird)? -- Regards, Stephan From paveldimow at gmail.com Mon Apr 8 22:27:41 2013 From: paveldimow at gmail.com (Pavel Dimow) Date: Mon, 8 Apr 2013 21:27:41 +0200 Subject: [Dovecot] dovecot 2 variables In-Reply-To: References: <5E6DF44C-9045-4CA0-97B1-7106257599CF@iki.fi> Message-ID: Interesting, but this means that we need to have one tree with all users (where each user have additional attribute containing local ip), instead we now have two separate trees because we use this for other authentication purposes. Thank you for sharing your thoughts Steffen On Mon, Apr 8, 2013 at 2:34 PM, Steffen Kaiser < skdovecot at smail.inf.fh-brs.de> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > > On Sun, 7 Apr 2013, Pavel Dimow wrote: > > Just to be clear my goal is to have multiple domains on multiple addresses >> but use one dovecot instance and to let users logging without @domain >> part. >> > > If %l is expanded in the LDAP query, you could add an attribute with the > local IP address, e.g.: > > pass_filter = (&(objectClass=mailUser)(|(**mail=%Lu)(&(localPart=%Lu)(** > localIP=%l)))) > > (check if parenthesis are balanced) Same with user_filter > > The idea: > > mailUserLDAPItem && ( nameWithDomain || ( nameWithoutDomain && localIP ) ) > > So the user could login with domain on any local port and without domain > on one or more local interfaces. > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBUWK5PV3r2wJMiz2NAQKNMA**gAovEJQY0nhBwT0E/**d9tEd6wokF5XlVjpc > 15vvc3zbJ9AaQVMz4LHAx1N4Secx+**BP+**UrJLiPPIegGAPbExA4gjI2oC31sEUc**JB > 8iBtRlbVHLn+**pV0DnlG5FBn0KQgIyX1ml+**AafcFrVOq/PcCTQzdWqO0oyLR6PN8a > SGpArMTweVjMpbhiYdR1fqtc5iYEI2**MefO4OjEG0Xxc2KfqzDZqUSZ1H4+**ftPT9a > oA59e2sc3PRjCrjpeA4UbWNC/**ZEDSJFtt01mX3WZ00HVI/+**gMiPZVY7NTeaCC9W4 > rq0dI2J1O/zP2+**yY40KtuZrSt7Kw4b61LXO8Yp/**fJVpGoZzf6HvuWA== > =/+hu > -----END PGP SIGNATURE----- > From tonio at starbridge.org Mon Apr 8 23:26:01 2013 From: tonio at starbridge.org (tonio at starbridge.org) Date: Mon, 08 Apr 2013 22:26:01 +0200 Subject: [Dovecot] crash with dovecot 2.2: Panic: Buffer full In-Reply-To: <1365368201.11047.138.camel@innu> References: <51446ACC.4060900@starbridge.org> <1363614474.10326.173.camel@innu> <6E5E2CD1-FD6F-4374-8D64-585E49128EC0@starbridge.org> <5161CD52.2070504@starbridge.org> <1365368201.11047.138.camel@innu> Message-ID: <516327D9.1040605@starbridge.org> Le 07/04/2013 22:56, Timo Sirainen a ?crit : > On Sun, 2013-04-07 at 21:47 +0200, tonio at starbridge.org wrote: >> since I've upgraded to 2.2.rc5 (c24783148d78), I've got the previous >> error again: >> It's happening on a large mailbox on almost every emails, with Horde 5 >> webmail client (works fine with thunderbird so far) >> Thanks for your help >> >> Apr 7 21:30:58 mx2 dovecot: imap(clean-quarantine at spamguard.fr): Panic: >> Buffer full (8206 > 8192, pool ) > Thanks, this should fix it: > http://hg.dovecot.org/dovecot-2.2/rev/bb25fa35d887 > > Hi Timo, It's ok for this error, but now, on a few email, I've got this: dovecot --version 2.2.rc6 (548e59794f2e) imap(clean-quarantine at spamguard.fr): Panic: file istream.c: line 153 (i_stream_read): assertion failed: (_stream->skip != _stream->pos) Apr 8 22:19:26 mx2 dovecot: imap(clean-quarantine at spamguard.fr): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x60ada) [0x7f692abe1ada] -> /usr/lib/dovecot/libdovecot.so.0(+0x60b1e) [0x7f692abe1b1e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f692aba3415] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x1b9) [0x7f692abea2a9] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7f692abea9dd] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9b624) [0x7f692aed8624] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_binary_stream+0x77) [0x7f692aed8ab7] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_binary_stream+0x60) [0x7f692aeb1640] -> /usr/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0x9f) [0x7f692af0db4f] -> dovecot/imap() [0x418f35] -> dovecot/imap() [0x4175dd] -> dovecot/imap(imap_fetch_more+0x34) [0x418534] -> dovecot/imap(cmd_fetch+0x309) [0x40e2c9] -> dovecot/imap(command_exec+0x3c) [0x41621c] -> dovecot/imap() [0x415280] -> dovecot/imap() [0x41533a] -> dovecot/imap(client_handle_input+0x115) [0x4155f5] -> dovecot/imap(client_input+0x72) [0x4159a2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f692abf14a6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7f692abf22f7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f692abf0fe8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f692aba85a3] -> dovecot/imap(main+0x270) [0x40b940] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f692a815ead] -> dovecot/imap() [0x40ba9d] Apr 8 22:19:26 mx2 dovecot: imap(clean-quarantine at spamguard.fr): Fatal: master: service(imap): child 4369 killed with signal 6 (core dumped) #0 0x00007f692a829475 in raise () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #1 0x00007f692a82c6f0 in abort () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #2 0x00007f692abe1ae8 in default_fatal_finish (type=, status=status at entry=0) at failures.c:191 backtrace = 0x62d818 "/usr/lib/dovecot/libdovecot.so.0(+0x60ada) [0x7f692abe1ada] -> /usr/lib/dovecot/libdovecot.so.0(+0x60b1e) [0x7f692abe1b1e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f692aba3415] -> /usr/lib/d"... #3 0x00007f692abe1b1e in i_internal_fatal_handler (ctx=0x7fff605d4680, format=, args=) at failures.c:652 status = 0 #4 0x00007f692aba3415 in i_panic (format=format at entry=0x7f692ac06e68 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fff605d4770, reg_save_area = 0x7fff605d46b0}} #5 0x00007f692abea2a9 in i_stream_read (stream=stream at entry=0x9fa6a0) at istream.c:153 _stream = 0x9fa640 old_size = 0 ret = -2 __FUNCTION__ = "i_stream_read" #6 0x00007f692abea9dd in i_stream_read_data (stream=stream at entry=0x9fa6a0, data_r=data_r at entry=0x7fff605d4820, size_r=size_r at entry=0x7fff605d4828, threshold=threshold at entry=0) at istream.c:479 ret = read_more = false __FUNCTION__ = "i_stream_read_data" #7 0x00007f692aed8624 in blocks_count_lines (full_input=0x9fa6a0, ctx=0x7fff605d4830) at index-mail-binary.c:319 block_idx = 5 p = size = 0 data = 0x0 ret = cur_block = 0x62d488 block_count = 7 cur_offset = 2755 skip = #8 index_mail_read_binary_to_cache (_mail=_mail at entry=0x66d630, part=part at entry=0x672190, include_hdr=include_hdr at entry=false, binary_r=binary_r at entry=0x7fff605d48e6, converted_r=converted_r at entry=0x7fff605d48e7) at index-mail-binary.c:393 mail = 0x66d630 cache = 0x657b30 ctx = {mail = 0x66d630, input = 0x685c00, has_nuls = false, converted = true, blocks = {arr = {buffer = 0x62d3d8, element_size = 24}, v = 0x62d3d8, v_modifiable = 0x62d3d8}, copy_start_offset = 113072} __FUNCTION__ = "index_mail_read_binary_to_cache" #9 0x00007f692aed8ab7 in index_mail_get_binary_stream (_mail=0x66d630, part=0x672190, include_hdr=false, size_r=0x7fff605d49a8, lines_r=, binary_r=0x7fff605d499e, stream_r=0x7fff605d4a70) at index-mail-binary.c:556 mail = 0x66d630 cache = 0x657b30 input = binary = converted = __FUNCTION__ = "index_mail_get_binary_stream" #10 0x00007f692aeb1640 in mail_get_binary_stream (mail=mail at entry=0x66d630, part=part at entry=0x672190, include_hdr=include_hdr at entry=false, size_r=size_r at entry=0x7fff605d49a8, binary_r=binary_r at entry=0x7fff605d499e, stream_r=stream_r at entry=0x7fff605d4a70) at mail.c:243 _data_stack_cur_id = 5 p = 0x66d630 ret = #11 0x00007f692af0db4f in imap_msgpart_open (mail=mail at entry=0x66d630, msgpart=0x669ac0, result_r=result_r at entry=0x7fff605d4a70) at imap-msgpart.c:645 part = 0x672190 part_size = {physical_size = 6681936, virtual_size = 0, lines = 6685256} size = include_hdr = false binary = use_partial_cache = ret = 0 #12 0x0000000000418f35 in fetch_body_msgpart (ctx=0x660248, mail=0x66d630, body=0x660888) at imap-fetch-body.c:164 result = {input = 0x0, size = 0, size_field = 0, binary_decoded_input_has_nuls = false} str = #13 0x00000000004175dd in imap_fetch_more_int (ctx=ctx at entry=0x660248, cancel=false) at imap-fetch.c:504 h = _data_stack_cur_id = 4 state = 0x660298 client = 0x65f550 handlers = 0x660578 count = 2 ret = __FUNCTION__ = "imap_fetch_more_int" #14 0x0000000000418534 in imap_fetch_more (ctx=0x660248, cmd=cmd at entry=0x660130) at imap-fetch.c:556 ret = __FUNCTION__ = "imap_fetch_more" #15 0x000000000040e2c9 in cmd_fetch (cmd=0x660130) at cmd-fetch.c:279 client = 0x65f550 ctx = 0x660248 args = 0x638a08 next_arg = list_arg = 0x2ab7ce60 search_args = 0x0 qresync_args = {qresync_sample_seqset = 0x638b68, qresync_sample_uidset = 0x0} messageset = 0x638b70 "1332738" send_vanished = ret = #16 0x000000000041621c in command_exec (cmd=cmd at entry=0x660130) at imap-commands.c:156 hook = 0x636d60 ret = #17 0x0000000000415280 in client_command_input (cmd=0x660130) at imap-client.c:775 client = 0x65f550 command = __FUNCTION__ = "client_command_input" #18 0x000000000041533a in client_command_input (cmd=0x660130) at imap-client.c:836 client = 0x65f550 command = __FUNCTION__ = "client_command_input" #19 0x00000000004155f5 in client_handle_next_command (remove_io_r=, client=0x65f550) at imap-client.c:874 No locals. #20 client_handle_input (client=client at entry=0x65f550) at imap-client.c:886 _data_stack_cur_id = 3 ret = false remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #21 0x00000000004159a2 in client_input (client=0x65f550) at imap-client.c:928 cmd = output = 0x65ff48 bytes = 37 __FUNCTION__ = "client_input" #22 0x00007f692abf14a6 in io_loop_call_io (io=0x660030) at ioloop.c:387 ioloop = 0x635700 t_id = 2 #23 0x00007f692abf22f7 in io_loop_handler_run (ioloop=ioloop at entry=0x635700) at ioloop-epoll.c:215 ctx = 0x635a70 events = 0x0 event = 0x635ae0 list = 0x660080 io = tv = {tv_sec = 1799, tv_usec = 999140} events_count = msecs = ret = 1 i = call = __FUNCTION__ = "io_loop_handler_run" #24 0x00007f692abf0fe8 in io_loop_run (ioloop=0x635700) at ioloop.c:406 No locals. #25 0x00007f692aba85a3 in master_service_run (service=0x635590, callback=callback at entry=0x41e770 ) at master-service.c:560 No locals. #26 0x000000000040b940 in main (argc=1, argv=0x635390) at main.c:400 set_roots = {0x425a20, 0x0} login_set = {auth_socket_path = 0x62d040 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x41e5e0 , failure_callback = 0x41e710 , request_auth_token = 1} service_flags = storage_service_flags = username = 0x0 c = From mazze at the-lions.org Mon Apr 8 22:39:26 2013 From: mazze at the-lions.org (Matthias Hofer) Date: Mon, 8 Apr 2013 21:39:26 +0200 Subject: [Dovecot] LMTP Setup/Design Help Request Message-ID: Hi altogether, I am switching from dbmail 2.2 to dovecot 2.1.7, and I was able to do a successful transition of IMAP. But I had a very hard time with receiving mail, and in the end -- after loads of reading and debugging -- I broke down and failed. This is why I am asking you for your kind help. I only have virtual users and have set mail_uid = dovemail mail_gid = dovemail For authentication, I simply use (for now) a flat file: passdb { driver = passwd-file args = scheme=PLAIN username_format=%u /etc/dovecot/mypasswd.file } # cat /etc/dovecot/mypasswd.file user1:{PLAIN}userpw1 user2:{PLAIN}userpw2 user3:{PLAIN}userpw3 And everything works fine with IMAP. I am completely domain-agnostic here. But I was not able to use this fine setup to receive mails with my postfix. I tried about 13 different configurations, some with considerable changes dovecot-config, the passwd-file or postfix, but I could not find a single variant working. In this situation, I would be very happy if somebody could give me a hint, which would be the prudent way to configure dovecot, LDA/LMTP and postfix based on the setup above. Thank you very much in advance, and have a great time, Matthias Hofer From bobgus at rcn.com Mon Apr 8 23:48:02 2013 From: bobgus at rcn.com (Bob Gustafson) Date: Mon, 08 Apr 2013 15:48:02 -0500 Subject: [Dovecot] repeating dsync - questions In-Reply-To: <332CD7C7-8A3D-4FDF-BAF7-80FB49BE033E@iki.fi> References: <1365176449.21402.96.camel@hoho6.chidig.com> <515F1C74.6070602@pacific.net> <8AD72A37-9764-4E71-B6C6-D54B0DD0E624@chidig.com> <515F9A52.5090806@pacific.net> <1365228541.21402.113.camel@hoho6.chidig.com> <51603D13.10806@pacific.net> <3D7EEAD5-D23D-4174-8A0D-261B3FE6B081@chidig.com> <1365343958.21402.157.camel@hoho6.chidig.com> <2160081B-1673-4466-9F00-12F58E384AB2@iki.fi> <1365369020.21402.176.camel@hoho6.chidig.com> <332CD7C7-8A3D-4FDF-BAF7-80FB49BE033E@iki.fi> Message-ID: <1365454082.21402.251.camel@hoho6.chidig.com> OK, success: see timings (real nn) below commands. Initial copy of Maildir from live system to test sys (14G of data) rsync -ar --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir real 37m Then 1st 'dsync -R backup maildir:~/Maildir' real 828m Then 2nd rsync to pick up new mail - **don't touch existing files** rsync -ar --times --ignore-existing hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir real 3m Then 2nd 'dsync -R backup maildir:~/Maildir' real 12m The --ignore-existing option on the 2nd rsync allows dsync to process the additional emails in a reasonable amount of time. The dovecot-uidlist which is modified in the Maildir by dsync is not written over by the 2nd rsync and therefore the 2nd dsync just processes the added messages. (There were no deletes between rsync runs) Thanks much for your hints and comments. Bob G On Mon, 2013-04-08 at 00:53 +0300, Timo Sirainen wrote: > On 8.4.2013, at 0.10, Bob Gustafson wrote: > > >>> I am still on my quest for a quick way to move mail from a live Maildir > >>> system to a 'soon to be live' sdbox system. > >>> > >>> I copy Maildir to new system using: > >>> rsync -ar --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir > >>> > >>> Then I convert from Maildir to sdbox with: > >>> dsync mirror maildir:~/Maildir > >>> > >>> Then I copy more messages from live system using rsync > >> > >> ^^ that is the mistake > > > > I guess I have a basic misunderstanding of what 'dsync mirror' is doing. > > > > My understanding is that going from Maildir to sdbox, dsync does not > > mess with the data in Maildir. The Maildir metadata is in one form and > > the sdbox metadata is in another form (in the sdbox directory). > > dsync does mess with metadata in the maildir. also with dsync mirror (as opposed to dsync backup) it can also modify the contents. The main problem here is: > > 1. dsync sees that a folder A in maildir doesn't have a GUID (because dsync is just about the only tool that uses it right now), and assigns the mailbox a new GUID > 2. dsync syncs the mailbox to sdbox with that GUID > 3. rsync comes and wipes out the maildir-uidlist that contained the GUID > 4. second dsync sees that folder A in maildir doesn't have a GUID, and assigns a new GUID to it > - now maildir has folder A with GUID 1, and sdbox has folder A with GUID 2 > - dsync thinks they are two different folders, and duplicates them as A and A_2. the A_2 gets also copied back to maildir, because you're using dsync mirror. This is why the second dsync is slow, it's actually doing all the work again, and actually doing twice the work since it's copying the mails from sdbox to maildir as well. > > v2.2 dsync is somewhat smarter and can figure out that they are actually the same folder A and it simply changes the other's GUID instead of duplicating all data. > > > No new email messages enter the sdbox system to be 'mirrored' to the > > Maildir system. > > > > I thought of using the 'dsync backup' command, but the sentence "Any > > changes done in destination are discarded." seems to indicate that each > > time 'dsync backup' is done, it starts from the beginning. No > > incremental backup (but this is done in 2.2 ?) > > dsync backup is incremental. it just wipes out any changes done at the other side (if there happens to be any). > > >>> Then I do the 'dsync mirror maildir:~/Maildir' again > >>> > >>> There were only a few messages that were copied over in the 2nd rsync > >>> pass and it went quickly, but the 2nd dsync pass is taking a long time. > >> > >> The second rsync is overwriting all the metadata changes (mailbox GUIDs > >> most importantly) that the first dsync run did. > > > > Why does dsync mess with the Maildir metadata? Won't that just confuse > > the dovecot running on the Maildir system? > > Incremental dsync doesn't work (well) without additional metadata. From andreas at cymail.eu Tue Apr 9 00:46:37 2013 From: andreas at cymail.eu (Andreas K.) Date: Tue, 09 Apr 2013 00:46:37 +0300 Subject: [Dovecot] LMTP Setup/Design Help Request In-Reply-To: References: Message-ID: On 08-04-2013 22:39, Matthias Hofer wrote: > Hi altogether, > > I am switching from dbmail 2.2 to dovecot 2.1.7, and I was able to do > a successful transition of IMAP. But I > had a very hard time with receiving mail, and in the end -- after > loads of reading and debugging -- I broke > down and failed. This is why I am asking you for your kind help. > > I only have virtual users and have set > > mail_uid = dovemail > mail_gid = dovemail > > For authentication, I simply use (for now) a flat file: > > passdb { > driver = passwd-file > args = scheme=PLAIN username_format=%u /etc/dovecot/mypasswd.file > } > > # cat /etc/dovecot/mypasswd.file > user1:{PLAIN}userpw1 > user2:{PLAIN}userpw2 > user3:{PLAIN}userpw3 > > And everything works fine with IMAP. I am completely domain-agnostic > here. > But I was not able to use this fine setup to receive mails with my > postfix. I tried about 13 different > configurations, some with considerable changes dovecot-config, the > passwd-file or postfix, but I could not > find a single variant working. > > In this situation, I would be very happy if somebody could give me a > hint, which would be the prudent way to > configure dovecot, LDA/LMTP and postfix based on the setup above. > > Thank you very much in advance, and have a great time, > > Matthias Hofer I suppose your postfix is in working state. Note that you do not need dovecot to deliver mail with postfix. But it is a good idea. To deliver using dovecot-lda my postfix main.cf contains mail_spool_directory = /Mail/ mailbox_command = /usr/local/libexec/dovecot/dovecot-lda -f "$SENDER" -a "$RECIPIENT" From stephan at rename-it.nl Tue Apr 9 01:05:17 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 09 Apr 2013 00:05:17 +0200 Subject: [Dovecot] make check error for Pigeonhole v0.3.4 for Dovecot v2.1.16 In-Reply-To: <51630997.50504@choon.net> References: <51608BB5.4010209@rename-it.nl> <51630997.50504@choon.net> Message-ID: <51633F1D.6070305@rename-it.nl> On 4/8/2013 8:16 PM, Giam Teck Choon wrote: > Hi, > > When I compile Pigeonhole v0.3.4 with Dovecot v2.1.16 until make check > output as below from my rpmbuild output: > > Test case: ./tests/extensions/mailbox/execute.svtest: > 1: Test 'MailboxExists - None exist' SUCCEEDED > 2: Test 'MailboxExists - Not all exist' SUCCEEDED > 3: Test 'MailboxExists - One exists' SUCCEEDED > 4: Test 'MailboxExists - All exist' SUCCEEDED > 5: Test ':Create' SUCCEEDED > PASS: 5 tests succeeded. > Test case: ./tests/extensions/date/basic.svtest: > 1: Test 'Defaults' SUCCEEDED > 2: Test 'Count' SUCCEEDED > 3: Test 'Invalid' SUCCEEDED > 4: Test 'Comparison' FAILED: date is invalid: 2009-07-23 > FAIL: 1 of 4 tests failed. > RPM build errors: > make: *** [tests/extensions/date/basic.svtest] Error 1 > error: Bad exit status from /var/tmp/rpm-tmp.CIcpqx (%check) > Bad exit status from /var/tmp/rpm-tmp.CIcpqx (%check) You're not the first one to notice: http://hg.rename-it.nl/dovecot-2.1-pigeonhole/rev/bc2126771d00 This is one of those genuine phase-of-the-moon kind of bugs :) Hmm, maybe I should make a new release for this problem already. Regards, Stephan. From msmith at giganews.com Tue Apr 9 01:41:59 2013 From: msmith at giganews.com (Michael Smith) Date: Mon, 8 Apr 2013 22:41:59 +0000 Subject: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot In-Reply-To: <62CA7D02-69DA-47C4-9CE7-4A8D9518670F@iki.fi> References: <62CA7D02-69DA-47C4-9CE7-4A8D9518670F@iki.fi> Message-ID: Timo, I tried importing the anonymized file, and there were no errors. So, it's something with the actual data. UTF-8 issues? While I can't send you a raw customer's mailbox, one of the failures is a 'role' account mailbox, with no critical/useful data in it. Here is a link (expires in 30 days) to download the mailbox, it's 107M. https://truck.it/p/HNlzl9hWbO The error I'm getting is dsync(webmail): Error: Sync failed for mbox file /var/opt/migrate/users/webmail/inbox: seq=4482 uid=4482 uid_broken=0 originally needed 10 bytes, now needs 12 bytes The seq and uid are different, depending on the mailbox being migrated. Some of the problem mailboxes only report a single failure, and some report multiple failures (where the seq/uid are different for each failure). For a given mailbox, the seq and uid reported seem to always be consistent. I create a directory called migrate, copy the file in there and name it inbox The command I'm using is Dsync -u webmail mirror mbox:migrate/ Here's my 2.2.rc3 doveconf -n output # 2.2.rc3: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.19.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) auth_debug = yes auth_debug_passwords = yes auth_default_realm = auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot-debug.log disable_plaintext_auth = no dotlock_use_excl = no lda_mailbox_autocreate = yes lock_method = dotlock log_path = /var/log/dovecot.log mail_access_groups = mail mail_debug = yes mail_fsync = always mail_location = mdbox:~/mail:INDEX=~/index mail_plugins = quota zlib mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_read_locks = dotlock mbox_write_locks = dotlock mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 20 M mmap_disable = yes passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autocreate = Trash autocreate2 = Junk autocreate3 = Drafts autocreate4 = Sent autocreate5 = INBOX autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Drafts autosubscribe4 = Sent autosubscribe5 = INBOX mail_max_userip_connections = 10 managesieve_max_line_length = 65536 quota = dict:User quota::file:%h/dovecot.quota quota2_rule = Trash:storage=+10%% quota3_rule = Junk:storage=+20%% quota_rule = *:storage=100M:messages=100000 recipient_delimiter = + sieve_before = /var/spool/mail/global.sieve/ zlib_save = gz zlib_save_level = 9 } pop3_reuse_xuidl = yes protocols = imap pop3 sieve lmtp service auth { inet_listener auth { port = 113 } unix_listener auth-userdb { user = nobody } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 service_count = 1 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } ssl = no ssl_cert = wrote: > I am trying to 'dsync mirror' old Qpopper/mbox inboxes to our new Dovecot/mdbox servers. For most of the several thousand accounts, it works without issue. But there are a handful of accounts that are generating the following errors. > > dsync(joe): Error: Sync failed for mbox file /var/opt/migrate/users/joe/inbox: seq=981 uid=981 uid_broken=0 originally needed 9 bytes, now needs 11 bytes > > dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=115028 uid=115028 uid_broken=0 originally needed 34 bytes, now needs 35 bytes These are some generic mbox bugs. I think the error goes away if you just repeat the run? > dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=114779 uid=114779 uid_broken=0 originally needed 34 bytes, now needs 35 bytes > dsync(john): Error: Sync failed for mbox file /var/opt/migrate/users/john/inbox: seq=114778 uid=114778 uid_broken=0 originally needed 34 bytes, now needs 35 bytes .. or are these all separate dsync runs giving different errors? Anyway, if you can send me an mbox file where I can reproduce this, I could fix it. You can use http://dovecot.org/tools/mbox-anonymize.pl script to replace all the actual data in the mbox file with 'x' chars. From chibi at gol.com Tue Apr 9 06:56:11 2013 From: chibi at gol.com (Christian Balzer) Date: Tue, 9 Apr 2013 12:56:11 +0900 Subject: [Dovecot] Proxying, pertinent values and features, SNI In-Reply-To: References: <20130403165922.33300812@batzmaru.gol.ad.jp> Message-ID: <20130409125611.1b3b0731@batzmaru.gol.ad.jp> On Thu, 4 Apr 2013 22:21:43 +0300 Timo Sirainen wrote: > On 3.4.2013, at 10.59, Christian Balzer wrote: > > > I'm looking into deploying dovecot as a proxy, currently using > > perdition. Have been using dovecot on the actual servers for years, > > nearly a decade. So far just 1.x, but for the proxy it will have to be > > 2.x (2.1.7 is the current Debian version), as the trigger for this > > change is the need to support multiple SSL certificates. > > > > All that happens on the proxy seems to be handled by the login > > processes, so that is why we're not seeing anything useful in the > > process titles or with doveadm, right? > > And from past comments by Timo I guess that adding such functionality > > isn't on his to-do list at all. > > doveadm proxy list > That will teach me to look at man pages. ^o^ Internal help all the way, man pages are for chums. ^o^ Thanks! > > A configurable capabilities string for POP would be quite welcome, but > > at least nothing is different between the 1.x backends and the 2.x > > proxy in that protocol. > > v2.2 backends actually add some new POP3 capabilities. I guess there > could be such a setting, although it's a bit annoying to develop.. > I guess so, but that will really make it an universally deployable proxy and help people transitioning to dovecot from other environments, too. [snip] > > > I presume to best support all(?) clients out there is to have > > "local_name" sections for SNI first and then "local" sections for IP > > address based certs. It is my understanding that SNI needs to be > > requested by the client, so aside from client bugs (nah, those don't > > exist ^o^) every client should get an appropriate response for TLS. > > Has anybody done a setup like that already? > > If you have separate IPs for each sertificate, you don't need to > support/configure SNI, so local {} blocks are enough. > I know that, the idea was/is to determine how many (connects and clients) do a proper TLS/SNI negotiation if offered. However are these even differently logged by dovecot? I suspect not. Regards, Christian -- Christian Balzer Network/Systems Engineer chibi at gol.com Global OnLine Japan/Fusion Communications http://www.gol.com/ From jg at softjury.de Tue Apr 9 11:00:39 2013 From: jg at softjury.de (Jan Phillip Greimann) Date: Tue, 09 Apr 2013 10:00:39 +0200 Subject: [Dovecot] LMTP Setup/Design Help Request In-Reply-To: References: Message-ID: <5163CAA7.3060609@softjury.de> (forgot to send to list) Hi Matthias, Here a litte bit of code snipplets how I configured dovecot authentication via relay domains. No user-handling in postfix exept relay domains and virtual alias map, user-handling over dovecot SASL/LMTP. This is no complete configuration, no warranty that this works for you! Greetings, Jan ------------------------------------------------------------ # /etc/dovecot/conf.d/10-master.conf # service auth { unix_listener auth-userdb { mode = 0600 user = dovemail group = dovemail } unix_listener /var/spool/postfix/private/auth { mode = 0660 # Assuming the default Postfix user and group user = postfix group = postfix } ### Also possible: # inet_listener { # port = 12345 # } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { mode = 0660 user = postfix group = postfix } ### Also possible: # inet_listener lmtp { # address = 192.168.0.123 127.0.0.1 ::1 # port = 24 # } } ------------------------------------------------------------ # /etc/postfix/lmtp_domains yourdomain.invalid lmtp:unix:private/dovecot-lmtp ------------------------------------------------------------ # /etc/postfix/main.cf transport_maps = btree:/etc/postfix/lmtp_domains,[...] relay_domains = btree:/etc/postfix/lmtp_domains,[...] unverified_recipient_reject_code = 577 smtpd_sasl_type = dovecot smtpd_sasl_path = private/auth smtpd_recipient_restrictions = # no dirty mails reject_non_fqdn_sender, reject_non_fqdn_recipient, reject_unknown_sender_domain, reject_unknown_recipient_domain, # Authorized mailers permit_sasl_authenticated, permit_mynetworks, # Policyd-Weight check_policy_service inet:127.0.0.1:12525, # Dynamic check of relay-recipients reject_unverified_recipient, # permit_mx_backup, reject_unauth_destination, permit ------------------------------------------------------------ From Lutz.Pressler at SerNet.DE Tue Apr 9 11:02:15 2013 From: Lutz.Pressler at SerNet.DE (Lutz =?iso-8859-1?Q?Pre=DFler?=) Date: Tue, 9 Apr 2013 10:02:15 +0200 Subject: [Dovecot] 2.2.0rc6: crash with mailbox_list_index=yes (and virtual?) Message-ID: Hello (Timo), depending on the client (with OfflineIMAP, but not a mobile one) my dovecot test configuration (config on request) crashes if mailbox_list_index=yes: Apr 9 09:26:31 host dovecot: imap-login: Login: user=, method=CRAM-MD5, rip=2001:xxxx:xxxx:xxxx:xxxx:xxxx:xxxx:xxxx, lip=2001:xxxx:xxxx:xxxx:xxxx:xxxx:xxxx:xxxx, mpid=19028, TLS, session= Apr 9 09:26:31 host dovecot: imap(19028, user) /+vqeOjZ1wAgAQY4BgPRMwIMKf/+amcv: Panic: file mail-index-view.c: line 169 (view_lookup_full): assertion failed: (seq > 0 && seq <= mail_index_view_get_messages_count(view)) Apr 9 09:26:31 host dovecot: imap(19028, lpmailext) /+vqeOjZ1wAgAQY4BgPRMwIMKf/+amcv: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x61 75a) [0x7fca0248c75a] -> /usr/lib/dovecot/libdovecot.so.0(+0x617a6) [0x7fca0248c7a6] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7fca0244d3cf] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xc9b5e) [0x7fca027adb5e] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xca238) [0x7fca027ae238] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_lookup_ext+0x17) [0x7fca027ad2b7] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_status+0x11f) [0x7fca0277559f] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_status_set_info_flags+0x8d) [0x7fca0277606d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_iter_next+0x18d) [0x7fca0277383d] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x93177) [0x7fca02777177] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_iter_next+0x255) [0x7fca02777465] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x94881) [0x7fca02778881] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x93177) [0x7fca02777177] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_iter_next+0x3c0)[0x7fca027775d0] -> /usr/lib/dovecot/modules/lib20_virtual_plugin.so(virtual_config_read+0x97d) [0x7fca0065344d] -> /usr/lib/dovecot/modules/lib20_virtual_plugin.so(+0x93c5) [0x7fca006553c5] -> /usr/lib/dovecot/modules/lib20_zlib_plugin.so(+0x2a8c) [0x7fca00447a8c] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x7dd94) [0x7fca02761d94] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0xf) [0x7fca02761f4f] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mailbox_get_metadata+0x5da) [0x7fca0278a41a] -> /usr/lib/dovecot/modules/lib20_virtual_plugin.so(+0x8d48) [0x7fca00654d48] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x91f05) [0x7fca02775f05] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_get_metadata+0x6e) [0x7fca02761b6e] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync_name+0x2e6) [0x7fca02776b66] Apr 9 09:26:31 host dovecot: imap(19028, user) /+vqeOjZ1wAgAQY4BgPRMwIMKf/+amcv: Fatal: master: service(imap): child 19028 killed with signal 6 (core dumped) gdb bt full attached. Haven't tested yet if disabling virtual namespaces makes a difference. Neither logged triggering IMAP commands. Regards, Lutz -------------- next part -------------- GNU gdb (GDB) 7.0.1-debian Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /usr/lib/dovecot/imap...Reading symbols from /usr/lib/debug/usr/lib/dovecot/imap...done. (no debugging symbols found)...done. Reading symbols from /usr/lib/dovecot/libdovecot-storage.so.0...Reading symbols from /usr/lib/debug/usr/lib/dovecot/libdovecot-storage.so.0.0.0...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /usr/lib/dovecot/libdovecot.so.0...Reading symbols from /usr/lib/debug/usr/lib/dovecot/libdovecot.so.0.0.0...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/libdovecot.so.0 Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /lib/librt.so.1...(no debugging symbols found)...done. Loaded symbols for /lib/librt.so.1 Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done. Loaded symbols for /lib/libdl.so.2 Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /lib/libpthread.so.0...(no debugging symbols found)...done. Loaded symbols for /lib/libpthread.so.0 Reading symbols from /usr/lib/dovecot/modules/lib01_acl_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib01_acl_plugin.so...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/modules/lib01_acl_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib02_imap_acl_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib02_imap_acl_plugin.so...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/modules/lib02_imap_acl_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib10_quota_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib10_quota_plugin.so...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/modules/lib10_quota_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib11_imap_quota_plugin.so...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib15_notify_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib15_notify_plugin.so...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/modules/lib15_notify_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib20_fts_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib20_fts_plugin.so...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/modules/lib20_fts_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib20_listescape_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib20_listescape_plugin.so...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/modules/lib20_listescape_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib20_mail_log_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib20_mail_log_plugin.so...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/modules/lib20_mail_log_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib20_mailbox_alias_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib20_mailbox_alias_plugin.so...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/modules/lib20_mailbox_alias_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib20_virtual_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib20_virtual_plugin.so...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/modules/lib20_virtual_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib20_zlib_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib20_zlib_plugin.so...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/modules/lib20_zlib_plugin.so Reading symbols from /usr/lib/libz.so.1...(no debugging symbols found)...done. Loaded symbols for /usr/lib/libz.so.1 Reading symbols from /lib/libbz2.so.1.0...(no debugging symbols found)...done. Loaded symbols for /lib/libbz2.so.1.0 Reading symbols from /usr/lib/dovecot/modules/lib21_fts_lucene_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib21_fts_lucene_plugin.so...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/modules/lib21_fts_lucene_plugin.so Reading symbols from /usr/lib/libstemmer.so.0d...(no debugging symbols found)...done. Loaded symbols for /usr/lib/libstemmer.so.0d Reading symbols from /usr/lib/libstdc++.so.6...(no debugging symbols found)...done. Loaded symbols for /usr/lib/libstdc++.so.6 Reading symbols from /lib/libm.so.6...(no debugging symbols found)...done. Loaded symbols for /lib/libm.so.6 Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols found)...done. Loaded symbols for /lib/libgcc_s.so.1 Reading symbols from /usr/lib/dovecot/modules/lib30_imap_zlib_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib30_imap_zlib_plugin.so...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/modules/lib30_imap_zlib_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib90_stats_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib90_stats_plugin.so...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/modules/lib90_stats_plugin.so Reading symbols from /usr/lib/dovecot/modules/lib95_imap_stats_plugin.so...Reading symbols from /usr/lib/debug/usr/lib/dovecot/modules/lib95_imap_stats_plugin.so...done. (no debugging symbols found)...done. Loaded symbols for /usr/lib/dovecot/modules/lib95_imap_stats_plugin.so Reading symbols from /lib/libnss_compat.so.2...(no debugging symbols found)...done. Loaded symbols for /lib/libnss_compat.so.2 Reading symbols from /lib/libnsl.so.1...(no debugging symbols found)...done. Loaded symbols for /lib/libnsl.so.1 Reading symbols from /lib/libnss_nis.so.2...(no debugging symbols found)...done. Loaded symbols for /lib/libnss_nis.so.2 Reading symbols from /lib/libnss_files.so.2...(no debugging symbols found)...done. Loaded symbols for /lib/libnss_files.so.2 Core was generated by `dovecot/imap [user'. Program terminated with signal 6, Aborted. #0 0x00007fca020fb1b5 in raise () from /lib/libc.so.6 (gdb) bt full #0 0x00007fca020fb1b5 in raise () from /lib/libc.so.6 No symbol table info available. #1 0x00007fca020fdfc0 in abort () from /lib/libc.so.6 No symbol table info available. #2 0x00007fca0248c76d in default_fatal_finish (type=, status=0) at failures.c:191 backtrace = 0x158dfc0 "/usr/lib/dovecot/libdovecot.so.0(+0x6175a) [0x7fca0248c75a] -> /usr/lib/dovecot/libdovecot.so.0(+0x617a6) [0x7fca0248c7a6] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7fca0244d3cf] -> /usr/lib/d"... #3 0x00007fca0248c7a6 in i_internal_fatal_handler (ctx=0x7fffbea0aac0, format=, args=) at failures.c:652 status = 0 #4 0x00007fca0244d3cf in i_panic (format=0x4a54
) at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffbea0ab90, reg_save_area = 0x7fffbea0aad0}} #5 0x00007fca027adb5e in view_lookup_full (view=0x15def10, seq=0, map_r=0x7fffbea0abf8, expunged_r=0x7fffbea0ac3f) at mail-index-view.c:169 broken_rec = {uid = 0, flags = 0 '\000'} rec = head_rec = __FUNCTION__ = "view_lookup_full" #6 0x00007fca027ae238 in view_lookup_ext_full (view=0x4a54, seq=19028, ext_id=4, map_r=0x7fffbea0abf8, data_r=0x0, expunged_r=0x7fca024bcb1f) at mail-index-view.c:370 rec = #7 0x00007fca027ad2b7 in mail_index_lookup_ext (view=0x4a54, seq=19028, ext_id=6, data_r=0x0, expunged_r=) at mail-index-view.c:538 map = 0x0 #8 0x00007fca0277559f in mailbox_list_index_status (list=, view=, seq=, items=STATUS_RECENT, status_r=0x7fffbea0ac80, mailbox_guid=0x0) at mailbox-list-index-status.c:100 rec = ilist = 0x15bc830 data = 0x0 expunged = false ret = true #9 0x00007fca0277606d in mailbox_list_index_status_set_info_flags (box=0x15e3410, uid=1, flags=0x15e07c0) at mailbox-list-index-status.c:514 view = 0x15def10 status = {messages = 22932736, recent = 0, unseen = 41297105, uidvalidity = 32714, uidnext = 22792240, first_unseen_seq = 0, first_recent_uid = 22792704, last_cached_seq = 0, highest_modseq = 22790640, highest_pvt_modseq = 22601552, keywords = 0x15c7500, permanent_flags = 22939472, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, have_guids = 0} seq = 0 ret = 1 #10 0x00007fca0277383d in mailbox_list_index_update_info (_ctx=0x15e0750) at mailbox-list-index-iter.c:100 box = 0x15e3410 #11 mailbox_list_index_iter_next (_ctx=0x15e0750) at mailbox-list-index-iter.c:163 match = #12 0x00007fca02777177 in mailbox_list_iter_next_call (ctx=0x4a54) at mailbox-list-iter.c:935 info = set = #13 0x00007fca02777465 in autocreate_iter_next (ctx=0x15e0750) at mailbox-list-iter.c:963 info = autoboxes = 0x158de90 autobox = 0x7fffbea0adfc #14 mailbox_list_iter_next (ctx=0x15e0750) at mailbox-list-iter.c:1004 _data_stack_cur_id = 9 info = 0x0 #15 0x00007fca02778881 in mailbox_list_ns_iter_try_next (_ctx=0x15de8f0) at mailbox-list-iter.c:577 errstr = error = 32767 #16 mailbox_list_ns_iter_next (_ctx=0x15de8f0) at mailbox-list-iter.c:639 info = 0x0 #17 0x00007fca02777177 in mailbox_list_iter_next_call (ctx=0x4a54) at mailbox-list-iter.c:935 info = set = #18 0x00007fca027775d0 in mailbox_list_iter_next (ctx=0x15de8f0) at mailbox-list-iter.c:1006 _data_stack_cur_id = 8 info = 0x0 #19 0x00007fca0065344d in virtual_config_expand_wildcards (mbox=0x15da630) at virtual-config.c:322 iter = 0x15de8f0 wboxes = 0x158dd88 j = 0 user = 0x7fffbea0b000 wildcard_boxes = {arr = {buffer = 0x158dd50, element_size = 8}, v = 0x158dd50, v_modifiable = 0x158dd50} info = 0x15e15e0 count = 1 neg_boxes = {arr = {buffer = 0x158ddb8, element_size = 8}, v = 0x158ddb8, v_modifiable = 0x158ddb8} i = 0 #20 virtual_config_read (mbox=0x15da630) at virtual-config.c:423 storage = 0x15bca00 ctx = {mbox = 0x15da630, input = 0x15dc760, pool = 0x15da610, rule = 0x158dbe8, rule_idx = 3, sep = 46 '.', have_wildcards = true, have_mailbox_defines = true} st = {st_dev = 0, st_ino = 0, st_nlink = 0, st_mode = 34864012, st_uid = 32714, st_gid = 3198201888, __pad0 = 32767, st_rdev = 140505598481637, st_size = 22793744, st_blksize = 140505585916452, st_blocks = 2311, st_atim = {tv_sec = 36758124, tv_nsec = 1}, st_mtim = {tv_sec = 4294967329204, tv_nsec = 1000}, st_ctim = {tv_sec = 0, tv_nsec = 17}, __unused = {4096, 8, 1365491055}} box_path = path = 0x158db98 "/home/lpressl/Maildir/virtual/.week/dovecot-virtual" line = error = 0x0 linenum = fd = 17 ret = #21 0x00007fca006553c5 in virtual_mailbox_open (box=0x15da630) at virtual-storage.c:288 ret = #22 0x00007fca00447a8c in zlib_mailbox_open (box=0x15da630) at zlib-plugin.c:265 No locals. #23 0x00007fca02761d94 in mailbox_open_full (box=0x15da630, input=) at mail-storage.c:1018 _data_stack_cur_id = 0 ret = #24 0x00007fca02761f4f in mailbox_open (box=0x4a54) at mail-storage.c:1060 No locals. #25 0x00007fca0278a41a in index_mailbox_get_metadata (box=0x4a54, items=MAILBOX_METADATA_GUID, metadata_r=0x6) at index-status.c:372 No locals. #26 0x00007fca00654d48 in virtual_mailbox_get_metadata (box=0x4a54, items=19028, metadata_r=0x6) at virtual-storage.c:376 No locals. #27 0x00007fca02775f05 in index_list_get_metadata (box=0x15da630, items=MAILBOX_METADATA_GUID, metadata_r=0x7fffbea0b4b0) at mailbox-list-index-status.c:202 No locals. #28 0x00007fca02761b6e in mailbox_get_metadata (box=0x15da630, items=MAILBOX_METADATA_GUID, metadata_r=0x7fffbea0b4b0) at mail-storage.c:1508 __FUNCTION__ = "mailbox_get_metadata" #29 0x00007fca02776b66 in node_lookup_guid (ctx=0x15d6fa0, name=, node_r=, created_r=) at mailbox-list-index-sync.c:25 box = 0x15da630 vname = str = 0x158d9a8 ns_sep = metadata = {guid = '\000' , virtual_size = 0, cache_fields = 0x0, precache_fields = 0, backend_ns_prefix = 0x0, backend_ns_type = 0} #30 node_add_to_index (ctx=0x15d6fa0, name=, node_r=, created_r=) at mailbox-list-index-sync.c:45 _data_stack_cur_id = 6 irec = {name_id = 1, parent_uid = 0, guid = '\000' , uid_validity = 0} seq = 8767310 #31 mailbox_list_index_node_add (ctx=0x15d6fa0, name=, node_r=, created_r=) at mailbox-list-index-sync.c:87 dup_name = #32 mailbox_list_index_sync_name (ctx=0x15d6fa0, name=, node_r=, created_r=) at mailbox-list-index-sync.c:125 path = 0x158d890 empty_path = {0x7fca027b9e0d "", 0x0} node = 0x15c7500 parent = i = seq = 0 __FUNCTION__ = "mailbox_list_index_sync_name" #33 0x00007fca02776d78 in mailbox_list_index_sync_list (list=) at mailbox-list-index-sync.c:315 name = 0x0 _data_stack_cur_id = 5 iter = 0x15d7370 info = flags = 0 node = 0x7fca024883ca seq = patterns = {0x7fca027bf387 "*", 0x0} created = false #34 mailbox_list_index_sync (list=) at mailbox-list-index-sync.c:386 sync_ctx = 0x15d6fa0 ret = #35 0x00007fca0277200f in mailbox_list_index_refresh (list=0x15bc1f0) at mailbox-list-index.c:373 ilist = 0x15bc830 view = 0x15ce4b0 ret = #36 0x00007fca02773a98 in iter_use_index (list=0x15bc1f0, patterns=, flags=) at mailbox-list-index-iter.c:25 No locals. #37 mailbox_list_index_iter_init (list=0x15bc1f0, patterns=, flags=) at mailbox-list-index-iter.c:53 ilist = 0x15bc830 ctx = 0x15ccc00 pool = 0x15ccbe0 ns_sep = 46 '.' #38 0x00007fca02777d6d in mailbox_list_iter_init_multiple (list=0x15bc1f0, patterns=0x4a54, flags=6) at mailbox-list-iter.c:173 ctx = ret = __FUNCTION__ = "mailbox_list_iter_init_multiple" #39 0x00007fca02778859 in mailbox_list_ns_iter_try_next (_ctx=0x15cc7f0) at mailbox-list-iter.c:571 errstr = error = 32714 #40 mailbox_list_ns_iter_next (_ctx=0x15cc7f0) at mailbox-list-iter.c:639 info = #41 0x00007fca02777177 in mailbox_list_iter_next_call (ctx=0x4a54) at mailbox-list-iter.c:935 info = set = #42 0x00007fca027775d0 in mailbox_list_iter_next (ctx=0x15cc7f0) at mailbox-list-iter.c:1006 _data_stack_cur_id = 4 info = 0x0 #43 0x000000000040ebd1 in cmd_list_continue (cmd=) at cmd-list.c:229 ctx = 0x15ca078 info = 0x1 flags = MAILBOX_NOCHILDREN str = 0x158d530 mutf7_name = 0x158d680 name = 0x1598e30 "\240T]\001" ret = 1 #44 0x000000000040f46e in cmd_list_full (cmd=0x15c9e30, lsub=) at cmd-list.c:463 client = 0x15c9250 args = 0x1598ab8 list_args = 0x15c9d80 arg_count = ctx = 0x15ca078 patterns = {arr = {buffer = 0x15ca0b8, element_size = 8}, v = 0x15ca0b8, v_modifiable = 0x15ca0b8} ref = 0x15ca0a8 "" pattern = 0x15ca0b0 "*" patterns_strarr = 0x15ca0f0 str = #45 0x00000000004160bd in command_exec (cmd=0x15c9e30) at imap-commands.c:156 hook = 0x1596da0 ret = #46 0x0000000000415210 in client_command_input (cmd=0x15c9e30) at imap-client.c:775 client = 0x15c9250 command = __FUNCTION__ = "client_command_input" #47 0x00000000004152fd in client_command_input (cmd=0x15c9e30) at imap-client.c:836 client = 0x15c9250 command = 0x0 __FUNCTION__ = "client_command_input" #48 0x000000000041557d in client_handle_next_command (client=0x15c9250) at imap-client.c:874 No locals. #49 client_handle_input (client=0x15c9250) at imap-client.c:886 _data_stack_cur_id = 3 ret = 128 remove_io = handled_commands = false __FUNCTION__ = "client_handle_input" #50 0x00000000004158ff in client_input (client=0x15c9250) at imap-client.c:928 cmd = output = 0x15c9c68 bytes = __FUNCTION__ = "client_input" #51 0x00007fca0249b6a6 in io_loop_call_io (io=0x15c9d30) at ioloop.c:387 ioloop = 0x1595730 t_id = 2 #52 0x00007fca0249c71f in io_loop_handler_run (ioloop=) at ioloop-epoll.c:215 ctx = 0x1595aa0 event = 0x1595b10 list = 0x15c9d80 io = 0x4a54 tv = {tv_sec = 9, tv_usec = 997323} msecs = ret = 1 i = 0 call = false __FUNCTION__ = "io_loop_handler_run" #53 0x00007fca0249b648 in io_loop_run (ioloop=0x1595730) at ioloop.c:406 No locals. #54 0x00007fca02452083 in master_service_run (service=0x15955c0, callback=0x4a54) at master-service.c:560 No locals. #55 0x000000000041eb77 in main (argc=2, argv=0x1595390) at main.c:400 set_roots = {0x426200, 0x0} login_set = {auth_socket_path = 0x158d048 "\200\320X\001", postlogin_socket_path = 0x158d080 "[user 2001:xxxx:xxxx:xxxx:xxxx:xxxx:xxxx:xxxx LIST]", postlogin_timeout_secs = 60, callback = 0x41ed70 , failure_callback = 0x41ed10 , request_auth_token = 1} service_flags = storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = (gdb) quit From asmarre at ull.edu.es Tue Apr 9 12:10:46 2013 From: asmarre at ull.edu.es (ADRIAN SANTOS MARRERO) Date: Tue, 9 Apr 2013 10:10:46 +0100 Subject: [Dovecot] "No such file or directory" error setting up dict quota for mdbox In-Reply-To: References: Message-ID: Hi again, I've finally resolved this problem. It was related with apparmor blocking the fstat system call for the lmtp process. Regards. 2013/4/8 ADRIAN SANTOS MARRERO > Hi, I've some troubles setting up the dict based quota plugin for mdbox, > it always returns a error when lmtp tries to deliver an e-mail: > > Apr 8 12:40:16 mb07 dovecot: lmtp(3001, asmarre at ull.es): Error: > fstat(/sharedfs/10.4.1.107/ull.es/54/asmarre/dovecot-quota.lock) failed: > No such file or directory > Apr 8 12:40:16 mb07 dovecot: lmtp(3001, asmarre at ull.es): Error: file > dict commit: file_dotlock_open(/sharedfs/ > 10.4.1.107/ull.es/54/asmarre/dovecot-quota) failed: No such file or > directory > Apr 8 12:40:16 mb07 dovecot: lmtp(3001, asmarre at ull.es): Error: dict > quota: Quota update failed, it's now desynced > > In fact lmtp does create the dovecot-quota.lock file but it does not > update the dovecot-quota file. > > If I run "doveadm quota recalc -u asmarre" it works and updates the > dovecot-quota file. > > The version of dovecot that I'm using is 2.0.19 and the configuration is: > > # 2.0.19: /etc/dovecot/dovecot.conf > # OS: Linux 3.2.0-32-generic x86_64 Ubuntu 12.04.2 LTS > mail_debug = yes > mail_location = mdbox:%h > mail_plugins = quota > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character > vacation subaddress comparator-i;ascii-numeric relational regex imap4flags > copy include variables body enotify environment mailbox date ihave > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > plugin { > quota = dict:User quota::file:%h/dovecot-quota > quota_rule = *:storage=1G > quota_warning = storage=95%% quota-warning 95 > quota_warning2 = storage=85%% quota-warning 85 > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > postmaster_address = postmaster at ull.es > protocols = " imap lmtp sieve pop3" > service lmtp { > inet_listener lmtp { > port = 24 > } > } > service managesieve-login { > inet_listener sieve_deprecated { > port = 2000 > } > } > service quota-warning { > executable = script /opt/ccti/correo/buzones/quota_warning.sh > unix_listener quota-warning { > user = dovecot > } > user = dovecot > } > ssl_cert = ssl_key = userdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > protocol lmtp { > mail_plugins = quota sieve zlib > } > protocol imap { > mail_plugins = quota imap_quota > } > protocol pop3 { > pop3_no_flag_updates = yes > pop3_uidl_format = %v.%u > } > > Thanks in advance. > From dovecot.org at choon.net Tue Apr 9 12:48:02 2013 From: dovecot.org at choon.net (Giam Teck Choon) Date: Tue, 09 Apr 2013 17:48:02 +0800 Subject: [Dovecot] make check error for Pigeonhole v0.3.4 for Dovecot v2.1.16 In-Reply-To: <51633F1D.6070305@rename-it.nl> References: <51608BB5.4010209@rename-it.nl> <51630997.50504@choon.net> <51633F1D.6070305@rename-it.nl> Message-ID: <5163E3D2.9010209@choon.net> On 04/09/2013 06:05 AM, Stephan Bosch wrote: > On 4/8/2013 8:16 PM, Giam Teck Choon wrote: >> Hi, >> >> When I compile Pigeonhole v0.3.4 with Dovecot v2.1.16 until make check >> output as below from my rpmbuild output: >> >> Test case: ./tests/extensions/mailbox/execute.svtest: >> 1: Test 'MailboxExists - None exist' SUCCEEDED >> 2: Test 'MailboxExists - Not all exist' SUCCEEDED >> 3: Test 'MailboxExists - One exists' SUCCEEDED >> 4: Test 'MailboxExists - All exist' SUCCEEDED >> 5: Test ':Create' SUCCEEDED >> PASS: 5 tests succeeded. >> Test case: ./tests/extensions/date/basic.svtest: >> 1: Test 'Defaults' SUCCEEDED >> 2: Test 'Count' SUCCEEDED >> 3: Test 'Invalid' SUCCEEDED >> 4: Test 'Comparison' FAILED: date is invalid: 2009-07-23 >> FAIL: 1 of 4 tests failed. >> RPM build errors: >> make: *** [tests/extensions/date/basic.svtest] Error 1 >> error: Bad exit status from /var/tmp/rpm-tmp.CIcpqx (%check) >> Bad exit status from /var/tmp/rpm-tmp.CIcpqx (%check) > > You're not the first one to notice: > > http://hg.rename-it.nl/dovecot-2.1-pigeonhole/rev/bc2126771d00 Thanks for the patch. > > This is one of those genuine phase-of-the-moon kind of bugs :) Yap ;) > > Hmm, maybe I should make a new release for this problem already. If you are going to do so then I shall wait otherwise I can simply pull the patch from http://hg.rename-it.nl/dovecot-2.1-pigeonhole/raw-diff/bc2126771d00/tests/extensions/date/basic.svtest and apply... IMO... not a big issue to me as need to notify you just in case no one does that ;) Thanks a lot for your prompt and friendly response. Have a nice day! Kindest regards, Giam Teck Choon > > Regards, > > Stephan. > > From tomppa at iki.fi Tue Apr 9 13:45:07 2013 From: tomppa at iki.fi (Tomi Vainio) Date: Tue, 09 Apr 2013 13:45:07 +0300 Subject: [Dovecot] 2.1.16 Solaris 10 compile regression Sunstudio compiler Message-ID: <5163F133.3040802@iki.fi> Hi, src/plugins/quota/quota-status.c won't compile due to missing include needed for optarg % make source='quota-status.c' object='quota-status.o' libtool=no \ DEPDIR=.deps depmode=none /bin/bash ../../../depcomp \ cc -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-master -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -I../../../src/doveadm -I/usr/local/include -I/usr/sfw/include -xO4 -xtarget=ultra3cu -xcache=64/32/4:8192/512/2 -I/usr/sfw/include -c quota-status.c "../../../src/lib-storage/mailbox-list.h", line 13: warning: useless declaration "quota-status.c", line 200: undefined symbol: optarg "quota-status.c", line 200: warning: improper pointer/integer combination: arg #1 cc: acomp failed for quota-status.c *** Error code 2 make: Fatal error: Command failed for target `quota-status.o' Also 2.2.rc6 fails when using Sunstudio make but works with gmake Making all in lib-http make: Fatal error in reader: Makefile, line 725: Unexpected end of line seen Tomppa From maia at weiser.dk Tue Apr 9 14:59:02 2013 From: maia at weiser.dk (maia at weiser.dk) Date: Tue, 9 Apr 2013 13:59:02 +0200 (CEST) Subject: [Dovecot] Received date on emails is wrong after file copying Message-ID: Hi, I have installed a new mail server where I'm migrating from Courier to Dovecot. I have made a mistake when I was copying over the emails so the date/time mark on them is updated. So all my mails are now from the copy date/time and not the real receive time. I have tried to copy the emails over again, so they get the right date/time on the file level. And when I look at a single email in details in SquirrelMail it has now the right date/time, but when I look at the overview of a folder it still have the copy date/time on them. Is there any way to get the date/time in the overview updated, maybe delete some index files or force it to re-index? I'm not even sure that the problem is in Dovecot. But I'm sure You can help me here. Best Regards, Kim Johansen From julio at psi.com.br Tue Apr 9 16:39:11 2013 From: julio at psi.com.br (Julio Cesar Covolato) Date: Tue, 09 Apr 2013 10:39:11 -0300 Subject: [Dovecot] script to detect dictionary attacks In-Reply-To: <51600485.2060503@thelounge.net> (sfid-H20130406-081923-+036.27-1@spamfilter.osbf.lua) References: <51600485.2060503@thelounge.net> (sfid-H20130406-081923-+036.27-1@spamfilter.osbf.lua) Message-ID: <516419FF.1090602@psi.com.br> Hi Reindl. I have a similar script to detect brute force attacs to dovecot sasl auth sistem, it's very simple to adapt to pop/imap failures log: http://psi.com.br/~julio/postfix/sasl-killer.sh Regards, -- ----------------------------- _ Julio Cesar Covolato 0v0 /(_)\ F: 55-11-3129-3366 ^ ^ PSI INTERNET ----------------------------- Em 06-04-2013 08:18, Reindl Harald escreveu: > Hi > > has someone a script which can filter out dictionary attacks > from /var/log/maillog and notify about the source-IPs? > > i know about fail2ban and so on, but i would like to have > a mail with the IP address for two reasons and avoid fail2ban > at all because it does not match in the way we maintain firewalls > > * add the IP to a distributed "iptables-block.sh" and distribute > it to any server with a comment and timestamp > * write a abuse-mail to the ISP > From dgp-dove at corefiling.co.uk Tue Apr 9 17:04:14 2013 From: dgp-dove at corefiling.co.uk (Daniel Piddock) Date: Tue, 09 Apr 2013 15:04:14 +0100 Subject: [Dovecot] Pigeonhole 0.3.4: Warning: sieve: encountered corrupt binary: re-compiling script Message-ID: <51641FDE.70308@corefiling.co.uk> Hi all, Upgraded to Dovecot 2.1.16 and Pigeonhole 0.3.4 yesterday. We use lmtp and sieve. I've now started to see in the logs the following entries: >Warning: Jz6kNv8AY1FdfQAAVMeomg: sieve: encountered corrupt binary: re-compiling script [script path] The script then appears to run correctly and the message gets stored where ever it should be. This only appears to be happening for a few users and although it happens on the majority of their messages it doesn't happen for every single one. What's the best way to start debugging? Thank, Dan From skdovecot at smail.inf.fh-brs.de Tue Apr 9 17:50:40 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 9 Apr 2013 16:50:40 +0200 (CEST) Subject: [Dovecot] How to see folders/subfolders/emails through imap In-Reply-To: <20130408175109.201510e1.skraw@ithnet.com> References: <20130408175109.201510e1.skraw@ithnet.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 8 Apr 2013, Stephan von Krawczynski wrote: > I am trying to do something very simple - at least thats what I thought. > I have some fs, it contains folders and subfolders with email files ordered > like maildir. Now I try to set up dovecot on top simply to let some imap > account watch these email files. But I cannot see any folders at all. I can > create new folders and see them, but I cannot create subfolders as subdirs > like "folder/subfolder". Instead I get "folder.subfolder" dirs on the fs. > I tried to set the separator to "/", but that does not help at all. > > Is there some easy way to configure dovecot to display: > > ///new/files... > /new/files... > /new/files... > > according to fs layout on some imap-client (like thunderbird)? Well, first, simply explain what you mean with "email files". a) you mentioned "maildir", so simply look at http://wiki2.dovecot.org/MailLocation/Maildir "Directory layout" this would also fit your example, IMHO. b) you mentioned "thunderbird", which does not use maildir to my knowledge, but mbox, so simply look at http://wiki2.dovecot.org/MailLocation/mbox You might want to place control files somewhere else, see CONTROL= and INDEX=. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUWQqwF3r2wJMiz2NAQKqYwgAwFZzOxZS5Dx+zP4IxPy/KsirUmVRhldp /fVbWtRHpqL2Nq7yuAnsgKUA3WpC5AvEhTBW49fC77GEbC9hHCJGZTQevmGsVlNH xGUS0G2A9JEkv1OJZV67LU5I3+0CgDi5hTwGd9cEk34llNHbiJoBnweG6MEIJ4jh PTKtcBG/WdU0LPxZUE0VvbVfW6t5Kbml7IFAiLqS3uQc5NE5IM3KfjWUom8ZcCQ/ Zo0BpBbHdfKTyHc9wSKwiN+0SFCVHn/Fx1n2coiAXpq0QuCINP63Fiss5BbYFi3e mkEXk7VUiosa5OnXq8RX151/nv0mSjglwlAGgE7olKqdwCyaW5V0LQ== =itDf -----END PGP SIGNATURE----- From Juergen.Obermann at hrz.uni-giessen.de Tue Apr 9 18:29:40 2013 From: Juergen.Obermann at hrz.uni-giessen.de (=?UTF-8?Q?J=C3=BCrgen_Obermann?=) Date: Tue, 09 Apr 2013 17:29:40 +0200 Subject: [Dovecot] failed compiling dovecot 2.1.16 under solaris Message-ID: Hello, compiling doevoct-2.1.16 with sun-compiler under solaris 10 gave me the following error source='quota-status.c' object='quota-status.o' libtool=no \ DEPDIR=.deps depmode=none /bin/bash ../../../depcomp \ cc -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-master -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -I../../../src/doveadm -I/usr/local/include -fast -xarch=v8plusa -I/usr/sfw/include -c quota-status.c "../../../src/lib-storage/mailbox-list.h", line 13: warning: useless declaration "quota-status.c", line 200: undefined symbol: optarg "quota-status.c", line 200: warning: improper pointer/integer combination: arg #1 cc: acomp failed for quota-status.c I could solve this problem with *** ./src/plugins/quota/quota-status.c.orig Thu Apr 4 22:58:30 2013 --- ./src/plugins/quota/quota-status.c Tue Apr 9 16:08:12 2013 *************** *** 11,16 **** --- 11,17 ---- #include "mail-storage-service.h" #include "quota-private.h" #include "quota-plugin.h" + #include enum quota_protocol { QUOTA_PROTOCOL_UNKNOWN = 0, but I don't know if this is the correct way to fix it. Greetings, J?rgen -- J?rgen Obermann Hochschulrechenzentrum der Justus-Liebig-Universit?t Gie?en Heinrich-Buff-Ring 44 Tel. 0641-9913054 From stephan at rename-it.nl Tue Apr 9 18:43:09 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 09 Apr 2013 17:43:09 +0200 Subject: [Dovecot] Pigeonhole 0.3.4: Warning: sieve: encountered corrupt binary: re-compiling script In-Reply-To: <51641FDE.70308@corefiling.co.uk> References: <51641FDE.70308@corefiling.co.uk> Message-ID: <5164370D.40400@rename-it.nl> Op 4/9/2013 4:04 PM, Daniel Piddock schreef: > Hi all, > > Upgraded to Dovecot 2.1.16 and Pigeonhole 0.3.4 yesterday. We use lmtp > and sieve. I've now started to see in the logs the following entries: >> Warning: Jz6kNv8AY1FdfQAAVMeomg: sieve: encountered corrupt binary: > re-compiling script [script path] > > The script then appears to run correctly and the message gets stored > where ever it should be. > > This only appears to be happening for a few users and although it > happens on the majority of their messages it doesn't happen for every > single one. > > What's the best way to start debugging? If it is re-occurring for the same user and script, something is definitely wrong. From what version are you upgrading? You can send me the .sieve and the .svbin so that I can see what is going on. Regards, Stephan. From dwmw2 at infradead.org Tue Apr 9 19:17:26 2013 From: dwmw2 at infradead.org (David Woodhouse) Date: Tue, 09 Apr 2013 17:17:26 +0100 Subject: [Dovecot] How to exec /usr/libexec/dovecot/imap with specific maildir location Message-ID: <1365524246.3883.50.camel@i7.infradead.org> Once upon a time I could configure my mailer to access my historical archives by running something like ssh $mailserver MAIL=maildir:~/Maildir-archive dovecot --exec-mail imap I need to run /usr/libexec/dovecot/imap manually now, and I've fixed that a while ago for my normal email access. But I've just had cause to go back to my archives for the first time in a while... and realised that I don't know how to make it work any more. When invoking /usr/libexec/dovecot/imap, is there an environment variable or command line option which can set the mail location? -- dwmw2 -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/x-pkcs7-signature Size: 6171 bytes Desc: not available URL: From skraw at ithnet.com Tue Apr 9 19:35:00 2013 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Tue, 9 Apr 2013 18:35:00 +0200 Subject: [Dovecot] How to see folders/subfolders/emails through imap In-Reply-To: References: <20130408175109.201510e1.skraw@ithnet.com> Message-ID: <20130409183500.5fbb00a2.skraw@ithnet.com> On Tue, 9 Apr 2013 16:50:40 +0200 (CEST) Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Mon, 8 Apr 2013, Stephan von Krawczynski wrote: > > > I am trying to do something very simple - at least thats what I thought. > > I have some fs, it contains folders and subfolders with email files ordered > > like maildir. Now I try to set up dovecot on top simply to let some imap > > account watch these email files. But I cannot see any folders at all. I can > > create new folders and see them, but I cannot create subfolders as subdirs > > like "folder/subfolder". Instead I get "folder.subfolder" dirs on the fs. > > I tried to set the separator to "/", but that does not help at all. > > > > Is there some easy way to configure dovecot to display: > > > > ///new/files... > > /new/files... > > /new/files... > > > > according to fs layout on some imap-client (like thunderbird)? > > Well, first, simply explain what you mean with "email files". > > a) you mentioned "maildir", so simply look at > http://wiki2.dovecot.org/MailLocation/Maildir "Directory layout" > this would also fit your example, IMHO. Ok, I thought the setup was pretty clear, but let me give more details. I have _no_ problem with understanding the several maildir formats, I am here using maildir (not ++). LAYOUT=fs therefore. My expectation was that directories would be shown as folders through imap. But they are in fact not shown at all, neither in thunderbird nor in sylpheed (to name another client). > b) you mentioned "thunderbird", which does not use maildir to my > knowledge, but mbox, so simply look at > http://wiki2.dovecot.org/MailLocation/mbox > > You might want to place control files somewhere else, see CONTROL= and > INDEX=. Uh? thunderbird is a client, the client should not bother at all about maildir or mbox on the server. Again, assume I have a mailserver. The MTA produces directories like: ///new/ ... //new/ ... ... //new/ (clearly a maildir-alike format) Now on this server I want dovecot to hand this layout to some email-client (on another box, lets say some wind*ws), thunderbird if possible, via imap. That's about all. I tried to tell dovecot that is mail_location=maildir::LAYOUT=fs Yes, there is only _one_ user. My expectation was to see as imap-folder but I see exactly zero. If I try to create a new folder from thunderbird side a directory is created inside , so generally dovecot understood the idea, only directories that are already there are not shown. -- Regards, Stephan From rs at sys4.de Tue Apr 9 19:58:05 2013 From: rs at sys4.de (Robert Schetterer) Date: Tue, 09 Apr 2013 18:58:05 +0200 Subject: [Dovecot] How to see folders/subfolders/emails through imap In-Reply-To: References: <20130408175109.201510e1.skraw@ithnet.com> Message-ID: <5164489D.8050700@sys4.de> Am 09.04.2013 16:50, schrieb Steffen Kaiser: > b) you mentioned "thunderbird", which does not use maildir to my > knowledge http://jaisejames.wordpress.com/2012/03/15/to-activate-maildir-in-thunderbird/ Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From ben at morrow.me.uk Tue Apr 9 20:44:16 2013 From: ben at morrow.me.uk (Ben Morrow) Date: Tue, 9 Apr 2013 18:44:16 +0100 Subject: [Dovecot] How to exec /usr/libexec/dovecot/imap with specific maildir location In-Reply-To: <1365524246.3883.50.camel@i7.infradead.org> References: <1365524246.3883.50.camel@i7.infradead.org> Message-ID: <20130409174415.GB47750@anubis.morrow.me.uk> At 5PM +0100 on 9/04/13 you (David Woodhouse) wrote: > Once upon a time I could configure my mailer to access my historical > archives by running something like > > ssh $mailserver MAIL=maildir:~/Maildir-archive dovecot --exec-mail imap > > I need to run /usr/libexec/dovecot/imap manually now, and I've fixed > that a while ago for my normal email access. But I've just had cause to > go back to my archives for the first time in a while... and realised > that I don't know how to make it work any more. > > When invoking /usr/libexec/dovecot/imap, is there an environment > variable or command line option which can set the mail location? I don't know about an environment variable, but you can use the -o option to set configuration variables in the dovecot.conf format: /usr/libexec/dovecot/imap -o mail_location=maildir:~/Maildir-archive Ben From tss at iki.fi Tue Apr 9 21:17:47 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 9 Apr 2013 21:17:47 +0300 Subject: [Dovecot] How to see folders/subfolders/emails through imap In-Reply-To: <20130408175109.201510e1.skraw@ithnet.com> References: <20130408175109.201510e1.skraw@ithnet.com> Message-ID: <3EFBD42D-4894-4E2E-9272-DD2201DD9B48@iki.fi> On 8.4.2013, at 18.51, Stephan von Krawczynski wrote: > I am trying to do something very simple - at least thats what I thought. > I have some fs, it contains folders and subfolders with email files ordered > like maildir. Now I try to set up dovecot on top simply to let some imap > account watch these email files. But I cannot see any folders at all. I can > create new folders and see them, but I cannot create subfolders as subdirs > like "folder/subfolder". Instead I get "folder.subfolder" dirs on the fs. > I tried to set the separator to "/", but that does not help at all. You mentioned you set LAYOUT=fs, but the above sounds like you're still using Maildir++. Set mail_debug=yes and see what it says. From tss at iki.fi Tue Apr 9 21:20:37 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 9 Apr 2013 21:20:37 +0300 Subject: [Dovecot] Received date on emails is wrong after file copying In-Reply-To: References: Message-ID: On 9.4.2013, at 14.59, maia at weiser.dk wrote: > I have tried to copy the emails over again, so they get the right > date/time on the file level. > > And when I look at a single email in details in SquirrelMail it has now > the right date/time, but when I look at the overview of a folder it still > have the copy date/time on them. > > Is there any way to get the date/time in the overview updated, maybe > delete some index files or force it to re-index? Delete all the dovecot.index.cache files. From tss at iki.fi Tue Apr 9 21:22:03 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 9 Apr 2013 21:22:03 +0300 Subject: [Dovecot] failed compiling dovecot 2.1.16 under solaris In-Reply-To: References: Message-ID: <445D3917-07C5-4A69-B342-8C069DF60B5D@iki.fi> On 9.4.2013, at 18.29, J?rgen Obermann wrote: > "quota-status.c", line 200: undefined symbol: optarg > "quota-status.c", line 200: warning: improper pointer/integer > combination: arg #1 > cc: acomp failed for quota-status.c > > + #include What about with stdio.h? That's the correct one according to man page. From campbell at cnpapers.com Tue Apr 9 21:33:09 2013 From: campbell at cnpapers.com (Steve Campbell) Date: Tue, 09 Apr 2013 14:33:09 -0400 Subject: [Dovecot] Any simple way to block logins by IP address? Message-ID: <51645EE5.1060403@cnpapers.com> Does Dovecot have a facility to block pop3 and imap logins by IP address. I usually do this by putting the IPs in my border firewall, but it's in transition currently to a new one, and I'd like to end connection fairly fast. If it matters, I'm using 2.0.9. Thanks steve campbell From skdovecot at smail.inf.fh-brs.de Tue Apr 9 22:19:25 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen) Date: Tue, 09 Apr 2013 21:19:25 +0200 Subject: [Dovecot] How to see folders/subfolders/emails through imap In-Reply-To: <20130409183500.5fbb00a2.skraw@ithnet.com> References: <20130408175109.201510e1.skraw@ithnet.com> <20130409183500.5fbb00a2.skraw@ithnet.com> Message-ID: <516469BD.8080101@smail.inf.fh-brs.de> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Stephan von Krawczynski wrote: > On Tue, 9 Apr 2013 16:50:40 +0200 (CEST) Steffen Kaiser > wrote: > I tried to tell dovecot that is > mail_location=maildir::LAYOUT=fs Works for me, Dovecot v2.2RC3 mail_location = maildir:/home/fs:LAYOUT=fs mkdir -p /home/fs/foo/{tmp,cur,new} mkdir -p /home/fs/foo/bar/{tmp,cur,new} telnet localhost 143 0 login nnn nnn 1 list "" "*" * LIST (\HasChildren) "/" foo * LIST (\HasNoChildren) "/" foo/bar * LIST (\HasNoChildren) "/" INBOX 1 OK List completed. - -- Steffen -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (Darwin) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iQEVAwUBUWRpvF3r2wJMiz2NAQLtngf9GoYZwASU+hp1P39ZIpoRELuz2U+YNl1f jeD/qfkXS8tWjfGzI18vVP1Xid65SiUfHm84wA5x/8rZfLo0oWvBekZTAV044Ndw ernCsbJG4sotJ0MS6rYRIUmO/wbpFAU4OW7N8I/e0pVZlgrv1ncD1cBSGsbN8FR8 DTlOqOGcxcrrcGBAVSdqqVU14jdrABhgPiWlNpOYBUV9qWATiOGaQsH47hDVAWT7 m5a7l2wVpAhVOkqaZIiYDeSA+7YJs7HTJYFuioVw04PW1nzrdnLBCR31DOCmoPlX 2ZsOeCP4e+Bnl0XsN6AG4AjvmRgMeFRrxMIRdR03WCk9VhBKIjbjAw== =mHIt -----END PGP SIGNATURE----- From dwmw2 at infradead.org Tue Apr 9 22:48:59 2013 From: dwmw2 at infradead.org (David Woodhouse) Date: Tue, 09 Apr 2013 20:48:59 +0100 Subject: [Dovecot] How to exec /usr/libexec/dovecot/imap with specific maildir location In-Reply-To: <20130409174415.GB47750@anubis.morrow.me.uk> References: <1365524246.3883.50.camel@i7.infradead.org> <20130409174415.GB47750@anubis.morrow.me.uk> Message-ID: <1365536939.3883.52.camel@i7.infradead.org> On Tue, 2013-04-09 at 18:44 +0100, Ben Morrow wrote: > /usr/libexec/dovecot/imap -o mail_location=maildir:~/Maildir-archive Perfect. Thank you. -- dwmw2 -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/x-pkcs7-signature Size: 6171 bytes Desc: not available URL: From skraw at ithnet.com Tue Apr 9 23:07:01 2013 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Tue, 9 Apr 2013 22:07:01 +0200 Subject: [Dovecot] How to see folders/subfolders/emails through imap In-Reply-To: <516469BD.8080101@smail.inf.fh-brs.de> References: <20130408175109.201510e1.skraw@ithnet.com> <20130409183500.5fbb00a2.skraw@ithnet.com> <516469BD.8080101@smail.inf.fh-brs.de> Message-ID: <20130409220701.ee91b641.skraw@ithnet.com> On Tue, 09 Apr 2013 21:19:25 +0200 Steffen wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Stephan von Krawczynski wrote: > > On Tue, 9 Apr 2013 16:50:40 +0200 (CEST) Steffen Kaiser > > wrote: > > > I tried to tell dovecot that is > > mail_location=maildir::LAYOUT=fs > > Works for me, Dovecot v2.2RC3 > > mail_location = maildir:/home/fs:LAYOUT=fs > mkdir -p /home/fs/foo/{tmp,cur,new} > mkdir -p /home/fs/foo/bar/{tmp,cur,new} > > telnet localhost 143 > 0 login nnn nnn > 1 list "" "*" > * LIST (\HasChildren) "/" foo > * LIST (\HasNoChildren) "/" foo/bar > * LIST (\HasNoChildren) "/" INBOX > 1 OK List completed. Ok, I solved it thanks to your striking example. The problem was: the clients remembered something from earlier sessions where the dovecot config was probably not correct. I removed the mailbox from the client and recreated it and now I see the correct list of folders. Thanks a lot for this hint. -- Regards, Stephan From tss at iki.fi Tue Apr 9 23:56:07 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 9 Apr 2013 23:56:07 +0300 Subject: [Dovecot] crash with dovecot 2.2: Panic: Buffer full In-Reply-To: <516327D9.1040605@starbridge.org> References: <51446ACC.4060900@starbridge.org> <1363614474.10326.173.camel@innu> <6E5E2CD1-FD6F-4374-8D64-585E49128EC0@starbridge.org> <5161CD52.2070504@starbridge.org> <1365368201.11047.138.camel@innu> <516327D9.1040605@starbridge.org> Message-ID: On 8.4.2013, at 23.26, tonio at starbridge.org wrote: > imap(clean-quarantine at spamguard.fr): Panic: file istream.c: line 153 > (i_stream_read): assertion failed: (_stream->skip != _stream->pos) http://hg.dovecot.org/dovecot-2.2/rev/fbef40826602 should fix this. From tss at iki.fi Wed Apr 10 00:04:32 2013 From: tss at iki.fi (Timo Sirainen) Date: Wed, 10 Apr 2013 00:04:32 +0300 Subject: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot In-Reply-To: References: <62CA7D02-69DA-47C4-9CE7-4A8D9518670F@iki.fi> Message-ID: <2DAEBE3C-53D8-4858-8067-3398CCF3B4BF@iki.fi> On 9.4.2013, at 1.41, Michael Smith wrote: > I tried importing the anonymized file, and there were no errors. So, it's something with the actual data. UTF-8 issues? > > While I can't send you a raw customer's mailbox, one of the failures is a 'role' account mailbox, with no critical/useful data in it. > > Here is a link (expires in 30 days) to download the mailbox, it's 107M. > https://truck.it/p/HNlzl9hWbO > > The error I'm getting is > dsync(webmail): Error: Sync failed for mbox file /var/opt/migrate/users/webmail/inbox: seq=4482 uid=4482 uid_broken=0 originally needed 10 bytes, now needs 12 bytes I can't reproduce with that file, dsync succeeds without errors. Maybe the problem requires something specific in the index files also? From tss at iki.fi Wed Apr 10 00:14:33 2013 From: tss at iki.fi (Timo Sirainen) Date: Wed, 10 Apr 2013 00:14:33 +0300 Subject: [Dovecot] 2.2.0rc6: crash with mailbox_list_index=yes (and virtual?) In-Reply-To: References: Message-ID: On 9.4.2013, at 11.02, Lutz Pre?ler wrote: > depending on the client (with OfflineIMAP, but not a mobile one) my dovecot > test configuration (config on request) crashes if mailbox_list_index=yes: Thanks, fixed: http://hg.dovecot.org/dovecot-2.2/rev/f39664bd4b29 From jtam.home at gmail.com Wed Apr 10 02:45:55 2013 From: jtam.home at gmail.com (Joseph Tam) Date: Tue, 9 Apr 2013 16:45:55 -0700 (PDT) Subject: [Dovecot] Any simple way to block logins by IP address? In-Reply-To: References: Message-ID: Steve Campbel writes: > Does Dovecot have a facility to block pop3 and imap logins by IP > address. I usually do this by putting the IPs in my border firewall, but > it's in transition currently to a new one, and I'd like to end > connection fairly fast. You probably want to compile in tcp_wrapper support and handle it that way http://wiki2.dovecot.org/LoginProcess You might also hook into a the post-login script if you need some bizarre logic to determine whether to allow a login or not, but this is later in the session setup rather than block-on-sight like a firewall. http://wiki2.dovecot.org/PostLoginScripting Joseph Tam From skraw at ithnet.com Wed Apr 10 11:21:19 2013 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Wed, 10 Apr 2013 10:21:19 +0200 Subject: [Dovecot] How to see folders/subfolders/emails through imap In-Reply-To: <20130409220701.ee91b641.skraw@ithnet.com> References: <20130408175109.201510e1.skraw@ithnet.com> <20130409183500.5fbb00a2.skraw@ithnet.com> <516469BD.8080101@smail.inf.fh-brs.de> <20130409220701.ee91b641.skraw@ithnet.com> Message-ID: <20130410102119.ca00acf7.skraw@ithnet.com> On Tue, 9 Apr 2013 22:07:01 +0200 Stephan von Krawczynski wrote: > On Tue, 09 Apr 2013 21:19:25 +0200 > Steffen wrote: > > > -----BEGIN PGP SIGNED MESSAGE----- > > Hash: SHA1 > > > > Stephan von Krawczynski wrote: > > > On Tue, 9 Apr 2013 16:50:40 +0200 (CEST) Steffen Kaiser > > > wrote: > > > > > I tried to tell dovecot that is > > > mail_location=maildir::LAYOUT=fs > > > > Works for me, Dovecot v2.2RC3 > > > > mail_location = maildir:/home/fs:LAYOUT=fs > > mkdir -p /home/fs/foo/{tmp,cur,new} > > mkdir -p /home/fs/foo/bar/{tmp,cur,new} > > > > telnet localhost 143 > > 0 login nnn nnn > > 1 list "" "*" > > * LIST (\HasChildren) "/" foo > > * LIST (\HasNoChildren) "/" foo/bar > > * LIST (\HasNoChildren) "/" INBOX > > 1 OK List completed. > > Ok, I solved it thanks to your striking example. The problem was: the clients > remembered something from earlier sessions where the dovecot config was > probably not correct. I removed the mailbox from the client and recreated it > and now I see the correct list of folders. Thanks a lot for this hint. Sorry, it seems not that easy. I had to find out that sylpheed works correctly now, but thunderbird does not show anything, just like before. Is there a way to log all imap commands and replies? -- Regards, Stephan From tss at iki.fi Wed Apr 10 11:36:24 2013 From: tss at iki.fi (Timo Sirainen) Date: Wed, 10 Apr 2013 11:36:24 +0300 Subject: [Dovecot] How to see folders/subfolders/emails through imap In-Reply-To: <20130410102119.ca00acf7.skraw@ithnet.com> References: <20130408175109.201510e1.skraw@ithnet.com> <20130409183500.5fbb00a2.skraw@ithnet.com> <516469BD.8080101@smail.inf.fh-brs.de> <20130409220701.ee91b641.skraw@ithnet.com> <20130410102119.ca00acf7.skraw@ithnet.com> Message-ID: On 10.4.2013, at 11.21, Stephan von Krawczynski wrote: > Sorry, it seems not that easy. > I had to find out that sylpheed works correctly now, but thunderbird does not > show anything, just like before. > Is there a way to log all imap commands and replies? http://wiki2.dovecot.org/Debugging/Rawlog Either you have set a namespace prefix to Thunderbird, or it's listing only subscribed folders and you don't have any subscriptions. From heupink at merit.unu.edu Wed Apr 10 11:50:38 2013 From: heupink at merit.unu.edu (mourik jan heupink) Date: Wed, 10 Apr 2013 10:50:38 +0200 Subject: [Dovecot] thunderbird detach attachment Message-ID: <516527DE.2050804@merit.unu.edu> Hi all, Thunderbird has an option to detach attachments from (for example) sent items. I've tried it, and it does not work, and also in the dovecot logs I don't see anything interesting meanwhile. Before looking deeper into this: Does anyone here know if this option is known to work, or not? We're running dovecot 2.1.7 on debian wheezy. Removing unwanted attachments is a nice way to keep mail archives smaller... Thanks, MJ From skraw at ithnet.com Wed Apr 10 11:57:54 2013 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Wed, 10 Apr 2013 10:57:54 +0200 Subject: [Dovecot] How to see folders/subfolders/emails through imap In-Reply-To: References: <20130408175109.201510e1.skraw@ithnet.com> <20130409183500.5fbb00a2.skraw@ithnet.com> <516469BD.8080101@smail.inf.fh-brs.de> <20130409220701.ee91b641.skraw@ithnet.com> <20130410102119.ca00acf7.skraw@ithnet.com> Message-ID: <20130410105754.2de61d10.skraw@ithnet.com> On Wed, 10 Apr 2013 11:36:24 +0300 Timo Sirainen wrote: > On 10.4.2013, at 11.21, Stephan von Krawczynski wrote: > > > Sorry, it seems not that easy. > > I had to find out that sylpheed works correctly now, but thunderbird does not > > show anything, just like before. > > Is there a way to log all imap commands and replies? > > http://wiki2.dovecot.org/Debugging/Rawlog > > Either you have set a namespace prefix to Thunderbird, or it's listing only subscribed folders and you don't have any subscriptions. You are right. In the meantime I found out that the default config in thunderbird lists only subscribed folders. Changing this setting makes it work as expected. Thank you for your hint. -- Regards, Stephan From dgp-dove at corefiling.co.uk Wed Apr 10 12:39:59 2013 From: dgp-dove at corefiling.co.uk (Daniel Piddock) Date: Wed, 10 Apr 2013 10:39:59 +0100 Subject: [Dovecot] Pigeonhole 0.3.4: Warning: sieve: encountered corrupt binary: re-compiling script In-Reply-To: <5164370D.40400@rename-it.nl> References: <51641FDE.70308@corefiling.co.uk> <5164370D.40400@rename-it.nl> Message-ID: <5165336F.7050309@corefiling.co.uk> On 09/04/13 16:43, Stephan Bosch wrote: > Op 4/9/2013 4:04 PM, Daniel Piddock schreef: >> Hi all, >> >> Upgraded to Dovecot 2.1.16 and Pigeonhole 0.3.4 yesterday. We use lmtp >> and sieve. I've now started to see in the logs the following entries: >>> Warning: Jz6kNv8AY1FdfQAAVMeomg: sieve: encountered corrupt binary: >> re-compiling script [script path] >> >> The script then appears to run correctly and the message gets stored >> where ever it should be. >> >> This only appears to be happening for a few users and although it >> happens on the majority of their messages it doesn't happen for every >> single one. >> >> What's the best way to start debugging? > > If it is re-occurring for the same user and script, something is > definitely wrong. From what version are you upgrading? > > You can send me the .sieve and the .svbin so that I can see what is > going on. > > Regards, > > Stephan. Hi Stephan, We were upgrading from Dovecot 2.1.15 and Pigeonhole 0.3.3. Somebody noticed that the .svbin wasn't actually being updated hence the regular error. Deleting the files forced pigeonhole to recreate them properly and the warnings stopped happening. [sent .svbin and .sieve off list] Cheers, Dan From rs at sys4.de Wed Apr 10 12:52:29 2013 From: rs at sys4.de (Robert Schetterer) Date: Wed, 10 Apr 2013 11:52:29 +0200 Subject: [Dovecot] thunderbird detach attachment In-Reply-To: <516527DE.2050804@merit.unu.edu> References: <516527DE.2050804@merit.unu.edu> Message-ID: <5165365D.60302@sys4.de> Am 10.04.2013 10:50, schrieb mourik jan heupink: > Hi all, > > Thunderbird has an option to detach attachments from (for example) sent > items. really ?, i think its an additional plugin I've tried it, and it does not work, and also in the dovecot logs > I don't see anything interesting meanwhile. > > Before looking deeper into this: Does anyone here know if this option is > known to work, or not? > > We're running dovecot 2.1.7 on debian wheezy. > > Removing unwanted attachments is a nice way to keep mail archives yes good idea > smaller... > > Thanks, > MJ My Understanding of that is as long as you have your mail folder option offline synchronzied , which is default at Thunderbird , all actions happens first to Thunderbird local tmp store , then synced to the server use secure way ,move all mails in imap sent folder to real local folder on your machine , then cut attachments , move it back to imap sent folder at last i guess your problem is not server related anyway, but Thunderbird might crash mail at trying cut direct on imap folder, i ve seen this some time before Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From andreas.kasenides at cs.ucy.ac.cy Wed Apr 10 13:10:23 2013 From: andreas.kasenides at cs.ucy.ac.cy (Andreas Kasenides) Date: Wed, 10 Apr 2013 13:10:23 +0300 Subject: [Dovecot] thunderbird detach attachment In-Reply-To: <516527DE.2050804@merit.unu.edu> References: <516527DE.2050804@merit.unu.edu> Message-ID: <51653A8F.1090803@cs.ucy.ac.cy> This looks to work on my 17.0.5 Thunderbird on CentOS 6.4 (I guess Dovecot is not involved but running on 2.2.beta1). It does detach the file, places it in the chosen folder, removes the option to detach or delete from the message menu but (nice indeed) remembers where you put the attachment and can still show it if you click on it or save it again if you want to!! But how do we know its been detached if it still shows in Thunderbird? Looking into the actual message file I see the following at the end: --------------020104000205010901050407 Content-Type: application/vnd.oasis.opendocument.text; name="=?UTF-8?B?MjAxMzA0MDQtzpPOoy5vZHQ=?=" Content-Disposition: attachment; filename="20130404-??.odt" X-Mozilla-External-Attachment-URL: file:///LocalData/tmp/20130404-%CE%93%CE%A3.odt X-Mozilla-Altered: AttachmentDetached; date="Wed Apr 10 12:51:00 2013" You deleted an attachment from this message. The original MIME headers for the attachment were: Content-Type: application/vnd.oasis.opendocument.text; name="=?UTF-8?B?MjAxMzA0MDQtzpPOoy5vZHQ=?=" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename*=UTF-8''%32%30%31%33%30%34%30%34%2D%CE%93%CE%A3%2E%6F%64%74 --------------020104000205010901050407-- Nice!! Andreas On 10/04/13 11:50, mourik jan heupink wrote: > Hi all, > > Thunderbird has an option to detach attachments from (for example) > sent items. I've tried it, and it does not work, and also in the > dovecot logs I don't see anything interesting meanwhile. > > Before looking deeper into this: Does anyone here know if this option > is known to work, or not? > > We're running dovecot 2.1.7 on debian wheezy. > > Removing unwanted attachments is a nice way to keep mail archives > smaller... > > Thanks, > MJ > > -- Andreas Kasenides Senior IT Officer Dept. of Computer Science, University of Cyprus Tel: 22892714, Fax: 22892701 From rs at sys4.de Wed Apr 10 13:21:23 2013 From: rs at sys4.de (Robert Schetterer) Date: Wed, 10 Apr 2013 12:21:23 +0200 Subject: [Dovecot] thunderbird detach attachment In-Reply-To: <5165365D.60302@sys4.de> References: <516527DE.2050804@merit.unu.edu> <5165365D.60302@sys4.de> Message-ID: <51653D23.6070405@sys4.de> Am 10.04.2013 11:52, schrieb Robert Schetterer: > Am 10.04.2013 10:50, schrieb mourik jan heupink: >> Hi all, >> >> Thunderbird has an option to detach attachments from (for example) sent >> items. > > really ?, i think its an additional plugin sorry ,confused by german translation in tb, in deed there is option detach > > I've tried it, and it does not work, and also in the dovecot logs >> I don't see anything interesting meanwhile. >> >> Before looking deeper into this: Does anyone here know if this option is >> known to work, or not? >> >> We're running dovecot 2.1.7 on debian wheezy. >> >> Removing unwanted attachments is a nice way to keep mail archives > > yes good idea > >> smaller... >> >> Thanks, >> MJ > > My Understanding of that is > as long as you have your mail folder option offline synchronzied , which > is default at Thunderbird , all actions happens first to Thunderbird > local tmp store , then synced to the server > > use secure way ,move all mails in imap sent folder to real local folder > on your machine , then cut attachments , move it back to imap sent folder > > at last i guess your problem is not server related anyway, but > Thunderbird might crash mail at trying cut direct on imap folder, i ve > seen this some time before > > > Best Regards > MfG Robert Schetterer > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From stephan at rename-it.nl Wed Apr 10 13:22:20 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 10 Apr 2013 12:22:20 +0200 Subject: [Dovecot] Pigeonhole 0.3.4: Warning: sieve: encountered corrupt binary: re-compiling script In-Reply-To: <5165336F.7050309@corefiling.co.uk> References: <51641FDE.70308@corefiling.co.uk> <5164370D.40400@rename-it.nl> <5165336F.7050309@corefiling.co.uk> Message-ID: <51653D5C.9060704@rename-it.nl> Op 4/10/2013 11:39 AM, Daniel Piddock schreef: > On 09/04/13 16:43, Stephan Bosch wrote: >> Op 4/9/2013 4:04 PM, Daniel Piddock schreef: >>> What's the best way to start debugging? >> If it is re-occurring for the same user and script, something is >> definitely wrong. From what version are you upgrading? >> >> You can send me the .sieve and the .svbin so that I can see what is >> going on. > We were upgrading from Dovecot 2.1.15 and Pigeonhole 0.3.3. Somebody > noticed that the .svbin wasn't actually being updated hence the regular > error. If Sieve fails to save the binary, some errors should be logged somewhere about that. E.g. sieve: binary save: failed to create temporary file: ... sieve: binary save: failed to save binary: ... Did you miss something in the logs? > Deleting the files forced pigeonhole to recreate them properly > and the warnings stopped happening. > > [sent .svbin and .sieve off list] This happens due to a change in the binary format of the vnd.dovecot.duplicate extension. I should have increased the global binary version number for this. This is cumbersome, so for Pigeonhole v0.4 extensions have their own version number. Version mismatches cause a (silent) recompile, avoiding these warnings. Regards, Stephan. From hylke at movinsoftware.nl Wed Apr 10 12:20:08 2013 From: hylke at movinsoftware.nl (HylkeB) Date: Wed, 10 Apr 2013 02:20:08 -0700 (PDT) Subject: [Dovecot] My old email is not stored Message-ID: <1365585608466-41478.post@n4.nabble.com> Hi, Im have not much experience with dovecot, postfix or debian, which i am using for my email server. But the thing is, everything worked just fine, until I found out that old emails were missing, only emails of a few months old exist on my server. I have no idea if this is a setting in dovecot, postfix or debian, or that something weird happened. But my question is, is there a setting in either dovecot, postfix or debian that i should check that could cause this behaviour, and if so, how do i check that? (opening and checking a conf file for example, or executing some commands in PuTTy). And if this is somehow default behaviour that cannot be changed, is there some other way to store all emails ever entered my inbox? Sincerely, Hylke Bron -- View this message in context: http://dovecot.2317879.n4.nabble.com/My-old-email-is-not-stored-tp41478.html Sent from the Dovecot mailing list archive at Nabble.com. From bind at enas.net Wed Apr 10 13:47:33 2013 From: bind at enas.net (Urban Loesch) Date: Wed, 10 Apr 2013 12:47:33 +0200 Subject: [Dovecot] My old email is not stored In-Reply-To: <1365585608466-41478.post@n4.nabble.com> References: <1365585608466-41478.post@n4.nabble.com> Message-ID: <51654345.5050602@enas.net> Hi, perhaps you are using POP3 in your mail client and have you have enabled the setting to delete mails on server after a few months. Change to IMAP and you leave all messages on the server. reagards urban On 10.04.2013 11:20, HylkeB wrote: > Hi, > > Im have not much experience with dovecot, postfix or debian, which i am > using for my email server. > > But the thing is, everything worked just fine, until I found out that old > emails were missing, only emails of a few months old exist on my server. I > have no idea if this is a setting in dovecot, postfix or debian, or that > something weird happened. > > But my question is, is there a setting in either dovecot, postfix or debian > that i should check that could cause this behaviour, and if so, how do i > check that? (opening and checking a conf file for example, or executing some > commands in PuTTy). > > And if this is somehow default behaviour that cannot be changed, is there > some other way to store all emails ever entered my inbox? > > Sincerely, > > Hylke Bron > > > > -- > View this message in context: http://dovecot.2317879.n4.nabble.com/My-old-email-is-not-stored-tp41478.html > Sent from the Dovecot mailing list archive at Nabble.com. > From Juergen.Obermann at hrz.uni-giessen.de Wed Apr 10 14:12:15 2013 From: Juergen.Obermann at hrz.uni-giessen.de (=?iso-8859-1?b?SvxyZ2Vu?= Obermann) Date: Wed, 10 Apr 2013 13:12:15 +0200 Subject: [Dovecot] failed compiling dovecot 2.1.16 under solaris In-Reply-To: <445D3917-07C5-4A69-B342-8C069DF60B5D@iki.fi> References: <445D3917-07C5-4A69-B342-8C069DF60B5D@iki.fi> Message-ID: <20130410131215.63251yc2jrjc20ww@webmail.hrz.uni-giessen.de> Am Di, 09 Apr 2013 schrieb Timo Sirainen: > On 9.4.2013, at 18.29, J?rgen Obermann > wrote: > >> "quota-status.c", line 200: undefined symbol: optarg >> "quota-status.c", line 200: warning: improper pointer/integer >> combination: arg #1 >> cc: acomp failed for quota-status.c >> >> + #include > > What about with stdio.h? That's the correct one according to man page. > > > With stdio.h it compiles OK too. -- Hochschulrechenzentrum der | Mail: Juergen.Obermann at hrz.uni-giessen.de Justus-Liebig-Universitaet | WWW: http://www.uni-giessen.de/obermann/ Heinrich-Buff-Ring 44 | Tel: 0641-99-13054 (0641-99-13001) D-35392 Giessen, Germany | Fax: 0641-99-13009 From skdovecot at smail.inf.fh-brs.de Wed Apr 10 14:41:42 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 10 Apr 2013 13:41:42 +0200 (CEST) Subject: [Dovecot] My old email is not stored In-Reply-To: <1365585608466-41478.post@n4.nabble.com> References: <1365585608466-41478.post@n4.nabble.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 10 Apr 2013, HylkeB wrote: > But the thing is, everything worked just fine, until I found out that old > emails were missing, only emails of a few months old exist on my server. I > have no idea if this is a setting in dovecot, postfix or debian, or that > something weird happened. I guess, that this is a client issue. Check, if your client has an "archieve" option or something like that. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUWVP9l3r2wJMiz2NAQKhogf/aV82O8eAkpEfMZAFY+SYvg8IdDFlmDL0 J56smFWBvUdSwTB9fr2kwKrT5NW/Tiruew5TS2/Mga+G5YVV2h0nRaohYLWJIs7M nq26wxT85kVIgWCRMc5mGvGAkHlrXIWES7x/qmQNELbT31z4HiZxeCPmsO5ZyKFZ vj5QCZZzz5Fd6JQ9Kwh+1PhYjkMjVta3RGB9LtP3CDnVLFuqZKWaI380HmzhThLa FCThkMCdZegRus5mHAnOin+L8VGbekoIUzh8+58Sc+FJxh5EEiGQSlmTyotUrIYN CqbnlaaUD7OoO8grDiLARPtL5PAjqhUC4lWmbrqTqgPUZyNhn6DVeA== =Gx3S -----END PGP SIGNATURE----- From hylke at movinsoftware.nl Wed Apr 10 14:58:03 2013 From: hylke at movinsoftware.nl (HylkeB) Date: Wed, 10 Apr 2013 04:58:03 -0700 (PDT) Subject: [Dovecot] My old email is not stored In-Reply-To: References: <1365585608466-41478.post@n4.nabble.com> Message-ID: <1365595083107-41487.post@n4.nabble.com> If it is a client issue, than thats fine. But then i wonder what the vmail/domain.com/email_name/Maildir/cur folder is for, because in there i can find the inbox of the last 14 days. Cant my emails be stored there for a longer (or infinite) time? It is not really an issue that i need to save my emails locally, but when i log in on a webclient to view emails, i dont see all emails, and when i installed my new computer a few weeks ago, i did also not have all my emails (since they are no longer on the server). Awnsering to an earlier reply: I am using pop3, not imap. Is it wise to change to imap? or shouldnt i bother that not all emails are stored on the server? And how do i change pop3 to imap? and lastly, when i were to change from pop3 to imap, how big are the changes that i mess up completely and i break the email server (which is a major problem). Sincerely, Hylke Bron -- View this message in context: http://dovecot.2317879.n4.nabble.com/My-old-email-is-not-stored-tp41478p41487.html Sent from the Dovecot mailing list archive at Nabble.com. From h.reindl at thelounge.net Wed Apr 10 15:05:22 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Wed, 10 Apr 2013 14:05:22 +0200 Subject: [Dovecot] My old email is not stored In-Reply-To: <1365595083107-41487.post@n4.nabble.com> References: <1365585608466-41478.post@n4.nabble.com> <1365595083107-41487.post@n4.nabble.com> Message-ID: <51655582.4010406@thelounge.net> Am 10.04.2013 13:58, schrieb HylkeB: > If it is a client issue, than thats fine. it is > But then i wonder what the vmail/domain.com/email_name/Maildir/cur folder is > for, because in there i can find the inbox of the last 14 days. Cant my > emails be stored there for a longer (or infinite) time? It is not really an > issue that i need to save my emails locally, but when i log in on a > webclient to view emails, i dont see all emails, and when i installed my new > computer a few weeks ago, i did also not have all my emails (since they are > no longer on the server) normally POP3 is configured to delete received messages after some days/weeks and it is not smart to disable this becuase if you have your local mailarchive and get a new computer you will receive ALL your mails again > Awnsering to an earlier reply: I am using pop3, not imap. Is it wise to > change to imap? or shouldnt i bother that not all emails are stored on the > server? nobody can answer this for you > And how do i change pop3 to imap? you can't you have to create a new mail-account and select IMAP in your client > and lastly, when i were to change > from pop3 to imap, how big are the changes that i mess up completely and i > break the email server (which is a major problem) depends on the storage of your server, on teh amount of mails, on the size of mails these are all questions that NOBODY can answer for you maybe the admin of your mailserver can, hopefully you are not -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From heupink at merit.unu.edu Wed Apr 10 15:11:47 2013 From: heupink at merit.unu.edu (mourik jan heupink) Date: Wed, 10 Apr 2013 14:11:47 +0200 Subject: [Dovecot] thunderbird detach attachment In-Reply-To: <51653A8F.1090803@cs.ucy.ac.cy> References: <516527DE.2050804@merit.unu.edu> <51653A8F.1090803@cs.ucy.ac.cy> Message-ID: <51655703.20001@merit.unu.edu> Hi all, Ow... too shortsighted..! You are right, it DOES work. The attachment is still there, but with empty contents. Thanks and sorry to bother you! MJ On 4/10/2013 12:10 PM, Andreas Kasenides wrote: > This looks to work on my 17.0.5 Thunderbird on CentOS 6.4 > (I guess Dovecot is not involved but running on 2.2.beta1). > It does detach the file, places it in the chosen folder, removes the > option to detach or delete from the message menu > but (nice indeed) remembers where you put the attachment and can still > show it if you click on it or save it again if you want to!! > > But how do we know its been detached if it still shows in Thunderbird? > Looking into the actual message file I see the following at the end: > > --------------020104000205010901050407 > Content-Type: application/vnd.oasis.opendocument.text; > name="=?UTF-8?B?MjAxMzA0MDQtzpPOoy5vZHQ=?=" > Content-Disposition: attachment; filename="20130404-??.odt" > X-Mozilla-External-Attachment-URL: > file:///LocalData/tmp/20130404-%CE%93%CE%A3.odt > X-Mozilla-Altered: AttachmentDetached; date="Wed Apr 10 12:51:00 2013" > > You deleted an attachment from this message. The original MIME headers > for the attachment were: > Content-Type: application/vnd.oasis.opendocument.text; > name="=?UTF-8?B?MjAxMzA0MDQtzpPOoy5vZHQ=?=" > Content-Transfer-Encoding: base64 > Content-Disposition: attachment; > filename*=UTF-8''%32%30%31%33%30%34%30%34%2D%CE%93%CE%A3%2E%6F%64%74 > > > --------------020104000205010901050407-- > > Nice!! > > Andreas > > > > On 10/04/13 11:50, mourik jan heupink wrote: >> Hi all, >> >> Thunderbird has an option to detach attachments from (for example) >> sent items. I've tried it, and it does not work, and also in the >> dovecot logs I don't see anything interesting meanwhile. >> >> Before looking deeper into this: Does anyone here know if this option >> is known to work, or not? >> >> We're running dovecot 2.1.7 on debian wheezy. >> >> Removing unwanted attachments is a nice way to keep mail archives >> smaller... >> >> Thanks, >> MJ >> >> > > From CMarcus at Media-Brokers.com Wed Apr 10 15:17:22 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 10 Apr 2013 08:17:22 -0400 Subject: [Dovecot] My old email is not stored In-Reply-To: <51655582.4010406@thelounge.net> References: <1365585608466-41478.post@n4.nabble.com> <1365595083107-41487.post@n4.nabble.com> <51655582.4010406@thelounge.net> Message-ID: <51655852.1050706@Media-Brokers.com> On 2013-04-10 8:05 AM, Reindl Harald wrote: > normally POP3 is configured to delete received messages after some > days/weeks and it is not smart to disable this becuase if you have > your local mailarchive and get a new computer you will receive ALL > your mails again Actually, normally POP3 defaults to deleting the messages *immediately* after being downloaded. POP3 is simply not designed for permanent server storage. As has already been explained, if you want to access your email from multiple devices and always see them, just switch to IMAP and be done with it. Playing with the POP3 settings to 'keep messages on the server' has always been problematic. -- Best regards, Charles From hylke at movinsoftware.nl Wed Apr 10 15:22:51 2013 From: hylke at movinsoftware.nl (HylkeB) Date: Wed, 10 Apr 2013 05:22:51 -0700 (PDT) Subject: [Dovecot] My old email is not stored In-Reply-To: <51655582.4010406@thelounge.net> References: <1365585608466-41478.post@n4.nabble.com> <1365595083107-41487.post@n4.nabble.com> <51655582.4010406@thelounge.net> Message-ID: <1365596571713-41491.post@n4.nabble.com> >normally POP3 is configured to delete received messages >after some days/weeks and it is not smart to disable this >becuase if you have your local mailarchive and get a new >computer you will receive ALL your mails again Well, receiving ALL mails again, might not be too handy, but 14 days is a quite short time. So can i change the pop3 settings so old emails are stored for e.g. 3 months instead of 14 days? And just curious, where can i disable the configuration that pop3 deletes received messages? >these are all questions that NOBODY can answer for you >maybe the admin of your mailserver can, hopefully you are not Well I am the admin for now, but when business gets more successful i might hire someone who can set up the email server the right way; someone who knows what he is doing. But for now, as long as everything works its good. -- View this message in context: http://dovecot.2317879.n4.nabble.com/My-old-email-is-not-stored-tp41478p41491.html Sent from the Dovecot mailing list archive at Nabble.com. From rs at sys4.de Wed Apr 10 15:25:39 2013 From: rs at sys4.de (Robert Schetterer) Date: Wed, 10 Apr 2013 14:25:39 +0200 Subject: [Dovecot] My old email is not stored In-Reply-To: <1365596571713-41491.post@n4.nabble.com> References: <1365585608466-41478.post@n4.nabble.com> <1365595083107-41487.post@n4.nabble.com> <51655582.4010406@thelounge.net> <1365596571713-41491.post@n4.nabble.com> Message-ID: <51655A43.9090001@sys4.de> Am 10.04.2013 14:22, schrieb HylkeB: > And just curious, where can i disable the configuration that pop3 deletes > received messages? thats a function of your pop3 clients, configure it there Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From CMarcus at Media-Brokers.com Wed Apr 10 15:27:50 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 10 Apr 2013 08:27:50 -0400 Subject: [Dovecot] My old email is not stored In-Reply-To: <1365596571713-41491.post@n4.nabble.com> References: <1365585608466-41478.post@n4.nabble.com> <1365595083107-41487.post@n4.nabble.com> <51655582.4010406@thelounge.net> <1365596571713-41491.post@n4.nabble.com> Message-ID: <51655AC6.5010903@Media-Brokers.com> On 2013-04-10 8:22 AM, HylkeB wrote: > Well, receiving ALL mails again, might not be too handy, but 14 days > is a quite short time. So can i change the pop3 settings so old > emails are stored for e.g. 3 months instead of 14 days? And just > curious, where can i disable the configuration that pop3 deletes > received messages? As has already been explained to you, these POP3 settings are CLIENT SPECIFIC. There is nothing that you can set on the SERVER to enforce it. You can have one client set to leave them on the server for as long as you want, and the second you set up your account as POP on another device and it connects, bam, all your messages are gone (unless you ALWAYS remember to change the setting BEFORE you ever connect to the account). Again - just switch to IMAP and be done with it. -- Best regards, Charles From h.reindl at thelounge.net Wed Apr 10 15:30:01 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Wed, 10 Apr 2013 14:30:01 +0200 Subject: [Dovecot] My old email is not stored In-Reply-To: <1365596571713-41491.post@n4.nabble.com> References: <1365585608466-41478.post@n4.nabble.com> <1365595083107-41487.post@n4.nabble.com> <51655582.4010406@thelounge.net> <1365596571713-41491.post@n4.nabble.com> Message-ID: <51655B49.30709@thelounge.net> Am 10.04.2013 14:22, schrieb HylkeB: >> normally POP3 is configured to delete received messages >> after some days/weeks and it is not smart to disable this >> becuase if you have your local mailarchive and get a new >> computer you will receive ALL your mails again > > Well, receiving ALL mails again, might not be too handy, but 14 days is a > quite short time. > So can i change the pop3 settings so old emails are stored for e.g. 3 months > instead of 14 days? > And just curious, where can i disable the configuration that pop3 deletes > received messages? why not type in google " POP3 settings" >> these are all questions that NOBODY can answer for you >> maybe the admin of your mailserver can, hopefully you are not > > Well I am the admin for now, but when business gets more successful i might > hire someone who can set up the email server the right way; someone who > knows what he is doing. But for now, as long as everything works its good it is a serious problem if people which even can not handle a mail-client maintain critical things like public mailservers because the critical is not only your problem, it becomes very fast a problem for ANYBODY which maintains a proper mailservice and has to fight against you spam caused by wrong configurations (open-relay) -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From dgp-dove at corefiling.co.uk Wed Apr 10 18:53:21 2013 From: dgp-dove at corefiling.co.uk (Daniel Piddock) Date: Wed, 10 Apr 2013 16:53:21 +0100 Subject: [Dovecot] Pigeonhole 0.3.4: Warning: sieve: encountered corrupt binary: re-compiling script In-Reply-To: <51653D5C.9060704@rename-it.nl> References: <51641FDE.70308@corefiling.co.uk> <5164370D.40400@rename-it.nl> <5165336F.7050309@corefiling.co.uk> <51653D5C.9060704@rename-it.nl> Message-ID: <51658AF1.5020306@corefiling.co.uk> On 10/04/13 11:22, Stephan Bosch wrote: > Op 4/10/2013 11:39 AM, Daniel Piddock schreef: >> On 09/04/13 16:43, Stephan Bosch wrote: >>> Op 4/9/2013 4:04 PM, Daniel Piddock schreef: >>>> What's the best way to start debugging? >>> If it is re-occurring for the same user and script, something is >>> definitely wrong. From what version are you upgrading? >>> >>> You can send me the .sieve and the .svbin so that I can see what is >>> going on. >> We were upgrading from Dovecot 2.1.15 and Pigeonhole 0.3.3. Somebody >> noticed that the .svbin wasn't actually being updated hence the regular >> error. > > If Sieve fails to save the binary, some errors should be logged > somewhere about that. E.g. > > sieve: binary save: failed to create temporary file: ... > sieve: binary save: failed to save binary: ... > > Did you miss something in the logs? We use syslog for logging. I've check mail.info, there's just the two lines mentioned before: lmtp throws a warning about corrupt binary and then reports storing the mail. There's nothing in the per-user .dovecot.sieve.log I'm not sure where else to check. >> Deleting the files forced pigeonhole to recreate them properly >> and the warnings stopped happening. >> >> [sent .svbin and .sieve off list] > > This happens due to a change in the binary format of the > vnd.dovecot.duplicate extension. I should have increased the global > binary version number for this. This is cumbersome, so for Pigeonhole > v0.4 extensions have their own version number. Version mismatches > cause a (silent) recompile, avoiding these warnings. At least that explains the problem. Cheers, Dan From hummel at pasteur.fr Wed Apr 10 19:28:47 2013 From: hummel at pasteur.fr (Thomas Hummel) Date: Wed, 10 Apr 2013 18:28:47 +0200 Subject: [Dovecot] Maildirs location migration In-Reply-To: <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> References: <20130403154220.GA25793@parmesan.sis.pasteur.fr> <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> Message-ID: <20130410162847.GB7798@parmesan.sis.pasteur.fr> On Thu, Apr 04, 2013 at 10:27:57PM +0300, Timo Sirainen wrote: > http://wiki2.dovecot.org/Tools/Dsync#example_converting works for moving mailboxes as well as converting. It works even while procmail is used to deliver mails. Thanks. I guess it works with conversion from Maildir to Maildir somewhere else too, right. So basically, it works as with conventional data moved with rsync in 2 phases (initial copy and sync of the (hopefully small) reminder to minimize ?downtime? or incomplete state except that dsync is used to have the mailbox format and dovecot knowledge, right ? -- Thomas Hummel | Institut Pasteur | Groupe Exploitation et Infrastructure From hummel at pasteur.fr Wed Apr 10 19:59:15 2013 From: hummel at pasteur.fr (Thomas Hummel) Date: Wed, 10 Apr 2013 18:59:15 +0200 Subject: [Dovecot] Maildirs location migration In-Reply-To: <20130410162847.GB7798@parmesan.sis.pasteur.fr> References: <20130403154220.GA25793@parmesan.sis.pasteur.fr> <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> <20130410162847.GB7798@parmesan.sis.pasteur.fr> Message-ID: <20130410165915.GD7798@parmesan.sis.pasteur.fr> On Wed, Apr 10, 2013 at 06:28:47PM +0200, Thomas Hummel wrote: > So basically, it works as with conventional data moved with rsync in 2 phases > (initial copy and sync of the (hopefully small) reminder to minimize ?downtime? > or incomplete state except that dsync is used to have the mailbox format and > dovecot knowledge, right ? Isn't there still a critical section : new imap connections could be created (if auth is not denied temporary for this user) while the final sync still to be finished or started ? Thanks. -- Thomas Hummel | Institut Pasteur | Groupe Exploitation et Infrastructure From tss at iki.fi Wed Apr 10 21:21:40 2013 From: tss at iki.fi (Timo Sirainen) Date: Wed, 10 Apr 2013 21:21:40 +0300 Subject: [Dovecot] Maildirs location migration In-Reply-To: <20130410165915.GD7798@parmesan.sis.pasteur.fr> References: <20130403154220.GA25793@parmesan.sis.pasteur.fr> <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> <20130410162847.GB7798@parmesan.sis.pasteur.fr> <20130410165915.GD7798@parmesan.sis.pasteur.fr> Message-ID: <1365618100.11047.180.camel@innu> On Wed, 2013-04-10 at 18:59 +0200, Thomas Hummel wrote: > On Wed, Apr 10, 2013 at 06:28:47PM +0200, Thomas Hummel wrote: > > > So basically, it works as with conventional data moved with rsync in 2 phases > > (initial copy and sync of the (hopefully small) reminder to minimize ?downtime? > > or incomplete state except that dsync is used to have the mailbox format and > > dovecot knowledge, right ? > > Isn't there still a critical section : new imap connections could be created > (if auth is not denied temporary for this user) while the final sync still to > be finished or started ? Not if you kick the users out at the correct time: - dsync - switch user to new format - kick users - final dsync It doesn't matter if new connections arrive during the final dsync, because they are using the new format already. dsync merges changes, it doesn't destroy any changes. From tss at iki.fi Wed Apr 10 23:46:36 2013 From: tss at iki.fi (Timo Sirainen) Date: Wed, 10 Apr 2013 23:46:36 +0300 Subject: [Dovecot] v2.2.rc7 released Message-ID: <1365626796.11047.191.camel@innu> http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc7.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc7.tar.gz.sig OK, still not quite v2.2.0, but now it's definitely very close. :) * checkpasword: AUTH_PASSWORD environment is no longer set. * Running dsync no longer triggers quota warnings. + dsync: Commit large transactions every 100 new messages, so if a large sync crashes it doesn't have to be restarted from the beginning. - replicator: doveadm commands and user list export may have skipped some users. - Various fixes to mailbox_list_index=yes From msmith at giganews.com Wed Apr 10 23:52:08 2013 From: msmith at giganews.com (Michael Smith) Date: Wed, 10 Apr 2013 20:52:08 +0000 Subject: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot In-Reply-To: <2DAEBE3C-53D8-4858-8067-3398CCF3B4BF@iki.fi> References: <62CA7D02-69DA-47C4-9CE7-4A8D9518670F@iki.fi> <2DAEBE3C-53D8-4858-8067-3398CCF3B4BF@iki.fi> Message-ID: It shouldn't. Part of the migration is to remove any existing dovecot mailbox for the user. It does this by deleting the entire user's directory. I just downloaded the file and checked. Oops, looks like I grabbed the post dsync mirror file. I've uploaded the correct file (pre dsync mirror). Downloaded it and confirmed I'm getting the following error on dsync mirror. dsync(webmail): Error: Sync failed for mbox file /var/opt/migrate/users/webmail/inbox: seq=4482 uid=4482 uid_broken=0 originally needed 10 bytes, now needs 12 bytes -- Michael Smith -----Original Message----- From: Timo Sirainen [mailto:tss at iki.fi] Sent: Tuesday, April 09, 2013 4:05 PM To: Michael Smith Cc: 'dovecot at dovecot.org' Subject: Re: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot On 9.4.2013, at 1.41, Michael Smith wrote: > I tried importing the anonymized file, and there were no errors. So, it's something with the actual data. UTF-8 issues? > > While I can't send you a raw customer's mailbox, one of the failures is a 'role' account mailbox, with no critical/useful data in it. > > Here is a link (expires in 30 days) to download the mailbox, it's 107M. > https://truck.it/p/HNlzl9hWbO > > The error I'm getting is > dsync(webmail): Error: Sync failed for mbox file /var/opt/migrate/users/webmail/inbox: seq=4482 uid=4482 uid_broken=0 originally needed 10 bytes, now needs 12 bytes I can't reproduce with that file, dsync succeeds without errors. Maybe the problem requires something specific in the index files also? From tonio at starbridge.org Thu Apr 11 08:59:09 2013 From: tonio at starbridge.org (Tonio) Date: Thu, 11 Apr 2013 07:59:09 +0200 Subject: [Dovecot] crash with dovecot 2.2: Panic: Buffer full In-Reply-To: References: <51446ACC.4060900@starbridge.org> <1363614474.10326.173.camel@innu> <6E5E2CD1-FD6F-4374-8D64-585E49128EC0@starbridge.org> <5161CD52.2070504@starbridge.org> <1365368201.11047.138.camel@innu> <516327D9.1040605@starbridge.org> Message-ID: Le 9 avr. 2013 ? 22:56, Timo Sirainen a ?crit : > On 8.4.2013, at 23.26, tonio at starbridge.org wrote: > >> imap(clean-quarantine at spamguard.fr): Panic: file istream.c: line 153 >> (i_stream_read): assertion failed: (_stream->skip != _stream->pos) > > http://hg.dovecot.org/dovecot-2.2/rev/fbef40826602 should fix this. > Thanks Timo Its ok now Regards Tonio From dovecot at lists.wgwh.ch Thu Apr 11 09:06:58 2013 From: dovecot at lists.wgwh.ch (Oli Schacher) Date: Thu, 11 Apr 2013 08:06:58 +0200 Subject: [Dovecot] v2.2.rc7 released In-Reply-To: <1365626796.11047.191.camel@innu> References: <1365626796.11047.191.camel@innu> Message-ID: <20130411080658.645e9a41@lists.wgwh.ch> On Wed, 10 Apr 2013 23:46:36 +0300 Timo Sirainen wrote: > OK, still not quite v2.2.0, but now it's definitely very close. :) Looking forward to the release, thank you! > * Running dsync no longer triggers quota warnings. Not sure if you saw my last post about this change.. it works but now maillog always shows these empty error messages after executing the quota script: Apr 11 07:55:08 fumailsynctest1 dovecot: lda(quotatest at munged): msgid=<20130411055508.10728.76331 at fumailsynctest1.munged>: saved mail to INBOX Apr 11 07:55:08 fumailsynctest1 dovecot: quota-warning: Error: close failed in file object destructor: Apr 11 07:55:08 fumailsynctest1 dovecot: quota-warning: Error: Error in sys.excepthook: Apr 11 07:55:08 fumailsynctest1 dovecot: quota-warning: Error: Apr 11 07:55:08 fumailsynctest1 dovecot: quota-warning: Error: Original exception was: -- message transmitted on 100% recycled electrons From dovecot at lists.wgwh.ch Thu Apr 11 09:27:17 2013 From: dovecot at lists.wgwh.ch (Oli Schacher) Date: Thu, 11 Apr 2013 08:27:17 +0200 Subject: [Dovecot] v2.2.rc7 released In-Reply-To: <20130411080658.645e9a41@lists.wgwh.ch> References: <1365626796.11047.191.camel@innu> <20130411080658.645e9a41@lists.wgwh.ch> Message-ID: <20130411082717.4057c2d3@lists.wgwh.ch> On Thu, 11 Apr 2013 08:06:58 +0200 Oli Schacher wrote: > Error in sys.excepthook: ... and after the first coffee I realize the error is generated by our python quota script and not by dovecot. I wonder why this only showed up since this change... sorry for the noise. -- message transmitted on 100% recycled electrons From Mark.Zealey at webfusion.com Thu Apr 11 11:28:54 2013 From: Mark.Zealey at webfusion.com (Mark Zealey) Date: Thu, 11 Apr 2013 08:28:54 +0000 Subject: [Dovecot] [PATCH proposal] make dsync preserve pop3_uidl_format Message-ID: <420B5E34BFEE9646B7198438F9978AE223EEF504@MAIL03.internal.webfusion.com> Hi there, I ran into an issue yesterday (dovecot 2.0) whereby when we dsync messages from a local machine (sdbox) to a remote (Maildir) which have different pop3_uidl_formats configured, the uidl format is not preserved. There doesn't seem to be any way to force this in the code, although I suspect that Maildir sources with saved pop3 uidls would pass them correctly. Attached is a rough patch against 2.0.21 dsync which will generate the uidls on the client before passing them over to the destination. This only works for %u and %v currently, also because dsync doesn't read the whole config file you need to specify -o pop3_uidl_format=... to dsync. Mark -------------- next part -------------- A non-text attachment was scrubbed... Name: dsync-save-uidl-format.patch Type: text/x-patch Size: 1694 bytes Desc: dsync-save-uidl-format.patch URL: From manu at netbsd.org Thu Apr 11 11:41:54 2013 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Thu, 11 Apr 2013 08:41:54 +0000 Subject: [Dovecot] [PATCHES] NetBSD support, authentication buffer size Message-ID: <20130411084154.GE14934@homeworld.netbsd.org> Hi Here are a few unintegrated patches, just tested against 2.2rc7: 1) NetBSD's getmntinfo uses struct statvfs while other BSD use struct statfs http://ftp.espci.fr/shadow/manu/patch-ak 2) NetBSD 5.x net_getunixcred() support. Build on NetBSD, but not tested (I am testing on NetBSD 6.0): http://ftp.espci.fr/shadow/manu/patch-src_lib_net.c 3) Increase authentication buffer size so that it can cope with unusual authentication scheme. This patch was integrated in dovecot-1.x but did not make its way in dovecot-2.x http://ftp.espci.fr/shadow/manu/patch-src_lib-master_master-auth.h -- Emmanuel Dreyfus manu at netbsd.org From hylke at movinsoftware.nl Thu Apr 11 12:00:27 2013 From: hylke at movinsoftware.nl (HylkeB) Date: Thu, 11 Apr 2013 02:00:27 -0700 (PDT) Subject: [Dovecot] My old email is not stored In-Reply-To: <51655AC6.5010903@Media-Brokers.com> References: <1365585608466-41478.post@n4.nabble.com> <1365595083107-41487.post@n4.nabble.com> <51655582.4010406@thelounge.net> <1365596571713-41491.post@n4.nabble.com> <51655AC6.5010903@Media-Brokers.com> Message-ID: <1365670827411-41506.post@n4.nabble.com> >> Well, receiving ALL mails again, might not be too handy, but 14 days >> is a quite short time. So can i change the pop3 settings so old >> emails are stored for e.g. 3 months instead of 14 days? And just >> curious, where can i disable the configuration that pop3 deletes >> received messages? >As has already been explained to you, these POP3 settings are CLIENT >SPECIFIC. There is nothing that you can set on the SERVER to enforce it. >You can have one client set to leave them on the server for as long as >you want, and the second you set up your account as POP on another >device and it connects, bam, all your messages are gone (unless you >ALWAYS remember to change the setting BEFORE you ever connect to the >account). I see now, took some time for me to sink in. Is there any way on the server to disable the pop3 protocol, so all email users cant accidently use pop3 and delete all their old emails? I suppose i would have to do something like the following on the server: - open dovecot.conf - change the first line (currently its protocols = imap imaps pop3 pop3s), and remove pop3 and pop3s - maybe delete/change something in this piece of code in dovecot.conf: protocol pop3 { pop3_uidl_format = %08Xu%08Xv } - restart dovecot (and maybe some other applications?) So is this the right way to disable the pop3 protocol in my mail server? I dont want to crash the mail server by disabling pop3. And about me being the admin of the mailserver, thanks to you guys im going to search for a company that can maintain the server stuff for me (hiring someone is too expensive for now), for they have more experience in servers and know what to do. Do you have any tips about what is important knowledge that an external company must have to properly maintain my server system? (mail server, backup, security etc) And thanks for all your help. -- View this message in context: http://dovecot.2317879.n4.nabble.com/My-old-email-is-not-stored-tp41478p41506.html Sent from the Dovecot mailing list archive at Nabble.com. From david at cryptix.de Thu Apr 11 12:04:19 2013 From: david at cryptix.de (David Obando) Date: Thu, 11 Apr 2013 11:04:19 +0200 Subject: [Dovecot] Postfix/Dovecot/lmtp with virtual and local users In-Reply-To: <847AC10A-AF94-4320-8BE8-8237D11EC6E8@iki.fi> References: <514B14CE.5040409@cryptix.de> <1363942136.13923.48.camel@innu> <514C29FD.9060300@cryptix.de> <847AC10A-AF94-4320-8BE8-8237D11EC6E8@iki.fi> Message-ID: <51667C93.7040506@cryptix.de> Hi, thanks for the answer. Do I understand you right that currently it's not possible to manage both system users and virtual users in a dovecot 2 and lmtp setup? You were talking about "adding a generic passdb/userdb { auth_username_format } setting". Are there any plans to do so? What are your recommendations about migrating from dovecot 1.2.15 to dovecot 2 regarding system and virtual users? Should I use LDA instead of LMTP then? Thank you very much, David Timo Sirainen schrieb am 31.03.2013 10:53: > On 22.3.2013, at 11.53, David Obando wrote: > >> Timo Sirainen schrieb am 22.03.2013 09:48: >>> Maybe. Depends on your Dovecot version and passdb/userdb >>> configuration. So, doveconf -n output? >> I use version 2.1.7 from the backports repo on Debian Squeeze. >> >> passdb { >> args = /etc/dovecot/dovecot-sql.conf.ext >> driver = sql >> } >> passdb { >> driver = pam >> } > Nope, you can't currently do "user at domain" auth for sql and "user" for PAM. You could try using passdb checkpassword instead though, which allows you to script it any way you want. > >> userdb { >> args = /etc/dovecot/dovecot-sql.conf.ext >> driver = sql >> } >> userdb { >> driver = passwd >> } > Also userdb passwd can't do that. > > I've thought of adding a generic passdb/userdb { auth_username_format } setting, but that doesn't exist yet. Would be easy to do though.. > -- The day microsoft makes something that doesn't suck is the day they start making vacuum cleaners. gpg --keyserver pgp.mit.edu --recv-keys 1920BD87 Key fingerprint = 3326 32CE 888B DFF1 DED3 B8D2 105F 29CB 1920 BD87 From tss at iki.fi Thu Apr 11 12:22:50 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 11 Apr 2013 12:22:50 +0300 Subject: [Dovecot] v2.2.rc7 released In-Reply-To: <20130411080658.645e9a41@lists.wgwh.ch> References: <1365626796.11047.191.camel@innu> <20130411080658.645e9a41@lists.wgwh.ch> Message-ID: <30737261-6693-48C1-9CFC-2E1B987A58FB@iki.fi> On 11.4.2013, at 9.06, Oli Schacher wrote: >> * Running dsync no longer triggers quota warnings. > > Not sure if you saw my last post about this change.. it works but > now maillog always shows these empty error messages after executing the > quota script: > > Apr 11 07:55:08 fumailsynctest1 dovecot: lda(quotatest at munged): msgid=<20130411055508.10728.76331 at fumailsynctest1.munged>: saved mail to INBOX > Apr 11 07:55:08 fumailsynctest1 dovecot: quota-warning: Error: close failed in file object destructor: > Apr 11 07:55:08 fumailsynctest1 dovecot: quota-warning: Error: Error in sys.excepthook: > Apr 11 07:55:08 fumailsynctest1 dovecot: quota-warning: Error: > Apr 11 07:55:08 fumailsynctest1 dovecot: quota-warning: Error: Original exception was: Those errors come from your script. I don't see anything in the quota warning change that could have changed a behavior in your script. Maybe your script changed also around the same time? From tss at iki.fi Thu Apr 11 12:28:31 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 11 Apr 2013 12:28:31 +0300 Subject: [Dovecot] [PATCHES] NetBSD support, authentication buffer size In-Reply-To: <20130411084154.GE14934@homeworld.netbsd.org> References: <20130411084154.GE14934@homeworld.netbsd.org> Message-ID: <98BDC043-930F-4AC6-A6BC-7471E1FE4847@iki.fi> On 11.4.2013, at 11.41, Emmanuel Dreyfus wrote: > Here are a few unintegrated patches, just tested against 2.2rc7: > > 1) NetBSD's getmntinfo uses struct statvfs while other BSD use struct statfs > http://ftp.espci.fr/shadow/manu/patch-ak > > 2) NetBSD 5.x net_getunixcred() support. Build on NetBSD, but not tested > (I am testing on NetBSD 6.0): > http://ftp.espci.fr/shadow/manu/patch-src_lib_net.c OK, I'll add these. > 3) Increase authentication buffer size so that it can cope with > unusual authentication scheme. This patch was integrated in dovecot-1.x > but did not make its way in dovecot-2.x > http://ftp.espci.fr/shadow/manu/patch-src_lib-master_master-auth.h By this I think you don't mean special authentication mechanisms, or even AUTHENTICATE PLAIN mechanism, but you mean that someone is using LOGIN command in such a kludgy way that the password field is over 1024 bytes long? I'm not very interested in supporting that, at least without a good reason. From hummel at pasteur.fr Thu Apr 11 13:07:21 2013 From: hummel at pasteur.fr (Thomas Hummel) Date: Thu, 11 Apr 2013 12:07:21 +0200 Subject: [Dovecot] Maildirs location migration In-Reply-To: <1365618100.11047.180.camel@innu> References: <20130403154220.GA25793@parmesan.sis.pasteur.fr> <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> <20130410162847.GB7798@parmesan.sis.pasteur.fr> <20130410165915.GD7798@parmesan.sis.pasteur.fr> <1365618100.11047.180.camel@innu> Message-ID: <20130411100721.GB9527@parmesan.sis.pasteur.fr> On Wed, Apr 10, 2013 at 09:21:40PM +0300, Timo Sirainen wrote: > Not if you kick the users out at the correct time: > > - dsync > - switch user to new format > - kick users > - final dsync > > It doesn't matter if new connections arrive during the final dsync, > because they are using the new format already. dsync merges changes, it > doesn't destroy any changes. It doesn't destroy changes but the user may see an incorrect state for a small amount of time, doesn't he ? For instance (using dsync to change Maildir location from file1 to filer2) : . Maildir in source : message tagged as New . initial dsync . user read the message in the source, message is now tagges as Read . switch user to Maildir in destination . kick user . user reconnects and sees, in destination, the message he just read tagged as New as long as the final dsync is not finished ? -- Thomas Hummel | Institut Pasteur | Groupe Exploitation et Infrastructure From tss at iki.fi Thu Apr 11 13:09:18 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 11 Apr 2013 13:09:18 +0300 Subject: [Dovecot] Maildirs location migration In-Reply-To: <20130411100721.GB9527@parmesan.sis.pasteur.fr> References: <20130403154220.GA25793@parmesan.sis.pasteur.fr> <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> <20130410162847.GB7798@parmesan.sis.pasteur.fr> <20130410165915.GD7798@parmesan.sis.pasteur.fr> <1365618100.11047.180.camel@innu> <20130411100721.GB9527@parmesan.sis.pasteur.fr> Message-ID: On 11.4.2013, at 13.07, Thomas Hummel wrote: >> It doesn't matter if new connections arrive during the final dsync, >> because they are using the new format already. dsync merges changes, it >> doesn't destroy any changes. > > It doesn't destroy changes but the user may see an incorrect state for a small > amount of time, doesn't he ? For a small amount of time, yes. > For instance (using dsync to change Maildir location from file1 to filer2) : > > . Maildir in source : message tagged as New > . initial dsync > . user read the message in the source, message is now tagges as Read > . switch user to Maildir in destination > . kick user > . user reconnects and sees, in destination, the message he just read tagged > as New as long as the final dsync is not finished > > ? Which is probably a few seconds, so I don't see this as much of a problem. From hummel at pasteur.fr Thu Apr 11 13:21:03 2013 From: hummel at pasteur.fr (Thomas Hummel) Date: Thu, 11 Apr 2013 12:21:03 +0200 Subject: [Dovecot] Maildirs location migration In-Reply-To: References: <20130403154220.GA25793@parmesan.sis.pasteur.fr> <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> <20130410162847.GB7798@parmesan.sis.pasteur.fr> <20130410165915.GD7798@parmesan.sis.pasteur.fr> <1365618100.11047.180.camel@innu> <20130411100721.GB9527@parmesan.sis.pasteur.fr> Message-ID: <20130411102103.GC9527@parmesan.sis.pasteur.fr> On Thu, Apr 11, 2013 at 01:09:18PM +0300, Timo Sirainen wrote: > Which is probably a few seconds, so I don't see this as much of a problem. Ok, thanks. -- Thomas Hummel | Institut Pasteur | Groupe Exploitation et Infrastructure From tss at iki.fi Thu Apr 11 13:22:06 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 11 Apr 2013 13:22:06 +0300 Subject: [Dovecot] Postfix/Dovecot/lmtp with virtual and local users In-Reply-To: <51667C93.7040506@cryptix.de> References: <514B14CE.5040409@cryptix.de> <1363942136.13923.48.camel@innu> <514C29FD.9060300@cryptix.de> <847AC10A-AF94-4320-8BE8-8237D11EC6E8@iki.fi> <51667C93.7040506@cryptix.de> Message-ID: <1365675726.11047.196.camel@innu> On Thu, 2013-04-11 at 11:04 +0200, David Obando wrote: > Hi, > > thanks for the answer. > Do I understand you right that currently it's not possible to manage > both system users and virtual users in a dovecot 2 and lmtp setup? If you have only a single domain, set auth_username_format=%Ln and configure your virtual userdb to work without @domain. Or you could switch to using only virtual users, and have your MTA forward the local users' mails to virtual users. Or you could use userdb checkpassword instead of passwd, which strips away the domain before doing a passwd lookup. > You were talking about "adding a generic passdb/userdb { > auth_username_format } setting". Are there any plans to do so? Sure, but as to when I'll actually implement it, no idea. It's not a big priority right now (although it would probably be pretty quick to implement). > What are your recommendations about migrating from dovecot 1.2.15 to > dovecot 2 regarding system and virtual users? Should I use LDA instead > of LMTP then? That's one possibility too, yes. From tss at iki.fi Thu Apr 11 13:25:21 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 11 Apr 2013 13:25:21 +0300 Subject: [Dovecot] [PATCH proposal] make dsync preserve pop3_uidl_format In-Reply-To: <420B5E34BFEE9646B7198438F9978AE223EEF504@MAIL03.internal.webfusion.com> References: <420B5E34BFEE9646B7198438F9978AE223EEF504@MAIL03.internal.webfusion.com> Message-ID: <1365675921.11047.199.camel@innu> On Thu, 2013-04-11 at 08:28 +0000, Mark Zealey wrote: > I ran into an issue yesterday (dovecot 2.0) whereby when we dsync messages from a local machine (sdbox) to a remote (Maildir) which have different pop3_uidl_formats configured, the uidl format is not preserved. There doesn't seem to be any way to force this in the code, although I suspect that Maildir sources with saved pop3 uidls would pass them correctly. Attached is a rough patch against 2.0.21 dsync which will generate the uidls on the client before passing them over to the destination. This only works for %u and %v currently, also because dsync doesn't read the whole config file you need to specify -o pop3_uidl_format=... to dsync. Hmm. Tricky. The UIDL generation in pop3 code would have to be moved to somewhere more generic for this to fully work. That's a little bit annoying to do. Another possibility would be to use v2.1+ and imapc+pop3c, which would preserve POP3 UIDLs: http://wiki2.dovecot.org/Migration/Dsync From manu at netbsd.org Thu Apr 11 14:58:21 2013 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Thu, 11 Apr 2013 13:58:21 +0200 Subject: [Dovecot] [PATCHES] NetBSD support, authentication buffer size In-Reply-To: <98BDC043-930F-4AC6-A6BC-7471E1FE4847@iki.fi> Message-ID: <1l1617l.1mhdmtf1o3woghM%manu@netbsd.org> Timo Sirainen wrote: > By this I think you don't mean special authentication mechanisms, or even > AUTHENTICATE PLAIN mechanism, but you mean that someone is using LOGIN > command in such a kludgy way that the password field is over 1024 > bytes long? This is for pam_saml. The webmail sends a signed SAML assertion as the password, and the PAM module validates it. You did support in in 1.x and it did not harm anyone... -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz manu at netbsd.org From tss at iki.fi Thu Apr 11 14:54:01 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 11 Apr 2013 14:54:01 +0300 Subject: [Dovecot] [PATCHES] NetBSD support, authentication buffer size In-Reply-To: <1l1617l.1mhdmtf1o3woghM%manu@netbsd.org> References: <1l1617l.1mhdmtf1o3woghM%manu@netbsd.org> Message-ID: <987AE960-F63F-4DC5-9568-47031084896B@iki.fi> On 11.4.2013, at 14.58, manu at netbsd.org (Emmanuel Dreyfus) wrote: >> By this I think you don't mean special authentication mechanisms, or even >> AUTHENTICATE PLAIN mechanism, but you mean that someone is using LOGIN >> command in such a kludgy way that the password field is over 1024 >> bytes long? > > This is for pam_saml. The webmail sends a signed SAML assertion as the > password, and the PAM module validates it. The pam_saml could easily be changed to use AUTHENTICATE PLAIN instead. > You did support in in 1.x and it did not harm anyone? It does make it easier to waste the (pre-login!) process memory usage. From lists at wildgooses.com Thu Apr 11 15:06:49 2013 From: lists at wildgooses.com (Ed W) Date: Thu, 11 Apr 2013 13:06:49 +0100 Subject: [Dovecot] Proxying, pertinent values and features, SNI In-Reply-To: <20130404115609.07cb3739@batzmaru.gol.ad.jp> References: <20130403165922.33300812@batzmaru.gol.ad.jp> <515C00D5.9010008@wildgooses.com> <20130404115609.07cb3739@batzmaru.gol.ad.jp> Message-ID: <5166A759.10700@wildgooses.com> On 04/04/2013 03:56, Christian Balzer wrote: > 2. Despite the fact that it will be trivial for anybody to determine that > OEM A is now hosted with us, a SAN SSL makes all the SANs visible in one > go, something they probably don't want. But someone smart enough to be able to look at a certificate, is probably also smart enough to be able to go to http://robtex.com and do some reverse IP tests on your IPs... I think the difference is minor - even if you used a whole bunch of IPs, one per customer, if they are near each other, then a few google searches and some use of robtex will quickly show up your customer base Cheers Ed W From skraw at ithnet.com Thu Apr 11 15:07:36 2013 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Thu, 11 Apr 2013 14:07:36 +0200 Subject: [Dovecot] Easy way to make all mailboxes of a user read-only Message-ID: <20130411140736.70345e6a.skraw@ithnet.com> Hello all, I try to configure dovecot to make all imap accesses read-only for a certain user. I thought this would be possible by creating a global acl file (here "global-acl") like: user= lr and plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 } But that seems to be ignored. What is wrong with this idea, the docs are not really clear about a single acl file with global settings. -- Regards, Stephan From CMarcus at Media-Brokers.com Thu Apr 11 15:12:27 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 11 Apr 2013 08:12:27 -0400 Subject: [Dovecot] My old email is not stored In-Reply-To: <1365670827411-41506.post@n4.nabble.com> References: <1365585608466-41478.post@n4.nabble.com> <1365595083107-41487.post@n4.nabble.com> <51655582.4010406@thelounge.net> <1365596571713-41491.post@n4.nabble.com> <51655AC6.5010903@Media-Brokers.com> <1365670827411-41506.post@n4.nabble.com> Message-ID: <5166A8AB.6070100@Media-Brokers.com> On 2013-04-11 5:00 AM, HylkeB wrote: > I see now, took some time for me to sink in. Is there any way on the server > to disable the pop3 protocol, so all email users cant accidently use pop3 > and delete all their old emails? > > I suppose i would have to do something like the following on the server: > - open dovecot.conf > - change the first line (currently its protocols = imap imaps pop3 pop3s), > and remove pop3 and pop3s > - maybe delete/change something in this piece of code in dovecot.conf: > protocol pop3 { > pop3_uidl_format = %08Xu%08Xv > } > - restart dovecot (and maybe some other applications?) > > So is this the right way to disable the pop3 protocol in my mail server? I > dont want to crash the mail server by disabling pop3. Yes, although I'm pretty sure you don't need to comment out the 'protocol pop3... section stuff as long as you disable the protocol itself (protocols = ...'). What other apps would you have to restart? Dovecot is the mail server. Before you do this, I'd inform/warn everyone, provide instructions for setting up their account as IMAP and wait until they have all done so, then tell them they can manually copy their email back to the server via their new IMAP account. This (waiting on everyone to confirm they have changed over) may not be practical though, depending on how many users you have. And you won't crash the server, but anyone still trying to connect using POP will start complaining loudly... ;) > And about me being the admin of the mailserver, thanks to you guys im going > to search for a company that can maintain the server stuff for me (hiring > someone is too expensive for now), for they have more experience in servers > and know what to do. I would strongly recommend Timo's new company. His rates are very reasonable, and who better to admin your server than a company run by the man himself? That is what we did. He converted our old courier-imap server in place (about 350GB of mail for about 70 users) in a very short period of time, and none of our users even noticed. http://www.dovecot.fi/ > Do you have any tips about what is important knowledge that an external > company must have to properly maintain my server system? (mail server, > backup, security etc) Way too broad of a subject... either you know, or you don't, and if you don't, it is up to you to decide if you want to spend the time and effort to learn it yourself (but what about securing things while you're learning?), or pay someone else to do it. And security is an entirely separate subject all its own. I consider myself to be reasonably competent (far from expert), but I know my own limitations and feel more comfortable having paid support from Timo's company... I'm also very curious about the upcoming (commercial) Object Storage support that will be available in 2.2 for real time cloud backup and to offload older emails from our local server... but that is another email... -- Best regards, Charles From dave.gattis at suhner.com Thu Apr 11 15:19:02 2013 From: dave.gattis at suhner.com (Dave Gattis) Date: Thu, 11 Apr 2013 08:19:02 -0400 Subject: [Dovecot] Dovecot distribution configuration files source Message-ID: Where can I find unaltered distribution config files (/etc/dovecot/ and /etc/dovecot/config.d/) for Dovecot 2.1.7? I upgraded from version 1 and had to butcher them to get it working. Now that I understand it better, I'd like to do it right. -- Dave From CMarcus at Media-Brokers.com Thu Apr 11 15:31:38 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 11 Apr 2013 08:31:38 -0400 Subject: [Dovecot] Questions about the upcoming Object Storage Plugin for 2.2 Message-ID: <5166AD2A.8060706@Media-Brokers.com> Hi Timo, I'm curious and have questions about the new Object Storage Plugin (OSP), and how it can be leveraged by an SMB like us. First, am I reading this right where it could be used as a kind of 'live/realtime backup' solution, where everything is stored *both* locally and in the cloud, with two-way syncing, ie, so local users could access the local server for faster access, and when outside the office, they'd access the cloud based storage and any changes made there are sync'd back to the local server? Or is it intended to be more as an alternative storage for storing older emails in a separate namespace? Or both/either? Second, is SIS fully supported by the OSP? Third - I'm a little confused by the Amazon S3 pricing page, especially on how to try to estimate the costs for usage (bandwidth, etc)... do you have any idea how to go about estimating that? Is there some kind of process we could use on our existing server to measure it over a given period of time that would give us an estimate of what to expect if we decided to switch over? Last - have you established pricing for the OSP? Will it be per user, or per MB/GB, per month (or per year), or just a one-time cost? And/or will you include/bundle it with any/all of your support tiers? Sorry if I'm jumping the gun here... Thanks, really looking forward to the 2.2 release! -- Best regards, Charles From manu at netbsd.org Thu Apr 11 15:57:45 2013 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Thu, 11 Apr 2013 12:57:45 +0000 Subject: [Dovecot] [PATCHES] NetBSD support, authentication buffer size In-Reply-To: <987AE960-F63F-4DC5-9568-47031084896B@iki.fi> References: <1l1617l.1mhdmtf1o3woghM%manu@netbsd.org> <987AE960-F63F-4DC5-9568-47031084896B@iki.fi> Message-ID: <20130411125745.GF14934@homeworld.netbsd.org> On Thu, Apr 11, 2013 at 02:54:01PM +0300, Timo Sirainen wrote: > > This is for pam_saml. The webmail sends a signed SAML assertion as the > > password, and the PAM module validates it. > The pam_saml could easily be changed to use AUTHENTICATE PLAIN instead. pam_saml is not the component that choose the authentication. The webmail does. Squirrelmail does not support PLAIN. > > You did support in in 1.x and it did not harm anyone? > It does make it easier to waste the (pre-login!) process memory usage. Perhaps it could be configurable? -- Emmanuel Dreyfus manu at netbsd.org From tss at iki.fi Thu Apr 11 16:00:22 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 11 Apr 2013 16:00:22 +0300 Subject: [Dovecot] Easy way to make all mailboxes of a user read-only In-Reply-To: <20130411140736.70345e6a.skraw@ithnet.com> References: <20130411140736.70345e6a.skraw@ithnet.com> Message-ID: On 11.4.2013, at 15.07, Stephan von Krawczynski wrote: > I try to configure dovecot to make all imap accesses read-only for a certain > user. I thought this would be possible by creating a global acl file (here > "global-acl") like: Sorry, there is still no "default ACLs" feature in Dovecot. The only semi-easy way to do what you want is using filesystem permissions. This is something that really should be developed though.. But probably not until v2.3. From tss at iki.fi Thu Apr 11 16:03:26 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 11 Apr 2013 16:03:26 +0300 Subject: [Dovecot] Dovecot distribution configuration files source In-Reply-To: References: Message-ID: <66E82C46-DB7A-4DC9-A2A5-D813A659928C@iki.fi> On 11.4.2013, at 15.19, Dave Gattis wrote: > Where can I find unaltered distribution config files (/etc/dovecot/ and /etc/dovecot/config.d/) for Dovecot 2.1.7? I upgraded from version 1 and had to butcher them to get it working. Now that I understand it better, I'd like to do it right. Maybe they are in /usr/share/doc/dovecot/example-config/ ? If not, get the source code tarball and see doc/example-config/. The 2.1.7 config is probably identical to 2.1.16 config. From skraw at ithnet.com Thu Apr 11 16:05:17 2013 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Thu, 11 Apr 2013 15:05:17 +0200 Subject: [Dovecot] Easy way to make all mailboxes of a user read-only In-Reply-To: <20130411140736.70345e6a.skraw@ithnet.com> References: <20130411140736.70345e6a.skraw@ithnet.com> Message-ID: <20130411150517.59c74cd5.skraw@ithnet.com> Let me explain some more details, that seem important to understand: I cannot use acl files per folder/mailbox because the MTA creates folders dynamically (re-orders mails in folders). So I really would need some idea to tell dovecot to let a certain user access his mailbox/folders read-only, no matter how many. A global acl _file_ would do that, or an acl-file that work for a whole tree of folders. A global acl directory does not help, because I would have to know the names of every single folder/mailbox to create the correct acl-file in the global directory. -- Regards, Stephan From skraw at ithnet.com Thu Apr 11 16:07:16 2013 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Thu, 11 Apr 2013 15:07:16 +0200 Subject: [Dovecot] Easy way to make all mailboxes of a user read-only In-Reply-To: References: <20130411140736.70345e6a.skraw@ithnet.com> Message-ID: <20130411150716.c02cd609.skraw@ithnet.com> On Thu, 11 Apr 2013 16:00:22 +0300 Timo Sirainen wrote: > On 11.4.2013, at 15.07, Stephan von Krawczynski wrote: > > > I try to configure dovecot to make all imap accesses read-only for a certain > > user. I thought this would be possible by creating a global acl file (here > > "global-acl") like: > > Sorry, there is still no "default ACLs" feature in Dovecot. The only semi-easy way to do what you want is using filesystem permissions. > > This is something that really should be developed though.. But probably not until v2.3. Oh, that is _bad_. I cannot use fs permissions because the MTA (postfix) must have write permissions (to the directories) to create the mail files... -- Regards, Stephan From h.reindl at thelounge.net Thu Apr 11 16:08:31 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 11 Apr 2013 15:08:31 +0200 Subject: [Dovecot] Easy way to make all mailboxes of a user read-only In-Reply-To: <20130411150517.59c74cd5.skraw@ithnet.com> References: <20130411140736.70345e6a.skraw@ithnet.com> <20130411150517.59c74cd5.skraw@ithnet.com> Message-ID: <5166B5CF.5080300@thelounge.net> Am 11.04.2013 15:05, schrieb Stephan von Krawczynski: > Let me explain some more details, that seem important to understand: > > I cannot use acl files per folder/mailbox because the MTA creates folders > dynamically (re-orders mails in folders) why does the MTA that? normally the MTA should only decide reject or accept a message and deliver it via LMTP to the LDA which can then filter via Sieve or whatever and from this moment on any dynamically created folder would be created in the dovecot world -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From skraw at ithnet.com Thu Apr 11 16:13:34 2013 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Thu, 11 Apr 2013 15:13:34 +0200 Subject: [Dovecot] Easy way to make all mailboxes of a user read-only In-Reply-To: <5166B5CF.5080300@thelounge.net> References: <20130411140736.70345e6a.skraw@ithnet.com> <20130411150517.59c74cd5.skraw@ithnet.com> <5166B5CF.5080300@thelounge.net> Message-ID: <20130411151334.091b6c5d.skraw@ithnet.com> On Thu, 11 Apr 2013 15:08:31 +0200 Reindl Harald wrote: > > > Am 11.04.2013 15:05, schrieb Stephan von Krawczynski: > > Let me explain some more details, that seem important to understand: > > > > I cannot use acl files per folder/mailbox because the MTA creates folders > > dynamically (re-orders mails in folders) > > why does the MTA that? > > normally the MTA should only decide reject or accept a message > and deliver it via LMTP to the LDA which can then filter via > Sieve or whatever and from this moment on any dynamically > created folder would be created in the dovecot world I cannot further explain the background, you have to believe that there is a good reason for this implementation. It is no standard mail service. -- Regards, Stephan From tss at iki.fi Thu Apr 11 16:15:23 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 11 Apr 2013 16:15:23 +0300 Subject: [Dovecot] Easy way to make all mailboxes of a user read-only In-Reply-To: <20130411150716.c02cd609.skraw@ithnet.com> References: <20130411140736.70345e6a.skraw@ithnet.com> <20130411150716.c02cd609.skraw@ithnet.com> Message-ID: On 11.4.2013, at 16.07, Stephan von Krawczynski wrote: > On Thu, 11 Apr 2013 16:00:22 +0300 > Timo Sirainen wrote: > >> On 11.4.2013, at 15.07, Stephan von Krawczynski wrote: >> >>> I try to configure dovecot to make all imap accesses read-only for a certain >>> user. I thought this would be possible by creating a global acl file (here >>> "global-acl") like: >> >> Sorry, there is still no "default ACLs" feature in Dovecot. The only semi-easy way to do what you want is using filesystem permissions. >> >> This is something that really should be developed though.. But probably not until v2.3. > > Oh, that is _bad_. I cannot use fs permissions because the MTA (postfix) must > have write permissions (to the directories) to create the mail files... The MTA can work as it used to, if it can just set a group-read permission to the files. So your read-only user would belong to that read-only-group. I'm not sure how Postfix assigns permissions, but if it can't do that you could switch to Dovecot LDA/LMTP which can set the group correctly. From skraw at ithnet.com Thu Apr 11 16:16:56 2013 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Thu, 11 Apr 2013 15:16:56 +0200 Subject: [Dovecot] Easy way to make all mailboxes of a user read-only In-Reply-To: References: <20130411140736.70345e6a.skraw@ithnet.com> Message-ID: <20130411151656.1afa1c54.skraw@ithnet.com> On Thu, 11 Apr 2013 16:00:22 +0300 Timo Sirainen wrote: > On 11.4.2013, at 15.07, Stephan von Krawczynski wrote: > > > I try to configure dovecot to make all imap accesses read-only for a certain > > user. I thought this would be possible by creating a global acl file (here > > "global-acl") like: > > Sorry, there is still no "default ACLs" feature in Dovecot. The only semi-easy way to do what you want is using filesystem permissions. > > This is something that really should be developed though.. But probably not until v2.3. And I just checked another thing: Though setting permissions to 400 the owner still can move mails to trash (seems to be a rename?). That is definitely not read-only. -- Regards, Stephan From skraw at ithnet.com Thu Apr 11 16:24:49 2013 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Thu, 11 Apr 2013 15:24:49 +0200 Subject: [Dovecot] Easy way to make all mailboxes of a user read-only In-Reply-To: References: <20130411140736.70345e6a.skraw@ithnet.com> <20130411150716.c02cd609.skraw@ithnet.com> Message-ID: <20130411152449.5647d91b.skraw@ithnet.com> On Thu, 11 Apr 2013 16:15:23 +0300 Timo Sirainen wrote: > On 11.4.2013, at 16.07, Stephan von Krawczynski wrote: > > > On Thu, 11 Apr 2013 16:00:22 +0300 > > Timo Sirainen wrote: > > > >> On 11.4.2013, at 15.07, Stephan von Krawczynski wrote: > >> > >>> I try to configure dovecot to make all imap accesses read-only for a certain > >>> user. I thought this would be possible by creating a global acl file (here > >>> "global-acl") like: > >> > >> Sorry, there is still no "default ACLs" feature in Dovecot. The only semi-easy way to do what you want is using filesystem permissions. > >> > >> This is something that really should be developed though.. But probably not until v2.3. > > > > Oh, that is _bad_. I cannot use fs permissions because the MTA (postfix) must > > have write permissions (to the directories) to create the mail files... > > The MTA can work as it used to, if it can just set a group-read permission to the files. So your read-only user would belong to that read-only-group. I'm not sure how Postfix assigns permissions, but if it can't do that you could switch to Dovecot LDA/LMTP which can set the group correctly. That is not the problem. I can set any type of permission on the mail file itself. Only it does not help because dovecot nevertheless is able to move the mails around or "delete" them by moving to trash box. -- Regards, Stephan From tss at iki.fi Thu Apr 11 16:35:32 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 11 Apr 2013 16:35:32 +0300 Subject: [Dovecot] Easy way to make all mailboxes of a user read-only In-Reply-To: <20130411152449.5647d91b.skraw@ithnet.com> References: <20130411140736.70345e6a.skraw@ithnet.com> <20130411150716.c02cd609.skraw@ithnet.com> <20130411152449.5647d91b.skraw@ithnet.com> Message-ID: On 11.4.2013, at 16.24, Stephan von Krawczynski wrote: >> The MTA can work as it used to, if it can just set a group-read permission to the files. So your read-only user would belong to that read-only-group. I'm not sure how Postfix assigns permissions, but if it can't do that you could switch to Dovecot LDA/LMTP which can set the group correctly. > > That is not the problem. I can set any type of permission on the mail file > itself. Only it does not help because dovecot nevertheless is able to move the > mails around or "delete" them by moving to trash box. No, the idea was to use two UNIX users: 1) the user that owns the mails and has read-write acces 2) another read-only user that does not own the mails, has only group-read access. can't do anything at all to the mails. The directories need to have similar permissions as well (750). From dovecot at lists.wgwh.ch Thu Apr 11 16:43:05 2013 From: dovecot at lists.wgwh.ch (Oli Schacher) Date: Thu, 11 Apr 2013 15:43:05 +0200 Subject: [Dovecot] v2.2.rc7 released In-Reply-To: <30737261-6693-48C1-9CFC-2E1B987A58FB@iki.fi> References: <1365626796.11047.191.camel@innu> <20130411080658.645e9a41@lists.wgwh.ch> <30737261-6693-48C1-9CFC-2E1B987A58FB@iki.fi> Message-ID: <20130411154305.47754ddc@lists.wgwh.ch> On Thu, 11 Apr 2013 12:22:50 +0300 Timo Sirainen wrote: > Those errors come from your script. I don't see anything in the quota > warning change that could have changed a behavior in your script. > Maybe your script changed also around the same time? > yeah, sorry. there was indeed a change at the same time that apparently now triggers a python internal bug when the script is called from dovecot. reproducible with a quota script as simple as: #!/usr/bin/python print "hello world" this could be the cause: http://bugs.python.org/issue11380 in any case, its not dovecot's fault. so again: sorry for the noise From CMarcus at Media-Brokers.com Thu Apr 11 16:55:05 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 11 Apr 2013 09:55:05 -0400 Subject: [Dovecot] Questions about the upcoming Object Storage Plugin for 2.2 In-Reply-To: <5166AD2A.8060706@Media-Brokers.com> References: <5166AD2A.8060706@Media-Brokers.com> Message-ID: <5166C0B9.7040501@Media-Brokers.com> On 2013-04-11 8:31 AM, Charles Marcus wrote: > Third - I'm a little confused by the Amazon S3 pricing page, Specifically, the 'Request Pricing' shown here: http://aws.amazon.com/s3/pricing/ Also... Would the plugin support the ability to use two different storage 'namespaces', e.g., one for primary email storage (stored on S3's 'Standard' storage tier), and one for 'older or 'archived' emails stored on the much cheaper 'Glacier' system/tier? Probably not that big a deal though, since the cost for a TB of storage at the Standard tier is still only .095/GB/mo, which only comes to $95/mo... wow, this is looking better all the time... -- Best regards, Charles From skraw at ithnet.com Thu Apr 11 16:57:23 2013 From: skraw at ithnet.com (Stephan von Krawczynski) Date: Thu, 11 Apr 2013 15:57:23 +0200 Subject: [Dovecot] Easy way to make all mailboxes of a user read-only In-Reply-To: References: <20130411140736.70345e6a.skraw@ithnet.com> <20130411150716.c02cd609.skraw@ithnet.com> <20130411152449.5647d91b.skraw@ithnet.com> Message-ID: <20130411155723.4a495366.skraw@ithnet.com> On Thu, 11 Apr 2013 16:35:32 +0300 Timo Sirainen wrote: > On 11.4.2013, at 16.24, Stephan von Krawczynski wrote: > > >> The MTA can work as it used to, if it can just set a group-read permission to the files. So your read-only user would belong to that read-only-group. I'm not sure how Postfix assigns permissions, but if it can't do that you could switch to Dovecot LDA/LMTP which can set the group correctly. > > > > That is not the problem. I can set any type of permission on the mail file > > itself. Only it does not help because dovecot nevertheless is able to move the > > mails around or "delete" them by moving to trash box. > > No, the idea was to use two UNIX users: > > 1) the user that owns the mails and has read-write acces > > 2) another read-only user that does not own the mails, has only group-read access. can't do anything at all to the mails. > > The directories need to have similar permissions as well (750). That's about as complicated as patching the MTA to auto-create the acl file, which I did now. I'd say global acls would be a nice coming feature ;-) -- Regards, Stephan From CMarcus at Media-Brokers.com Thu Apr 11 17:06:04 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 11 Apr 2013 10:06:04 -0400 Subject: [Dovecot] Questions about the upcoming Object Storage Plugin for 2.2 In-Reply-To: <5166C0B9.7040501@Media-Brokers.com> References: <5166AD2A.8060706@Media-Brokers.com> <5166C0B9.7040501@Media-Brokers.com> Message-ID: <5166C34C.6050305@Media-Brokers.com> On 2013-04-11 9:55 AM, Charles Marcus wrote: > Would the plugin support the ability to use two different storage > 'namespaces', e.g., one for primary email storage (stored on S3's > 'Standard' storage tier), and one for 'older or 'archived' emails > stored on the much cheaper 'Glacier' system/tier? Never mind about this, further reading on their Glacier storage reveals it isn't suited to email storage, but could definitely be used with Dovecots new 'Archive' feature for *permanent* email archival... So, the question is would the OSP support this? Mirroring/storing live email to the standard S3 filesystem, and storing permanent email archives to the Glacier system (maybe on some kind of scheduled nightly or weekly basis)? -- Best regards, Charles From rs at sys4.de Thu Apr 11 18:05:21 2013 From: rs at sys4.de (Robert Schetterer) Date: Thu, 11 Apr 2013 17:05:21 +0200 Subject: [Dovecot] Easy way to make all mailboxes of a user read-only In-Reply-To: References: <20130411140736.70345e6a.skraw@ithnet.com> Message-ID: <5166D131.4040701@sys4.de> Am 11.04.2013 15:00, schrieb Timo Sirainen: > On 11.4.2013, at 15.07, Stephan von Krawczynski wrote: > >> I try to configure dovecot to make all imap accesses read-only for a certain >> user. I thought this would be possible by creating a global acl file (here >> "global-acl") like: > > Sorry, there is still no "default ACLs" feature in Dovecot. The only semi-easy way to do what you want is using filesystem permissions. > > This is something that really should be developed though.. But probably not until v2.3. > i tested somthing "alike" setting acl by using sieve external prog but at last it get to complex , so i did another solution layout but you may try by your own Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From pigi at frumar.it Thu Apr 11 18:29:15 2013 From: pigi at frumar.it (Pigi) Date: Thu, 11 Apr 2013 17:29:15 +0200 Subject: [Dovecot] Problem with fts lucene, on solaris 10 Message-ID: <201304111729.15627.pigi@frumar.it> Sorry for top posting, but I have no additional info on this. BTW I need to refresh the question as I have tried squat, and I'm biting the dust with the already known problems ( "Corrupted squat uidlist file" or "Panic: file squat-trie.c:" ). Is there some pointer on where/how to find assist on fts-lucene to keep on analisys for this problem on sparc ? T.I.A. Pigi On Monday 08 April 2013, Pigi wrote: > On Monday 08 April 2013, Timo Sirainen wrote: > > On 8.4.2013, at 12.19, Pigi wrote: > > > > > Program received signal SIGSEGV, Segmentation fault. > > > 0xfebd65dc in _malloc_unlocked () from /lib/libc.so.1 > > > (gdb) bt full > > > #0 0xfebd65dc in _malloc_unlocked () from /lib/libc.so.1 > > > No symbol table info available. > > > #1 0xfebd66e4 in realloc () from /lib/libc.so.1 > > > No symbol table info available. > > > #2 0xff1d9a70 in pool_system_realloc (pool=0xff21576c, mem=0xff21576c, old_size=0, new_size=8192) at mempool-system.c:115 > > > No locals. > > > #3 0xff1cda28 in i_realloc (mem=0x0, old_size=0, new_size=8192) at imem.c:14 > > > No locals. > > > > Looks to me like memory corruption, which is just about impossible to debug if you don't have valgrind or a similar tool (and I don't think Solaris has any such free tools). > > Yes, you're right. There aren't ( already packaged ) tool for valgrinding or similar. > > > Do you happen to get any other crashes where it doesn't crash in malloc code? You showed previously that it was crashing with SIGBUS somewhere. > > For what I can see, form dovecot.log I have a couple of error: > Apr 08 12:02:18 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx > Apr 08 12:02:18 imap(xxxx): Error: indexer failed to index mailbox INBOX > Apr 08 12:02:18 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 27242 killed with signal 11 (core not dumped) > Apr 08 12:02:19 indexer-worker(xxxx): Error: lucene index /home/xxxx/Maildir/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out > Apr 08 12:03:46 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx > Apr 08 12:03:46 imap(xxxx): Error: indexer failed to index mailbox INBOX > Apr 08 12:03:46 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 27445 killed with signal 10 (core not dumped) > Apr 08 12:06:57 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx > Apr 08 12:06:57 imap(xxxx): Error: indexer failed to index mailbox INBOX > Apr 08 12:06:57 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 27761 killed with signal 11 (core not dumped) > Apr 08 12:08:33 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx > > Here a couple or more of gdb"ed" process, but tied to SEGV ( I almost suspect that when gdbing I always catch a SEGV ) : > > ============================================================== > First gdb > ============================================================== > No symbol table info available. > #1 0xfebd6884 in realloc () from /lib/libc.so.1 > No symbol table info available. > #2 0xfe83d270 in lucene::util::StringReader::init (this=0x8d328, _value=0x2bb288, _length=3958, copyData=true) > at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/util/Reader.cpp:48 > tmp = (TCHAR *) 0x2051e0 > length = 3958 > #3 0xfe8837f0 in lucene::index::DocumentsWriter::ThreadState::FieldData::invertField (this=0x92df8, field=0x8d238, analyzer=0x2cb60, maxFieldLength=10000) > at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriterThreadState.cpp:887 > stringValue = (const TCHAR *) 0x2bb288 > stringValueLength = 3958 > stream = (class lucene::analysis::TokenStream *) 0x0 > streamValue = (class lucene::analysis::TokenStream *) 0x8d328 > #4 0xfe883a58 in lucene::index::DocumentsWriter::ThreadState::FieldData::processField (this=0x92df8, analyzer=0x2cb60) > at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriterThreadState.cpp:798 > field = (class lucene::document::Field *) 0x8d238 > #5 0xfe883d6c in lucene::index::DocumentsWriter::ThreadState::processDocument (this=0x8c0a8, analyzer=0x2cb60) > at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/util/Array.h:90 > i = 6 > #6 0xfe87ea00 in lucene::index::DocumentsWriter::updateDocument (this=0x84790, doc=0x8b838, analyzer=0x2cb60, delTerm=0x0) > at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriter.cpp:946 > state = (class lucene::index::DocumentsWriter::ThreadState *) 0x8c0a8 > #7 0xfe87eb5c in lucene::index::DocumentsWriter::addDocument (this=0x84790, doc=0x8b838, analyzer=0x2cb60) > at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriter.cpp:930 > No locals. > #8 0xfe8b1ea0 in lucene::index::IndexWriter::addDocument (this=0x8cc18, doc=0x8b838, analyzer=0x2cb60) > at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/IndexWriter.cpp:682 > No locals. > #9 0xfea18e04 in lucene_index_build_flush (index=0x37ba8) at lucene-wrapper.cc:484 > ret = 0 > #10 0xfea18f88 in lucene_index_build_more (index=0x37ba8, uid=2995, data=0x185d18 "", size=23, hdr_name=0x8ba60 "Return-Path") > at lucene-wrapper.cc:507 > id = {4, 0, 0, 0, -4196824, -15011172, 534768, -4196336, 516256, 0, 11560, -20155708, 9, 10, 36, 2727408, 516256, 148, 0, 441, 148864, 534768, 3} > namesize = 9216 > datasize = 9216 > dest = Cannot access memory at address 0xbb3 > (gdb) quit > > ============================================================== > Second gdb > ============================================================== > > gdb) bt full > #0 0xfebd6b24 in realfree () from /lib/libc.so.1 > No symbol table info available. > #1 0xfebd7354 in cleanfree () from /lib/libc.so.1 > No symbol table info available. > #2 0xfebd64ac in _malloc_unlocked () from /lib/libc.so.1 > No symbol table info available. > #3 0xfebd639c in malloc () from /lib/libc.so.1 > No symbol table info available. > #4 0xfe737b38 in operator new () from /usr/sfw/lib/libstdc++.so.6 > No symbol table info available. > #5 0xfe8613f4 in Document (this=0x8b838) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Document.cpp:57 > No locals. > #6 0xfea18fa8 in lucene_index_build_more (index=0x37ba8, uid=2995, data=0x8d7b0 "", size=23, hdr_name=0x8b9d0 "Return-Path") > at lucene-wrapper.cc:511 > id = {4, 0, 0, 0, -4196824, -15011172, 1605360, -4196336, 516256, 0, 11560, -20155708, 9, 10, 36, 2122656, 516256, 148, 0, 441, 148864, 1605360, 3} > namesize = 9216 > datasize = 9216 > dest = Cannot access memory at address 0xbb3 > (gdb) quit > > =============================================== > third gdb > ===================================================== > (gdb) cont > Continuing. > > Program received signal SIGSEGV, Segmentation fault. > 0xfebd710c in t_splay () from /lib/libc.so.1 > (gdb) bt full > #0 0xfebd710c in t_splay () from /lib/libc.so.1 > No symbol table info available. > #1 0xfebd6eb8 in t_delete () from /lib/libc.so.1 > No symbol table info available. > #2 0xfebd6acc in realfree () from /lib/libc.so.1 > No symbol table info available. > #3 0xfebd72c8 in _free_unlocked () from /lib/libc.so.1 > No symbol table info available. > #4 0xfebd7204 in free () from /lib/libc.so.1 > No symbol table info available. > #5 0xfe862144 in lucene::document::Field::_resetValue (this=0x71e288) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Field.cpp:300 > No locals. > #6 0xfe862248 in ~Field (this=0x71e288) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Field.cpp:103 > No locals. > #7 0xfe90dcc8 in ~CLVector (this=0x23c248) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/util/Equators.h:227 > itr = {_M_current = 0x71eb00} > #8 0xfe860dfc in ~Document (this=0x832e0) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Document.cpp:69 > No locals. > #9 0xfea18e30 in lucene_index_build_flush (index=0x8adc0) at lucene-wrapper.cc:493 > ret = 0 > #10 0xfea18f88 in lucene_index_build_more (index=0x8adc0, uid=4128, data=0x6b2b00 "", size=23, hdr_name=0x1b6508 "Return-Path") > at lucene-wrapper.cc:507 > id = {4, 0, 0, 0, -4196824, -15011172, 3114656, -4196336, 584416, 0, 11560, 0, 0, 0, 36, 7697128, 584416, 845, 0, 2382, 148880, 3114656, 3} > namesize = 9216 > datasize = 9216 > dest = Cannot access memory at address 0x1020 > (gdb) > > > > Here a couple of ( probably ) interesting stuff : > > root # grep "signal 10" /usr/local/dovecot/var/log/dovecot.log |wc > 33 284 2308 > root # grep "signal 11" /usr/local/dovecot/var/log/dovecot.log |wc > 69 549 4457 > root # grep "Lock obtain timed out" /usr/local/dovecot/var/log/dovecot.log |wc > 74 420 3976 > > Thus, 74 times of 102 seems to be tied to "IndexWriter() failed (#1): Lock obtain timed out" ( which I don't really understand, > or at least I have not enough comprehension of code to understand). > The path where lucene try to get a lock is not NFS, but is an automount on the same machine ( no NFS then ). > > It seems that the "Lock obtain timed out" happens every time I read a message with the MUA. > > This error ("Lock obtain") happens every time I read a message from my MUA, I think it's due to the indexing process running on READ > imap command: > > Apr 08 15:18:13 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx > Apr 08 15:18:13 imap(xxxx): Error: indexer failed to index mailbox INBOX > Apr 08 15:18:13 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 18171 killed with signal 11 (core not dumped) > Apr 08 15:18:15 indexer-worker(xxxx): Error: lucene index /home/xxxx/Maildir/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out > > > When searching, instead, get the "Lock timeout" followed by another error: > > Apr 08 15:11:37 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx > Apr 08 15:11:37 imap(xxxx): Error: indexer failed to index mailbox INBOX > Apr 08 15:11:37 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 17438 killed with signal 10 (core not dumped) > Apr 08 15:11:38 indexer-worker(xxxx): Error: lucene index /home/xxxx/Maildir/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out > Apr 08 15:11:51 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx > Apr 08 15:11:51 imap(xxxx): Error: indexer failed to index mailbox INBOX > > > > In both case the signal ( 11 or 10, SEGV or SIGBUS ) it's indifferent ( sometimes is 10 sometimes is 11 ). > > Hope I've been able to explain, as my english seems to get worst every time ;) > > Pigi > > From manu at netbsd.org Thu Apr 11 18:41:46 2013 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Thu, 11 Apr 2013 15:41:46 +0000 Subject: [Dovecot] [PATCHES] NetBSD support, authentication buffer size In-Reply-To: <20130411125745.GF14934@homeworld.netbsd.org> References: <1l1617l.1mhdmtf1o3woghM%manu@netbsd.org> <987AE960-F63F-4DC5-9568-47031084896B@iki.fi> <20130411125745.GF14934@homeworld.netbsd.org> Message-ID: <20130411154146.GH14934@homeworld.netbsd.org> On Thu, Apr 11, 2013 at 12:57:45PM +0000, Emmanuel Dreyfus wrote: > Perhaps [MASTER_AUTH_MAX_DATA_SIZE] could be configurable? I tried to add a configuration option for that, but dovecot design makes a good job at separating master and login structures, hence The Right Way is not obvious. Anu suggestion? -- Emmanuel Dreyfus manu at netbsd.org From tss at iki.fi Thu Apr 11 19:15:56 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 11 Apr 2013 19:15:56 +0300 Subject: [Dovecot] [PATCHES] NetBSD support, authentication buffer size In-Reply-To: <20130411154146.GH14934@homeworld.netbsd.org> References: <1l1617l.1mhdmtf1o3woghM%manu@netbsd.org> <987AE960-F63F-4DC5-9568-47031084896B@iki.fi> <20130411125745.GF14934@homeworld.netbsd.org> <20130411154146.GH14934@homeworld.netbsd.org> Message-ID: <1365696956.11047.207.camel@innu> On Thu, 2013-04-11 at 15:41 +0000, Emmanuel Dreyfus wrote: > On Thu, Apr 11, 2013 at 12:57:45PM +0000, Emmanuel Dreyfus wrote: > > Perhaps [MASTER_AUTH_MAX_DATA_SIZE] could be configurable? > > I tried to add a configuration option for that, but dovecot design > makes a good job at separating master and login structures, hence > The Right Way is not obvious. Anu suggestion? I don't want to add configuration options that are going to be used by only a couple of people. Squirrelmail already must have special support for pam_saml to work, I suggest changing Squirrelmail to use AUTHENTICATE PLAIN. From pyz at brama.com Thu Apr 11 19:33:58 2013 From: pyz at brama.com (Max Pyziur) Date: Thu, 11 Apr 2013 12:33:58 -0400 Subject: [Dovecot] Configuring dovecot to use tcp wrappers In-Reply-To: References: Message-ID: > On 5.4.2013, at 18.19, Max Pyziur wrote: > >> So my question relates to the second part of the configuration examples >> in the links above: >> >> service tcpwrap { >> unix_listener login/tcpwrap { >> group = $default_login_user >> mode = 0600 >> user = $default_login_user >> } >> } >> >> Where does this code get placed (in dovecot.conf or in one of the files >> in /etc/dovecot/conf.d)? > > Doesn't really matter. I'd put it into conf.d/10-master.conf which has > other services. > >> And regarding $default_login_user, it appears in a comment line in >> /etc/dovecot/conf.d/10-master.conf >> >> Should that line be uncommented? > > Just leave it uncommented and it'll use the default value (which it has > been using so far already). After some delay, I'm returning to this project. I've made the changes per above. I've put in a test ip address in /etc/hosts.deny like so: dovecot: 166.84.1.2 And then I execute the following from 166.84.1.2 to port 110: bash-3.2$ telnet SiteWhereImConfiguringDovecot 110 Trying SiteWhereImConfiguringDovecot... Connected to SiteWhereImConfiguringDovecot. Escape character is '^]'. +OK Dovecot ready. quit +OK Logging out Connection closed by foreign host. If dovecot is configured with tcp wrappers (which it is; built on a CentOS 6 system, installed and configured per instructions), and the firewall has ports 110 and 143 open, but I'm blocking a particular host through /etc/hosts.deny then I should not be able to telnet to either port 110 or 143; both requests should be blocked from the originating IP, no? Much thanks for your help, Max Pyziur pyz at brama.com From tss at iki.fi Thu Apr 11 19:36:31 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 11 Apr 2013 19:36:31 +0300 Subject: [Dovecot] Problem with fts lucene, on solaris 10 In-Reply-To: <201304111729.15627.pigi@frumar.it> References: <201304111729.15627.pigi@frumar.it> Message-ID: <2D89BF9E-792B-4E08-B5CA-9C7B4ED4518E@iki.fi> On 11.4.2013, at 18.29, Pigi wrote: > Sorry for top posting, but I have no additional info on this. > BTW I need to refresh the question as I have tried squat, and I'm biting the dust with the already known problems > ( "Corrupted squat uidlist file" or "Panic: file squat-trie.c:" ). > > Is there some pointer on where/how to find assist on fts-lucene to keep on analisys for this problem on sparc ? Sorry, I don't have any good ideas on how to debug this further. I'd use valgrind on Linux to debug it, but Solaris doesn't have valgrind. Then again if there was a generic bug in CLucene it would be visible by running the same tests in Linux+valgrind, but I'm not aware of CLucene having such generic bugs, so it's probably somehow Solaris or Sparc specific. > > T.I.A. > > Pigi > > On Monday 08 April 2013, Pigi wrote: >> On Monday 08 April 2013, Timo Sirainen wrote: >>> On 8.4.2013, at 12.19, Pigi wrote: >>> >>>> Program received signal SIGSEGV, Segmentation fault. >>>> 0xfebd65dc in _malloc_unlocked () from /lib/libc.so.1 >>>> (gdb) bt full >>>> #0 0xfebd65dc in _malloc_unlocked () from /lib/libc.so.1 >>>> No symbol table info available. >>>> #1 0xfebd66e4 in realloc () from /lib/libc.so.1 >>>> No symbol table info available. >>>> #2 0xff1d9a70 in pool_system_realloc (pool=0xff21576c, mem=0xff21576c, old_size=0, new_size=8192) at mempool-system.c:115 >>>> No locals. >>>> #3 0xff1cda28 in i_realloc (mem=0x0, old_size=0, new_size=8192) at imem.c:14 >>>> No locals. >>> >>> Looks to me like memory corruption, which is just about impossible to debug if you don't have valgrind or a similar tool (and I don't think Solaris has any such free tools). >> >> Yes, you're right. There aren't ( already packaged ) tool for valgrinding or similar. >> >>> Do you happen to get any other crashes where it doesn't crash in malloc code? You showed previously that it was crashing with SIGBUS somewhere. >> >> For what I can see, form dovecot.log I have a couple of error: >> Apr 08 12:02:18 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx >> Apr 08 12:02:18 imap(xxxx): Error: indexer failed to index mailbox INBOX >> Apr 08 12:02:18 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 27242 killed with signal 11 (core not dumped) >> Apr 08 12:02:19 indexer-worker(xxxx): Error: lucene index /home/xxxx/Maildir/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out >> Apr 08 12:03:46 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx >> Apr 08 12:03:46 imap(xxxx): Error: indexer failed to index mailbox INBOX >> Apr 08 12:03:46 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 27445 killed with signal 10 (core not dumped) >> Apr 08 12:06:57 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx >> Apr 08 12:06:57 imap(xxxx): Error: indexer failed to index mailbox INBOX >> Apr 08 12:06:57 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 27761 killed with signal 11 (core not dumped) >> Apr 08 12:08:33 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx >> >> Here a couple or more of gdb"ed" process, but tied to SEGV ( I almost suspect that when gdbing I always catch a SEGV ) : >> >> ============================================================== >> First gdb >> ============================================================== >> No symbol table info available. >> #1 0xfebd6884 in realloc () from /lib/libc.so.1 >> No symbol table info available. >> #2 0xfe83d270 in lucene::util::StringReader::init (this=0x8d328, _value=0x2bb288, _length=3958, copyData=true) >> at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/util/Reader.cpp:48 >> tmp = (TCHAR *) 0x2051e0 >> length = 3958 >> #3 0xfe8837f0 in lucene::index::DocumentsWriter::ThreadState::FieldData::invertField (this=0x92df8, field=0x8d238, analyzer=0x2cb60, maxFieldLength=10000) >> at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriterThreadState.cpp:887 >> stringValue = (const TCHAR *) 0x2bb288 >> stringValueLength = 3958 >> stream = (class lucene::analysis::TokenStream *) 0x0 >> streamValue = (class lucene::analysis::TokenStream *) 0x8d328 >> #4 0xfe883a58 in lucene::index::DocumentsWriter::ThreadState::FieldData::processField (this=0x92df8, analyzer=0x2cb60) >> at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriterThreadState.cpp:798 >> field = (class lucene::document::Field *) 0x8d238 >> #5 0xfe883d6c in lucene::index::DocumentsWriter::ThreadState::processDocument (this=0x8c0a8, analyzer=0x2cb60) >> at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/util/Array.h:90 >> i = 6 >> #6 0xfe87ea00 in lucene::index::DocumentsWriter::updateDocument (this=0x84790, doc=0x8b838, analyzer=0x2cb60, delTerm=0x0) >> at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriter.cpp:946 >> state = (class lucene::index::DocumentsWriter::ThreadState *) 0x8c0a8 >> #7 0xfe87eb5c in lucene::index::DocumentsWriter::addDocument (this=0x84790, doc=0x8b838, analyzer=0x2cb60) >> at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriter.cpp:930 >> No locals. >> #8 0xfe8b1ea0 in lucene::index::IndexWriter::addDocument (this=0x8cc18, doc=0x8b838, analyzer=0x2cb60) >> at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/IndexWriter.cpp:682 >> No locals. >> #9 0xfea18e04 in lucene_index_build_flush (index=0x37ba8) at lucene-wrapper.cc:484 >> ret = 0 >> #10 0xfea18f88 in lucene_index_build_more (index=0x37ba8, uid=2995, data=0x185d18 "", size=23, hdr_name=0x8ba60 "Return-Path") >> at lucene-wrapper.cc:507 >> id = {4, 0, 0, 0, -4196824, -15011172, 534768, -4196336, 516256, 0, 11560, -20155708, 9, 10, 36, 2727408, 516256, 148, 0, 441, 148864, 534768, 3} >> namesize = 9216 >> datasize = 9216 >> dest = Cannot access memory at address 0xbb3 >> (gdb) quit >> >> ============================================================== >> Second gdb >> ============================================================== >> >> gdb) bt full >> #0 0xfebd6b24 in realfree () from /lib/libc.so.1 >> No symbol table info available. >> #1 0xfebd7354 in cleanfree () from /lib/libc.so.1 >> No symbol table info available. >> #2 0xfebd64ac in _malloc_unlocked () from /lib/libc.so.1 >> No symbol table info available. >> #3 0xfebd639c in malloc () from /lib/libc.so.1 >> No symbol table info available. >> #4 0xfe737b38 in operator new () from /usr/sfw/lib/libstdc++.so.6 >> No symbol table info available. >> #5 0xfe8613f4 in Document (this=0x8b838) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Document.cpp:57 >> No locals. >> #6 0xfea18fa8 in lucene_index_build_more (index=0x37ba8, uid=2995, data=0x8d7b0 "", size=23, hdr_name=0x8b9d0 "Return-Path") >> at lucene-wrapper.cc:511 >> id = {4, 0, 0, 0, -4196824, -15011172, 1605360, -4196336, 516256, 0, 11560, -20155708, 9, 10, 36, 2122656, 516256, 148, 0, 441, 148864, 1605360, 3} >> namesize = 9216 >> datasize = 9216 >> dest = Cannot access memory at address 0xbb3 >> (gdb) quit >> >> =============================================== >> third gdb >> ===================================================== >> (gdb) cont >> Continuing. >> >> Program received signal SIGSEGV, Segmentation fault. >> 0xfebd710c in t_splay () from /lib/libc.so.1 >> (gdb) bt full >> #0 0xfebd710c in t_splay () from /lib/libc.so.1 >> No symbol table info available. >> #1 0xfebd6eb8 in t_delete () from /lib/libc.so.1 >> No symbol table info available. >> #2 0xfebd6acc in realfree () from /lib/libc.so.1 >> No symbol table info available. >> #3 0xfebd72c8 in _free_unlocked () from /lib/libc.so.1 >> No symbol table info available. >> #4 0xfebd7204 in free () from /lib/libc.so.1 >> No symbol table info available. >> #5 0xfe862144 in lucene::document::Field::_resetValue (this=0x71e288) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Field.cpp:300 >> No locals. >> #6 0xfe862248 in ~Field (this=0x71e288) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Field.cpp:103 >> No locals. >> #7 0xfe90dcc8 in ~CLVector (this=0x23c248) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/util/Equators.h:227 >> itr = {_M_current = 0x71eb00} >> #8 0xfe860dfc in ~Document (this=0x832e0) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Document.cpp:69 >> No locals. >> #9 0xfea18e30 in lucene_index_build_flush (index=0x8adc0) at lucene-wrapper.cc:493 >> ret = 0 >> #10 0xfea18f88 in lucene_index_build_more (index=0x8adc0, uid=4128, data=0x6b2b00 "", size=23, hdr_name=0x1b6508 "Return-Path") >> at lucene-wrapper.cc:507 >> id = {4, 0, 0, 0, -4196824, -15011172, 3114656, -4196336, 584416, 0, 11560, 0, 0, 0, 36, 7697128, 584416, 845, 0, 2382, 148880, 3114656, 3} >> namesize = 9216 >> datasize = 9216 >> dest = Cannot access memory at address 0x1020 >> (gdb) >> >> >> >> Here a couple of ( probably ) interesting stuff : >> >> root # grep "signal 10" /usr/local/dovecot/var/log/dovecot.log |wc >> 33 284 2308 >> root # grep "signal 11" /usr/local/dovecot/var/log/dovecot.log |wc >> 69 549 4457 >> root # grep "Lock obtain timed out" /usr/local/dovecot/var/log/dovecot.log |wc >> 74 420 3976 >> >> Thus, 74 times of 102 seems to be tied to "IndexWriter() failed (#1): Lock obtain timed out" ( which I don't really understand, >> or at least I have not enough comprehension of code to understand). >> The path where lucene try to get a lock is not NFS, but is an automount on the same machine ( no NFS then ). >> >> It seems that the "Lock obtain timed out" happens every time I read a message with the MUA. >> >> This error ("Lock obtain") happens every time I read a message from my MUA, I think it's due to the indexing process running on READ >> imap command: >> >> Apr 08 15:18:13 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx >> Apr 08 15:18:13 imap(xxxx): Error: indexer failed to index mailbox INBOX >> Apr 08 15:18:13 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 18171 killed with signal 11 (core not dumped) >> Apr 08 15:18:15 indexer-worker(xxxx): Error: lucene index /home/xxxx/Maildir/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out >> >> >> When searching, instead, get the "Lock timeout" followed by another error: >> >> Apr 08 15:11:37 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx >> Apr 08 15:11:37 imap(xxxx): Error: indexer failed to index mailbox INBOX >> Apr 08 15:11:37 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 17438 killed with signal 10 (core not dumped) >> Apr 08 15:11:38 indexer-worker(xxxx): Error: lucene index /home/xxxx/Maildir/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out >> Apr 08 15:11:51 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx >> Apr 08 15:11:51 imap(xxxx): Error: indexer failed to index mailbox INBOX >> >> >> >> In both case the signal ( 11 or 10, SEGV or SIGBUS ) it's indifferent ( sometimes is 10 sometimes is 11 ). >> >> Hope I've been able to explain, as my english seems to get worst every time ;) >> >> Pigi >> >> > From tss at iki.fi Thu Apr 11 20:12:02 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 11 Apr 2013 20:12:02 +0300 Subject: [Dovecot] Questions about the upcoming Object Storage Plugin for 2.2 In-Reply-To: <5166AD2A.8060706@Media-Brokers.com> References: <5166AD2A.8060706@Media-Brokers.com> Message-ID: <9E7B2EAC-5718-4BBE-9858-1E3D4DAF5FDF@iki.fi> On 11.4.2013, at 15.31, Charles Marcus wrote: > I'm curious and have questions about the new Object Storage Plugin (OSP), and how it can be leveraged by an SMB like us. I'll give some more complete answers and examples and such within a few days.. Or probably better if I write down some scenarios to some web page or something. > First, am I reading this right where it could be used as a kind of 'live/realtime backup' solution, where everything is stored *both* locally and in the cloud, with two-way syncing, ie, so local users could access the local server for faster access, and when outside the office, they'd access the cloud based storage and any changes made there are sync'd back to the local server? Or is it intended to be more as an alternative storage for storing older emails in a separate namespace? Or both/either? Currently you have a local cache (e.g. 100 GB total). You can also use dsync replication to replicate it somewhere, either locally or to another server. With dsync I think you can basically run it any way you want. > Second, is SIS fully supported by the OSP? Not currently, but could be added. > Third - I'm a little confused by the Amazon S3 pricing page, especially on how to try to estimate the costs for usage (bandwidth, etc)... do you have any idea how to go about estimating that? Is there some kind of process we could use on our existing server to measure it over a given period of time that would give us an estimate of what to expect if we decided to switch over? If you have large enough local cache, you're not really doing anything except uploading messages. Also index files are periodically being uploaded for each user (every 5 minutes if they have changed), but they are often also not full index files but smaller diffs for them (although upload bandwidth is free so doesn't really matter either). So ideally there would be no download costs at all, because nothing is downloaded. And the number of requests per user per day .. I haven't really counted, but I'd guess between a few hundred and a thousand. Lets say a thousand, which means with 100 users/year it's $182.50. > Last - have you established pricing for the OSP? Will it be per user, or per MB/GB, per month (or per year), or just a one-time cost? And/or will you include/bundle it with any/all of your support tiers? All of the above, I think ;) From pyz at brama.com Thu Apr 11 21:04:07 2013 From: pyz at brama.com (Max Pyziur) Date: Thu, 11 Apr 2013 14:04:07 -0400 (EDT) Subject: [Dovecot] Configuring dovecot to use tcp wrappers In-Reply-To: References: Message-ID: On Thu, 11 Apr 2013, lists-dovecot wrote: > > [... snip ...] >> >> I've put in a test ip address in /etc/hosts.deny like so: >> dovecot: 166.84.1.2 >> >> And then I execute the following from 166.84.1.2 to port 110: >> bash-3.2$ telnet SiteWhereImConfiguringDovecot 110 >> Trying SiteWhereImConfiguringDovecot... >> Connected to SiteWhereImConfiguringDovecot. >> Escape character is '^]'. >> +OK Dovecot ready. >> quit >> +OK Logging out >> Connection closed by foreign host. >> >> If dovecot is configured with tcp wrappers (which it is; built on >> a CentOS 6 system, installed and configured per instructions), >> and the firewall has ports 110 and 143 open, >> but I'm blocking a particular host through /etc/hosts.deny >> then I should not be able to telnet to either port 110 or 143; both >> requests should be blocked from the originating IP, no? >> >> Much thanks for your help, >> >> Max Pyziur >> pyz at brama.com > > > What are you using as the service name in hosts.deny? I think it > should be "imap-login:", (that's what I have as an > historical/left-over entry) but don't have dovecot configured with > wrappers on my current centos system so can't test this to be > certain. Also make certain that you don't have anything in your > hosts.allow file that would override the hosts.deny entry. I was using dovecot, until you convinced me to do otherwise. Putting pop3 in /etc/hosts.deny with the associated ip seems to work, like so: pop3: 166.84.1.2 or imap imap: 166.84.1.2 (are there any challenges to this?) Given that services such sendmail and sshd respond to sshd: xxx.xxx.xxx.xxx sendmail: xxx.xxx.xxx.xxx I thought that it should be dovecot: xxx.xxx.xxx.xxx As a suggestion, can dovecot binaries for distributions such as CentOS and Fedora be compiled with tcp wrappers by default? > - Richard Much thanks. MP pyz at brama.com From andrzej.filip at gmail.com Thu Apr 11 23:39:33 2013 From: andrzej.filip at gmail.com (Andrzej A. Filip) Date: Thu, 11 Apr 2013 22:39:33 +0200 Subject: [Dovecot] Reading dovecot-uidlist by external program (locking) Message-ID: <51671F85.5020907@gmail.com> How to lock dovecot-uidlist file before reading by an external program? [perl script] From andrzej.filip at gmail.com Thu Apr 11 23:45:06 2013 From: andrzej.filip at gmail.com (Andrzej A. Filip) Date: Thu, 11 Apr 2013 22:45:06 +0200 Subject: [Dovecot] Reading dovecot-uidlist by external program (locking) In-Reply-To: <51671F85.5020907@gmail.com> References: <51671F85.5020907@gmail.com> Message-ID: <516720D2.8080402@gmail.com> On 04/11/2013 10:39 PM, Andrzej A. Filip wrote: > How to lock dovecot-uidlist file before reading by an external program? > [perl script] I have been too "sending happy". http://wiki2.dovecot.org/MailboxFormat/Maildir The dovecot-uidlist file doesn't need to be locked for reading. From r at sys4.de Fri Apr 12 00:00:09 2013 From: r at sys4.de (Ralf Hildebrandt) Date: Thu, 11 Apr 2013 23:00:09 +0200 Subject: [Dovecot] How to prevent delivery to mailboxes over quota at SMTP-time Message-ID: <20130411210009.GD4839@sys4.de> Hi! I wrote a little something about how to prevent delivery to mailboxes over quota while still being in the SMTP dialogue: http://sys4.de/en/blog/2013/04/08/postfix-dovecot-mailbox-quota/ (Postfix/Dovecot-2.2) -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From jtam.home at gmail.com Fri Apr 12 03:02:13 2013 From: jtam.home at gmail.com (Joseph Tam) Date: Thu, 11 Apr 2013 17:02:13 -0700 (PDT) Subject: [Dovecot] Configuring dovecot to use tcp wrappers In-Reply-To: References: Message-ID: "Max Pyziur" wrote: > I've put in a test ip address in /etc/hosts.deny like so: > dovecot: 166.84.1.2 Maybe imap: 166.84.1.2 imaps: 166.84.1.2 pop3: 166.84.1.2 pop3s: 166.84.1.2 Joseph Tam From tlx at leuxner.net Fri Apr 12 10:33:24 2013 From: tlx at leuxner.net (Thomas Leuxner) Date: Fri, 12 Apr 2013 09:33:24 +0200 Subject: [Dovecot] How to prevent delivery to mailboxes over quota at SMTP-time In-Reply-To: <20130411210009.GD4839@sys4.de> References: <20130411210009.GD4839@sys4.de> Message-ID: <20130412073323.GA18372@nihlus.leuxner.net> * Ralf Hildebrandt 2013.04.11 23:00: > http://sys4.de/en/blog/2013/04/08/postfix-dovecot-mailbox-quota/ Hi Ralf, played around with it a bit. There is another thread here which indicates people couldn't get it to work. With the latest and greatest it seems to have some query issue: [...] Apr 12 09:22:04 spectre postfix/smtpd[18355]: warning: access table inet:127.0.0.1:10027 entry has empty value [...] Regards Thomas # 2.2.rc7 (cf898dbcbffb): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-0.bpo.4-amd64 x86_64 Debian 6.0.7 auth_cache_size = 16 k auth_verbose = yes mail_location = mdbox:~/mdbox mail_plugins = acl quota stats mailbox_list_index = yes namespace { list = yes location = mdbox:/var/vmail/public:INDEXPVT=~/mdbox/public prefix = Public/ separator = / subscriptions = no type = public } namespace inbox { hidden = no inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = username_format=%u /var/vmail/auth.d/%d/passwd driver = passwd-file } plugin { acl = vfile:/var/vmail/conf.d/%d/acls:cache_secs=300 mail_log_events = expunge mailbox_delete quota = dict:user::file:%h/mdbox/dovecot-quota quota_grace = 10%% quota_rule = *:storage=1GB quota_rule2 = Trash:storage=+10%% quota_status_nouser = DUNNO quota_status_success = DUNNO sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/vmail/conf.d/%d/sieve stats_refresh = 30s stats_track_cmds = yes } protocols = " imap lmtp" quota_full_tempfail = yes service auth-worker { unix_listener auth-worker { user = doveauth } user = doveauth } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = doveauth } service imap-login { inet_listener imap { address = 1.2.3.4 port = 143 } inet_listener imaps { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { address = 127.0.0.1 port = 10027 } } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_ca = From per at computer.org Fri Apr 12 10:43:56 2013 From: per at computer.org (Per Jessen) Date: Fri, 12 Apr 2013 09:43:56 +0200 Subject: [Dovecot] How to prevent delivery to mailboxes over quota at SMTP-time References: <20130411210009.GD4839@sys4.de> Message-ID: Ralf Hildebrandt wrote: > Hi! > > I wrote a little something about how to prevent delivery to mailboxes > over quota while still being in the SMTP dialogue: > http://sys4.de/en/blog/2013/04/08/postfix-dovecot-mailbox-quota/ > (Postfix/Dovecot-2.2) > Cool, thanks for posting that. I guess I'll have to upgrade, I think we're dovecot 2.0. -- Per Jessen, Z?rich (9.6?C) http://www.dns24.ch/ - free DNS hosting, made in Switzerland. From tlx at leuxner.net Fri Apr 12 10:55:21 2013 From: tlx at leuxner.net (Thomas Leuxner) Date: Fri, 12 Apr 2013 09:55:21 +0200 Subject: [Dovecot] How to prevent delivery to mailboxes over quota at SMTP-time In-Reply-To: <20130412073323.GA18372@nihlus.leuxner.net> References: <20130411210009.GD4839@sys4.de> <20130412073323.GA18372@nihlus.leuxner.net> Message-ID: <20130412075521.GB18372@nihlus.leuxner.net> * Thomas Leuxner 2013.04.12 09:33: > [...] > Apr 12 09:22:04 spectre postfix/smtpd[18355]: warning: access table inet:127.0.0.1:10027 entry has empty value > [...] After some mails have been accepted it starts to reject like this: ==> /var/log/dovecot/dovecot.log <== Apr 12 09:46:30 spectre dovecot: quota-status(tlx at leuxner.net): Error: user tlx at leuxner.net: Error reading configuration: net_connect_unix(/var/run/dovecot/config) failed: Permission denied ==> /var/log/mail.log <== Apr 12 09:46:31 spectre postfix/smtpd[18494]: NOQUEUE: reject: RCPT from duonullaocto.xi.ecm-cluster.com[91.192.42.208]: 450 4.7.1 : Recipient address rejected: Internal error occurred. Refer to server log for more information.; from= to= proto=ESMTP helo= -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From kandakc at gmail.com Fri Apr 12 12:34:48 2013 From: kandakc at gmail.com (ChandranManikandan) Date: Fri, 12 Apr 2013 17:34:48 +0800 Subject: [Dovecot] Migration from courier to dovecot Message-ID: Hi, I am using Courier imap+Qmail+Vpopmail. My IMAP having slow issues on our email client while download message as well switch to another folder. I would request you to give me the procedure for migration as well let me know if anything going wrong after migrate. We have 100 mailboxes and some email box more than 25 GB. I want to access email fast in oulook client 2010 as well squirrelmail. Kindly guide me . Am waiting for your reply asap. -- *Thanks & Best Regards, Manikandan.C * From dan.clovis1 at gmail.com Fri Apr 12 16:03:16 2013 From: dan.clovis1 at gmail.com (Dan Clovis) Date: Fri, 12 Apr 2013 14:03:16 +0100 Subject: [Dovecot] Dovecot / Postfix Message-ID: <51680614.4090604@gmail.com> Ave Maria! I have Dovecot and Postifx setup with MySQL - emails seem to go through the server but for some reason the pipe into the wrong Virtual Domain any ideas? Also I notice If you need any other configurations please let me know... mail.info logs: Apr 12 13:30:14 Server1 postfix/smtpd[21411]: connect from mail-qe0-f48.google.com[209.85.128.48] Apr 12 13:30:14 Server1 postfix/trivial-rewrite[21415]: warning: do not list domain ccpop.itco.co in BOTH mydestination and virtual_mailbox_domains Apr 12 13:30:14 Server1 postfix/smtpd[21411]: F365B14EE1AE: client=mail-qe0-f48.google.com[209.85.128.48] Apr 12 13:30:15 Server1 postfix/cleanup[21416]: F365B14EE1AE: message-id= Apr 12 13:30:15 Server1 postfix/qmgr[21407]: F365B14EE1AE: from=, size=1706, nrcpt=1 (queue active) Apr 12 13:30:15 Server1 dovecot: auth(default): master in: USER#0111#011dan at companycouk.com#011service=deliver Apr 12 13:30:15 Server1 dovecot: auth(default): master out: USER#0111#011dan at companycouk.com#011uid=5000#011gid=5000#011home=/home/vmail/companycouk.com/dan Apr 12 13:30:15 Server1 postfix/pipe[21417]: F365B14EE1AE: to=, orig_to=, relay=dovecot, delay=0.29, delays=0.28/0/0/0.01, dsn=2.0.0, status=sent (delivered via dovecot service) Apr 12 13:30:15 Server1 postfix/qmgr[21407]: F365B14EE1AE: removed Postfix main.cf # See /usr/share/postfix/main.cf.dist for a commented, more complete version # Debian specific: Specifying a file name will cause the first # line of that file to be used as the name. The Debian default # is /etc/mailname. #myorigin = /etc/mailname smtpd_banner = $myhostname ESMTP $mail_name (Debian/GNU) biff = no # appending .domain is the MUA's job. append_dot_mydomain = no # Uncomment the next line to generate "delayed mail" warnings #delay_warning_time = 4h readme_directory = /usr/share/doc/postfix # TLS parameters smtpd_tls_cert_file = /etc/postfix/smtpd.cert smtpd_tls_key_file = /etc/postfix/smtpd.key smtpd_use_tls = yes smtpd_tls_session_cache_database = btree:${data_directory}/smtpd_scache smtp_tls_session_cache_database = btree:${data_directory}/smtp_scache # See /usr/share/doc/postfix/TLS_README.gz in the postfix-doc package for # information on enabling SSL in the smtp client. myhostname = pop3.companycouk.com alias_maps = hash:/etc/aliases alias_database = hash:/etc/aliases myorigin = /etc/mailname mydestination = ccpop.itco.co, localhost, localhost.localdomain, companycoServer1, companycoServer1.companycoServer1 relayhost = mynetworks = 127.0.0.0/8 mailbox_command = procmail -a "$EXTENSION" mailbox_size_limit = 0 recipient_delimiter = + inet_interfaces = all html_directory = /usr/share/doc/postfix/html message_size_limit = 30720000 virtual_alias_domains = virtual_alias_maps = proxy:mysql:/etc/postfix/mysql-virtual_forwardings.cf, mysql:/etc/postfix/mysql-virtual_email2email.cf virtual_mailbox_domains = proxy:mysql:/etc/postfix/mysql-virtual_domains.cf virtual_mailbox_maps = proxy:mysql:/etc/postfix/mysql-virtual_mailboxes.cf virtual_mailbox_base = /home/vmail virtual_uid_maps = static:5000 virtual_gid_maps = static:5000 smtpd_sasl_auth_enable = yes broken_sasl_auth_clients = yes smtpd_sasl_authenticated_header = yes smtpd_recipient_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination virtual_create_maildirsize = yes virtual_maildir_extended = yes proxy_read_maps = $local_recipient_maps $mydestination $virtual_alias_maps $virtual_alias_domains $virtual_mailbox_maps $virtual_mailbox_domains $relay_recipient_maps $relay_domains $canonical_maps $sender_canonical_maps $recipient_canonical_maps $relocated_maps $transport_maps $mynetworks $virtual_mailbox_limit_maps virtual_transport = dovecot dovecot_destination_recipient_limit = 1 God Bless Dan From h.reindl at thelounge.net Fri Apr 12 16:09:19 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 12 Apr 2013 15:09:19 +0200 Subject: [Dovecot] Dovecot / Postfix In-Reply-To: <51680614.4090604@gmail.com> References: <51680614.4090604@gmail.com> Message-ID: <5168077F.5090306@thelounge.net> Am 12.04.2013 15:03, schrieb Dan Clovis: > I have Dovecot and Postifx setup with MySQL - emails seem to go through the server but for some reason the pipe > into the wrong Virtual Domain any ideas? > > Also I notice > > If you need any other configurations please let me know... > > mail.info logs: > Apr 12 13:30:14 Server1 postfix/smtpd[21411]: connect from mail-qe0-f48.google.com[209.85.128.48] > Apr 12 13:30:14 Server1 postfix/trivial-rewrite[21415]: warning: do not list domain ccpop.itco.co in BOTH > mydestination and virtual_mailbox_domains fix this first - there is a reson for the warning! -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From jerry at seibercom.net Fri Apr 12 16:22:14 2013 From: jerry at seibercom.net (Jerry) Date: Fri, 12 Apr 2013 09:22:14 -0400 Subject: [Dovecot] Dovecot / Postfix In-Reply-To: <51680614.4090604@gmail.com> References: <51680614.4090604@gmail.com> Message-ID: <20130412092214.35d14b71@scorpio> On Fri, 12 Apr 2013 14:03:16 +0100 Dan Clovis articulated: > I have Dovecot and Postifx setup with MySQL - emails seem to go > through the server but for some reason the pipe into the wrong > Virtual Domain any ideas? > > Also I notice > > If you need any other configurations please let me know... Post the output of "postconf -n". See for further details. Actually, this question probably belongs on the Postfix forum. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From r at sys4.de Fri Apr 12 16:40:18 2013 From: r at sys4.de (Ralf Hildebrandt) Date: Fri, 12 Apr 2013 15:40:18 +0200 Subject: [Dovecot] How to prevent delivery to mailboxes over quota at SMTP-time In-Reply-To: <20130412073323.GA18372@nihlus.leuxner.net> References: <20130411210009.GD4839@sys4.de> <20130412073323.GA18372@nihlus.leuxner.net> Message-ID: <20130412134017.GB7189@sys4.de> * Thomas Leuxner : > * Ralf Hildebrandt 2013.04.11 23:00: > > > http://sys4.de/en/blog/2013/04/08/postfix-dovecot-mailbox-quota/ > > Hi Ralf, > > played around with it a bit. There is another thread here which indicates people couldn't get it to work. With the latest and greatest it seems to have some query issue: > > [...] > Apr 12 09:22:04 spectre postfix/smtpd[18355]: warning: access table inet:127.0.0.1:10027 entry has empty value > [...] Try testing it manually, like this: # telnet localhost 12340 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. request=smtpd_access_policy sender=sentto-19572345-3526-1365773584-mateusz.xxxxx=charite.de at returns.groups.yahoo.com recipient=mateusz.xxxxx at charite.de size=100 action=552 5.2.2 Quota exceeded (mailbox for user is full) -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From davide.marchi at mail.cgilfe.it Fri Apr 12 17:00:29 2013 From: davide.marchi at mail.cgilfe.it (Davide) Date: Fri, 12 Apr 2013 16:00:29 +0200 Subject: [Dovecot] Problem with vpopmail + qmail + dovecot lda Message-ID: <5168137D.1040802@mail.cgilfe.it> I have a little problem in my configuration (vpopmail + qmail + dovecot 2.1.12 with LDA) my .qmail-default is this | /var/qmail/bin/preline -f /usr/local/libexec/dovecot/dovecot-lda -d $EXT@$USER -e | /home/vpopmail/bin/vdelivermail '' bounce-no-mailbox I receive al mails to postmaster for non-existent users (all my users are virtual and live under group 89 vpopmail) and this is ok but all mails for quota-full users dosen't If i remove the vdelivermail part in .qmail-default i receive bounce for quota-full but not for non-existent users. If can be usefull this is my dovecot conf auth_cache_size = 10 k auth_cache_ttl = 5 hours auth_mechanisms = plain cram-md5 disable_plaintext_auth = yes dotlock_use_excl = yes first_valid_gid = 89 first_valid_uid = 89 info_log_path = /var/log/dovecot/dovecot.log last_valid_gid = 89 last_valid_uid = 89 listen = 127.0.0.1 log_path = /var/log/dovecot/dovecot-err.log debug_log_path = /var/log/dovecot/dovecot-debug.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = never mail_location = maildir:~/Maildir # mail_debug = yes mmap_disable = yes mail_plugins=$mail_plugins notify zlib fts fts_solr quota default_internal_user = dovecot default_login_user = dovenull default_vsz_limit = 512M maildir_very_dirty_syncs=yes verbose_ssl = no # syslog_facility = mail namespace { inbox = yes location = prefix = separator = / type = private } # Public namespace namespace { type = public separator = / prefix = Public/ location = maildir:/var/mail/public subscriptions = no list = children } passdb { args = webmail=127.0.0.1 cache_key=%u%s driver = vpopmail } plugin { fts = solr fts_decoder = decode2text fts_solr = url=http://192.168.10.103:8983/solr/ break-imap-search debug zlib_save_level = 9 # 1..9 zlib_save = gz # or bz2 # sieve = /usr/local/lib/dovecot/sieve/%n.sieve sieve=~/.dovecot.sieve sieve_dir=~/sieve # sieve_default = /usr/local/lib/dovecot/sieve/default.sieve # sieve_global_dir = /usr/local/lib/dovecot/sieve/ mail_log_events = delete undelete expunge copy mail_log_fields = uid box msgid size mail_log_group_events = quota = maildir:User quota quota_rule2 = Trash:storage=+20%% quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u # antispam_debug_target = syslog # antispam_verbose_debug = 1 antispam_backend = pipe antispam_spam = SPAM antispam_unsure = UNSURE antispam_trash_pattern_ignorecase = trash;Deleted * # antispam_signature = X-DSPAM-Signature # antispam_signature_missing = move # antispam_dspam_binary = /usr/local/bin/dspamc # antispam_crm_args = -u;%h;/usr/share/crm114/mailreaver.crm;--fileprefix=/usr/share/crm114/ #sa-learn -u clamav --spam /var/mail/public/.Spam --showdots # antispam_dspam_args = --deliver;--user;%u antispam_pipe_program = /usr/bin/sa-learn # (defaults to /usr/sbin/sendmail) antispam_pipe_program_args = -u;clamav antispam_pipe_program_spam_arg = --spam antispam_pipe_program_notspam_arg = --ham antispam_pipe_tmpdir = /mnt/ramdisk } protocols = imap sieve service auth { unix_listener auth-master { group = vchkpw mode = 0660 user = vpopmail } unix_listener auth-userdb { mode = 0600 user = vpopmail group = vchkpw } # user = vpopmail vsz_limit = 64 M } service imap-login { executable = /usr/local/libexec/dovecot/imap-login inet_listener imaps { address = 192.168.119.150 } process_limit = 500 process_min_avail = 8 service_count = 1 #user = dovecot } service managesieve-login { executable = managesieve-login inet_listener sieve { address = 127.0.0.1 port = 4190 } #inet_listener sieve_deprecated { # port = 2000 #} # Number of connections to handle before starting a new process. Typically # the only useful values are 0 (unlimited) or 1. 1 is more secure, but 0 # is faster. service_count = 1 # Number of processes to always keep waiting for more connections. process_min_avail = 1 # If you set service_count=0, you probably need to grow this. vsz_limit = 64M } service managesieve { # Max. number of ManageSieve processes (connections) process_limit = 10 } # Service configuration protocol sieve { # Maximum ManageSieve command line length in bytes. ManageSieve usually does # not involve overly long command lines, so this setting will not normally need # adjustment managesieve_max_line_length = 65536 # Maximum number of ManageSieve connections allowed for a user from each IP address. # NOTE: The username is compared case-sensitively. #mail_max_userip_connections = 10 # Space separated list of plugins to load (none known to be useful so far). Do NOT # try to load IMAP plugins here. #mail_plugins = # MANAGESIEVE logout format string: # %i - total number of bytes read from client # %o - total number of bytes sent to client managesieve_logout_format = bytes=%i/%o # To fool ManageSieve clients that are focused on CMU's timesieved you can specify # the IMPLEMENTATION capability that the dovecot reports to clients. # For example: 'Cyrus timsieved v2.2.13' managesieve_implementation_string = Dovecot Pigeonhole # Explicitly specify the SIEVE and NOTIFY capability reported by the server before # login. If left unassigned these will be reported dynamically according to what # the Sieve interpreter supports by default (after login this may differ depending # on the user). #managesieve_sieve_capability = #managesieve_notify_capability = # The maximum number of compile errors that are returned to the client upon script # upload or script verification. #managesieve_max_compile_errors = 5 # Refer to 90-sieve.conf for script quota configuration and configuration of # Sieve execution limits. log_path = /var/log/dovecot/dovecot-sieve-error.log info_log_path = /var/log/dovecot/dovecot-sieve.log } service decode2text { executable = script /usr/local/libexec/dovecot/decode2text.sh unix_listener decode2text { mode = 0666 user = dovecot } #user = vpopmail } service imap { executable = /usr/local/libexec/dovecot/imap vsz_limit = 1024M } service quota-warning { executable = script /usr/local/libexec/dovecot/quota_warning # use some unprivileged user for executing the quota warnings user = vpopmail unix_listener quota-warning { group = vchkpw mode = 0660 user = vpopmail } } ssl_cert = -<%s>-%m: %$ hostname = mail.cgilfe.it info_log_path = /var/log/dovecot/dovecot-deliver.log log_path = /var/log/dovecot/dovecot-deliver.log mail_plugin_dir = /usr/local/lib/dovecot mail_plugins = $mail_plugins mail_log sieve postmaster_address = postmaster at mail.cgilfe.it rejection_reason = Il Vostro messaggio a <%t> ? stato automaticamente rifiutato:%n%r sendmail_path = /usr/bin/sendmail # quota_full_tempfail = yes } -- *Davide Marchi* *T*eorema *F*errara *Srl* Via Spronello, 7 - Ferrara - 44121 Tel. *0532783161* Fax. *0532783368* E-m at il: *davide.marchi at mail.cgilfe.it* Skype: *davide.marchi73* Web: *http://www.cgilfe.it* *CONFIDENZIALITA'* *Ai sensi del D.Lgs. 196/2003 si precisa che le informazioni contenute in questo messaggio sono riservate ed a uso esclusivo del destinatario/dei destinatari. Qualora il messaggio in parola Le fosse pervenuto per errore, La invitiamo ad eliminarlo senza copiarlo e a non inoltrarlo a terzi, dandocene gentilmente comunicazione.* *Per favore, pensa all'ambiente. Stampa questa email solo se necessario.* From tlx at leuxner.net Fri Apr 12 17:09:01 2013 From: tlx at leuxner.net (Thomas Leuxner) Date: Fri, 12 Apr 2013 16:09:01 +0200 Subject: [Dovecot] How to prevent delivery to mailboxes over quota at SMTP-time In-Reply-To: <20130412134017.GB7189@sys4.de> References: <20130411210009.GD4839@sys4.de> <20130412073323.GA18372@nihlus.leuxner.net> <20130412134017.GB7189@sys4.de> Message-ID: <20130412140900.GC18372@nihlus.leuxner.net> * Ralf Hildebrandt 2013.04.12 15:40: > > [...] > > Apr 12 09:22:04 spectre postfix/smtpd[18355]: warning: access table inet:127.0.0.1:10027 entry has empty value > > [...] > > Try testing it manually, like this: > > # telnet localhost 12340 > Trying 127.0.0.1... > Connected to localhost. > Escape character is '^]'. > request=smtpd_access_policy > sender=sentto-19572345-3526-1365773584-mateusz.xxxxx=charite.de at returns.groups.yahoo.com > recipient=mateusz.xxxxx at charite.de > size=100 > > action=552 5.2.2 Quota exceeded (mailbox for user is full) That seems to work. Created local over usage and can query that: $ doveadm quota get -u tlx at leuxner.net Quota name Type Value Limit % user STORAGE 317790 204800 155 user MESSAGE 5181 $ telnet localhost 10027 Trying ::1... Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. request=smtpd_access_policy sender=noreply at example.org recipient=tlx at leuxner.net size=100 action=552 5.2.2 Quota exceeded (mailbox for user is full) Still when I point Postfix to use it, it creates the error above and the strange config socket issue in Dovecot: > Apr 12 09:46:30 spectre dovecot: quota-status(tlx at leuxner.net): Error: user tlx at leuxner.net: Error reading configuration: net_connect_unix(/var/run/dovecot/config) failed: Permission denied -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From dan.clovis1 at gmail.com Fri Apr 12 17:42:11 2013 From: dan.clovis1 at gmail.com (Dan Clovis) Date: Fri, 12 Apr 2013 15:42:11 +0100 Subject: [Dovecot] Dovecot / Postfix In-Reply-To: <20130412092214.35d14b71@scorpio> References: <51680614.4090604@gmail.com> <20130412092214.35d14b71@scorpio> Message-ID: <51681D43.2000707@gmail.com> Ave Maria! You are right, I will post it on postfix forum - however if you are gracious enough the help me - here is the output you requested.... ;) alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases append_dot_mydomain = no biff = no broken_sasl_auth_clients = yes config_directory = /etc/postfix html_directory = /usr/share/doc/postfix/html inet_interfaces = all mailbox_command = procmail -a "$EXTENSION" mailbox_size_limit = 0 message_size_limit = 30720000 mydestination = companycouk.com, ccpop.itco.co, localhost, localhost.localdomain, companycoServer1, companycoServer1.companycoServer1 myhostname = pop3.companycouk.com mynetworks = 127.0.0.0/8 myorigin = /etc/mailname proxy_read_maps = $local_recipient_maps $mydestination $virtual_alias_maps $virtual_alias_domains $virtual_mailbox_maps $virtual_mailbox_domains $relay_recipient_maps $relay_domains $canonical_maps $sender_canonical_maps $recipient_canonical_maps $relocated_maps $transport_maps $mynetworks $virtual_mailbox_limit_maps readme_directory = /usr/share/doc/postfix recipient_delimiter = + relayhost = smtp_tls_session_cache_database = btree:${data_directory}/smtp_scache smtpd_banner = $myhostname ESMTP $mail_name (Debian/GNU) smtpd_recipient_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination smtpd_sasl_auth_enable = yes smtpd_sasl_authenticated_header = yes smtpd_tls_cert_file = /etc/postfix/smtpd.cert smtpd_tls_key_file = /etc/postfix/smtpd.key smtpd_tls_session_cache_database = btree:${data_directory}/smtpd_scache smtpd_use_tls = yes virtual_alias_domains = virtual_alias_maps = proxy:mysql:/etc/postfix/mysql-virtual_forwardings.cf, mysql:/etc/postfix/mysql-virtual_email2email.cf virtual_gid_maps = static:5000 virtual_mailbox_base = /home/vmail virtual_mailbox_domains = proxy:mysql:/etc/postfix/mysql-virtual_domains.cf virtual_mailbox_maps = proxy:mysql:/etc/postfix/mysql-virtual_mailboxes.cf virtual_transport = dovecot virtual_uid_maps = static:5000 On 12/04/2013 14:22, Jerry wrote: > On Fri, 12 Apr 2013 14:03:16 +0100 > Dan Clovis articulated: > >> I have Dovecot and Postifx setup with MySQL - emails seem to go >> through the server but for some reason the pipe into the wrong >> Virtual Domain any ideas? >> >> Also I notice >> >> If you need any other configurations please let me know... > Post the output of "postconf -n". See > for further details. > Actually, this question probably belongs on the Postfix forum. > From noeldude at gmail.com Fri Apr 12 18:38:52 2013 From: noeldude at gmail.com (Noel) Date: Fri, 12 Apr 2013 10:38:52 -0500 Subject: [Dovecot] Dovecot / Postfix In-Reply-To: <51681D43.2000707@gmail.com> References: <51680614.4090604@gmail.com> <20130412092214.35d14b71@scorpio> <51681D43.2000707@gmail.com> Message-ID: <51682A8C.5050801@gmail.com> On 4/12/2013 9:42 AM, Dan Clovis wrote: > Ave Maria! > > You are right, I will post it on postfix forum - however if you > are gracious enough the help me - here is the output you > requested.... ;) > > alias_database = hash:/etc/aliases ... > smtpd_recipient_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination but what we really want to see (and what postfix-users will want to see) is how you integrated this into postfix, not a working config before changes. Did you maybe forget the "check_policy_service" keyword? -- Noel Jones From tss at iki.fi Fri Apr 12 20:33:07 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 12 Apr 2013 20:33:07 +0300 Subject: [Dovecot] v2.2.0 released Message-ID: <1365787987.11047.246.camel@innu> http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz.sig Everything now seems to be stable and working in v2.2, so I can finally move onto developing great new interesting features for v2.3. :) My company has also launched a web shop where you can buy various products. One of them is cheap access to Dovecot enterprise edition repositories, which are basically same as regular Dovecot releases, except they are kept patched with the latest important bugfixes. We currently have releases for RHEL/CentOS 5 and 6, Debian Squeeze and Ubuntu 12.04 LTS. By buying Dovecot-EE you'll also get a 30 day demo license for object storages, if you want to try it out. http://shop.dovecot.fi/ * When creating home directories, the permissions are copied from the parent directory if it has setgid-bit set. For full details, see http://wiki2.dovecot.org/SharedMailboxes/Permissions * "doveadm auth" command was renamed to "doveadm auth test" * IMAP: ID command now advertises server name as Dovecot by default. It was already trivial to guess this from command replies. * dovecot.index.cache files can be safely accessed only by v2.1.11+. Older versions may think they're corrupted and delete them. * LDA/LMTP: If saving a mail brings user from under quota to over quota, allow it based on quota_grace setting (default: 10% above quota limit). * pop3_lock_session=yes now uses a POP3-only dovecot-pop3-session.lock file instead of actually locking the mailbox (and causing IMAP/LDA/LMTP to wait for the POP3 session to close). * mail_shared_explicit_inbox setting's default switched to "no". * ssl_client_ca_dir setting replaced imapc_ssl_ca_dir and pop3c_ssl_ca_dir settings. + Implemented IMAP MOVE and BINARY extensions + Implemented IMAP CATENATE, URLAUTH and URLAUTH=BINARY extensions (by Stephan Bosch). + Implemented IMAP NOTIFY extension. Requires mailbox_list_index=yes to be enabled. + Redesigned and rewritten dsync. The new design makes the syncing faster, more reliable and more featureful. The new dsync protocol isn't backwards compatible with old dsync versions (but is designed to be forwards compatible with future versions). + All mailbox formats now support per-user message flags for shared mailboxes by using a private index. It can be enabled by adding :INDEXPVT= to mail location. This should be used instead of :INDEX also for Maildir/mbox to improve performance. + Improved mailbox list indexes. They should be usable now, although still disabled by default. + Added LAYOUT=index. The mailbox directories are created using their GUIDs in the filesystem, while the actual GUID <-> name mapping exists only in the index. + LMTP proxy: Implemented XCLIENT extension for passing remote IP address through proxy. From msmith at giganews.com Fri Apr 12 21:13:22 2013 From: msmith at giganews.com (Michael Smith) Date: Fri, 12 Apr 2013 18:13:22 +0000 Subject: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot In-Reply-To: References: <62CA7D02-69DA-47C4-9CE7-4A8D9518670F@iki.fi> <2DAEBE3C-53D8-4858-8067-3398CCF3B4BF@iki.fi> Message-ID: Timo, Any luck reproducing the sync error with the updated/correct mbox file? -- Michael Smith -----Original Message----- From: dovecot-bounces at dovecot.org [mailto:dovecot-bounces at dovecot.org] On Behalf Of Michael Smith Sent: Wednesday, April 10, 2013 3:52 PM To: 'Timo Sirainen' Cc: 'dovecot at dovecot.org' Subject: Re: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot It shouldn't. Part of the migration is to remove any existing dovecot mailbox for the user. It does this by deleting the entire user's directory. I just downloaded the file and checked. Oops, looks like I grabbed the post dsync mirror file. I've uploaded the correct file (pre dsync mirror). Downloaded it and confirmed I'm getting the following error on dsync mirror. dsync(webmail): Error: Sync failed for mbox file /var/opt/migrate/users/webmail/inbox: seq=4482 uid=4482 uid_broken=0 originally needed 10 bytes, now needs 12 bytes -- Michael Smith -----Original Message----- From: Timo Sirainen [mailto:tss at iki.fi] Sent: Tuesday, April 09, 2013 4:05 PM To: Michael Smith Cc: 'dovecot at dovecot.org' Subject: Re: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot On 9.4.2013, at 1.41, Michael Smith wrote: > I tried importing the anonymized file, and there were no errors. So, it's something with the actual data. UTF-8 issues? > > While I can't send you a raw customer's mailbox, one of the failures is a 'role' account mailbox, with no critical/useful data in it. > > Here is a link (expires in 30 days) to download the mailbox, it's 107M. > https://truck.it/p/HNlzl9hWbO > > The error I'm getting is > dsync(webmail): Error: Sync failed for mbox file /var/opt/migrate/users/webmail/inbox: seq=4482 uid=4482 uid_broken=0 originally needed 10 bytes, now needs 12 bytes I can't reproduce with that file, dsync succeeds without errors. Maybe the problem requires something specific in the index files also? From tss at iki.fi Fri Apr 12 21:17:09 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 12 Apr 2013 21:17:09 +0300 Subject: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot In-Reply-To: References: <62CA7D02-69DA-47C4-9CE7-4A8D9518670F@iki.fi> <2DAEBE3C-53D8-4858-8067-3398CCF3B4BF@iki.fi> Message-ID: <9E7F07ED-59CC-4D1E-9316-ABDF9389F28A@iki.fi> Yes, I can reproduce it now. I'll try to get it fixed on Monday. On 12.4.2013, at 21.13, Michael Smith wrote: > Timo, > > Any luck reproducing the sync error with the updated/correct mbox file? > > -- > Michael Smith > > > -----Original Message----- > From: dovecot-bounces at dovecot.org [mailto:dovecot-bounces at dovecot.org] On Behalf Of Michael Smith > Sent: Wednesday, April 10, 2013 3:52 PM > To: 'Timo Sirainen' > Cc: 'dovecot at dovecot.org' > Subject: Re: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot > > It shouldn't. Part of the migration is to remove any existing dovecot mailbox for the user. It does this by deleting the entire user's directory. > > I just downloaded the file and checked. Oops, looks like I grabbed the post dsync mirror file. > > I've uploaded the correct file (pre dsync mirror). Downloaded it and confirmed I'm getting the following error on dsync mirror. > > dsync(webmail): Error: Sync failed for mbox file /var/opt/migrate/users/webmail/inbox: seq=4482 uid=4482 uid_broken=0 originally needed 10 bytes, now needs 12 bytes > > > -- > Michael Smith > > -----Original Message----- > From: Timo Sirainen [mailto:tss at iki.fi] > Sent: Tuesday, April 09, 2013 4:05 PM > To: Michael Smith > Cc: 'dovecot at dovecot.org' > Subject: Re: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot > > On 9.4.2013, at 1.41, Michael Smith wrote: > >> I tried importing the anonymized file, and there were no errors. So, it's something with the actual data. UTF-8 issues? >> >> While I can't send you a raw customer's mailbox, one of the failures is a 'role' account mailbox, with no critical/useful data in it. >> >> Here is a link (expires in 30 days) to download the mailbox, it's 107M. >> https://truck.it/p/HNlzl9hWbO >> >> The error I'm getting is >> dsync(webmail): Error: Sync failed for mbox file /var/opt/migrate/users/webmail/inbox: seq=4482 uid=4482 uid_broken=0 originally needed 10 bytes, now needs 12 bytes > > I can't reproduce with that file, dsync succeeds without errors. Maybe the problem requires something specific in the index files also? > > From mark at msapiro.net Fri Apr 12 22:16:53 2013 From: mark at msapiro.net (Mark Sapiro) Date: Fri, 12 Apr 2013 12:16:53 -0700 Subject: [Dovecot] v2.2.0 released In-Reply-To: <1365787987.11047.246.camel@innu> References: <1365787987.11047.246.camel@innu> Message-ID: <51685DA5.5060506@msapiro.net> On 4/12/2013 10:33 AM, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz.sig > > Everything now seems to be stable and working in v2.2, so I can finally > move onto developing great new interesting features for v2.3. :) It's installed and running here. Congratulations (big round of applause) -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan From jg at softjury.de Fri Apr 12 23:18:39 2013 From: jg at softjury.de (Jan Phillip Greimann) Date: Fri, 12 Apr 2013 22:18:39 +0200 Subject: [Dovecot] v2.2.0 released In-Reply-To: <1365787987.11047.246.camel@innu> References: <1365787987.11047.246.camel@innu> Message-ID: <51686C1F.1090401@softjury.de> Am 12.04.2013 19:33, schrieb Timo Sirainen: > http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz.sig > > Everything now seems to be stable and working in v2.2, so I can finally > move onto developing great new interesting features for v2.3. :) Thank you for the afford every time, great work! From maia at weiser.dk Fri Apr 12 23:26:14 2013 From: maia at weiser.dk (Kim Johansen) Date: Fri, 12 Apr 2013 22:26:14 +0200 Subject: [Dovecot] Migration from courier to dovecot In-Reply-To: References: Message-ID: <51686DE6.8050303@weiser.dk> Hey, I am working on doing this migration myself. I have migrated some test users. And I have build this script to help me, maybe you can use it for inspiration(It is on your own risk to use it!): #!/bin/sh #Source="/var/vpopmail/" Destination="/var/mail/vmail/" i=0 for line in $(cat mailboxs.txt) do if [ -d $Source$line.maildir ] then # Create destination echo "--Creating $Destination$line" mkdir -p $Destination$line # Load new data from backup echo "--Copy from $Source$line to $Destination$line" cp -a $Source$line.maildir $Destination$line #If they exist mv trash, send and draft to .INBOX.XXXX echo "--If exist then, mv trash send and draft to .INBOX.XXX in $Destination$line" if [ -d $Destination$line/.maildir/.Drafts ]; then mv $Destination$line/.maildir/.Drafts $Destination$line/.maildir/.INBOX.Drafts fi if [ -d $Destination$line/.maildir/.Trash ]; then mv $Destination$line/.maildir/.Trash $Destination$line/.maildir/.INBOX.Trash fi if [ -d $Destination$line/.maildir/.Sent ]; then mv $Destination$line/.maildir/.Sent $Destination$line/.maildir/.INBOX.Sent fi # Change the file right to the new system incl hidden files echo "--Changes owner to vmail:vmail on $Destination$line recursive" chown -R vmail:vmail $Destination$line $Destination$line.* # Run converter script if et reports an error we stop the whole script echo "--Calling courier-dovecot-migrate.pl" /home/weiser/courier-dovecot-migrate.pl --to-dovecot --convert $Destination$line.maildir current=$? if [ $current -ne "0" ]; then echo "$current" exit fi # move data from .maildir to .. echo "--Moving data from ./.maildir to ." mv $Destination$line.maildir/* $Destination$line mv $Destination$line.maildir/.* $Destination$line # remove old unused .maildir echo "--Remove old courierfiles and folder and .maildir" rmdir $Destination$line.maildir /usr/bin/find $Destination$line -name courierimapsubscribed -exec rm {} \; /usr/bin/find $Destination$line -name courierimapuiddb -exec rm {} \; /usr/bin/find $Destination$line -name courierpop3dsizelist -exec rm {} \; /usr/bin/find $Destination$line -name courierimapacl -exec rm {} \; /usr/bin/find $Destination$line -name courierimapkeywords -exec rm -f -R {} \; i=$(( i + 1 )) else echo "$Source$line.maildir folder not found" fi done; echo "$i mailbox mirgrated" it needs to external files to work: mailboxs.txt, which have a path to each mail folder: domain1/user1/ domain1/user2/ domain2/user1/ and the courier-dovecot-migrate.pl which you can find more information about here: http://wiki2.dovecot.org/Migration/Courier good luck. -- Kim Johansen On 2013-04-12 11:34, ChandranManikandan wrote: > Hi, > I am using Courier imap+Qmail+Vpopmail. > My IMAP having slow issues on our email client while download message as > well switch to another folder. I would request you to give me the procedure > for migration as well let me know if anything going wrong after migrate. We > have 100 mailboxes and some email box more than 25 GB. I want to access > email fast in oulook client 2010 as well squirrelmail. Kindly guide me . Am > waiting for your reply asap. > From nick.z.edwards at gmail.com Sat Apr 13 07:13:58 2013 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Sat, 13 Apr 2013 14:13:58 +1000 Subject: [Dovecot] listen directive changed? Message-ID: Timo, Is the global listen directive supposed to be a governing directive, like in apache? or is it there just in case you dont use it in protocols? I set a specific ipv6 address in global listen, but use [::] in proto Testing to a secondary IP, not in the global listen, it still connects, so can I ask has the original use of global listen been deprecated? ciao From mazze at the-lions.org Sat Apr 13 12:17:07 2013 From: mazze at the-lions.org (Matthias Hofer) Date: Sat, 13 Apr 2013 11:17:07 +0200 Subject: [Dovecot] LMTP Setup/Design Help Request Message-ID: Hi again, Thank you for your first hints. I have now set up a dedicated test instance of postfix and dovecot to be able to recreate the problems in detail. Even after using your inputs, they do not seem to work with my setup I already mentioned above. I get errors like postfix/lmtp[10994]: C2DF4C000DF: to=, relay=mail.mydomain.org[private/dovecot-lmtp], delay=0.1, delays=0.05/0/0/0.04, dsn=5.1.1, status=bounced (host mail.mydomain.org[private/dovecot-lmtp] said: 550 5.1.1 User doesn't exist: user1 at mydomain.org (in reply to RCPT TO command)) As stated before, my setup is as follows: > I only have virtual users and have set > > mail_uid = dovemail > mail_gid = dovemail > > For authentication, I simply use (for now) a flat file: > > passdb { > driver = passwd-file > args = scheme=PLAIN username_format=%u /etc/dovecot/mypasswd.file > } > > # cat /etc/dovecot/mypasswd.file > user1:{PLAIN}userpw1 > user2:{PLAIN}userpw2 > user3:{PLAIN}userpw3 > > And everything works fine with IMAP. I am completely domain-agnostic > here. I do not know how to strip the domain when the username is handed over from postfix to dovecot, and what would be the sane solution. I hope, you can give me a hint to that. Thank you, again, and greetings, Matthias Hofer From pw at wk-serv.de Sat Apr 13 12:27:24 2013 From: pw at wk-serv.de (Patrick Westenberg) Date: Sat, 13 Apr 2013 11:27:24 +0200 Subject: [Dovecot] LMTP Setup/Design Help Request In-Reply-To: References: Message-ID: <516924FC.8090103@wk-serv.de> Matthias Hofer schrieb: > postfix/lmtp[10994]: C2DF4C000DF: to=, relay=mail.mydomain.org[private/dovecot-lmtp], > delay=0.1, delays=0.05/0/0/0.04, dsn=5.1.1, status=bounced (host mail.mydomain.org[private/dovecot-lmtp] > said: 550 5.1.1 User doesn't exist: user1 at mydomain.org (in reply to RCPT TO command)) > >> # cat /etc/dovecot/mypasswd.file >> user1:{PLAIN}userpw1 >> user2:{PLAIN}userpw2 >> user3:{PLAIN}userpw3 You have to use full usernames like: user1 at mydomain.org user2 at mydomain.org user3 at mydomain.org user1 != user1 at mydomain.org Patrick From lists at luigirosa.com Sat Apr 13 14:29:24 2013 From: lists at luigirosa.com (Luigi Rosa) Date: Sat, 13 Apr 2013 13:29:24 +0200 Subject: [Dovecot] 2.2.0 lmtp runtime error Message-ID: <51694194.80307@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I didn't have much time in the last 2 weeks, so I was stuck to a functioning 2.2.rc3 + pigeonhole 0.4.0 Server is CentOS 64: Linux mail.luigirosa.com 2.6.32-358.2.1.el6.centos.plus.x86_64 #1 SMP Wed Mar 13 02:09:07 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux I compiled and installed 2.2.0 and rebuilt pigeonhole 0.4.0 and this hapens ans soon as a new mail arrives: Apr 13 13:18:02 mail dovecot: lmtp(12350, lrosa at xxxx.com): Debug: Effective uid=501, gid=501, home=/var/spool/mail/xxxx.com/lrosa/ Apr 13 13:18:02 mail dovecot: lmtp(12350, lrosa at xxxx.com): Debug: maildir++: root=/var/spool/mail/xxxx.com/lrosa, index=, indexpvt=, control=, inbox=/var/spool/mail/xxxx.com/lrosa, alt= Apr 13 13:18:02 mail dovecot: lmtp(12350, lrosa at xxxx.com): Debug: sieve: Pigeonhole version 0.4.0 initializing Apr 13 13:18:02 mail dovecot: lmtp(12350, lrosa at xxxx.com): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Apr 13 13:18:02 mail dovecot: lmtp(12350, lrosa at xxxx.com): Debug: +VmOJOo+aVE+MAAAP6OfHg: sieve: using the following location for user's Sieve script: /var/spool/mail/xxxx.com/lrosa//.dovecot.sieve;name=main script Apr 13 13:18:02 mail dovecot: lmtp(12350, lrosa at xxxx.com): Debug: +VmOJOo+aVE+MAAAP6OfHg: sieve: loading script /var/spool/mail/xxxx.com/lrosa//.dovecot.sieve;name=main script Apr 13 13:18:02 mail dovecot: lmtp(12350, lrosa at xxxx.com): Debug: +VmOJOo+aVE+MAAAP6OfHg: sieve: script binary /var/spool/mail/xxxx.com/lrosa//.dovecot.svbin successfully loaded Apr 13 13:18:02 mail dovecot: lmtp(12350, lrosa at xxxx.com): Debug: +VmOJOo+aVE+MAAAP6OfHg: sieve: binary save: not saving binary /var/spool/mail/xxxx.com/lrosa//.dovecot.svbin, because it is already stored Apr 13 13:18:02 mail dovecot: lmtp(12350, lrosa at xxxx.com): Debug: +VmOJOo+aVE+MAAAP6OfHg: sieve: executing script from /var/spool/mail/xxxx.com/lrosa//.dovecot.svbin Apr 13 13:18:02 mail dovecot: lmtp(12346, lists at luigirosa.com): Debug: Namespace : Using permissions from /var/spool/mail/luigirosa.com/lists: mode=0700 gid=default Apr 13 13:18:02 mail dovecot: lmtp(12350, lrosa at xxxx.com): Debug: Namespace : Using permissions from /var/spool/mail/xxxx.com/lrosa: mode=0700 gid=default Apr 13 13:18:02 mail dovecot: lmtp(12346, lists at luigirosa.com): Fatal: master: service(lmtp): child 12346 killed with signal 11 (core dumps disabled) Apr 13 13:18:02 mail dovecot: lmtp(12350, lrosa at xxxx.com): Fatal: master: service(lmtp): child 12350 killed with signal 11 (core dumps disabled) Apr 13 13:18:02 mail dovecot: lmtp(12348, lrosa at xxxx.com): Debug: Namespace : Using permissions from /var/spool/mail/xxxx.com/lrosa: mode=0700 gid=default Apr 13 13:18:02 mail dovecot: lmtp(12348, lrosa at xxxx.com): Fatal: master: service(lmtp): child 12348 killed with signal 11 (core dumps disabled) Ciao, luigi - -- / +--[Luigi Rosa]-- \ God runs electromagnetics by wave theory on Monday, Wednesday, and Friday, and the Devil runs them by quantum theory on Tuesday, Thursday, and Saturday. --William Bragg -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iEYEARECAAYFAlFpQYcACgkQ3kWu7Tfl6ZTCgwCdGeOjpkQNwYPN5JHhG01/fm3d BMQAniE22e2ie4/ab6S2cFf6pFvqgo+U =iHoY -----END PGP SIGNATURE----- From mazze at the-lions.org Sat Apr 13 15:00:22 2013 From: mazze at the-lions.org (Matthias Hofer) Date: Sat, 13 Apr 2013 14:00:22 +0200 Subject: [Dovecot] LMTP Setup/Design Help Request In-Reply-To: <516924FC.8090103@wk-serv.de> References: <516924FC.8090103@wk-serv.de> Message-ID: <4296b57ec817fe9a0e74819f476309d1.squirrel@webmail.the-lions.org> > [...] >> postfix/lmtp[10994]: C2DF4C000DF: to=, relay=mail.mydomain.org[private/dovecot-lmtp], >> delay=0.1, delays=0.05/0/0/0.04, dsn=5.1.1, status=bounced (host mail.mydomain.org[private/dovecot-lmtp] >> said: 550 5.1.1 User doesn't exist: user1 at mydomain.org (in reply to RCPT TO command)) >> >>> # cat /etc/dovecot/mypasswd.file >>> user1:{PLAIN}userpw1 >>> user2:{PLAIN}userpw2 >>> user3:{PLAIN}userpw3 > > You have to use full usernames like: > > user1 at mydomain.org > user2 at mydomain.org > user3 at mydomain.org > > user1 != user1 at mydomain.org I understand that technical issue, but what I wanted was a possible solution based on plain usernames. This is because I want to make the transition from dbmail to dovecot completely transparent to users and clients, and dbmail just uses plain login names, indepentend of what e-Mail alias would then in dbmail be mapped to which login name. The plain solution above now works completely transparent for IMAP with dovecot, and it is also documented in the wiki that dovecot is domain agnostic. That is great news for my setup. Where I am very flexible is delivering mail: I could use dovecot-lda or dovecot-lmtpd, or postfix doing the work itself or whatever. It is just that I did not find any solution, and this is why I was asking for help here. So, is there a way for dovecot-{lda/lmtpd} to accept "user1 at mydomain.org" but checks for "user1" in the user DB? If there is some other idea, I would be happy to hear about it. Thank you, again, Matthias Hofer From pw at wk-serv.de Sat Apr 13 15:05:01 2013 From: pw at wk-serv.de (Patrick Westenberg) Date: Sat, 13 Apr 2013 14:05:01 +0200 Subject: [Dovecot] LMTP Setup/Design Help Request In-Reply-To: <4296b57ec817fe9a0e74819f476309d1.squirrel@webmail.the-lions.org> References: <516924FC.8090103@wk-serv.de> <4296b57ec817fe9a0e74819f476309d1.squirrel@webmail.the-lions.org> Message-ID: <516949ED.1030605@wk-serv.de> Matthias Hofer schrieb: > So, is there a way for dovecot-{lda/lmtpd} to accept "user1 at mydomain.org" but checks for "user1" in the user > DB? Try username_format=%n so dovecot uses the username only: http://wiki2.dovecot.org/Variables passdb { driver = passwd-file args = scheme=PLAIN username_format=%n /etc/dovecot/mypasswd.file } From ngu.antoine at gmail.com Sat Apr 13 15:52:35 2013 From: ngu.antoine at gmail.com (Antoine Nguyen) Date: Sat, 13 Apr 2013 14:52:35 +0200 Subject: [Dovecot] Dict quota question Message-ID: Hi all, I'm using Dovecot 2.1.16 and I'd like to know if the following configuration is supported: * An SQL dictionary quota * A static userdb to get uid/gid/home information * An SQL userdb to get per-user quota limit Currenlty, current quota usage are properly stored into the database but per-user limits are not found. If I replace the SQL dictionary by the maildir backend (my previous config.), it works as expected. Do you have any idea? Thanks in advance, Antoine Nguyen http://modoboa.org/ From delrio at mie.utoronto.ca Sat Apr 13 16:51:30 2013 From: delrio at mie.utoronto.ca (Oscar del Rio) Date: Sat, 13 Apr 2013 09:51:30 -0400 Subject: [Dovecot] 2.2.0 lmtp runtime error In-Reply-To: <51694194.80307@luigirosa.com> References: <51694194.80307@luigirosa.com> Message-ID: <516962E2.4070108@mie.utoronto.ca> On 13/04/2013 7:29 AM, Luigi Rosa wrote: > I didn't have much time in the last 2 weeks, so I was stuck to a functioning > 2.2.rc3 + pigeonhole 0.4.0 > > Server is CentOS 64: > Linux mail.luigirosa.com 2.6.32-358.2.1.el6.centos.plus.x86_64 #1 SMP Wed Mar > 13 02:09:07 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux > > I compiled and installed 2.2.0 and rebuilt pigeonhole 0.4.0 Did you re-download the most recent pigeonhole code? I believe there were API changes since RC3. From mazze at the-lions.org Sat Apr 13 17:14:04 2013 From: mazze at the-lions.org (Matthias Hofer) Date: Sat, 13 Apr 2013 16:14:04 +0200 Subject: [Dovecot] LMTP Setup/Design Help Request Message-ID: >> So, is there a way for dovecot-{lda/lmtpd} to accept "user1 at mydomain.org" but checks for "user1" in the >> user >> DB? > > Try username_format=%n so dovecot uses the username only: > http://wiki2.dovecot.org/Variables > > passdb { > driver = passwd-file > args = scheme=PLAIN username_format=%n /etc/dovecot/mypasswd.file > } Great! I did not think about that, but this solved this issue :D Thank you a lot. And I was now able to solve also my further issues. So I am prepared to try again to switch :) Have great day! Matthias Hofer From lists at luigirosa.com Sat Apr 13 17:18:04 2013 From: lists at luigirosa.com (Luigi Rosa) Date: Sat, 13 Apr 2013 16:18:04 +0200 Subject: [Dovecot] 2.2.0 lmtp runtime error In-Reply-To: <516962E2.4070108@mie.utoronto.ca> References: <51694194.80307@luigirosa.com> <516962E2.4070108@mie.utoronto.ca> Message-ID: <5169691C.9020605@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Oscar del Rio said the following on 13/04/2013 15:51: > Did you re-download the most recent pigeonhole code? I believe there were > API changes since RC3. I redownloaded the entire 0.4.0 just after Dovecot 2.2.0 The same 0.0.4 works with 2.2.rc3 Ciao, luigi - -- / +--[Luigi Rosa]-- \ Procrastinators do it tomorrow. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iEYEARECAAYFAlFpaRwACgkQ3kWu7Tfl6ZQqzQCffKrMZ5jjSgIDt+mHuOwDfTkZ pV4AmwdlKUzAsNHZjyGdRH+o5C7FmRBR =m7CE -----END PGP SIGNATURE----- From jg at softjury.de Sat Apr 13 21:42:11 2013 From: jg at softjury.de (Jan Phillip Greimann) Date: Sat, 13 Apr 2013 20:42:11 +0200 Subject: [Dovecot] LMTP Setup/Design Help Request In-Reply-To: <4296b57ec817fe9a0e74819f476309d1.squirrel@webmail.the-lions.org> References: <516924FC.8090103@wk-serv.de> <4296b57ec817fe9a0e74819f476309d1.squirrel@webmail.the-lions.org> Message-ID: <5169A703.9040309@softjury.de> At first, everyone should use "Reply to List", it's much easier to understand if you see every ones answers. :) I see that you solved the problem, another things that could help in future: dovecot logging verbosity http://wiki1.dovecot.org/Logging#Logging_verbosity This is a great help if something doesn't work. Have a nice weekend. :) Greetings, Jan From andreas at cymail.eu Sat Apr 13 23:24:15 2013 From: andreas at cymail.eu (Andreas Kasenides) Date: Sat, 13 Apr 2013 23:24:15 +0300 Subject: [Dovecot] v2.2.0 released In-Reply-To: <1365787987.11047.246.camel@innu> References: <1365787987.11047.246.camel@innu> Message-ID: On 12-04-2013 20:33, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz.sig > > Everything now seems to be stable and working in v2.2, so I can > finally > move onto developing great new interesting features for v2.3. :) > [snip] Running happily here. Thank you and congrats. Andreas From odhiambo at gmail.com Sat Apr 13 23:28:12 2013 From: odhiambo at gmail.com (Odhiambo Washington) Date: Sat, 13 Apr 2013 23:28:12 +0300 Subject: [Dovecot] v2.2.0 released In-Reply-To: <1365787987.11047.246.camel@innu> References: <1365787987.11047.246.camel@innu> Message-ID: Running happily on ALL my FreeBSD (8.3 and 9.1) boxes! Thanks for all the work! On 12 April 2013 20:33, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz.sig > > Everything now seems to be stable and working in v2.2, so I can finally > move onto developing great new interesting features for v2.3. :) > > My company has also launched a web shop where you can buy various > products. One of them is cheap access to Dovecot enterprise edition > repositories, which are basically same as regular Dovecot releases, > except they are kept patched with the latest important bugfixes. We > currently have releases for RHEL/CentOS 5 and 6, Debian Squeeze and > Ubuntu 12.04 LTS. By buying Dovecot-EE you'll also get a 30 day demo > license for object storages, if you want to try it out. > http://shop.dovecot.fi/ > > * When creating home directories, the permissions are copied from > the > parent directory if it has setgid-bit set. For full details, see > http://wiki2.dovecot.org/SharedMailboxes/Permissions > * "doveadm auth" command was renamed to "doveadm auth test" > * IMAP: ID command now advertises server name as Dovecot by > default. > It was already trivial to guess this from command replies. > * dovecot.index.cache files can be safely accessed only by > v2.1.11+. > Older versions may think they're corrupted and delete them. > * LDA/LMTP: If saving a mail brings user from under quota to over > quota, allow it based on quota_grace setting (default: 10% > above quota limit). > * pop3_lock_session=yes now uses a POP3-only > dovecot-pop3-session.lock > file instead of actually locking the mailbox (and causing > IMAP/LDA/LMTP to wait for the POP3 session to close). > * mail_shared_explicit_inbox setting's default switched to "no". > * ssl_client_ca_dir setting replaced imapc_ssl_ca_dir and > pop3c_ssl_ca_dir settings. > > + Implemented IMAP MOVE and BINARY extensions > + Implemented IMAP CATENATE, URLAUTH and URLAUTH=BINARY extensions > (by Stephan Bosch). > + Implemented IMAP NOTIFY extension. Requires > mailbox_list_index=yes > to be enabled. > + Redesigned and rewritten dsync. The new design makes the syncing > faster, more reliable and more featureful. The new dsync protocol > isn't backwards compatible with old dsync versions (but is > designed > to be forwards compatible with future versions). > + All mailbox formats now support per-user message flags for shared > mailboxes by using a private index. It can be enabled by adding > :INDEXPVT= to mail location. This should be used instead of > :INDEX also for Maildir/mbox to improve performance. > + Improved mailbox list indexes. They should be usable now, > although > still disabled by default. > + Added LAYOUT=index. The mailbox directories are created using > their > GUIDs in the filesystem, while the actual GUID <-> name mapping > exists only in the index. > + LMTP proxy: Implemented XCLIENT extension for passing remote IP > address through proxy. > > > -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254733744121/+254722743223 "I can't hear you -- I'm using the scrambler." From anmeyer at anup.de Sat Apr 13 23:56:38 2013 From: anmeyer at anup.de (Andreas Meyer) Date: Sat, 13 Apr 2013 22:56:38 +0200 Subject: [Dovecot] v2.2.0 released In-Reply-To: <51685DA5.5060506@msapiro.net> References: <1365787987.11047.246.camel@innu> <51685DA5.5060506@msapiro.net> Message-ID: <20130413225638.51e6c560@itxnew.bitcorner.intern> Mark Sapiro wrote: > On 4/12/2013 10:33 AM, Timo Sirainen wrote: > > http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz > > http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz.sig > > > > Everything now seems to be stable and working in v2.2, so I can finally > > move onto developing great new interesting features for v2.3. :) > > > It's installed and running here. Congratulations (big round of applause) Can I upgrade from 2.1.16 to 2.2 with the old config? Is there something to be carefull with? Andreas From glibdud at hotmail.com Sun Apr 14 05:10:08 2013 From: glibdud at hotmail.com (David Murphy) Date: Sat, 13 Apr 2013 22:10:08 -0400 Subject: [Dovecot] How to manually generate a password hash Message-ID: Hi folks. I've recently set up a Postfix 2.9.6/Dovecot 2.0.19 IMAPS/SMTPS setup on Ubuntu 12.04.2 (Mysql backend). I'm new to all this, so I apologize if this is fairly basic. I've attempted to the best of my ability to search for an answer, but no luck so far. What I'm trying to do is generate a password hash that I can inject directly into my Mysql database (disaster recovery sort of situation). Towards that goal, I'm trying to use 'doveadm pw' to generate a hash that matches a known password in my database. Unfortunately, I'm coming up empty. My default_pass_scheme in dovecot-sql.conf is set to MD5-CRYPT, and the passwords in the database have no scheme prefixes. I'm attempting to generate a hash with: sudo doveadm pw -s 'MD5-CRYPT' but the hash generated does not match the user's password hash in the database, which is known to be a good password. I'm able to log into this account successfully in both Roundcube and a remote IMAP client. I've also tried using the -p flag and including the password in the command, and that doesn't do it either, though it oddly gives a different response than using the prompt. (What causes this? Newlines?) So... what am I missing? If the hash was salted, it would seem the hashes in the database would be longer than the ones generated at the command line, but that isn't the case. I'm out of ideas. Any guidance appreciated. -Dave From professa at dementianati.com Sun Apr 14 06:32:14 2013 From: professa at dementianati.com (Professa Dementia) Date: Sat, 13 Apr 2013 20:32:14 -0700 Subject: [Dovecot] How to manually generate a password hash In-Reply-To: References: Message-ID: <516A233E.6030008@dementianati.com> On 4/13/2013 7:10 PM, David Murphy wrote: > Hi folks. I've recently set up a Postfix 2.9.6/Dovecot 2.0.19 IMAPS/SMTPS setup on Ubuntu 12.04.2 (Mysql backend). I'm new to all this, so I apologize if this is fairly basic. I've attempted to the best of my ability to search for an answer, but no luck so far. > > What I'm trying to do is generate a password hash that I can inject directly into my Mysql database (disaster recovery sort of situation). Towards that goal, I'm trying to use 'doveadm pw' to generate a hash that matches a known password in my database. Unfortunately, I'm coming up empty. > > My default_pass_scheme in dovecot-sql.conf is set to MD5-CRYPT, and the passwords in the database have no scheme prefixes. I'm attempting to generate a hash with: > > sudo doveadm pw -s 'MD5-CRYPT' > > but the hash generated does not match the user's password hash in the database, which is known to be a good password. I'm able to log into this account successfully in both Roundcube and a remote IMAP client. I've also tried using the -p flag and including the password in the command, and that doesn't do it either, though it oddly gives a different response than using the prompt. (What causes this? Newlines?) > > So... what am I missing? If the hash was salted, it would seem the hashes in the database would be longer than the ones generated at the command line, but that isn't the case. I'm out of ideas. Any guidance appreciated. > > -Dave > > Can you post one of your hashes? Dem From e-frog at gmx.de Sun Apr 14 09:58:17 2013 From: e-frog at gmx.de (e-frog) Date: Sun, 14 Apr 2013 08:58:17 +0200 Subject: [Dovecot] v2.2.0 released In-Reply-To: <20130413225638.51e6c560@itxnew.bitcorner.intern> References: <1365787987.11047.246.camel@innu> <51685DA5.5060506@msapiro.net> <20130413225638.51e6c560@itxnew.bitcorner.intern> Message-ID: <516A5389.6020503@gmx.de> On 13.04.2013 22:56, wrote Andreas Meyer: > Mark Sapiro wrote: > >> On 4/12/2013 10:33 AM, Timo Sirainen wrote: >>> http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz >>> http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz.sig >>> >>> Everything now seems to be stable and working in v2.2, so I can finally >>> move onto developing great new interesting features for v2.3. :) >> >> >> It's installed and running here. Congratulations (big round of applause) > > Can I upgrade from 2.1.16 to 2.2 with the old config? Is there something > to be carefull with? > > Andreas > http://wiki2.dovecot.org/Upgrading/2.2 From lists at necoro.eu Sun Apr 14 12:40:23 2013 From: lists at necoro.eu (=?UTF-8?B?UmVuw6kgTmV1bWFubg==?=) Date: Sun, 14 Apr 2013 11:40:23 +0200 Subject: [Dovecot] How to manually generate a password hash In-Reply-To: References: Message-ID: <516A7987.7060808@necoro.eu> Am 14.04.2013 04:10, schrieb David Murphy: > Hi folks. I've recently set up a Postfix 2.9.6/Dovecot 2.0.19 IMAPS/SMTPS setup on Ubuntu 12.04.2 (Mysql backend). I'm new to all this, so I apologize if this is fairly basic. I've attempted to the best of my ability to search for an answer, but no luck so far. > > What I'm trying to do is generate a password hash that I can inject directly into my Mysql database (disaster recovery sort of situation). Towards that goal, I'm trying to use 'doveadm pw' to generate a hash that matches a known password in my database. Unfortunately, I'm coming up empty. > > My default_pass_scheme in dovecot-sql.conf is set to MD5-CRYPT, and the passwords in the database have no scheme prefixes. I'm attempting to generate a hash with: > > sudo doveadm pw -s 'MD5-CRYPT' > > but the hash generated does not match the user's password hash in the database, which is known to be a good password. *-CRYPT hashes are salted. Hence it is intended, that hashes differ. $ doveadm pw -s 'MD5-CRYPT' -p test {MD5-CRYPT}$1$s3UfgF6q$YRupP9GlEcaU5CYUOfkFl0 $ doveadm pw -s 'MD5-CRYPT' -p test {MD5-CRYPT}$1$yVZQVf8U$aaguS/rkQOJXu29V76nUl/ > I've also tried using the -p flag and including the password in the command, and that doesn't do it either, though it oddly gives a different response than using the prompt. (What causes this? Newlines?) I don't understand what you are trying to say here... - Ren? From professa at dementianati.com Sun Apr 14 13:24:38 2013 From: professa at dementianati.com (Professa Dementia) Date: Sun, 14 Apr 2013 03:24:38 -0700 Subject: [Dovecot] How to manually generate a password hash In-Reply-To: References: Message-ID: <516A83E6.7050302@dementianati.com> On 4/13/2013 7:10 PM, David Murphy wrote: > Hi folks. I've recently set up a Postfix 2.9.6/Dovecot 2.0.19 IMAPS/SMTPS setup on Ubuntu 12.04.2 (Mysql backend). I'm new to all this, so I apologize if this is fairly basic. I've attempted to the best of my ability to search for an answer, but no luck so far. > > What I'm trying to do is generate a password hash that I can inject directly into my Mysql database (disaster recovery sort of situation). Towards that goal, I'm trying to use 'doveadm pw' to generate a hash that matches a known password in my database. Unfortunately, I'm coming up empty. > > My default_pass_scheme in dovecot-sql.conf is set to MD5-CRYPT, and the passwords in the database have no scheme prefixes. I'm attempting to generate a hash with: > > sudo doveadm pw -s 'MD5-CRYPT' > > but the hash generated does not match the user's password hash in the database, which is known to be a good password. I'm able to log into this account successfully in both Roundcube and a remote IMAP client. I've also tried using the -p flag and including the password in the command, and that doesn't do it either, though it oddly gives a different response than using the prompt. (What causes this? Newlines?) > > So... what am I missing? If the hash was salted, it would seem the hashes in the database would be longer than the ones generated at the command line, but that isn't the case. I'm out of ideas. Any guidance appreciated. > > -Dave > > 1) If your passwords are of the format $1$..., then they are in standard crypt md5 format. They are salted. The salt is between the second and third $ and the actual hash follows the third $. 2) The version of Dovecot you are running has several bugs in "doveadm pw" that you might be encountering. This will prevent you from verifying the hashes. Some of these have been fixed in the current release. Try the following command. This should give you a "verified" response on a patched version of doveadm. (NOTE this command is all on one line, but may wrap in the email). doveadm pw -s MD5-CRYPT -p abc123 -t '$1$85P5.CAv$tqx.O2iZwnIZjuMQ7fo6m1' It should reply: $1$85P5.CAv$tqx.O2iZwnIZjuMQ7fo6m1 (verified) Or possibly (depending on the version of dovecot you run): {MD5-CRYPT}$1$85P5.CAv$tqx.O2iZwnIZjuMQ7fo6m1 (verified) If you do not get one of the above responses to the test, you should upgrade, since your doveadm is broken. To test your hashes, use the above command format substituting your password after -p and your hash after -t. This is only if your hashes begin with $1$..., however. If they do not, then they are not in crypt md5 format and you will need to figure out what format they are. Once again, however, you need to be running at least 2.1.17, I believe, or maybe a recent release of 2.2 that has the doveadm patches. Dem From tss at iki.fi Sun Apr 14 18:29:12 2013 From: tss at iki.fi (Timo Sirainen) Date: Sun, 14 Apr 2013 18:29:12 +0300 Subject: [Dovecot] 2.2.0 lmtp runtime error In-Reply-To: <51694194.80307@luigirosa.com> References: <51694194.80307@luigirosa.com> Message-ID: <55BC2474-B448-490F-9E61-DA7F9122802F@iki.fi> On 13.4.2013, at 14.29, Luigi Rosa wrote: > I compiled and installed 2.2.0 and rebuilt pigeonhole 0.4.0 and this hapens > ans soon as a new mail arrives: > > Apr 13 13:18:02 mail dovecot: lmtp(12346, lists at luigirosa.com): Fatal: master: > service(lmtp): child 12346 killed with signal 11 (core dumps disabled) gdb backtrace would be helpful in figuring out what causes the crash: http://dovecot.org/bugreport.html From tss at iki.fi Sun Apr 14 18:31:55 2013 From: tss at iki.fi (Timo Sirainen) Date: Sun, 14 Apr 2013 18:31:55 +0300 Subject: [Dovecot] listen directive changed? In-Reply-To: References: Message-ID: <1D989A1A-F648-4647-A3A9-CC5481A54300@iki.fi> On 13.4.2013, at 7.13, Nick Edwards wrote: > Is the global listen directive supposed to be a governing directive, > like in apache? or is it there just in case you dont use it in > protocols? > > I set a specific ipv6 address in global listen, but use [::] in proto I don't understand what you mean by "in proto". If you mean inside protocol {} setting, that's a deprecated way and should log warnings about it. > Testing to a secondary IP, not in the global listen, it still > connects, so can I ask has the original use of global listen been > deprecated? It's the default listen setting, which gets used by all services' inet_listeners that don't override it. From glibdud at hotmail.com Sun Apr 14 18:59:41 2013 From: glibdud at hotmail.com (David Murphy) Date: Sun, 14 Apr 2013 11:59:41 -0400 Subject: [Dovecot] How to manually generate a password hash In-Reply-To: <516A83E6.7050302@dementianati.com> References: , <516A83E6.7050302@dementianati.com> Message-ID: > Date: Sun, 14 Apr 2013 03:24:38 -0700 > From: professa at dementianati.com > CC: dovecot at dovecot.org > Subject: Re: [Dovecot] How to manually generate a password hash > > 1) If your passwords are of the format $1$..., then they are in standard > crypt md5 format. They are salted. The salt is between the second and > third $ and the actual hash follows the third $. Aha! That's the piece I was missing. I never noticed the third '$' and for some reason I never tried running doveadm pw the exact same way twice in a row to notice that the results were different. Verified that I could generate a hash from doveadm pw, insert it in the database, and log in on that account. Thank you, and thanks to the others who responded as well. -Dave From lists at luigirosa.com Sun Apr 14 19:44:08 2013 From: lists at luigirosa.com (Luigi Rosa) Date: Sun, 14 Apr 2013 18:44:08 +0200 Subject: [Dovecot] 2.2.0 lmtp runtime error In-Reply-To: <55BC2474-B448-490F-9E61-DA7F9122802F@iki.fi> References: <51694194.80307@luigirosa.com> <55BC2474-B448-490F-9E61-DA7F9122802F@iki.fi> Message-ID: <516ADCD8.6000204@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Timo Sirainen said the following on 14/04/2013 17:29: Packing it along with the log and sending to your email account right now Ciao, luigi - -- / +--[Luigi Rosa]-- \ Massachusetts patient tested for mad cow disease. So, be sure not to eat meat from any Massachusetts patients --fark.com -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iEYEARECAAYFAlFq3NgACgkQ3kWu7Tfl6ZS9ywCZAfR8LlmiYbFQXMECh437OdcN gfUAn3LgJZqw4e8dGtdgj3sgHlLghzZQ =Ym7C -----END PGP SIGNATURE----- From distler at golem.ph.utexas.edu Sun Apr 14 18:38:01 2013 From: distler at golem.ph.utexas.edu (Jacques Distler) Date: Sun, 14 Apr 2013 10:38:01 -0500 Subject: [Dovecot] Dovecot 2.2.0 Compilation Error Message-ID: On MacOSX 10.6, I get: ld: duplicate symbol _cmd_batch in dsync/.libs/libdsync.a(doveadm-dsync.o) and doveadm-mail-batch.o for architecture x86_64 collect2: ld returned 1 exit status make[4]: *** [doveadm] Error 1 when compiling Dovecot 2.2.0. By contrast, 2.1.16 compiled (and runs) just fine. I'm surprised that this hasn't cropped up elsewhere. From tss at iki.fi Sun Apr 14 21:28:22 2013 From: tss at iki.fi (Timo Sirainen) Date: Sun, 14 Apr 2013 21:28:22 +0300 Subject: [Dovecot] Dovecot 2.2.0 Compilation Error In-Reply-To: References: Message-ID: <3E1CEAB1-5A9F-4F93-B0DC-AA12A59768EF@iki.fi> On 14.4.2013, at 18.38, Jacques Distler wrote: > On MacOSX 10.6, I get: > > ld: duplicate symbol _cmd_batch in dsync/.libs/libdsync.a(doveadm-dsync.o) and doveadm-mail-batch.o for architecture x86_64 > collect2: ld returned 1 exit status > make[4]: *** [doveadm] Error 1 > > when compiling Dovecot 2.2.0. By contrast, 2.1.16 compiled (and runs) just fine. > > I'm surprised that this hasn't cropped up elsewhere. Fixed: http://hg.dovecot.org/dovecot-2.2/rev/a7d0bb66639f Looks like it didn't happen in Linux. From tss at iki.fi Sun Apr 14 21:30:24 2013 From: tss at iki.fi (Timo Sirainen) Date: Sun, 14 Apr 2013 21:30:24 +0300 Subject: [Dovecot] 2.2.0 lmtp runtime error In-Reply-To: <516ADCD8.6000204@luigirosa.com> References: <51694194.80307@luigirosa.com> <55BC2474-B448-490F-9E61-DA7F9122802F@iki.fi> <516ADCD8.6000204@luigirosa.com> Message-ID: <7E90E5C6-366F-4517-A704-4D410F4AA16A@iki.fi> Looks like mailbox_list_index=yes is broken in v2.2.0 release. Strange that I didn't notice it. This fixes it: http://hg.dovecot.org/dovecot-2.2/rev/fc9ef7d2251a From lists at luigirosa.com Sun Apr 14 22:33:14 2013 From: lists at luigirosa.com (Luigi Rosa) Date: Sun, 14 Apr 2013 21:33:14 +0200 Subject: [Dovecot] 2.2.0 lmtp runtime error In-Reply-To: <7E90E5C6-366F-4517-A704-4D410F4AA16A@iki.fi> References: <51694194.80307@luigirosa.com> <55BC2474-B448-490F-9E61-DA7F9122802F@iki.fi> <516ADCD8.6000204@luigirosa.com> <7E90E5C6-366F-4517-A704-4D410F4AA16A@iki.fi> Message-ID: <516B047A.3070906@luigirosa.com> Timo Sirainen said the following on 14/04/2013 20:30: > Looks like mailbox_list_index=yes is broken in v2.2.0 release. Strange that I didn't notice it. This fixes it: > > http://hg.dovecot.org/dovecot-2.2/rev/fc9ef7d2251a Tha patch did the trick, it works! Ciao, luigi -- / +--[Luigi Rosa]-- \ If it's working, the diagnostics say it's fine. If it's not working, the diagnostics say it's fine. From jtam.home at gmail.com Mon Apr 15 01:30:00 2013 From: jtam.home at gmail.com (Joseph Tam) Date: Sun, 14 Apr 2013 15:30:00 -0700 (PDT) Subject: [Dovecot] How to manually generate a password hash In-Reply-To: References: Message-ID: David Murphy writes: http://en.wikipedia.org/wiki/Salt_%28cryptography%29 > So... what am I missing? If the hash was salted, it would seem the > hashes in the database would be longer than the ones generated at the > command line, but that isn't the case. I'm out of ideas. Any guidance > appreciated. The hashes are salted, and that is why the hashes are different, even though the same password is used. (Test it by using the output of "doveadm pw" and plugging it into your test account). The hashes ought to be the same length. The out would be proportional to the length of your input password if the were encrypting, rathher than hashing. But the length of the hash is consant + encoded(salt) + encoded (hash(password)), all of which ought to be fixed lengths. Joseph Tam From marc at perkel.com Mon Apr 15 08:35:17 2013 From: marc at perkel.com (Marc Perkel) Date: Sun, 14 Apr 2013 22:35:17 -0700 Subject: [Dovecot] v2.2.0 - possible bug? In-Reply-To: <1365787987.11047.246.camel@innu> References: <1365787987.11047.246.camel@innu> Message-ID: <516B9195.4030302@perkel.com> When doing a server side message body search I got this in the logs: Apr 14 22:32:24 imap(support at junkemailfilter.com): Panic: file message-parser.c: line 698 (preparsed_parse_prologue_more): assertion failed: (ctx->part->children != NULL) Apr 14 22:32:24 imap(support at junkemailfilter.com): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x5f45a) [0x7f6eab1d745a] -> /usr/lib/dovecot/libdovecot.so.0(+0x5f4a6) [0x7f6eab1d74a6] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f6eab197d4f] -> /usr/lib/dovecot/libdovecot.so.0(+0x52863) [0x7f6eab1ca863] -> /usr/lib/dovecot/libdovecot.so.0(message_parser_parse_next_block+0x29) [0x7f6eab1ca349] -> /usr/lib/dovecot/libdovecot.so.0(message_search_msg+0x5d) [0x7f6eab1cc51d] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9d558) [0x7f6eab4d5558] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_search_args_foreach+0x3c) [0x7f6eab4acc3c] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9d289) [0x7f6eab4d5289] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9e2fd) [0x7f6eab4d62fd] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0xe8) [0x7f6eab4d6938] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x27) [0x7f6eab4b1057] -> dovecot/imap [support at junkemailfilter.com 127.0.0.1 UID SEARCH]() [0x41a78f] -> dovecot/imap [support at junkemailfilter.com 127.0.0.1 UID SEARCH](imap_search_start+0xe9) [0x41abf9] -> dovecot/imap [support at junkemailfilter.com 127.0.0.1 UID SEARCH](cmd_search+0xc5) [0x40ff75] -> dovecot/imap [support at junkemailfilter.com 127.0.0.1 UID SEARCH](command_exec+0x3d) [0x414f5d] -> dovecot/imap [support at junkemailfilter.com 127.0.0.1 UID SEARCH]() [0x4140c0] -> dovecot/imap [support at junkemailfilter.com 127.0.0.1 UID SEARCH]() [0x4141ad] -> dovecot/imap [support at junkemailfilter.com 127.0.0.1 UID SEARCH](client_handle_input+0x11d) [0x41442d] -> dovecot/imap [support at junkemailfilter.com 127.0.0.1 UID SEARCH](client_input+0x6f) [0x41479f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f6eab1e63a6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f6eab1e7407] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f6eab1e6348] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f6eab19ca03] -> dovecot/imap [support at junkemailfilter.com 127.0.0.1 UID SEARCH](main+0x2a7) [0x41d997] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f6eaadfecdd] -> dovecot/imap [support at junkemailfilter.com 127.0.0.1 UID SEARCH]() [0x40a4d9] Apr 14 22:32:24 imap(support at junkemailfilter.com): Fatal: master: service(imap): child 28156 killed with signal 6 (core dumps disabled) From r at sys4.de Mon Apr 15 12:08:28 2013 From: r at sys4.de (Ralf Hildebrandt) Date: Mon, 15 Apr 2013 11:08:28 +0200 Subject: [Dovecot] Coredump -> backtrace Script Message-ID: <20130415090827.GB30889@sys4.de> I wrote a little something about how I'm automatically creating backtraces from coredumps: http://sys4.de/de/blog/2013/04/13/core-catcher-linux/ I've been using this with Dovecot-HEAD and Squid-HEAD, mostly :) -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From tss at iki.fi Mon Apr 15 12:09:53 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 15 Apr 2013 12:09:53 +0300 Subject: [Dovecot] v2.2.0 - possible bug? In-Reply-To: <516B9195.4030302@perkel.com> References: <1365787987.11047.246.camel@innu> <516B9195.4030302@perkel.com> Message-ID: <85919EE6-2E26-4E2F-99E6-838D4E878D25@iki.fi> On 15.4.2013, at 8.35, Marc Perkel wrote: > When doing a server side message body search I got this in the logs: > > Apr 14 22:32:24 imap(support at junkemailfilter.com): Panic: file message-parser.c: line 698 (preparsed_parse_prologue_more): assertion failed: (ctx->part->children != NULL) You can reproduce this? What if you delete that mailbox's dovecot.index.cache and search twice after that? From ngu.antoine at gmail.com Mon Apr 15 12:18:18 2013 From: ngu.antoine at gmail.com (Antoine Nguyen) Date: Mon, 15 Apr 2013 11:18:18 +0200 Subject: [Dovecot] Dict quota question In-Reply-To: References: Message-ID: Up. Any idea about this? Does anybody ever try to build such a configuration? Thanks. 2013/4/13 Antoine Nguyen > Hi all, > > I'm using Dovecot 2.1.16 and I'd like to know if the following > configuration is supported: > > * An SQL dictionary quota > * A static userdb to get uid/gid/home information > * An SQL userdb to get per-user quota limit > > Currenlty, current quota usage are properly stored into the database but > per-user limits are not found. If I replace the SQL dictionary by the > maildir backend (my previous config.), it works as expected. > > Do you have any idea? > > Thanks in advance, > > Antoine Nguyen > http://modoboa.org/ > From gilles.chauvin at univ-rouen.fr Mon Apr 15 15:42:11 2013 From: gilles.chauvin at univ-rouen.fr (Gilles Chauvin) Date: Mon, 15 Apr 2013 14:42:11 +0200 Subject: [Dovecot] lazy_expunge plugin with virtual mailboxes Message-ID: <1943514.v2kXgonMKC@gcn-archlinux> Hi, When using both lazy_expunge and virtual mailboxes (with, for instance, a "All Messages" virtual mailbox) as soon as a user deletes/expunges a mail in one of its mailbox, Dovecot is saving two mails to the lazy_expunge namespace (the one in the user mailbox and the one in the virtual mailbox). Is there some kind of trick to make Dovecot ignore any mail deleted from a virtual mailbox namespace ? Thanks, Gilles. From marc at perkel.com Mon Apr 15 16:39:33 2013 From: marc at perkel.com (Marc Perkel) Date: Mon, 15 Apr 2013 06:39:33 -0700 Subject: [Dovecot] v2.2.0 - possible bug? In-Reply-To: <85919EE6-2E26-4E2F-99E6-838D4E878D25@iki.fi> References: <1365787987.11047.246.camel@innu> <516B9195.4030302@perkel.com> <85919EE6-2E26-4E2F-99E6-838D4E878D25@iki.fi> Message-ID: <516C0315.2080402@perkel.com> On 4/15/2013 2:09 AM, Timo Sirainen wrote: > On 15.4.2013, at 8.35, Marc Perkel wrote: > >> When doing a server side message body search I got this in the logs: >> >> Apr 14 22:32:24 imap(support at junkemailfilter.com): Panic: file message-parser.c: line 698 (preparsed_parse_prologue_more): assertion failed: (ctx->part->children != NULL) > You can reproduce this? What if you delete that mailbox's dovecot.index.cache and search twice after that? > > > I deleted all index files in location INDEX=/email/imap-cache/%d-%n - same result. I then deleted these files: -rw------- 1 mail mail 41 Mar 21 2007 dovecot-keywords -rw------- 1 mail mail 694046 Apr 15 06:20 dovecot-uidlist -rw------- 1 mail mail 8 Dec 5 07:58 dovecot-uidvalidity -rw------- 1 mail mail 0 Apr 1 2009 dovecot-uidvalidity.49d3bf54 The search still didn't work but there was no crash report in the logs. When I say the search didn't work it found nothing and it returned way to fast. From marc at perkel.com Mon Apr 15 16:43:22 2013 From: marc at perkel.com (Marc Perkel) Date: Mon, 15 Apr 2013 06:43:22 -0700 Subject: [Dovecot] v2.2.0 - possible bug? In-Reply-To: <85919EE6-2E26-4E2F-99E6-838D4E878D25@iki.fi> References: <1365787987.11047.246.camel@innu> <516B9195.4030302@perkel.com> <85919EE6-2E26-4E2F-99E6-838D4E878D25@iki.fi> Message-ID: <516C03FA.7030803@perkel.com> On 4/15/2013 2:09 AM, Timo Sirainen wrote: > On 15.4.2013, at 8.35, Marc Perkel wrote: > >> When doing a server side message body search I got this in the logs: >> >> Apr 14 22:32:24 imap(support at junkemailfilter.com): Panic: file message-parser.c: line 698 (preparsed_parse_prologue_more): assertion failed: (ctx->part->children != NULL) > You can reproduce this? What if you delete that mailbox's dovecot.index.cache and search twice after that? > New update - tried it again and got the error in the logs: Apr 15 06:40:28 imap-login: Info: Login: user=, method=PLAIN, rip=::1, lip=::1, mpid=11228, secured, session=<82RcZWbaRgAAAAAAAAAAAAAAAAAAAAAB> Apr 15 06:40:28 imap(support at junkemailfilter.com): Panic: file message-parser.c: line 698 (preparsed_parse_prologue_more): assertion failed: (ctx->part->children != NULL) Apr 15 06:40:28 imap(support at junkemailfilter.com): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x5f45a) [0x7f6d585bf45a] -> /usr/lib/dovecot/libdovecot.so.0(+0x5f4a6) [0x7f6d585bf4a6] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f6d5857fd4f] -> /usr/lib/dovecot/libdovecot.so.0(+0x52863) [0x7f6d585b2863] -> /usr/lib/dovecot/libdovecot.so.0(message_parser_parse_next_block+0x29) [0x7f6d585b2349] -> /usr/lib/dovecot/libdovecot.so.0(message_search_msg+0x5d) [0x7f6d585b451d] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9d558) [0x7f6d588bd558] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_search_args_foreach+0x3c) [0x7f6d58894c3c] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9d289) [0x7f6d588bd289] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9e2fd) [0x7f6d588be2fd] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0xe8) [0x7f6d588be938] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x27) [0x7f6d58899057] -> dovecot/imap [support at junkemailfilter.com ::1 UID SEARCH]() [0x41a78f] -> dovecot/imap [support at junkemailfilter.com ::1 UID SEARCH](imap_search_start+0xe9) [0x41abf9] -> dovecot/imap [support at junkemailfilter.com ::1 UID SEARCH](cmd_search+0xc5) [0x40ff75] -> dovecot/imap [support at junkemailfilter.com ::1 UID SEARCH](command_exec+0x3d) [0x414f5d] -> dovecot/imap [support at junkemailfilter.com ::1 UID SEARCH]() [0x4140c0] -> dovecot/imap [support at junkemailfilter.com ::1 UID SEARCH]() [0x4141ad] -> dovecot/imap [support at junkemailfilter.com ::1 UID SEARCH](client_handle_input+0x11d) [0x41442d] -> dovecot/imap [support at junkemailfilter.com ::1 UID SEARCH](client_input+0x6f) [0x41479f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f6d585ce3a6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f6d585cf407] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f6d585ce348] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f6d58584a03] -> dovecot/imap [support at junkemailfilter.com ::1 UID SEARCH](main+0x2a7) [0x41d997] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f6d581e6cdd] -> dovecot/imap [support at junkemailfilter.com ::1 UID SEARCH]() [0x40a4d9] Apr 15 06:40:28 imap(support at junkemailfilter.com): Fatal: master: service(imap): child 11228 killed with signal 6 (core dumps disabled) These files were recreated: -rw-rw---- 1 mail mail 48 Apr 15 06:40 dovecot-keywords -rw-rw---- 1 mail mail 678358 Apr 15 06:40 dovecot-uidlist From tss at iki.fi Mon Apr 15 17:09:20 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 15 Apr 2013 17:09:20 +0300 Subject: [Dovecot] v2.2.0 - possible bug? In-Reply-To: <516C03FA.7030803@perkel.com> References: <1365787987.11047.246.camel@innu> <516B9195.4030302@perkel.com> <85919EE6-2E26-4E2F-99E6-838D4E878D25@iki.fi> <516C03FA.7030803@perkel.com> Message-ID: <1366034960.11047.254.camel@innu> On Mon, 2013-04-15 at 06:43 -0700, Marc Perkel wrote: > On 4/15/2013 2:09 AM, Timo Sirainen wrote: > > On 15.4.2013, at 8.35, Marc Perkel wrote: > > > >> When doing a server side message body search I got this in the logs: > >> > >> Apr 14 22:32:24 imap(support at junkemailfilter.com): Panic: file message-parser.c: line 698 (preparsed_parse_prologue_more): assertion failed: (ctx->part->children != NULL) > > You can reproduce this? What if you delete that mailbox's dovecot.index.cache and search twice after that? > > > > New update - tried it again and got the error in the logs: There's one mail that causes this crash. Any chance you can find that and send it to me? Would make fixing it a bit easier. For example you can probably find it with: doveadm exec imap -u support at junkemailfilter.com a select inbox b search 1:100 text foobar And then move around in the 1:100 range until you find the mail. Then you can get the mail (e.g. 123) with: doveadm fetch -u support at junkemailfilter.com text mailbox inbox 123 > email.txt From tss at iki.fi Mon Apr 15 17:10:15 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 15 Apr 2013 17:10:15 +0300 Subject: [Dovecot] v2.2.0 - possible bug? In-Reply-To: <1366034960.11047.254.camel@innu> References: <1365787987.11047.246.camel@innu> <516B9195.4030302@perkel.com> <85919EE6-2E26-4E2F-99E6-838D4E878D25@iki.fi> <516C03FA.7030803@perkel.com> <1366034960.11047.254.camel@innu> Message-ID: <1366035015.11047.255.camel@innu> On Mon, 2013-04-15 at 17:09 +0300, Timo Sirainen wrote: > On Mon, 2013-04-15 at 06:43 -0700, Marc Perkel wrote: > > On 4/15/2013 2:09 AM, Timo Sirainen wrote: > > > On 15.4.2013, at 8.35, Marc Perkel wrote: > > > > > >> When doing a server side message body search I got this in the logs: > > >> > > >> Apr 14 22:32:24 imap(support at junkemailfilter.com): Panic: file message-parser.c: line 698 (preparsed_parse_prologue_more): assertion failed: (ctx->part->children != NULL) > > > You can reproduce this? What if you delete that mailbox's dovecot.index.cache and search twice after that? > > > > > > > New update - tried it again and got the error in the logs: > > There's one mail that causes this crash. Any chance you can find that > and send it to me? Would make fixing it a bit easier. For example you > can probably find it with: Actually don't bother, looks like I can reproduce it myself also. :) I thought it was a more rare problem. From tss at iki.fi Mon Apr 15 17:23:55 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 15 Apr 2013 17:23:55 +0300 Subject: [Dovecot] v2.2.0 - possible bug? In-Reply-To: <1366035015.11047.255.camel@innu> References: <1365787987.11047.246.camel@innu> <516B9195.4030302@perkel.com> <85919EE6-2E26-4E2F-99E6-838D4E878D25@iki.fi> <516C03FA.7030803@perkel.com> <1366034960.11047.254.camel@innu> <1366035015.11047.255.camel@innu> Message-ID: <1366035835.11047.257.camel@innu> On Mon, 2013-04-15 at 17:10 +0300, Timo Sirainen wrote: > > > >> Apr 14 22:32:24 imap(support at junkemailfilter.com): Panic: file message-parser.c: line 698 (preparsed_parse_prologue_more): assertion failed: (ctx->part->children != NULL) > > > > You can reproduce this? What if you delete that mailbox's dovecot.index.cache and search twice after that? > > Actually don't bother, looks like I can reproduce it myself also. :) I > thought it was a more rare problem. I don't think it is a very common problem actually, I just happened to have such mail in my inbox. This fixes it: http://hg.dovecot.org/dovecot-2.2/rev/b38d5ebacf25 From tss at iki.fi Mon Apr 15 17:37:00 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 15 Apr 2013 17:37:00 +0300 Subject: [Dovecot] Dict quota question In-Reply-To: References: Message-ID: On 13.4.2013, at 15.52, Antoine Nguyen wrote: > I'm using Dovecot 2.1.16 and I'd like to know if the following > configuration is supported: > > * An SQL dictionary quota > * A static userdb to get uid/gid/home information > * An SQL userdb to get per-user quota limit > > Currenlty, current quota usage are properly stored into the database but > per-user limits are not found. If I replace the SQL dictionary by the > maildir backend (my previous config.), it works as expected. > > Do you have any idea? You can't have both static userdb and sql userdb. Create just one sql userdb, which returns something like: select quota_rule, 123 uid, 123 as gid, '/home/%u' as home from quota_limits where username = '%u' I don't really understand what sql dict vs maildir backend has to do with it. Both of them get the limits from the same quota_rule the same way (although with maildir if you don't return a quota_rule, it gets the limits from the maildirsize file, maybe you were seeing this). From user+dovecot at localhost.localdomain.org Mon Apr 15 17:37:25 2013 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Mon, 15 Apr 2013 16:37:25 +0200 Subject: [Dovecot] imap Panic: file index-attachment.c: line 231 (index_attachment_save_finish): assertion failed: (attach->input->eof) Message-ID: <516C10A5.10503@localhost.localdomain.org> Hi Timo, some imap processes seems to have some problems. Regards, Pascal -------------- next part -------------- Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. #0 0x00007fbf87b25475 in raise () from /lib/x86_64-linux-gnu/libc.so.6 (gdb) bt full #0 0x00007fbf87b25475 in raise () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #1 0x00007fbf87b286f0 in abort () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #2 0x00007fbf87ef71c9 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:191 backtrace = 0x194bf58 "/usr/local/lib/dovecot/libdovecot.so.0(+0x7a1a2) [0x7fbf87ef71a2] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x7b4cd) [0x7fbf87ef84cd] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbf87ef7"... #3 0x00007fbf87ef84cd in i_internal_fatal_handler (ctx=0x7fffb895a7b0, format=0x7fbf8828f4c0 "file %s: line %d (%s): assertion failed: (%s)", args=0x7fffb895a798) at failures.c:652 status = 0 #4 0x00007fbf87ef74a5 in i_panic (format=0x7fbf8828f4c0 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fffb895a880, reg_save_area = 0x7fffb895a7c0}} #5 0x00007fbf8822776e in index_attachment_save_finish (ctx=0x19ed140) at index-attachment.c:231 attach = 0x1a0d870 __FUNCTION__ = "index_attachment_save_finish" #6 0x00007fbf881b3ab0 in dbox_save_end (ctx=0x19ed140) at dbox-save.c:106 mdata = 0x19ed150 dbox_output = 0x1a07008 __FUNCTION__ = "dbox_save_end" #7 0x00007fbf881aadf7 in mdbox_save_finish_write (_ctx=0x19ed140) at mdbox-save.c:198 ctx = 0x19ed140 mail = 0x636c08 #8 0x00007fbf881aaf5d in mdbox_save_finish (ctx=0x19ed140) at mdbox-save.c:228 ret = 0 #9 0x00007fbf872c505b in quota_save_finish (ctx=0x19ed140) at quota-storage.c:281 qbox = 0x19e0a50 #10 0x00007fbf882041f7 in mailbox_save_finish (_ctx=0x1971498) at mail-storage.c:2022 ctx = 0x19ed140 t = 0x19ebdc0 keywords = 0x0 pvt_flags = 0 copying_via_save = false ret = 0 __FUNCTION__ = "mailbox_save_finish" #11 0x000000000040d165 in cmd_append_continue_message (cmd=0x1971340) at cmd-append.c:802 all_written = true client = 0x1970760 ctx = 0x1971438 ret = 0 #12 0x000000000041a04e in command_exec (cmd=0x1971340) at imap-commands.c:156 hook = 0x1954da0 ret = false #13 0x000000000040b9be in client_input_append (cmd=0x1971340) at cmd-append.c:112 ctx = 0x1971438 client = 0x1970760 reason = 0x7fbf87ef5033 "H\213\005.3'" finished = false __FUNCTION__ = "client_input_append" #14 0x00007fbf87f0e58d in io_loop_call_io (io=0x19de2a0) at ioloop.c:387 ioloop = 0x1953720 t_id = 2 #15 0x00007fbf87f101ed in io_loop_handler_run (ioloop=0x1953720) at ioloop-epoll.c:215 ctx = 0x1953aa0 events = 0x1953b10 event = 0x1953b10 list = 0x1971290 io = 0x19de2a0 tv = {tv_sec = 59, tv_usec = 999033} events_count = 6 msecs = 60000 ret = 1 i = 0 j = 0 call = true __FUNCTION__ = "io_loop_handler_run" #16 0x00007fbf87f0e630 in io_loop_run (ioloop=0x1953720) at ioloop.c:406 No locals. #17 0x00007fbf87ea609e in master_service_run (service=0x19535b0, callback=0x426143 ) at master-service.c:560 No locals. #18 0x000000000042645c in main (argc=1, argv=0x1953390) at main.c:400 set_roots = {0x42f500, 0x0} login_set = {auth_socket_path = 0x194b050 , postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x425f07 , failure_callback = 0x4260cf , request_auth_token = 1} service_flags = MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = -1 -------------- next part -------------- # 2.2.0: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.0 auth_mechanisms = plain login debug_log_path = /var/log/dovecot_dbg.log dict { quota = pgsql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_gid = 70000 first_valid_uid = 70000 lmtp_save_to_detail_mailbox = yes login_access_sockets = tcpwrap mail_access_groups = dovemail mail_attachment_dir = /srv/mail/.SiS/%X{gid} mail_attachment_fs = sis posix:mode=0660 mail_attachment_hash = %{sha256} mail_location = mdbox:~/mdbox mail_plugins = quota stats zlib managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace Public { location = maildir:/srv/mail/.public/%X{gid}/Maildir:LAYOUT=fs:INDEX=~/Maildir/public prefix = "#Public/" separator = / subscriptions = no type = public } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:user:%{uid}:noenforcing:proxy::quota quota_rule = *:storage=2G:messages=0 quota_rule2 = Trash:storage=+100M recipient_delimiter = + sieve = ~/.dovecot.sieve sieve_dir = ~/sieve stats_refresh = 1min zlib_save = bz2 zlib_save_level = 6 } postmaster_address = postmaster at example.com protocols = imap lmtp sieve service auth-worker { unix_listener auth-worker { group = $default_internal_user mode = 0660 user = doveauth } user = doveauth } service auth { client_limit = 1425 unix_listener /var/spool/postfix-orange/private/dovecot-auth { group = postfix mode = 0600 user = postfix } user = doveauth } service dict { idle_kill = 150 secs unix_listener dict { group = dovemail mode = 0660 } } service imap-login { process_limit = 256 } service imap { process_limit = 256 } service lmtp { executable = lmtp -D unix_listener /var/spool/postfix-blau/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } unix_listener /var/spool/postfix-orange/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service stats { fifo_listener stats-mail { mode = 0666 } } service tcpwrap { unix_listener login/tcpwrap { group = $default_login_user mode = 0600 user = $default_login_user } } ssl = required ssl_cert = mail_plugins = quota stats zlib imap_quota imap_stats imap_zlib } protocol lmtp { mail_plugins = quota stats zlib sieve } From tss at iki.fi Mon Apr 15 17:51:34 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 15 Apr 2013 17:51:34 +0300 Subject: [Dovecot] imap Panic: file index-attachment.c: line 231 (index_attachment_save_finish): assertion failed: (attach->input->eof) In-Reply-To: <516C10A5.10503@localhost.localdomain.org> References: <516C10A5.10503@localhost.localdomain.org> Message-ID: <1366037494.11047.259.camel@innu> On Mon, 2013-04-15 at 16:37 +0200, Pascal Volk wrote: > some imap processes seems to have some problems. Can you reproduce it? What client was that with? I wonder if it was using CATENATE extension. From user+dovecot at localhost.localdomain.org Mon Apr 15 17:58:06 2013 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Mon, 15 Apr 2013 16:58:06 +0200 Subject: [Dovecot] imap Panic: file index-attachment.c: line 231 (index_attachment_save_finish): assertion failed: (attach->input->eof) In-Reply-To: <1366037494.11047.259.camel@innu> References: <516C10A5.10503@localhost.localdomain.org> <1366037494.11047.259.camel@innu> Message-ID: <516C157E.7050607@localhost.localdomain.org> On 04/15/2013 04:51 PM, Timo Sirainen wrote: > Can you reproduce it? What client was that with? I wonder if it was > using CATENATE extension. Three users where able to crash their imap service. All three users are using Thunderbird 17.0.5 at Windows. I'm not sure what they've done exactly. Nobody complained about it - so far. Regards, Pascal From list at airstreamcomm.net Mon Apr 15 18:55:28 2013 From: list at airstreamcomm.net (list at airstreamcomm.net) Date: Mon, 15 Apr 2013 10:55:28 -0500 Subject: [Dovecot] v2.2.0 released In-Reply-To: <1365787987.11047.246.camel@innu> References: <1365787987.11047.246.camel@innu> Message-ID: <516C22F0.6060600@airstreamcomm.net> On 4/12/13 12:33 PM, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.0.tar.gz.sig > > Everything now seems to be stable and working in v2.2, so I can finally > move onto developing great new interesting features for v2.3. :) > > My company has also launched a web shop where you can buy various > products. One of them is cheap access to Dovecot enterprise edition > repositories, which are basically same as regular Dovecot releases, > except they are kept patched with the latest important bugfixes. We > currently have releases for RHEL/CentOS 5 and 6, Debian Squeeze and > Ubuntu 12.04 LTS. By buying Dovecot-EE you'll also get a 30 day demo > license for object storages, if you want to try it out. > http://shop.dovecot.fi/ > > * When creating home directories, the permissions are copied from the > parent directory if it has setgid-bit set. For full details, see > http://wiki2.dovecot.org/SharedMailboxes/Permissions > * "doveadm auth" command was renamed to "doveadm auth test" > * IMAP: ID command now advertises server name as Dovecot by default. > It was already trivial to guess this from command replies. > * dovecot.index.cache files can be safely accessed only by v2.1.11+. > Older versions may think they're corrupted and delete them. > * LDA/LMTP: If saving a mail brings user from under quota to over > quota, allow it based on quota_grace setting (default: 10% > above quota limit). > * pop3_lock_session=yes now uses a POP3-only dovecot-pop3-session.lock > file instead of actually locking the mailbox (and causing > IMAP/LDA/LMTP to wait for the POP3 session to close). > * mail_shared_explicit_inbox setting's default switched to "no". > * ssl_client_ca_dir setting replaced imapc_ssl_ca_dir and > pop3c_ssl_ca_dir settings. > > + Implemented IMAP MOVE and BINARY extensions > + Implemented IMAP CATENATE, URLAUTH and URLAUTH=BINARY extensions > (by Stephan Bosch). > + Implemented IMAP NOTIFY extension. Requires mailbox_list_index=yes > to be enabled. > + Redesigned and rewritten dsync. The new design makes the syncing > faster, more reliable and more featureful. The new dsync protocol > isn't backwards compatible with old dsync versions (but is designed > to be forwards compatible with future versions). > + All mailbox formats now support per-user message flags for shared > mailboxes by using a private index. It can be enabled by adding > :INDEXPVT= to mail location. This should be used instead of > :INDEX also for Maildir/mbox to improve performance. > + Improved mailbox list indexes. They should be usable now, although > still disabled by default. > + Added LAYOUT=index. The mailbox directories are created using their > GUIDs in the filesystem, while the actual GUID <-> name mapping > exists only in the index. > + LMTP proxy: Implemented XCLIENT extension for passing remote IP > address through proxy. > > Does the new obox plugin support any of the open source object storage systems such as openstack, glusterfs, or ceph? From your store site it does not appear so. From tss at iki.fi Mon Apr 15 19:16:44 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 15 Apr 2013 19:16:44 +0300 Subject: [Dovecot] v2.2.0 released In-Reply-To: <516C22F0.6060600@airstreamcomm.net> References: <1365787987.11047.246.camel@innu> <516C22F0.6060600@airstreamcomm.net> Message-ID: <11C42D8A-3EC2-4DA7-8DD8-94230284F8BE@iki.fi> On 15.4.2013, at 18.55, list at airstreamcomm.net wrote: > Does the new obox plugin support any of the open source object storage systems such as openstack, glusterfs, or ceph? From your store site it does not appear so. Glusterfs isn't really object storage (unless they've changed since I last looked at them), and it already more or less works with Dovecot using the existing mailbox formats. Except last I heard it still caused index file corruption. Openstack Swift support is coming. There's a half-working version of it already, would need just a day or two to finish it up. I haven't looked at Ceph closely yet, but it would be nice to support it as well. obox can also be used with a regular POSIX filesystem, although it loses the prefetching capabilities then. So it could be used with e.g. Glusterfs or NFS to provide an efficient local cache. I've also thought about trying out if prefetching could be done by creating new "diskio" processes with a ton of threads doing the actual disk I/O. From manu at netbsd.org Mon Apr 15 19:18:19 2013 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Mon, 15 Apr 2013 16:18:19 +0000 Subject: [Dovecot] v2.2.0 released In-Reply-To: <11C42D8A-3EC2-4DA7-8DD8-94230284F8BE@iki.fi> References: <1365787987.11047.246.camel@innu> <516C22F0.6060600@airstreamcomm.net> <11C42D8A-3EC2-4DA7-8DD8-94230284F8BE@iki.fi> Message-ID: <20130415161819.GE9659@homeworld.netbsd.org> On Mon, Apr 15, 2013 at 07:16:44PM +0300, Timo Sirainen wrote: > Glusterfs isn't really object storage (unless they've changed since I > last looked at them), I did not test it, but object storage was added in 3.3, IIRC. -- Emmanuel Dreyfus manu at netbsd.org From stephan at rename-it.nl Mon Apr 15 19:35:02 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 15 Apr 2013 18:35:02 +0200 Subject: [Dovecot] v2.2.0 released In-Reply-To: <11C42D8A-3EC2-4DA7-8DD8-94230284F8BE@iki.fi> References: <1365787987.11047.246.camel@innu> <516C22F0.6060600@airstreamcomm.net> <11C42D8A-3EC2-4DA7-8DD8-94230284F8BE@iki.fi> Message-ID: <516C2C36.4060206@rename-it.nl> On 4/15/2013 6:16 PM, Timo Sirainen wrote: > On 15.4.2013, at 18.55, list at airstreamcomm.net wrote: > >> Does the new obox plugin support any of the open source object storage systems such as openstack, glusterfs, or ceph? From your store site it does not appear so. > Glusterfs isn't really object storage (unless they've changed since I last looked at them), and it already more or less works with Dovecot using the existing mailbox formats. Except last I heard it still caused index file corruption. > > Openstack Swift support is coming. There's a half-working version of it already, would need just a day or two to finish it up. Looks like Openstack support would imply GlusterFS Object Storage support: http://gluster.org/community/documentation/index.php/About33 Regards, Stephan From marc at perkel.com Mon Apr 15 19:42:08 2013 From: marc at perkel.com (Marc Perkel) Date: Mon, 15 Apr 2013 09:42:08 -0700 Subject: [Dovecot] v2.2.0 - possible bug? In-Reply-To: <1366035835.11047.257.camel@innu> References: <1365787987.11047.246.camel@innu> <516B9195.4030302@perkel.com> <85919EE6-2E26-4E2F-99E6-838D4E878D25@iki.fi> <516C03FA.7030803@perkel.com> <1366034960.11047.254.camel@innu> <1366035015.11047.255.camel@innu> <1366035835.11047.257.camel@innu> Message-ID: <516C2DE0.8030800@perkel.com> On 4/15/2013 7:23 AM, Timo Sirainen wrote: > On Mon, 2013-04-15 at 17:10 +0300, Timo Sirainen wrote: >>>>>> Apr 14 22:32:24 imap(support at junkemailfilter.com): Panic: file message-parser.c: line 698 (preparsed_parse_prologue_more): assertion failed: (ctx->part->children != NULL) >>>>> You can reproduce this? What if you delete that mailbox's dovecot.index.cache and search twice after that? >> Actually don't bother, looks like I can reproduce it myself also. :) I >> thought it was a more rare problem. > I don't think it is a very common problem actually, I just happened to > have such mail in my inbox. This fixes it: > http://hg.dovecot.org/dovecot-2.2/rev/b38d5ebacf25 > > > > So - will there be a 2.2.1 out today? From tss at iki.fi Mon Apr 15 19:50:59 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 15 Apr 2013 19:50:59 +0300 Subject: [Dovecot] imap Panic: file index-attachment.c: line 231 (index_attachment_save_finish): assertion failed: (attach->input->eof) In-Reply-To: <516C10A5.10503@localhost.localdomain.org> References: <516C10A5.10503@localhost.localdomain.org> Message-ID: <1366044659.11047.276.camel@innu> On Mon, 2013-04-15 at 16:37 +0200, Pascal Volk wrote: > some imap processes seems to have some problems. I still can't reproduce .. but I wonder if the attached patch makes a difference. Also in the gdb these would be useful to know: p *attach.input.real_stream.parent.real_stream p *attach.input.real_stream.parent.real_stream.parent.real_stream p *attach.input.real_stream.parent.real_stream.parent.real_stream.parent.real_stream (not sure how many parents it has) -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: text/x-patch Size: 1439 bytes Desc: not available URL: From tss at iki.fi Mon Apr 15 19:53:13 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 15 Apr 2013 19:53:13 +0300 Subject: [Dovecot] imap Panic: file index-attachment.c: line 231 (index_attachment_save_finish): assertion failed: (attach->input->eof) In-Reply-To: <1366044659.11047.276.camel@innu> References: <516C10A5.10503@localhost.localdomain.org> <1366044659.11047.276.camel@innu> Message-ID: <1366044793.11047.277.camel@innu> On Mon, 2013-04-15 at 19:50 +0300, Timo Sirainen wrote: > On Mon, 2013-04-15 at 16:37 +0200, Pascal Volk wrote: > > > some imap processes seems to have some problems. > > I still can't reproduce .. but I wonder if the attached patch makes a > difference. Uh, wrong directory. This patch. :) -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: text/x-patch Size: 590 bytes Desc: not available URL: From tss at iki.fi Mon Apr 15 19:55:07 2013 From: tss at iki.fi (Timo Sirainen) Date: Mon, 15 Apr 2013 19:55:07 +0300 Subject: [Dovecot] imap Panic: file index-attachment.c: line 231 (index_attachment_save_finish): assertion failed: (attach->input->eof) In-Reply-To: <1366044793.11047.277.camel@innu> References: <516C10A5.10503@localhost.localdomain.org> <1366044659.11047.276.camel@innu> <1366044793.11047.277.camel@innu> Message-ID: <1366044907.11047.278.camel@innu> On Mon, 2013-04-15 at 19:53 +0300, Timo Sirainen wrote: > On Mon, 2013-04-15 at 19:50 +0300, Timo Sirainen wrote: > > On Mon, 2013-04-15 at 16:37 +0200, Pascal Volk wrote: > > > > > some imap processes seems to have some problems. > > > > I still can't reproduce .. but I wonder if the attached patch makes a > > difference. > > Uh, wrong directory. This patch. :) Once more, with some error checks :) -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: text/x-patch Size: 631 bytes Desc: not available URL: From ngu.antoine at gmail.com Mon Apr 15 21:18:15 2013 From: ngu.antoine at gmail.com (Antoine Nguyen) Date: Mon, 15 Apr 2013 20:18:15 +0200 Subject: [Dovecot] Dict quota question In-Reply-To: References: Message-ID: 2013/4/15 Timo Sirainen > > You can't have both static userdb and sql userdb. Create just one sql > userdb, which returns something like: > > select quota_rule, 123 uid, 123 as gid, '/home/%u' as home from > quota_limits where username = '%u' > Ok. I didn't know it was possible to use variables into sql lookup results. Good to know :) > > I don't really understand what sql dict vs maildir backend has to do with > it. Both of them get the limits from the same quota_rule the same way > (although with maildir if you don't return a quota_rule, it gets the limits > from the maildirsize file, maybe you were seeing this). > I think you're right, the quota limit should come from the maildirsize file. Thanks for your help ! Antoine From lists at luigirosa.com Mon Apr 15 21:25:01 2013 From: lists at luigirosa.com (Luigi Rosa) Date: Mon, 15 Apr 2013 20:25:01 +0200 Subject: [Dovecot] rsync migration issue Message-ID: <516C45FD.3020402@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I am trying to migrate a mail server from an old VM to a new one. I have maildir and virtual users, the files and dirs of the file system are owned by a single user. I exported the old (now in production) /var/spool/mail with (ro,no_root_squash) parameters I mounted the NFS on the new server with -o nolock This is not the first time I use this method and it always worked. Until now. If I try to rsync the current maildir structure to the new server I get MANY errors like: rsync: readdir("/mnt/xxxx/username"): Invalid argument (22) rsync: readdir("/mnt/xxxx/username/.Deleted Messages/cur"): Too many levels of symbolic links (40) I tried with rsync -a rsync --force --delete-after --devices --specials --sparse -tPrlHpogEAX rsync --force --delete-after --devices --specials --sparse -tPrlHpogEAXL but the result is the same. Suggestions? I don't want to tgz every mailbox, but I wuold like to do a rsync during the night and a final rsync bevore switching IP addresses to minimize downtime. Ciao, luigi - -- / +--[Luigi Rosa]-- \ It has just been discovered that research causes cancer in rats. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iEYEARECAAYFAlFsRfcACgkQ3kWu7Tfl6ZRNbQCgk9AR7THYXT6+rqLFE5H8zSem QhUAnR33bNbcXwWfNSj8PN0YgY40gdHH =salc -----END PGP SIGNATURE----- From lbinotto at sidor.com Mon Apr 15 22:29:28 2013 From: lbinotto at sidor.com (BINOTTO Luis SIDOR) Date: Mon, 15 Apr 2013 14:59:28 -0430 Subject: [Dovecot] Delete_to_Trash plugin problem Message-ID: Hello list... I am new at dovecot and I have a problem with it; any help will be very grateful We have a exchange server with outlook at the client side, and we are migrating the exchange server to postfix/dovecot(1.2.15) solution. I enabled the "deleted-to-trash" plugin (v0.3) to move the messages to the Trash folder automatically when it is deleted. Also, I am using quota and quota_imap plugins to maintain the quota for users. The quota rule for Trash folder is unlimit. The problem is, when the client reach their maximum quota and try to delete a mail in the inbox to release space. The delete to trash plugin effectively copy it to the Trash folder, but the original mail still remain (marked for delete) at the inbox folder and the quota does not released. Am I doing something wrong? Thanking you in anticipation.... Luis Binotto. " Notificacion Automatica: Este mensaje y cualquier archivo que se adjunte contiene informacion privilegiada y confidencial. Es para uso exclusivo del destinatario. Si usted ha recibido esta comunicacion por error, por favor avisenos inmediatamente. Automatic notification: This e-mail and any file transmitted with it are confidential and may be legally privileged. It is intended solely for the addressee and may not be disclosed to or used by anyone other than the addressee. If you have received this e-mail by mistake , please advise the sender immediately" From user+dovecot at localhost.localdomain.org Tue Apr 16 00:33:30 2013 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Mon, 15 Apr 2013 23:33:30 +0200 Subject: [Dovecot] imap Panic: file index-attachment.c: line 231 (index_attachment_save_finish): assertion failed: (attach->input->eof) In-Reply-To: <1366044907.11047.278.camel@innu> References: <516C10A5.10503@localhost.localdomain.org> <1366044659.11047.276.camel@innu> <1366044793.11047.277.camel@innu> <1366044907.11047.278.camel@innu> Message-ID: <516C722A.3040206@localhost.localdomain.org> On 04/15/2013 06:55 PM Timo Sirainen wrote: > On Mon, 2013-04-15 at 19:53 +0300, Timo Sirainen wrote: >> Uh, wrong directory. This patch. :) > > Once more, with some error checks :) OK, applied that patch. Lets see what will happen. Regards, Pascal -- The trapper recommends today: defaced.1310523 at localdomain.org From gregs at sloop.net Tue Apr 16 02:48:25 2013 From: gregs at sloop.net (Gregory Sloop) Date: Mon, 15 Apr 2013 16:48:25 -0700 Subject: [Dovecot] Moving mail servers, moving mailboxes Message-ID: <377722326.20130415164825@sloop.net> So, I've done some searching - but search terms are hard to come by, that work, for this query. In short, migrating a RHEL 5.9 server running the back-ported Dovecot 1.0.7 To: Ububtu 12.04 with 2.0.19, I believe. [I'm not against compiling a more recent version if there's some real advantage to doing so. But I'd certainly prefer to stay with the packaged version.] Most users are POP3, with some leaving messages on the server for a while. Other users are IMAP - whole mail repository on server. --- In an ideal world, I'd like to simply copy all the mailboxes/dirs from one server to the other. [Local/LAN file copies are possible] It would be great if the message ID's wouldn't change, so the read/unread/new etc status all all the messages wouldn't change between the two servers for POP/IMAP. --- So, does anyone have a reasonable walk-through for doing so? Is this a poor idea? Should I simply set myself on fire now and save everyone a lot of hassle? :) Would you suggest an alternative, and tell me if it might achieve the objectives above? I'm more than glad to take pointers to threads on this topic. I just haven't been able to dredge this up with my Google-foo. TIA -Greg From rauchwolke at gmx.net Tue Apr 16 04:01:39 2013 From: rauchwolke at gmx.net (rauchwolke at gmx.net) Date: Tue, 16 Apr 2013 03:01:39 +0200 Subject: [Dovecot] Dovecot 2.2.0 compile error Message-ID: <20130416010137.C3DFA1AE8770@dovecot.org> Hi, i tried to compile dovecot 2.2.0 and i end up with this error: make[6]: Entering directory `/mnt/data/Develop/Openwrt/trunk_git/build_dir/target-mips_r2_uClibc-0.9.33.2/dovecot-2.2.0/src/util' /bin/sh ../../libtool --tag=CC --mode=link mips-openwrt-linux-uclibc-gcc -std=gnu99 -Os -pipe -mips32r2 -mtune=mips32r2 -fno-caller-saves -mno-branch-likely -fhonour-copts -Wno-error=unused-but-set-variable -msoft-float -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/include -no-undefined -Wl,--as-needed -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/lib -o gdbhelper gdbhelper.o ../../src/lib-dovecot/libdovecot.la -export-dynamic -ldl OpenWrt-libtool: link: mips-openwrt-linux-uclibc-gcc -std=gnu99 -Os -pipe -mips32r2 -mtune=mips32r2 -fno-caller-saves -mno-branch-likely -fhonour-copts -Wno-error=unused-but-set-variable -msoft-float -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/include -Wl,--as-needed -o .libs/gdbhelper gdbhelper.o -Wl,--export-dynamic -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/lib ../../src/lib-dovecot/.libs/libdovecot.so -ldl -Wl,-rpath -Wl,/usr/lib/dovecot ../../src/lib-dovecot/.libs/libdovecot.so:(.got+0x0): multiple definition of `_GLOBAL_OFFSET_TABLE_' collect2: ld returned 1 exit status make[6]: *** [gdbhelper] Error 1 make[6]: Leaving directory `/mnt/data/Develop/Openwrt/trunk_git/build_dir/target-mips_r2_uClibc-0.9.33.2/dovecot-2.2.0/src/util' Making all in doveadm make[6]: Entering directory `/mnt/data/Develop/Openwrt/trunk_git/build_dir/target-mips_r2_uClibc-0.9.33.2/dovecot-2.2.0/src/doveadm' Making all in dsync make[7]: Entering directory `/mnt/data/Develop/Openwrt/trunk_git/build_dir/target-mips_r2_uClibc-0.9.33.2/dovecot-2.2.0/src/doveadm/dsync' make[7]: Nothing to be done for `all'. Version 2.1.16 compiled fine. How can i fix this linker error? With kind regards From martino87rm at gmail.com Tue Apr 16 04:54:15 2013 From: martino87rm at gmail.com (Marcin Czupryniak) Date: Tue, 16 Apr 2013 03:54:15 +0200 Subject: [Dovecot] SSHA512 auth not working Message-ID: <516CAF47.80400@gmail.com> I'm trying to configure SSHA512 passwords and when testing discovered that they were not working as expected. At first i was using Centos 6.4 which doesn't have the glibc CRYPT newest functions ($6$salt$pass) so had to rollback to the Dovecot format ({SSHA512.HEX}saltedpassword+salt ) but I'm unable to let dovecot authenticate properly. Some logs and details: Apr 16 02:55:37 auth: Debug: client in: AUTH 1 PLAIN service=imap lip=xxx rip=xxx lport=143 rport=58171 resp=AGRpbm9AYWJjLml0AGRpbm8= Apr 16 02:55:37 auth: Debug: sql(dino at abc.it,xxxx): query: SELECT '{SSHA512.HEX}' || password as password FROM mailboxes WHERE fullusername='dino at abc.it' Apr 16 02:55:37 auth: Info: sql(dino at abc.it,xxxx): Password mismatch (given password: dino) Apr 16 02:55:37 auth: Error: md5_verify(dino at abc.it): Not a valid MD5-CRYPT or PLAIN-MD5 password Apr 16 02:55:37 auth: Warning: Invalid OTP data in passdb Apr 16 02:55:37 auth: Warning: Invalid OTP data in passdb Apr 16 02:55:37 auth: Debug: sql(dino at abc.it,xxxx): SSHA512.HEX(dino) != 'd449914d83c85a786bcde7114b3dfdb24a651c27956388ac641d46eaf40c86e7c95ce2534348730475c8893eab314af189b3a46bf6d76b82cfba119e920813a531e985acd35c47ca8d3cafe50b595b66' Apr 16 02:55:39 auth: Debug: client out: FAIL 1 user=dino at abc.it Full password as taken from database: {SSHA512.HEX}d449914d83c85a786bcde7114b3dfdb24a651c27956388ac641d46eaf40c86e7c95ce2534348730475c8893eab314af189b3a46bf6d76b82cfba119e920813a531e985acd35c47ca8d3cafe50b595b66 The first 128 chars are the salted password, remaining 32 the salt (hex uuid representation) I've checked twice that the generated passwords are correct, in fact if you salt the password (dino) you get the exact 128chars as in the stored password but dovecot compares the full password with the salt (160 chars), is this correct? Any ideas? From lists at luigirosa.com Tue Apr 16 07:58:05 2013 From: lists at luigirosa.com (Luigi Rosa) Date: Tue, 16 Apr 2013 06:58:05 +0200 Subject: [Dovecot] rsync migration issue [solved] In-Reply-To: <516C45FD.3020402@luigirosa.com> References: <516C45FD.3020402@luigirosa.com> Message-ID: <516CDA5D.1090007@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Luigi Rosa said the following on 15/04/2013 20:25: > I mounted the NFS on the new server with -o nolock > > This is not the first time I use this method and it always worked. Until > now. > > If I try to rsync the current maildir structure to the new server I get > MANY errors like: > > rsync: readdir("/mnt/xxxx/username"): Invalid argument (22) rsync: > readdir("/mnt/xxxx/username/.Deleted Messages/cur"): Too many levels of > symbolic links (40) For the record: solved using rsync over ssh instead of mounting the file system with NFS. Ciao, luigi - -- / +--[Luigi Rosa]-- \ Mathematicians are like Frenchmen: whatever you say to them they translate into their own language and forthwith it is something entirely different. --Johann Wolfgang von Goethe -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iEYEARECAAYFAlFs2lUACgkQ3kWu7Tfl6ZSRTACfbDpq7+jxIL6LgFILFd1qM3YW rY0AoMfew+XII5Geb9JxsvaeYiTgBUTX =DkXI -----END PGP SIGNATURE----- From kris.magnusson at icloud.com Tue Apr 16 07:43:35 2013 From: kris.magnusson at icloud.com (Kris Magnusson) Date: Mon, 15 Apr 2013 21:43:35 -0700 Subject: [Dovecot] Probs authenticating to Dovecot Message-ID: <1A8A6A01-32F0-4F4F-AA10-3F539531A159@icloud.com> Hi folks. I have set up a Ubuntu 12.04 VM with Dovecot, Postfix, MySQL, amavisd, and ISPConfig 3. The VM has tons of RAM and disk and processor and is permanently connected to the Internet with a static IP. I followed the instructions at howtoforge.com to set up and configure this VM and am using ISPConfig to set up a mail hub for multiple domains. I have the DNS for my other domains' MX records pointing at this host?we'll call it "mail." Here's the version of Dovecot I'm using: root at mail:# dovecot --version 2.1.7 Anyway, when I try to connect to my VM and Dovecot using Mail.app on Mountain Lion, I get the following messages in mail.log: Apr 15 01:18:40 mail postfix/smtpd[4284]: connect from 50-196-170-xxx-static.hfc.comcastbusiness.net[50.196.170.xxx] Apr 15 01:18:40 mail dovecot: auth-worker(4331): mysql(localhost): Connected to database dbispconfig Apr 15 01:18:42 mail postfix/smtpd[4284]: warning: 50-196-170-xxx-static.hfc.comcastbusiness.net[50.196.170.xxx]: SASL PLAIN authentication failed: Apr 15 01:18:42 mail postfix/smtpd[4284]: disconnect from 50-196-170-xxx-static.hfc.comcastbusiness.net[50.196.170.xxx] Apr 15 01:18:54 mail dovecot: imap-login: Disconnected (auth failed, 1 attempts in 6 secs): user=, method=PLAIN, rip=50.196.170.xxx, lip=50.196.170.yyy, TLS, session= Apr 15 01:19:04 mail dovecot: imap-login: Disconnected (auth failed, 1 attempts in 10 secs): user=, method=PLAIN, rip=50.196.170.xxx, lip=50.196.170.yyy, TLS, session= But if I run alpine on mail, I can send and receive mail all day long. Here's a log entry that demonstrates this: Apr 15 01:20:01 mail postfix/smtpd[4284]: connect from localhost[127.0.0.1] Apr 15 01:20:01 mail postfix/smtpd[4284]: lost connection after CONNECT from localhost[127.0.0.1] Apr 15 01:20:01 mail postfix/smtpd[4284]: disconnect from localhost[127.0.0.1] Apr 15 01:20:01 mail dovecot: pop3-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session= So I thought it was a problem with SASL not liking PLAIN authentication. When I go to /etc/dovecot and print the contents of dovecot.conf, I see that auth_mechanisms = plain login. root at mail:/etc/dovecot# more dovecot.conf listen = *,[::] protocols = imap pop3 auth_mechanisms = plain login disable_plaintext_auth = no log_timestamp = "%Y-%m-%d %H:%M:%S " mail_privileged_group = vmail ssl_cert = References: <516CAF47.80400@gmail.com> Message-ID: <1366091711.9241.7.camel@tardis> On Tue, 2013-04-16 at 03:54 +0200, Marcin Czupryniak wrote: > I'm trying to configure SSHA512 passwords and when testing discovered > that they were not working as expected. > At first i was using Centos 6.4 which doesn't have the glibc CRYPT > newest functions ($6$salt$pass) so had to rollback to the Dovecot format > ({SSHA512.HEX}saltedpassword+salt ) but I'm unable to let dovecot > authenticate properly. > I have one CentOS server (5.9) and only one, so can't test any others (they are all slackware) but... crypt($pass, '$6$' . $salt) "dino", results in: $6$n.vM3bqg3C6LPtJv $keF2z/6VXv99NKf92Abbz/sPLBcWHV2hBXOkDf41OKLqe9p7V39xcFc92K1S4WvWQ3rK0konAw.pV.YEQspuM. So if 6.4 does not work, you are missing something. try this #!/path/to/perl $pass ="dino"; @pschars = ("A" .. "Z", "a" .. "z", 0 .. 9, ".", "/"); $salt= join '', @pschars[map {rand @pschars} (1..16)]; $sha512p = crypt($pass, '$6$' . $salt); print "\n $sha512p \n"; -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From noel.butler at ausics.net Tue Apr 16 09:16:27 2013 From: noel.butler at ausics.net (Noel Butler) Date: Tue, 16 Apr 2013 16:16:27 +1000 Subject: [Dovecot] Probs authenticating to Dovecot In-Reply-To: <1A8A6A01-32F0-4F4F-AA10-3F539531A159@icloud.com> References: <1A8A6A01-32F0-4F4F-AA10-3F539531A159@icloud.com> Message-ID: <1366092987.9241.20.camel@tardis> On Mon, 2013-04-15 at 21:43 -0700, Kris Magnusson wrote: > Hi folks. I have set up a Ubuntu 12.04 VM with Dovecot, Postfix, MySQL, amavisd, and ISPConfig 3. > tatic IP. I followed the instructions at howtoforge.com to set up and configure this Somebody else recently used some howto from there and had no end of troubles. > But if I run alpine on mail, I can send and receive mail all day long. Here's a log entry that demonstrates this: > > Apr 15 01:20:01 mail postfix/smtpd[4284]: connect from localhost[127.0.0.1] > Apr 15 01:20:01 mail postfix/smtpd[4284]: lost connection after CONNECT from localhost[127.0.0.1] > Apr 15 01:20:01 mail postfix/smtpd[4284]: disconnect from localhost[127.0.0.1] > Apr 15 01:20:01 mail dovecot: pop3-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session= eh? that says you did not log in pop3, and postfix by default will relay for localhost, well, with most configs in mynetworks having localhost it will. telnet mail 110 user username pass password list quit ... does that work? I bet it doesn't. > root at mail:/etc/dovecot# more dovecot.conf dovecot -n output is best > listen = *,[::] > protocols = imap pop3 you use sieve below, but now in proto? > auth_mechanisms = plain login > disable_plaintext_auth = no > log_timestamp = "%Y-%m-%d %H:%M:%S " > mail_privileged_group = vmail > ssl_cert = ssl_key = passdb { > args = /etc/dovecot/dovecot-sql.conf > driver = sql > } verify your sql is valid by using mysql shell > userdb { > args = /etc/dovecot/dovecot-sql.conf > driver = sql > } > plugin { > quota = dict:user::file:/var/vmail/%d/%n/.quotausage > sieve=/var/vmail/%d/%n/.sieve > } > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = vmail > mode = 0600 > user = vmail > } > user = root > } > protocol imap { > mail_plugins = quota imap_quota > } > protocol pop3 { > pop3_uidl_format = %08Xu%08Xv > mail_plugins = quota > } > protocol lda { > mail_plugins = sieve quota > } > You need to check your postconf -n output as well to make sure it knows dovecot. postconf -a should show dovecot (maybe cyrus as well, but it needs to know dovecot) > Any thoughts or recommendations? If you followed whatever guide it was in full, and have triple checked that, ummm, find another guide? -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From kris.magnusson at icloud.com Tue Apr 16 09:38:39 2013 From: kris.magnusson at icloud.com (Kris Magnusson) Date: Mon, 15 Apr 2013 23:38:39 -0700 Subject: [Dovecot] Probs authenticating to Dovecot In-Reply-To: <1366092987.9241.20.camel@tardis> References: <1A8A6A01-32F0-4F4F-AA10-3F539531A159@icloud.com> <1366092987.9241.20.camel@tardis> Message-ID: I have triple (trippple) checked the recommended configuration and it is per the how-to. The SQL is likely fine. I'm not a SQL maven, but I'm not dumb about SQL, and it passed a couple of inspections. You're right that telnet localhost 110 doesn't work. postconf -a reports that it knows about cyrus and dovecot. I don't really trust this ISPConfig thing, as it likes to do its own stuff that flies in the face of reason, and introducing a DB into the mix just made things an order of magnitude more complicated. I'd rather use OpenLDAP, since I can write JNDI code to figure out what's going on with a directory and even add/modify/delete entries to/in the directory. I will blow this VM away and start from scratch. Unless anyone has any concrete suggestions I can implement before then that I can use to salvage a day's worth of work. Is there a best possible OS for running Dovecot/Postfix? That would be a step in the right direction. Ubuntu is great for running WordPress, but I recognize there are different OSes out there. I don't care if it's Linux-based or a BSD distribution. Will Dovecot/Postfix scale without a RDBMS backing it up? Or will OpenLDAP suffice? Thanks much. Kris On Apr 15, 2013, at 11:16 PM, Noel Butler wrote: > On Mon, 2013-04-15 at 21:43 -0700, Kris Magnusson wrote: > >> Hi folks. I have set up a Ubuntu 12.04 VM with Dovecot, Postfix, MySQL, amavisd, and ISPConfig 3. > > > > >> tatic IP. I followed the instructions at howtoforge.com to set up and configure this > > > Somebody else recently used some howto from there and had no end of > troubles. > > > >> But if I run alpine on mail, I can send and receive mail all day long. Here's a log entry that demonstrates this: >> >> Apr 15 01:20:01 mail postfix/smtpd[4284]: connect from localhost[127.0.0.1] >> Apr 15 01:20:01 mail postfix/smtpd[4284]: lost connection after CONNECT from localhost[127.0.0.1] >> Apr 15 01:20:01 mail postfix/smtpd[4284]: disconnect from localhost[127.0.0.1] > > > >> Apr 15 01:20:01 mail dovecot: pop3-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session= > > > > eh? that says you did not log in pop3, and postfix by default will > relay for localhost, well, with most configs in mynetworks having > localhost it will. > > telnet mail 110 > user username > pass password > list > quit > ... does that work? I bet it doesn't. > > > >> root at mail:/etc/dovecot# more dovecot.conf > > dovecot -n output is best > > > > >> listen = *,[::] >> protocols = imap pop3 > > > you use sieve below, but now in proto? > >> auth_mechanisms = plain login >> disable_plaintext_auth = no >> log_timestamp = "%Y-%m-%d %H:%M:%S " >> mail_privileged_group = vmail >> ssl_cert = > ssl_key = > > >> passdb { >> args = /etc/dovecot/dovecot-sql.conf >> driver = sql >> } > > > verify your sql is valid by using mysql shell > > >> userdb { >> args = /etc/dovecot/dovecot-sql.conf >> driver = sql >> } >> plugin { >> quota = dict:user::file:/var/vmail/%d/%n/.quotausage >> sieve=/var/vmail/%d/%n/.sieve >> } >> service auth { >> unix_listener /var/spool/postfix/private/auth { >> group = postfix >> mode = 0660 >> user = postfix >> } >> unix_listener auth-userdb { >> group = vmail >> mode = 0600 >> user = vmail >> } >> user = root >> } >> protocol imap { >> mail_plugins = quota imap_quota >> } >> protocol pop3 { >> pop3_uidl_format = %08Xu%08Xv >> mail_plugins = quota >> } >> protocol lda { >> mail_plugins = sieve quota >> } >> > > > You need to check your postconf -n output as well to make sure it > knows dovecot. > > postconf -a should show dovecot (maybe cyrus as well, but it needs to > know dovecot) > > >> Any thoughts or recommendations? > > If you followed whatever guide it was in full, and have triple checked > that, ummm, find another guide? > From noel.butler at ausics.net Tue Apr 16 10:09:52 2013 From: noel.butler at ausics.net (Noel Butler) Date: Tue, 16 Apr 2013 17:09:52 +1000 Subject: [Dovecot] Probs authenticating to Dovecot In-Reply-To: References: <1A8A6A01-32F0-4F4F-AA10-3F539531A159@icloud.com> <1366092987.9241.20.camel@tardis> Message-ID: <1366096192.9241.40.camel@tardis> On Mon, 2013-04-15 at 23:38 -0700, Kris Magnusson wrote: > > and introducing a DB into the mix just made things an order of magnitude more complicated. I'd rather use OpenLDAP, since I can write JNDI code to figure out what's going on with a directory and even add/modify/delete entries to/in the directory. > I'll start a war here, but IMO, ldap is just another database... If you are doing virtuals nothing wrong with them, mysql works fine. > I will blow this VM away and start from scratch. Unless anyone has any concrete suggestions I can implement before then that I can use to salvage a day's worth of work. > Unless you built them from source, I'd wait a day or so (if you can) until maybe some ubuntu users can offer suggestions, but, given ubuntu is just a dressed up debian, you might find something of interest that will work for you on google. > Is there a best possible OS for running Dovecot/Postfix? Slackware! haha - asking that question will start another war - each to our own, whatever distro you are comfortable with - slackware, centos, debian, suse, or the kiddie variants (fedora/ubuntu) (/me puts on flame suite )... it wont make much difference really, it's just a mater of getting the daemons to talk nicely to each other, which they do, postfix, dovecot and mysql go hand in hand. > but I recognize there are different OSes out there. I don't care if it's Linux-based or a BSD distribution. > > Will Dovecot/Postfix scale without a RDBMS backing it up? Or will OpenLDAP suffice? > It scales best with one, but that's just my opinion, there are some folk who do use ldap but I dont know their network requirements. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From jarrad at elysiumtech.com.au Tue Apr 16 10:17:14 2013 From: jarrad at elysiumtech.com.au (Jarrad) Date: Tue, 16 Apr 2013 16:47:14 +0930 Subject: [Dovecot] Dovecot IMAPS and slow reconnections Message-ID: Hi List, I've recently moved from postfix + courier-imap to a new server with postfix + dovecot with a mysql user management. I have it up and running and receiving mail ok but I'm having problems with IMAP connections being slow. I have an iphone with multiple imap accounts set up on it (4 I think) and when I open the mail app it connects to first account quickly. Then if I navigate to another account it takes about 1 minute to connect (sits there with the 'connecting....' status) Looking at the logs it shows the connection come through at the same time the iphone actually connects so it's as if something is timing out before it actually connects. My setup is an Amazon EC2 micro instance running debian wheezy. There is about 5 domains being hosted with approximately 4-5 accounts for each so it's not a heavy load by any means. I've tried bumping up the max connections, service_count and minimum processes but nothing seems to help. Any advice is much appreciated. My config is as per below: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.0 ext4 auth_debug = yes auth_verbose = yes disable_plaintext_auth = no mail_location = maildir:/var/vmail/%d/%n/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = " imap pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } } service imap-login { process_min_avail = 5 service_count = 10 } ssl_cert = } protocol imap { mail_max_userip_connections = 100 } From skdovecot at smail.inf.fh-brs.de Tue Apr 16 10:21:38 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 16 Apr 2013 09:21:38 +0200 (CEST) Subject: [Dovecot] Probs authenticating to Dovecot In-Reply-To: References: <1A8A6A01-32F0-4F4F-AA10-3F539531A159@icloud.com> <1366092987.9241.20.camel@tardis> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 15 Apr 2013, Kris Magnusson wrote: > I will blow this VM away and start from scratch. Unless anyone has any concrete suggestions I can implement before then that I can use to salvage a day's worth of work. If you want to debug this config further, I would 1) enable auth_debug in Dovcot, see http://wiki2.dovecot.org/Logging 2) check with telnet if authentification works in Dovecot 3) check if SMTP AUTH works If you don't trust ISPConfig, then ignore this VM, check out the Dovecot Wiki2 and its Postfix howto. > Is there a best possible OS for running Dovecot/Postfix? That would be a step in the right direction. Ubuntu is great for running WordPress, but I recognize there are different OSes out there. I don't care if it's Linux-based or a BSD distribution. I don't think there is a "best" OS. You could compile Dovecot yourself, the development packages of dependencies are available in most (all?) distributions, then you are not stuck on one particular version of Dovecot. > Will Dovecot/Postfix scale without a RDBMS backing it up? Or will OpenLDAP suffice? Dovecot will work fine with OpenLDAP, esp. because it implements caching. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUWz8Al3r2wJMiz2NAQLGNgf/YU6ecbB15V4kJBEKolId06m4odtDwb7z md+gsYghBNAGkqO5hg6brJKHhrx/ReBUI68iIwQ9X26ifF90oOSrGINv5NH0uYpK 10YI0zljq45b4/GC3927PP56K1wrKm/ekhLJJ368bdCqfH3jznaFViU+gn1Ud3FZ bOh0Y2lQHINIkpI9GqlZAGeLj8GZ3k0urv8KSENLaWqf5/ycSNTvpCI1b5xuXYvc +z3LB5NBtCLP/OLjVDhy5a/TpK6L0nYgc6Tphf+7HJR9nHWMez/7NZqa/faPRVZd v+5qa2n7wB9powAjIJZWLMIBGzk/AEVTTdbZ3etzK6sVwKeHkvL6Uw== =6nJA -----END PGP SIGNATURE----- From noel.butler at ausics.net Tue Apr 16 10:29:53 2013 From: noel.butler at ausics.net (Noel Butler) Date: Tue, 16 Apr 2013 17:29:53 +1000 Subject: [Dovecot] Probs authenticating to Dovecot In-Reply-To: References: <1A8A6A01-32F0-4F4F-AA10-3F539531A159@icloud.com> <1366092987.9241.20.camel@tardis> Message-ID: <1366097393.9241.45.camel@tardis> On Mon, 2013-04-15 at 23:38 -0700, Kris Magnusson wrote: > I will blow this VM away and start from scratch. Unless anyone has any concrete suggestions I can implement before then that I can use to salvage a day's worth of work. > If it comes down to it, I just asked on IRC for you if anyone knows a good howto for ubuntu, someone replied to look for the ISP setup guide by Chris Haas, said it was for debian so should work. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From jg at softjury.de Tue Apr 16 10:39:23 2013 From: jg at softjury.de (Jan Phillip Greimann) Date: Tue, 16 Apr 2013 09:39:23 +0200 Subject: [Dovecot] [OT] xi.rename-it.nl dovecot-2.2 stable-auto Message-ID: <516D002B.5040809@softjury.de> Hi there, I check my mail-server for debian package-upgrades with Nagios, so everyday I got a mail for 8 "new" dovecot-packages on this server. I think that wasn't so in 2.1 stable-auto, but I'm not sure about that. Maybe someone who uses the 2.1 stable-auto repo could response to this? But 2.2 released only few days ago, maybe the repo-admin hadn't time to change this, or my memory about this is wrong. best regards, Jan From kris.magnusson at icloud.com Tue Apr 16 10:43:33 2013 From: kris.magnusson at icloud.com (Kris Magnusson) Date: Tue, 16 Apr 2013 00:43:33 -0700 Subject: [Dovecot] Probs authenticating to Dovecot In-Reply-To: <1366097393.9241.45.camel@tardis> References: <1A8A6A01-32F0-4F4F-AA10-3F539531A159@icloud.com> <1366092987.9241.20.camel@tardis> <1366097393.9241.45.camel@tardis> Message-ID: <080DA301-13DD-4893-9358-74D45E3CB5C5@icloud.com> Thanks much. I prefer Debian for server work anyway. Best, Kris On Apr 16, 2013, at 12:29 AM, Noel Butler wrote: > On Mon, 2013-04-15 at 23:38 -0700, Kris Magnusson wrote: > > >> I will blow this VM away and start from scratch. Unless anyone has any concrete suggestions I can implement before then that I can use to salvage a day's worth of work. >> > > > If it comes down to it, I just asked on IRC for you if anyone knows a > good howto for ubuntu, someone replied to look for the ISP setup guide > by Chris Haas, said it was for debian so should work. > From marek.skubela at dignum.de Tue Apr 16 11:10:18 2013 From: marek.skubela at dignum.de (Marek Skubela) Date: Tue, 16 Apr 2013 10:10:18 +0200 Subject: [Dovecot] LDAP attribute as shared mailbox name Message-ID: <516D076A.9080003@dignum.de> Hello, Is it possible to use LDAP attribute (cn in my case) instead of e-mail address as a shared folder name, so users would see something like: Shared > ExampleCompany Service and not the default Shared > service at example.com? -- Regards, Marek Skubela From cryptodan at gmail.com Tue Apr 16 11:10:05 2013 From: cryptodan at gmail.com (Daniel Reinhardt) Date: Tue, 16 Apr 2013 04:10:05 -0400 Subject: [Dovecot] Probs authenticating to Dovecot In-Reply-To: <080DA301-13DD-4893-9358-74D45E3CB5C5@icloud.com> References: <1A8A6A01-32F0-4F4F-AA10-3F539531A159@icloud.com> <1366092987.9241.20.camel@tardis> <1366097393.9241.45.camel@tardis> <080DA301-13DD-4893-9358-74D45E3CB5C5@icloud.com> Message-ID: What was the output of the telnet localhost 110? Did it present any error messages? On Tue, Apr 16, 2013 at 3:43 AM, Kris Magnusson wrote: > Thanks much. I prefer Debian for server work anyway. > > Best, Kris > > On Apr 16, 2013, at 12:29 AM, Noel Butler wrote: > > > On Mon, 2013-04-15 at 23:38 -0700, Kris Magnusson wrote: > > > > > >> I will blow this VM away and start from scratch. Unless anyone has any > concrete suggestions I can implement before then that I can use to salvage > a day's worth of work. > >> > > > > > > If it comes down to it, I just asked on IRC for you if anyone knows a > > good howto for ubuntu, someone replied to look for the ISP setup guide > > by Chris Haas, said it was for debian so should work. > > > > -- Daniel Reinhardt cryptodan at cryptodan.net http://www.cryptodan.net 301-875-7018(c) 410-455-0488(h) From kris.magnusson at icloud.com Tue Apr 16 11:12:58 2013 From: kris.magnusson at icloud.com (Kris Magnusson) Date: Tue, 16 Apr 2013 01:12:58 -0700 Subject: [Dovecot] Probs authenticating to Dovecot In-Reply-To: References: <1A8A6A01-32F0-4F4F-AA10-3F539531A159@icloud.com> <1366092987.9241.20.camel@tardis> <1366097393.9241.45.camel@tardis> <080DA301-13DD-4893-9358-74D45E3CB5C5@icloud.com> Message-ID: <352B5163-C6EC-44BF-9161-797073DDD5B6@icloud.com> root at mail:/etc/dovecot# telnet mail 110 Trying 50.196.172.zzz... telnet: Unable to connect to remote host: Connection timed out On Apr 16, 2013, at 1:10 AM, Daniel Reinhardt wrote: > What was the output of the telnet localhost 110? > > Did it present any error messages? > > > On Tue, Apr 16, 2013 at 3:43 AM, Kris Magnusson > wrote: > >> Thanks much. I prefer Debian for server work anyway. >> >> Best, Kris >> >> On Apr 16, 2013, at 12:29 AM, Noel Butler wrote: >> >>> On Mon, 2013-04-15 at 23:38 -0700, Kris Magnusson wrote: >>> >>> >>>> I will blow this VM away and start from scratch. Unless anyone has any >> concrete suggestions I can implement before then that I can use to salvage >> a day's worth of work. >>>> >>> >>> >>> If it comes down to it, I just asked on IRC for you if anyone knows a >>> good howto for ubuntu, someone replied to look for the ISP setup guide >>> by Chris Haas, said it was for debian so should work. >>> >> >> > > > -- > Daniel Reinhardt > cryptodan at cryptodan.net > http://www.cryptodan.net > 301-875-7018(c) > 410-455-0488(h) From cryptodan at gmail.com Tue Apr 16 11:16:57 2013 From: cryptodan at gmail.com (Daniel Reinhardt) Date: Tue, 16 Apr 2013 04:16:57 -0400 Subject: [Dovecot] Probs authenticating to Dovecot In-Reply-To: <352B5163-C6EC-44BF-9161-797073DDD5B6@icloud.com> References: <1A8A6A01-32F0-4F4F-AA10-3F539531A159@icloud.com> <1366092987.9241.20.camel@tardis> <1366097393.9241.45.camel@tardis> <080DA301-13DD-4893-9358-74D45E3CB5C5@icloud.com> <352B5163-C6EC-44BF-9161-797073DDD5B6@icloud.com> Message-ID: It would appear that port 110 is not opened on your firewall, and is that IP address one that is assigned to your External WAN interface on your Comcast connection? The VM should have a Privately assigned IP address as given by the VM Software. On Tue, Apr 16, 2013 at 4:12 AM, Kris Magnusson wrote: > root at mail:/etc/dovecot# telnet mail 110 > Trying 50.196.172.zzz... > telnet: Unable to connect to remote host: Connection timed out > > On Apr 16, 2013, at 1:10 AM, Daniel Reinhardt wrote: > > > What was the output of the telnet localhost 110? > > > > Did it present any error messages? > > > > > > On Tue, Apr 16, 2013 at 3:43 AM, Kris Magnusson > > wrote: > > > >> Thanks much. I prefer Debian for server work anyway. > >> > >> Best, Kris > >> > >> On Apr 16, 2013, at 12:29 AM, Noel Butler > wrote: > >> > >>> On Mon, 2013-04-15 at 23:38 -0700, Kris Magnusson wrote: > >>> > >>> > >>>> I will blow this VM away and start from scratch. Unless anyone has any > >> concrete suggestions I can implement before then that I can use to > salvage > >> a day's worth of work. > >>>> > >>> > >>> > >>> If it comes down to it, I just asked on IRC for you if anyone knows a > >>> good howto for ubuntu, someone replied to look for the ISP setup guide > >>> by Chris Haas, said it was for debian so should work. > >>> > >> > >> > > > > > > -- > > Daniel Reinhardt > > cryptodan at cryptodan.net > > http://www.cryptodan.net > > 301-875-7018(c) > > 410-455-0488(h) > > -- Daniel Reinhardt cryptodan at cryptodan.net http://www.cryptodan.net 301-875-7018(c) 410-455-0488(h) From professa at dementianati.com Tue Apr 16 11:26:34 2013 From: professa at dementianati.com (Professa Dementia) Date: Tue, 16 Apr 2013 01:26:34 -0700 Subject: [Dovecot] Probs authenticating to Dovecot In-Reply-To: <1A8A6A01-32F0-4F4F-AA10-3F539531A159@icloud.com> References: <1A8A6A01-32F0-4F4F-AA10-3F539531A159@icloud.com> Message-ID: <516D0B3A.4060107@dementianati.com> Turn on the following directives: auth_verbose = yes auth_debug_passwords = yes Restart, then reconnect with your mail client. You should have much better logging to determine the source of the problem. Dem From hummel at pasteur.fr Tue Apr 16 13:38:33 2013 From: hummel at pasteur.fr (Thomas Hummel) Date: Tue, 16 Apr 2013 12:38:33 +0200 Subject: [Dovecot] Maildirs location migration In-Reply-To: References: <20130403154220.GA25793@parmesan.sis.pasteur.fr> <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> <20130410162847.GB7798@parmesan.sis.pasteur.fr> <20130410165915.GD7798@parmesan.sis.pasteur.fr> <1365618100.11047.180.camel@innu> <20130411100721.GB9527@parmesan.sis.pasteur.fr> Message-ID: <20130416103832.GG17909@parmesan.sis.pasteur.fr> On Thu, Apr 11, 2013 at 01:09:18PM +0300, Timo Sirainen wrote: > > the user may see an incorrect state for a small amount of time, doesn't he > > ? > [...] > For a small amount of time, yes. [...] > Which is probably a few seconds, so I don't see this as much of a problem. Well, isn't, as with rsync, the travel time through the filesystem (to find out what's to be sync'ed) incompressible, in which case it would take more than a few seconds on a large mailbox (I'm testing but in more complex conditions) ? Is dsync, for that matter, fastest than rsync (maybe because using dovecot-uidlist or similar) ? Besides, how about client side indexing while in this incoherent, not yet fully sync'ed state ? Wouldn't there be corruption risk ? Thanks. -- Thomas Hummel | Institut Pasteur | Groupe Exploitation et Infrastructure From tss at iki.fi Tue Apr 16 14:00:38 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 16 Apr 2013 14:00:38 +0300 Subject: [Dovecot] Maildirs location migration In-Reply-To: <20130416103832.GG17909@parmesan.sis.pasteur.fr> References: <20130403154220.GA25793@parmesan.sis.pasteur.fr> <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> <20130410162847.GB7798@parmesan.sis.pasteur.fr> <20130410165915.GD7798@parmesan.sis.pasteur.fr> <1365618100.11047.180.camel@innu> <20130411100721.GB9527@parmesan.sis.pasteur.fr> <20130416103832.GG17909@parmesan.sis.pasteur.fr> Message-ID: <1366110038.11047.290.camel@innu> On Tue, 2013-04-16 at 12:38 +0200, Thomas Hummel wrote: > On Thu, Apr 11, 2013 at 01:09:18PM +0300, Timo Sirainen wrote: > > > > the user may see an incorrect state for a small amount of time, doesn't he > > > ? > > > [...] > > For a small amount of time, yes. > > [...] > > Which is probably a few seconds, so I don't see this as much of a problem. > > Well, isn't, as with rsync, the travel time through the filesystem (to find out > what's to be sync'ed) incompressible, in which case it would take more than a > few seconds on a large mailbox (I'm testing but in more complex conditions) ? > > Is dsync, for that matter, fastest than rsync (maybe because using > dovecot-uidlist or similar) ? dsync doesn't scan through filesystem. It reads the changes from the index files. If there are no changes it's pretty much instant even with 1M mail mailbox. With changes it's still fast enough (and could be faster still by using incremental syncing with saved state via -s parameter). > Besides, how about client side indexing while in this incoherent, not yet fully > sync'ed state ? Wouldn't there be corruption risk ? The worst that can happen is: 1) Client sees new mail 123 in old server 2) Client sees only mails up to 122 in the new server 3) Client again will see mail 123 after a while I'm actually not sure how clients will handle that. It is an IMAP protocol violation. It would be possible to add a new flag to dsync where it would treat all new emails as conflicts and give them new UIDs, so in the above case it wouldn't save a mail 123 but 124. From christian.wiese at securepoint.de Tue Apr 16 16:12:55 2013 From: christian.wiese at securepoint.de (Christian Wiese) Date: Tue, 16 Apr 2013 15:12:55 +0200 Subject: [Dovecot] Dovecot 2.2 multiple master user passdb's not working anymore Message-ID: <20130416151255.24069cab@cw-desktop> Hi, after an update from dovecot 2.1.16 to 2.2.0 I encountered a problem when using multiple master user passdb's like the following: ----%<--------------------------------------------------------- passdb { args = /etc/dovecot/passwd.foo-master driver = passwd-file master = yes } passdb { args = /etc/dovecot/passwd.bar-master driver = passwd-file master = yes } ----%<--------------------------------------------------------- The former behavior that the passdb's are searched sequentially to find the given master user doesn't seem to work anymore. Only the first passdb is searched, and thus authentication will fail for all master users which are not defined in the first passdb. Because I cannot find any hint that the master user handling has changed fundamentally it looks like a bug, but maybe I missed configuration related changes from 2.1 to 2.2 that is causing this new behavior. Cheers, Chris From tss at iki.fi Tue Apr 16 16:20:50 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 16 Apr 2013 16:20:50 +0300 Subject: [Dovecot] Dovecot 2.2 multiple master user passdb's not working anymore In-Reply-To: <20130416151255.24069cab@cw-desktop> References: <20130416151255.24069cab@cw-desktop> Message-ID: On 16.4.2013, at 16.12, Christian Wiese wrote: > after an update from dovecot 2.1.16 to 2.2.0 I encountered a problem > when using multiple master user passdb's like the following: Fixed: http://hg.dovecot.org/dovecot-2.2/rev/854469baa57c From christian.wiese at securepoint.de Tue Apr 16 16:56:14 2013 From: christian.wiese at securepoint.de (Christian Wiese) Date: Tue, 16 Apr 2013 15:56:14 +0200 Subject: [Dovecot] Dovecot 2.2 multiple master user passdb's not working anymore In-Reply-To: References: <20130416151255.24069cab@cw-desktop> Message-ID: <20130416155614.54f31b31@cw-desktop> Hi Timo, > > after an update from dovecot 2.1.16 to 2.2.0 I encountered a problem > > when using multiple master user passdb's like the following: > > Fixed: http://hg.dovecot.org/dovecot-2.2/rev/854469baa57c > Thanks a lot for the quick fix! It's working again! :) Cheers, Chris From dafan.zhai at securepoint.de Tue Apr 16 17:04:42 2013 From: dafan.zhai at securepoint.de (Dafan Zhai) Date: Tue, 16 Apr 2013 16:04:42 +0200 Subject: [Dovecot] [PATCH] mailbox_get_metadata() for mailboxes with open transactions. Message-ID: <516D5A7A.1060804@securepoint.de> Hi everyone, I am writing a dovecot statistic plugin, which calls mailbox_get_metadata() to get the virtual size of the mailbox, if a mail is copied. I have noticed that mailbox_get_metadata() calls mailbox_sync(), and mailbox_sync() will fail for the mailboxes with open transactions. But if a mail is copied, there must be at least one transaction opened for the mailbox. So I can not get the virtual size. Commit [1] has fixed the same problem in mailbox_get_status(). I think the same should also be done in mailbox_get_metadata(). See the patch below. Dovecot version: 2.2.0 OS: OS: Linux 3.4.39-dist i686 maildir:~/Maildir:LAYOUT=fs:INBOX=~/Maildir/INBOX Dafan [1] http://hg.dovecot.org/dovecot-2.2/rev/12136db6e31f # HG changeset patch # User Dafan Zhai # Date 1366118323 -7200 # Node ID 7f0c5122d863d303ef5e74bbf650c2bac89ac564 # Parent f33bacb03cc22e02ca2d11d527d8dc0d99214486 lib-storage: mailbox_get_metadata() no longer forces mailbox to be synced. This fixes getting virtual size through mailbox_get_metadata() of mailboxes with open transactions. diff -r f33bacb03cc2 -r 7f0c5122d863 src/lib-storage/index/index-status.c --- a/src/lib-storage/index/index-status.c Tue Apr 16 15:54:05 2013 +0300 +++ b/src/lib-storage/index/index-status.c Tue Apr 16 15:18:43 2013 +0200 @@ -371,10 +371,10 @@ if (!box->opened) { if (mailbox_open(box) < 0) return -1; - } - if (!box->synced && (items & MAILBOX_METADATA_SYNC_ITEMS) != 0) { - if (mailbox_sync(box, MAILBOX_SYNC_FLAG_FAST) < 0) - return -1; + if ((items & MAILBOX_METADATA_SYNC_ITEMS) != 0) { + if (mailbox_sync(box, MAILBOX_SYNC_FLAG_FAST) < 0) + return -1; + } } if ((items & MAILBOX_METADATA_VIRTUAL_SIZE) != 0) { From tss at iki.fi Tue Apr 16 17:14:55 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 16 Apr 2013 17:14:55 +0300 Subject: [Dovecot] [PATCH] mailbox_get_metadata() for mailboxes with open transactions. In-Reply-To: <516D5A7A.1060804@securepoint.de> References: <516D5A7A.1060804@securepoint.de> Message-ID: On 16.4.2013, at 17.04, Dafan Zhai wrote: > I am writing a dovecot statistic plugin, which calls mailbox_get_metadata() to get the virtual size of the mailbox, if a mail is copied. I have noticed that mailbox_get_metadata() calls mailbox_sync(), and mailbox_sync() will fail for the mailboxes with open transactions. But if a mail is copied, there must be at least one transaction opened for the mailbox. So I can not get the virtual size. If you hook into mailbox_copy() you'll be calling it for each mail separately that is copied within the same command. Also you're calling it even if the copy fails later (e.g. IMAP COPY gets aborted if some messages are missing). So you should delay calling it until after transaction commit (set your own flag to the transaction that messages were copied). Maybe even until the next sync is called. > Commit [1] has fixed the same problem in mailbox_get_status(). I think the same should also be done in mailbox_get_metadata(). See the patch below. Too much of a chance of breaking some code that relies on the current behavior. From tss at iki.fi Tue Apr 16 17:21:00 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 16 Apr 2013 17:21:00 +0300 Subject: [Dovecot] LDAP attribute as shared mailbox name In-Reply-To: <516D076A.9080003@dignum.de> References: <516D076A.9080003@dignum.de> Message-ID: <9D9B6D85-5255-462B-B054-BE2653931EC6@iki.fi> On 16.4.2013, at 11.10, Marek Skubela wrote: > Is it possible to use LDAP attribute (cn in my case) instead > of e-mail address as a shared folder name, so users would > see something like: Shared > ExampleCompany Service > and not the default Shared > service at example.com? Only if you change all of the usernames to look like that instead of email addresses (this translation could be done by passdb/userdb after user login). If there are only a few such accounts, maybe you should be using public namespaces instead. From hummel at pasteur.fr Tue Apr 16 17:35:25 2013 From: hummel at pasteur.fr (Thomas Hummel) Date: Tue, 16 Apr 2013 16:35:25 +0200 Subject: [Dovecot] Maildirs location migration In-Reply-To: <1366110038.11047.290.camel@innu> References: <20130403154220.GA25793@parmesan.sis.pasteur.fr> <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> <20130410162847.GB7798@parmesan.sis.pasteur.fr> <20130410165915.GD7798@parmesan.sis.pasteur.fr> <1365618100.11047.180.camel@innu> <20130411100721.GB9527@parmesan.sis.pasteur.fr> <20130416103832.GG17909@parmesan.sis.pasteur.fr> <1366110038.11047.290.camel@innu> Message-ID: <20130416143525.GJ17909@parmesan.sis.pasteur.fr> On Tue, Apr 16, 2013 at 02:00:38PM +0300, Timo Sirainen wrote: > dsync doesn't scan through filesystem. It reads the changes from the > index files. If there are no changes it's pretty much instant even with > 1M mail mailbox. With changes it's still fast enough (and could be > faster still by using incremental syncing with saved state via -s > parameter). Ok. Actually, I had benched an initial dsync (i.e. no mail in destination) with a parallelized rsync of precalculated (by an home made tool) chunks of files of the maildir. For a ~3.3G Maildir, dsync took ~1 hour vs 10 min with 4 rsync at a time. This of course is a very unfair comparison to dsync since I was using a cluster to parallelise rsyncs. But as you said, dsync could be wiser, so I was thinking of using parallel rsync to make the initial mirror and then use dsync instead of rsync in the final step described in the dsync wiki. I'm still not sure if I should forbid dovecot auth temporary (using auth-deny for instance) or try the seemless way. > > Besides, how about client side indexing while in this incoherent, not yet fully > > sync'ed state ? Wouldn't there be corruption risk ? > > The worst that can happen is: > > 1) Client sees new mail 123 in old server > 2) Client sees only mails up to 122 in the new server > 3) Client again will see mail 123 after a while > > I'm actually not sure how clients will handle that. It is an IMAP > protocol violation. It would be possible to add a new flag to dsync > where it would treat all new emails as conflicts and give them new UIDs, > so in the above case it wouldn't save a mail 123 but 124. I see. But there are other cases : for instance, the user deletes a mail foobar in the new server because he reconnects after the kick. I guess dsync would merge the change and would not sync the foobar message from the old server in the final step. But what if another , new, mail foobaz is delivered : would'it get the nextuid which was the uid of the deleted foobar mail, thus confusing the client local indexes ? Thanks -- Thomas Hummel | Institut Pasteur | Groupe Exploitation et Infrastructure From tss at iki.fi Tue Apr 16 17:51:21 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 16 Apr 2013 17:51:21 +0300 Subject: [Dovecot] Maildirs location migration In-Reply-To: <20130416143525.GJ17909@parmesan.sis.pasteur.fr> References: <20130403154220.GA25793@parmesan.sis.pasteur.fr> <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> <20130410162847.GB7798@parmesan.sis.pasteur.fr> <20130410165915.GD7798@parmesan.sis.pasteur.fr> <1365618100.11047.180.camel@innu> <20130411100721.GB9527@parmesan.sis.pasteur.fr> <20130416103832.GG17909@parmesan.sis.pasteur.fr> <1366110038.11047.290.camel@innu> <20130416143525.GJ17909@parmesan.sis.pasteur.fr> Message-ID: <7C2CEFCE-A7E4-4C60-8157-FFA55846708B@iki.fi> On 16.4.2013, at 17.35, Thomas Hummel wrote: >>> Besides, how about client side indexing while in this incoherent, not yet fully >>> sync'ed state ? Wouldn't there be corruption risk ? >> >> The worst that can happen is: >> >> 1) Client sees new mail 123 in old server >> 2) Client sees only mails up to 122 in the new server >> 3) Client again will see mail 123 after a while >> >> I'm actually not sure how clients will handle that. It is an IMAP >> protocol violation. It would be possible to add a new flag to dsync >> where it would treat all new emails as conflicts and give them new UIDs, >> so in the above case it wouldn't save a mail 123 but 124. > > I see. But there are other cases : > > for instance, the user deletes a mail foobar in the new server because he reconnects > after the kick. I guess dsync would merge the change and would not sync the > foobar message from the old server in the final step. But what if another , new, mail foobaz is > delivered : would'it get the nextuid which was the uid of the deleted foobar mail, > thus confusing the client local indexes ? dsync in general resolves UID conflicts. If there's any chance that an IMAP client could have seen two different messages with the same UID, both of the messages get assigned new UIDs. That's why I was wondering only about the case that I mentioned. There the client couldn't have seen two different messages, but it's possible that some client could hide the mail 123 because it thought it got lost. From rauchwolke at gmx.net Tue Apr 16 17:55:29 2013 From: rauchwolke at gmx.net (rauchwolke at gmx.net) Date: Tue, 16 Apr 2013 16:55:29 +0200 Subject: [Dovecot] Dovecot 2.2.0 compile error Message-ID: <20130416145527.E9B271AE884E@dovecot.org> Hi, i tried to compile dovecot 2.2.0 and i end up with this error: make[6]: Entering directory `/mnt/data/Develop/Openwrt/trunk_git/build_dir/target-mips_r2_uClibc-0.9.33.2/dovecot-2.2.0/src/util' /bin/sh ../../libtool --tag=CC --mode=link mips-openwrt-linux-uclibc-gcc -std=gnu99 -Os -pipe -mips32r2 -mtune=mips32r2 -fno-caller-saves -mno-branch-likely -fhonour-copts -Wno-error=unused-but-set-variable -msoft-float -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/include -no-undefined -Wl,--as-needed -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/lib -o gdbhelper gdbhelper.o ../../src/lib-dovecot/libdovecot.la -export-dynamic -ldl OpenWrt-libtool: link: mips-openwrt-linux-uclibc-gcc -std=gnu99 -Os -pipe -mips32r2 -mtune=mips32r2 -fno-caller-saves -mno-branch-likely -fhonour-copts -Wno-error=unused-but-set-variable -msoft-float -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/include -Wl,--as-needed -o .libs/gdbhelper gdbhelper.o -Wl,--export-dynamic -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/lib ../../src/lib-dovecot/.libs/libdovecot.so -ldl -Wl,-rpath -Wl,/usr/lib/dovecot ../../src/lib-dovecot/.libs/libdovecot.so:(.got+0x0): multiple definition of `_GLOBAL_OFFSET_TABLE_' collect2: ld returned 1 exit status make[6]: *** [gdbhelper] Error 1 make[6]: Leaving directory `/mnt/data/Develop/Openwrt/trunk_git/build_dir/target-mips_r2_uClibc-0.9.33.2/dovecot-2.2.0/src/util' Making all in doveadm make[6]: Entering directory `/mnt/data/Develop/Openwrt/trunk_git/build_dir/target-mips_r2_uClibc-0.9.33.2/dovecot-2.2.0/src/doveadm' Making all in dsync make[7]: Entering directory `/mnt/data/Develop/Openwrt/trunk_git/build_dir/target-mips_r2_uClibc-0.9.33.2/dovecot-2.2.0/src/doveadm/dsync' make[7]: Nothing to be done for `all'. Version 2.1.16 compiled fine. How can i fix this linker error? With kind regards From hummel at pasteur.fr Tue Apr 16 18:03:22 2013 From: hummel at pasteur.fr (Thomas Hummel) Date: Tue, 16 Apr 2013 17:03:22 +0200 Subject: [Dovecot] Maildirs location migration In-Reply-To: <7C2CEFCE-A7E4-4C60-8157-FFA55846708B@iki.fi> References: <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> <20130410162847.GB7798@parmesan.sis.pasteur.fr> <20130410165915.GD7798@parmesan.sis.pasteur.fr> <1365618100.11047.180.camel@innu> <20130411100721.GB9527@parmesan.sis.pasteur.fr> <20130416103832.GG17909@parmesan.sis.pasteur.fr> <1366110038.11047.290.camel@innu> <20130416143525.GJ17909@parmesan.sis.pasteur.fr> <7C2CEFCE-A7E4-4C60-8157-FFA55846708B@iki.fi> Message-ID: <20130416150321.GL17909@parmesan.sis.pasteur.fr> On Tue, Apr 16, 2013 at 05:51:21PM +0300, Timo Sirainen wrote: > dsync in general resolves UID conflicts. If there's any chance that an IMAP client could have seen two different messages with the same UID, both of the messages get assigned new UIDs. I'm not sure I understand this correctly : let's say that : 1. in old, foobar as uid 100 2. initial dsync 3. user gets relocated, kicked and reconnects to new, then deletes foobar 4. final dsync. dsync somehow manages to understand it should not sync foobar from old to new 5. migration is over, new message foobaz comes in. Oh, I get it, you mean since uids gets only incremented, this new could not get uid 100 and then confuse the client index ? -- Thomas Hummel | Institut Pasteur | Groupe Exploitation et Infrastructure From tss at iki.fi Tue Apr 16 18:07:51 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 16 Apr 2013 18:07:51 +0300 Subject: [Dovecot] Dovecot 2.2.0 compile error In-Reply-To: <20130416145527.E9B271AE884E@dovecot.org> References: <20130416145527.E9B271AE884E@dovecot.org> Message-ID: <32B8F324-31DF-46A4-A42D-2105135D51B7@iki.fi> On 16.4.2013, at 17.55, rauchwolke at gmx.net wrote: > i tried to compile dovecot 2.2.0 and i end up with this error: > > make[6]: Entering directory `/mnt/data/Develop/Openwrt/trunk_git/build_dir/target-mips_r2_uClibc-0.9.33.2/dovecot-2.2.0/src/util' > /bin/sh ../../libtool --tag=CC --mode=link mips-openwrt-linux-uclibc-gcc -std=gnu99 -Os -pipe -mips32r2 -mtune=mips32r2 -fno-caller-saves -mno-branch-likely -fhonour-copts -Wno-error=unused-but-set-variable -msoft-float -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/include -no-undefined -Wl,--as-needed -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/lib -o gdbhelper gdbhelper.o So it's failing only at gdbhelper. Why there and not earlier?.. > ../../src/lib-dovecot/.libs/libdovecot.so:(.got+0x0): multiple definition of `_GLOBAL_OFFSET_TABLE_' Does it have it multiple times? nm src/lib-dovecot/.libs/libdovecot.so | grep _GLOBAL_OFFSET_TABLE_ > Version 2.1.16 compiled fine. How can i fix this linker error? No idea. From tss at iki.fi Tue Apr 16 18:11:02 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 16 Apr 2013 18:11:02 +0300 Subject: [Dovecot] Maildirs location migration In-Reply-To: <20130416150321.GL17909@parmesan.sis.pasteur.fr> References: <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> <20130410162847.GB7798@parmesan.sis.pasteur.fr> <20130410165915.GD7798@parmesan.sis.pasteur.fr> <1365618100.11047.180.camel@innu> <20130411100721.GB9527@parmesan.sis.pasteur.fr> <20130416103832.GG17909@parmesan.sis.pasteur.fr> <1366110038.11047.290.camel@innu> <20130416143525.GJ17909@parmesan.sis.pasteur.fr> <7C2CEFCE-A7E4-4C60-8157-FFA55846708B@iki.fi> <20130416150321.GL17909@parmesan.sis.pasteur.fr> Message-ID: <3081A940-793E-4A00-8054-C2FB57633F4B@iki.fi> On 16.4.2013, at 18.03, Thomas Hummel wrote: > On Tue, Apr 16, 2013 at 05:51:21PM +0300, Timo Sirainen wrote: > >> dsync in general resolves UID conflicts. If there's any chance that an IMAP client could have seen two different messages with the same UID, both of the messages get assigned new UIDs. > > I'm not sure I understand this correctly : > > let's say that : > > 1. in old, foobar as uid 100 > 2. initial dsync > 3. user gets relocated, kicked and reconnects to new, then deletes foobar > 4. final dsync. dsync somehow manages to understand it should not sync foobar from old to new Yes. It sees that uid 100 was deleted, and keeps nextuid=101. > 5. migration is over, new message foobaz comes in. Oh, I get it, you mean since > uids gets only incremented, this new could not get uid 100 and then confuse the > client index ? The new message gets uid 101, as according to nextuid value. A slightly more complex one would have been: 1. you have mails up to 100 2. dsync 3. old server gets new mail uid=101 4. old server deletes uid 101 5. new server gets new mail uid 101 5. dsync sees that there's a conflict (even though the old mail was already deleted), and gives the new server's new mail uid 102 From steve at earth.ox.ac.uk Tue Apr 16 18:25:53 2013 From: steve at earth.ox.ac.uk (Stephen Usher) Date: Tue, 16 Apr 2013 16:25:53 +0100 Subject: [Dovecot] Dovecot 2.1.16: Quota plugin compile fails: Solaris 10 Message-ID: <516D6D81.2050508@earth.ox.ac.uk> Dovecot 2.1.16 fails to compile giving the following error under Solaris 10. Previously I had no problem compiling 2.1.12. The start of the config.log file contains: It was created by Dovecot configure 2.1.16, which was generated by GNU Autoconf 2.68. Invocation command line was $ ./configure ## --------- ## ## Platform. ## ## --------- ## hostname = luna uname -m = i86pc uname -r = 5.10 uname -s = SunOS uname -v = Generic_148889-01 /usr/bin/uname -p = i386 /bin/uname -X = System = SunOS Node = luna Release = 5.10 KernelID = Generic_148889-01 Machine = i86pc BusType = Serial = Users = OEM# = 0 Origin# = 1 NumCPU = 4 /bin/arch = i86pc /usr/bin/arch -k = i86pc /usr/convex/getsysinfo = unknown /usr/bin/hostinfo = unknown /bin/machine = unknown /usr/bin/oslevel = unknown /bin/universe = unknown PATH: /usr/sfw/bin PATH: /usr/local/bin PATH: /usr/bin PATH: /usr/sbin PATH: /usr/ccs/bin PATH: /opt/SUNWspro/bin PATH: /usr/ucb GCC version info: Reading specs from /usr/sfw/lib/gcc/i386-pc-solaris2.10/3.4.3/specs Configured with: /builds/sfw10-gate/usr/src/cmd/gcc/gcc-3.4.3/configure --prefix=/usr/sfw --with-as=/usr/sfw/bin/gas --with-gnu-as --with-ld=/usr/ccs/bin/ld --without-gnu-ld --enable-languages=c,c++ --enable-shared Thread model: posix gcc version 3.4.3 (csl-sol210-3_4-branch+sol_rpath) Making all in quota gmake[4]: Entering directory `/usr/local/src/mail/dovecot/dovecot-2.1.16/src/plugins/quota' gcc -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-master -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -I../../../src/doveadm -I/usr/local/ssl/include -I/usr/sfw/include -I/usr/local/include -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -I/usr/local/ssl/include -MT quota-status.o -MD -MP -MF .deps/quota-status.Tpo -c -o quota-status.o quota-status.c quota-status.c: In function `main': quota-status.c:200: error: `optarg' undeclared (first use in this function) quota-status.c:200: error: (Each undeclared identifier is reported only once quota-status.c:200: error: for each function it appears in.) gmake[4]: *** [quota-status.o] Error 1 gmake[4]: Leaving directory `/usr/local/src/mail/dovecot/dovecot-2.1.16/src/plugins/quota' Steve -- --------------------------------------------------------------------------- IT Systems Administrator, E-Mail:- steve at earth.ox.ac.uk Department of Earth Sciences, Tel:- +44 (0)1865 282110 Oxford University, South Parks Road, Oxford, UK. Fax:- +44 (0)1865 272072 From steve at earth.ox.ac.uk Tue Apr 16 18:37:29 2013 From: steve at earth.ox.ac.uk (Stephen Usher) Date: Tue, 16 Apr 2013 16:37:29 +0100 Subject: [Dovecot] Dovecot 2.1.16: Quota plugin compile fails: Solaris 10 In-Reply-To: <516D6D81.2050508@earth.ox.ac.uk> References: <516D6D81.2050508@earth.ox.ac.uk> Message-ID: <516D7039.5010209@earth.ox.ac.uk> It seems that the following C standard header files need to be included in quota-status.c: #include #include #include Once these are added it compiles. Steve -- --------------------------------------------------------------------------- IT Systems Administrator, E-Mail:- steve at earth.ox.ac.uk Department of Earth Sciences, Tel:- +44 (0)1865 282110 Oxford University, South Parks Road, Oxford, UK. Fax:- +44 (0)1865 272072 From msmith at giganews.com Tue Apr 16 19:01:34 2013 From: msmith at giganews.com (Michael Smith) Date: Tue, 16 Apr 2013 16:01:34 +0000 Subject: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot In-Reply-To: <9E7F07ED-59CC-4D1E-9316-ABDF9389F28A@iki.fi> References: <62CA7D02-69DA-47C4-9CE7-4A8D9518670F@iki.fi> <2DAEBE3C-53D8-4858-8067-3398CCF3B4BF@iki.fi> <9E7F07ED-59CC-4D1E-9316-ABDF9389F28A@iki.fi> Message-ID: Timo, Just checking if you've had a chance to identify the problem. Yesterday I saw a patch for multipart messages. Was this related, or a separate issue? -- Michael Smith -----Original Message----- From: Timo Sirainen [mailto:tss at iki.fi] Sent: Friday, April 12, 2013 1:17 PM To: Michael Smith Cc: 'dovecot at dovecot.org' Subject: Re: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot Yes, I can reproduce it now. I'll try to get it fixed on Monday. On 12.4.2013, at 21.13, Michael Smith wrote: > Timo, > > Any luck reproducing the sync error with the updated/correct mbox file? > > -- > Michael Smith > > > -----Original Message----- > From: dovecot-bounces at dovecot.org [mailto:dovecot-bounces at dovecot.org] On Behalf Of Michael Smith > Sent: Wednesday, April 10, 2013 3:52 PM > To: 'Timo Sirainen' > Cc: 'dovecot at dovecot.org' > Subject: Re: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot > > It shouldn't. Part of the migration is to remove any existing dovecot mailbox for the user. It does this by deleting the entire user's directory. > > I just downloaded the file and checked. Oops, looks like I grabbed the post dsync mirror file. > > I've uploaded the correct file (pre dsync mirror). Downloaded it and confirmed I'm getting the following error on dsync mirror. > > dsync(webmail): Error: Sync failed for mbox file /var/opt/migrate/users/webmail/inbox: seq=4482 uid=4482 uid_broken=0 originally needed 10 bytes, now needs 12 bytes > > > -- > Michael Smith > > -----Original Message----- > From: Timo Sirainen [mailto:tss at iki.fi] > Sent: Tuesday, April 09, 2013 4:05 PM > To: Michael Smith > Cc: 'dovecot at dovecot.org' > Subject: Re: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot > > On 9.4.2013, at 1.41, Michael Smith wrote: > >> I tried importing the anonymized file, and there were no errors. So, it's something with the actual data. UTF-8 issues? >> >> While I can't send you a raw customer's mailbox, one of the failures is a 'role' account mailbox, with no critical/useful data in it. >> >> Here is a link (expires in 30 days) to download the mailbox, it's 107M. >> https://truck.it/p/HNlzl9hWbO >> >> The error I'm getting is >> dsync(webmail): Error: Sync failed for mbox file /var/opt/migrate/users/webmail/inbox: seq=4482 uid=4482 uid_broken=0 originally needed 10 bytes, now needs 12 bytes > > I can't reproduce with that file, dsync succeeds without errors. Maybe the problem requires something specific in the index files also? > > From list at airstreamcomm.net Tue Apr 16 19:30:33 2013 From: list at airstreamcomm.net (list at airstreamcomm.net) Date: Tue, 16 Apr 2013 11:30:33 -0500 Subject: [Dovecot] v2.2.0 released In-Reply-To: <11C42D8A-3EC2-4DA7-8DD8-94230284F8BE@iki.fi> References: <1365787987.11047.246.camel@innu> <516C22F0.6060600@airstreamcomm.net> <11C42D8A-3EC2-4DA7-8DD8-94230284F8BE@iki.fi> Message-ID: <516D7CA9.5060309@airstreamcomm.net> On 4/15/13 11:16 AM, Timo Sirainen wrote: > On 15.4.2013, at 18.55, list at airstreamcomm.net wrote: > >> Does the new obox plugin support any of the open source object storage systems such as openstack, glusterfs, or ceph? From your store site it does not appear so. > Glusterfs isn't really object storage (unless they've changed since I last looked at them), and it already more or less works with Dovecot using the existing mailbox formats. Except last I heard it still caused index file corruption. > > Openstack Swift support is coming. There's a half-working version of it already, would need just a day or two to finish it up. > > I haven't looked at Ceph closely yet, but it would be nice to support it as well. > > obox can also be used with a regular POSIX filesystem, although it loses the prefetching capabilities then. So it could be used with e.g. Glusterfs or NFS to provide an efficient local cache. I've also thought about trying out if prefetching could be done by creating new "diskio" processes with a ton of threads doing the actual disk I/O. > > Timo, Riak CS is S3 compatible. Just curious if you have tested with Riak CS (especially the multi-data center implementation). From tss at iki.fi Tue Apr 16 20:08:49 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 16 Apr 2013 20:08:49 +0300 Subject: [Dovecot] Sync errors trying to sync old mbox inboxes to dovecot In-Reply-To: References: <62CA7D02-69DA-47C4-9CE7-4A8D9518670F@iki.fi> <2DAEBE3C-53D8-4858-8067-3398CCF3B4BF@iki.fi> <9E7F07ED-59CC-4D1E-9316-ABDF9389F28A@iki.fi> Message-ID: <1366132129.11047.295.camel@innu> On Tue, 2013-04-16 at 16:01 +0000, Michael Smith wrote: > Just checking if you've had a chance to identify the problem. Yesterday I saw a patch for multipart messages. Was this related, or a separate issue? Here: http://hg.dovecot.org/dovecot-2.2/rev/c473f8d2540e From user+dovecot at localhost.localdomain.org Tue Apr 16 20:28:05 2013 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Tue, 16 Apr 2013 19:28:05 +0200 Subject: [Dovecot] imap Panic: file index-attachment.c: line 231 (index_attachment_save_finish): assertion failed: (attach->input->eof) In-Reply-To: <516C722A.3040206@localhost.localdomain.org> References: <516C10A5.10503@localhost.localdomain.org> <1366044659.11047.276.camel@innu> <1366044793.11047.277.camel@innu> <1366044907.11047.278.camel@innu> <516C722A.3040206@localhost.localdomain.org> Message-ID: <516D8A25.3080607@localhost.localdomain.org> On 04/15/2013 11:33 PM Pascal Volk wrote: > OK, applied that patch. Lets see what will happen. > Looks good. No crash in the last 20 hours. Regards, Pascal -- The trapper recommends today: cafefeed.1310619 at localdomain.org From lbinotto at sidor.com Tue Apr 16 20:32:35 2013 From: lbinotto at sidor.com (BINOTTO Luis SIDOR) Date: Tue, 16 Apr 2013 13:02:35 -0430 Subject: [Dovecot] Delete_to_Trash plugin and quota problem Message-ID: Hello list... I am new at dovecot and I have a problem with it; any help will be very grateful We have a exchange server with outlook at the client side, and we are migrating the exchange server to postfix/dovecot(1.2.15) solution. I enabled the "deleted-to-trash" plugin (v0.3) to move the messages to the Trash folder automatically when it is deleted. Also, I am using quota and quota_imap plugins to maintain the quota for users. The quota rule for Trash folder is unlimit. The problem is, when the client reach their maximum quota and try to delete a mail in the inbox to release space. The delete to trash plugin effectively copy it to the Trash folder, but the original mail still remain (marked for delete) at the inbox folder and the quota does not released. This is my Configuration: Dovecot -n # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.6 log_path: /var/log/dovecot.log protocols: imap imaps pop3 pop3s login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_uid: 16343 mail_gid: 16343 mail_location: maildir:mailboxes/mail mail_debug: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): autocreate deleted_to_trash quota imap_quota mail_plugins(imap): autocreate deleted_to_trash quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh lda: postmaster_address: sirbil at sidor.com mail_plugins: quota log_path: /var/log/dovecot.log auth default: mechanisms: gssapi gss-spnego login ntlm username_format: %Ln use_winbind: yes passdb: driver: pam userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: autocreate: Trash autosubscribe: Trash deleted_to_trash_folder: Trash quota: maildir:User quota quota_rule: *:storage=100M quota_rule2: Trash:storage=1G quota_warning: storage=80%% /etc/dovecot/scripts/quota-warning.sh 80 quota_warning2: storage=90%% /etc/dovecot/scripts/quota-warning.sh 90 quota_warning3: storage=96%% /etc/dovecot/scripts/quota-exceeded.sh 100 quota_exceeded_message: Ha exedido el tamano del buzon /etc/dovecot/dovecot-ldap.conf: ... user_attrs = postalCode=mail=maildir:/mailboxes/%$/,title=quota_rule=*:storage=%$M ... Am I doing something wrong? Thanking you in anticipation.... L. Binotto " Notificacion Automatica: Este mensaje y cualquier archivo que se adjunte contiene informacion privilegiada y confidencial. Es para uso exclusivo del destinatario. Si usted ha recibido esta comunicacion por error, por favor avisenos inmediatamente. Automatic notification: This e-mail and any file transmitted with it are confidential and may be legally privileged. It is intended solely for the addressee and may not be disclosed to or used by anyone other than the addressee. If you have received this e-mail by mistake , please advise the sender immediately" From rauchwolke at gmx.net Tue Apr 16 20:34:02 2013 From: rauchwolke at gmx.net (Peter Wagner) Date: Tue, 16 Apr 2013 19:34:02 +0200 Subject: [Dovecot] Dovecot 2.2.0 compile error In-Reply-To: <32B8F324-31DF-46A4-A42D-2105135D51B7@iki.fi> References: <20130416145527.E9B271AE884E@dovecot.org> <32B8F324-31DF-46A4-A42D-2105135D51B7@iki.fi> Message-ID: <20130416173401.3474B1AE87C0@dovecot.org> On Tue, 16 Apr 2013 18:07:51 +0300 Timo Sirainen wrote: > On 16.4.2013, at 17.55, rauchwolke at gmx.net wrote: > > > i tried to compile dovecot 2.2.0 and i end up with this error: > > > > make[6]: Entering directory `/mnt/data/Develop/Openwrt/trunk_git/build_dir/target-mips_r2_uClibc-0.9.33.2/dovecot-2.2.0/src/util' > > /bin/sh ../../libtool --tag=CC --mode=link mips-openwrt-linux-uclibc-gcc -std=gnu99 -Os -pipe -mips32r2 -mtune=mips32r2 -fno-caller-saves -mno-branch-likely -fhonour-copts -Wno-error=unused-but-set-variable -msoft-float -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/include -no-undefined -Wl,--as-needed -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/lib -o gdbhelper gdbhelper.o > > So it's failing only at gdbhelper. Why there and not earlier?.. I don't know. > > > ../../src/lib-dovecot/.libs/libdovecot.so:(.got+0x0): multiple definition of `_GLOBAL_OFFSET_TABLE_' > > Does it have it multiple times? No only once. i attached the last 1000 lines of the output. > > nm src/lib-dovecot/.libs/libdovecot.so | grep _GLOBAL_OFFSET_TABLE_ nm src/lib-dovecot/.libs/libdovecot.so | grep _GLOBAL_OFFSET_TABLE_ 000b4d00 A _GLOBAL_OFFSET_TABLE_ > > > Version 2.1.16 compiled fine. How can i fix this linker error? > > No idea. > -------------- next part -------------- A non-text attachment was scrubbed... Name: log.txz Type: application/x-xz-compressed-tar Size: 13520 bytes Desc: not available URL: From AxelLuttgens at swing.be Tue Apr 16 20:45:58 2013 From: AxelLuttgens at swing.be (Axel Luttgens) Date: Tue, 16 Apr 2013 19:45:58 +0200 Subject: [Dovecot] Small documentation error? Message-ID: <62246089-4510-45EE-8BDD-FEE4359975CC@swing.be> Hello, At http://wiki2.dovecot.org/MailboxFormat/mbox: The UID for a new message is calculated from "last used UID" in X-IMAP header + 1 Shouldn't it read "in X-UID header + 1" instead? Axel From AxelLuttgens at swing.be Tue Apr 16 20:47:02 2013 From: AxelLuttgens at swing.be (Axel Luttgens) Date: Tue, 16 Apr 2013 19:47:02 +0200 Subject: [Dovecot] Running LMTP as a user other than the root user Message-ID: <171F2418-4D48-48F3-BA87-FAE0DBAA9333@swing.be> Hello, With this one in Postfix' main.cf: virtual_transport = lmtp:unix:/_ROOT/var/run/dovecot/lmtp and Dovecot settings reproduced at the end of this message, there is no problem for having mail delivered into a user's INBOX. But as soon as I try the security improvement suggested in the docs: service lmtp { user = dovemailer } this is what I get in the logs: postfix/smtpd[52588]: connect from localhost[127.0.0.1] postfix/smtpd[52588]: E86B5BD2BA0: client=localhost[127.0.0.1] postfix/cleanup[52594]: E86B5BD2BA0: message-id=<20130416171203.E86B5BD2BA0 at ALMba.local> postfix/qmgr[88232]: E86B5BD2BA0: from=, size=315, nrcpt=1 (queue active) dovecot[52568]: lmtp(52596): Debug: none: root=, index=, control=, inbox=, alt= dovecot[52568]: lmtp(52596): Connect from local dovecot[52568]: lmtp(52596): Debug: Loading modules from directory: /_ROOT/dovecot-2.1.16-0.3.4/lib/dovecot dovecot[52568]: lmtp(52596): Debug: Module loaded: /_ROOT/dovecot-2.1.16-0.3.4/lib/dovecot/lib10_quota_plugin.so dovecot[52568]: auth: Error: userdb(test at example.com): client doesn't have lookup permissions for this user: userdb reply doesn't contain uid (to bypass this check, set: service auth { unix_listener /_ROOT/var/run/dovecot/auth-userdb { mode=0777 } }) dovecot[52568]: lmtp(52596): Error: user test at example.com: Auth USER lookup failed dovecot[52568]: lmtp(52596): Debug: auth input: postfix/lmtp[52595]: E86B5BD2BA0: to=, relay=ALMba.local[/_ROOT/var/run/dovecot/lmtp], delay=19, delays=19/0.02/0.17/0.06, dsn=4.3.0, status=deferred (host ALMba.local[/_ROOT/var/run/dovecot/lmtp] said: 451 4.3.0 Internal error occurred. Refer to server log for more information. (in reply to RCPT TO command)) dovecot[52568]: lmtp(52596): Disconnect from local: Client quit (in reset) postfix/smtpd[52588]: disconnect from localhost[127.0.0.1] and the message of course remains in Postfix' queue. I understand that the +x workaround suggested for the auth-userdb socket (so as to have 0777 permissions instead of 0666) relies on provisions made in Dovecot's code in order to relax some requirements. But I still need help for a correct interpretation... The socket receives 0666 permissions by default; any process should thus be able to read from/write to that socket. So, why set such a default, since it is anyway going to yield un-intuitive results? And, as far as the log messages are concerned: "client doesn't have lookup permissions...". Who's the client here? Still from the log: "client doesn't have lookup permissions for this user:". Which user? "userdb reply doesn't contain uid" The userdb query seems to have failed; but does it mean that is should explicitly return a uid? TIA, Axel $ doveconf -n # 2.1.16: /_ROOT/etc/dovecot/dovecot.conf # OS: Darwin 12.3.0 x86_64 auth_verbose = yes disable_plaintext_auth = no mail_debug = yes mail_gid = dovemailer mail_location = mbox:~/mboxes:INBOX=~/mboxes/inbox mail_uid = dovemailer managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl passdb { args = /_ROOT/etc/dovecot/db.conf driver = sql } plugin { quota = dirsize:User quota quota_rule = *:storage=1M } ssl = no userdb { driver = prefetch } userdb { args = /_ROOT/etc/dovecot/db.conf driver = sql } protocol lmtp { mail_plugins = quota } protocol pop3 { mail_plugins = quota pop3_uidl_format = %08Xv%08Xu } protocol imap { mail_plugins = quota } With above settings, the permissions on socket auth-userdb are: srw-rw-rw- 1 dovecot wheel 0 16 avr 16:05 auth-userdb and the full config for service lmtp is: $ doveconf service/lmtp service lmtp { chroot = client_limit = 1 drop_priv_before_exec = no executable = lmtp extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } From tss at iki.fi Tue Apr 16 22:01:44 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 16 Apr 2013 22:01:44 +0300 Subject: [Dovecot] Small documentation error? In-Reply-To: <62246089-4510-45EE-8BDD-FEE4359975CC@swing.be> References: <62246089-4510-45EE-8BDD-FEE4359975CC@swing.be> Message-ID: On 16.4.2013, at 20.45, Axel Luttgens wrote: > Hello, > > At http://wiki2.dovecot.org/MailboxFormat/mbox: > > The UID for a new message is calculated from "last used UID" in > X-IMAP header + 1 > > Shouldn't it read "in X-UID header + 1" instead? No. Either X-IMAP: or X-IMAPbase: header. From tss at iki.fi Tue Apr 16 22:04:03 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 16 Apr 2013 22:04:03 +0300 Subject: [Dovecot] v2.2.0 released In-Reply-To: <516D7CA9.5060309@airstreamcomm.net> References: <1365787987.11047.246.camel@innu> <516C22F0.6060600@airstreamcomm.net> <11C42D8A-3EC2-4DA7-8DD8-94230284F8BE@iki.fi> <516D7CA9.5060309@airstreamcomm.net> Message-ID: <919931C0-C1F9-43D3-9292-735B75C579AF@iki.fi> On 16.4.2013, at 19.30, list at airstreamcomm.net wrote: > On 4/15/13 11:16 AM, Timo Sirainen wrote: >> On 15.4.2013, at 18.55, list at airstreamcomm.net wrote: >> >>> Does the new obox plugin support any of the open source object storage systems such as openstack, glusterfs, or ceph? From your store site it does not appear so. >> Glusterfs isn't really object storage (unless they've changed since I last looked at them), and it already more or less works with Dovecot using the existing mailbox formats. Except last I heard it still caused index file corruption. >> >> Openstack Swift support is coming. There's a half-working version of it already, would need just a day or two to finish it up. >> >> I haven't looked at Ceph closely yet, but it would be nice to support it as well. >> >> obox can also be used with a regular POSIX filesystem, although it loses the prefetching capabilities then. So it could be used with e.g. Glusterfs or NFS to provide an efficient local cache. I've also thought about trying out if prefetching could be done by creating new "diskio" processes with a ton of threads doing the actual disk I/O. >> >> > > Timo, Riak CS is S3 compatible. Just curious if you have tested with Riak CS (especially the multi-data center implementation). I've only tested it against Amazon S3. But if it's fully API compatible, I don't see why it wouldn't work.. From tss at iki.fi Tue Apr 16 23:42:43 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 16 Apr 2013 23:42:43 +0300 Subject: [Dovecot] v2.2.0 released In-Reply-To: <11C42D8A-3EC2-4DA7-8DD8-94230284F8BE@iki.fi> References: <1365787987.11047.246.camel@innu> <516C22F0.6060600@airstreamcomm.net> <11C42D8A-3EC2-4DA7-8DD8-94230284F8BE@iki.fi> Message-ID: <0AC3CDEA-6252-4371-BD70-613F03D3C6D5@iki.fi> On 15.4.2013, at 19.16, Timo Sirainen wrote: > On 15.4.2013, at 18.55, list at airstreamcomm.net wrote: > >> Does the new obox plugin support any of the open source object storage systems such as openstack, glusterfs, or ceph? From your store site it does not appear so. > > Openstack Swift support is coming. There's a half-working version of it already, would need just a day or two to finish it up. BTW. This is also done now, although not heavily tested yet. From daniel.parthey at informatik.tu-chemnitz.de Wed Apr 17 00:03:10 2013 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Tue, 16 Apr 2013 23:03:10 +0200 Subject: [Dovecot] dovecot index errors since 2.1.12 [SOLVED with 2.1.16] In-Reply-To: References: <50D0E224.2050508@imt-systems.com> <20130114151644.GA31122@daniel.localdomain> Message-ID: <20130416210310.GA8842@daniel.localdomain> Timo Sirainen wrote: > On 14.1.2013, at 17.16, Daniel Parthey wrote: > > > Last week we upgraded to 2.1.13 and since then we encountered the same issues as > > Morten Stevens. We got a lot of error messages with corrupt index cache > > and FETCH errors: So we had to roll back to dovecot 2.1.10. Now the errors are gone. > > > > Jan 12 16:48:35 10.129.3.233 dovecot: mailbox: mail: imap(user1 at example.org): : Error: Cached message size larger than expected (5194 > 4399) > > Does reverting this change also fix it for you? http://hg.dovecot.org/dovecot-2.1/rev/6c1b4b9f527c Yes, I can confirm 2.1.16 to be running smoothly without any cache issues. Thanks, Timo! > I guess you're using only LMTP to deliver mails? Yes, LMTP director proxy only. > How many CPU cores do you have? 2 CPU cores on each of the 4 machines. Regards Daniel -- https://plus.google.com/103021802792276734820 From AxelLuttgens at swing.be Wed Apr 17 00:03:22 2013 From: AxelLuttgens at swing.be (Axel Luttgens) Date: Tue, 16 Apr 2013 23:03:22 +0200 Subject: [Dovecot] Small documentation error? In-Reply-To: References: <62246089-4510-45EE-8BDD-FEE4359975CC@swing.be> Message-ID: <93DBA188-7788-46BC-9201-E698ADFA42EB@swing.be> Le 16 avr. 2013 ? 21:01, Timo Sirainen a ?crit : > On 16.4.2013, at 20.45, Axel Luttgens wrote: > >> Hello, >> >> At http://wiki2.dovecot.org/MailboxFormat/mbox: >> >> The UID for a new message is calculated from "last used UID" in >> X-IMAP header + 1 >> >> Shouldn't it read "in X-UID header + 1" instead? > > No. Either X-IMAP: or X-IMAPbase: header. Hello Timo, Yes, sorry for the noise... Thanks, Axel From daniel.parthey at informatik.tu-chemnitz.de Wed Apr 17 00:35:19 2013 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Tue, 16 Apr 2013 23:35:19 +0200 Subject: [Dovecot] Dovecot 2.1.16: Mail server input error: UPDATE-SESSION pop3: stats shrank In-Reply-To: <20130113081050.GB21652@daniel.localdomain> References: <2089EEB4-E249-4D1F-8064-DFE1F9641957@iki.fi> <20121127214749.GA11546@daniel.localdomain> <20130113081050.GB21652@daniel.localdomain> Message-ID: <20130416213519.GA8948@daniel.localdomain> Daniel Parthey wrote: > Timo Sirainen wrote: > > On 27.11.2012, at 23.47, Daniel Parthey wrote: > > > Can you fix these strange stats plugin errors please? > > > These are the only errors regularly occurring in our 2.1.10 logs: > > > > > > Nov 27 08:06:54 10.129.3.249 dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mlpath 429 < 622 > > > Nov 27 08:07:06 10.129.3.249 dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mlpath 436 < 622 > > > > It's strange that I can't figure out how to reproduce this no matter what I do. Could you with latest hg, especially: > > http://hg.dovecot.org/dovecot-2.1/rev/c81f1ca3cda6 > > and also the attached patch, which simplifies the stats plugin? > > Yes, version 2.1.13 plus the simplification patch fixes the problem. > Please apply :) Version 2.1.16 logs the following error: Apr 16 18:07:58 10.129.3.249 dovecot: stats: Error: Mail server input error: UPDATE-SESSION user1 at example.org pop3: stats shrank: mlpath 1 < 2 Apr 16 18:46:44 10.129.3.233 dovecot: stats: Error: Mail server input error: UPDATE-SESSION user2 at example.org pop3: stats shrank: mlpath 3 < 4 Were there any reasons NOT to apply stats.diff the 2.1.x branch or did you simply overlook my mail? Regards Daniel -- https://plus.google.com/103021802792276734820 -------------- next part -------------- A non-text attachment was scrubbed... Name: stats.diff Type: text/x-diff Size: 2959 bytes Desc: stats.diff URL: -------------- next part -------------- # 2.1.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-46-server x86_64 Ubuntu 10.04.4 LTS auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_cache_ttl = 1 mins auth_verbose = yes auth_verbose_passwords = sha1 deliver_log_format = mailbox: deliver: session=<%{session}> msgid=%m from=%f: %$ dict { quota = mysql:/etc/dovecot/conf.d/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no doveadm_password = xxx imapc_features = rfc822.size imapc_host = local-mailbox imapc_port = 18143 instance_name = dovecot-mailbox lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_greeting = Mailbox login_log_format = mailbox: login: %$: %s login_trusted_networks = 10.129.3.0/24 mail_debug = yes mail_fsync = always mail_gid = vmail mail_home = /mail/dovecot/%d/%n mail_location = mdbox:~/mail mail_log_prefix = "mailbox: mail: %s(%u): <%{session}>: " mail_plugins = quota stats mail_privileged_group = vmail mail_uid = vmail managesieve_implementation_string = Sieve managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vnd.dovecot.duplicate mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 50 M mmap_disable = yes namespace { inbox = yes location = mailbox Archives { special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quota quota_rule = *:storage=10G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +vnd.dovecot.duplicate stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = dovecot user = dovecot } } service dict { unix_listener dict { group = vmail mode = 0660 } } service doveadm { inet_listener doveadm-server { port = 19000 } } service imap-login { inet_listener imap { port = 19143 } } service imap-postlogin { executable = script-login /usr/local/bin/dovecot-postlogin user = $default_internal_user } service imap { executable = imap imap-postlogin } service lmtp { inet_listener lmtp-without-quota { address = * port = 19025 } inet_listener lmtp { address = * port = 19024 } } service managesieve-login { inet_listener sieve { port = 19200 } } service pop3-login { inet_listener pop3 { port = 19110 } } service pop3-postlogin { executable = script-login /usr/local/bin/dovecot-postlogin user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin } service quota-warning { executable = script /usr/local/bin/quota-warning extra_groups = dovecot unix_listener quota-warning { user = vmail } user = vmail } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl = no syslog_facility = local1 userdb { driver = prefetch } userdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_plugins = quota stats imap_quota imap_stats } protocol lmtp { mail_plugins = quota stats sieve } -------------- next part -------------- # 2.1.16: /etc/dovecot-director/dovecot-director.conf # OS: Linux 2.6.32-46-server x86_64 Ubuntu 10.04.4 LTS auth_verbose = yes auth_verbose_passwords = sha1 base_dir = /var/run/dovecot-director deliver_log_format = director: deliver: session=<%{session}> msgid=%m from=%f: %$ director_doveadm_port = 20000 director_mail_servers = 10.129.3.193 10.129.3.192 10.129.3.191 10.129.3.190 director_servers = 10.129.3.193 10.129.3.192 10.129.3.191 10.129.3.190 director_user_expire = 2 days disable_plaintext_auth = no doveadm_password = xxx doveadm_proxy_port = 19000 instance_name = dovecot-director lmtp_proxy = yes login_greeting = Mail Balancer login_log_format = director: login: %$: %s login_trusted_networks = 10.129.3.0/24 mail_debug = yes mail_fsync = always mail_gid = vmail mail_home = /mail/dovecot/%d/%n mail_location = mdbox:~/mail mail_log_prefix = "director: mail: %s(%u): <%{session}>: " mail_max_userip_connections = 20 mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes passdb { args = /etc/dovecot-director/conf.d/dovecot-sql.conf.ext driver = sql } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { executable = doveadm-server director inet_listener doveadm-server { port = 20000 } } service imap-login { executable = imap-login director inet_listener imap { port = 20143 } inet_listener imaps { port = 20993 ssl = yes } } service ipc { unix_listener ipc { user = dovecot } } service lmtp { inet_listener lmtp-without-quota { address = * port = 20025 } inet_listener lmtp { address = * port = 20024 } } service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 20200 } } service pop3-login { executable = pop3-login director inet_listener pop3 { port = 20110 } inet_listener pop3s { port = 20995 ssl = yes } } ssl_cert = References: <20130416145527.E9B271AE884E@dovecot.org> <32B8F324-31DF-46A4-A42D-2105135D51B7@iki.fi> <20130416173401.3474B1AE87C0@dovecot.org> Message-ID: <20130416222747.EDD891AE8816@dovecot.org> On Tue, 16 Apr 2013 19:34:02 +0200 Peter Wagner wrote: > On Tue, 16 Apr 2013 18:07:51 +0300 > Timo Sirainen wrote: > > > On 16.4.2013, at 17.55, rauchwolke at gmx.net wrote: > > > > > i tried to compile dovecot 2.2.0 and i end up with this error: > > > > > > make[6]: Entering directory `/mnt/data/Develop/Openwrt/trunk_git/build_dir/target-mips_r2_uClibc-0.9.33.2/dovecot-2.2.0/src/util' > > > /bin/sh ../../libtool --tag=CC --mode=link mips-openwrt-linux-uclibc-gcc -std=gnu99 -Os -pipe -mips32r2 -mtune=mips32r2 -fno-caller-saves -mno-branch-likely -fhonour-copts -Wno-error=unused-but-set-variable -msoft-float -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/include -no-undefined -Wl,--as-needed -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/lib -o gdbhelper gdbhelper.o > > > > So it's failing only at gdbhelper. Why there and not earlier?.. > > I don't know. > > > > > > ../../src/lib-dovecot/.libs/libdovecot.so:(.got+0x0): multiple definition of `_GLOBAL_OFFSET_TABLE_' > > > > Does it have it multiple times? > > No only once. i attached the last 1000 lines of the output. > > > > > nm src/lib-dovecot/.libs/libdovecot.so | grep _GLOBAL_OFFSET_TABLE_ > > nm src/lib-dovecot/.libs/libdovecot.so | grep _GLOBAL_OFFSET_TABLE_ > 000b4d00 A _GLOBAL_OFFSET_TABLE_ > > > > > > Version 2.1.16 compiled fine. How can i fix this linker error? > > > > No idea. > > the weired thing is, when i build it with --without-shared-libs the program builds fine and works. How can i find out why this works but using shard-libs doesn't? with kind regards Peter From tss at iki.fi Wed Apr 17 01:37:42 2013 From: tss at iki.fi (Timo Sirainen) Date: Wed, 17 Apr 2013 01:37:42 +0300 Subject: [Dovecot] Dovecot 2.2.0 compile error In-Reply-To: <201304162233.r3GMX2ef018352@ikiaikainen.iki.fi> References: <20130416145527.E9B271AE884E@dovecot.org> <32B8F324-31DF-46A4-A42D-2105135D51B7@iki.fi> <20130416173401.3474B1AE87C0@dovecot.org> <201304162233.r3GMX2ef018352@ikiaikainen.iki.fi> Message-ID: On 17.4.2013, at 1.27, Peter Wagner wrote: >>>> make[6]: Entering directory `/mnt/data/Develop/Openwrt/trunk_git/build_dir/target-mips_r2_uClibc-0.9.33.2/dovecot-2.2.0/src/util' >>>> /bin/sh ../../libtool --tag=CC --mode=link mips-openwrt-linux-uclibc-gcc -std=gnu99 -Os -pipe -mips32r2 -mtune=mips32r2 -fno-caller-saves -mno-branch-likely -fhonour-copts -Wno-error=unused-but-set-variable -msoft-float -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/include -no-undefined -Wl,--as-needed -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/target-mips_r2_uClibc-0.9.33.2/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/usr/lib -L/mnt/data/Develop/Openwrt/trunk_git/staging_dir/toolchain-mips_r2_gcc-4.6-linaro_uClibc-0.9.33.2/lib -o gdbhelper gdbhelper.o > the weired thing is, when i build it with --without-shared-libs > the program builds fine and works. How can i find out why this works > but using shard-libs doesn't? Probably specific to the mips/linaro/something tools that you're using. Have you tried that v2.1 still compiles? The best way to figure out why it works and v2.2 doesn't would be to find the specific commit from v2.2 that broke it. http://mercurial.selenic.com/wiki/BisectExtension could make finding that easier. From jtam.home at gmail.com Wed Apr 17 02:14:08 2013 From: jtam.home at gmail.com (Joseph Tam) Date: Tue, 16 Apr 2013 16:14:08 -0700 (PDT) Subject: [Dovecot] Dovecot 2.1.16: Quota plugin compile fails: Solaris 10 In-Reply-To: References: Message-ID: Stephen Usher writes: > quota-status.c: In function `main': > quota-status.c:200: error: `optarg' undeclared (first use in this function) > ... > It seems that the following C standard header files need to be included in > quota-status.c: > > #include > #include > #include It was mentioned a few weeks back (check the archives), but you only need one of them (which may include the others). My patch to cope with this --- a/src/plugins/quota/quota-status.c Sat Apr 13 02:18:40 2013 +++ b/src/plugins/quota/quota-status.c Sat Apr 13 02:18:56 2013 @@ -14,0 +14,1 @@ +#include This worked for me. Joseph Tam From manu at netbsd.org Wed Apr 17 04:02:03 2013 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Wed, 17 Apr 2013 03:02:03 +0200 Subject: [Dovecot] dovecot-2.2 Warning: autocreate plugin is deprecated, use mailbox { auto } setting instead Message-ID: <1l1gae3.k56g2w1hm90f9M%manu@netbsd.org> Hi After upgrading to 2.2, I get this: Warning: autocreate plugin is deprecated, use mailbox { auto } setting instead I found no documentation on mailbox { auto }. Where should it go in the config file? -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz manu at netbsd.org From dovecot at lists.wgwh.ch Wed Apr 17 06:57:43 2013 From: dovecot at lists.wgwh.ch (Oli Schacher) Date: Wed, 17 Apr 2013 05:57:43 +0200 Subject: [Dovecot] dovecot-2.2 Warning: autocreate plugin is deprecated, use mailbox { auto } setting instead In-Reply-To: <1l1gae3.k56g2w1hm90f9M%manu@netbsd.org> References: <1l1gae3.k56g2w1hm90f9M%manu@netbsd.org> Message-ID: <20130417055743.000017e9@unknown> Am Wed, 17 Apr 2013 03:02:03 +0200 schrieb manu at netbsd.org (Emmanuel Dreyfus): > Hi > > After upgrading to 2.2, I get this: > Warning: autocreate plugin is deprecated, use mailbox { auto } setting > instead > > I found no documentation on mailbox { auto }. Where should it go in > the config file? > > http://wiki2.dovecot.org/MailboxSettings From manu at netbsd.org Wed Apr 17 07:25:57 2013 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Wed, 17 Apr 2013 06:25:57 +0200 Subject: [Dovecot] dovecot-2.2 Warning: autocreate plugin is deprecated, use mailbox { auto } setting instead In-Reply-To: <20130417055743.000017e9@unknown> Message-ID: <1l1gkc3.fffyyh7atw99M%manu@netbsd.org> Oli Schacher wrote: > http://wiki2.dovecot.org/MailboxSettings I am not sure on how to make it fit at mine. doveconf -n says this: mail_location = mbox:~/mail:INBOX=/var/mail/%u:INDEX=/mail/indexes/%u: SUBSCRIPTIONS=../.mailboxlist (...) plugin { autocreate = INBOX autosubscribe = INBOX quota = fs:User quota quota_warning = storage=95%% quota-warning %u } What should I have instead? Something like this? mail_location = mbox:~/mail:INBOX=/var/mail/%u:INDEX=/mail/indexes/%u: SUBSCRIPTIONS=../.mailboxlist (...) plugin { autosubscribe = INBOX quota = fs:User quota quota_warning = storage=95%% quota-warning %u } namespace inbox { mailbox INBOX { auto = create } } -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz manu at netbsd.org From gregs at sloop.net Wed Apr 17 07:59:27 2013 From: gregs at sloop.net (Gregory Sloop) Date: Tue, 16 Apr 2013 21:59:27 -0700 Subject: [Dovecot] Moving mail servers, moving mailboxes In-Reply-To: <377722326.20130415164825@sloop.net> References: <377722326.20130415164825@sloop.net> Message-ID: <666950613.20130416215927@sloop.net> I hate to bug anyone about this again, but I'm really unsure of how best to proceed. If someone could point me in a good direction - a web-link or link to a relevant listserv thread - I'd really appreciate it. Some additional searches have given me _some_ new ideas. - I've seen about dsync - but it appears that would only help between two v2.x Postfix machines, correct? [Or will it pull from 1.x to 2.x without an issue?] TIA -Greg GS> So, I've done some searching - but search terms are hard to come by, GS> that work, for this query. GS> In short, migrating a RHEL 5.9 server running the back-ported Dovecot 1.0.7 GS> To: Ububtu 12.04 with 2.0.19, I believe. GS> [I'm not against compiling a more recent version if there's some real GS> advantage to doing so. But I'd certainly prefer to stay with the GS> packaged version.] GS> Most users are POP3, with some leaving messages on the server for a GS> while. GS> Other users are IMAP - whole mail repository on server. GS> --- GS> In an ideal world, I'd like to simply copy all the mailboxes/dirs from one GS> server to the other. [Local/LAN file copies are possible] GS> It would be great if the message ID's wouldn't change, so the GS> read/unread/new etc status all all the messages wouldn't change GS> between the two servers for POP/IMAP. GS> --- GS> So, does anyone have a reasonable walk-through for doing so? GS> Is this a poor idea? GS> Should I simply set myself on fire now and save everyone a lot of hassle? :) GS> Would you suggest an alternative, and tell me if it might achieve the GS> objectives above? GS> I'm more than glad to take pointers to threads on this topic. I just GS> haven't been able to dredge this up with my Google-foo. GS> TIA GS> -Greg From michael at los-pollos.co Wed Apr 17 08:03:57 2013 From: michael at los-pollos.co (Michael) Date: Wed, 17 Apr 2013 15:03:57 +1000 Subject: [Dovecot] Moving mail servers, moving mailboxes In-Reply-To: <666950613.20130416215927@sloop.net> References: <377722326.20130415164825@sloop.net> <666950613.20130416215927@sloop.net> Message-ID: <516E2D3D.3000304@los-pollos.co> Hi, I don't think dsync works between 1.x and 2.x. I have migrated a few of my clients exchange servers to my dovecot servers and I always find LARCH https://github.com/rgrove/larch works really well. Michael. On 17/04/2013 2:59 PM, Gregory Sloop wrote: > I hate to bug anyone about this again, but I'm really unsure of how best to > proceed. > > If someone could point me in a good direction - a web-link or link to > a relevant listserv thread - I'd really appreciate it. > > Some additional searches have given me _some_ new ideas. > - I've seen about dsync - but it appears that would only help between > two v2.x Postfix machines, correct? [Or will it pull from 1.x to 2.x > without an issue?] > > TIA > > -Greg > > GS> So, I've done some searching - but search terms are hard to come by, > GS> that work, for this query. > > GS> In short, migrating a RHEL 5.9 server running the back-ported Dovecot 1.0.7 > GS> To: Ububtu 12.04 with 2.0.19, I believe. > > GS> [I'm not against compiling a more recent version if there's some real > GS> advantage to doing so. But I'd certainly prefer to stay with the > GS> packaged version.] > > GS> Most users are POP3, with some leaving messages on the server for a > GS> while. > > GS> Other users are IMAP - whole mail repository on server. > > GS> --- > GS> In an ideal world, I'd like to simply copy all the mailboxes/dirs from one > GS> server to the other. [Local/LAN file copies are possible] > > GS> It would be great if the message ID's wouldn't change, so the > GS> read/unread/new etc status all all the messages wouldn't change > GS> between the two servers for POP/IMAP. > > GS> --- > GS> So, does anyone have a reasonable walk-through for doing so? > GS> Is this a poor idea? > GS> Should I simply set myself on fire now and save everyone a lot of hassle? :) > GS> Would you suggest an alternative, and tell me if it might achieve the > GS> objectives above? > > GS> I'm more than glad to take pointers to threads on this topic. I just > GS> haven't been able to dredge this up with my Google-foo. > > GS> TIA > GS> -Greg > > > > -- > Regards, Michael. From daniel.parthey at informatik.tu-chemnitz.de Wed Apr 17 09:28:34 2013 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 17 Apr 2013 08:28:34 +0200 Subject: [Dovecot] %{session} does not work with deliver_log_format In-Reply-To: <5884A78A-BCBA-4BAC-84F4-2F66BBB69BCE@iki.fi> References: <20130224225349.GA7429@daniel.localdomain> <20130225213442.GA10452@daniel.localdomain> <5884A78A-BCBA-4BAC-84F4-2F66BBB69BCE@iki.fi> Message-ID: <20130417062834.GA7573@daniel.localdomain> Timo Sirainen wrote: > On 25.2.2013, at 23.34, Daniel Parthey wrote: > > >> LMTP has a completely different session ID currently, which gets reset for each mail delivery and is written to the Received: header that it writes. > >> It doesn't traverse through proxies, because each delivery gets a different ID anyway. > >> > >> So .. Why is it that you want this? For matching a log line with a Received: > >> header? I guess that could be done, but the name should probably be different > >> from %{session} so it won't get mixed up with what IMAP/POP3 uses it for. > > > > I simply run an LMTP director/proxy to prevent NFS locking issues > > and in error cases I want to investigate where the mail has gone > > (through the director lmtp to the mailbox lmtp). I thought this > > is what "session IDs" were intended for. > > The SMTP server should log the delivery ID that the backend generates, and you should be able to grep for it, right? Ah ok, that's totally fine. I didn't expect the ID to be the "backend" IP :) > > Obviously, the generated ID is a different one for director and mailbox, > > looking at the Received: lines of a single message: > > > > Received: from mail01.example.org ([10.129.3.193]) > > by mail01.example.org (Dovecot) with LMTP id vdSeD+CrK1HXZQAAiWCYmA > > ; Mon, 25 Feb 2013 19:25:02 +0100 > > Received: from mx01.example.org ([127.0.0.1]) > > by mail01.example.org (Dovecot) with LMTP id fu7aIn6sK1EMaQAAiWCYmA > > ; Mon, 25 Feb 2013 19:25:02 +0100 > > > > What would you suggest how to track an LMTP delivery through a > > director proxy? Should one use the MessageID to correlate the > > lmtp log entries in dovecot-director.log and dovecot.log? > > I was first thinking about having LMTP proxy log the delivery ID, until I > noticed that LMTP proxy doesn't log anything about delivered mails currently. > I'm not really sure if that would be of any actual help? Currently our lmtp proxy logs the following: dovecot: lmtp(3538): Debug: none: root=, index=, control=, inbox=, alt= dovecot: lmtp(3538): Connect from 127.0.0.1 dovecot: lmtp(3538): Debug: auth input: user=user at example.org proxy proxy_timeout=120 port=19024 host=10.129.3.193 proxy_refresh=86400 dovecot: lmtp(3538): Disconnect from 127.0.0.1: Client quit (in reset) In combination with syslog timestamp, this is enough information to track the user/backend assignment in the director, also shown by doveadm director status user at example.org. Regards Daniel -- https://plus.google.com/103021802792276734820 From rs at sys4.de Wed Apr 17 10:44:40 2013 From: rs at sys4.de (Robert Schetterer) Date: Wed, 17 Apr 2013 09:44:40 +0200 Subject: [Dovecot] dovecot-2.2 Warning: autocreate plugin is deprecated, use mailbox { auto } setting instead In-Reply-To: <20130417055743.000017e9@unknown> References: <1l1gae3.k56g2w1hm90f9M%manu@netbsd.org> <20130417055743.000017e9@unknown> Message-ID: <516E52E8.8080406@sys4.de> Am 17.04.2013 05:57, schrieb Oli Schacher: > Am Wed, 17 Apr 2013 03:02:03 +0200 > schrieb manu at netbsd.org (Emmanuel Dreyfus): > >> Hi >> >> After upgrading to 2.2, I get this: >> Warning: autocreate plugin is deprecated, use mailbox { auto } setting >> instead >> >> I found no documentation on mailbox { auto }. Where should it go in >> the config file? >> >> > > http://wiki2.dovecot.org/MailboxSettings > to my knowledge, in 2.1 autocreate worked still but only for first login but SPECIAL-USE can and/or can/should be used additional, so the question is, did this change in 2.2, i guess not , "warning" normal means, its still working but you should use other ways, and the feature is not longer developed, and may not included in future so Timo perhaps should do some clarification, or add some words to wiki about it. For small search in 2.2 changelog i didnt found any autocreate change so at recent it should still work like 2.1 Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From fabio.ferrari at unimore.it Wed Apr 17 10:49:55 2013 From: fabio.ferrari at unimore.it (FABIO FERRARI) Date: Wed, 17 Apr 2013 09:49:55 +0200 Subject: [Dovecot] process_limit must be 1 Message-ID: <772feea3a0efaab716188df69bd07d20.squirrel@webmail2.unimore.it> Hello, recently I have migrated a dovecot configuration from a Red Hat 5 to a CentOS 6. Since the versions of dovecot are quite the same (dovecot-2.0.1-1_118.el5 vs dovecot-2.0.9-5.el6.x86_64), I was thinking that copying the configurations file from one server to the other was a good thing, but instead, when I try to start the service, I have this bad error: Avvio di Dovecot Imap: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: service(anvil): process_limit must be 1 Does anyone know why I am getting this? Is there a change in configurations between the 2 versions, is it a known issue or I have to check something else? thanks in advance Fabio Ferrari From tss at iki.fi Wed Apr 17 12:43:23 2013 From: tss at iki.fi (Timo Sirainen) Date: Wed, 17 Apr 2013 12:43:23 +0300 Subject: [Dovecot] dovecot-2.2 Warning: autocreate plugin is deprecated, use mailbox { auto } setting instead In-Reply-To: <1l1gkc3.fffyyh7atw99M%manu@netbsd.org> References: <1l1gkc3.fffyyh7atw99M%manu@netbsd.org> Message-ID: <54AF2C2D-D79E-438F-9E31-298B2B76F344@iki.fi> On 17.4.2013, at 7.25, Emmanuel Dreyfus wrote: > plugin { > autocreate = INBOX > autosubscribe = INBOX INBOX doesn't have to be explicitly autocreated, it always is. I also doubt any client needs it to be autosubscribed. > namespace inbox { > mailbox INBOX { > auto = create auto = subscribe if you want it to be autosubscribed. > } > } Although now I started to wonder if namespace has non-empty prefix if it's possible to autosubscribe to INBOX.. From tss at iki.fi Wed Apr 17 12:58:02 2013 From: tss at iki.fi (Timo Sirainen) Date: Wed, 17 Apr 2013 12:58:02 +0300 Subject: [Dovecot] Moving mail servers, moving mailboxes In-Reply-To: <377722326.20130415164825@sloop.net> References: <377722326.20130415164825@sloop.net> Message-ID: On 16.4.2013, at 2.48, Gregory Sloop wrote: > In short, migrating a RHEL 5.9 server running the back-ported Dovecot 1.0.7 > To: Ububtu 12.04 with 2.0.19, I believe. Dovecot v2.0 can use v1.0's mbox/maildir files including their metadata. v2.0 should also be able to read v1.0's index files without errors. > In an ideal world, I'd like to simply copy all the mailboxes/dirs from one > server to the other. [Local/LAN file copies are possible] You can do that. Or use rsync. From user+dovecot at localhost.localdomain.org Wed Apr 17 12:58:04 2013 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Wed, 17 Apr 2013 11:58:04 +0200 Subject: [Dovecot] imap Fatal: bzlib.read(~/mdbox/storage/m.317): Out of memory Message-ID: <516E722C.5010201@localhost.localdomain.org> Hi Timo, today I found a raw backtrace after the bzlib.read() out of memory message. Regards, Pascal -------------- next part -------------- Apr 17 10:41:44 imap(user at example.com): Fatal: bzlib.read(/srv/mail/x/70004/70038/mdbox/storage/m.317): Out of memory Apr 17 10:41:44 imap(user at example.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x7a1b6) [0x7ff6837791b6] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x7b4e1) [0x7ff68377a4e1] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7ff683779662] -> /usr/local/lib/dovecot/lib20_zlib_plugin.so(+0x4ef4) [0x7ff682731ef4] -> /usr/local/lib/dovecot/libdovecot.so.0(i_stream_read+0xc9) [0x7ff683785812] -> /usr/local/lib/dovecot/libdovecot.so.0(i_stream_read_copy_from_parent+0xa4) [0x7ff683785ba5] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xbba73) [0x7ff683aa8a73] -> /usr/local/lib/dovecot/libdovecot.so.0(i_stream_read+0xc9) [0x7ff683785812] -> /usr/local/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x61) [0x7ff683786707] -> /usr/local/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x109) [0x7ff683766b44] -> /usr/local/lib/dovecot/libdovecot.so.0(message_parse_header+0x5e) [0x7ff6837678de] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc838f) [0x7ff683ab538f] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc9a2a) [0x7ff683ab6a2a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xc9c6a) [0x7ff683ab6c6a] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xca206) [0x7ff683ab7206] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xca4c2) [0x7ff683ab74c2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xca7f7) [0x7ff683ab77f7] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x43) [0x7ff683ab784e] -> /usr/local/lib/dovecot/lib90_stats_plugin.so(+0x3753) [0x7ff681efc753] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x49) [0x7ff683a857e2] -> dovecot/imap [user at example.com 192.0.96.113 UID SEARCH]() [0x421883] -> dovecot/imap [user at example.com 192.0.96.113 UID SEARCH]() [0x421bdf] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x914ba) [0x7ff6837904ba] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0x20) [0x7ff683790541] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xeb) [0x7ff68379210d] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x5e) [0x7ff683790644] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x2e) [0x7ff68372809e] -> dovecot/imap [user at example.com 192.0.96.113 UID SEARCH](main+0x2af) [0x4264a0] From hummel at pasteur.fr Wed Apr 17 13:19:30 2013 From: hummel at pasteur.fr (Thomas Hummel) Date: Wed, 17 Apr 2013 12:19:30 +0200 Subject: [Dovecot] Maildirs location migration In-Reply-To: <1366110038.11047.290.camel@innu> References: <20130403154220.GA25793@parmesan.sis.pasteur.fr> <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> <20130410162847.GB7798@parmesan.sis.pasteur.fr> <20130410165915.GD7798@parmesan.sis.pasteur.fr> <1365618100.11047.180.camel@innu> <20130411100721.GB9527@parmesan.sis.pasteur.fr> <20130416103832.GG17909@parmesan.sis.pasteur.fr> <1366110038.11047.290.camel@innu> Message-ID: <20130417101930.GA20215@parmesan.sis.pasteur.fr> On Tue, Apr 16, 2013 at 02:00:38PM +0300, Timo Sirainen wrote: > The worst that can happen is: > > 1) Client sees new mail 123 in old server > 2) Client sees only mails up to 122 in the new server > 3) Client again will see mail 123 after a while > > I'm actually not sure how clients will handle that. It is an IMAP > protocol violation. Why is it a protocol violation ? if new was up to 122, nextuid would have been 123 so what's the problem, protocol wise, to see 123 come later ? Of course if a new mail is delivered in new as 123, there 's a conflict. But as you said dsync knows how to handle this and would assign new uids to both and the client, as you said, could get confused about what he thought was 123. But even in that case, wouldn't he see the message (as a new one with it's new uid) ? I mean, nothing would be "lost" ? Thanks -- Thomas Hummel | Institut Pasteur | Groupe Exploitation et Infrastructure From tss at iki.fi Wed Apr 17 13:25:38 2013 From: tss at iki.fi (Timo Sirainen) Date: Wed, 17 Apr 2013 13:25:38 +0300 Subject: [Dovecot] Maildirs location migration In-Reply-To: <20130417101930.GA20215@parmesan.sis.pasteur.fr> References: <20130403154220.GA25793@parmesan.sis.pasteur.fr> <5EDC194C-7D75-4A30-AB41-9935C6FDD0E1@iki.fi> <20130410162847.GB7798@parmesan.sis.pasteur.fr> <20130410165915.GD7798@parmesan.sis.pasteur.fr> <1365618100.11047.180.camel@innu> <20130411100721.GB9527@parmesan.sis.pasteur.fr> <20130416103832.GG17909@parmesan.sis.pasteur.fr> <1366110038.11047.290.camel@innu> <20130417101930.GA20215@parmesan.sis.pasteur.fr> Message-ID: <77163CE8-247B-46FF-81DA-A132B0E4ED65@iki.fi> On 17.4.2013, at 13.19, Thomas Hummel wrote: > On Tue, Apr 16, 2013 at 02:00:38PM +0300, Timo Sirainen wrote: > >> The worst that can happen is: >> >> 1) Client sees new mail 123 in old server >> 2) Client sees only mails up to 122 in the new server >> 3) Client again will see mail 123 after a while >> >> I'm actually not sure how clients will handle that. It is an IMAP >> protocol violation. > > Why is it a protocol violation ? if new was up to 122, nextuid would have been > 123 so what's the problem, protocol wise, to see 123 come later ? Because client saw uidnext=124 on the old server, which shrank back to uidnext=123 on the new server. That shouldn't happen even temporarily. > Of course if a new mail is delivered in new as 123, there 's a conflict. But > as you said dsync knows how to handle this and would assign new uids to both > and the client, as you said, could get confused about what he thought was 123. > But even in that case, wouldn't he see the message (as a new one with it's new uid) ? > I mean, nothing would be "lost" ? Yeah, when conflicts are fixed nothing gets lost. In that "worst case" I mentioned there's no conflict really, just a message that disappears and appears back. Hmm. Maybe Dovecot should keep track of what messages IMAP clients have seen, and automatically figure out when it should change UIDs in those cases. From ronleach at tesco.net Wed Apr 17 14:17:06 2013 From: ronleach at tesco.net (Ron Leach) Date: Wed, 17 Apr 2013 12:17:06 +0100 Subject: [Dovecot] Moving mail servers, moving mailboxes In-Reply-To: References: <377722326.20130415164825@sloop.net> Message-ID: <516E84B2.9080608@tesco.net> On 17/04/2013 10:58, Timo Sirainen wrote: > On 16.4.2013, at 2.48, Gregory Sloop wrote: > >> In short, migrating a RHEL 5.9 server running the back-ported Dovecot 1.0.7 >> To: Ububtu 12.04 with 2.0.19, I believe. > > Dovecot v2.0 can use v1.0's mbox/maildir files including their metadata. v2.0 should also be able to read v1.0's index files without errors. > We've a similar wish, except that we were hoping to install 2.2 on a different box (intending in our case to run Debian Squeeze instead of Ubuntu LTS). Can 2.2 (or, if not, then 2.1) also read 1.0 metadata? (Or is 'only' 2.0 able to read 1.0 metadata? In which case we'd probably migrate through 2.0.x to 2.2, on Squeeze.) Note on the Wiki: The Migration page http://wiki2.dovecot.org/Migration is good at describing migration 'to' Dovecot from other systems, and does suggest that Dovecot will read existing files. I think there were earlier discussions on the list about Dovecot version changes which meant that newer versions could read older versions' data, but older versions could not read newer versions' data. These aspects are not relevant for 'migrating to' Dovecot, but are worth keeping in mind for 'upgrading' Dovecot. There is version to version upgrading advice, covering all aspects, not only which version can read what, here http://wiki2.dovecot.org/Upgrading What I can see, from the descriptions of each version change, is that V2.x can read V1.x, but V1.2.4 or lower cannot read V2.x data. Permissions for Maildir changed, though, in V2.0 and, then for all mailbox types (it says 'creating home directories', actually), in V2.2. This latter change in 2.2 seems to be relevant for any mailboxes that will be accessed by several different users who are actually 'system users', ie, a mail service where the mailbox is 'shared', and the installation is using 'system users' (not, therefore, using 'virtual users', if I have understood correctly). This info is (surely) fully understood already by all the serious mail-server users on the list, but I wonder if it might be helpful to spell it out for less confident users who are getting up to speed with these aspects. If the text I've written above is correct, shall I add it to the upgrading page of the Wiki, so that there is a definitive answer to the query which version(s) read what? regards, Ron From tss at iki.fi Wed Apr 17 16:21:11 2013 From: tss at iki.fi (Timo Sirainen) Date: Wed, 17 Apr 2013 16:21:11 +0300 Subject: [Dovecot] imap Panic: file index-attachment.c: line 231 (index_attachment_save_finish): assertion failed: (attach->input->eof) In-Reply-To: <516D8A25.3080607@localhost.localdomain.org> References: <516C10A5.10503@localhost.localdomain.org> <1366044659.11047.276.camel@innu> <1366044793.11047.277.camel@innu> <1366044907.11047.278.camel@innu> <516C722A.3040206@localhost.localdomain.org> <516D8A25.3080607@localhost.localdomain.org> Message-ID: <1366204871.11047.296.camel@innu> On Tue, 2013-04-16 at 19:28 +0200, Pascal Volk wrote: > On 04/15/2013 11:33 PM Pascal Volk wrote: > > OK, applied that patch. Lets see what will happen. > > > > Looks good. No crash in the last 20 hours. OK. Committed the patch a little bit differently: http://hg.dovecot.org/dovecot-2.2/rev/8a07a5f6fd54 From thomasstandaert_2 at hotmail.com Wed Apr 17 16:26:42 2013 From: thomasstandaert_2 at hotmail.com (Thomas Standaert) Date: Wed, 17 Apr 2013 16:26:42 +0300 Subject: [Dovecot] Dovecot connection problem - Too many invalid commands (no auth attempts) - v2.0.19 Message-ID: Hello. This might be a silly problem, but I'm a bit a newbie at this, and the internet didn't give me a solution to this yet. I installed a mail server with postfix, dovecot, postfixadmin and a mysql DB for authentification, using this tutorial : http://www.exratione.com/2012/05/a-mailserver-on-ubuntu-1204-postfix-dovecot -mysql/. Except step 4. The complete tutorial worked on a virtual machine, but doesn't work here on a vps from ovh.net. Connecting via telnet localhost 143 works, I can connect. When I try to connect via thunderbird, the domain name is picked up, but gives me a bad login/password combination. Mail.log, mail.err and error don't show anything. Via MS Outlook, I seem to get stuck on the connection page, and I get the following errors in mail.log: dovecot: imap-login: Disconnected: Too many invalid commands (no auth attempts): rip=x, lip=y dovecot: pop3-login: Disconnected (no auth attempts): rip=x, lip=y dovecot: imap-login: Disconnected (no auth attempts): rip=x, lip=y, TLS: Disconnected dovecot: pop3-login: Disconnected (no auth attempts): rip=x, lip=y, TLS: Disconnected dovecot: pop3-login: Aborted login (no auth attempts): rip=x, lip=y dovecot: imap-login: Disconnected (no auth attempts): rip=x, lip=y, TLS: Disconnected dovecot: imap-login: Disconnected (no auth attempts rip=x, lip=y dovecot: imap-login: Disconnected (no auth attempts): rip=x, lip=y, TLS handshaking: Disconnected dovecot: pop3-login: Disconnected (no auth attempts): rip=x, lip=y, TLS handshaking: Disconnected And after a while asks to try to connect via plain method. Doveconf -n gives me this # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab068.8 x86_64 Ubuntu 12.04.2 LTS simfs auth_mechanisms = plain login first_valid_uid = 150 last_valid_uid = 150 mail_gid = mail mail_location = maildir:/var/vmail/%d/%n mail_uid = vmail passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = " imap pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = mail mode = 0600 user = vmail } } ssl_cert = References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 17 Apr 2013, Thomas Standaert wrote: Did you enabled auth_debug in Dovecot ? When you use telnet ip 143 1 login "user" "password" does it work? MUAs do too much, when it does not work at once. It it works, try using TLS e.g.: gnutls-cli -p 143 --starttls localhost STARTTLS ^D 1 login "user" "password" - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUW6pqF3r2wJMiz2NAQJyCggAhNDwtOWw95OMs1UNNd9eK8qwc/3EZSZh uBEpRuMx4JyUzvpE5U8b51pmqwTFP+gsLokw2yMpX/9f1oD5/9MedKr8wsuGVq+G W3a4NnK2Go9MelD3Pk4brZv6QDDupFV3zugwePFpA8OM0Mzp93uq3kwK4cX6+BDu ePY4DMFdcT9zydtbXE3SJhx4eXIxJIMekH1y7QH6gaglfJ9+sapfN9AE4nVOtSkN Ydrk9TnJJ3e3i0UF1AknbMolWVF4Wa52RTcrZBkeTADz7Uv5Xn2bkVnG14zt4LN/ Vb9BIEqz2rJHJoSsBAamZU2pwkug3fbzIHs+bt6++5nneT/K3Vav9g== =H7z5 -----END PGP SIGNATURE----- From gregs at sloop.net Wed Apr 17 17:18:54 2013 From: gregs at sloop.net (Gregory Sloop) Date: Wed, 17 Apr 2013 07:18:54 -0700 Subject: [Dovecot] Moving mail servers, moving mailboxes In-Reply-To: References: <377722326.20130415164825@sloop.net> Message-ID: <1607148840.20130417071854@sloop.net> TS> On 16.4.2013, at 2.48, Gregory Sloop wrote: >> In short, migrating a RHEL 5.9 server running the back-ported Dovecot 1.0.7 >> To: Ububtu 12.04 with 2.0.19, I believe. TS> Dovecot v2.0 can use v1.0's mbox/maildir files including their TS> metadata. v2.0 should also be able to read v1.0's index files without errors. Thanks Timo for the answer - that helps a lot... Now, some follow-up. I assume this means that all version of 2.x (to current) can read 1.x files. [If I'm wrong, please correct me.] Is there a tool to convert/migrate the mailbox format from v1 to 2, or does v2 do it "automagically" or something? [I'm sure there must be a tool, but some searching wasn't finding it for me.] --- As long as I'm asking about mailbox formats, is it possible to use DBox with postfix - it appears on the Wiki that it's not, but then I find posts on the web that appear to indicate it *is* possible. [We're using Postfix as our MTA.] Thanks again all! -Greg >> In an ideal world, I'd like to simply copy all the mailboxes/dirs from one >> server to the other. [Local/LAN file copies are possible] TS> You can do that. Or use rsync. -- Gregory Sloop, Principal: Sloop Network & Computer Consulting Voice: 503.251.0452 x82 EMail: gregs at sloop.net http://www.sloop.net --- From schnederle at futureweb.at Wed Apr 17 17:36:48 2013 From: schnederle at futureweb.at (Andreas Schnederle-Wagner - Futureweb.at) Date: Wed, 17 Apr 2013 14:36:48 +0000 Subject: [Dovecot] Problem with "convert" Plugin Message-ID: <54b8e914e1a4489e9d4b06732a2a3ba1@EXCHANGE.corp.futureweb.at> Hello, I got a Problem with the "convert" Plugin. Trying to convert from mbox to maildir Format. OS: CentOS release 5.8 (Final) dovecot -version: 1.0.7 (Centos RPM) convert Plugin call: convert_mail = mbox:/opt/pop3/%u:INBOX=/var/spool/mail/%u When converting to maildir - POP3 works fine (except the lost UIDL - so every server-saved message is double downloaded - but did not find any fix for this problem with convert plugin) But the IMAP In-Boxes give me some headache . All Folders are converted correct - and displayed in Mail Client. But all Mails in the IMAP INBOX are "lost" (at least Mail Client won't show them anymore) Newly delivered Mails to the Inbox work - but all older ones are missing. When looking into this Folder: /var/maildata/USER/Maildir/cur/ I can see that newly delivered mails look like this: 1366122898.14776_0.SERVERNAME:2, And the old - converted ones like this: 1366119758.P14442Q12M682874.SERVERNAME:2, Can someone point me in the right direction why the converted Mails are missing? (It worked on other Servers - about 1 year ago - without any problem?!) Thank you Andreas Schnederle-Wagner Futureweb OG Innsbrucker Str.?4 6380 St. Johann schnederle at futureweb.at www.futureweb.at www.ortsinfo.at Fon: +43 (0) 5352 65335-0 Fax:?+43 (0) 5352 65335-777 Gratis ?ber Skype anrufen | Skype-ID: futureweb From thomasstandaert_2 at hotmail.com Wed Apr 17 18:58:16 2013 From: thomasstandaert_2 at hotmail.com (Thomas Standaert) Date: Wed, 17 Apr 2013 18:58:16 +0300 Subject: [Dovecot] Dovecot connection problem - Too many invalid commands (no auth attempts) - v2.0.19 In-Reply-To: References: Message-ID: Hey Steffen, thanks for the quick response! I enabled auth-debug now in dovecot. A normal telnet ip 143 works, after I put disable_plaintext_auth to no of course. I could connect, and see my folders. Mail.log didn't give me anything abnormal, and showed me neatly the connection and the sql querries. One abnormality though, just mentioning it, when I try to type in 1 login user password, I got a "BAD Error in IMAP command received by server." Or when I copy pasted the same thing (from the localhost terminal where I tried it there) it worked. After that I tried gnutls-cli -p 143 --starttls localhost 1 STARTTLS ^D It gave me following error: The hostname in the certificate does NOT match 'localhost' It's probably a certificate error (I use a self-signed, planning on buying one maybe later). I'm now digging google again, and triple checking each conf file. I added the hostname to the localhost entry of /etc/hosts, but no positive response yet. Thank you again Greetings, Thomas Standaert -----Original Message----- From: dovecot-bounces at dovecot.org [mailto:dovecot-bounces at dovecot.org] On Behalf Of Steffen Kaiser Sent: woensdag 17 april 2013 16:55 To: Dovecot Mailing List Subject: Re: [Dovecot] Dovecot connection problem - Too many invalid commands (no auth attempts) - v2.0.19 On Wed, 17 Apr 2013, Thomas Standaert wrote: Did you enabled auth_debug in Dovecot ? When you use telnet ip 143 1 login "user" "password" does it work? MUAs do too much, when it does not work at once. It it works, try using TLS e.g.: gnutls-cli -p 143 --starttls localhost STARTTLS ^D 1 login "user" "password" - -- Steffen Kaiser From rudazz at gmail.com Wed Apr 17 20:32:00 2013 From: rudazz at gmail.com (Ruda Porto Filgueiras) Date: Wed, 17 Apr 2013 14:32:00 -0300 Subject: [Dovecot] qmail-ldap LDA Delivery and sieve Message-ID: Hi, I'm using dovecot 2.1.7 on debian Squeeze with ldap integration. Almost everything is working fine and I would link to thank all developers for this amazing piece of software. But after changing my qmail-ldap to do LDA integration get all the benefits from LDA and sieve, some emails return with failure like this: : lda(sar): Fatal: Unknown argument: sar Usage: dovecot-lda [-c ] [-a
] [-d ] [-p ] [-f ] [-m ] [-e] [-k] It happens on messanges that could not be delivered and need to be returned to the sender. I'm using the configuration described on wiki to do qmail-ldap integration: http://wiki.dovecot.org/HowTo/qmailldap The relevant delivery command is: | /usr/lib/dovecot/dovecot-lda -a $RECIPIENT -f $SENDER -d $USER I also tried to use this way, as documented here: http://wiki2.dovecot.org/LDA/Qmail | /var/qmail/bin/preline -f /usr/lib/dovecot/dovecot-lda But in that case, some sieve plugins can't detect the mail recipient, like vacation plugin. Finally, the vacation plugin also is not doing email forwarding when I use the first delivery option above. Follow my settings: # LDAP scope = subtree user_attrs = uidNumber=11184,gidNumber=2110 user_filter = (&(objectClass=qmailUser)(uid=%u)(accountStatus=active)) pass_attrs=uid=user,userPassword=password,mailHost=host,=proxy_maybe=y pass_filter = (&(objectClass=qmailUser)(uid=%u)(accountStatus=active)) iterate_attrs = uid=user iterate_filter = (&(objectClass=qmailUser)(accountStatus=active)) # dovecot -n output: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 6.0.7 ext4 default_client_limit = 8000 default_process_limit = 2048 disable_plaintext_auth = no hostname = mail.mondialline.com.br lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To mail_gid = vmail mail_location = maildir:/dados/vmail/%u/Maildir mail_plugins = zlib mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vacation-seconds namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = /dados/vmail/%u/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +vacation +vacation-seconds sieve_global_dir = /var/lib/dovecot/sieve/global/ sieve_vacation_default_period = 1h sieve_vacation_max_period = 30d sieve_vacation_min_period = 0 } postmaster_address = ti at mondialline.com.br protocols = " imap lmtp sieve" service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 10 } service imap { process_limit = 2048 } service managesieve-login { inet_listener sieve { port = 4190 } } shutdown_clients = no ssl_cert = References: Message-ID: <1366232963.2414.110.camel@worklian> Hi, > > : > lda(sar): Fatal: Unknown argument: sar > Usage: dovecot-lda [-c ] [-a
] [-d ] [-p ] > [-f ] [-m ] [-e] [-k] > > It happens on messanges that could not be delivered and need to be > returned to the sender. I would think this indicates that lda is trying to deliver the message to sar when it should be delivering to sar at mondialline.com.br. Probably you need to adjust your ldap user_attrs and user_filters so it returns what lda needs, but that is just a guess after a short look at your mail... > I also tried to use this way, as documented here: > http://wiki2.dovecot.org/LDA/Qmail > | /var/qmail/bin/preline -f /usr/lib/dovecot/dovecot-lda This is the way I did it, but I had to add the HOME variable like so: |HOME=/home/mail/$USER /var/qmail/bin/preline -f /usr/local/libexec/dovecot/dovecot-lda I dont' see anything obviously wrong with your settings, but I am connecting to an active directory instead of an openldap server, so your setup is different than mine: > Follow my settings: > > # LDAP > scope = subtree > user_attrs = uidNumber=11184,gidNumber=2110 > user_filter = (&(objectClass=qmailUser)(uid=%u)(accountStatus=active)) > pass_attrs=uid=user,userPassword=password,mailHost=host,=proxy_maybe=y > pass_filter = (&(objectClass=qmailUser)(uid=%u)(accountStatus=active)) > iterate_attrs = uid=user > iterate_filter = (&(objectClass=qmailUser)(accountStatus=active)) > > # dovecot -n output: > # 2.1.7: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 6.0.7 ext4 > default_client_limit = 8000 > default_process_limit = 2048 > disable_plaintext_auth = no > hostname = mail.mondialline.com.br > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > lda_original_recipient_header = X-Original-To > mail_gid = vmail > mail_location = maildir:/dados/vmail/%u/Maildir > mail_plugins = zlib > mail_privileged_group = vmail > mail_uid = vmail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date ihave vacation-seconds > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = INBOX. > separator = . > type = private > } > passdb { > args = /etc/dovecot/master-users > driver = passwd-file > master = yes > pass = yes > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > plugin { > sieve = /dados/vmail/%u/.dovecot.sieve > sieve_dir = ~/sieve > sieve_extensions = +vacation +vacation-seconds > sieve_global_dir = /var/lib/dovecot/sieve/global/ > sieve_vacation_default_period = 1h > sieve_vacation_max_period = 30d > sieve_vacation_min_period = 0 > } > postmaster_address = ti at mondialline.com.br > protocols = " imap lmtp sieve" > service dict { > unix_listener dict { > group = vmail > mode = 0600 > user = vmail > } > } > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > process_min_avail = 10 > } > service imap { > process_limit = 2048 > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > } > shutdown_clients = no > ssl_cert = ssl_key = submission_host = mail.mondialline.com.br:25 > userdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > default_fields = uid=vmail gid=vmail home=/dados/vmail/%u > driver = ldap > } > protocol lmtp { > auth_socket_path = director-userdb > } > protocol lda { > mail_plugins = zlib sieve > } > protocol imap { > mail_max_userip_connections = 500 > mail_plugins = zlib imap_zlib > } > protocol sieve { > mail_max_userip_connections = 100 > managesieve_max_line_length = 65536 > } > > Best regards, > > -- > Rud? Porto Filgueiras > http://python-blog.blogspot.com > http://twitter.com/rudaporto From stephan at rename-it.nl Thu Apr 18 02:12:18 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 18 Apr 2013 01:12:18 +0200 Subject: [Dovecot] Dovecot 2.2 & LEMONADE extensions In-Reply-To: <5154D6DC.40306@rename-it.nl> References: <5151A4F5.3090706@softjury.de> <5154AB92.9020700@wildgooses.com> <55A02E03-42A8-4DF6-9A5B-7168AA530BF8@iki.fi> <5154D6DC.40306@rename-it.nl> Message-ID: <516F2C52.5050905@rename-it.nl> On 3/29/2013 12:48 AM, Stephan Bosch wrote: > On 3/28/2013 11:10 PM, Timo Sirainen wrote: >> On 28.3.2013, at 22.44, Ed W wrote: >> >> Also there's a good chance that Dovecot v2.3 will have an SMTP >> submission server with BURL support (that will simply forward the >> mail to a real SMTP server). > > A few weeks back I gave this a look and I made a functional prototype > of that already. I'll commit it to my patch repository in a week or so. You can track Dovecot SMTP submission developments in this Mercurial patch queue (mq extension): http://hg.rename-it.nl/dovecot-2.2-patches/ The core functionality works, but there is still much work to be done. Regards, Stephan. From jk at jkart.de Thu Apr 18 02:34:33 2013 From: jk at jkart.de (Jim Knuth) Date: Thu, 18 Apr 2013 01:34:33 +0200 Subject: [Dovecot] auth: passwd file (info): unknown user Message-ID: <516F3189.6000306@jkart.de> Hello, the problem is: The users are system users (by Confixx) say webxpy. But behind it e-mail puts of course address like info at domain.de and so on. Everything functions perfectly, nevertheless, is following in the log. ? ? dovecot: auth: passwd file (jk): unknown user ? dovecot: auth: passwd file (jim.knuth): unknown user ? dovecot: auth: passwd file (info): unknown user ? and so on It is tried obviously, before the domain part in the passwd file to find user info ? However, there is in it only webxpy. How can I solve this dilemma, by which does this come then? auth_username_format = %n Thanks in advance as attached mine dovecot-n -- Mit freundlichen Gr??en, with kind regards, Jim Knuth -------------- next part -------------- # 2.2.0 (bafcb428167b): /etc/dovecot/dovecot.conf # OS: Linux 2.6.29.4-default i686 Debian 7.0 auth_master_user_separator = * auth_mechanisms = plain login auth_username_format = %n auth_verbose = yes auth_worker_max_count = 50 disable_plaintext_auth = no listen = * login_greeting = Mailserver ready. managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace inbox { inbox = yes list = yes location = maildir:~/Maildir mailbox Ablage { auto = subscribe } mailbox Drafts { special_use = \Drafts } mailbox Entwurf { auto = subscribe special_use = \Drafts } mailbox Gesendet { auto = subscribe } mailbox Junk { special_use = \Junk } mailbox Papierkorb { auto = subscribe special_use = \Trash } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = } passdb { args = username_format=%n driver = pam } plugin { quota = maildir:User quota quota_grace = 5%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Sorry, but Mailbox is full|Mailbox ist voll quota_status_success = DUNNO sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/global/global.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ sieve_global_path = /etc/dovecot/sieve/global/global.sieve trash = /etc/dovecot/dovecot-trash.conf.ext } postmaster_address = postmaster at art-domains.de protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { mode = 0600 } } service imap-login { client_limit = 128 process_limit = 256 service_count = 0 vsz_limit = 64 M } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 vsz_limit = 64 M } service pop3-login { client_limit = 128 process_limit = 256 service_count = 0 vsz_limit = 64 M } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { address = 127.0.0.1 port = 12340 } } ssl_cert = References: <1D989A1A-F648-4647-A3A9-CC5481A54300@iki.fi> Message-ID: I do not get warnings, and, listen = *, ::1, 2001:470:some:subnet::ffff _snip_ inet_listener imap { address = *,[::] port = 143 ... same with pop3 If I use 2001:470:some:subnet::2222 dovecot (2.1.16) answers Sorry about previous direct message, darn gmail and darn bosses ( policy says cant use company email for public lists) On 4/15/13, Timo Sirainen wrote: > On 13.4.2013, at 7.13, Nick Edwards wrote: > >> Is the global listen directive supposed to be a governing directive, >> like in apache? or is it there just in case you dont use it in >> protocols? >> >> I set a specific ipv6 address in global listen, but use [::] in proto > > I don't understand what you mean by "in proto". If you mean inside protocol > {} setting, that's a deprecated way and should log warnings about it. > >> Testing to a secondary IP, not in the global listen, it still >> connects, so can I ask has the original use of global listen been >> deprecated? > > It's the default listen setting, which gets used by all services' > inet_listeners that don't override it. > > From richw at richw.org Thu Apr 18 09:51:55 2013 From: richw at richw.org (Rich Wales) Date: Wed, 17 Apr 2013 23:51:55 -0700 Subject: [Dovecot] Pros and cons of having folders under INBOX vs. not Message-ID: <516F980B.3040406@liberation.richw.org> I have some questions about whether I should set up folders under INBOX vs. having them outside the INBOX namespace. I'm setting up a new Dovecot 2.2.0 on an Ubuntu 12.04.2 server. My plan is to move my users (family members) to this new server from an old Cyrus server. Everybody is currently using (and will continue to use) IMAP, and either Thunderbird or SquirrelMail as their e-mail client. I'm using the maildir mailbox format on this new Dovecot server. No one is using the new Dovecot server yet, so I'm still free to do additional tweaking of the server configuration. When I used imapsync to copy everyone's mail to the new server, I found that all the folders (other than INBOX) were renamed. On the old Cyrus server, all the folders are subfolders of INBOX, but the folders on the new Dovecot server are not. (For example, a folder named "INBOX.Dovecot" on the old server was renamed to "Dovecot" on the new server by the imapsync utility.) Can I just keep things this way on the new server? Or are my users going to run into problems if folders are not all under INBOX? I do realize that IMAP servers can be set up either to put everything under INBOX, or not, but I'm not familiar with all the pros/cons. And if I do need (or want) to put all the folders under INBOX, can I simply rename the existing folders in each user's Maildir (and also edit folder names accordingly in everyone's "subscriptions" file)? Or will Dovecot be broken unless I recopy everything from scratch (with a command-line option to imapsync to put everything in the INBOX destination namespace)? Rich Wales richw at richw.org From stan at hardwarefreak.com Thu Apr 18 10:38:59 2013 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Thu, 18 Apr 2013 02:38:59 -0500 Subject: [Dovecot] Pros and cons of having folders under INBOX vs. not In-Reply-To: <516F980B.3040406@liberation.richw.org> References: <516F980B.3040406@liberation.richw.org> Message-ID: <516FA313.8070109@hardwarefreak.com> On 4/18/2013 1:51 AM, Rich Wales wrote: > I have some questions about whether I should set up folders under > INBOX vs. having them outside the INBOX namespace. > > I'm setting up a new Dovecot 2.2.0 on an Ubuntu 12.04.2 server. > > My plan is to move my users (family members) to this new server from > an old Cyrus server. > > Everybody is currently using (and will continue to use) IMAP, and > either Thunderbird or SquirrelMail as their e-mail client. > > I'm using the maildir mailbox format on this new Dovecot server. > > No one is using the new Dovecot server yet, so I'm still free to do > additional tweaking of the server configuration. > > When I used imapsync to copy everyone's mail to the new server, I > found that all the folders (other than INBOX) were renamed. On the > old Cyrus server, all the folders are subfolders of INBOX, but the > folders on the new Dovecot server are not. (For example, a folder > named "INBOX.Dovecot" on the old server was renamed to "Dovecot" on > the new server by the imapsync utility.) > > Can I just keep things this way on the new server? Or are my users > going to run into problems if folders are not all under INBOX? I > do realize that IMAP servers can be set up either to put everything > under INBOX, or not, but I'm not familiar with all the pros/cons. It's a new server which requires a new MUA configuration, folder subscriptions, etc. Any mail sorting or other folder based MUA rules will have to be rewritten regardless. So the namespace hierarchy shouldn't really matter from a technical standpoint. What matters is if your family members are able and, more importantly, willing, to adapt to a new namespace layout. > And if I do need (or want) to put all the folders under INBOX, can > I simply rename the existing folders in each user's Maildir (and > also edit folder names accordingly in everyone's "subscriptions" > file)? Or will Dovecot be broken unless I recopy everything from > scratch (with a command-line option to imapsync to put everything > in the INBOX destination namespace)? I don't think your directory renaming method will work, at least not in isolation. I think you'll still need to tweak your Dovecot namespace config. -- Stan From f.bonnet at esiee.fr Thu Apr 18 16:21:46 2013 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Thu, 18 Apr 2013 15:21:46 +0200 Subject: [Dovecot] Slooow imap copy to "Sent" folders Message-ID: <516FF36A.1080402@esiee.fr> Hello Many users here use the "copy to Sent folder" using the IMAP protocol with Dovecot 2.1.15 on a FresBSD 9 server. Since few days this operation ( copy to sent folder ) became longer than before , it could takes several seconds to complete even the message is very short. Is there a parameter I could tweak to boost this a bit ? may users complain with reason thank you From freemail.grharry at gmail.com Thu Apr 18 17:59:07 2013 From: freemail.grharry at gmail.com (HL) Date: Thu, 18 Apr 2013 17:59:07 +0300 Subject: [Dovecot] Multiple Logins on same accounts from different stations Message-ID: <51700A3B.6070806@gmail.com> Hi, all I've recently upgraded to 2.1.16 and found my self in deep .... There are 4 accounts in my setup that need to be accessed simultaneously by 5-6 PCs on a local lan. The thing is if a user A updates, deletes, flags mail messages in the imap folders the changes don't get propagated to the other mail clients. To state this clearly, PC (A) thunderbird has an account SALES, Maildir etc PC (B) thunderbird also has the SALES account. Changes from PC (A) and vice-versa like marks,deletes, or moves mails around will randomly get propagated to PC (B) Sometimes they do sometimes they don't. This never occured with previous version 1.2.xx I am attaching my doveconf -a output .. Please Help, Thanks in advance Harry -------------- next part -------------- # 2.1.16 (b63f87ed9311): /etc/dovecot/dovecot.conf # OS: Linux 2.6.24-11-pve x86_64 Debian 6.0.7 auth_anonymous_username = anonymous auth_cache_negative_ttl = 1 hours auth_cache_size = 0 auth_cache_ttl = 1 hours auth_debug = no auth_debug_passwords = no auth_default_realm = auth_failure_delay = 2 secs auth_first_valid_uid = 500 auth_gssapi_hostname = auth_krb5_keytab = auth_last_valid_uid = 0 auth_master_user_separator = auth_mechanisms = plain auth_proxy_self = auth_realms = auth_socket_path = auth-userdb auth_ssl_require_client_cert = no auth_ssl_username_from_cert = no auth_use_winbind = no auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth_username_format = %Lu auth_username_translation = auth_verbose = no auth_verbose_passwords = no auth_winbind_helper_path = /usr/bin/ntlm_auth auth_worker_max_count = 30 base_dir = /var/run/dovecot config_cache_size = 1 M debug_log_path = default_client_limit = 1000 default_idle_kill = 1 mins default_internal_user = dovecot default_login_user = dovenull default_process_limit = 256 default_vsz_limit = 256 M deliver_log_format = msgid=%m: %$ dict_db_config = director_doveadm_port = 0 director_mail_servers = director_servers = director_user_expire = 15 mins director_username_hash = %u disable_plaintext_auth = yes dotlock_use_excl = yes doveadm_allowed_commands = doveadm_password = doveadm_proxy_port = 0 doveadm_socket_path = doveadm-server doveadm_worker_count = 0 dsync_alt_char = _ dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u -l%{lock_timeout} -n%{namespace} first_valid_gid = 1 first_valid_uid = 500 hostname = mail.mydomain.tld imap_capability = imap_client_workarounds = imap_id_log = imap_id_send = imap_idle_notify_interval = 2 mins imap_logout_format = in=%i out=%o imap_max_line_length = 64 k imapc_features = imapc_host = imapc_list_prefix = imapc_master_user = imapc_max_idle_time = 29 mins imapc_password = imapc_port = 143 imapc_rawlog_dir = imapc_ssl = no imapc_ssl_ca_dir = imapc_ssl_verify = yes imapc_user = %u import_environment = TZ info_log_path = instance_name = dovecot last_valid_gid = 0 last_valid_uid = 0 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = libexec_dir = /usr/lib/dovecot listen = *, :: lmtp_address_translate = lmtp_proxy = no lmtp_rcpt_check_quota = no lmtp_save_to_detail_mailbox = no lock_method = fcntl log_path = syslog log_timestamp = "%b %d %H:%M:%S " login_access_sockets = login_greeting = Dovecot ready. login_log_format = %$: %s login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c session=<%{session}> login_trusted_networks = mail_access_groups = mail_attachment_dir = mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} mail_attachment_min_size = 128 k mail_cache_fields = flags mail_cache_min_mail_count = 0 mail_chroot = mail_debug = no mail_fsync = optimized mail_full_filesystem_access = no mail_gid = mail_home = mail_location = maildir:~/Maildir mail_log_prefix = "%s(%u): " mail_max_keyword_length = 50 mail_max_lock_timeout = 0 mail_max_userip_connections = 120 mail_never_cache_fields = imap.envelope mail_nfs_index = no mail_nfs_storage = no mail_plugin_dir = /usr/lib/dovecot/modules mail_plugins = autocreate acl fts fts_solr zlib mail_log notify mail_prefetch_count = 0 mail_privileged_group = mail_save_crlf = no mail_shared_explicit_inbox = yes mail_temp_dir = /tmp mail_temp_scan_interval = 1 weeks mail_uid = mailbox_idle_check_interval = 30 secs mailbox_list_index = no maildir_broken_filename_sizes = no maildir_copy_with_hardlinks = yes maildir_stat_dirs = no maildir_very_dirty_syncs = no managesieve_client_workarounds = managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave master_user_separator = mbox_dirty_syncs = yes mbox_dotlock_change_timeout = 2 mins mbox_lazy_writes = yes mbox_lock_timeout = 5 mins mbox_md5 = apop3d mbox_min_index_size = 0 mbox_read_locks = fcntl mbox_very_dirty_syncs = no mbox_write_locks = dotlock fcntl mdbox_preallocate_space = no mdbox_rotate_interval = 0 mdbox_rotate_size = 2 M mmap_disable = no namespace { disabled = no hidden = no ignore_on_failure = no inbox = no list = yes location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u:CONTROL=~/Maildir/shared/%%u/control prefix = Shared/%%u/ separator = / subscriptions = no type = shared } namespace { disabled = no hidden = no ignore_on_failure = no inbox = no list = yes location = maildir:/var/mail/public:INDEX=~/Maildir/public prefix = Public/ separator = / subscriptions = no type = public } namespace inbox { disabled = no hidden = no ignore_on_failure = no inbox = yes list = yes location = mailbox Drafts { auto = no special_use = \Drafts } mailbox Junk { auto = no special_use = \Junk } mailbox Sent { auto = no special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Trash { auto = no special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = default_fields = deny = no driver = pam master = no override_fields = pass = no } plugin { acl = vfile acl_anyone = allow acl_shared_dict = file:/var/dovecot/shared-mailboxes.db antispam_backend = pipe antispam_mail_notspam = --forget antispam_mail_sendmail = /usr/local/bin/sa-learn-pipe.sh antispam_mail_spam = --spam antispam_mail_tmpdir = /tmp antispam_spam = SPAM antispam_spam_pattern = SPAM antispam_spam_pattern_ignorecase = SPAM antispam_trash_pattern_ignorecase = trash;Deleted * auth_socket_path = /var/run/dovecot/auth-master autocreate = Spam autosubscribe = Public/info fts = solr fts_solr = url=http://10.0.173.34:8080/solr_srv/dovecot/ break-imap-search mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 8 } pop3_client_workarounds = pop3_enable_last = no pop3_fast_size_lookups = no pop3_lock_session = no pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = no pop3_reuse_xuidl = no pop3_save_uidl = no pop3_uidl_duplicates = allow pop3_uidl_format = %08Xu%08Xv pop3c_host = pop3c_master_user = pop3c_password = pop3c_port = 110 pop3c_rawlog_dir = pop3c_ssl = no pop3c_ssl_ca_dir = pop3c_ssl_verify = yes pop3c_user = %u postmaster_address = grharry at mydomain.tld protocols = " imap lmtp sieve" quota_full_tempfail = no recipient_delimiter = + rejection_reason = Your message to <%t> was automatically rejected:%n%r rejection_subject = Rejected: %s replication_full_sync_interval = 12 hours replication_max_conns = 10 replicator_host = replicator replicator_port = 0 sendmail_path = /usr/sbin/sendmail service aggregator { chroot = . client_limit = 0 drop_priv_before_exec = no executable = aggregator extra_groups = fifo_listener replication-notify-fifo { group = mode = 0600 user = } group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replication-notify { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service anvil { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = anvil extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = anvil unix_listener anvil-auth-penalty { group = mode = 0600 user = } unix_listener anvil { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service auth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = auth -w extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener auth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service auth { chroot = client_limit = 0 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-client { group = mode = 0600 user = } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = vmail mode = 0666 user = $default_internal_user } unix_listener login/login { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service config { chroot = client_limit = 0 drop_priv_before_exec = no executable = config extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = config unix_listener config { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service dict { chroot = client_limit = 1 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service director { chroot = . client_limit = 0 drop_priv_before_exec = no executable = director extra_groups = fifo_listener login/proxy-notify { group = mode = 00 user = } group = idle_kill = 4294967295 secs inet_listener { address = port = 0 ssl = no } privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener director-admin { group = mode = 0600 user = } unix_listener director-userdb { group = mode = 0600 user = } unix_listener login/director { group = mode = 00 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dns_client { chroot = client_limit = 1 drop_priv_before_exec = no executable = dns-client extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dns-client { group = mode = 0666 user = } unix_listener login/dns-client { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener doveadm-server { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service imap-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = port = 143 ssl = no } inet_listener imaps { address = port = 993 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 0 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service imap { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener login/imap { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service indexer-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = indexer-worker extra_groups = group = idle_kill = 0 privileged_group = process_limit = 10 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service indexer { chroot = client_limit = 0 drop_priv_before_exec = no executable = indexer extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service ipc { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = ipc extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener ipc { group = mode = 0600 user = } unix_listener login/ipc-proxy { group = mode = 0600 user = $default_login_user } user = $default_internal_user vsz_limit = 18446744073709551615 B } service lmtp { chroot = client_limit = 1 drop_priv_before_exec = no executable = lmtp extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service log { chroot = client_limit = 0 drop_priv_before_exec = no executable = log extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = log unix_listener log-errors { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service managesieve-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = managesieve-login extra_groups = group = idle_kill = 0 inet_listener sieve { address = port = 4190 ssl = no } privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service managesieve { chroot = client_limit = 1 drop_priv_before_exec = no executable = managesieve extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = unix_listener login/sieve { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service pop3-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = pop3-login extra_groups = group = idle_kill = 0 inet_listener pop3 { address = port = 110 ssl = no } inet_listener pop3s { address = port = 995 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = pop3 service_count = 0 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service pop3 { chroot = client_limit = 1 drop_priv_before_exec = no executable = pop3 extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = pop3 service_count = 1 type = unix_listener login/pop3 { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service replicator { chroot = client_limit = 0 drop_priv_before_exec = no executable = replicator extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replicator { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service ssl-params { chroot = client_limit = 0 drop_priv_before_exec = no executable = ssl-params extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = startup unix_listener login/ssl-params { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service stats { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = stats extra_groups = fifo_listener stats-mail { group = mode = 0600 user = } group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener stats { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service tcpwrap { chroot = client_limit = 1 drop_priv_before_exec = no executable = tcpwrap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = user = $default_internal_user vsz_limit = 18446744073709551615 B } shutdown_clients = yes ssl = yes ssl_ca = ssl_cert = References: <516FF36A.1080402@esiee.fr> Message-ID: <1366301674.2414.184.camel@worklian> We have a monopoly ISP who gives terrible upload speeds in their internet packages. it is pretty easy for most offices to flood the upload side of the connection, and when that happens we see the symptoms you describe. Not sure if that is applicable to you, but that is what I check when I get these reports... -- Computerisms Bob Miller 867-334-7117 / 867-633-3760 http://computerisms.ca On Thu, 2013-04-18 at 15:21 +0200, Frank Bonnet wrote: > Hello > > Many users here use the "copy to Sent folder" using the IMAP protocol > with Dovecot 2.1.15 on a FresBSD 9 server. > > Since few days this operation ( copy to sent folder ) became longer > than before , it could takes several seconds to complete even the > message is very short. > > Is there a parameter I could tweak to boost this a bit ? > may users complain with reason > > thank you > From CMarcus at Media-Brokers.com Thu Apr 18 19:54:20 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 18 Apr 2013 12:54:20 -0400 Subject: [Dovecot] Slooow imap copy to "Sent" folders In-Reply-To: <1366301674.2414.184.camel@worklian> References: <516FF36A.1080402@esiee.fr> <1366301674.2414.184.camel@worklian> Message-ID: <5170253C.2020909@Media-Brokers.com> On 2013-04-18 12:14 PM, Bob Miller wrote: > We have a monopoly ISP who gives terrible upload speeds in their > internet packages. it is pretty easy for most offices to flood the > upload side of the connection, and when that happens we see the symptoms > you describe. Not sure if that is applicable to you, but that is what I > check when I get these reports... We deal with a lot of large attachments, so I can't wait for the new 'Submission' agent in dovecot, which will allow someone to write a plugin that will leverage it to automatically save a copy of all sent messages to a designated Sent folder (like gmail does now)... then you can simply disable the 'Save a copy of sent messages to the server' for your dovecot account (if this option is enabled) and it happens automagically from then on. -- Best regards, Charles From CMarcus at Media-Brokers.com Thu Apr 18 19:55:47 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 18 Apr 2013 12:55:47 -0400 Subject: [Dovecot] Multiple Logins on same accounts from different stations In-Reply-To: <51700A3B.6070806@gmail.com> References: <51700A3B.6070806@gmail.com> Message-ID: <51702593.409@Media-Brokers.com> On 2013-04-18 10:59 AM, HL wrote: > I am attaching my doveconf -a output No, no, we need doveconf -n output (changes/settings being used), not -a (all/defaults). -- Best regards, Charles From freemail.grharry at gmail.com Thu Apr 18 20:08:01 2013 From: freemail.grharry at gmail.com (HL) Date: Thu, 18 Apr 2013 20:08:01 +0300 Subject: [Dovecot] Multiple Logins on same accounts from different stations, RE-POSTING Message-ID: <51702871.8070907@gmail.com> Sorry List, I am reposting with dovecot -n ------------------------------------------------------------------ Hi, all I've recently upgraded to 2.1.16 and found my self in deep .... There are 4 accounts in my setup that need to be accessed simultaneously by 5-6 PCs on a local lan. The thing is if a user A updates, deletes, flags mail messages in the imap folders the changes don't get propagated to the other mail clients. To state this clearly, PC (A) thunderbird has an account SALES, Maildir etc PC (B) thunderbird also has the SALES account. Changes from PC (A) and vice-versa like marks,deletes, or moves mails around will randomly get propagated to PC (B) Sometimes they do sometimes they don't. This never occured with previous version 1.2.xx I am attaching my doveconf -a output .. Please Help, Thanks in advance Harry -------------------------------------------------------------------- Thanks -------------- next part -------------- # 2.1.16 (b63f87ed9311): /etc/dovecot/dovecot.conf # OS: Linux 2.6.24-11-pve x86_64 Debian 6.0.7 default_process_limit = 256 hostname = mail.mydomain.tld lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_location = maildir:~/Maildir mail_max_userip_connections = 120 mail_plugins = autocreate acl fts fts_solr zlib mail_log notify managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = no location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u:CONTROL=~/Maildir/shared/%%u/control prefix = Shared/%%u/ separator = / subscriptions = no type = shared } namespace { location = maildir:/var/mail/public:INDEX=~/Maildir/public prefix = Public/ separator = / subscriptions = no type = public } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { driver = pam } plugin { acl = vfile acl_anyone = allow acl_shared_dict = file:/var/dovecot/shared-mailboxes.db antispam_backend = pipe antispam_mail_notspam = --forget antispam_mail_sendmail = /usr/local/bin/sa-learn-pipe.sh antispam_mail_spam = --spam antispam_mail_tmpdir = /tmp antispam_spam = SPAM antispam_spam_pattern = SPAM antispam_spam_pattern_ignorecase = SPAM antispam_trash_pattern_ignorecase = trash;Deleted * auth_socket_path = /var/run/dovecot/auth-master autocreate = Spam autosubscribe = Public/info fts = solr fts_solr = url=http://10.0.173.34:8080/solr_srv/dovecot/ break-imap-search mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 8 } postmaster_address = grharry at mydomain.tld protocols = " imap lmtp sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 } } service imap-login { inet_listener imaps { port = 993 ssl = yes } service_count = 0 } service pop3-login { service_count = 0 } ssl_cert = References: <1366232963.2414.110.camel@worklian> Message-ID: On Wed, Apr 17, 2013 at 6:09 PM, Bob Miller wrote: > Hi, Hi Bob, Thanks a lot for your response. >> : >> lda(sar): Fatal: Unknown argument: sar >> Usage: dovecot-lda [-c ] [-a
] [-d ] [-p ] >> [-f ] [-m ] [-e] [-k] >> >> It happens on messanges that could not be delivered and need to be >> returned to the sender. > > I would think this indicates that lda is trying to deliver the message > to sar when it should be delivering to sar at mondialline.com.br. Probably > you need to adjust your ldap user_attrs and user_filters so it returns > what lda needs, but that is just a guess after a short look at your > mail... Yeap, that's exactly what I guess, but I can't find wich ldap attrs I should return for the user mail adress. :-( >> I also tried to use this way, as documented here: >> http://wiki2.dovecot.org/LDA/Qmail >> | /var/qmail/bin/preline -f /usr/lib/dovecot/dovecot-lda > > This is the way I did it, but I had to add the HOME variable like so: > > |HOME=/home/mail/$USER /var/qmail/bin/preline > -f /usr/local/libexec/dovecot/dovecot-lda I would try it. This way all work fine but sieve vacation didnt. Best Regards, -- Rud? Porto Filgueiras http://python-blog.blogspot.com http://twitter.com/rudaporto From tss at iki.fi Thu Apr 18 22:21:58 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 18 Apr 2013 22:21:58 +0300 Subject: [Dovecot] Multiple Logins on same accounts from different stations, RE-POSTING In-Reply-To: <51702871.8070907@gmail.com> References: <51702871.8070907@gmail.com> Message-ID: On 18.4.2013, at 20.08, HL wrote: > I've recently upgraded to 2.1.16 and found my self in deep .... > > There are 4 accounts in my setup that need to be accessed simultaneously by 5-6 PCs on a local lan. > > The thing is if a user A updates, deletes, flags mail messages in the imap folders the changes don't get propagated to the other > mail clients. > > To state this clearly, > PC (A) thunderbird has an account SALES, Maildir etc > PC (B) thunderbird also has the SALES account. > > Changes from PC (A) and vice-versa like marks,deletes, or moves mails around will randomly get propagated to PC (B) > Sometimes they do sometimes they don't. > This never occured with previous version 1.2.xx Do you mean that the 4 people are using 1 shared account, or do you mean 4 different user accounts are accessing a shared folder (via shared/public namespace)? From tss at iki.fi Thu Apr 18 22:24:05 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 18 Apr 2013 22:24:05 +0300 Subject: [Dovecot] Problem with "convert" Plugin In-Reply-To: <54b8e914e1a4489e9d4b06732a2a3ba1@EXCHANGE.corp.futureweb.at> References: <54b8e914e1a4489e9d4b06732a2a3ba1@EXCHANGE.corp.futureweb.at> Message-ID: <09AB92DC-12A9-45F8-9801-9D1E2AA72B81@iki.fi> On 17.4.2013, at 17.36, Andreas Schnederle-Wagner - Futureweb.at wrote: > I got a Problem with the "convert" Plugin. Trying to convert from mbox to maildir Format. > OS: CentOS release 5.8 (Final) > dovecot -version: 1.0.7 (Centos RPM) > convert Plugin call: convert_mail = mbox:/opt/pop3/%u:INBOX=/var/spool/mail/%u > > When converting to maildir - POP3 works fine (except the lost UIDL - so every server-saved message is double downloaded - but did not find any fix for this problem with convert plugin) No idea, could be a bug in convert plugin. v1.0 is rather old. From tss at iki.fi Thu Apr 18 22:27:12 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 18 Apr 2013 22:27:12 +0300 Subject: [Dovecot] dovecot index errors since 2.1.12 [SOLVED with 2.1.16] In-Reply-To: <20130416210310.GA8842@daniel.localdomain> References: <50D0E224.2050508@imt-systems.com> <20130114151644.GA31122@daniel.localdomain> <20130416210310.GA8842@daniel.localdomain> Message-ID: <748AA474-751B-464F-A30C-B363FB9CB4AD@iki.fi> On 17.4.2013, at 0.03, Daniel Parthey wrote: > Timo Sirainen wrote: >> On 14.1.2013, at 17.16, Daniel Parthey wrote: >> >>> Last week we upgraded to 2.1.13 and since then we encountered the same issues as >>> Morten Stevens. We got a lot of error messages with corrupt index cache >>> and FETCH errors: So we had to roll back to dovecot 2.1.10. Now the errors are gone. >>> >>> Jan 12 16:48:35 10.129.3.233 dovecot: mailbox: mail: imap(user1 at example.org): : Error: Cached message size larger than expected (5194 > 4399) >> >> Does reverting this change also fix it for you? http://hg.dovecot.org/dovecot-2.1/rev/6c1b4b9f527c > > Yes, I can confirm 2.1.16 to be running smoothly without any cache issues. > Thanks, Timo! Do you mean it works even without reverting that change? (I didn't do any changes to that code..) From tss at iki.fi Thu Apr 18 22:28:11 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 18 Apr 2013 22:28:11 +0300 Subject: [Dovecot] dovecot index errors since 2.1.12 [SOLVED with 2.1.16] In-Reply-To: <748AA474-751B-464F-A30C-B363FB9CB4AD@iki.fi> References: <50D0E224.2050508@imt-systems.com> <20130114151644.GA31122@daniel.localdomain> <20130416210310.GA8842@daniel.localdomain> <748AA474-751B-464F-A30C-B363FB9CB4AD@iki.fi> Message-ID: On 18.4.2013, at 22.27, Timo Sirainen wrote: > On 17.4.2013, at 0.03, Daniel Parthey wrote: > >> Timo Sirainen wrote: >>> On 14.1.2013, at 17.16, Daniel Parthey wrote: >>> >>>> Last week we upgraded to 2.1.13 and since then we encountered the same issues as >>>> Morten Stevens. We got a lot of error messages with corrupt index cache >>>> and FETCH errors: So we had to roll back to dovecot 2.1.10. Now the errors are gone. >>>> >>>> Jan 12 16:48:35 10.129.3.233 dovecot: mailbox: mail: imap(user1 at example.org): : Error: Cached message size larger than expected (5194 > 4399) >>> >>> Does reverting this change also fix it for you? http://hg.dovecot.org/dovecot-2.1/rev/6c1b4b9f527c >> >> Yes, I can confirm 2.1.16 to be running smoothly without any cache issues. >> Thanks, Timo! > > Do you mean it works even without reverting that change? (I didn't do any changes to that code..) Oh, right, I browsed back this thread and found the change that really fixed it :) From tss at iki.fi Thu Apr 18 23:19:41 2013 From: tss at iki.fi (Timo Sirainen) Date: Thu, 18 Apr 2013 23:19:41 +0300 Subject: [Dovecot] listen directive changed? In-Reply-To: References: <1D989A1A-F648-4647-A3A9-CC5481A54300@iki.fi> Message-ID: <9C28489A-0F74-4679-833A-1A1FD1458EB7@iki.fi> On 18.4.2013, at 2.36, Nick Edwards wrote: > I do not get warnings, and, > > listen = *, ::1, 2001:470:some:subnet::ffff > > _snip_ > inet_listener imap { > address = *,[::] > port = 143 > ... > > same with pop3 > > If I use 2001:470:some:subnet::2222 dovecot (2.1.16) answers If you override the imap+pop3 inet_listener, then yes it overrides the default listen setting and Dovecot listens on [::]. What did you want to happen? From voytek at sbt.net.au Thu Apr 18 23:48:53 2013 From: voytek at sbt.net.au (voytek at sbt.net.au) Date: Fri, 19 Apr 2013 06:48:53 +1000 Subject: [Dovecot] ot: moving files/dirs from terminal ? Message-ID: warning, dumb question ahead: I want to re-arrange, rename & create some sub directories below INBOX in my own mailbox; if I use 'mc' from terminal to do so, can that cause me grief...? do I need to ?? re-index explicitly?? afterwards ? how to re-index ? or is that a really _B_ad idea, and, I should do it through say squirrelmail client ? thanks for any pointers! # dovecot --version 2.1.1 INBOX mail path /var/spool/mail/vhosts/dom.tld/voytek at dom.tld From h.reindl at thelounge.net Thu Apr 18 23:54:20 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 18 Apr 2013 22:54:20 +0200 Subject: [Dovecot] ot: moving files/dirs from terminal ? In-Reply-To: References: Message-ID: <51705D7C.60503@thelounge.net> Am 18.04.2013 22:48, schrieb voytek at sbt.net.au: > warning, dumb question ahead: > > I want to re-arrange, rename & create some sub directories below INBOX in > my own mailbox; > > if I use 'mc' from terminal to do so, can that cause me grief...? nobody does this with mc any mail-client suppports drag&drop to move messages and folders -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From tss at iki.fi Fri Apr 19 00:41:26 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 19 Apr 2013 00:41:26 +0300 Subject: [Dovecot] v2.2.1 released Message-ID: <51FA2BDC-A85B-46DF-9ABF-0DA0849D47FE@iki.fi> http://dovecot.org/releases/2.2/dovecot-2.2.1.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.1.tar.gz.sig - mailbox_list_index=yes was broken. - LAYOUT=index didn't list subscriptions. - auth: Multiple master passdbs didn't work. - Message parsing (e.g. during search) crashed when multipart message didn't actually contain any parts. From nick.z.edwards at gmail.com Fri Apr 19 01:53:54 2013 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Fri, 19 Apr 2013 08:53:54 +1000 Subject: [Dovecot] listen directive changed? In-Reply-To: <9C28489A-0F74-4679-833A-1A1FD1458EB7@iki.fi> References: <1D989A1A-F648-4647-A3A9-CC5481A54300@iki.fi> <9C28489A-0F74-4679-833A-1A1FD1458EB7@iki.fi> Message-ID: So what is the point of the global? I commented out the address in inet_listener, assuming it then will use global, but no, cant connect at all then. Should for clarification, should we not use global entry and rely on inet_listener? Or should there be a change so inet_listener pulls its addresses from global if no address is provided in inet_listener statements it seems at present to be two competing options. On 4/19/13, Timo Sirainen wrote: > On 18.4.2013, at 2.36, Nick Edwards wrote: > >> I do not get warnings, and, >> >> listen = *, ::1, 2001:470:some:subnet::ffff >> >> _snip_ >> inet_listener imap { >> address = *,[::] >> port = 143 >> ... >> >> same with pop3 >> >> If I use 2001:470:some:subnet::2222 dovecot (2.1.16) answers > > If you override the imap+pop3 inet_listener, then yes it overrides the > default listen setting and Dovecot listens on [::]. What did you want to > happen? > > From tss at iki.fi Fri Apr 19 01:56:55 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 19 Apr 2013 01:56:55 +0300 Subject: [Dovecot] listen directive changed? In-Reply-To: References: <1D989A1A-F648-4647-A3A9-CC5481A54300@iki.fi> <9C28489A-0F74-4679-833A-1A1FD1458EB7@iki.fi> Message-ID: On 19.4.2013, at 1.53, Nick Edwards wrote: > So what is the point of the global? > I commented out the address in inet_listener, assuming it then will > use global, but no, cant connect at all then. If you comment out the address in inet_listener, it does use the global listen setting. I don't know why you can't connect at all then. Either the global listen setting is wrong or there's a bug in code that parses it. From marc at perkel.com Fri Apr 19 05:24:05 2013 From: marc at perkel.com (Marc Perkel) Date: Thu, 18 Apr 2013 19:24:05 -0700 Subject: [Dovecot] v2.2.1 released In-Reply-To: <51FA2BDC-A85B-46DF-9ABF-0DA0849D47FE@iki.fi> References: <51FA2BDC-A85B-46DF-9ABF-0DA0849D47FE@iki.fi> Message-ID: <5170AAC5.5020507@perkel.com> Message search is FIXED! On 4/18/2013 2:41 PM, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.1.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.1.tar.gz.sig > > - mailbox_list_index=yes was broken. > - LAYOUT=index didn't list subscriptions. > - auth: Multiple master passdbs didn't work. > - Message parsing (e.g. during search) crashed when multipart message > didn't actually contain any parts. > > > > From kengheng at mysql.cc Fri Apr 19 06:50:08 2013 From: kengheng at mysql.cc (kengheng) Date: Fri, 19 Apr 2013 11:50:08 +0800 Subject: [Dovecot] Make install error Message-ID: <5170BEF0.6060306@mysql.cc> Hi, I'm recompiling dovecot 2.2.0/2.2.1 with error below during make install: test -z "/usr/local/dovecot/lib/dovecot/auth" || /usr/bin/mkdir -p "/usr/local/dovecot/lib/dovecot/auth" /usr/bin/mkdir: cannot create directory ?/usr/local/dovecot/lib/dovecot/auth?: File exists make[3]: *** [install-auth_moduleLTLIBRARIES] Error 1 make[3]: Leaving directory `/usr/local/src/dovecot-2.2.1/src/auth' make[2]: *** [install-am] Error 2 make[2]: Leaving directory `/usr/local/src/dovecot-2.2.1/src/auth' make[1]: *** [install-recursive] Error 1 make[1]: Leaving directory `/usr/local/src/dovecot-2.2.1/src' make: *** [install-recursive] Error 1 The target Svr OS: OpenSuse 12.2 x86 and installed success for qmail/vpopmail. The configuration for dovecot as below: ./configure \ --prefix=/usr/local/dovecot \ --with-vpopmail \ --with-docs \ --with-ssl \ --without-shadow \ --without-pam \ --without-ldap \ --without-pgsql \ --without-sql \ --without-mysql \ --without-sqlite Thanks, KH. Chan From freemail.grharry at gmail.com Fri Apr 19 08:39:59 2013 From: freemail.grharry at gmail.com (HL) Date: Fri, 19 Apr 2013 08:39:59 +0300 Subject: [Dovecot] Multiple Logins on same accounts from different stations, RE-POSTING In-Reply-To: References: <51702871.8070907@gmail.com> Message-ID: <5170D8AF.4000304@gmail.com> On 18/04/2013 10:21 ??, Timo Sirainen wrote: > On 18.4.2013, at 20.08, HL wrote: >> I've recently upgraded to 2.1.16 and found my self in deep .... >> >> There are 4 accounts in my setup that need to be accessed simultaneously by 5-6 PCs on a local lan. >> >> The thing is if a user A updates, deletes, flags mail messages in the imap folders the changes don't get propagated to the other >> mail clients. >> >> To state this clearly, >> PC (A) thunderbird has an account SALES, Maildir etc >> PC (B) thunderbird also has the SALES account. >> >> Changes from PC (A) and vice-versa like marks,deletes, or moves mails around will randomly get propagated to PC (B) >> Sometimes they do sometimes they don't. >> This never occured with previous version 1.2.xx > Do you mean that the 4 people are using 1 shared account, or do you mean 4 different user accounts are accessing a shared folder (via shared/public namespace)? > Yes 4 people are using all 4 shared accounts. ( No Shared or Public Namespaces for them ) They all login from their client to these 4 accounts, with 4 distinct userNames and passwords. They prefer it this way. From cryptodan at gmail.com Fri Apr 19 08:49:09 2013 From: cryptodan at gmail.com (Daniel Reinhardt) Date: Fri, 19 Apr 2013 01:49:09 -0400 Subject: [Dovecot] Multiple Logins on same accounts from different stations, RE-POSTING In-Reply-To: <5170D8AF.4000304@gmail.com> References: <51702871.8070907@gmail.com> <5170D8AF.4000304@gmail.com> Message-ID: In all honesty with this setup, I would recommend that you setup a sales at domain alias account and put these 4 accounts within that alias. Each user would then get a single copy of the message, and would prevent accidental deletion by another user. It is never wise to allow multiple people to login to one account from multiple locations. One user can move data to another folder and another user may not like that other persons method of organization. On Fri, Apr 19, 2013 at 1:39 AM, HL wrote: > On 18/04/2013 10:21 ??, Timo Sirainen wrote: > >> On 18.4.2013, at 20.08, HL wrote: >> >>> I've recently upgraded to 2.1.16 and found my self in deep .... >>> >>> There are 4 accounts in my setup that need to be accessed simultaneously >>> by 5-6 PCs on a local lan. >>> >>> The thing is if a user A updates, deletes, flags mail messages in the >>> imap folders the changes don't get propagated to the other >>> mail clients. >>> >>> To state this clearly, >>> PC (A) thunderbird has an account SALES, Maildir etc >>> PC (B) thunderbird also has the SALES account. >>> >>> Changes from PC (A) and vice-versa like marks,deletes, or moves mails >>> around will randomly get propagated to PC (B) >>> Sometimes they do sometimes they don't. >>> This never occured with previous version 1.2.xx >>> >> Do you mean that the 4 people are using 1 shared account, or do you mean >> 4 different user accounts are accessing a shared folder (via shared/public >> namespace)? >> >> Yes 4 people are using all 4 shared accounts. ( No Shared or Public > Namespaces for them ) > They all login from their client to these 4 accounts, with 4 distinct > userNames and passwords. > They prefer it this way. > > > > > -- Daniel Reinhardt cryptodan at cryptodan.net http://www.cryptodan.net 301-875-7018(c) 410-455-0488(h) From eray.aslan at caf.com.tr Fri Apr 19 08:53:45 2013 From: eray.aslan at caf.com.tr (Eray Aslan) Date: Fri, 19 Apr 2013 08:53:45 +0300 Subject: [Dovecot] Pigeonhole for 2.2? (was: v2.2.1 released) In-Reply-To: <51FA2BDC-A85B-46DF-9ABF-0DA0849D47FE@iki.fi> References: <51FA2BDC-A85B-46DF-9ABF-0DA0849D47FE@iki.fi> Message-ID: <20130419055344.GA2874@gaby.caf.local> On Fri, Apr 19, 2013 at 12:41:26AM +0300, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.1.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.1.tar.gz.sig Thanks. Any idea about when pigeonhole (v0.4.0?) for dovecot-2.2 will be released? -- Eray Aslan From pvsuja at gmail.com Fri Apr 19 08:55:51 2013 From: pvsuja at gmail.com (pvsuja) Date: Thu, 18 Apr 2013 22:55:51 -0700 (PDT) Subject: [Dovecot] IMAP monitoring Message-ID: <1366350951067-41723.post@n4.nabble.com> Dear Sir, I want to get some statistics of dovecot IMAP server like the number of current IMAP connections, who is logged in to the Dovecot server, bandwidth usage. Is there any utility which does this sort of full monitoring? I tried doveadm who to get the details of logged in users. but its not returning any output even though i am logged in to the server. Thanks and regards, Suja -- View this message in context: http://dovecot.2317879.n4.nabble.com/IMAP-monitoring-tp41723.html Sent from the Dovecot mailing list archive at Nabble.com. From freemail.grharry at gmail.com Fri Apr 19 09:06:07 2013 From: freemail.grharry at gmail.com (HL) Date: Fri, 19 Apr 2013 09:06:07 +0300 Subject: [Dovecot] Multiple Logins on same accounts from different stations, RE-POSTING In-Reply-To: References: <51702871.8070907@gmail.com> <5170D8AF.4000304@gmail.com> Message-ID: <5170DECF.6070305@gmail.com> On 19/04/2013 08:49 ??, Daniel Reinhardt wrote: > In all honesty with this setup, I would recommend that you setup a > sales at domain alias account and put these 4 accounts within that > alias. Each user would then get a single copy of the message, and > would prevent accidental deletion by another user. > > It is never wise to allow multiple people to login to one account from > multiple locations. One user can move data to another folder and > another user may not like that other persons method of organization. > Thanks for your contribution however I think you reply on a different issue, that is Business internal procedures and organization. My users have the appropriate setup that supports your point of view plus ... shared folders, Public Folders, aliases ... name it. However they prefer it this way for some reason that beats me. Mainly the issue here is the IMAP protocol and communication between mail client and server. Thanks. From jtam.home at gmail.com Fri Apr 19 09:11:18 2013 From: jtam.home at gmail.com (Joseph Tam) Date: Thu, 18 Apr 2013 23:11:18 -0700 (PDT) Subject: [Dovecot] IMAP monitoring In-Reply-To: References: Message-ID: > From: pvsuja > > I want to get some statistics of dovecot IMAP server like the number of > current IMAP connections, who is logged in to the Dovecot server, doveadm who > bandwidth usage. You can sort of get that from the logs. For example, from my logs Apr 18 23:08:19 server dovecot: imap(user): Disconnected: Logged out in=9516 out=89038 telling you how many bytes tranferred in and out during the session. > Is there any utility which does this sort of full monitoring? > I tried doveadm who to get the details of logged in users. > but its not returning any output even though i am logged in to the server. "doveadm who" ought to work. What does it return? Joseph Tam From nmilas at noa.gr Fri Apr 19 09:59:12 2013 From: nmilas at noa.gr (Nikolaos Milas) Date: Fri, 19 Apr 2013 09:59:12 +0300 Subject: [Dovecot] Dovecot Failover Message-ID: <5170EB40.7010103@noa.gr> Hello, Assuming we have two (low traffic) servers (on different data centers) replicated using dsync, what is the best way to automatically direct users to the main server when it is up and to the redundant one when the main server is down? Using DNS? I've seen that DNS-based failover has generally issues (for example: http://serverfault.com/questions/60553/why-is-dns-failover-not-recommended, which is informative although it refers to web servers). What is the suggested approach? HAProxy? Heartbeat/Pacemaker? Any advice will be appreciated. Thanks and regards, Nick From tss at iki.fi Fri Apr 19 10:43:08 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 19 Apr 2013 10:43:08 +0300 Subject: [Dovecot] Dovecot Failover In-Reply-To: <5170EB40.7010103@noa.gr> References: <5170EB40.7010103@noa.gr> Message-ID: On 19.4.2013, at 9.59, Nikolaos Milas wrote: > Assuming we have two (low traffic) servers (on different data centers) replicated using dsync, what is the best way to automatically direct users to the main server when it is up and to the redundant one when the main server is down? > > Using DNS? I've seen that DNS-based failover has generally issues (for example: http://serverfault.com/questions/60553/why-is-dns-failover-not-recommended, which is informative although it refers to web servers). > > What is the suggested approach? HAProxy? Heartbeat/Pacemaker? Well, there are two failure reasons: a) Dovecot server fails. For that, you could use any kind of a proxy that redirects traffic to the other server (even Dovecot proxy on another server). b) Network connection to the whole data center dies, or the whole data center loses power or otherwise dies. There's really no other choice to failover that than DNS, unless you manage to route the same IP address to two different data centers and just update the route. I'd be more worried about b), since you can already fix a) pretty quickly with VMs. Or a) could also be switched to become a Dovecot proxy on demand if there's a bigger problem that can't be immediately fixed. From tss at iki.fi Fri Apr 19 10:49:34 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 19 Apr 2013 10:49:34 +0300 Subject: [Dovecot] Dovecot Failover In-Reply-To: References: <5170EB40.7010103@noa.gr> Message-ID: <8137242A-8008-4B53-9C57-48844CAF5DA9@iki.fi> On 19.4.2013, at 10.43, Timo Sirainen wrote: > On 19.4.2013, at 9.59, Nikolaos Milas wrote: > >> Assuming we have two (low traffic) servers (on different data centers) replicated using dsync, what is the best way to automatically direct users to the main server when it is up and to the redundant one when the main server is down? >> >> Using DNS? I've seen that DNS-based failover has generally issues (for example: http://serverfault.com/questions/60553/why-is-dns-failover-not-recommended, which is informative although it refers to web servers). BTW. I'm kind of hoping that if dsync replication becomes more commonly used with people commonly setting up two A records for the IMAP server, the IMAP clients would evolve to support this by trying out all the listed IPs. Web browsers already do this nowadays (and that's why I think your URL is a bit out of date). From skdovecot at smail.inf.fh-brs.de Fri Apr 19 10:59:33 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 19 Apr 2013 09:59:33 +0200 (CEST) Subject: [Dovecot] Slooow imap copy to "Sent" folders In-Reply-To: <5170253C.2020909@Media-Brokers.com> References: <516FF36A.1080402@esiee.fr> <1366301674.2414.184.camel@worklian> <5170253C.2020909@Media-Brokers.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 18 Apr 2013, Charles Marcus wrote: > We deal with a lot of large attachments, so I can't wait for the new > 'Submission' agent in dovecot, which will allow someone to write a plugin > that will leverage it to automatically save a copy of all sent messages to a > designated Sent folder (like gmail does now)... then you can simply disable > the 'Save a copy of sent messages to the server' for your dovecot account (if > this option is enabled) and it happens automagically from then on. Do you have access to the MTA your users are submitting their mails to? If so, you could add the sender as BCC / envelope recipient with a default folder to drop off the message, e.g. with sub addressing "sender+Sent at sender-domain". Well, because you need to reconfigure each MUA, you could add the BCC there. That way, the message is transmitted only once and has the message queueid in its header for debugging purposes. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUXD5ZV3r2wJMiz2NAQJyJQgAn+AuRjbvo739l0YyTWviDoKGCnwAGU7Q 4JZTXNw+/91lZkNjvg8Cbkw1704zfL+XWFJER7LW+YQ8gkirOsaXfyBCE9SuRuly XmNN4utRGjq6OqJ5XuRq/ueCyu/DxEZ5T1GVzXvkawcm1vrOV406RFwTkxTUSy4q zgDNhtrNXKJ2bTZaBDGxWRr3If1PuyDTYGKO/aQvc47gLO802vu3xVUiG7Lve028 Udry05hHfS+n/pcddEOcw6FohPLF1rPx6aOqZgemxnzTjTO39+urzndB5x/Pu38T EsR8zIjcckEKug9FFAjpiCzvOs6gIR55M+UzTNdYdR79R69HbFkTZA== =F4aq -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Fri Apr 19 11:06:16 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 19 Apr 2013 10:06:16 +0200 (CEST) Subject: [Dovecot] Multiple Logins on same accounts from different stations, RE-POSTING In-Reply-To: References: <51702871.8070907@gmail.com> <5170D8AF.4000304@gmail.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 19 Apr 2013, Daniel Reinhardt wrote: > In all honesty with this setup, I would recommend that you setup a > sales at domain alias account and put these 4 accounts within that alias. > Each user would then get a single copy of the message, and would prevent > accidental deletion by another user. when one customer gets 4 different answers to one question, this setup to split one message 4 times makes trouble. > It is never wise to allow multiple people to login to one account from > multiple locations. One user can move data to another folder and another > user may not like that other persons method of organization. That's an organisational problem and depends on the function of the mail account. In fact, I don't like multiple humans using one account, because you cannot really log, who did what. That makes shared mailboxes superior. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUXD6+F3r2wJMiz2NAQJjJQf+MNqjXMASwxtIu0+F1urOJhuTN06pDHTH LsiZidkGEyfqagC+irOkJzl34M4JzplHJCHPZbPQqWNvua0v2Kr23HBxh3yvoFIY 9NKLRcuLoylx0bK66vZA26LLtlIlmGgQZF7ugO1KWwNfQg8bjY0ec7Xhyssom0jc 3KoQf0JAiVXwmM118GmdMaE4QpMKvbADtkkvR83fyBJXWqACgRJJJenXAaSsPEQs bHEyeVJxyl/Fv9AZKMqYkp7zRk2UZhnxRcUNQ6M0Hm5hZTkuPeJjMsMiFE8nq+56 WSYuqTjfFVZmPaSZzZNz9+vmjoWsh59WkN82tjP5p/WPZFplK0N9sg== =91O/ -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Fri Apr 19 11:16:47 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 19 Apr 2013 10:16:47 +0200 (CEST) Subject: [Dovecot] Multiple Logins on same accounts from different stations, RE-POSTING In-Reply-To: <51702871.8070907@gmail.com> References: <51702871.8070907@gmail.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 18 Apr 2013, HL wrote: > There are 4 accounts in my setup that need to be accessed simultaneously by > 5-6 PCs on a local lan. > > The thing is if a user A updates, deletes, flags mail messages in the imap > folders the changes don't get propagated to the other > mail clients. > > To state this clearly, > PC (A) thunderbird has an account SALES, Maildir etc > PC (B) thunderbird also has the SALES account. We had similiar problem with Dovecot. I have a mail account shared by 3 users, which communicate with labels/keywords/flags with each other, what to do with the message, until it is moved to "done" eventually. Even the new and replied status was not shared with a running Thunderbird. Telnet and non-caching MUAs showed the changed status fine, hence, it was a problem TB getting the changes. I never pinpointed the problem, never got errors in TB or Dovecot, but after I replaced TB with another, newer version and re-created the profile anew, the problem went away. Those three users definitly never changed the TB configuration themselves :-) so I really suspect some problem with the cache of TB. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUXD9b13r2wJMiz2NAQLHgwf/S/r8GYahN0h7PJj6mplmUoEwAf069jNT 98izuRYYrLaeu7eqJHYx/4AVzW99ngjAvY/bDctQGxYHfcVIc9npuKUkYYHcM51n 4yOf+DALgRQaNaYmKH69ajSl28VXOjFFin7U7IfiRLJDIaOVyfVi06QBfIJoHEDZ Hks7nGolO1Bh+uHs9MySQQ9oS8ofTqOq3n0OUh+9s19FJCDiA/2PxEI4LR65dxNf QP+RI9w5JfkQp2cadYHDlTSgWhm0gSunSMn2CKBvgVs09s0EaitaYHzTo8hMx4Sb gU02B90t9ZSAlIos2mU7u8nPYoiAhr0ZfGor8M+FvxwePfiKM+1X9w== =o4Ra -----END PGP SIGNATURE----- From tss at iki.fi Fri Apr 19 11:17:02 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 19 Apr 2013 11:17:02 +0300 Subject: [Dovecot] Multiple Logins on same accounts from different stations, RE-POSTING In-Reply-To: <5170D8AF.4000304@gmail.com> References: <51702871.8070907@gmail.com> <5170D8AF.4000304@gmail.com> Message-ID: <59BC676F-5E55-40F0-AF60-F2565E9A5A07@iki.fi> On 19.4.2013, at 8.39, HL wrote: >>> Changes from PC (A) and vice-versa like marks,deletes, or moves mails around will randomly get propagated to PC (B) >>> Sometimes they do sometimes they don't. >>> This never occured with previous version 1.2.xx >> Do you mean that the 4 people are using 1 shared account, or do you mean 4 different user accounts are accessing a shared folder (via shared/public namespace)? >> > Yes 4 people are using all 4 shared accounts. ( No Shared or Public Namespaces for them ) > They all login from their client to these 4 accounts, with 4 distinct userNames and passwords. > They prefer it this way. That's still a bit confusing .. It's 4 shared accounts, because there are 4 different mailboxes, not because there are 4 people? If there were different accounts accessing the same shared mailbox, I could see why it might sometimes not notice all the latest changes (because they'd be using different index files then and might miss changes in maildir - although even that shouldn't happen). But if the clients aren't seeing changes for the same shared account, then I can't really think of any good reason for your problem. All clients are notified of all changes when Dovecot sees them. There shouldn't be any change from how v1.2 worked. From skdovecot at smail.inf.fh-brs.de Fri Apr 19 11:23:17 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 19 Apr 2013 10:23:17 +0200 (CEST) Subject: [Dovecot] ot: moving files/dirs from terminal ? In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 19 Apr 2013, voytek at sbt.net.au wrote: > I want to re-arrange, rename & create some sub directories below INBOX in > my own mailbox; > > if I use 'mc' from terminal to do so, can that cause me grief...? Yes, you need to know the internals of your mail storage. Actually I do something like this from the command line with Maildir sometimes. Maybe you cause your client to redownload all messages again, maybe duplicate them or make messages inaccessable. > do I need to ?? re-index explicitly?? afterwards ? how to re-index ? Maybe, it depends on the storage you are using. With mbox and Maildir Dovecot should detect the change and re-index itself. > or is that a really _B_ad idea, and, I should do it through say > squirrelmail client ? That's on the sure side of life. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUXD+9V3r2wJMiz2NAQL6Vgf8DtpUM8RdMR8/KXzcF5XBxSSPC2c4H5m8 xOvVwOMAsx5UG4owgkuImJb7ob3PTw2EX32xj1p2/5LyGXK9DD5LLORgAy9DXJ5y Gh51pRSsQ+P67amp62MbgiZIJ7u7mEXOlvZsJyWBfVLSOflwyzR8sPNfpQLpzNSu onLUuhEr4FG6RO1Xo5Yz0Pdgqo5ZgluOJg/GZk7HiC8Vhw4pd44OMi20WZX4RMvR tuYhxUWbVRiYhFNZu2l/r4dvL8r7TK6KwgkFyXVXWakzT5PZvibuvlRWFTTod0j/ lj4vQL1HqzcSH/6QUXST+fW+T2nCJT4mXNQoAIixqKPw6lF/kgTLvg== =uNhu -----END PGP SIGNATURE----- From leva at ecentrum.hu Fri Apr 19 12:06:22 2013 From: leva at ecentrum.hu (LEVAI Daniel) Date: Fri, 19 Apr 2013 11:06:22 +0200 Subject: [Dovecot] [Dovecot-news] v2.2.1 released In-Reply-To: <51FA2BDC-A85B-46DF-9ABF-0DA0849D47FE@iki.fi> References: <51FA2BDC-A85B-46DF-9ABF-0DA0849D47FE@iki.fi> Message-ID: <20130419090621.GA8846@daniell-kurt.KURTHQ.local> On p, ?pr 19, 2013 at 00:41:26 +0300, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.1.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.1.tar.gz.sig [...] On OpenBSD 5.2-stable: $ ./configure --disable-static --with-statedir=/var/dovecot --sysconfdir=/etc --localstatedir=/var \ --mandir='${prefix}/man' --with-ssldir=/etc/ssl \ --with-notify=kqueue --with-ioloop=kqueue --with-ssl=openssl \ --without-pam --without-shadow --without-nss --without-vpopmail --with-pgsql \ --with-solr --with-zlib --with-storages=maildir --with-pic \ --with-libiconv-prefix=/usr/local/ && \ make [...] /bin/sh ../../libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I../.. -I/usr/local/include -I/usr/local//include -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/include -fstack-protector -MT net.lo -MD -MP -MF .deps/net.Tpo -c -o net.lo net.c libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -I/usr/local/include -I/usr/local//include -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/include -fstack-protector -MT net.lo -MD -MP -MF .deps/net.Tpo -c net.c -fPIC -DPIC -o .libs/net.o net.c: In function 'net_getunixcred': net.c:731: error: storage size of 'ucred' isn't known net.c:731: warning: unused variable 'ucred' *** Error code 1 Stop in /home/daniell/dovecot/dovecot-2.2.1/src/lib (line 883 of Makefile). *** Error code 1 Stop in /home/daniell/dovecot/dovecot-2.2.1/src/lib (line 645 of Makefile). *** Error code 1 Stop in /home/daniell/dovecot/dovecot-2.2.1/src (line 390 of Makefile). *** Error code 1 Stop in /home/daniell/dovecot/dovecot-2.2.1 (line 517 of Makefile). *** Error code 1 Stop in /home/daniell/dovecot/dovecot-2.2.1 (line 350 of Makefile). ----------------------------------8<---------------------------------- Somehow configure didn't define HAVE_STRUCT_SOCKPEERCRED to 1 in config.h, but I can not untangle the autoconf magic right now. Daniel -- L?VAI D?niel PGP key ID = 0x83B63A8F Key fingerprint = DBEC C66B A47A DFA2 792D 650C C69B BE4C 83B6 3A8F From leva at ecentrum.hu Fri Apr 19 12:17:24 2013 From: leva at ecentrum.hu (LEVAI Daniel) Date: Fri, 19 Apr 2013 11:17:24 +0200 Subject: [Dovecot] [Dovecot-news] v2.2.1 released In-Reply-To: <20130419090621.GA8846@daniell-kurt.KURTHQ.local> References: <51FA2BDC-A85B-46DF-9ABF-0DA0849D47FE@iki.fi> <20130419090621.GA8846@daniell-kurt.KURTHQ.local> Message-ID: <20130419091724.GB8846@daniell-kurt.KURTHQ.local> On p, ?pr 19, 2013 at 11:06:22 +0200, LEVAI Daniel wrote: > On p, ?pr 19, 2013 at 00:41:26 +0300, Timo Sirainen wrote: > > http://dovecot.org/releases/2.2/dovecot-2.2.1.tar.gz > > http://dovecot.org/releases/2.2/dovecot-2.2.1.tar.gz.sig > [...] > > On OpenBSD 5.2-stable: .. and -current. > $ ./configure --disable-static --with-statedir=/var/dovecot --sysconfdir=/etc --localstatedir=/var \ > --mandir='${prefix}/man' --with-ssldir=/etc/ssl \ > --with-notify=kqueue --with-ioloop=kqueue --with-ssl=openssl \ > --without-pam --without-shadow --without-nss --without-vpopmail --with-pgsql \ > --with-solr --with-zlib --with-storages=maildir --with-pic \ > --with-libiconv-prefix=/usr/local/ && \ > make The missing information from configure: [...] checking ucred.h usability... no checking ucred.h presence... no checking for ucred.h... no checking sys/ucred.h usability... no checking sys/ucred.h presence... yes configure: WARNING: sys/ucred.h: present but cannot be compiled configure: WARNING: sys/ucred.h: check for missing prerequisite headers? configure: WARNING: sys/ucred.h: see the Autoconf documentation configure: WARNING: sys/ucred.h: section "Present But Cannot Be Compiled" configure: WARNING: sys/ucred.h: proceeding with the compiler's result configure: WARNING: ## ---------------------------------- ## configure: WARNING: ## Report this to dovecot at dovecot.org ## configure: WARNING: ## ---------------------------------- ## checking for sys/ucred.h... no [...] Daniel -- L?VAI D?niel PGP key ID = 0x83B63A8F Key fingerprint = DBEC C66B A47A DFA2 792D 650C C69B BE4C 83B6 3A8F From christian.wiese at securepoint.de Fri Apr 19 12:33:24 2013 From: christian.wiese at securepoint.de (Christian Wiese) Date: Fri, 19 Apr 2013 11:33:24 +0200 Subject: [Dovecot] [Dovecot-news] v2.2.1 released In-Reply-To: <20130419091724.GB8846@daniell-kurt.KURTHQ.local> References: <51FA2BDC-A85B-46DF-9ABF-0DA0849D47FE@iki.fi> <20130419090621.GA8846@daniell-kurt.KURTHQ.local> <20130419091724.GB8846@daniell-kurt.KURTHQ.local> Message-ID: <20130419113324.7a088c22@cw-desktop> Hi, inspecting the config.log file created by the configure script might be more useful to analyze the issue, than what you pasted. Cheers Chris Am Fri, 19 Apr 2013 11:17:24 +0200 schrieb LEVAI Daniel : > On p, ?pr 19, 2013 at 11:06:22 +0200, LEVAI Daniel wrote: > > On p, ?pr 19, 2013 at 00:41:26 +0300, Timo Sirainen wrote: > > > http://dovecot.org/releases/2.2/dovecot-2.2.1.tar.gz > > > http://dovecot.org/releases/2.2/dovecot-2.2.1.tar.gz.sig > > [...] > > > > On OpenBSD 5.2-stable: > .. and -current. > > > > $ ./configure --disable-static --with-statedir=/var/dovecot > > --sysconfdir=/etc --localstatedir=/var \ --mandir='${prefix}/man' > > --with-ssldir=/etc/ssl \ --with-notify=kqueue --with-ioloop=kqueue > > --with-ssl=openssl \ --without-pam --without-shadow --without-nss > > --without-vpopmail --with-pgsql \ --with-solr --with-zlib > > --with-storages=maildir --with-pic \ > > --with-libiconv-prefix=/usr/local/ && \ make > > The missing information from configure: > [...] > checking ucred.h usability... no > checking ucred.h presence... no > checking for ucred.h... no > checking sys/ucred.h usability... no > checking sys/ucred.h presence... yes > configure: WARNING: sys/ucred.h: present but cannot be compiled > configure: WARNING: sys/ucred.h: check for missing prerequisite > headers? > configure: WARNING: sys/ucred.h: see the Autoconf documentation > configure: WARNING: sys/ucred.h: section "Present But Cannot Be > Compiled" > configure: WARNING: sys/ucred.h: proceeding with the compiler's result > configure: WARNING: ## ---------------------------------- ## > configure: WARNING: ## Report this to dovecot at dovecot.org ## > configure: WARNING: ## ---------------------------------- ## > checking for sys/ucred.h... no > [...] > > > Daniel > -- Kind regards, Mit freundlichen Gr??en, Christian Wiese Follow us on Facebook: Follow us on Twitter: --------------------------------------------------------------------- Securepoint GmbH Christian Wiese Salzstr. 1 D-21335 Lueneburg http://www.securepoint.de Tele: ++49 4131 2401-0 Fax: ++49 4131 2401-50 Lueneburg HRB 1776 --------------------------------------------------------------------- CONFIDENTIALITY : This e-mail and any attachments are confidential and may be privileged. If you are not a named recipient, please notify the sender immediately and do not disclose the contents to another person, use it for any purpose or store or copy the information in any medium. GEHEIMHALTUNGSPFLICHT : Dieses E-Mail und alle damit verbundenen Anlagen sind vertraulich und d?rfen nur bestimmten Personen zug?nglich gemacht werden. Sofern Sie nicht zu den angegebenen Empf?ngern geh?ren, benachrichtigen Sie bitte unverz?glich den Absender. Der Inhalt darf weder an Dritte weitergegeben noch zu anderen Zwecken verwendet werden. Die Informationen d?rfen auch nicht auf einem Datentr?ger gespeichert oder auf einen Datentr?ger kopiert werden. From freemail.grharry at gmail.com Fri Apr 19 12:36:22 2013 From: freemail.grharry at gmail.com (HL) Date: Fri, 19 Apr 2013 12:36:22 +0300 Subject: [Dovecot] Multiple Logins on same accounts from different stations, RE-POSTING In-Reply-To: <59BC676F-5E55-40F0-AF60-F2565E9A5A07@iki.fi> References: <51702871.8070907@gmail.com> <5170D8AF.4000304@gmail.com> <59BC676F-5E55-40F0-AF60-F2565E9A5A07@iki.fi> Message-ID: <51711016.2020802@gmail.com> On 19/04/2013 11:17 ??, Timo Sirainen wrote: > On 19.4.2013, at 8.39, HL wrote: > >>>> Changes from PC (A) and vice-versa like marks,deletes, or moves mails around will randomly get propagated to PC (B) >>>> Sometimes they do sometimes they don't. >>>> This never occured with previous version 1.2.xx >>> Do you mean that the 4 people are using 1 shared account, or do you mean 4 different user accounts are accessing a shared folder (via shared/public namespace)? >>> >> Yes 4 people are using all 4 shared accounts. ( No Shared or Public Namespaces for them ) >> They all login from their client to these 4 accounts, with 4 distinct userNames and passwords. >> They prefer it this way. > That's still a bit confusing .. It's 4 shared accounts, because there are 4 different mailboxes, not because there are 4 people? > > If there were different accounts accessing the same shared mailbox, I could see why it might sometimes not notice all the latest changes (because they'd be using different index files then and might miss changes in maildir - although even that shouldn't happen). But if the clients aren't seeing changes for the same shared account, then I can't really think of any good reason for your problem. All clients are notified of all changes when Dovecot sees them. There shouldn't be any change from how v1.2 worked. > Does dovecot notify clients that drop into an idle state ? I see a bunch of *_idle_* params, that confuse me, like default_idle_kill = 1 mins imap_idle_notify_interval = 2 mins imapc_max_idle_time = 29 mins mailbox_idle_check_interval = 30 secs and idle_kill = 0 or idle_kill = 4294967295 secs in various services Thanks, Harry From rs at sys4.de Fri Apr 19 13:18:43 2013 From: rs at sys4.de (Robert Schetterer) Date: Fri, 19 Apr 2013 12:18:43 +0200 Subject: [Dovecot] IMAP monitoring In-Reply-To: References: Message-ID: <51711A03.1040902@sys4.de> Am 19.04.2013 08:11, schrieb Joseph Tam: >> From: pvsuja >> >> I want to get some statistics of dovecot IMAP server like the number of >> current IMAP connections, who is logged in to the Dovecot server, > > doveadm who > >> bandwidth usage. > > You can sort of get that from the logs. For example, from my logs > > Apr 18 23:08:19 server dovecot: imap(user): Disconnected: Logged out > in=9516 out=89038 > > telling you how many bytes tranferred in and out during the session. > >> Is there any utility which does this sort of full monitoring? >> I tried doveadm who to get the details of logged in users. >> but its not returning any output even though i am logged in to the >> server. > > "doveadm who" ought to work. What does it return? > > Joseph Tam you might use the stats plugin http://wiki2.dovecot.org/Statistics and/or collect something from rsyslog etc with different tools, nagios, zabbix, xymon etc see screenshot http://sys4.de/de/blog/2013/01/10/xymon-dovecot-count-imap-pop3-logins-graph-central-rsyslog-server-ubuntu-lucid/ Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From rs at sys4.de Fri Apr 19 13:20:25 2013 From: rs at sys4.de (Robert Schetterer) Date: Fri, 19 Apr 2013 12:20:25 +0200 Subject: [Dovecot] Dovecot Failover In-Reply-To: <5170EB40.7010103@noa.gr> References: <5170EB40.7010103@noa.gr> Message-ID: <51711A69.20300@sys4.de> Am 19.04.2013 08:59, schrieb Nikolaos Milas: > Hello, > > Assuming we have two (low traffic) servers (on different data centers) > replicated using dsync, what is the best way to automatically direct > users to the main server when it is up and to the redundant one when the > main server is down? > > Using DNS? I've seen that DNS-based failover has generally issues (for > example: > http://serverfault.com/questions/60553/why-is-dns-failover-not-recommended, > which is informative although it refers to web servers). > > What is the suggested approach? HAProxy? Heartbeat/Pacemaker? i run keepalived as loadbalancer/failover but pacemaker etc should work fine too > > Any advice will be appreciated. > > Thanks and regards, > Nick > > > > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From voytek at sbt.net.au Fri Apr 19 13:34:34 2013 From: voytek at sbt.net.au (voytek at sbt.net.au) Date: Fri, 19 Apr 2013 20:34:34 +1000 Subject: [Dovecot] IMAP monitoring In-Reply-To: <51711A03.1040902@sys4.de> References: <51711A03.1040902@sys4.de> Message-ID: <427956f0-080e-4643-aab2-f11536a1226b@email.android.com> Have a look also at Glen's cacti/dovecot stats http://www.pitt-pladdy.com/blog/_20110625-123333_0100_Dovecot_stats_on_Cacti_via_SNMP_/ -- Sent from Kaiten Mail. Please excuse my brevity. From CMarcus at Media-Brokers.com Fri Apr 19 14:12:20 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 19 Apr 2013 07:12:20 -0400 Subject: [Dovecot] Multiple Logins on same accounts from different stations, RE-POSTING In-Reply-To: <51711016.2020802@gmail.com> References: <51702871.8070907@gmail.com> <5170D8AF.4000304@gmail.com> <59BC676F-5E55-40F0-AF60-F2565E9A5A07@iki.fi> <51711016.2020802@gmail.com> Message-ID: <51712694.4040107@Media-Brokers.com> On 2013-04-19 5:36 AM, HL wrote: > On 19/04/2013 11:17 ??, Timo Sirainen wrote: >> On 19.4.2013, at 8.39, HL wrote: >> >>> Yes 4 people are using all 4 shared accounts. ( No Shared or Public >>> Namespaces for them ) >>> They all login from their client to these 4 accounts, with 4 >>> distinct userNames and passwords. >>> They prefer it this way. >> That's still a bit confusing .. It's 4 shared accounts, because there >> are 4 different mailboxes, not because there are 4 people? > Does dovecot notify clients that drop into an idle state ? > I see a bunch of *_idle_* params, that confuse me, like Harry, before asking new questions, please clear up the confusion first by answering the question above. Am I reading it correctly that you have 4 email accounts: user1 at example.com user2 at example.com user3 at example.com user4 at example.com ? Then each of these individual users has all 4 accounts set up in their email clients? -- Best regards, Charles From tss at iki.fi Fri Apr 19 14:16:16 2013 From: tss at iki.fi (Timo Sirainen) Date: Fri, 19 Apr 2013 14:16:16 +0300 Subject: [Dovecot] Multiple Logins on same accounts from different stations, RE-POSTING In-Reply-To: <51711016.2020802@gmail.com> References: <51702871.8070907@gmail.com> <5170D8AF.4000304@gmail.com> <59BC676F-5E55-40F0-AF60-F2565E9A5A07@iki.fi> <51711016.2020802@gmail.com> Message-ID: <571210C3-D45E-468B-9314-6FE3E0D1C648@iki.fi> On 19.4.2013, at 12.36, HL wrote: >> If there were different accounts accessing the same shared mailbox, I could see why it might sometimes not notice all the latest changes (because they'd be using different index files then and might miss changes in maildir - although even that shouldn't happen). But if the clients aren't seeing changes for the same shared account, then I can't really think of any good reason for your problem. All clients are notified of all changes when Dovecot sees them. There shouldn't be any change from how v1.2 worked. >> > Does dovecot notify clients that drop into an idle state ? That's especially when it notifies them. > I see a bunch of *_idle_* params, that confuse me, like > > default_idle_kill = 1 mins > imap_idle_notify_interval = 2 mins > imapc_max_idle_time = 29 mins > mailbox_idle_check_interval = 30 secs > > and > > idle_kill = 0 > or > idle_kill = 4294967295 secs Well, there are 3 different things in here.. mailbox_idle_check_interval was a bit badly named, but that's the only one that actually affects notifications. With 30 secs it means that unless kernel notifies faster using e.g. inotify, Dovecot checks every 30 seconds the filesystem to see if the mtimes have changed. From christian.wiese at securepoint.de Fri Apr 19 14:28:08 2013 From: christian.wiese at securepoint.de (Christian Wiese) Date: Fri, 19 Apr 2013 13:28:08 +0200 Subject: [Dovecot] Make install error In-Reply-To: <5170BEF0.6060306@mysql.cc> References: <5170BEF0.6060306@mysql.cc> Message-ID: <20130419132808.2f91cdf7@cw-desktop> Hi, I already compiled/installed dovecot 2.2.0 as you did without any problems. Also compiling dovecot 2.2.1 and installing it on top of the previous 2.2.0 install works. So it seems to me that this is an issue related to your system environment. Did you checked how your Suse installation behaves when you are manually trigger the same commands? ---%<--------------------------------------------------------------- test -z "/usr/local/dovecot/lib/dovecot/auth" || /usr/bin/mkdir -p "/usr/local/dovecot/lib/dovecot/auth" ---%<--------------------------------------------------------------- Did you checked filesystem permissions too? Regards, Chris Am Fri, 19 Apr 2013 11:50:08 +0800 schrieb kengheng : > Hi, I'm recompiling dovecot 2.2.0/2.2.1 with error below during make > install: > > test -z "/usr/local/dovecot/lib/dovecot/auth" || /usr/bin/mkdir -p > "/usr/local/dovecot/lib/dovecot/auth" > /usr/bin/mkdir: cannot create directory > ?/usr/local/dovecot/lib/dovecot/auth?: File exists > make[3]: *** [install-auth_moduleLTLIBRARIES] Error 1 > make[3]: Leaving directory `/usr/local/src/dovecot-2.2.1/src/auth' > make[2]: *** [install-am] Error 2 > make[2]: Leaving directory `/usr/local/src/dovecot-2.2.1/src/auth' > make[1]: *** [install-recursive] Error 1 > make[1]: Leaving directory `/usr/local/src/dovecot-2.2.1/src' > make: *** [install-recursive] Error 1 > > > The target Svr OS: OpenSuse 12.2 x86 and installed success for > qmail/vpopmail. The configuration for dovecot as below: > ./configure \ > --prefix=/usr/local/dovecot \ > --with-vpopmail \ > --with-docs \ > --with-ssl \ > --without-shadow \ > --without-pam \ > --without-ldap \ > --without-pgsql \ > --without-sql \ > --without-mysql \ > --without-sqlite > > Thanks, > KH. Chan -- Kind regards, Mit freundlichen Gr??en, Christian Wiese Follow us on Facebook: Follow us on Twitter: --------------------------------------------------------------------- Securepoint GmbH Christian Wiese Salzstr. 1 D-21335 Lueneburg http://www.securepoint.de Tele: ++49 4131 2401-0 Fax: ++49 4131 2401-50 Lueneburg HRB 1776 --------------------------------------------------------------------- CONFIDENTIALITY : This e-mail and any attachments are confidential and may be privileged. If you are not a named recipient, please notify the sender immediately and do not disclose the contents to another person, use it for any purpose or store or copy the information in any medium. GEHEIMHALTUNGSPFLICHT : Dieses E-Mail und alle damit verbundenen Anlagen sind vertraulich und d?rfen nur bestimmten Personen zug?nglich gemacht werden. Sofern Sie nicht zu den angegebenen Empf?ngern geh?ren, benachrichtigen Sie bitte unverz?glich den Absender. Der Inhalt darf weder an Dritte weitergegeben noch zu anderen Zwecken verwendet werden. Die Informationen d?rfen auch nicht auf einem Datentr?ger gespeichert oder auf einen Datentr?ger kopiert werden. From wawaks at gmail.com Fri Apr 19 14:44:36 2013 From: wawaks at gmail.com (Slawomir Wawak) Date: Fri, 19 Apr 2013 13:44:36 +0200 Subject: [Dovecot] Dovecot and port forwarding Message-ID: Hello! I try to configure POP3s with Dovecot. My mail server is behind router and I forward 995 port from router to mail server. POP3s works ok when I log directly to 995 on server. Unfortunately, it shows nothing when I log from outside. It happens also when the firewall is off. All I can see in log is this: Apr 19 13:39:43 hostname dovecot: pop3-login: Warning: SSL: where=0x10, ret=1: before/accept initialization [123.123.123.123] Apr 19 13:39:43 hostname dovecot: pop3-login: Warning: SSL: where=0x2001, ret=1: before/accept initialization [123.123.123.123] Apr 19 13:39:43 hostname dovecot: pop3-login: Warning: SSL: where=0x2002, ret=-1: unknown state [123.123.123.123] Apr 19 13:39:43 hostname dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Apr 19 13:39:43 hostname dovecot: auth: Debug: auth client connected (pid=17056) Apr 19 13:39:47 hostname dovecot: pop3-login: Disconnected (no auth attempts): rip=123.123.123.123, lip=10.0.0.2, TLS handshaking: Disconnected (hostname and IPs changed) My config: # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-40-generic-pae i686 Ubuntu 12.04.2 LTS auth_debug = yes mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail passdb { driver = pam } protocols = pop3 service pop3-login { inet_listener pop3s { address = * } } ssl_cert = References: Message-ID: <517138F8.8090507@mejor.pl> W dniu 19.04.2013 13:44, Slawomir Wawak pisze: > Hello! > I try to configure POP3s with Dovecot. My mail server is behind router and > I forward 995 port from router to mail server. POP3s works ok when I log > directly to 995 on server. Unfortunately, it shows nothing when I log from > outside. It happens also when the firewall is off. > All I can see in log is this: > > Apr 19 13:39:43 hostname dovecot: pop3-login: Warning: SSL: where=0x10, > ret=1: before/accept initialization [123.123.123.123] > Apr 19 13:39:43 hostname dovecot: pop3-login: Warning: SSL: where=0x2001, > ret=1: before/accept initialization [123.123.123.123] > Apr 19 13:39:43 hostname dovecot: pop3-login: Warning: SSL: where=0x2002, > ret=-1: unknown state [123.123.123.123] > Apr 19 13:39:43 hostname dovecot: auth: Debug: Loading modules from > directory: /usr/lib/dovecot/modules/auth > Apr 19 13:39:43 hostname dovecot: auth: Debug: auth client connected > (pid=17056) > Apr 19 13:39:47 hostname dovecot: pop3-login: Disconnected (no auth > attempts): rip=123.123.123.123, lip=10.0.0.2, TLS handshaking: Disconnected Hi! You are talking without SSL to port with SSL. You should check you NAT. Regards. From valjohn1647 at gmail.com Fri Apr 19 15:42:29 2013 From: valjohn1647 at gmail.com (val john) Date: Fri, 19 Apr 2013 18:12:29 +0530 Subject: [Dovecot] LDAP authentication Message-ID: Hi guys im new to dovecot , and im trying to authenticate dovecot to LDAP this my configuration dovecot --version 1.2.15 dovecot -n # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.5 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap pop3 login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_location: mbox:~/mail:INBOX=/var/mail/%u mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 auth default: verbose: yes debug: yes passdb: driver: pam passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: passwd userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf *Out put of dovecot-ldap.conf* file uris = ldap://ldap.example.com:389 dn = cn=admin,dc=example,dc=com dnpass = abc tls = no ldap_version = 3 base = ou=users,dc=example,dc=com scope = subtree user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid user_filter = (&(objectClass=inetOrgPerson)(uid=%u)) pass_attrs = uid=user,userPassword=password pass_filter = (&(objectClass=inetOrgPerson)(uid=%u)) * * *Out put of LDAP , * # Entry 1: uid=userone,ou=users,dc=example,dc=com dn: uid=userone,ou=users,dc=example,dc=com cn: Firtname Lastname displayname: Firtname Lastname givenname: Firstname mail: userone at example.com objectclass: inetOrgPerson objectclass: top sn: Lastname uid: userone userpassword: {SHA}0P/ssspVCIZx8+tVsss= but authentication fails with the follwing error , Please Advice Apr 19 08:18:48 localhost dovecot: auth(default): client in: AUTH#0111#011PLAIN#011service=imap#011secured#011lip=127.0.0.1#011rip=127.0.0.1#011lport=143#011rport=38734#011resp= Apr 19 08:18:48 localhost dovecot: auth-worker(default): pam(userone,127.0.0.1): lookup service=dovecot Apr 19 08:18:48 localhost dovecot: auth-worker(default): pam(userone,127.0.0.1): #1/1 style=1 msg=Password: Apr 19 08:18:49 localhost dovecot: auth(default): new auth connection: pid=7517 Apr 19 08:18:50 localhost dovecot: auth-worker(default): pam(userone,127.0.0.1): pam_authenticate() failed: Authentication failure (password mismatch?) Apr 19 08:18:50 localhost dovecot: auth(default): ldap(userone,127.0.0.1): pass search: base=ou=users,dc=example,dc=com scope=subtree filter=(uid=userone) fields=uid,userPassword Apr 19 08:18:50 localhost dovecot: auth(default): ldap(userone,127.0.0.1): result: uid(user)=userone userPassword(password)= Apr 19 08:18:50 localhost dovecot: auth(default): client out: OK#0111#011user=userone Apr 19 08:18:50 localhost dovecot: auth(default): master in: REQUEST#0111#0117514#0111 Apr 19 08:18:50 localhost dovecot: auth(default): passwd(userone,127.0.0.1): lookup Apr 19 08:18:50 localhost dovecot: auth(default): passwd(userone,127.0.0.1): unknown user Apr 19 08:18:50 localhost dovecot: auth(default): ldap(userone,127.0.0.1): user search: base=ou=users,dc=example,dc=com scope=subtree filter=(uid=userone) fields=homeDirectory,uidNumber,gidNumber Apr 19 08:18:51 localhost dovecot: auth(default): ldap(userone,127.0.0.1): no fields returned by the server Apr 19 08:18:51 localhost dovecot: auth(default): master out: USER#0111#011userone Apr 19 08:18:51 localhost dovecot: dovecot: User userone is missing UID (see mail_uid setting) Apr 19 08:18:51 localhost dovecot: imap-login: Internal login failure (auth failed, 1 attempts): user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured From ben at morrow.me.uk Fri Apr 19 16:23:53 2013 From: ben at morrow.me.uk (Ben Morrow) Date: Fri, 19 Apr 2013 14:23:53 +0100 Subject: [Dovecot] Make install error In-Reply-To: <5170BEF0.6060306@mysql.cc> References: <5170BEF0.6060306@mysql.cc> Message-ID: <20130419132352.GC18505@anubis.morrow.me.uk> At 11AM +0800 on 19/04/13 you (kengheng) wrote: > Hi, I'm recompiling dovecot 2.2.0/2.2.1 with error below during make > install: > > test -z "/usr/local/dovecot/lib/dovecot/auth" || /usr/bin/mkdir -p > "/usr/local/dovecot/lib/dovecot/auth" > /usr/bin/mkdir: cannot create directory > ?/usr/local/dovecot/lib/dovecot/auth?: File exists mkdir -p silently succeeds if the directory already exists, so this must mean that some part of that path already exists as a file rather than a directory. Ben From skdovecot at smail.inf.fh-brs.de Fri Apr 19 17:45:09 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 19 Apr 2013 16:45:09 +0200 (CEST) Subject: [Dovecot] LDAP authentication In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 19 Apr 2013, val john wrote: > uris = ldap://ldap.example.com:389 > dn = cn=admin,dc=example,dc=com > dnpass = abc > tls = no > ldap_version = 3 > base = ou=users,dc=example,dc=com > scope = subtree > user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ > > # Entry 1: uid=userone,ou=users,dc=example,dc=com > dn: uid=userone,ou=users,dc=example,dc=com > cn: Firtname Lastname > displayname: Firtname Lastname > givenname: Firstname > mail: userone at example.com > objectclass: inetOrgPerson > objectclass: top > sn: Lastname > uid: userone > userpassword: {SHA}0P/ssspVCIZx8+tVsss= No uidNumber nor gidNumber nor homeDirectory here. > but authentication fails with the follwing error , Please Advice > Apr 19 08:18:50 localhost dovecot: auth(default): > ldap(userone,127.0.0.1): result: uid(user)=userone > userPassword(password)= > Apr 19 08:18:50 localhost dovecot: auth(default): client out: > OK#0111#011user=userone LDAP authentification succeeds. > Apr 19 08:18:50 localhost dovecot: auth(default): > ldap(userone,127.0.0.1): user search: base=ou=users,dc=example,dc=com > scope=subtree filter=(uid=userone) > fields=homeDirectory,uidNumber,gidNumber Now requesting the LDAP attributes you've specified, ... > Apr 19 08:18:51 localhost dovecot: auth(default): > ldap(userone,127.0.0.1): no fields returned by the server ..., but none there. > Apr 19 08:18:51 localhost dovecot: auth(default): master out: > USER#0111#011userone > Apr 19 08:18:51 localhost dovecot: dovecot: User userone is missing > UID (see mail_uid setting) Dovecot does not know, which uid to use. Either assign global mail_uid and mail_gid or add mailUid and mailGid attributes to your LDAP items. Next problem will be the missing homeDirectory ... . > Apr 19 08:18:51 localhost dovecot: imap-login: Internal login failure > (auth failed, 1 attempts): user=, method=PLAIN, > rip=127.0.0.1, lip=127.0.0.1, secured > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUXFYdV3r2wJMiz2NAQJmrwf/U5six5ut3Z+QwfFvm+mSgyXz44nhWnsB EozjS2ULT4MtOUWZacDLooQf6FYh+7gOUwpCOqeBHfOcQvW5p5gTflJU4S+WdDgL Vuq9IeUcbcaHOOTrEuuenOMuI0nZLB1pv9Rz7KjeRfgAr9H/v4GmirYj9+cuHrWs jSWjwN+lOj1FmOp7U1F3UAZoibQOTi9JdgUm7MgEOB6v5QobG+oxpiA7Xkl/MXAY Ip3BOo7qWsuwXVuSnI/9bH7jDk4yK0jitHulsYY5+yl2ePvF86hOLxv60oliyVkI qkIRd1W8aWLnz9lPTdiL2N5eKOXWpHi0gZYyrVe8vYxVYxrdpgSMmQ== =t29J -----END PGP SIGNATURE----- From freemail.grharry at gmail.com Fri Apr 19 18:21:35 2013 From: freemail.grharry at gmail.com (HL) Date: Fri, 19 Apr 2013 18:21:35 +0300 Subject: [Dovecot] Multiple Logins on same accounts from different stations, RE-POSTING In-Reply-To: <51712694.4040107@Media-Brokers.com> References: <51702871.8070907@gmail.com> <5170D8AF.4000304@gmail.com> <59BC676F-5E55-40F0-AF60-F2565E9A5A07@iki.fi> <51711016.2020802@gmail.com> <51712694.4040107@Media-Brokers.com> Message-ID: <517160FF.2030701@gmail.com> On 19/04/2013 02:12 ??, Charles Marcus wrote: > On 2013-04-19 5:36 AM, HL wrote: >> On 19/04/2013 11:17 ??, Timo Sirainen wrote: >>> On 19.4.2013, at 8.39, HL wrote: >>> >>>> Yes 4 people are using all 4 shared accounts. ( No Shared or Public >>>> Namespaces for them ) >>>> They all login from their client to these 4 accounts, with 4 >>>> distinct userNames and passwords. >>>> They prefer it this way. > >>> That's still a bit confusing .. It's 4 shared accounts, because >>> there are 4 different mailboxes, not because there are 4 people? > >> Does dovecot notify clients that drop into an idle state ? >> I see a bunch of *_idle_* params, that confuse me, like > > Harry, before asking new questions, please clear up the confusion > first by answering the question above. > > Am I reading it correctly that you have 4 email accounts: > > user1 at example.com > user2 at example.com > user3 at example.com > user4 at example.com ? > > Then each of these individual users has all 4 accounts set up in their > email clients? > Correct .... and Thanks From rob0 at gmx.co.uk Fri Apr 19 19:05:57 2013 From: rob0 at gmx.co.uk (/dev/rob0) Date: Fri, 19 Apr 2013 11:05:57 -0500 Subject: [Dovecot] Moving mail servers, moving mailboxes In-Reply-To: <1607148840.20130417071854@sloop.net> References: <377722326.20130415164825@sloop.net> <1607148840.20130417071854@sloop.net> Message-ID: <20130419160557.GO3672@harrier.slackbuilds.org> On Wed, Apr 17, 2013 at 07:18:54AM -0700, Gregory Sloop wrote: > As long as I'm asking about mailbox formats, is it possible to use > DBox with postfix - it appears on the Wiki that it's not, but then > I find posts on the web that appear to indicate it *is* possible. Postfix has native support only for mbox and maildir. But Postfix can invoke the Dovecot LDA via a pipe(8) transport(5), or lmtp(8) to Dovecot's LMTP service. http://wiki2.dovecot.org/HowTo/PostfixDovecotLMTP http://wiki2.dovecot.org/LDA http://wiki2.dovecot.org/LMTP -- http://rob0.nodns4.us/ -- system administration and consulting Offlist GMX mail is seen only if "/dev/rob0" is in the Subject: From noel.butler at ausics.net Sat Apr 20 04:29:10 2013 From: noel.butler at ausics.net (Noel Butler) Date: Sat, 20 Apr 2013 11:29:10 +1000 Subject: [Dovecot] listen directive changed? In-Reply-To: References: <1D989A1A-F648-4647-A3A9-CC5481A54300@iki.fi> <9C28489A-0F74-4679-833A-1A1FD1458EB7@iki.fi> Message-ID: <1366421350.3933.3.camel@tardis> On Fri, 2013-04-19 at 01:56 +0300, Timo Sirainen wrote: > On 19.4.2013, at 1.53, Nick Edwards wrote: > > > So what is the point of the global? > > I commented out the address in inet_listener, assuming it then will > > use global, but no, cant connect at all then. > > If you comment out the address in inet_listener, it does use the global listen setting. > I don't know why you can't connect at all then. Either the global listen setting is wrong or there's a bug in code that parses it. > no bug in 2.1.16 at least, because it certainly does work that way. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From noel.butler at ausics.net Sat Apr 20 04:33:36 2013 From: noel.butler at ausics.net (Noel Butler) Date: Sat, 20 Apr 2013 11:33:36 +1000 Subject: [Dovecot] Dovecot Failover In-Reply-To: References: <5170EB40.7010103@noa.gr> Message-ID: <1366421616.3933.7.camel@tardis> speaking of failover, recall about two years ago when I and (IIRC two others, forget who, dont have copy of messages anymore) asked about mysql failover (where it only talked to the second host when the first failed to respond - like postfix does) you mentioned it would go on your "to do list" for future release, this was back in 1.2, now we are at 2.2, how is this option proceeding? On Fri, 2013-04-19 at 10:43 +0300, Timo Sirainen wrote: > On 19.4.2013, at 9.59, Nikolaos Milas wrote: > > > Assuming we have two (low traffic) servers (on different data centers) replicated using dsync, what is the best way to automatically direct users to the main server when it is up and to the redundant one when the main server is down? > > > > Using DNS? I've seen that DNS-based failover has generally issues (for example: http://serverfault.com/questions/60553/why-is-dns-failover-not-recommended, which is informative although it refers to web servers). > > > > What is the suggested approach? HAProxy? Heartbeat/Pacemaker? > > Well, there are two failure reasons: > > a) Dovecot server fails. For that, you could use any kind of a proxy that redirects traffic to the other server (even Dovecot proxy on another server). > > b) Network connection to the whole data center dies, or the whole data center loses power or otherwise dies. There's really no other choice to failover that than DNS, unless you manage to route the same IP address to two different data centers and just update the route. > > I'd be more worried about b), since you can already fix a) pretty quickly with VMs. Or a) could also be switched to become a Dovecot proxy on demand if there's a bigger problem that can't be immediately fixed. > -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 490 bytes Desc: This is a digitally signed message part URL: From lutz.niederer at gmx.net Sat Apr 20 20:03:35 2013 From: lutz.niederer at gmx.net (lutz.niederer at gmx.net) Date: Sat, 20 Apr 2013 19:03:35 +0200 (CEST) Subject: [Dovecot] Integrate mbox into mdbox Message-ID: Hi! ? I have several mbox files (unstructured, only the big?plain mbox?files) and I would like to integrate/read these mbox files into mdbox subfolders of specific users.? This is a production system and I don't want to disturb running services and I am a bit afraid of not using the right command and maybe destroying (or whatever) their mailboxes.? I am sure it is pretty easy.? Can someone please tell me the correct dsync command line that I should use to read each mbox file?(one-way)?into the specific folder of the?mdbox folder structure of a specific user? ? Thanks a lot, -lutzn ? From user+dovecot at localhost.localdomain.org Sat Apr 20 22:45:35 2013 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 20 Apr 2013 21:45:35 +0200 Subject: [Dovecot] imap Fatal: bzlib.read(~/mdbox/storage/m.317): Out of memory In-Reply-To: <516E722C.5010201@localhost.localdomain.org> References: <516E722C.5010201@localhost.localdomain.org> Message-ID: <5172F05F.9000104@localhost.localdomain.org> On 04/17/2013 11:58 AM Pascal Volk wrote: > Apr 17 10:41:44 imap(user at example.com): Fatal: bzlib.read(/srv/mail/x/70004/70038/mdbox/storage/m.317): Out of memory Yeah, http://hg.dovecot.org/dovecot-2.2/rev/994488139eca fixed it. Regards, Pascal -- The trapper recommends today: defaced.1311021 at localdomain.org From stan at hardwarefreak.com Sun Apr 21 02:29:24 2013 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 20 Apr 2013 18:29:24 -0500 Subject: [Dovecot] Integrate mbox into mdbox In-Reply-To: References: Message-ID: <517324D4.9080408@hardwarefreak.com> On 4/20/2013 12:03 PM, lutz.niederer at gmx.net wrote: > I have several mbox files (unstructured, only the big plain mbox files) and I would like to integrate/read these mbox files into mdbox subfolders of specific users. This is a production system and I don't want to disturb running services and I am a bit afraid of not using the right command and maybe destroying (or whatever) their mailboxes. I am sure it is pretty easy. Can someone please tell me the correct dsync command line that I should use to read each mbox file (one-way) into the specific folder of the mdbox folder structure of a specific user? More information about the nature of these mbox files, and how they are or will be used, would be helpful. Is there a reason you don't/won't/can't simply create a new namespace, instead of copying the contents from the mbox files into users' mdbox files? -- Stan From lutz.niederer at gmx.net Sun Apr 21 10:10:14 2013 From: lutz.niederer at gmx.net (lutz.niederer at gmx.net) Date: Sun, 21 Apr 2013 09:10:14 +0200 (CEST) Subject: [Dovecot] Integrate mbox into mdbox In-Reply-To: <517324D4.9080408@hardwarefreak.com> References: , <517324D4.9080408@hardwarefreak.com> Message-ID: > > I have several mbox files (unstructured, only the big plain mbox files) and I would like to integrate/read these mbox files into mdbox subfolders of specific users. This is a production system and I don't want to disturb running services and I am a bit afraid of not using the right command and maybe destroying (or whatever) their mailboxes. I am sure it is pretty easy. Can someone please tell me the correct dsync command line that I should use to read each mbox file (one-way) into the specific folder of the mdbox folder structure of a specific user? > More information about the nature of these mbox files, and how they are > or will be used, would be helpful. These mbox files are left over from old installations. The messages contained in these files should be moved into users' mdbox folders. The user tells me the name of the folder and I was hoping for a dsync command line that reads all the messages from the mbox and feeds them into that specific mdbox folder. Some users have 1 some have 5 mbox files left over that need to be imported. After that the mbox files can be thrown away. > Is there a reason you don't/won't/can't simply create a new namespace, > instead of copying the contents from the mbox files into users' mdbox files? Simplicity. I thought it would be much easier to push them into mdbox folders with the right command - one by one - than doing it with namespaces. If there is no other way I will do it with namespaces. -lutzn From admin at iliusha.md Sun Apr 21 10:54:56 2013 From: admin at iliusha.md (iliusha) Date: Sun, 21 Apr 2013 00:54:56 -0700 (PDT) Subject: [Dovecot] Sieve - BCC Message-ID: <1366530896876-41757.post@n4.nabble.com> Hi ! Can you help me please with sieve plugin for dovecot I have this rule: /require ["variables", "envelope", "fileinto", "subaddress", "imap4flags"]; if anyof ( address :is [ "to", "cc", "bcc" ] "test at example.com", envelope :contains "to" "test at example.com" ) { fileinto "Test"; stop; }/ and if somebody sends me an email with "test at example.com" in "TO" or "CC" - then sieve works properly and put this email in Test folder, but i can't understand why if it sends e-mail to "test at example.com" in BCC - sieve don't move it to Test but leave it in Inbox? If i run sieve-test -faD .dovecot.sieve "Message-ID" i get: /Performed actions: * store message in folder: Test Implicit keep: (none) sieve-test(root): Info: final result: success/ but in dovecot log i get: /Info: sieve: msgid=<20130421074437.570EA2BA1C1F at mail.com>: stored mail into mailbox 'INBOX'/ and email is going to Inbox folder, instead Test. Please tell me what i am doing wrong and how i can make sieve to work properly with BCC. Thank You. -- View this message in context: http://dovecot.2317879.n4.nabble.com/Sieve-BCC-tp41757.html Sent from the Dovecot mailing list archive at Nabble.com. From ben at morrow.me.uk Sun Apr 21 11:57:40 2013 From: ben at morrow.me.uk (Ben Morrow) Date: Sun, 21 Apr 2013 09:57:40 +0100 Subject: [Dovecot] Sieve - BCC In-Reply-To: <1366530896876-41757.post@n4.nabble.com> References: <1366530896876-41757.post@n4.nabble.com> Message-ID: <20130421085739.GA32796@anubis.morrow.me.uk> At 12AM -0700 on 21/04/13 you (iliusha) wrote: > > Can you help me please with sieve plugin for dovecot > > I have this rule: > > /require ["variables", "envelope", "fileinto", "subaddress", "imap4flags"]; > if anyof > ( > address :is [ "to", "cc", "bcc" ] "test at example.com", > envelope :contains "to" "test at example.com" > > ) > { > > fileinto "Test"; > stop; > }/ > > and if somebody sends me an email with "test at example.com" in "TO" or "CC" - > then sieve works properly and put this email in Test folder, but i can't > understand why if it sends e-mail to "test at example.com" in BCC - sieve don't > move it to Test but leave it in Inbox? You can't. The whole point of Bcc is that the sending SMTP server removes the header before the mail is sent, so that the other recipients can't see someone was CCed. Filtering on the envelope recipient address ought to be sufficient, unless that address is getting rewritten somewhere in the mail path. > If i run sieve-test -faD .dovecot.sieve "Message-ID" i get: > > /Performed actions: > > * store message in folder: Test > > Implicit keep: > > (none) > > sieve-test(root): Info: final result: success/ > > but in dovecot log i get: > /Info: sieve: msgid=<20130421074437.570EA2BA1C1F at mail.com>: stored mail into > mailbox 'INBOX'/ > and email is going to Inbox folder, instead Test. I'm not sure exactly what you're doing here, but if you're passing sieve-test a mail that does actually have a Bcc line with your address in, I would expect it to work. The problem is that ordinary incoming mail won't have that line. Ben From admin at iliusha.md Sun Apr 21 16:10:41 2013 From: admin at iliusha.md (iliusha) Date: Sun, 21 Apr 2013 06:10:41 -0700 (PDT) Subject: [Dovecot] Sieve - BCC In-Reply-To: <20130421085739.GA32796@anubis.morrow.me.uk> References: <1366530896876-41757.post@n4.nabble.com> <20130421085739.GA32796@anubis.morrow.me.uk> Message-ID: <1366549841631-41759.post@n4.nabble.com> > The whole point of Bcc is that the sending SMTP server removes the header before the mail is sent Yes, you right, thank you, i didn't know that. but, do you now what is strange - ok i don't have the BCC point in message header, but i have Envelope-to: header, why the sieve won't process it? (envelope :contains "to" "test at example.com" ) This is how i receive email headers: /Return-path: *Envelope-to: test at example.com* Delivery-date: Sun, 21 Apr 2013 09:24:23 +0300 Received: from [1.1.1.1] (helo=helo) by MX-Server with esmtp (Exim 4.77 (FreeBSD)) (envelope-from ) id 1UTnhH-000Gx0-I2 *for test at example.com*; Sun, 21 Apr 2013 09:24:23 +0300 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=example.com; s=dkim; h=Content-Type:MIME-Version:Message-ID:Date:Subject:To:From; bh=JPnc/R6ltRQ3Naw1NgX7zO/kXeb6z96fjMSgEkiwbRk=; b=aXNcToLUBFCJJDs8zTCKPIHHIaKQCQYwGC0/mKKsPA4sqXtca7Y1jsqSdO86WolrQV9J/LWmvT39PufdvQjo0u9zmRWfGOBDi2NJ9m+6KS5cQhQgDyVkNr+HbpX/pm1ALkzGfRWMDFbVzEZ+IDCB /TWHE2A9+yCZIQGlLOIDTuo=; Received: from [1.1.1.1] (helo=AdminPC) by mx0.example.com with esmtpa (Exim 4.80.1 (FreeBSD)) (envelope-from ) id 1UTkt0-00011o-1U; Sun, 21 Apr 2013 06:24:22 +0300 From: "Admin" To: Subject: test1 Date: Sun, 21 Apr 2013 09:24:23 +0300 Message-ID: <000001ce3e58$ddc6a3b0$9953eb10$@example.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_NextPart_000_0001_01CE3E72.031429D0" X-Mailer: Microsoft Outlook 14.0 Thread-Index: Ac4+WN2excy0RNupTa6JtRtSdrQjog== Content-Language: ro X-ACL-Warn: M40=White Host or Relay Host X-SA-Exim-Connect-IP: 1.1.1.1 X-SA-Exim-Mail-From: sender at example.com X-SA-Exim-Scanned: No (on mx0.example.com); SAEximRunCond expanded to false This is a multipart message in MIME format. ------=_NextPart_000_0001_01CE3E72.031429D0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit test/ -- View this message in context: http://dovecot.2317879.n4.nabble.com/Sieve-BCC-tp41757p41759.html Sent from the Dovecot mailing list archive at Nabble.com. From h.reindl at thelounge.net Sun Apr 21 16:21:31 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sun, 21 Apr 2013 15:21:31 +0200 Subject: [Dovecot] Sieve - BCC In-Reply-To: <1366549841631-41759.post@n4.nabble.com> References: <1366530896876-41757.post@n4.nabble.com> <20130421085739.GA32796@anubis.morrow.me.uk> <1366549841631-41759.post@n4.nabble.com> Message-ID: <5173E7DB.8050702@thelounge.net> Am 21.04.2013 15:10, schrieb iliusha: >> The whole point of Bcc is that the sending SMTP server removes the header > before the mail is sent > Yes, you right, thank you, i didn't know that. > > but, do you now what is strange - ok i don't have the BCC point in message > header, but i have Envelope-to: header, why the sieve won't process it? > (envelope :contains "to" "test at example.com" ) uhm the header is "Envelope-to" and you write "envelope :contains" > This is how i receive email headers: > > /Return-path: > *Envelope-to: test at example.com* if header :matches ["Envelope-to"] ["test at example.com"] {} would make more sense -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From admin at iliusha.md Sun Apr 21 16:34:53 2013 From: admin at iliusha.md (iliusha) Date: Sun, 21 Apr 2013 06:34:53 -0700 (PDT) Subject: [Dovecot] Sieve - BCC In-Reply-To: <5173E7DB.8050702@thelounge.net> References: <1366530896876-41757.post@n4.nabble.com> <20130421085739.GA32796@anubis.morrow.me.uk> <1366549841631-41759.post@n4.nabble.com> <5173E7DB.8050702@thelounge.net> Message-ID: <1366551293807-41761.post@n4.nabble.com> *if header :matches ["Envelope-to"] ["test at examle.com"] {} * is exactly what i need. Thank You All. -- View this message in context: http://dovecot.2317879.n4.nabble.com/Sieve-BCC-tp41757p41761.html Sent from the Dovecot mailing list archive at Nabble.com. From stephan at rename-it.nl Sun Apr 21 16:38:46 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Sun, 21 Apr 2013 15:38:46 +0200 Subject: [Dovecot] Sieve - BCC In-Reply-To: <5173E7DB.8050702@thelounge.net> References: <1366530896876-41757.post@n4.nabble.com> <20130421085739.GA32796@anubis.morrow.me.uk> <1366549841631-41759.post@n4.nabble.com> <5173E7DB.8050702@thelounge.net> Message-ID: <5173EBE6.606@rename-it.nl> Hi Reindl, On 4/21/2013 3:21 PM, Reindl Harald wrote: > Am 21.04.2013 15:10, schrieb iliusha: >> but, do you now what is strange - ok i don't have the BCC point in message >> header, but i have Envelope-to: header, why the sieve won't process it? >> (envelope :contains "to" "test at example.com" ) > uhm the header is "Envelope-to" and you write "envelope :contains" > >> This is how i receive email headers: >> >> /Return-path: >> *Envelope-to: test at example.com* > if header :matches ["Envelope-to"] ["test at example.com"] {} > would make more sense Although the above will work, it does not mean that the approach Iliusha has chosen is wrong. Be sure you know the Sieve specification before you comment: https://tools.ietf.org/html/rfc5228#section-5.4 In fact, that is normally the cleanest method to access the actual message envelope. Depending on the setup, those envelope headers may or may not represent the correct information. They usually do, if they exist, but still. Also, why do you use ':matches' in your example? :) Regards, Stephan. From stephan at rename-it.nl Sun Apr 21 16:52:03 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Sun, 21 Apr 2013 15:52:03 +0200 Subject: [Dovecot] Sieve - BCC In-Reply-To: <1366549841631-41759.post@n4.nabble.com> References: <1366530896876-41757.post@n4.nabble.com> <20130421085739.GA32796@anubis.morrow.me.uk> <1366549841631-41759.post@n4.nabble.com> Message-ID: <5173EF03.5040300@rename-it.nl> On 4/21/2013 3:10 PM, iliusha wrote: >> The whole point of Bcc is that the sending SMTP server removes the header > before the mail is sent > Yes, you right, thank you, i didn't know that. > > but, do you now what is strange - ok i don't have the BCC point in message > header, but i have Envelope-to: header, why the sieve won't process it? > (envelope :contains "to" "test at example.com" ) > > This is how i receive email headers: > > /Return-path: > *Envelope-to: test at example.com* > Delivery-date: Sun, 21 Apr 2013 09:24:23 +0300 That is strange. This could mean that the envelope is passed a bit differently than you think. Those headers are only used by Dovecot if no other sources are available for envelope information. Do you see anything strange in the logs? You could try the following Sieve script to get a bit more information (perhaps I should make a normal debug log line for this). require "vnd.dovecot.debug"; require "envelope"; require "variables"; # Get envelope if envelope :matches "to" "*" { set "env_to" "${1}"; } debug_log "ENVELOPE_TO: ${env_to}"; You need to enable the vnd.dovecot.debug extension in your sieve_extensions= setting. The debug line will be logged in the user log (e.g. ~/.dovecot.sieve.log) Regards, Stephan. From h.reindl at thelounge.net Sun Apr 21 16:55:42 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sun, 21 Apr 2013 15:55:42 +0200 Subject: [Dovecot] Sieve - BCC In-Reply-To: <5173EBE6.606@rename-it.nl> References: <1366530896876-41757.post@n4.nabble.com> <20130421085739.GA32796@anubis.morrow.me.uk> <1366549841631-41759.post@n4.nabble.com> <5173E7DB.8050702@thelounge.net> <5173EBE6.606@rename-it.nl> Message-ID: <5173EFDE.5020701@thelounge.net> Am 21.04.2013 15:38, schrieb Stephan Bosch: >>> /Return-path: >>> *Envelope-to: test at example.com* >> if header :matches ["Envelope-to"] ["test at example.com"] {} >> would make more sense > > Although the above will work, it does not mean that the approach Iliusha has chosen is wrong. Be sure you know the > Sieve specification before you comment: > > https://tools.ietf.org/html/rfc5228#section-5.4 i comment not based on how things SHOULD be in theory i GENERALLY comment with working examples how they ARE from the real world > In fact, that is normally the cleanest method to access the actual message envelope. Depending on the setup, those > envelope headers may or may not represent the correct information. They usually do, if they exist, but still. > > Also, why do you use ':matches' in your example? :) because the "contains" from the OP has the same intention? because it is from a well working sieve-script for subject-matching with some hundret entries to protect postmaster-address from most spam while go with the RFC that postmaster must not be spam-filtered at the MX if header :matches ["Subject"] ["*please your woman*","*see sexy*"]{discard;} goes well with the RFC as example and leaves me in peace at the same time :-) -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From stephan at rename-it.nl Sun Apr 21 17:16:56 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Sun, 21 Apr 2013 16:16:56 +0200 Subject: [Dovecot] Sieve - BCC In-Reply-To: <5173EFDE.5020701@thelounge.net> References: <1366530896876-41757.post@n4.nabble.com> <20130421085739.GA32796@anubis.morrow.me.uk> <1366549841631-41759.post@n4.nabble.com> <5173E7DB.8050702@thelounge.net> <5173EBE6.606@rename-it.nl> <5173EFDE.5020701@thelounge.net> Message-ID: <5173F4D8.7060601@rename-it.nl> On 4/21/2013 3:55 PM, Reindl Harald wrote: > > Am 21.04.2013 15:38, schrieb Stephan Bosch: >>>> /Return-path: >>>> *Envelope-to: test at example.com* >>> if header :matches ["Envelope-to"] ["test at example.com"] {} >>> would make more sense >> Although the above will work, it does not mean that the approach Iliusha has chosen is wrong. Be sure you know the >> Sieve specification before you comment: >> >> https://tools.ietf.org/html/rfc5228#section-5.4 > i comment not based on how things SHOULD be in theory > i GENERALLY comment with working examples how they ARE from the real world I don't have a problem with that. I'm just saying that it DOES make (more) sense to use the envelope extension the way he is doing. :) Did you encounter any problems with the envelope extension in your own experience? >> Also, why do you use ':matches' in your example? :) > because the "contains" from the OP has the same intention? > > because it is from a well working sieve-script for subject-matching with > some hundret entries to protect postmaster-address from most spam while > go with the RFC that postmaster must not be spam-filtered at the MX > > if header :matches ["Subject"] ["*please your woman*","*see sexy*"]{discard;} > > goes well with the RFC as example and leaves me in peace at the same time :-) Well, using ':matches" for one key value without wildcards is a bit useless. In that case it is equivalent to ':is' or leaving the match type out. But yes, I agree, if it is part of a large list of match keys (only some of which have no wild cards), it does make sense. Regards, Stephan. From h.reindl at thelounge.net Sun Apr 21 17:30:48 2013 From: h.reindl at thelounge.net (Reindl Harald) Date: Sun, 21 Apr 2013 16:30:48 +0200 Subject: [Dovecot] Sieve - BCC In-Reply-To: <5173F4D8.7060601@rename-it.nl> References: <1366530896876-41757.post@n4.nabble.com> <20130421085739.GA32796@anubis.morrow.me.uk> <1366549841631-41759.post@n4.nabble.com> <5173E7DB.8050702@thelounge.net> <5173EBE6.606@rename-it.nl> <5173EFDE.5020701@thelounge.net> <5173F4D8.7060601@rename-it.nl> Message-ID: <5173F818.9060904@thelounge.net> Am 21.04.2013 16:16, schrieb Stephan Bosch: > On 4/21/2013 3:55 PM, Reindl Harald wrote: >> i comment not based on how things SHOULD be in theory >> i GENERALLY comment with working examples how they ARE from the real world > > I don't have a problem with that. I'm just saying that it DOES make (more) sense to use the envelope extension the > way he is doing. :) > > Did you encounter any problems with the envelope extension in your own experience? i try to minimize the usage of extensions to write as portable scripts as possible independent if we speak about sieve, php or whatever language >>> Also, why do you use ':matches' in your example? :) >> because the "contains" from the OP has the same intention? >> >> because it is from a well working sieve-script for subject-matching with >> some hundret entries to protect postmaster-address from most spam while >> go with the RFC that postmaster must not be spam-filtered at the MX >> >> if header :matches ["Subject"] ["*please your woman*","*see sexy*"]{discard;} >> >> goes well with the RFC as example and leaves me in peace at the same time :-) > > Well, using ':matches" for one key value without wildcards is a bit useless. In that case it is equivalent to ':is' > or leaving the match type out. But yes, I agree, if it is part of a large list of match keys (only some of which > have no wild cards), it does make sense yep, and the spamfilter-sieve is generated from a database with a small webinterface for add and remove entries and the only difference is the decision komma at the end or not - see below, maybe some other admin is happy with it :-) if header :matches ["Subject"] [ "*aktuelle stellenausschreibungen*", "*alert - new message received*", "*alert will be released in just*", "*arbeitsmarkt naturwissenschaften*", "*armbanduhren*", "*banks and wallstreet*", "*banks manipulate us*", "*bedroom life*", "*can earn more*", "*can we chat*", "*card payment*", "*company to research*", "*consultant*", "*control de presentismo*", "*could be a big bounce play*", "*day-trade play*", "*delight this night*", "*einen neuen job*", "*environmental company*", "*featured on cbs*", "*financial consulting*", "*fw: job", "*fw: reseume*", "*gibraltar*", "*got those pics*", "*great opportunity*", "*great start with actual gains*", "*hour work week*", "*investment partnership*", "*invite you to work*", "*job offer*", "*konto bei credit suisse*", "*kraft foods*", "*love life*", "*make money today*", "*making a fool of you*", "*methods of power*", "*my profile*", "*new daily matches*", "*new ematches by email*", "*new monster stock*", "*offenen stellen*", "*organic growth potential*", "*payment new code*", "*per hour for remote assistance*", "*please your woman*", "*promocione*", "*promotion company looking*", "*re: my profile*", "*re: reseume*", "*ready to flirt*", "*remote assistants*", "*satisfy ladies*", "*searching for representatives*", "*see sexy*", "*the big dollars*", "*ticket to richer life*", "*ubs ag -konto*", "*ubs ag-konto*", "*united technologies corporation*", "*viagra*", "*viarga*", "*von ihrem konto bei ubs ag*", "*wake up her true desires*", "*we are currently looking to recruit", "*we are looking for assistants in your town*", "*we invite you to a remote job*", "*we offer you a personal decision*", "*we will advise you for free*", "*wir suchen einen operationsmanager*", "*wire transfer confirmation*", "*with the advertising*", "*work offer*", "*you have new matches*", "*your carnal needs*", "*your girlfriend*", "*your interest rates are unfair*", "*your intimate life*", "*your monthly income can be increased*", "*your wire transfer*", "2 explosions*", "30 days to a new ph*", "a call for nomination*", "abwesend: spam quarantine*", "achtung: von ihrem konto*", "act now and thank me later*", "add the title*", "administrative assistant*", "administrative sales*", "administrator", "administrator in*", "administrator pos*", "administrator-financier*", "alert - new matches", "angebote im netz", "arbeit in deutschland*", "arbeiten in teilzeit*", "are you ready to impress*", "as a matter*", "assistant vacancy*", "bases de empresas*", "bekommen sie philip stein*", "best prices*", "breaking -*", "buy today*", "career opportunity*", "congrats members*", "conspiracy: banks*", "control de accesos*", "current open position*", "current vacancy*", "database management*", "do you desire*", "do you want to gratify*", "employment*", "environmental business*", "environmental organization*", "es ist der magische*", "excellent opportunity*", "fantastische ergebnisse*", "finance administrator*", "finance manager", "financial redemption*", "from coast to coast", "from the desk of*", "full recruitment*", "fw: work*", "get a new job*", "getting ready*", "hey honey*", "hey there*", "hi honey*", "hi sweetie*", "hot stock*", "i seek for your sincere*", "information zur jobborse*", "it continues to climb*", "it is absolutely awesome*", "it reports additional positive results", "it`s me again*", "job ad*", "job angebot*", "job offer*", "job opportunity*", "job proposal*", "job-vorschlag*", "jobbvagledare*", "karriarcenter*", "keep your gf*", "learn*", "life is miserable*", "linkedin*", "listados de*", "located in europe?*", "managed to make*", "manager*", "more exposure", "most good recruiters", "my hot pics*", "my pics for you", "new buddy request*", "new job*", "new request", "new shop*", "next day delivery. sale", "offene stelle*", "offshore*", "open vacancy*", "order now*", "order today*", "our quickly expanding*", "paid surveys*", "part-time work*", "position opening*", "postmaster order on www.gsm-proslushka.com", "postmaster*", "re: changelog new", "re: jobbsokande*", "re: remember me*", "re: spam quarantine summary*", "re: urgent notification*", "re: your profile", "read me*", "read, research*", "recruitment*", "retirement out of office re: spam quarantine summary*", "save money*", "should you buy it*", "show your true greatness*", "small cap daily", "small helper for*", "soka job*", "something big is coming*", "spy devices*", "start new employment today*", "start working today*", "starten sie*", "stunning investigation*", "submit your nomination*", "superb chance for employment*", "sweet lord*", "texas explosion*", "this company*", "this stock*", "today new matches", "turn your 2 spare*", "ubs ag kontobenachrichtigung*", "ultra fast delivery*", "vacancy*", "verizon wireless*", "virtual assistant*", "virtual manager*", "virtuelle-manager*", "we are creating*", "we are hearing some big*", "we grow thin quickly*", "we invite you*", "what a mega*", "work at*", "work for*", "work with*", "working in europe", "working in*", "working part time*", "working with*", "you are nominated*", "you can earn an additional*", "you do not have much money*", "you have new matches", "your tracking number*" ] { discard; } else { keep; } -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 263 bytes Desc: OpenPGP digital signature URL: From admin at iliusha.md Sun Apr 21 18:07:14 2013 From: admin at iliusha.md (iliusha) Date: Sun, 21 Apr 2013 08:07:14 -0700 (PDT) Subject: [Dovecot] Sieve - BCC In-Reply-To: <5173EF03.5040300@rename-it.nl> References: <1366530896876-41757.post@n4.nabble.com> <20130421085739.GA32796@anubis.morrow.me.uk> <1366549841631-41759.post@n4.nabble.com> <5173EF03.5040300@rename-it.nl> Message-ID: <1366556834656-41767.post@n4.nabble.com> Stephan Bosch-2 wrote > On 4/21/2013 3:10 PM, iliusha wrote: >>> The whole point of Bcc is that the sending SMTP server removes the >>> header >> before the mail is sent > > Do you see anything strange in the logs? > > You could try the following Sieve script to get a bit more information > (perhaps I should make a normal debug log line for this). > > require "vnd.dovecot.debug"; > require "envelope"; > require "variables"; > > # Get envelope > if envelope :matches "to" "*" { set "env_to" "${1}"; } > > debug_log "ENVELOPE_TO: ${env_to}"; > > You need to enable the vnd.dovecot.debug extension in your > sieve_extensions= setting. > > The debug line will be logged in the user log (e.g. ~/.dovecot.sieve.log) > > Regards, > > Stephan. Enabling debug i found where was my mistake, so i use Virtual list: test at example.com -> user at example.com. and when i sent email to test at example.com it automatically goes to user at example.com, but in email headers i saw Envelope To: test at example.com, and I thought that sieve also sees Envelope to: test at example.com, but it is not right. (It is my first experience with sieve, i am new in this.) main_script: line 17: info: DEBUG: ENVELOPE_TO: *user at example.com*. info: msgid=<010301ce3e9e$642ed9f0$2c8c8dd0$@gmail.com>: stored mail into mailbox 'INBOX' Anyway, i'm happy that i found the solution using this forum, otherwise i did not believe that it is possible. Thank You. -- View this message in context: http://dovecot.2317879.n4.nabble.com/Sieve-BCC-tp41757p41767.html Sent from the Dovecot mailing list archive at Nabble.com. From stan at hardwarefreak.com Sun Apr 21 22:51:29 2013 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sun, 21 Apr 2013 14:51:29 -0500 Subject: [Dovecot] Integrate mbox into mdbox In-Reply-To: References: , <517324D4.9080408@hardwarefreak.com> Message-ID: <51744341.8030405@hardwarefreak.com> On 4/21/2013 2:10 AM, lutz.niederer at gmx.net wrote: >>> I have several mbox files (unstructured, only the big plain mbox files) and I would like to integrate/read these mbox files into mdbox subfolders of specific users. This is a production system and I don't want to disturb running services and I am a bit afraid of not using the right command and maybe destroying (or whatever) their mailboxes. I am sure it is pretty easy. Can someone please tell me the correct dsync command line that I should use to read each mbox file (one-way) into the specific folder of the mdbox folder structure of a specific user? > >> More information about the nature of these mbox files, and how they are >> or will be used, would be helpful. > > These mbox files are left over from old installations. The messages contained in these files should be moved into users' mdbox folders. The user tells me the name of the folder and I was hoping for a dsync command line that reads all the messages from the mbox and feeds them into that specific mdbox folder. Some users have 1 some have 5 mbox files left over that need to be imported. After that the mbox files can be thrown away. > >> Is there a reason you don't/won't/can't simply create a new namespace, >> instead of copying the contents from the mbox files into users' mdbox files? > > Simplicity. I thought it would be much easier to push them into mdbox folders with the right command - one by one - than doing it with namespaces. If there is no other way I will do it with namespaces. Simplicity is the reason I mentioned this. You should be able to simply copy all the mbox files, possibly with a single command, to an appropriate user directory, then create the namespace. The way you've described this it seems these mbox files are archives, not 'active' folders that were being used daily prior to your new Dovecot deployment. If that is correct the namespace route is probably better, for many reasons, related both to Dovecot and filesystem fragmentation, etc. If these are folders that were being used daily, recently, then migrating the contents to mdbox may be preferable, as future appends will create less FS fragmentation vs mbox. -- Stan From stephan at rename-it.nl Sun Apr 21 22:51:52 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Sun, 21 Apr 2013 21:51:52 +0200 Subject: [Dovecot] Pigeonhole for 2.2? In-Reply-To: <20130419055344.GA2874@gaby.caf.local> References: <51FA2BDC-A85B-46DF-9ABF-0DA0849D47FE@iki.fi> <20130419055344.GA2874@gaby.caf.local> Message-ID: <51744358.209@rename-it.nl> On 4/19/2013 7:53 AM, Eray Aslan wrote: > On Fri, Apr 19, 2013 at 12:41:26AM +0300, Timo Sirainen wrote: >> http://dovecot.org/releases/2.2/dovecot-2.2.1.tar.gz >> http://dovecot.org/releases/2.2/dovecot-2.2.1.tar.gz.sig > Thanks. Any idea about when pigeonhole (v0.4.0?) for dovecot-2.2 will > be released? There is one issue with the doveadm-sieve plugin that I need to solve before releasing it. That should happen some time in the coming week. Regards, Stephan. From AxelLuttgens at swing.be Mon Apr 22 15:07:29 2013 From: AxelLuttgens at swing.be (Axel Luttgens) Date: Mon, 22 Apr 2013 14:07:29 +0200 Subject: [Dovecot] Dovecot 2.1.16: "default_client_count" written to the logs Message-ID: <04182A1D-B7BF-426D-B017-6AEA5DF66078@swing.be> Hello, As to be expected with low system limits, a warning may be written to the logs: master: Warning: fd limit (ulimit -n) is lower than required under max. load (256 < 1000), because of default_client_count Shouldn't it read "default_client_limit" instead of "default_client_count"? It seems that the warning is written only when reloading Dovecot, not upon Dovecot's startup. Is this deliberate? Thanks, Axel From list at airstreamcomm.net Mon Apr 22 19:34:35 2013 From: list at airstreamcomm.net (list at airstreamcomm.net) Date: Mon, 22 Apr 2013 11:34:35 -0500 Subject: [Dovecot] Dovecot Failover In-Reply-To: <8137242A-8008-4B53-9C57-48844CAF5DA9@iki.fi> References: <5170EB40.7010103@noa.gr> <8137242A-8008-4B53-9C57-48844CAF5DA9@iki.fi> Message-ID: <5175669B.8020100@airstreamcomm.net> On 4/19/13 2:49 AM, Timo Sirainen wrote: > On 19.4.2013, at 10.43, Timo Sirainen wrote: > >> On 19.4.2013, at 9.59, Nikolaos Milas wrote: >> >>> Assuming we have two (low traffic) servers (on different data centers) replicated using dsync, what is the best way to automatically direct users to the main server when it is up and to the redundant one when the main server is down? >>> >>> Using DNS? I've seen that DNS-based failover has generally issues (for example: http://serverfault.com/questions/60553/why-is-dns-failover-not-recommended, which is informative although it refers to web servers). > BTW. I'm kind of hoping that if dsync replication becomes more commonly used with people commonly setting up two A records for the IMAP server, the IMAP clients would evolve to support this by trying out all the listed IPs. Web browsers already do this nowadays (and that's why I think your URL is a bit out of date). > > If DNS were the preferred method for load balancing IMAP/POP3 (or others) I would recommend the clients begin supporting SRV records as they were specifically designed to handle this kind of scenario. From richw at richw.org Mon Apr 22 21:23:54 2013 From: richw at richw.org (Rich Wales) Date: Mon, 22 Apr 2013 11:23:54 -0700 Subject: [Dovecot] Replication -- multiple users, three or more servers? Message-ID: <5175803A.7050703@rde-richw-4.stanford.edu> I'm running Dovecot 2.2.1 on an Ubuntu 12.04.2 server, with half a dozen accounts for various family members. I want to set up replication involving at least three Ubuntu servers, with different users replicated on different sets of servers. For example, I might have mail for "user1" replicated on "server1", "server2", and "server3"... while mail for "user2" would be on "server1" and "server2"... and mail for "user3" would be on "server1" and "server3". I've read the wiki page (http://wiki2.dovecot.org/Replication), but I'm still confused. I'd love to see an example that clearly shows how to set up specific individual mail users to be replicated on a different set of servers for each user, like what I described above. Rich Wales richw at richw.org From jtam.home at gmail.com Tue Apr 23 05:56:08 2013 From: jtam.home at gmail.com (Joseph Tam) Date: Mon, 22 Apr 2013 19:56:08 -0700 (PDT) Subject: [Dovecot] Using dsync to export mail to remote IMAP account Message-ID: I've read the web/man pages on dsync, but it's not clear to me whether dsync can be used to export (rather than import) a user's mailbox to a remote non-dovecot IMAP account. (The intention is to use it whenever a user leaves and wants to copy their local mail to Google or whatever. I currently use uw-imapd's mailutil -- it works, but it's dreadfully slow.) As a first crack at it, I tried (on the dovecot server) dsync -o imapc_user=remoteuser -o imapc_password=remotepassword -o imapc_host=remote-imap-server -o imapc_port=993 -o imapc_ssl=imaps -o imapc_features=rfc822.size -o imapc_list_prefix=remoteprefix -o mailbox_list_index=no backup -f -u localuser imapc: I got this error: dsync(localuser): Error: user localuser: Initialization failed: Namespace '': Unknown mail storage driver imapc dsync(localuser): Fatal: User init failed Is exporting mail to a remote (non-dovecot) IMAP account even doable with dsync, or am I completely off-track? Joseph Tam From michael at los-pollos.co Tue Apr 23 07:07:49 2013 From: michael at los-pollos.co (Michael) Date: Tue, 23 Apr 2013 14:07:49 +1000 Subject: [Dovecot] Using dsync to export mail to remote IMAP account In-Reply-To: References: Message-ID: <51760915.10306@los-pollos.co> On 23/04/2013 12:56 PM, Joseph Tam wrote: > > > I've read the web/man pages on dsync, but it's not clear to me whether > dsync can be used to export (rather than import) a user's mailbox to a > remote non-dovecot IMAP account. > > (The intention is to use it whenever a user leaves and wants to copy > their > local mail to Google or whatever. I currently use uw-imapd's mailutil -- > it works, but it's dreadfully slow.) > > As a first crack at it, I tried (on the dovecot server) > > dsync -o imapc_user=remoteuser > -o imapc_password=remotepassword > -o imapc_host=remote-imap-server > -o imapc_port=993 > -o imapc_ssl=imaps > -o imapc_features=rfc822.size > -o imapc_list_prefix=remoteprefix > -o mailbox_list_index=no > backup -f -u localuser imapc: > > I got this error: > > dsync(localuser): Error: user localuser: Initialization failed: > Namespace '': Unknown mail storage driver imapc > dsync(localuser): Fatal: User init failed > > Is exporting mail to a remote (non-dovecot) IMAP account even doable > with dsync, or > am I completely off-track? > > Joseph Tam > > -- No I think dsync only works with dovecot servers. I find LARCH works best for what you are trying to do: https://github.com/rgrove/larch From tss at iki.fi Tue Apr 23 13:30:11 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 23 Apr 2013 13:30:11 +0300 Subject: [Dovecot] Make install error In-Reply-To: <5170BEF0.6060306@mysql.cc> References: <5170BEF0.6060306@mysql.cc> Message-ID: <1366713011.11047.345.camel@innu> On Fri, 2013-04-19 at 11:50 +0800, kengheng wrote: > Hi, I'm recompiling dovecot 2.2.0/2.2.1 with error below during make > install: > > test -z "/usr/local/dovecot/lib/dovecot/auth" || /usr/bin/mkdir -p > "/usr/local/dovecot/lib/dovecot/auth" > /usr/bin/mkdir: cannot create directory > ?/usr/local/dovecot/lib/dovecot/auth?: File exists This file shouldn't exist. > The target Svr OS: OpenSuse 12.2 x86 and installed success for > qmail/vpopmail. The configuration for dovecot as below: > ./configure \ > --prefix=/usr/local/dovecot \ > --with-vpopmail \ > --with-docs \ > --with-ssl \ > --without-shadow \ > --without-pam \ > --without-ldap \ > --without-pgsql \ > --without-sql \ > --without-mysql \ > --without-sqlite I think there's an older differently installed Dovecot in there. rm -rf /usr/local/dovecot/lib and try make install again. From tss at iki.fi Tue Apr 23 13:37:49 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 23 Apr 2013 13:37:49 +0300 Subject: [Dovecot] Dovecot 2.1.16: "default_client_count" written to the logs In-Reply-To: <04182A1D-B7BF-426D-B017-6AEA5DF66078@swing.be> References: <04182A1D-B7BF-426D-B017-6AEA5DF66078@swing.be> Message-ID: <1366713469.11047.348.camel@innu> On Mon, 2013-04-22 at 14:07 +0200, Axel Luttgens wrote: > Hello, > > As to be expected with low system limits, a warning may be written to the logs: > master: Warning: fd limit (ulimit -n) is lower than required under > max. load (256 < 1000), because of default_client_count > Shouldn't it read "default_client_limit" instead of "default_client_count"? Yes, fixed. > It seems that the warning is written only when reloading Dovecot, not upon Dovecot's startup. > Is this deliberate? At startup it only goes to stderr, which I guess your init script hides. Although it would be nice if it logged it also.. I'll see about changing that. From tss at iki.fi Tue Apr 23 13:41:22 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 23 Apr 2013 13:41:22 +0300 Subject: [Dovecot] Replication -- multiple users, three or more servers? In-Reply-To: <5175803A.7050703@rde-richw-4.stanford.edu> References: <5175803A.7050703@rde-richw-4.stanford.edu> Message-ID: <1366713682.11047.351.camel@innu> On Mon, 2013-04-22 at 11:23 -0700, Rich Wales wrote: > I'm running Dovecot 2.2.1 on an Ubuntu 12.04.2 server, with half a dozen > accounts for various family members. I want to set up replication > involving at least three Ubuntu servers, with different users replicated > on different sets of servers. > > For example, I might have mail for "user1" replicated on "server1", > "server2", and "server3"... > > while mail for "user2" would be on "server1" and "server2"... > > and mail for "user3" would be on "server1" and "server3". > > I've read the wiki page (http://wiki2.dovecot.org/Replication), but I'm > still confused. I'd love to see an example that clearly shows how to > set up specific individual mail users to be replicated on a different > set of servers for each user, like what I described above. Everything is the same as in that wiki page, except you need to have userdb field override the mail_replica setting. Or I guess you wouldn't want to have a default mail_replica at all, so users won't accidentally get replicated to wrong place. See http://wiki2.dovecot.org/UserDatabase/ExtraFields For example with SQL something like: user_query = SELECT home, uid, gid, \ concat('tcp:', replicahost) as mail_replica \ FROM users WHERE userid = '%u' From tss at iki.fi Tue Apr 23 13:43:17 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 23 Apr 2013 13:43:17 +0300 Subject: [Dovecot] Using dsync to export mail to remote IMAP account In-Reply-To: References: Message-ID: <1366713797.11047.353.camel@innu> On Mon, 2013-04-22 at 19:56 -0700, Joseph Tam wrote: > > I've read the web/man pages on dsync, but it's not clear to me whether > dsync can be used to export (rather than import) a user's mailbox to a > remote non-dovecot IMAP account. It should be possible at some point, but currently probably won't work very well. > I got this error: > > dsync(localuser): Error: user localuser: Initialization failed: > Namespace '': Unknown mail storage driver imapc > dsync(localuser): Fatal: User init failed But this looks like you simply haven't compiled Dovecot with imapc support. See if dovecot --build-options|grep storage returns imapc. From user+dovecot at localhost.localdomain.org Tue Apr 23 14:47:39 2013 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Tue, 23 Apr 2013 13:47:39 +0200 Subject: [Dovecot] imap Panic: file istream-seekable.c: line 253 (i_stream_seekable_read): assertion failed: (stream->istream.v_offset + stream->pos <= sstream->write_peak) Message-ID: <517674DB.2090302@localhost.localdomain.org> Hi Timo, just another crash - using 2.2.1 (c95cea6e1389). Regards, Pascal -------------- next part -------------- Reading symbols from /usr/local/libexec/dovecot/imap...done. [New LWP 15198] warning: Can't read pathname for load map: Input/output error. [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. #0 0x00007fea0d3a0475 in *__GI_raise (sig=) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 64 ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory. Already logging to gdb.txt. #0 0x00007fea0d3a0475 in *__GI_raise (sig=) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 pid = selftid = #1 0x00007fea0d3a36f0 in *__GI_abort () at abort.c:92 act = {__sigaction_handler = {sa_handler = 0x7fff5fba6bd0, sa_sigaction = 0x7fff5fba6bd0}, sa_mask = {__val = {140643224991072, 140643224986893, 140734799440880, 140643225264237, 140643227545232, 140643220802464, 140643233288192, 140643228326759, 4294967295, 206158430224, 1, 3048496, 0, 0, 0, 140643224485888}}, sa_flags = 232077810, sa_restorer = 0x5d61393300000001} sigs = {__val = {32, 0 }} #2 0x00007fea0d772231 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:191 backtrace = 0xca4020 "/usr/local/lib/dovecot/libdovecot.so.0(+0x7a20a) [0x7fea0d77220a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x7b535) [0x7fea0d773535] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fea0d772"... #3 0x00007fea0d773535 in i_internal_fatal_handler (ctx=0x7fff5fba6d70, format=0x7fea0d7b83a0 "file %s: line %d (%s): assertion failed: (%s)", args=0x7fff5fba6d58) at failures.c:652 status = 0 #4 0x00007fea0d77250d in i_panic (format=0x7fea0d7b83a0 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fff5fba6e40, reg_save_area = 0x7fff5fba6d80}} #5 0x00007fea0d786bb8 in i_stream_seekable_read (stream=0xd658a0) at istream-seekable.c:253 sstream = 0xd658a0 data = 0x7fff5fba6ea0 "\320n\272_\377\177" size = 14047392 pos = 27457 ret = 139638205298784 __FUNCTION__ = "i_stream_seekable_read" #6 0x00007fea0d77e866 in i_stream_read (stream=0xd65900) at istream.c:149 _stream = 0xd658a0 old_size = 0 ret = 140643225038704 __FUNCTION__ = "i_stream_read" #7 0x00007fea0d784c6f in i_stream_limit_read (stream=0xd39d00) at istream-limit.c:50 lstream = 0xd39d00 left = 140643225038704 ret = 14047488 pos = 0 __FUNCTION__ = "i_stream_limit_read" #8 0x00007fea0d77e866 in i_stream_read (stream=0xd39d60) at istream.c:149 _stream = 0xd39d00 old_size = 0 ret = 13868288 __FUNCTION__ = "i_stream_read" #9 0x00007fea0d77ebf9 in i_stream_read_copy_from_parent (istream=0xd39f00) at istream.c:193 stream = 0xd39ea0 pos = 0 ret = 13868288 __FUNCTION__ = "i_stream_read_copy_from_parent" #10 0x00007fea0daa1b67 in i_stream_mail_read (stream=0xd39ea0) at istream-mail.c:67 mstream = 0xd39ea0 size = 13868384 ret = 13254133 #11 0x00007fea0d77e866 in i_stream_read (stream=0xd39f00) at istream.c:149 _stream = 0xd39ea0 old_size = 0 ret = 140643221218978 __FUNCTION__ = "i_stream_read" #12 0x00007fea0d782fc9 in i_stream_crlf_read_common (cstream=0xd5e440) at istream-crlf.c:22 stream = 0xd5e440 size = 0 avail = 13254247 ret = 0 __FUNCTION__ = "i_stream_crlf_read_common" #13 0x00007fea0d7830d1 in i_stream_crlf_read_crlf (stream=0xd5e440) at istream-crlf.c:46 cstream = 0xd5e440 data = 0xd39ea0 "\002" ptr = 0xd39ea0 "\002" src = 0x7fffffffffff
src_end = 0xd39f00 "Ak" dest = 0xd39f00 "Ak" dest_end = 0x0 size = 0 copy_len = 27457 ret = 140734799442160 __FUNCTION__ = "i_stream_crlf_read_crlf" #14 0x00007fea0d77e866 in i_stream_read (stream=0xd5e4a0) at istream.c:149 _stream = 0xd5e440 old_size = 0 ret = 140643225038704 __FUNCTION__ = "i_stream_read" #15 0x00007fea0d784c6f in i_stream_limit_read (stream=0xd5e5e0) at istream-limit.c:50 lstream = 0xd5e5e0 left = 140643225038704 ret = 14017696 pos = 0 __FUNCTION__ = "i_stream_limit_read" #16 0x00007fea0d77e866 in i_stream_read (stream=0xd5e640) at istream.c:149 _stream = 0xd5e5e0 old_size = 0 ret = -6697839139754035552 __FUNCTION__ = "i_stream_read" #17 0x00007fea0d77f75b in i_stream_read_data (stream=0xd5e640, data_r=0x7fff5fba7258, size_r=0x7fff5fba7268, threshold=8191) at istream.c:479 ret = 0 read_more = false __FUNCTION__ = "i_stream_read_data" #18 0x00007fea0d796ce1 in io_stream_copy (outstream=0xccda68, instream=0xd5e640, block_size=8192) at ostream.c:326 start_offset = 0 iov = {iov_base = 0x7fff5fba7290, iov_len = 0} data = 0x0 ret = 0 #19 0x00007fea0d797101 in o_stream_default_send_istream (outstream=0xccd9e0, instream=0xd5e640) at ostream.c:468 No locals. #20 0x00007fea0d796b4f in o_stream_send_istream (outstream=0xccda68, instream=0xd5e640) at ostream.c:287 _outstream = 0xccd9e0 ret = 0 __FUNCTION__ = "o_stream_send_istream" #21 0x000000000041db0f in fetch_stream_continue (ctx=0xcc94b0) at imap-fetch-body.c:90 state = 0xcc9500 ret = 13835120 #22 0x000000000041df49 in fetch_body_msgpart (ctx=0xcc94b0, mail=0xd39530, body=0xd31b70) at imap-fetch-body.c:184 result = {input = 0xd5e640, size = 285, size_field = 0, binary_decoded_input_has_nuls = false} str = 0xca3be0 #23 0x000000000041c880 in imap_fetch_more_int (ctx=0xcc94b0, cancel=false) at imap-fetch.c:504 h = 0xcc98d0 _data_stack_cur_id = 4 state = 0xcc9500 client = 0xcc8760 handlers = 0xcc97e0 count = 7 ret = 1 __FUNCTION__ = "imap_fetch_more_int" #24 0x000000000041cab9 in imap_fetch_more (ctx=0xcc94b0, cmd=0xcc9340) at imap-fetch.c:556 ret = 0 __FUNCTION__ = "imap_fetch_more" #25 0x000000000040f046 in cmd_fetch (cmd=0xcc9340) at cmd-fetch.c:279 client = 0xcc8760 ctx = 0xcc94b0 args = 0xcaeac8 next_arg = 0xcaeb28 list_arg = 0xcc9428 search_args = 0x0 qresync_args = {qresync_sample_seqset = 0x1, qresync_sample_uidset = 0x10} messageset = 0xcaec30 "1796" send_vanished = false ret = 1 #26 0x000000000041a03e in command_exec (cmd=0xcc9340) at imap-commands.c:156 hook = 0xcacda0 ret = false #27 0x0000000000418f7a in client_command_input (cmd=0xcc9340) at imap-client.c:775 client = 0xcc8760 command = 0x7fff5fba7500 __FUNCTION__ = "client_command_input" #28 0x000000000041927a in client_command_input (cmd=0xcc9340) at imap-client.c:836 client = 0xcc8760 command = 0xcacab8 __FUNCTION__ = "client_command_input" #29 0x000000000041939a in client_handle_next_command (client=0xcc8760, remove_io_r=0x7fff5fba758d) at imap-client.c:874 No locals. #30 0x000000000041941a in client_handle_input (client=0xcc8760) at imap-client.c:886 _data_stack_cur_id = 3 ret = false remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #31 0x00000000004195ad in client_input (client=0xcc8760) at imap-client.c:928 cmd = 0xcbd480 output = 0xccda68 bytes = 133 __FUNCTION__ = "client_input" #32 0x00007fea0d7895f5 in io_loop_call_io (io=0xcc9240) at ioloop.c:387 ioloop = 0xcab720 t_id = 2 #33 0x00007fea0d78b255 in io_loop_handler_run (ioloop=0xcab720) at ioloop-epoll.c:215 ctx = 0xcabaa0 events = 0xcabb10 event = 0xcabb10 list = 0xcc9290 io = 0xcc9240 tv = {tv_sec = 4, tv_usec = 839927} events_count = 6 msecs = 4840 ret = 1 i = 0 j = 0 call = true __FUNCTION__ = "io_loop_handler_run" #34 0x00007fea0d789698 in io_loop_run (ioloop=0xcab720) at ioloop.c:406 No locals. #35 0x00007fea0d72109e in master_service_run (service=0xcab5b0, callback=0x426133 ) at master-service.c:560 No locals. #36 0x000000000042644c in main (argc=1, argv=0xcab390) at main.c:400 set_roots = {0x42f520, 0x0} login_set = {auth_socket_path = 0xca3050 "8", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x425ef7 , failure_callback = 0x4260bf , request_auth_token = 1} service_flags = MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = -1 No core file now. From skdovecot at smail.inf.fh-brs.de Tue Apr 23 15:37:08 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 23 Apr 2013 14:37:08 +0200 (CEST) Subject: [Dovecot] Integrate mbox into mdbox In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sat, 20 Apr 2013, lutz.niederer at gmx.net wrote: > I have several mbox files (unstructured, only the big?plain mbox?files) > and I would like to integrate/read these mbox files into mdbox > subfolders of specific users.? This is a production system and I don't > want to disturb running services and I am a bit afraid of not using the > right command and maybe destroying (or whatever) their mailboxes.? I am > sure it is pretty easy.? Can someone please tell me the correct dsync > command line that I should use to read each mbox file?(one-way)?into the > specific folder of the?mdbox folder structure of a specific user? what Dovecot version do you have? doveadm help import might do what you want. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUXaAdF3r2wJMiz2NAQLuaAf+P3B81+32fQ/35n+Vt8lWQWo1jCdAyhPB qP837o3FMwbYhOBxF99VLZDLrB09SQE6s/677QW5yTuFZnWIyWZRRYRWYPXXKCzv qaPp1LoNX+YrdR14eaq1knh4XpF3S9bvd/cb1pPVP3s0yggzLiKcyTeSzamugvFl AlFgRcDYEK+GKqwOV6w5Mg47wb0yKEFYQkWY6x5rtqTY5/XaqsvcGPBNw89U4h2w xUJcPx+lT3nI500M5IbikY1sr1rPv2XJRrngFlBbaf/hNFuFFf4H1WhKO3H06I7F miXmTs2h9u8N1ysRq/uqCZGEc2gkg1gaTGke5hMa5b53D9AvB8rZGA== =KPWK -----END PGP SIGNATURE----- From piper at hrz.uni-marburg.de Tue Apr 23 15:56:07 2013 From: piper at hrz.uni-marburg.de (Piper Andreas) Date: Tue, 23 Apr 2013 14:56:07 +0200 Subject: [Dovecot] Dovecot 2.2.1: typo in src/lib-http/Makefile.in Message-ID: <517684E7.3030207@hrz.uni-marburg.de> Hello, there seems to be a typo in the dovecot-2.2.1-sources: in dovecot-2.2.1/src/lib-http/Makefile.in at line 758 the two lines ../lib-test/libtest.la \ ../lib/liblib.la do not fit into the Makefile-syntax. At compile-time they produce the error make: Fatal error in reader: Makefile, line 725: Unexpected end of line seen If I remove these two lines, everything compiles fine. Could you please check this. Thanks, Andreas -- ________________________________________________________________________ Dr. Andreas Piper, Hochschulrechenzentrum der Philipps-Univ. Marburg Hans-Meerwein-Stra?e, 35032 Marburg, Germany Phone: +49 6421 28-23521 Fax: -26994 E-Mail: piper at HRZ.Uni-Marburg.DE From AxelLuttgens at swing.be Tue Apr 23 16:09:32 2013 From: AxelLuttgens at swing.be (Axel Luttgens) Date: Tue, 23 Apr 2013 15:09:32 +0200 Subject: [Dovecot] Dovecot 2.1.16: "default_client_count" written to the logs In-Reply-To: <1366713469.11047.348.camel@innu> References: <04182A1D-B7BF-426D-B017-6AEA5DF66078@swing.be> <1366713469.11047.348.camel@innu> Message-ID: <089B3A62-24F6-4FFB-A563-09C00CB49052@swing.be> Le 23 avr. 2013 ? 12:37, Timo Sirainen a ?crit : > On Mon, 2013-04-22 at 14:07 +0200, Axel Luttgens wrote: >> Hello, >> >> [...] >> Shouldn't it read "default_client_limit" instead of "default_client_count"? > > Yes, fixed. Thanks, Timo. >> It seems that the warning is written only when reloading Dovecot, not upon Dovecot's startup. >> Is this deliberate? > > At startup it only goes to stderr, which I guess your init script hides. Indeed, stdout/stderr are ignored by default for daemons started by launchd (one could specify file paths for those outputs, at the expense of some fds). > Although it would be nice if it logged it also.. I'll see about changing > that. Probably not a high priority one, but... yes, would be nice to have such warnings logged as well at startup. Best regards, Axel From tss at iki.fi Tue Apr 23 16:21:25 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 23 Apr 2013 16:21:25 +0300 Subject: [Dovecot] Dovecot 2.2.1: typo in src/lib-http/Makefile.in In-Reply-To: <517684E7.3030207@hrz.uni-marburg.de> References: <517684E7.3030207@hrz.uni-marburg.de> Message-ID: <6C6C27DC-3B12-41B4-BFDE-F79A956F810B@iki.fi> On 23.4.2013, at 15.56, Piper Andreas wrote: > > there seems to be a typo in the dovecot-2.2.1-sources: > > in dovecot-2.2.1/src/lib-http/Makefile.in at line 758 the two lines > > ../lib-test/libtest.la \ > ../lib/liblib.la > > do not fit into the Makefile-syntax. At compile-time they produce the error > > make: Fatal error in reader: Makefile, line 725: Unexpected end of line seen Fixed: http://hg.dovecot.org/dovecot-2.2/rev/43e7606b31e2 From AxelLuttgens at swing.be Tue Apr 23 16:43:28 2013 From: AxelLuttgens at swing.be (Axel Luttgens) Date: Tue, 23 Apr 2013 15:43:28 +0200 Subject: [Dovecot] Running LMTP as a user other than the root user In-Reply-To: <171F2418-4D48-48F3-BA87-FAE0DBAA9333@swing.be> References: <171F2418-4D48-48F3-BA87-FAE0DBAA9333@swing.be> Message-ID: <3E037E18-ACA9-4E60-8D8B-D0ED07088A42@swing.be> Le 16 avr. 2013 ? 19:47, Axel Luttgens a ?crit : > [...] Mea culpa. I missed a few enlightening lines in 10-master.conf, at the beginning of the "service auth" section. They are terribly useful for understanding the coding choices and to conclude that everything "works as intended". Axel From tss at iki.fi Tue Apr 23 17:22:28 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 23 Apr 2013 17:22:28 +0300 Subject: [Dovecot] imap Panic: file istream-seekable.c: line 253 (i_stream_seekable_read): assertion failed: (stream->istream.v_offset + stream->pos <= sstream->write_peak) In-Reply-To: <517674DB.2090302@localhost.localdomain.org> References: <517674DB.2090302@localhost.localdomain.org> Message-ID: On 23.4.2013, at 14.47, Pascal Volk wrote: > just another crash - using 2.2.1 (c95cea6e1389). Fixed: http://hg.dovecot.org/dovecot-2.2/rev/2784b88a4260 (This started happening only after yesterday's zlib change.) From rickard.nilsson at telia.com Tue Apr 23 17:58:58 2013 From: rickard.nilsson at telia.com (Rickard Nilsson) Date: Tue, 23 Apr 2013 16:58:58 +0200 Subject: [Dovecot] Feature request: Configure CONFIG_MODULE_DIR and AUTH_MODULE_DIR at runtime Message-ID: Hi! I am running dovecot 2.1.16 on NixOS (http://nixos.org), and I have been fighting the dynamically loaded dovecot modules/plugins a bit. The problem is that in Nix/NixOS all packages are completely isolated from each other (each package has a separate /lib, /libexec, /bin etc, with only its own files in it). So dovecot has all its modules under /nix/store/xxx-dovecot/{lib,libexec}/dovecot, and the Pigeonhole modules are under /nix/store/yyy-pidgeonhole/{lib,libexec}/dovecot. Now, dovecot wants to load modules only from one directory, so I created a "virtual" package that unifies all modules in /nix/store/zzz-dovecot-plugins/{lib,libexec}/dovecot. I can then use this directory as the "mail_plugin_dir" setting in dovecot.conf. This works fine, dovecot can then find the "sieve" mail plugin. The problem is the service and auth modules, that dovecot tries to load from the compile-time set MODULE_DIR/{settings,auth}. This is a problem for me, because I can't set the module path during compilation since that introduces a circular dependency between the dovecot package and the virtual dovecot-plugins package. I have solved this by hacking dovecot to read an environment variable, DOVECOT_CONFIG_MODULE_DIR, in the config_parse_load_modules function. This way I can inject my module path during runtime. But this only works for the master process, not the config process which seems to reset its environment (I assume it does this when dropping privileges). So I did another hack which lets me pass an argument to the config process which contains the module path. I can then set this argument in dovecot.conf by "service config { executable = config /my/module/path }". These hacks work, and I can now use both the sieve mail plugin and the sieve service. I have attached the patch, but this is not a request to add it to the source. My hack is a hack because I don't know enough about the inner workings of dovecot to solve it in a good way. Rather, I'm asking for some way to configure the module path in dovecot, either as an argument to the master process or as a setting in dovecot.conf. A bonus would be the ability to specify several paths that dovecot would search, then I can do away with my virtual module package. Best regards, Rickard Nilsson -------------- next part -------------- A non-text attachment was scrubbed... Name: module_dir.patch Type: application/octet-stream Size: 4666 bytes Desc: not available URL: From tss at iki.fi Tue Apr 23 18:20:02 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 23 Apr 2013 18:20:02 +0300 Subject: [Dovecot] Feature request: Configure CONFIG_MODULE_DIR and AUTH_MODULE_DIR at runtime In-Reply-To: References: Message-ID: <928006EA-6DC7-4316-82E6-32E831D281CB@iki.fi> On 23.4.2013, at 17.58, Rickard Nilsson wrote: > I am running dovecot 2.1.16 on NixOS (http://nixos.org), and I have been fighting the dynamically loaded dovecot modules/plugins a bit. > > The problem is that in Nix/NixOS all packages are completely isolated from each other (each package has a separate /lib, /libexec, /bin etc, with only its own files in it). So dovecot has all its modules under /nix/store/xxx-dovecot/{lib,libexec}/dovecot, and the Pigeonhole modules are under /nix/store/yyy-pidgeonhole/{lib,libexec}/dovecot. > > Now, dovecot wants to load modules only from one directory, so I created a "virtual" package that unifies all modules in /nix/store/zzz-dovecot-plugins/{lib,libexec}/dovecot. I can then use this directory as the "mail_plugin_dir" setting in dovecot.conf. This works fine, dovecot can then find the "sieve" mail plugin. > > The problem is the service and auth modules, that dovecot tries to load from the compile-time set MODULE_DIR/{settings,auth}. This is a problem for me, because I can't set the module path during compilation since that introduces a circular dependency between the dovecot package and the virtual dovecot-plugins package. Sounds like a rather generic problem in nixos. Maybe there could be generic way to handle this for other packages too, like maybe creating a whole new directory somewhere (e.g. under /var) that has symlinks to all the installed plugins? > I have solved this by hacking dovecot to read an environment variable, DOVECOT_CONFIG_MODULE_DIR, in the config_parse_load_modules function. This way I can inject my module path during runtime. But this only works for the master process, not the config process which seems to reset its environment (I assume it does this when dropping privileges). So I did another hack which lets me pass an argument to the config process which contains the module path. I can then set this argument in dovecot.conf by "service config { executable = config /my/module/path }". You can preserve environments by adding them to import_environment setting. > These hacks work, and I can now use both the sieve mail plugin and the sieve service. I have attached the patch, but this is not a request to add it to the source. My hack is a hack because I don't know enough about the inner workings of dovecot to solve it in a good way. Rather, I'm asking for some way to configure the module path in dovecot, either as an argument to the master process or as a setting in dovecot.conf. A bonus would be the ability to specify several paths that dovecot would search, then I can do away with my virtual module package. I'd rather make those plugin dirs configurable, since it only adds new settings that just about nobody changes (and perhaps I shouldn't have added mail_plugin_dir setting either in the first place). From richw at richw.org Tue Apr 23 18:29:31 2013 From: richw at richw.org (Rich Wales) Date: Tue, 23 Apr 2013 08:29:31 -0700 Subject: [Dovecot] Replication -- multiple users, three or more servers? In-Reply-To: <1366713682.11047.351.camel@innu> References: <5175803A.7050703@rde-richw-4.stanford.edu> <1366713682.11047.351.camel@innu> Message-ID: <5176A8DB.4060106@liberation.richw.org> Replying to Timo: > Everything is the same as in that wiki page, except you need to have > userdb field override the mail_replica setting. Or I guess you wouldn't > want to have a default mail_replica at all, so users won't accidentally > get replicated to wrong place. See > http://wiki2.dovecot.org/UserDatabase/ExtraFields OK, thanks. Is there a debugging option I can specify here to cause Dovecot to generate more verbose logging output, so I can see exactly what is happening (and what is not working) when I try to run replication? In the "Replication" wiki page, you show one example using the string "remote:" at the start of the "mail_replica" value, and another example starting with "remoteprefix:". What is the difference between these? Or is there a typo here? I tried searching the wiki but couldn't find anything explaining this. The example with a dsync wrapper script seems to be describing a situation where the first line of text sent to the remote host consists of the user name (which is read by the wrapper script and passed as a command-line argument to dsync-server). Is this what "remoteprefix:" does, in contrast to "remote:"? In the dsync wrapper script example, is "vmail" in the mail_replica value an example of a user ID to be used on the remote host? What user ID is used on the local host? I think one reason why my tests so far haven't been working may be that I'm not sure which user ID is being used on each end, so my SSH keys aren't being used properly and the connection is failing. Finally, the "Replication" wiki page mentions the "authorized_keys2" file, which (AFAIK) is deprecated in the current SSH -- all authorized keys should be in a single "authorized_keys" file on the target host, right? Rich Wales richw at richw.org From rickard.nilsson at telia.com Tue Apr 23 18:33:44 2013 From: rickard.nilsson at telia.com (Rickard Nilsson) Date: Tue, 23 Apr 2013 17:33:44 +0200 Subject: [Dovecot] Feature request: Configure CONFIG_MODULE_DIR and AUTH_MODULE_DIR at runtime In-Reply-To: <928006EA-6DC7-4316-82E6-32E831D281CB@iki.fi> References: <928006EA-6DC7-4316-82E6-32E831D281CB@iki.fi> Message-ID: Den 2013-04-23 17:20:02 skrev Timo Sirainen : > On 23.4.2013, at 17.58, Rickard Nilsson > wrote: > >> The problem is the service and auth modules, that dovecot tries to load >> from the compile-time set MODULE_DIR/{settings,auth}. This is a problem >> for me, because I can't set the module path during compilation since >> that introduces a circular dependency between the dovecot package and >> the virtual dovecot-plugins package. > > Sounds like a rather generic problem in nixos. Maybe there could be > generic way to handle this for other packages too, like maybe creating a > whole new directory somewhere (e.g. under /var) that has symlinks to all > the installed plugins? Yes, that is possible. I can create the plugin directory as part of the dovecot service startup, I do not need to build it as a separate package. Could dovecot maybe be made to search for plugins somewhere under base_dir? I already make sure the base_dir is created before starting the service, I could assemble a base_dir/plugins or something, too. >> I have solved this by hacking dovecot to read an environment variable, >> DOVECOT_CONFIG_MODULE_DIR, in the config_parse_load_modules function. >> This way I can inject my module path during runtime. But this only >> works for the master process, not the config process which seems to >> reset its environment (I assume it does this when dropping privileges). >> So I did another hack which lets me pass an argument to the config >> process which contains the module path. I can then set this argument in >> dovecot.conf by "service config { executable = config /my/module/path >> }". > > You can preserve environments by adding them to import_environment > setting. OK, that's good to know, although I would like to avoid the environment trickery entirely. >> These hacks work, and I can now use both the sieve mail plugin and the >> sieve service. I have attached the patch, but this is not a request to >> add it to the source. My hack is a hack because I don't know enough >> about the inner workings of dovecot to solve it in a good way. Rather, >> I'm asking for some way to configure the module path in dovecot, either >> as an argument to the master process or as a setting in dovecot.conf. A >> bonus would be the ability to specify several paths that dovecot would >> search, then I can do away with my virtual module package. > > I'd rather make those plugin dirs configurable, since it only adds new > settings that just about nobody changes (and perhaps I shouldn't have > added mail_plugin_dir setting either in the first place). With configurable, you mean compile-time configurable? I could live with that. The best would be if the configured paths were relative the base_dir, as mentioned above. But absolute paths could work too (but it would make it harder to run several instances side-by-side). / Rickard From professa at dementianati.com Tue Apr 23 19:28:55 2013 From: professa at dementianati.com (Professa Dementia) Date: Tue, 23 Apr 2013 09:28:55 -0700 Subject: [Dovecot] Feature request: Configure CONFIG_MODULE_DIR and AUTH_MODULE_DIR at runtime In-Reply-To: References: Message-ID: <5176B6C7.4000907@dementianati.com> If you start/stop dovecot with an initscript or some other related system, you can do what SuSE does, since this problem occurs in lots of situations, not just dovecot. Since you know where all the config files are, you could either have the initscript set up a directory with symlinks, as Timo said, or you could collect them together and place them all in one file that is in the correct location. Multiple config files for dovecot can be concatenated together if you are careful to scan for and accommodate "include" directives. Dem From kyle-dovecot at memoryhole.net Tue Apr 23 19:52:01 2013 From: kyle-dovecot at memoryhole.net (Kyle Wheeler) Date: Tue, 23 Apr 2013 10:52:01 -0600 Subject: [Dovecot] mailbox_list_index_parse_header crash Message-ID: <20130423165201.GB32084@queeg.we-be-smart.org> Hi, I got all excited about IMAP NOTIFY support and tried enabling mailbox_list_index on my server. Unfortunately, I rather quickly ran into trouble of the segfault variety. This prevented me from doing basic things like seeing the contents of some of my folders. Disabling mailbox_list_index got me back up and running, but... darnit, that's annoying. The only message I got in my log file was this: imap(user at domain): Fatal: master: service(imap): child 6899 killed with signal 11 (core dumped) If I can help track this down, please let me know. Here's the backtrace: #0 hash_table_insert_node (table=0x10eff60, key=0x103, value=0x10fd8b0, check_existing=) at hash.c:268 node = 0x69616d2d746e6573 prev = 0x10fbee0 hash = __FUNCTION__ = "hash_table_insert_node" #1 0x00007fad738a11be in hash_table_insert (table=0x10eff60, key=0x1, value=0x101) at hash.c:285 node = 0x0 #2 0x00007fad73b81e68 in mailbox_list_index_parse_header (list=, view=0x11095f0, force=) at mailbox-list-index.c:196 data = 0x10f5f30 i = 4980 len = 1 size = 8192 id = 1 #3 mailbox_list_index_parse (list=, view=0x11095f0, force=) at mailbox-list-index.c:317 ilist = 0x10edc80 hdr = error = 0x10f5820 "`?\016\001" __FUNCTION__ = "mailbox_list_index_parse" #4 0x00007fad73b86b03 in mailbox_list_index_sync_begin (list=0x10ed890, sync_ctx_r=0x7fff2ad61ee0) at mailbox-list-index-sync.c:247 ilist = 0x10edc80 sync_ctx = index_sync_ctx = view = 0x11095f0 trans = hdr = #5 0x00007fad73b86ffb in mailbox_list_index_sync (list=0x10eff60) at mailbox-list-index-sync.c:382 sync_ctx = 0x1107300 ret = #6 0x00007fad73b8233f in mailbox_list_index_refresh (list=0x10ed890) at mailbox-list-index.c:376 ilist = 0x10edc80 view = 0x1107300 ret = #7 0x00007fad73b85e19 in index_list_update_mailbox (box=0x10f40a0) at mailbox-list-index-status.c:363 list_sync_ctx = 0x1107140 list_view = list_trans = changes = {status = {messages = 718675880, recent = 32767, unseen = 4294967295, uidvalidity = 0, uidnext = 68, first_unseen_seq = 0, first_recent_uid = 1, last_cached_seq = 0, highest_modseq = 3176264, highest_pvt_modseq = 17854784, keywords = 0x10f40a0, permanent_flags = 17778368, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, have_guids = 0}, guid = "p ?*?\177\000\000D\000\000\000\000\000\000", seq = 17750944, rec_changed = false, msgs_changed = false, hmodseq_changed = false} __FUNCTION__ = "index_list_update_mailbox" #8 0x00007fad73b86089 in index_list_sync_deinit (ctx=0x1107140, status_r=0x7fff2ad62070) at mailbox-list-index-status.c:470 box = 0x10f40a0 #9 0x00007fad73b70f4a in mailbox_sync_deinit (_ctx=0x0, status_r=0x1) at mail-storage.c:1655 ctx = 0x10eff60 box = 0x10f40a0 errormsg = error = ret = #10 0x00007fad73b7100b in mailbox_sync (box=, flags=) at mail-storage.c:1681 ctx = 0x0 status = {sync_delayed_expunges = 0} #11 0x00007fad73b9af72 in index_storage_get_status (box=0x10f40a0, items=17, status_r=) at index-status.c:39 No locals. #12 0x00007fad72cabde4 in fts_mailbox_get_status (box=0x10f40a0, items=17, status_r=0x7fff2ad621b0) at fts-storage.c:86 seq = #13 0x00007fad73b864e6 in index_list_get_status (box=0x10f40a0, items=17, status_r=0x7fff2ad621b0) at mailbox-list-index-status.c:162 No locals. #14 0x000000000041c8da in imap_status_get (cmd=0x10f1880, ns=0x10e8b00, mailbox=0x10cc2c8 "Flight.RV", items=0x7fff2ad62240, result_r=0x7fff2ad621b0) at imap-status.c:84 client = 0x10f0ce0 box = 0x10f40a0 errstr = ret = #15 0x000000000041219d in cmd_status (cmd=0x10f1880) at cmd-status.c:40 client = 0x10f0ce0 args = 0x10d7a38 list_args = 0x10d7be0 items = {status = 17, metadata = 0} result = {status = {messages = 0, recent = 0, unseen = 0, uidvalidity = 0, uidnext = 0, first_unseen_seq = 0, first_recent_uid = 0, last_cached_seq = 0, highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, have_guids = 1}, metadata = {guid = "PY\r\001", '\000' , virtual_size = 17651520, cache_fields = 0x7fad73836e40, precache_fields = 1934521552, backend_ns_prefix = 0x7fad74012000 "", backend_ns_type = 1080}, error = 4294967295, errstr = 0xffffffffffffffa8
} ns = mailbox = 0x10cc2c8 "Flight.RV" orig_mailbox = 0x10d7b98 "Flight.RV" #16 0x00000000004160ad in command_exec (cmd=0x10f1880) at imap-commands.c:156 hook = 0x10d5d90 ret = #17 0x0000000000415200 in client_command_input (cmd=0x10f1880) at imap-client.c:775 client = 0x10f0ce0 command = __FUNCTION__ = "client_command_input" #18 0x00000000004152ed in client_command_input (cmd=0x10f1880) at imap-client.c:836 client = 0x10f0ce0 command = 0x0 __FUNCTION__ = "client_command_input" #19 0x000000000041556d in client_handle_next_command (client=0x10f0ce0) at imap-client.c:874 No locals. #20 client_handle_input (client=0x10f0ce0) at imap-client.c:886 _data_stack_cur_id = 3 ret = 208 remove_io = handled_commands = false __FUNCTION__ = "client_handle_input" #21 0x00000000004158ef in client_input (client=0x10f0ce0) at imap-client.c:928 cmd = output = 0x10f16d8 bytes = __FUNCTION__ = "client_input" #22 0x00007fad738abdf6 in io_loop_call_io (io=0x10f1780) at ioloop.c:387 ioloop = 0x10d4720 t_id = 2 #23 0x00007fad738ace6f in io_loop_handler_run (ioloop=) at ioloop-epoll.c:215 ctx = 0x10d4aa0 event = 0x10d4b10 list = 0x10f17d0 io = 0x10eff60 tv = {tv_sec = 1799, tv_usec = 999580} msecs = ret = 1 i = 0 call = false __FUNCTION__ = "io_loop_handler_run" #24 0x00007fad738abd98 in io_loop_run (ioloop=0x10d4720) at ioloop.c:406 No locals. #25 0x00007fad738621b3 in master_service_run (service=0x10d45b0, callback=0x1) at master-service.c:560 No locals. #26 0x000000000041eb67 in main (argc=1, argv=0x10d4390) at main.c:400 set_roots = {0x426200, 0x0} login_set = {auth_socket_path = 0x10cc050 "(", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x41ed60 , failure_callback = 0x41ed00 , request_auth_token = 1} service_flags = storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = ~Kyle -- For every complex problem, there is a solution that is simple, neat, and wrong. -- H. L. Mencken -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 842 bytes Desc: not available URL: From kyle-dovecot at memoryhole.net Tue Apr 23 19:53:57 2013 From: kyle-dovecot at memoryhole.net (Kyle Wheeler) Date: Tue, 23 Apr 2013 10:53:57 -0600 Subject: [Dovecot] mailbox_list_index_parse_header crash In-Reply-To: <20130423165201.GB32084@queeg.we-be-smart.org> References: <20130423165201.GB32084@queeg.we-be-smart.org> Message-ID: <20130423165357.GC32084@queeg.we-be-smart.org> Sorry, I should have said; I'm running 2.2.1 On Tuesday, April 23 at 10:52 AM, quoth Kyle Wheeler: >Hi, > >I got all excited about IMAP NOTIFY support and tried enabling >mailbox_list_index on my server. Unfortunately, I rather quickly ran >into trouble of the segfault variety. This prevented me from doing >basic things like seeing the contents of some of my folders. Disabling >mailbox_list_index got me back up and running, but... darnit, that's >annoying. The only message I got in my log file was this: > >imap(user at domain): Fatal: master: service(imap): child 6899 killed with signal 11 (core dumped) > >If I can help track this down, please let me know. Here's the >backtrace: > >#0 hash_table_insert_node (table=0x10eff60, key=0x103, value=0x10fd8b0, check_existing=) at hash.c:268 > node = 0x69616d2d746e6573 > prev = 0x10fbee0 > hash = > __FUNCTION__ = "hash_table_insert_node" >#1 0x00007fad738a11be in hash_table_insert (table=0x10eff60, key=0x1, value=0x101) at hash.c:285 > node = 0x0 >#2 0x00007fad73b81e68 in mailbox_list_index_parse_header (list=, view=0x11095f0, > force=) at mailbox-list-index.c:196 > data = 0x10f5f30 > i = 4980 > len = 1 > size = 8192 > id = 1 >#3 mailbox_list_index_parse (list=, view=0x11095f0, force=) > at mailbox-list-index.c:317 > ilist = 0x10edc80 > hdr = > error = 0x10f5820 "`?\016\001" > __FUNCTION__ = "mailbox_list_index_parse" >#4 0x00007fad73b86b03 in mailbox_list_index_sync_begin (list=0x10ed890, sync_ctx_r=0x7fff2ad61ee0) > at mailbox-list-index-sync.c:247 > ilist = 0x10edc80 > sync_ctx = > index_sync_ctx = > view = 0x11095f0 > trans = > hdr = >#5 0x00007fad73b86ffb in mailbox_list_index_sync (list=0x10eff60) at mailbox-list-index-sync.c:382 > sync_ctx = 0x1107300 > ret = >#6 0x00007fad73b8233f in mailbox_list_index_refresh (list=0x10ed890) at mailbox-list-index.c:376 > ilist = 0x10edc80 > view = 0x1107300 > ret = >#7 0x00007fad73b85e19 in index_list_update_mailbox (box=0x10f40a0) at mailbox-list-index-status.c:363 > list_sync_ctx = 0x1107140 > list_view = > list_trans = > changes = {status = {messages = 718675880, recent = 32767, unseen = 4294967295, uidvalidity = 0, uidnext = 68, > first_unseen_seq = 0, first_recent_uid = 1, last_cached_seq = 0, highest_modseq = 3176264, > highest_pvt_modseq = 17854784, keywords = 0x10f40a0, permanent_flags = 17778368, permanent_keywords = 0, > allow_new_keywords = 0, nonpermanent_modseqs = 0, have_guids = 0}, > guid = "p ?*?\177\000\000D\000\000\000\000\000\000", seq = 17750944, rec_changed = false, msgs_changed = false, > hmodseq_changed = false} > __FUNCTION__ = "index_list_update_mailbox" >#8 0x00007fad73b86089 in index_list_sync_deinit (ctx=0x1107140, status_r=0x7fff2ad62070) at mailbox-list-index-status.c:470 > box = 0x10f40a0 >#9 0x00007fad73b70f4a in mailbox_sync_deinit (_ctx=0x0, status_r=0x1) at mail-storage.c:1655 > ctx = 0x10eff60 > box = 0x10f40a0 > errormsg = > error = > ret = >#10 0x00007fad73b7100b in mailbox_sync (box=, flags=) at mail-storage.c:1681 > ctx = 0x0 > status = {sync_delayed_expunges = 0} >#11 0x00007fad73b9af72 in index_storage_get_status (box=0x10f40a0, items=17, status_r=) > at index-status.c:39 >No locals. >#12 0x00007fad72cabde4 in fts_mailbox_get_status (box=0x10f40a0, items=17, status_r=0x7fff2ad621b0) at fts-storage.c:86 > seq = >#13 0x00007fad73b864e6 in index_list_get_status (box=0x10f40a0, items=17, status_r=0x7fff2ad621b0) > at mailbox-list-index-status.c:162 >No locals. >#14 0x000000000041c8da in imap_status_get (cmd=0x10f1880, ns=0x10e8b00, mailbox=0x10cc2c8 "Flight.RV", items=0x7fff2ad62240, > result_r=0x7fff2ad621b0) at imap-status.c:84 > client = 0x10f0ce0 > box = 0x10f40a0 > errstr = > ret = >#15 0x000000000041219d in cmd_status (cmd=0x10f1880) at cmd-status.c:40 > client = 0x10f0ce0 > args = 0x10d7a38 > list_args = 0x10d7be0 > items = {status = 17, metadata = 0} > result = {status = {messages = 0, recent = 0, unseen = 0, uidvalidity = 0, uidnext = 0, first_unseen_seq = 0, > first_recent_uid = 0, last_cached_seq = 0, highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, > permanent_flags = 0, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, have_guids = 1}, > metadata = {guid = "PY\r\001", '\000' , virtual_size = 17651520, cache_fields = 0x7fad73836e40, > precache_fields = 1934521552, backend_ns_prefix = 0x7fad74012000 "", backend_ns_type = 1080}, error = 4294967295, > errstr = 0xffffffffffffffa8
} > ns = > mailbox = 0x10cc2c8 "Flight.RV" > orig_mailbox = 0x10d7b98 "Flight.RV" >#16 0x00000000004160ad in command_exec (cmd=0x10f1880) at imap-commands.c:156 > hook = 0x10d5d90 > ret = >#17 0x0000000000415200 in client_command_input (cmd=0x10f1880) at imap-client.c:775 > client = 0x10f0ce0 > command = > __FUNCTION__ = "client_command_input" >#18 0x00000000004152ed in client_command_input (cmd=0x10f1880) at imap-client.c:836 > client = 0x10f0ce0 > command = 0x0 > __FUNCTION__ = "client_command_input" >#19 0x000000000041556d in client_handle_next_command (client=0x10f0ce0) at imap-client.c:874 >No locals. >#20 client_handle_input (client=0x10f0ce0) at imap-client.c:886 > _data_stack_cur_id = 3 > ret = 208 > remove_io = > handled_commands = false > __FUNCTION__ = "client_handle_input" >#21 0x00000000004158ef in client_input (client=0x10f0ce0) at imap-client.c:928 > cmd = > output = 0x10f16d8 > bytes = > __FUNCTION__ = "client_input" >#22 0x00007fad738abdf6 in io_loop_call_io (io=0x10f1780) at ioloop.c:387 > ioloop = 0x10d4720 > t_id = 2 >#23 0x00007fad738ace6f in io_loop_handler_run (ioloop=) at ioloop-epoll.c:215 > ctx = 0x10d4aa0 > event = 0x10d4b10 > list = 0x10f17d0 > io = 0x10eff60 > tv = {tv_sec = 1799, tv_usec = 999580} > msecs = > ret = 1 > i = 0 > call = false > __FUNCTION__ = "io_loop_handler_run" >#24 0x00007fad738abd98 in io_loop_run (ioloop=0x10d4720) at ioloop.c:406 >No locals. >#25 0x00007fad738621b3 in master_service_run (service=0x10d45b0, callback=0x1) at master-service.c:560 >No locals. >#26 0x000000000041eb67 in main (argc=1, argv=0x10d4390) at main.c:400 > set_roots = {0x426200, 0x0} > login_set = {auth_socket_path = 0x10cc050 "(", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, > callback = 0x41ed60 , failure_callback = 0x41ed00 , > request_auth_token = 1} > service_flags = > storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT > username = 0x0 > c = > > >~Kyle >-- >For every complex problem, there is a solution that is simple, neat, >and wrong. > -- H. L. Mencken ~Kyle -- If you cannot change your mind, how can you be certain that you have one? -- Unknown -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 842 bytes Desc: not available URL: From tss at iki.fi Tue Apr 23 21:06:19 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 23 Apr 2013 21:06:19 +0300 Subject: [Dovecot] mailbox_list_index_parse_header crash In-Reply-To: <20130423165201.GB32084@queeg.we-be-smart.org> References: <20130423165201.GB32084@queeg.we-be-smart.org> Message-ID: <1366740379.11047.355.camel@innu> On Tue, 2013-04-23 at 10:52 -0600, Kyle Wheeler wrote: > I got all excited about IMAP NOTIFY support and tried enabling > mailbox_list_index on my server. Unfortunately, I rather quickly ran > into trouble of the segfault variety. This prevented me from doing > basic things like seeing the contents of some of my folders. Disabling > mailbox_list_index got me back up and running, but... darnit, that's > annoying. The only message I got in my log file was this: > > imap(user at domain): Fatal: master: service(imap): child 6899 killed with signal 11 (core dumped) > > If I can help track this down, please let me know. Here's the > backtrace: > > #0 hash_table_insert_node (table=0x10eff60, key=0x103, value=0x10fd8b0, check_existing=) at hash.c:268 > node = 0x69616d2d746e6573 > prev = 0x10fbee0 > hash = > __FUNCTION__ = "hash_table_insert_node" http://hg.dovecot.org/dovecot-2.2/rev/d3d380221043 should help? From kyle-dovecot at memoryhole.net Tue Apr 23 22:35:48 2013 From: kyle-dovecot at memoryhole.net (Kyle Wheeler) Date: Tue, 23 Apr 2013 13:35:48 -0600 Subject: [Dovecot] mailbox_list_index_parse_header crash In-Reply-To: <1366740379.11047.355.camel@innu> References: <20130423165201.GB32084@queeg.we-be-smart.org> <1366740379.11047.355.camel@innu> Message-ID: <20130423193548.GB13050@queeg.we-be-smart.org> On Tuesday, April 23 at 09:06 PM, quoth Timo Sirainen: >On Tue, 2013-04-23 at 10:52 -0600, Kyle Wheeler wrote: > >> I got all excited about IMAP NOTIFY support and tried enabling >> mailbox_list_index on my server. Unfortunately, I rather quickly ran >> into trouble of the segfault variety. This prevented me from doing >> basic things like seeing the contents of some of my folders. Disabling >> mailbox_list_index got me back up and running, but... darnit, that's >> annoying. The only message I got in my log file was this: >> >> imap(user at domain): Fatal: master: service(imap): child 6899 killed with signal 11 (core dumped) >> >> If I can help track this down, please let me know. Here's the >> backtrace: >> >> #0 hash_table_insert_node (table=0x10eff60, key=0x103, value=0x10fd8b0, check_existing=) at hash.c:268 >> node = 0x69616d2d746e6573 >> prev = 0x10fbee0 >> hash = >> __FUNCTION__ = "hash_table_insert_node" > >http://hg.dovecot.org/dovecot-2.2/rev/d3d380221043 should help? Excellent - running tests now... answers soon. ~Kyle -- Human beings are the only creatures that allow their children to come back home. -- Bill Cosby -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 842 bytes Desc: not available URL: From jtam.home at gmail.com Wed Apr 24 01:06:09 2013 From: jtam.home at gmail.com (Joseph Tam) Date: Tue, 23 Apr 2013 15:06:09 -0700 (PDT) Subject: [Dovecot] Using dsync to export mail to remote IMAP account In-Reply-To: References: Message-ID: Timo Sirainen writes: >> I've read the web/man pages on dsync, but it's not clear to me whether >> dsync can be used to export (rather than import) a user's mailbox to a >> remote non-dovecot IMAP account. > > It should be possible at some point, but currently probably won't work > very well. Ah, thanks for the clarification. >> dsync(localuser): Error: user localuser: Initialization failed: >> Namespace '': Unknown mail storage driver imapc >> dsync(localuser): Fatal: User init failed > > But this looks like you simply haven't compiled Dovecot with imapc > support. See if > > dovecot --build-options|grep storage > > returns imapc. Right you are. Joseph Tam From kengheng at mysql.cc Wed Apr 24 08:27:30 2013 From: kengheng at mysql.cc (kengheng) Date: Wed, 24 Apr 2013 13:27:30 +0800 Subject: [Dovecot] Make install error In-Reply-To: <1366713011.11047.345.camel@innu> References: <5170BEF0.6060306@mysql.cc> <1366713011.11047.345.camel@innu> Message-ID: <51776D42.1080103@mysql.cc> Hi, I tried remove and make install, same err happended. I noticed from the log below, it first generate the "/usr/local/dovecot/lib/dovecot/auth" with checkpassword-reply, and it is success, the coming generation directory for auth at "/usr/local/dovecot/lib/dovecot/", it is weird that the make install generation for file auth and directory auth at same path. It is causing the issues. make[3]: Entering directory `/usr/local/src/dovecot-2.2.1/src/auth' test -z "/usr/local/dovecot/lib/dovecot" || /usr/bin/mkdir -p "/usr/local/dovecot/lib/dovecot" /bin/sh ../../libtool --mode=install /usr/bin/install -c auth checkpassword-reply '/usr/local/dovecot/lib/dovecot' libtool: install: /usr/bin/install -c .libs/auth /usr/local/dovecot/lib/dovecot/auth libtool: install: /usr/bin/install -c .libs/checkpassword-reply /usr/local/dovecot/lib/dovecot/checkpassword-reply test -z "/usr/local/dovecot/lib/dovecot/auth" || /usr/bin/mkdir -p "/usr/local/dovecot/lib/dovecot/auth" /usr/bin/mkdir: cannot create directory ?/usr/local/dovecot/lib/dovecot/auth?: File exists make[3]: *** [install-auth_moduleLTLIBRARIES] Error 1 make[3]: Leaving directory `/usr/local/src/dovecot-2.2.1/src/auth' make[2]: *** [install-am] Error 2 make[2]: Leaving directory `/usr/local/src/dovecot-2.2.1/src/auth' make[1]: *** [install-recursive] Error 1 make[1]: Leaving directory `/usr/local/src/dovecot-2.2.1/src' make: *** [install-recursive] Error 1 On 4/23/13 6:30 PM, Timo Sirainen wrote: > On Fri, 2013-04-19 at 11:50 +0800, kengheng wrote: >> Hi, I'm recompiling dovecot 2.2.0/2.2.1 with error below during make >> install: >> >> test -z "/usr/local/dovecot/lib/dovecot/auth" || /usr/bin/mkdir -p >> "/usr/local/dovecot/lib/dovecot/auth" >> /usr/bin/mkdir: cannot create directory >> ?/usr/local/dovecot/lib/dovecot/auth?: File exists > This file shouldn't exist. > >> The target Svr OS: OpenSuse 12.2 x86 and installed success for >> qmail/vpopmail. The configuration for dovecot as below: >> ./configure \ >> --prefix=/usr/local/dovecot \ >> --with-vpopmail \ >> --with-docs \ >> --with-ssl \ >> --without-shadow \ >> --without-pam \ >> --without-ldap \ >> --without-pgsql \ >> --without-sql \ >> --without-mysql \ >> --without-sqlite > I think there's an older differently installed Dovecot in there. rm > -rf /usr/local/dovecot/lib and try make install again. > > > > From leo at psychologie.tu-dresden.de Wed Apr 24 09:13:18 2013 From: leo at psychologie.tu-dresden.de (Frank Leonhardt) Date: Wed, 24 Apr 2013 08:13:18 +0200 Subject: [Dovecot] login crashes - maybe too many simultan connections Message-ID: <517777FE.9060806@psychologie.tu-dresden.de> Hallo, since a few days, users sometimes have problems connecting to our mailserver, in the mail.err are many lines like this: Apr 23 11:14:25 psy2 dovecot: dovecot: child 17607 (login) killed with signal 11 (core dumps disabled) (ip=xx.xx.146.84) Users who are already logged in keep connected, but new connections are not possible.This happens only between 10 am and 3 pm, never in the early morning or at night, so i assume, maybe this is caused by too many simultaneous connections? After restarting dovecot the problem is temporary solved, new users may connect, but after one or a few days, this may happen again. # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.1 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: alle mail_location: maildir:~/Maildir fsync_disable: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 auth default: passdb: driver: pam args: dovecot userdb: driver: passwd May anybody help? Thanks in advance! Greetings from Frank. From ngu.antoine at gmail.com Wed Apr 24 17:46:37 2013 From: ngu.antoine at gmail.com (Antoine Nguyen) Date: Wed, 24 Apr 2013 16:46:37 +0200 Subject: [Dovecot] Strange issue with doveadm user Message-ID: Dear all, I encounter a strange issue with the *doveadm user* command. (dovecot 2.1.16) I try to retrieve information about a specific user but dovecot says it doesn't exist (whereas I just created it). The following command fails: $ sudo -u vmail doveadm user pouet at domain.tld userdb lookup: user pouet at domain.tld doesn't exist If I try a more global lookup, the user is properly found: $ sudo -u vmail doveadm user *@domain.tld user1 at domain.tld *pouet at domain.tld* Sending a query for another user works well. For example : $ sudo -u vmail doveadm user user1 at domain.tld userdb: user1 at domain.tld home : /var/vmail/domain.tld/user1 uid : 500 gid : 500 quota_rule: *:bytes=100M I really don't understand what's happening... The only difference I see between the users is that user1 was created when I was using dovecot 1.2... Thanks for your help. From ben at morrow.me.uk Wed Apr 24 18:50:50 2013 From: ben at morrow.me.uk (Ben Morrow) Date: Wed, 24 Apr 2013 16:50:50 +0100 Subject: [Dovecot] Make install error In-Reply-To: <51776D42.1080103@mysql.cc> References: <5170BEF0.6060306@mysql.cc> <1366713011.11047.345.camel@innu> <51776D42.1080103@mysql.cc> Message-ID: <20130424155049.GB66499@anubis.morrow.me.uk> At 1PM +0800 on 24/04/13 you (kengheng) wrote: > Hi, I tried remove and make install, same err happended. I noticed from > the log below, it first generate the > "/usr/local/dovecot/lib/dovecot/auth" with checkpassword-reply, and it > is success, the coming generation directory for auth at > "/usr/local/dovecot/lib/dovecot/", it is weird that the make install > generation for file auth and directory auth at same path. It is causing > the issues. > > make[3]: Entering directory `/usr/local/src/dovecot-2.2.1/src/auth' > test -z "/usr/local/dovecot/lib/dovecot" || /usr/bin/mkdir -p > "/usr/local/dovecot/lib/dovecot" > /bin/sh ../../libtool --mode=install /usr/bin/install -c auth > checkpassword-reply '/usr/local/dovecot/lib/dovecot' These files should be installed under libexec; probably /usr/local/dovecot/libexec/dovecot, though I'm not sure how autoconf chooses the libexec directory when you're using an explicit prefix. What do the following give you (in the top-level Dovecot source dir)? grep ^libexecdir config.log grep ^exec_prefix config.log grep ^prefix config.log Ben From ngu.antoine at gmail.com Wed Apr 24 19:25:46 2013 From: ngu.antoine at gmail.com (Antoine Nguyen) Date: Wed, 24 Apr 2013 18:25:46 +0200 Subject: [Dovecot] Strange issue with doveadm user In-Reply-To: References: Message-ID: Sorry for the noise, I've solved my issue. 2013/4/24 Antoine Nguyen > Dear all, > > I encounter a strange issue with the *doveadm user* command. (dovecot > 2.1.16) > > I try to retrieve information about a specific user but dovecot says it > doesn't exist (whereas I just created it). The following command fails: > > $ sudo -u vmail doveadm user pouet at domain.tld > userdb lookup: user pouet at domain.tld doesn't exist > > If I try a more global lookup, the user is properly found: > > $ sudo -u vmail doveadm user *@domain.tld > user1 at domain.tld > *pouet at domain.tld* > > Sending a query for another user works well. For example : > > $ sudo -u vmail doveadm user user1 at domain.tld > userdb: user1 at domain.tld > home : /var/vmail/domain.tld/user1 > uid : 500 > gid : 500 > quota_rule: *:bytes=100M > > I really don't understand what's happening... The only difference I see > between the users is that user1 was created when I was using dovecot 1.2... > > Thanks for your help. > From tss at iki.fi Wed Apr 24 20:11:02 2013 From: tss at iki.fi (Timo Sirainen) Date: Wed, 24 Apr 2013 20:11:02 +0300 Subject: [Dovecot] login crashes - maybe too many simultan connections In-Reply-To: <517777FE.9060806@psychologie.tu-dresden.de> References: <517777FE.9060806@psychologie.tu-dresden.de> Message-ID: <36166911-65CC-40F8-A80B-4C6A0F0FFC61@iki.fi> On 24.4.2013, at 9.13, Frank Leonhardt wrote: > Apr 23 11:14:25 psy2 dovecot: dovecot: child 17607 (login) killed with signal 11 (core dumps disabled) (ip=xx.xx.146.84) That's a bug. > # 1.2.15: /etc/dovecot/dovecot.conf But you're using a way too old version. It's highly likely that it's already been fixed. Only v2.1 and newer is actively supported right now. From richw at richw.org Wed Apr 24 20:31:13 2013 From: richw at richw.org (Rich Wales) Date: Wed, 24 Apr 2013 10:31:13 -0700 Subject: [Dovecot] Replication -- multiple users, three or more servers? In-Reply-To: <5176A8DB.4060106@liberation.richw.org> References: <5175803A.7050703@rde-richw-4.stanford.edu> <1366713682.11047.351.camel@innu> <5176A8DB.4060106@liberation.richw.org> Message-ID: <517816E1.7070705@rde-richw-4.stanford.edu> I've ALMOST got this to work, but I'm still running into a problem. First, here's what I'm doing so far. If my understanding of what's going on (described below) is off, I trust someone will correct me. Also, when/if I get these details straight, I'm willing to help update the "Replication" wiki page to make it clearer and more accurate. I followed Obi-wan's admonition ("Use the source, Luke") and figured out that when the "mail_replica" value starts with "remoteprefix:", the behaviour is identical to "remote:" EXCEPT that the data stream sent to the remote server starts with a line containing the mail account name followed by a newline character. Also, it appears that the "dsync_remote_cmd" is run by default as "root" on the local server. I'm assuming for the moment that %{user} and %{host} in "dsync_remote_cmd" are being replaced by the user and host information in the "mail_replica" value. If the public key value included in "authorized_keys" for the target account on the remote server contains a command= parameter, the "ssh" documentation says that this command will override any command given on the "ssh" command line on the local server. Thus, it should not really be necessary to include a remote command on the tail end of the "ssh" specified in "dsync_remote_cmd". Note, BTW, that the "authorized_keys2" file (mentioned in the current documentation) is deprecated now in SSH; all public keys on the remote server should be in "authorized_keys" now. I also discovered that in order to get "ssh" to work properly in a non-interactive scenario -- without any prompting for typed input (which would break things) -- I needed to run the "ssh" command once by hand, to cache the remote server's host key information in the local "known_hosts" file. So, with all the above in mind, I added the following to the Dovecot configuration on the local host. (My local host is named "richatwork", and my remote host is named "pigeon".) mail_plugins = $mail_plugins notify replication service replicator { process_min_avail = 1 } dsync_remote_cmd = /usr/bin/ssh -i /root/.ssh/dsync_dsa %{user}@%{host} plugin { mail_replica = remoteprefix:root at pigeon.richw.org } I added the public key value (from /root/.ssh/dsync_dsa.pub) to the /root/.ssh/authorized_keys file on the remote host (pigeon), with the command= parameter set to the name of a script on the remote host with the following content: #! /bin/sh read username exec /usr/bin/doveadm dsync-server -u $username With the above setup, replication ALMOST seems to work, EXCEPT that it's failing with the following error in the local host's mail.log: richatwork dovecot: doveadm: Error: dsync-remote(richatwork): Error: dsync(local): Remote dsync doesn't use compatible protocol Both servers are running the identical version of Dovecot (2.2.1), so I'm confused as to why I would be getting a protocol mismatch. Is there some other configuration option I need to check? Rich Wales richw at richw.org =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= "dovecot -n" output on the local server (richatwork): # 2.2.1 (e819374de157): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-40-generic-pae i686 Ubuntu 12.04.2 LTS auth_username_format = %Ln auth_verbose = yes dsync_remote_cmd = /usr/bin/ssh -i /root/.ssh/dsync_dsa %{user}@%{host} login_greeting = richatwork.richw.org (%{lip}) Dovecot ready; hello, %{rip} mail_location = maildir:~/Maildir mail_plugins = " notify replication" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . } passdb { args = scheme=crypt username_format=%n /etc/dovecot/private/userdb driver = passwd-file } plugin { mail_replica = remoteprefix:root at pigeon.richw.org sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_max_actions = 1000 } protocols = " imap lmtp sieve" service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = user = } } service imap { executable = imap postlogin } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } process_min_avail = 5 } service postlogin { executable = script-login -d rawlog -t } service replicator { process_min_avail = 1 } ssl_cert = We migrated to dovecot from courier and maintained a courier compatible namespace configuration. This resulted in ios clients needing to be manually configured in order to use the special folders correctly (delete messages, save drafts, etc) either by being given the correct "Path Prefix" or by manually selecting the special folders. I can't fathom why apple has chosen not to support or can't detect namespace correctly and require manual configuration but if they haven't done it by now they must have some reason for it and aren't going to fix it any time soon. Are there any creative solutions to fixing the i-clients and preventing them from needing manual configuration? -K From rs at sys4.de Wed Apr 24 20:54:55 2013 From: rs at sys4.de (Robert Schetterer) Date: Wed, 24 Apr 2013 19:54:55 +0200 Subject: [Dovecot] ios clients and namespace trouble In-Reply-To: References: Message-ID: <51781C6F.4040602@sys4.de> Am 24.04.2013 19:39, schrieb Kelsey Cummings: > We migrated to dovecot from courier and maintained a courier compatible > namespace configuration. This resulted in ios clients needing to be > manually configured in order to use the special folders correctly > (delete messages, save drafts, etc) either by being given the correct > "Path Prefix" or by manually selecting the special folders. > > I can't fathom why apple has chosen not to support or can't detect > namespace correctly and require manual configuration but if they haven't > done it by now they must have some reason for it and aren't going to fix > it any time soon. > > Are there any creative solutions to fixing the i-clients and preventing > them from needing manual configuration? > > -K Apple has a long history with bugs on imap, they are focused in using their own services, so they might never fix outside stuff, but however why not ask Apple for help, you paid a lot to them Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From kgc at corp.sonic.net Wed Apr 24 22:05:17 2013 From: kgc at corp.sonic.net (Kelsey Cummings) Date: Wed, 24 Apr 2013 12:05:17 -0700 Subject: [Dovecot] ios clients and namespace trouble In-Reply-To: <51781C6F.4040602@sys4.de> References: <51781C6F.4040602@sys4.de> Message-ID: <0e81deb7cae0ef837120be70fac81559@sonic.net> On 2013-04-24 10:54, Robert Schetterer wrote: > Apple has a long history with bugs on imap, they are focused in using > their own services, so they might never fix outside stuff, but however > why not ask Apple for help, you paid a lot to them I've never paid them a dime to them in my life but I probably have many thousands of their devices talking to my imap servers and this issue leads to a support burden on our end. I recognize that their client is apparently broken on this point and that asking apple to fix it is pointless. Perhaps ironically, the local apple store knows about this problem but views it as "our" problem and not theirs - they only know that they get a people in the store on a regular basis asking for help because they can't delete their mail on their sonic.net mail accounts. I was curious if anyone else had come up with a work around for this before or if they had tried and failed. Perhaps a hidden namespace with folders linked to the real special folders or might that have unintended consequences? -K From dovecot at lists.wgwh.ch Thu Apr 25 11:51:20 2013 From: dovecot at lists.wgwh.ch (Oli Schacher) Date: Thu, 25 Apr 2013 10:51:20 +0200 Subject: [Dovecot] doveadm search causes replication error message Message-ID: <20130425105120.3e38a9c3@lists.wgwh.ch> Hi # 2.2.1 (83d83f55e5c2+) / dsync replicated setup I just noticed that 'doveadm search' apparently tries to replicate mailboxes and spits out errors if a mailbox in the search query is not found: #doveadm search -u user at example.com mailbox Spamreport doveadm(user at example.com): Error: Syncing mailbox Spamreport failed: Mailbox doesn't exist: Spamreport this is especially problematic with -A searches as this causes a error message for every user which doesn't have that folder. Is this a bug or intended behaviour? Should I just 2>/dev/null these errors in doveadm scripts? Thanks Oli -- message transmitted on 100% recycled electrons From jancarel.putter at gmail.com Thu Apr 25 16:20:11 2013 From: jancarel.putter at gmail.com (JC Putter) Date: Thu, 25 Apr 2013 15:20:11 +0200 Subject: [Dovecot] .dovecot.sieve/tmp)failed: Not a directory Message-ID: stat(/var/spool/vmail/example.com/user/.dovecot.sieve/tmp)failed: Not a directory auth_mechanisms = plain login disable_plaintext_auth = no first_valid_uid = 2000 last_valid_uid = 2000 mail_gid = 2000 mail_location = maildir:/var/spool/vmail/%d/%n mail_uid = 2000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } service auth { unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } ssl_cert = Hello, on a system with dovecot 2.2 I've got a mailbox containing multiple mails from a person called Kr?ger, but From: header encoded differently. Some are encoded in UTF-8 normalization form decomposed (as used by Mac OSX), that is u and umlaut accent as sperate combined codepoints instead of one ?: From: =?utf-8?Q?replaced_Kru=CC=88ger?= Searching within roundcube webmail for "kr?ger" as sender missis this mails. Roundcube sends (dovecot rawlog): A0003 UID THREAD REFS UTF-8 ALL HEADER FROM {7+}kr?ger Is this supposed to work? Haven't done any more debugging (other search variants) or read RFCs. As a user I would expect Unicode equivalence rules be applied (see http://en.wikipedia.org/wiki/Unicode_equivalence) Regards, Lutz From kyle-dovecot at memoryhole.net Thu Apr 25 19:55:52 2013 From: kyle-dovecot at memoryhole.net (Kyle Wheeler) Date: Thu, 25 Apr 2013 10:55:52 -0600 Subject: [Dovecot] Lucene and Zlib with 2.2.1 Message-ID: <20130425165552.GA637@queeg.we-be-smart.org> Hello, I have an "archive" folder in my inbox, where I manually stick old mails into a compressed mbox format. Since upgrading to Dovecot 2.2.1, I've started seeing messages like the following in my log files: imap(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable indexer-worker(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable indexer-worker(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable indexer-worker(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable imap(...): Error: indexer failed to index mailbox INBOX/Archive/2007/Sent.gz These errors *appear* to be mostly benign; I still get results from searching the mailbox. But for whatever reason, the indexer appears to not be working for those folders. As you can probably tell, I'm using the fts_lucene plugin, which used to work just fine (with Dovecot 2.1.x). Is this expected behavior? Are these errors truly ignorable? Why are these compressed mailboxes not selectable? ~Kyle -- Where justice is denied, where poverty is enforced, where ignorance prevails, and where any one class is made to feel that society is an organized conspiracy to oppress, rob and degrade them, neither persons nor property will be safe. -- Frederick Douglas -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 842 bytes Desc: not available URL: From rs at sys4.de Thu Apr 25 20:44:26 2013 From: rs at sys4.de (Robert Schetterer) Date: Thu, 25 Apr 2013 19:44:26 +0200 Subject: [Dovecot] Lucene and Zlib with 2.2.1 In-Reply-To: <20130425165552.GA637@queeg.we-be-smart.org> References: <20130425165552.GA637@queeg.we-be-smart.org> Message-ID: <51796B7A.3020607@sys4.de> Am 25.04.2013 18:55, schrieb Kyle Wheeler: > As you can probably tell, I'm using the fts_lucene plugin, which used to > work just fine (with Dovecot 2.1.x). Is this expected behavior? Are > these errors truly ignorable? Why are these compressed mailboxes not > selectable? sorry to ask , but did you compile with lucene ? Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich From CMarcus at Media-Brokers.com Thu Apr 25 20:52:29 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 25 Apr 2013 13:52:29 -0400 Subject: [Dovecot] .dovecot.sieve/tmp)failed: Not a directory In-Reply-To: References: Message-ID: <51796D5D.1080004@Media-Brokers.com> On 2013-04-25 9:20 AM, JC Putter wrote: > stat(/var/spool/vmail/example.com/user/.dovecot.sieve/tmp)failed: Not > a directory > > auth_mechanisms = plain login Looks like an ancient version, since the version info is not included with doveconf -n output? > According to the Wiki Always provide a link too... is this the wiki for version 1 (wiki1.) or 2 (wiki2.)? > "It is not wise to place this link inside your mail store, as it may be > mistaken for a mail folder. Inside a maildir for instance, the default > .dovecot.sieve would show up as phantom folder */dovecot/sieve* in your > IMAP tree." > > Sorry i am a bit of a noob, the docs don't explain clearly what to do... You need to create and set a 'home' directory for each user for this kind of things (even if they are virtual users, they need a 'home' dir)... http://wiki2.dovecot.org/MailLocation Scroll down to where it discusses 'Homeless users'... If you are still on version 1, the first thing you need to do is upgrade to at least the latest 2.1, but I'd recommend just upgrading to the latest 2.2 (currently 2.2.1)... -- Best regards, Charles From richw at richw.org Thu Apr 25 22:01:05 2013 From: richw at richw.org (Rich Wales) Date: Thu, 25 Apr 2013 12:01:05 -0700 Subject: [Dovecot] Replication fails with "Remote dsync doesn't use compatible protocol" Message-ID: <51797D71.6050908@rde-richw-4.stanford.edu> I can't get replication to work in Dovecot 2.2.1. I'm getting the following error on the machine where I'm initiating the replication: richatwork dovecot: doveadm: Error: dsync-remote(richatwork): Error: dsync(local): Remote dsync doesn't use compatible protocol Both the local and remote servers are running identical versions of Dovecot (2.2.1), so I don't understand why I would be having any sort of "compatible protocol" problem. Any ideas? I posted the "dovecot -n" output for both servers in my earlier e-mail on this issue, which I sent about 24 hours ago (and which I assume was too long for people to be willing to read). Rich Wales richw at richw.org From stephan at rename-it.nl Thu Apr 25 22:38:03 2013 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 25 Apr 2013 21:38:03 +0200 Subject: [Dovecot] .dovecot.sieve/tmp)failed: Not a directory In-Reply-To: References: Message-ID: <5179861B.7070109@rename-it.nl> On 4/25/2013 3:20 PM, JC Putter wrote: > stat(/var/spool/vmail/example.com/user/.dovecot.sieve/tmp)failed: Not > a directory Could you send dovecot -n output? The config data you sent looks incomplete. Regards, Stephan. From chibi at gol.com Fri Apr 26 11:57:10 2013 From: chibi at gol.com (Christian Balzer) Date: Fri, 26 Apr 2013 17:57:10 +0900 Subject: [Dovecot] Slow DNS warnings (proxy/auth) Message-ID: <20130426175710.064e6296@batzmaru.gol.ad.jp> Hello, I've just finished transiting our proxies from perdition to dovecot (2.1.7-7 Debian). Yesterday 12 messages (all within the same second) like this caught my attention: --- Apr 25 17:19:09 pp11 dovecot: auth: Warning: proxy(redacted at gol.com,xx.xx.xx.xx,<26hUEivbfQBlMrMS>): DNS lookup for mb04.dentaku.gol.com took 5.002 s --- Now this machine at that time was handling a load of about 2 logins per second, about 20% of what it previously handled with perdition w/o a hiccup. It also runs a local caching nameserver and the A record for the mailbox server in question was most definitely cached at the time (verified via TTL). The machine in question was very bored and certainly capable of handling hundreds if not thousands of DNS queries per second at that moment. In short, I can't see any reason how the lookup could have taken so long, so my guess is there are some issues with the dns-helper (locking, stepping on each others feet, not being spawned fast enough) causing this. Some general remarks, dovecot as proxy feels "heavier" than perdition. In the CPU area that's probably a more subjective impression, because all the little helper processes make it clear what's going on where. Though the "config" process being rather active is something that perdition definitely doesn't do, it reads the config once at start time and that's it. All the IPC and central processes of course also make dovecot rather file handle hungry. Memory wise it's about 35% bigger than perdition and that's not subjective at all. ^o^ About one MB per proxy process/connection for dovecot in my case. Caveat emptor. ^o^ Regards, Christian -- Christian Balzer Network/Systems Engineer chibi at gol.com Global OnLine Japan/Fusion Communications http://www.gol.com/ From kgc at corp.sonic.net Sat Apr 27 00:03:43 2013 From: kgc at corp.sonic.net (Kelsey Cummings) Date: Fri, 26 Apr 2013 14:03:43 -0700 Subject: [Dovecot] ios clients and namespace trouble In-Reply-To: <0e81deb7cae0ef837120be70fac81559@sonic.net> References: <51781C6F.4040602@sys4.de> <0e81deb7cae0ef837120be70fac81559@sonic.net> Message-ID: <517AEBAF.30307@corp.sonic.net> On 4/24/2013 12:05 PM, Kelsey Cummings wrote: > before or if they had tried and failed. Perhaps a hidden namespace with > folders linked to the real special folders or might that have unintended > consequences? This seems to kinda work with the only oddity being that the ios client, if not manually configured with the correct prefix, ends up creating new folders in the hidden one and initially displaying them at the same level as the inbox. Once the app is restarted it sees them in the "correct" namespace as a folder under the inbox. However, looks like some other clients might get confused, but maybe Windows Live Mail is going to get confused anyway. ;) namespace { type=private separator = . prefix = INBOX. inbox = yes mailbox Trash { auto = create special_use = \Trash } ... } namespace FAKE { type=private separator = . hidden = yes list = no mailbox Trash { special_use = \Trash } ... } -- Kelsey Cummings - kgc at corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407 From richw at richw.org Sat Apr 27 05:02:36 2013 From: richw at richw.org (Rich Wales) Date: Fri, 26 Apr 2013 19:02:36 -0700 Subject: [Dovecot] Replication fails with "Remote dsync doesn't use compatible protocol" In-Reply-To: <51797D71.6050908@rde-richw-4.stanford.edu> References: <51797D71.6050908@rde-richw-4.stanford.edu> Message-ID: <517B31BC.6040104@liberation.richw.org> > richatwork dovecot: doveadm: Error: dsync-remote(richatwork): Error: > dsync(local): Remote dsync doesn't use compatible protocol I was finally able to get replication working by abandoning the "wrapper script" approach and, instead, putting a "mail_replica" value on each line of the userdb file -- like this: richatwork::5003:5003::/home/mail/richatwork::userdb_mail_replica=remote:richatwork at pigeon.richw.org The root dsync public key in each individual account's .ssh/authorized_keys file has a command= parameter invoking "/usr/bin/doveadm dsync-server" with the appropriate "-u" option. As I noted in an earlier e-mail, if you put a command= parameter on a public key in the "authorized_keys" file, you don't need to specify the command in the "ssh" command line -- in fact, there is no point to doing that (any command in the "ssh" command line is ignored if the public key on the target has a command= parameter). Now that I have replication working, I have another question: Is it sufficient to configure just one server for replication in order to have changes propagated in both directions? Or do I need to configure replication on both servers (with each one replicating to the other)? Rich Wales richw at richw.org From jeep at rahul.net Sat Apr 27 20:54:55 2013 From: jeep at rahul.net (Jeff Lacki) Date: Sat, 27 Apr 2013 10:54:55 -0700 Subject: [Dovecot] dovecot-sql.conf - Unknown setting: driver Message-ID: <20130427175455.83C2B129DA9@aqua.rahul.net> Im upgrading my dovecot from 2.1.14 to dovecot 2.2.1 on linux. Im using the same configuration file against my MySQL db and getting the following error: doveconf -n # 2.2.1: /opt/dovecot221/etc/dovecot/dovecot.conf doveconf: Fatal: Error in configuration file /opt/dovecot221/etc/dovecot/conf.d/dovecot-sql.conf line 2: Unknown setting: driver dovecot-sql.conf: # The mysqld.sock socket may be in different locations in different systems driver = mysql # Use "host= ... pass=foo#bar" if your password has '#' character connect = host=/var/run/mysqld/mysqld.sock dbname=mydb user=username password=pass password_query = SELECT userid AS username, domain, password \ FROM users WHERE userid = '%n' AND domain = '%d' user_query = SELECT home, uid, gid FROM users WHERE userid = '%n' AND domain = '%d' home=/opt/ii/%1n/%n/INBOX # For using doveadm -A: iterate_query = SELECT userid AS username, domain FROM users That file worked fine in the last version. Looking at the docs 'driver' is still a valid setting. Can someone help me figure out why its complaining? Ive even Im lost as to why this error is occuring unless the error itself is actually another problem and the wrong error is popping up. Been working on this for a day and cant figure it out. Thanks in advance! /mf/home/jeep/shell/.signature From p.heinlein at heinlein-support.de Sat Apr 27 21:00:53 2013 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Sat, 27 Apr 2013 20:00:53 +0200 Subject: [Dovecot] dovecot-sql.conf - Unknown setting: driver In-Reply-To: <20130427175455.83C2B129DA9@aqua.rahul.net> References: <20130427175455.83C2B129DA9@aqua.rahul.net> Message-ID: <517C1255.5050406@heinlein-support.de> Am 27.04.2013 19:54, schrieb Jeff Lacki: > doveconf: Fatal: Error in configuration file /opt/dovecot221/etc/dovecot/conf.d/dovecot-sql.conf line 2: Unknown setting: driver "driver =" doesn't belong to the normal dovecot configuration. It should be located in a seperate file called dovecot-sql.conf.ext which is referred (and not included!) by the passdb and userdb-setting: passdb { driver = sql # Path for SQL configuration file, see example-config/dovecot-sql.conf.ext args = /etc/dovecot/dovecot-sql.conf.ext } > dovecot-sql.conf: Per Default /etc/dovecot/conf.d/*.conf is included into the main config, so this is why those files should be named as "*.conf.ext" and not as "*.conf" Place it outside conf.d or rename it. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From p.heinlein at heinlein-support.de Sat Apr 27 21:05:21 2013 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Sat, 27 Apr 2013 20:05:21 +0200 Subject: [Dovecot] dovecot-sql.conf - Unknown setting: driver In-Reply-To: <517C1255.5050406@heinlein-support.de> References: <20130427175455.83C2B129DA9@aqua.rahul.net> <517C1255.5050406@heinlein-support.de> Message-ID: <517C1361.5020706@heinlein-support.de> Am 27.04.2013 20:00, schrieb Peer Heinlein: Hi, >> doveconf: Fatal: Error in configuration file /opt/dovecot221/etc/dovecot/conf.d/dovecot-sql.conf line 2: Unknown setting: driver > > "driver =" doesn't belong to the normal dovecot configuration. It should > be located in a seperate file called dovecot-sql.conf.ext which is > referred (and not included!) by the passdb and userdb-setting: For clearification: driver = mysql doesn't belong to the normal configuration. "driver = sql" can be part of the passdb/userdb-configuration, as I showed in my own example: > passdb { > driver = sql > > # Path for SQL configuration file, see example-config/dovecot-sql.conf.ext > args = /etc/dovecot/dovecot-sql.conf.ext > } Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From jeep at rahul.net Sat Apr 27 21:28:07 2013 From: jeep at rahul.net (Jeff Lacki) Date: Sat, 27 Apr 2013 11:28:07 -0700 Subject: [Dovecot] dovecot-sql.conf - Unknown setting: driver In-Reply-To: <517C1255.5050406@heinlein-support.de> References: <20130427175455.83C2B129DA9@aqua.rahul.net> <517C1255.5050406@heinlein-support.de> Message-ID: <20130427182807.AC9EF129D17@aqua.rahul.net> Peer Heinlein wrote: > Am 27.04.2013 19:54, schrieb Jeff Lacki: > > > > doveconf: Fatal: Error in configuration file /opt/dovecot221/etc/dovecot/conf.d/dovecot-sql.conf line 2: Unknown setting: driver > > "driver =" doesn't belong to the normal dovecot configuration. It should > be located in a seperate file called dovecot-sql.conf.ext which is > referred (and not included!) by the passdb and userdb-setting: > Turns out that I had 2 files (from my lack of understanding months ago): - dovecot-sql.conf - dovecot-sql.conf.ext I got rid of the dovecot-sql.conf and fixed the path to the dovecot-sql.conf.ext and that fixed it. Thank you Peer! /mf/home/jeep/shell/.signature From andre.rodier at gmail.com Sun Apr 28 19:42:01 2013 From: andre.rodier at gmail.com (Andre Rodier) Date: Sun, 28 Apr 2013 17:42:01 +0100 Subject: [Dovecot] Dovecot Solr Panic Message-ID: <20130428164200.GA661@london.s2end.co.uk> Hello Everyone, I have a small base of users (30), but a lot of emails. I have an error again when I am indexing a virtual folder with a large number of folders. I appreciate this is a special case, but I am using dovecot and solr as it is, according to the documentation, the favourite way. One user is using a large number of archives sub folders, by years, months and subfolders, since 5 years. I am convincing this user to give up this organisation, but in the mean time, I hope to solve this problem. The virtual folder, called Archives, references all the sub folders in the Archive folder. There is about 380 folders, and worst of all, 55k characters with their names concatenated. On solr, I have increased the value of headerBufferSize to a huge value, but I have still this error. Anyway, this is the error I have when I try to index this virtual folder: ---8<--------------------------------------------------------------------------------------------------------------------------------------- root at lapetus:/mnt/emails/indiefield.co.uk/jsmith/Mails/Virtual# doveadm -v index -u 'john smith' 'Search/Archives' doveadm(john smith): Info: Search/Archives: Caching mails seq=109580..127362 1800/17783doveadm(john smith): Panic: file solr-connection.c: line 416 (solr_connection_select): assertion failed: (!conn->posting) doveadm(john smith): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4414a) [0x7fcb7b5b014a] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7fcb7b5b020a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fcb7b58782a] -> /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(+0x754a) [0x7fcb790fa54a] -> /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(+0x4037) [0x7fcb790f7037] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_backend_get_last_uid+0x5a) [0x7fcb79b2f66a] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xc1fd) [0x7fcb79b341fd] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xc689) [0x7fcb79b34689] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xc51e) [0x7fcb79b3451e] -> doveadm(+0x16719) [0x7fcb7bf71719] -> doveadm(+0x13346) [0x7fcb7bf6e346] -> doveadm(+0x13e21) [0x7fcb7bf6ee21] -> doveadm(doveadm_mail_try_run+0x161) [0x7fcb7bf6f2e1] -> doveadm(main+0x3d1) [0x7fcb7bf6def1] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7fcb7b200ead] -> doveadm(+0x13125) [0x7fcb7bf6e125] Aborted ---8<--------------------------------------------------------------------------------------------------------------------------------------- On the solr side: ---8<--------------------------------------------------------------------------------------------------------------------------------------- 28-Apr-2013 17:13:33 org.apache.solr.update.processor.LogUpdateProcessor finish INFO: {add=[1/70af772eafc17c51fb350000812a8a77/john smith at indiefield.co.uk, 2/70af772eafc17c51fb350000812a8a77/john smith at indiefield.co.uk, 3/70af772eafc17c51fb350000812a8a 77/john smith at indiefield.co.uk, 4/70af772eafc17c51fb350000812a8a77/john smith at indiefield.co.uk, 5/70af772eafc17c51fb350000812a8a77/john smith at indiefield.co.uk, 6/70af772ea fc17c51fb350000812a8a77/john smith at indiefield.co.uk, 7/70af772eafc17c51fb350000812a8a77/john smith at indiefield.co.uk, 8/70af772eafc17c51fb350000812a8a77/john smith at indiefie ld.co.uk, ... (8 added)]} 0 19141 28-Apr-2013 17:13:33 org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: ParseError at [row,col]:[1188418,131] Message: Premature end of file. at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:72) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:54) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1317) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:338) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:241) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:388) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418) at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:943) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:843) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Caused by: javax.xml.stream.XMLStreamException: ParseError at [row,col]:[1188418,131] Message: Premature end of file. at com.sun.org.apache.xerces.internal.impl.XMLStreamReaderImpl.next(XMLStreamReaderImpl.java:592) at org.apache.solr.handler.XMLLoader.readDoc(XMLLoader.java:273) at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:138) at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:69) ... 22 more ---8<--------------------------------------------------------------------------------------------------------------------------------------- Kind regards, Andre Rodier From manu at netbsd.org Mon Apr 29 10:43:33 2013 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Mon, 29 Apr 2013 07:43:33 +0000 Subject: [Dovecot] quota-related crash for doveadm dsync operation Message-ID: <20130429074333.GA5707@homeworld.netbsd.org> Hi I understand the crash below is caused by filesystem quota. I just report it because perhaps it could have a more graceful failure. Apr 29 09:39:17 danceny dovecot: dsync-local(jdoe): Error: Mailbox Sent: Saving failed: Not enough disk space Apr 29 09:39:17 danceny syslogd[165]: last message repeated 4 times Apr 29 09:39:17 danceny dovecot: doveadm: Error: dsync-remote(jdoe): Error: Cached message size smaller than expected (35111 < 40830) Apr 29 09:39:17 danceny dovecot: doveadm: Error: dsync-remote(jdoe): Error: Corrupted index cache file /mail/indexes/jdoe/.imap/Sent/dovecot.index.cache: Broken physical size for mail UID 976 Apr 29 09:39:17 danceny dovecot: doveadm: Error: dsync-remote(jdoe): Error: dsync(local): read(/home/pct/jdoe/mail/Sent) failed: Invalid argument Apr 29 09:39:17 danceny dovecot: dsync-local(jdoe): Error: dsync(root at volanges.net.espci.fr): read() failed: Broken pipe Apr 29 09:39:17 danceny dovecot: dsync-local(jdoe): Panic: file mail-storage.c: line 1830 (mailbox_transaction_commit_get_changes): assertion failed: (ret < 0 || seq_range_count(&changes_r->saved_uids) == save_count || array_count(&changes_r->saved_uids) == 0) Apr 29 09:39:17 danceny dovecot: dsync-local(jdoe): Fatal: master: service(doveadm): child 23443 killed with signal 6 (core not dumped - set service doveadm { drop_priv_before_exec=yes }) -- Emmanuel Dreyfus manu at netbsd.org From andre.rodier at gmail.com Mon Apr 29 12:08:10 2013 From: andre.rodier at gmail.com (Andre Rodier) Date: Mon, 29 Apr 2013 10:08:10 +0100 Subject: [Dovecot] Dovecot Solr Panic In-Reply-To: <20130428164200.GA661@london.s2end.co.uk> References: <20130428164200.GA661@london.s2end.co.uk> Message-ID: <517E387A.1010707@gmail.com> Sorry, I checked my dovecot version, and it has not been updated by Debian yet. I will check if I can find a method to update without breaking dependancies. Andr? On 28/04/13 17:42, Andre Rodier wrote: > Hello Everyone, > > I have a small base of users (30), but a lot of emails. > > I have an error again when I am indexing a virtual folder with a large number of folders. > I appreciate this is a special case, but I am using dovecot and solr as it is, according to the documentation, the favourite way. > > One user is using a large number of archives sub folders, by years, months and subfolders, since 5 years. I am convincing this user to give up this > organisation, but in the mean time, I hope to solve this problem. > > The virtual folder, called Archives, references all the sub folders in the Archive folder. There is about 380 folders, and worst of all, 55k characters with > their names concatenated. > > On solr, I have increased the value of headerBufferSize to a huge value, but I have still this error. > > Anyway, this is the error I have when I try to index this virtual folder: > > ---8<--------------------------------------------------------------------------------------------------------------------------------------- > root at lapetus:/mnt/emails/indiefield.co.uk/jsmith/Mails/Virtual# doveadm -v index -u 'john smith' 'Search/Archives' > doveadm(john smith): Info: Search/Archives: Caching mails seq=109580..127362 > 1800/17783doveadm(john smith): Panic: file solr-connection.c: line 416 (solr_connection_select): assertion failed: (!conn->posting) > doveadm(john smith): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4414a) [0x7fcb7b5b014a] -> > /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7fcb7b5b020a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fcb7b58782a] -> > /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(+0x754a) [0x7fcb790fa54a] -> /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(+0x4037) [0x7fcb790f7037] -> > /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_backend_get_last_uid+0x5a) [0x7fcb79b2f66a] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xc1fd) > [0x7fcb79b341fd] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xc689) [0x7fcb79b34689] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xc51e) > [0x7fcb79b3451e] -> doveadm(+0x16719) [0x7fcb7bf71719] -> doveadm(+0x13346) [0x7fcb7bf6e346] -> doveadm(+0x13e21) [0x7fcb7bf6ee21] -> > doveadm(doveadm_mail_try_run+0x161) [0x7fcb7bf6f2e1] -> doveadm(main+0x3d1) [0x7fcb7bf6def1] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) > [0x7fcb7b200ead] -> doveadm(+0x13125) [0x7fcb7bf6e125] > Aborted > ---8<--------------------------------------------------------------------------------------------------------------------------------------- > > On the solr side: > > ---8<--------------------------------------------------------------------------------------------------------------------------------------- > 28-Apr-2013 17:13:33 org.apache.solr.update.processor.LogUpdateProcessor finish > INFO: {add=[1/70af772eafc17c51fb350000812a8a77/john smith at indiefield.co.uk, 2/70af772eafc17c51fb350000812a8a77/john smith at indiefield.co.uk, 3/70af772eafc17c51fb350000812a8a > 77/john smith at indiefield.co.uk, 4/70af772eafc17c51fb350000812a8a77/john smith at indiefield.co.uk, 5/70af772eafc17c51fb350000812a8a77/john smith at indiefield.co.uk, 6/70af772ea > fc17c51fb350000812a8a77/john smith at indiefield.co.uk, 7/70af772eafc17c51fb350000812a8a77/john smith at indiefield.co.uk, 8/70af772eafc17c51fb350000812a8a77/john smith at indiefie > ld.co.uk, ... (8 added)]} 0 19141 > 28-Apr-2013 17:13:33 org.apache.solr.common.SolrException log > SEVERE: org.apache.solr.common.SolrException: ParseError at [row,col]:[1188418,131] > Message: Premature end of file. > at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:72) > at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:54) > at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1317) > at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:338) > at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:241) > at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157) > at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:388) > at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418) > at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:943) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:843) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410) > at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Caused by: javax.xml.stream.XMLStreamException: ParseError at [row,col]:[1188418,131] > Message: Premature end of file. > at com.sun.org.apache.xerces.internal.impl.XMLStreamReaderImpl.next(XMLStreamReaderImpl.java:592) > at org.apache.solr.handler.XMLLoader.readDoc(XMLLoader.java:273) > at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:138) > at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:69) > ... 22 more > ---8<--------------------------------------------------------------------------------------------------------------------------------------- > > Kind regards, > Andre Rodier From rs at sys4.de Mon Apr 29 12:21:15 2013 From: rs at sys4.de (Robert Schetterer) Date: Mon, 29 Apr 2013 11:21:15 +0200 Subject: [Dovecot] Dovecot Solr Panic In-Reply-To: <517E387A.1010707@gmail.com> References: <20130428164200.GA661@london.s2end.co.uk> <517E387A.1010707@gmail.com> Message-ID: <517E3B8B.8070303@sys4.de> Am 29.04.2013 11:08, schrieb Andre Rodier: > Sorry, > > I checked my dovecot version, and it has not been updated by Debian yet. > > I will check if I can find a method to update without breaking dependancies. > > Andr? perhaps look at http://wiki.dovecot.org/PrebuiltBinaries#Automatically_Built_Packages leads to rep http://xi.rename-it.nl/debian/ Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From manu at netbsd.org Mon Apr 29 12:48:43 2013 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Mon, 29 Apr 2013 09:48:43 +0000 Subject: [Dovecot] many SSH connexions with dsynx/SSH replication Message-ID: <20130429094843.GB5707@homeworld.netbsd.org> Hi I am trying replication over dsync/ssh, as explained there: http://wiki2.dovecot.org/Replication I added the options below to dovecot.conf. It works, but it seems there is a new SSH connexion for each user, which is a bit overkill performance-wise. Since I sync as root, I guess there is a way of haing everything on the same SSH connexion? --- cut here --- mail_plugins = $mail_plugins notify replication service replicator { process_min_avail = 1 } dsync_remote_cmd = ssh -lroot %{host} doveadm dsync-server -u%u plugin { mail_replica = remote:root at mail1.example.net } service aggregator { fifo_listener replication-notify-fifo { user = dovecot } unix_listener replication-notify { user = dovecot } } service replicator { unix_listener replicator-doveadm { mode = 0600 } } service doveadm { inet_listener { port = 12345 ssl = yes } } doveadm_port = 12345 ssl_client_ca_file = /etc/openssl/certs/ca.crt doveadm_proxy_port = 0 --- cut here --- -- Emmanuel Dreyfus manu at netbsd.org From andre.rodier at gmail.com Mon Apr 29 14:00:20 2013 From: andre.rodier at gmail.com (=?ISO-8859-1?Q?Andr=E9_Rodier?=) Date: Mon, 29 Apr 2013 12:00:20 +0100 Subject: [Dovecot] Dovecot Solr Panic In-Reply-To: <517E3B8B.8070303@sys4.de> References: <20130428164200.GA661@london.s2end.co.uk> <517E387A.1010707@gmail.com> <517E3B8B.8070303@sys4.de> Message-ID: <517E52C4.2040505@gmail.com> Thanks Robert, I was not aware of this distribution. ATB, Andr? On 29/04/13 10:21, Robert Schetterer wrote: > Am 29.04.2013 11:08, schrieb Andre Rodier: >> Sorry, >> >> I checked my dovecot version, and it has not been updated by Debian yet. >> >> I will check if I can find a method to update without breaking dependancies. >> >> Andr? > > perhaps look at > > http://wiki.dovecot.org/PrebuiltBinaries#Automatically_Built_Packages > > leads to rep > > http://xi.rename-it.nl/debian/ > > Best Regards > MfG Robert Schetterer > From janfrode at tanso.net Mon Apr 29 15:30:24 2013 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Mon, 29 Apr 2013 14:30:24 +0200 Subject: [Dovecot] dovecot stats Message-ID: I just upgraded one of our servers to dovecot v2.1.16 (ee), and am looking into the stats feature. Am I interpreting the wiki correct in reading that the "doveadm stats dump command" only returns statistics about IMAP commands? Is it possible to collect info about POP3 and LMTP commands also ? Also, is "doveadm stats dump command" telling me the results of all commands that has finished the last stats_command_min_time, or will it maybe contain much more than 1 minute of activity ? -jf From daniel.parthey at informatik.tu-chemnitz.de Mon Apr 29 17:38:56 2013 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Mon, 29 Apr 2013 16:38:56 +0200 Subject: [Dovecot] Dovecot 2.1.16 doveadm purge -A segfault Message-ID: <20130429143856.GA17844@daniel.localdomain> Hi, I know that a lot of work has been done regarding doveadm server, but I'm still experiencing easily reproducible segfault crashes of doveadm-server with 2.1.16 when running the following command in a 4 node director/mailbox cluster: /usr/bin/doveadm -c /etc/dovecot-director/dovecot-director.conf -D purge -A The dovecot-error.log shows the following errors (addresses anonymized): Apr 29 15:45:14 10.129.3.233 dovecot: doveadm: Error: purge: invalid option -- '' Apr 29 15:45:14 10.129.3.233 dovecot: doveadm(x.xxxxxx at xxx-xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.233 dovecot: doveadm: Error: purge: invalid option -- '?' Apr 29 15:45:14 10.129.3.233 dovecot: doveadm(x.xxxxxx at xxx-xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.249 dovecot: doveadm: Error: purge: invalid option -- '?' Apr 29 15:45:14 10.129.3.249 dovecot: doveadm(x.xxxxxx at xxx-xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.249 dovecot: doveadm: Error: purge: invalid option -- 'r' Apr 29 15:45:14 10.129.3.249 dovecot: doveadm(x.xxxxxx at xxx-xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.213 dovecot: doveadm: Error: purge: invalid option -- 'e' Apr 29 15:45:14 10.129.3.213 dovecot: doveadm(xxxxx at xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.213 dovecot: doveadm: Error: purge: invalid option -- 'g' Apr 29 15:45:14 10.129.3.213 dovecot: doveadm(xxxxx at xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.213 dovecot: doveadm: Error: purge: invalid option -- 'e' Apr 29 15:45:14 10.129.3.213 dovecot: doveadm(xxxxx at xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.213 dovecot: doveadm: Error: purge: invalid option -- '-' Apr 29 15:45:14 10.129.3.213 dovecot: doveadm(xxxxx at xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.249 dovecot: doveadm: Error: purge: invalid option -- '' Apr 29 15:45:14 10.129.3.249 dovecot: doveadm(xxxxxxxxxx at xxxxxxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.213 dovecot: doveadm(xxxxx at xxxxxx.xx): Fatal: master: service(doveadm): child 6316 killed with signal 11 (core dumped) There seems to something wrong with the doveadm command parser: # gdb /usr/lib/dovecot/doveadm-server /var/tmp/6316 (gdb) bt full #0 0x00007f52f0dc7cca in ?? () from /lib/libc.so.6 No symbol table info available. #1 0x00007f52f0dc8dab in ?? () from /lib/libc.so.6 No symbol table info available. #2 0x00007f52f0dc8e18 in getopt () from /lib/libc.so.6 No symbol table info available. #3 0x00000000004138ce in doveadm_mail_cmd_server_parse (conn=0xe09ad0) at client-connection.c:69 getopt_args = 0xdfa6b8 "AS:u:" c = cmd = 0xe062c8 add_username_header = false #4 client_handle_command (conn=0xe09ad0) at client-connection.c:223 ctx = 0xe0dae0 flags = cmd_name = input = {module = 0x0, service = 0x4210f0 "doveadm", username = 0xdfa59a "xxxxxxx at xxxxxxxx.xx", session_id = 0x0, local_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' , __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = 0, flags_override_remove = 0, no_userdb_lookup = 0} argc = #5 client_connection_input (conn=0xe09ad0) at client-connection.c:326 args = _data_stack_cur_id = 3 line = ok = #6 0x00007f52f10e6166 in io_loop_call_io (io=0xe097e0) at ioloop.c:379 ioloop = 0xe026a0 t_id = 2 #7 0x00007f52f10e71ef in io_loop_handler_run (ioloop=) at ioloop-epoll.c:213 ctx = 0xe054f0 event = 0xe05560 list = 0xe09950 io = 0xdfa5c8 tv = {tv_sec = 2147483, tv_usec = 0} msecs = ret = i = 0 call = false #8 0x00007f52f10e6108 in io_loop_run (ioloop=0xe026a0) at ioloop.c:398 No locals. #9 0x00007f52f10d15a3 in master_service_run (service=0xe02550, callback=0) at master-service.c:544 No locals. #10 0x0000000000414111 in main (argc=1, argv=0xe02370) at main.c:90 set_roots = {0x422780, 0x0} error = 0x0 Regards Daniel -- https://plus.google.com/103021802792276734820 -------------- next part -------------- # 2.1.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-46-server x86_64 Ubuntu 10.04.4 LTS auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_cache_ttl = 1 mins auth_verbose = yes auth_verbose_passwords = sha1 deliver_log_format = mailbox: deliver: msgid=%m from=%f: %$ dict { quota = mysql:/etc/dovecot/conf.d/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no doveadm_password = aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa imapc_features = rfc822.size imapc_host = local-mailbox imapc_port = 18143 instance_name = dovecot-mailbox lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_greeting = Mailbox login_log_format = mailbox: login: %$: %s login_trusted_networks = 10.129.3.0/24 mail_debug = yes mail_fsync = always mail_gid = vmail mail_home = /mail/dovecot/%d/%n mail_location = mdbox:~/mail mail_log_prefix = "mailbox: mail: %s(%u): <%{session}>: " mail_plugins = quota stats mail_privileged_group = vmail mail_uid = vmail managesieve_implementation_string = Sieve managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vnd.dovecot.duplicate mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 50 M mmap_disable = yes namespace { inbox = yes location = mailbox Archives { special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quota quota_rule = *:storage=10G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +vnd.dovecot.duplicate stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = dovecot user = dovecot } } service dict { unix_listener dict { group = vmail mode = 0660 } } service doveadm { inet_listener doveadm-server { port = 19000 } } service imap-login { inet_listener imap { port = 19143 } } service imap-postlogin { executable = script-login /usr/local/bin/dovecot-postlogin user = $default_internal_user } service imap { executable = imap imap-postlogin } service lmtp { inet_listener lmtp-without-quota { address = * port = 19025 } inet_listener lmtp { address = * port = 19024 } } service managesieve-login { inet_listener sieve { port = 19200 } } service pop3-login { inet_listener pop3 { port = 19110 } } service pop3-postlogin { executable = script-login /usr/local/bin/dovecot-postlogin user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin } service quota-warning { executable = script /usr/local/bin/quota-warning extra_groups = dovecot unix_listener quota-warning { user = vmail } user = vmail } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl = no syslog_facility = local1 userdb { driver = prefetch } userdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_plugins = quota stats imap_quota imap_stats } protocol lmtp { mail_plugins = quota stats sieve } -------------- next part -------------- # 2.1.16: /etc/dovecot-director/dovecot-director.conf # OS: Linux 2.6.32-46-server x86_64 Ubuntu 10.04.4 LTS auth_verbose = yes auth_verbose_passwords = sha1 base_dir = /var/run/dovecot-director deliver_log_format = director: deliver: msgid=%m from=%f: %$ director_doveadm_port = 20000 director_mail_servers = 10.129.3.193 10.129.3.192 10.129.3.191 10.129.3.190 director_servers = 10.129.3.193 10.129.3.192 10.129.3.191 10.129.3.190 director_user_expire = 2 days disable_plaintext_auth = no doveadm_password = aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa doveadm_proxy_port = 19000 instance_name = dovecot-director lmtp_proxy = yes login_greeting = Mail Balancer login_log_format = director: login: %$: %s login_trusted_networks = 10.129.3.0/24 mail_debug = yes mail_fsync = always mail_gid = vmail mail_home = /mail/dovecot/%d/%n mail_location = mdbox:~/mail mail_log_prefix = "director: mail: %s(%u): <%{session}>: " mail_max_userip_connections = 20 mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes passdb { args = /etc/dovecot-director/conf.d/dovecot-sql.conf.ext driver = sql } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { executable = doveadm-server director inet_listener doveadm-server { port = 20000 } } service imap-login { executable = imap-login director inet_listener imap { port = 20143 } inet_listener imaps { port = 20993 ssl = yes } } service ipc { unix_listener ipc { user = dovecot } } service lmtp { inet_listener lmtp-without-quota { address = * port = 20025 } inet_listener lmtp { address = * port = 20024 } } service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 20200 } } service pop3-login { executable = pop3-login director inet_listener pop3 { port = 20110 } inet_listener pop3s { port = 20995 ssl = yes } } ssl_cert = Hello, I am settiing up a dovecot (imap, pop, sieve, lda) + openldap infrastructure. I need to store the timestamp of the last login of each user in an attribute of its corresponding ldap object. I could not find a way of doing this through configuration options so I am thinking of coding this task into the dovecot-auth source code, maybe in the passdb-ldap.c file. What do you recomend about this? Thanks. __________ Information from ESET Mail Security, version of virus signature database 8278 (20130429) __________ The message was checked by ESET Mail Security. http://www.eset.com From p.heinlein at heinlein-support.de Mon Apr 29 18:03:22 2013 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Mon, 29 Apr 2013 17:03:22 +0200 Subject: [Dovecot] last login timestamp In-Reply-To: <9b8130bbd8137a4bc9c53bc65281b5ea@frsf.utn.edu.ar> References: <9b8130bbd8137a4bc9c53bc65281b5ea@frsf.utn.edu.ar> Message-ID: <517E8BBA.2090406@heinlein-support.de> Am 29.04.2013 16:50, schrieb Oscar A. Jara:> > > Hello, I am settiing up a dovecot (imap, pop, sieve, lda) + openldap > infrastructure. I need to store the timestamp of the last login of each > user in an attribute of its corresponding ldap object. I could not find > a way of doing this through configuration options so I am thinking of > coding this task into the dovecot-auth source code, maybe in the > passdb-ldap.c file. What do you recomend about this? Thanks. It's very easy to use post-login-scripting as described on http://wiki2.dovecot.org/PostLoginScripting You just have to code the LDAP-updates in bash. But: We have done this in the past, but we realized, that those many user-logins (~15.000 to ~20.000 active users simultaneously) had been a measureable impact on our LDAP. Okay, not very suprising... We decided to use the simple way of touching ~/.lastlogin. It should be easy to set up a second script that updates the LDAP-records once per night. Normally there shouldn't been a reason to have lastlogin updated "realtime" in LDAP many time per hour. Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From kyle-dovecot at memoryhole.net Mon Apr 29 18:44:41 2013 From: kyle-dovecot at memoryhole.net (Kyle Wheeler) Date: Mon, 29 Apr 2013 09:44:41 -0600 Subject: [Dovecot] mailbox_list_index_parse_header crash In-Reply-To: <1366740379.11047.355.camel@innu> References: <20130423165201.GB32084@queeg.we-be-smart.org> <1366740379.11047.355.camel@innu> Message-ID: <20130429154441.GF6596@queeg.we-be-smart.org> On Tuesday, April 23 at 09:06 PM, quoth Timo Sirainen: >On Tue, 2013-04-23 at 10:52 -0600, Kyle Wheeler wrote: > >> I got all excited about IMAP NOTIFY support and tried enabling >> mailbox_list_index on my server. Unfortunately, I rather quickly ran >> into trouble of the segfault variety. This prevented me from doing >> basic things like seeing the contents of some of my folders. Disabling >> mailbox_list_index got me back up and running, but... darnit, that's >> annoying. The only message I got in my log file was this: >> >> imap(user at domain): Fatal: master: service(imap): child 6899 killed with signal 11 (core dumped) >> >> If I can help track this down, please let me know. Here's the >> backtrace: >> >> #0 hash_table_insert_node (table=0x10eff60, key=0x103, value=0x10fd8b0, check_existing=) at hash.c:268 >> node = 0x69616d2d746e6573 >> prev = 0x10fbee0 >> hash = >> __FUNCTION__ = "hash_table_insert_node" > >http://hg.dovecot.org/dovecot-2.2/rev/d3d380221043 should help? Solved the problem - thanks! ~Kyle -- Thanks to the power of denial, I'm immortal! -- Phillip J. Fry, Futurama -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 842 bytes Desc: not available URL: From sven at svenhartge.de Mon Apr 29 18:46:38 2013 From: sven at svenhartge.de (Sven Hartge) Date: Mon, 29 Apr 2013 17:46:38 +0200 Subject: [Dovecot] last login timestamp References: <9b8130bbd8137a4bc9c53bc65281b5ea@frsf.utn.edu.ar> Message-ID: <69mopcs92lv8@mids.svenhartge.de> Oscar A. Jara wrote: > Hello, I am settiing up a dovecot (imap, pop, sieve, lda) + openldap > infrastructure. I need to store the timestamp of the last login of > each user in an attribute of its corresponding ldap object. I could > not find a way of doing this through configuration options so I am > thinking of coding this task into the dovecot-auth source code, maybe > in the passdb-ldap.c file. What do you recomend about this? Thanks. I don't think this is a wise idea. LDAP does not like to be written to. With approach like you envision you will certainly kill your LDAP server instantly. If you have any replicated slaves, the write load you will be creating will kill them a second later. Either use post-login scripting to store that value in a SQL database, or better, just touch a file in the users $HOME. Question: why do you need this las-login timestamp information? Maybe there is a better way to solve your problem/need. Gr??e, Sven. -- Sigmentation fault. Core dumped. From kyle-dovecot at memoryhole.net Mon Apr 29 18:51:59 2013 From: kyle-dovecot at memoryhole.net (Kyle Wheeler) Date: Mon, 29 Apr 2013 09:51:59 -0600 Subject: [Dovecot] Lucene and Zlib with 2.2.1 In-Reply-To: <51796B7A.3020607@sys4.de> References: <20130425165552.GA637@queeg.we-be-smart.org> <51796B7A.3020607@sys4.de> Message-ID: <20130429155159.GG6596@queeg.we-be-smart.org> On Thursday, April 25 at 07:44 PM, quoth Robert Schetterer: >Am 25.04.2013 18:55, schrieb Kyle Wheeler: >> As you can probably tell, I'm using the fts_lucene plugin, which used to >> work just fine (with Dovecot 2.1.x). Is this expected behavior? Are >> these errors truly ignorable? Why are these compressed mailboxes not >> selectable? > >sorry to ask , but did you compile with lucene ? Yes I did. I configured my compile like this: ./configure --without-sql --without-vpopmail --with-ldap \ --with-lucene --with-stemmer I've got CLucene 2.3.3.4 installed, and libstemmer version 0+svn527-1 (the version that's packaged as part of Debian). Running ldd on /usr/local/lib/dovecot/lib21_fs_lucene_plugin.so says it's linked against both libclucene and libstemmer: /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so: linux-vdso.so.1 => (0x00007fff3f3ff000) libclucene-core.so.1 => /usr/local/lib/libclucene-core.so.1 (0x00007f9b0e5f5000) libstemmer.so.0d => /usr/lib/libstemmer.so.0d (0x00007f9b0e3a4000) librt.so.1 => /lib/librt.so.1 (0x00007f9b0e19b000) libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x00007f9b0de87000) libm.so.6 => /lib/libm.so.6 (0x00007f9b0dc05000) libc.so.6 => /lib/libc.so.6 (0x00007f9b0d8a2000) libgcc_s.so.1 => /lib/libgcc_s.so.1 (0x00007f9b0d68c000) libclucene-shared.so.1 => /usr/local/lib/libclucene-shared.so.1 (0x00007f9b0d46c000) libpthread.so.0 => /lib/libpthread.so.0 (0x00007f9b0d24f000) libz.so.1 => /usr/lib/libz.so.1 (0x00007f9b0d038000) /lib64/ld-linux-x86-64.so.2 (0x00007f9b0ebde000) ~Kyle -- It was we, the people; not we, the white male citizens; nor yet we, the male citizens; but we, the whole people, who formed the Union. [...] Men, their rights and nothing more; women, their rights and nothing less. -- Susan B. Anthony -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 842 bytes Desc: not available URL: From rs at sys4.de Mon Apr 29 19:01:33 2013 From: rs at sys4.de (Robert Schetterer) Date: Mon, 29 Apr 2013 18:01:33 +0200 Subject: [Dovecot] last login timestamp In-Reply-To: <517E8BBA.2090406@heinlein-support.de> References: <9b8130bbd8137a4bc9c53bc65281b5ea@frsf.utn.edu.ar> <517E8BBA.2090406@heinlein-support.de> Message-ID: <517E995D.3060606@sys4.de> Am 29.04.2013 17:03, schrieb Peer Heinlein: > Am 29.04.2013 16:50, schrieb Oscar A. Jara:> >> >> Hello, I am settiing up a dovecot (imap, pop, sieve, lda) + openldap >> infrastructure. I need to store the timestamp of the last login of each >> user in an attribute of its corresponding ldap object. I could not find >> a way of doing this through configuration options so I am thinking of >> coding this task into the dovecot-auth source code, maybe in the >> passdb-ldap.c file. What do you recomend about this? Thanks. > > It's very easy to use post-login-scripting as described on > > http://wiki2.dovecot.org/PostLoginScripting > > You just have to code the LDAP-updates in bash. > > But: We have done this in the past, but we realized, that those many > user-logins (~15.000 to ~20.000 active users simultaneously) had been a > measureable impact on our LDAP. Okay, not very suprising... > > We decided to use the simple way of touching ~/.lastlogin. > > It should be easy to set up a second script that updates the > LDAP-records once per night. Normally there shouldn't been a reason to > have lastlogin updated "realtime" in LDAP many time per hour. > > Peer > > > doing touch method may slow down your i.e cluster filesystem, database etc specially with high frequent logins, related how/what you need such timestamps you can get them from logs too, to get an idea look http://sys4.de/de/blog/2013/02/02/monitoring-dovecot-last-login-rsyslog/ to get an idea ,what i mean Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From rs at sys4.de Mon Apr 29 19:08:02 2013 From: rs at sys4.de (Robert Schetterer) Date: Mon, 29 Apr 2013 18:08:02 +0200 Subject: [Dovecot] Lucene and Zlib with 2.2.1 In-Reply-To: <20130429155159.GG6596@queeg.we-be-smart.org> References: <20130425165552.GA637@queeg.we-be-smart.org> <51796B7A.3020607@sys4.de> <20130429155159.GG6596@queeg.we-be-smart.org> Message-ID: <517E9AE2.2040903@sys4.de> Am 29.04.2013 17:51, schrieb Kyle Wheeler: > On Thursday, April 25 at 07:44 PM, quoth Robert Schetterer: >> Am 25.04.2013 18:55, schrieb Kyle Wheeler: >>> As you can probably tell, I'm using the fts_lucene plugin, which used to >>> work just fine (with Dovecot 2.1.x). Is this expected behavior? Are >>> these errors truly ignorable? Why are these compressed mailboxes not >>> selectable? >> >> sorry to ask , but did you compile with lucene ? > > Yes I did. I configured my compile like this: > > ./configure --without-sql --without-vpopmail --with-ldap \ > --with-lucene --with-stemmer > > I've got CLucene 2.3.3.4 installed, and libstemmer version 0+svn527-1 > (the version that's packaged as part of Debian). Running ldd on > /usr/local/lib/dovecot/lib21_fs_lucene_plugin.so says it's linked > against both libclucene and libstemmer: > > /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so: > linux-vdso.so.1 => (0x00007fff3f3ff000) > libclucene-core.so.1 => /usr/local/lib/libclucene-core.so.1 > (0x00007f9b0e5f5000) > libstemmer.so.0d => /usr/lib/libstemmer.so.0d (0x00007f9b0e3a4000) > librt.so.1 => /lib/librt.so.1 (0x00007f9b0e19b000) > libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x00007f9b0de87000) > libm.so.6 => /lib/libm.so.6 (0x00007f9b0dc05000) > libc.so.6 => /lib/libc.so.6 (0x00007f9b0d8a2000) > libgcc_s.so.1 => /lib/libgcc_s.so.1 (0x00007f9b0d68c000) > libclucene-shared.so.1 => /usr/local/lib/libclucene-shared.so.1 > (0x00007f9b0d46c000) > libpthread.so.0 => /lib/libpthread.so.0 (0x00007f9b0d24f000) > libz.so.1 => /usr/lib/libz.so.1 (0x00007f9b0d038000) > /lib64/ld-linux-x86-64.so.2 (0x00007f9b0ebde000) > > ~Kyle i ve got no problems with lucene dove 2.1.15 and before 2.1.x versions, didnt tested with 2.2.x , also as far i remember i did no use stemmer, what about try without stemmer ? But however it may be be a bug in 2.2.x, did you try latest hg version ? perhaps wait for Timos answer Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From p.heinlein at heinlein-support.de Mon Apr 29 19:23:06 2013 From: p.heinlein at heinlein-support.de (Peer Heinlein) Date: Mon, 29 Apr 2013 18:23:06 +0200 Subject: [Dovecot] last login timestamp In-Reply-To: <517E995D.3060606@sys4.de> References: <9b8130bbd8137a4bc9c53bc65281b5ea@frsf.utn.edu.ar> <517E8BBA.2090406@heinlein-support.de> <517E995D.3060606@sys4.de> Message-ID: <517E9E6A.4080704@heinlein-support.de> Am 29.04.2013 18:01, schrieb Robert Schetterer: > doing touch method may slow down your i.e cluster filesystem, database > etc specially with high frequent logins, related how/what you need such > timestamps > you can get them from logs too, to get an idea If a system's breaking down by touching one file per login this system should never host users, that receive more then 20 mails per day. EVERY single stupid e-mail generates MUCH more I/O then touching last-login. Every log line generates as much I/O, als touching this file. Anyway, I never believed that cluster filesystems are a usable storage system for mailservers. I don't like and recommend cluster filesystems for that. But, sure, your way with cron saves some I/O, that's right. I just remembered, that in our LDAP-lastlogin-script we simply built in a check that READ lastlogin befor updating it and that just updated lastlogin, if lastlogin differs from the actual date. In that case every user generates just one LDAP-write per day, which was quite okay. Peer - Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin From rs at sys4.de Mon Apr 29 19:47:18 2013 From: rs at sys4.de (Robert Schetterer) Date: Mon, 29 Apr 2013 18:47:18 +0200 Subject: [Dovecot] last login timestamp In-Reply-To: <517E9E6A.4080704@heinlein-support.de> References: <9b8130bbd8137a4bc9c53bc65281b5ea@frsf.utn.edu.ar> <517E8BBA.2090406@heinlein-support.de> <517E995D.3060606@sys4.de> <517E9E6A.4080704@heinlein-support.de> Message-ID: <517EA416.2030108@sys4.de> Am 29.04.2013 18:23, schrieb Peer Heinlein: > Am 29.04.2013 18:01, schrieb Robert Schetterer: > > > >> doing touch method may slow down your i.e cluster filesystem, database >> etc specially with high frequent logins, related how/what you need such >> timestamps >> you can get them from logs too, to get an idea > > If a system's breaking down by touching one file per login this system > should never host users, that receive more then 20 mails per day. please read and understand what "high frequent logins" means, i am talking about i.e 2000 pop3 tls logins per second > > EVERY single stupid e-mail generates MUCH more I/O then touching > last-login. Every log line generates as much I/O, als touching this file. dont tell ,instead measure ,try i.e with high pop3 rates on drbd ocfs2 cluster and maildir > > Anyway, I never believed that cluster filesystems are a usable storage > system for mailservers. I don't like and recommend cluster filesystems > for that. i dont remember asking that, however i have that up and running and many others have too, we done tests about different filesystems if done right , its an absolut working power solution, plugin believing is not part of dovecot *g > > But, sure, your way with cron saves some I/O, that's right. its not meant to be the holy grail, but may use as simple workaround everyone needs to have logs ( i.e in big setups you have central logging ), so why not use it for this job too, instead of figure around with filestamps, database , ldap logins , change dovecot config etc > > I just remembered, that in our LDAP-lastlogin-script we simply built in > a check that READ lastlogin befor updating it and that just updated > lastlogin, if lastlogin differs from the actual date. In that case every > user generates just one LDAP-write per day, which was quite okay. i did not say yor solution is wrong or bad, but however there are many ways to goal last login target > > Peer > > > - > Heinlein Support GmbH > Schwedter Str. 8/9b, 10119 Berlin > > http://www.heinlein-support.de > > Tel: 030 / 405051-42 > Fax: 030 / 405051-19 > > Zwangsangaben lt. ?35a GmbHG: HRB 93818 B / Amtsgericht > Berlin-Charlottenburg, > Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From oajara at frsf.utn.edu.ar Mon Apr 29 20:14:01 2013 From: oajara at frsf.utn.edu.ar (oajara at frsf.utn.edu.ar) Date: Mon, 29 Apr 2013 14:14:01 -0300 Subject: [Dovecot] last login timestamp In-Reply-To: <517EA416.2030108@sys4.de> References: <9b8130bbd8137a4bc9c53bc65281b5ea@frsf.utn.edu.ar> <517E8BBA.2090406@heinlein-support.de> <517E995D.3060606@sys4.de> <517E9E6A.4080704@heinlein-support.de> <517EA416.2030108@sys4.de> Message-ID: <63705f37f1119f6b090f8ac478b55409@frsf.utn.edu.ar> I guess I don't have such a high load so I will try Peer's recomendation about using PostLoginScripting first and measure the impact. I will try the log monitoring technique if the impact is significant. Thank you very much. El 29.04.2013 13:47, Robert Schetterer escribi?: > Am 29.04.2013 18:23, schrieb Peer Heinlein: > >> Am 29.04.2013 18:01, schrieb Robert Schetterer: >> >>> doing touch method may slow down your i.e cluster filesystem, database etc specially with high frequent logins, related how/what you need such timestamps you can get them from logs too, to get an idea >> If a system's breaking down by touching one file per login this system should never host users, that receive more then 20 mails per day. > > please read and understand what "high frequent logins" means, i am > talking about i.e 2000 pop3 tls logins per second > >> EVERY single stupid e-mail generates MUCH more I/O then touching last-login. Every log line generates as much I/O, als touching this file. > > dont tell ,instead measure ,try i.e with high pop3 rates on drbd ocfs2 > cluster and maildir > Anyway, I never believed that cluster filesystems are a usable storage system for mailservers. I d > >> i have that up and running and many others have too, we done tests about different filesystems if done right , its an absolut working power solution > elieving is not part of dovecot *g But, sure, your way with cron saves some I/O, that's right. > > its not meant to be the holy grail, but may use as simple workaround > everyone needs to have logs ( i.e in big setups you hav> , ldap logins , change dovecot config etc > " style="padding-left:5px; border-left:#1010ff 2px solid; margin-left:5px; width:100%">I just remembered, that in our LDAP-lastlogin-script we simply built in a check that READ lastlogin befor updating it and that just updated lastlogin, if lastlogin differs from the actual date. In that case every user generates just one LDAP-write per day, which was quite okay. > > i did not say y> pe="cite" style="padding-left:5px; border-left:#1010ff 2px solid; margin-left:5px; width:100%">Peer - Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de [1] Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zw > t. ?35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Gesch?ftsf?hrer: Peer Heinlein -- Sitz: Berlin > > Best Regards > MfG Robert Schetterer > > -- > [*] sys4 AG > > http://s> ?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein __________ Information from ESET Mail Security, version of virus signature database 8279 (20130429) __________ The message was checked by ESET Mail Sec > ef="http://www.eset.com">http://www.eset.com Links: ------ [1] http://www.heinlein-support.de __________ Information from ESET Mail Security, version of virus signature database 8279 (20130429) __________ The message was checked by ESET Mail Security. http://www.eset.com From jeep at rahul.net Mon Apr 29 20:26:29 2013 From: jeep at rahul.net (Jeff Lacki) Date: Mon, 29 Apr 2013 10:26:29 -0700 Subject: [Dovecot] help with LMTP setup Message-ID: <20130429172629.50F3C129F60@aqua.rahul.net> Im trying to convert my dovecot-lda setup to use LMTP for better security. My setup is postfix + dovecot + mysql with virtual users. Im setting up dovecot 2.2.1 w/postfix 2.10.0 Im still learning dovecot so Im not totally sure where Im going wrong. Can someone point out why Im getting permission problems? Im also concerned with server security, so if you notice anything that should be better, please point that out. I am the only user on this Linux box. Thank you! ls -l /opt/imapdata/j/jeff/INBOX total 8 drwxr-xr-x 2 vmail vmail 4096 Apr 27 14:21 ./ drwxr-xr-x 3 vmail vmail 4096 Apr 27 14:21 ../ Dovecot is running with the following users: root 20847 0.0 0.0 15572 1108 ? Ss 10:23 0:00 /opt/optdovecot/sbin/dovecot dovenull 20848 0.0 0.0 46752 2724 ? S 10:23 0:00 dovecot/imap-login dovenull 20849 0.0 0.0 46752 2720 ? S 10:23 0:00 dovecot/imap-login vmail 20850 0.0 0.0 13408 1068 ? S 10:23 0:00 dovecot/anvil root 20851 0.0 0.0 13540 1192 ? S 10:23 0:00 dovecot/log root 20853 0.0 0.0 16504 2128 ? S 10:23 0:00 dovecot/config vmail 20854 0.0 0.0 136448 2972 ? S 10:23 0:00 dovecot/auth Im getting the following when an email comes in: Apr 29 10:11:57 fed8 postfix/virtual[20666]: D88F3DF3BD: to=, relay=virtual, delay=370, delays=370/0.03/0/0.07, dsn=4.2.0, status=deferred (delivery failed to mailbox ///opt/imapdata/j/jeff/INBOX/inbox: unable to create lock file ///opt/imapdata/j/jeff/INBOX/inbox.lock: Permission denied) my postfix/master.cf entry: dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/opt/dovecot/libexec/dovecot/lmtp -f ${sender} -d ${recipient} doveconf -n: # 2.2.1: /opt/dovecot221/etc/dovecot/dovecot.conf # OS: Linux 3.8.5-201.fc18.x86_64 x86_64 Fedora release 18 (Spherical Cow) auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain default_internal_user = vmail first_valid_gid = 2000 first_valid_uid = 2000 listen = * lock_method = flock login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_debug = yes mail_gid = vmail mail_privileged_group = vmail mail_uid = vmail mbox_lock_timeout = 1 mins mbox_write_locks = fcntl passdb { args = /opt/dovecot/etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size } postmaster_address = jeff at otherdomain.com protocols = imap lmtp sendmail_path = /usr/lib/sendmail service auth { inet_listener { port = 12345 } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0660 user = vmail } user = $default_internal_user } service imap-login { inet_listener imaps { port = 993 ssl = yes } process_min_avail = 2 service_count = 1 vsz_limit = 64 M } service lmtp { executable = lmtp -L inet_listener lmtp { address = 192.168.1.22 127.0.0.1 port = 24 } unix_listener lmtp { mode = 0666 } user = vmail } ssl = required ssl_cert = References: <9b8130bbd8137a4bc9c53bc65281b5ea@frsf.utn.edu.ar> <517E8BBA.2090406@heinlein-support.de> <517E995D.3060606@sys4.de> <517E9E6A.4080704@heinlein-support.de> <517EA416.2030108@sys4.de> <63705f37f1119f6b090f8ac478b55409@frsf.utn.edu.ar> Message-ID: <517EB3EE.1080908@sys4.de> Am 29.04.2013 19:14, schrieb oajara at frsf.utn.edu.ar: > I guess I don't have such a high load so I will try Peer's > recomendation about using PostLoginScripting first and measure the > impact. I will try the log monitoring technique if the impact is > significant. Thank you very much. for low/middle traffic servers PostLoginScripting touch method as described in the dove wiki is absolut ok, i decide changing it ,about getting over 1000 logins per second on a 4000 Users systems loadbalanced Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From rs at sys4.de Mon Apr 29 21:02:36 2013 From: rs at sys4.de (Robert Schetterer) Date: Mon, 29 Apr 2013 20:02:36 +0200 Subject: [Dovecot] help with LMTP setup In-Reply-To: <20130429172629.50F3C129F60@aqua.rahul.net> References: <20130429172629.50F3C129F60@aqua.rahul.net> Message-ID: <517EB5BC.2010000@sys4.de> Am 29.04.2013 19:26, schrieb Jeff Lacki: > my postfix/master.cf entry: > > dovecot unix - n n - - pipe > flags=DRhu user=vmail:vmail argv=/opt/dovecot/libexec/dovecot/lmtp -f ${sender} -d ${recipient} with short look you mixed wrong with lda setup ? which may setup i.e like this dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/dovecot-lda -d $(recipient) i.e lmtp can be done like this /etc/postfix/main.cf virtual_transport = lmtp:unix:private/dovecot-lmtp /etc/dovecot/conf.d/10-master.conf service lmtp { vsz_limit = ... unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } process_min_avail = ... } Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From michael.abbott at apple.com Mon Apr 29 21:37:23 2013 From: michael.abbott at apple.com (Mike Abbott) Date: Mon, 29 Apr 2013 13:37:23 -0500 Subject: [Dovecot] CATENATE allows zero parts Message-ID: <8FDB0BF3-3481-4E74-89A7-108F9E86FE5C@apple.com> I'm pleased to see that dovecot-2.2 includes support for RFCs 4467 and 4469 (URLAUTH and CATENATE). I have begun testing these features (in dovecot-2.2.1) and comparing their functionality against Apple's implementation. So far I have discovered a few inconsistencies. I will report each of these, and any more that I may find, in separate threads. The first issue is that using CATENATE with no message parts works but, IMO, shouldn't: a2 append inbox catenate () a2 OK [APPENDUID 1366726248 9] Append completed. For comparison this is how Apple's enhanced dovecot in OS X Server handles this request: a2 append inbox catenate () a2 BAD Invalid arguments. According to RFC 4469 section 3 CATENATE requires "one or more message parts." This is formalized in section 5: append-data =/ "CATENATE" SP "(" cat-part *(SP cat-part) ")" and in RFC 3501 section 9 which states that "[ABNF] rules MUST be followed strictly." I believe that permitting zero cat-parts is contrary to the RFC, although I can understand permitting it under the general doctrine of "servers should be liberal in what they accept, and clients strict in what they send." Is accepting zero cat-parts an intentional exception to the RFC or an oversight? From michael.abbott at apple.com Mon Apr 29 21:38:42 2013 From: michael.abbott at apple.com (Mike Abbott) Date: Mon, 29 Apr 2013 13:38:42 -0500 Subject: [Dovecot] CATENATE doesn't support literal+ url Message-ID: <1824A6D3-F4EE-42D5-A623-1471E54221A4@apple.com> Dovecot-2.2.1 does not appear to support URLs specified via non-synchronizing literals (RFC 2088 LITERAL+), and also does not read and discard the literal+ input after reporting the error. This results in the literal+ input being interpreted as IMAP commands, which could alter the user's mail store in unexpected ways and/or lead to the abrupt disconnection of the client for exceeding the maximum number of bad IMAP commands. Example using dovecot-2.2.1 (note that the text nonsync literal includes the invisible CRLFs: "foobarCRLFbarbazCRLF"): a3 append inbox catenate (url {9+} /some-url text {16+} foobar barbaz ) a4 noop a3 BAD Error in IMAP command APPEND: Invalid arguments. foobar BAD Error in IMAP command : Unknown command. barbaz BAD Error in IMAP command : Unknown command. ) BAD Error in IMAP command : Unknown command. a4 OK NOOP completed. Example using Apple's enhanced dovecot in OS X Server: a3 append inbox catenate (url {9+} /some-url text {16+} foobar barbaz ) a4 noop a3 NO [BADURL /some-url] missing or invalid uid a4 OK NOOP completed. I believe the RFCs indicate that nonsync literal URLs should be permitted. RFC 4469 section 5: append-data =/ "CATENATE" SP "(" cat-part *(SP cat-part) ")" cat-part = text-literal / url url = "URL" SP astring RFC 3501 section 9: astring = 1*ASTRING-CHAR / string string = quoted / literal RFC 2088 section 4: literal ::= "{" number ["+"] "}" CRLF *CHAR8 From michael.abbott at apple.com Mon Apr 29 21:40:14 2013 From: michael.abbott at apple.com (Mike Abbott) Date: Mon, 29 Apr 2013 13:40:14 -0500 Subject: [Dovecot] CATENATE allows empty messages Message-ID: Dovecot-2.2.1 allows empty messages to be APPENDed when using CATENATE: b1 append inbox catenate (text {0+} ) b1 OK [APPENDUID 1366726248 12] Append completed. Contrast this with regular APPEND: b2 append inbox {0+} b2 NO Can't save a zero byte message. Note that zero-size literals are OK but zero-size messages are not. So while "b1" above should fail like "b2", this should continue to succeed: b3 append inbox catenate (text {0+} text {8+} foobar ) b3 OK [APPENDUID 1366726248 13] Append completed. From michael.abbott at apple.com Mon Apr 29 21:43:26 2013 From: michael.abbott at apple.com (Mike Abbott) Date: Mon, 29 Apr 2013 13:43:26 -0500 Subject: [Dovecot] CATENATE allows empty messages In-Reply-To: References: Message-ID: <259202B1-CE90-42DA-90AD-509E3B689BDF@apple.com> Something ate an important leading space from my message. > b3 append inbox catenate (text {0+} > text {8+} > foobar > ) > b3 OK [APPENDUID 1366726248 13] Append completed. There was and should be a single space before the "text {8+}" above. From jeep at rahul.net Mon Apr 29 22:36:54 2013 From: jeep at rahul.net (Jeff Lacki) Date: Mon, 29 Apr 2013 12:36:54 -0700 Subject: [Dovecot] help with LMTP setup In-Reply-To: <517EB5BC.2010000@sys4.de> References: <20130429172629.50F3C129F60@aqua.rahul.net> <517EB5BC.2010000@sys4.de> Message-ID: <20130429193654.87F29129FC6@aqua.rahul.net> Robert Schetterer wrote: > Am 29.04.2013 19:26, schrieb Jeff Lacki: > > my postfix/master.cf entry: > > > > dovecot unix - n n - - pipe > > flags=DRhu user=vmail:vmail argv=/opt/dovecot/libexec/dovecot/lmtp -f ${sender} -d ${recipient} > > with short look > you mixed wrong with lda setup ? > > which may setup i.e like this > > dovecot unix - n n - - pipe > flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/dovecot-lda -d > $(recipient) > > > i.e lmtp can be done like this > > /etc/postfix/main.cf > > virtual_transport = lmtp:unix:private/dovecot-lmtp > > /etc/dovecot/conf.d/10-master.conf > > service lmtp { > vsz_limit = ... > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0660 > user = postfix > } > process_min_avail = ... > } > > > Best Regards > MfG Robert Schetterer > Thanks Robert, unfortunately I still get the same error after making those modifications. Any other suggestions? Thanks! /mf/home/jeep/shell/.signature From michael.abbott at apple.com Mon Apr 29 23:43:04 2013 From: michael.abbott at apple.com (Mike Abbott) Date: Mon, 29 Apr 2013 15:43:04 -0500 Subject: [Dovecot] CATENATE doesn't support literal+ url In-Reply-To: <1824A6D3-F4EE-42D5-A623-1471E54221A4@apple.com> References: <1824A6D3-F4EE-42D5-A623-1471E54221A4@apple.com> Message-ID: > Dovecot-2.2.1 does not appear to support URLs specified via non-synchronizing literals Or synchronizing literals either: b2 append inbox catenate (url {8} b2 BAD Error in IMAP command APPEND: Invalid arguments. Although the consequences of this are less severe since clients should send no more data for that command after receiving the tagged response. From tss at iki.fi Tue Apr 30 00:06:53 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 30 Apr 2013 00:06:53 +0300 Subject: [Dovecot] CATENATE doesn't support literal+ url In-Reply-To: References: <1824A6D3-F4EE-42D5-A623-1471E54221A4@apple.com> Message-ID: On 29.4.2013, at 23.43, Mike Abbott wrote: >> Dovecot-2.2.1 does not appear to support URLs specified via non-synchronizing literals > > Or synchronizing literals either: > > b2 append inbox catenate (url {8} > b2 BAD Error in IMAP command APPEND: Invalid arguments. > > Although the consequences of this are less severe since clients should send no more data for that command after receiving the tagged response. Looks like the code should be calling imap_parser_read_last_literal() after reading URL with literal parameter.. I'll get that fixed. From tss at iki.fi Tue Apr 30 00:12:21 2013 From: tss at iki.fi (Timo Sirainen) Date: Tue, 30 Apr 2013 00:12:21 +0300 Subject: [Dovecot] CATENATE allows empty messages In-Reply-To: References: Message-ID: On 29.4.2013, at 21.40, Mike Abbott wrote: > Dovecot-2.2.1 allows empty messages to be APPENDed when using CATENATE: > b1 append inbox catenate (text {0+} > ) > b1 OK [APPENDUID 1366726248 12] Append completed. > > Contrast this with regular APPEND: > b2 append inbox {0+} > b2 NO Can't save a zero byte message. > > Note that zero-size literals are OK but zero-size messages are not. So while "b1" above should fail like "b2", this should continue to succeed: > b3 append inbox catenate (text {0+} > text {8+} > foobar > ) > b3 OK [APPENDUID 1366726248 13] Append completed. This could be changed I guess, but I don't think it's a bug. I don't see anything in RFC 3501 prohibiting saving empty messages. Only the MULTIAPPEND RFC says: A zero-length message literal argument is an error, and MUST return a NO. This can be used to cancel the append. But that doesn't prohibit zero-length CATENATE parameters. From julio at psi.com.br Tue Apr 30 01:40:20 2013 From: julio at psi.com.br (Julio Cesar Covolato) Date: Mon, 29 Apr 2013 19:40:20 -0300 Subject: [Dovecot] last login timestamp In-Reply-To: <517EB3EE.1080908@sys4.de> (sfid-H20130429-145556-+035.14-1@spamfilter.osbf.lua) References: <9b8130bbd8137a4bc9c53bc65281b5ea@frsf.utn.edu.ar> <517E8BBA.2090406@heinlein-support.de> <517E995D.3060606@sys4.de> <517E9E6A.4080704@heinlein-support.de> <517EA416.2030108@sys4.de> <63705f37f1119f6b090f8ac478b55409@frsf.utn.edu.ar> <517EB3EE.1080908@sys4.de> (sfid-H20130429-145556-+035.14-1@spamfilter.osbf.lua) Message-ID: <517EF6D4.2080701@psi.com.br> Em 29/04/2013 14:54, Robert Schetterer escreveu: > Am 29.04.2013 19:14, schrieb oajara at frsf.utn.edu.ar: >> I guess I don't have such a high load so I will try Peer's >> recomendation about using PostLoginScripting first and measure the >> impact. I will try the log monitoring technique if the impact is >> significant. Thank you very much. > for low/middle traffic servers PostLoginScripting touch method as > described in the dove wiki is absolut ok, i decide changing it ,about > getting over 1000 logins per second on a 4000 Users systems loadbalanced > > Best Regards > MfG Robert Schetterer > Hi. My aproach is just find the oldest message in the folder mailbase/domain/user/Maildir/new/ for every user once a day. If there are message older then 90 days, put in an on-hold dir compressed archive and block all messages to that user, if not claimed in 180 days delete all. There are a simple shell script that i made whith mysql backend (iredmail): http://www.psi.com.br/~julio/postfix/MailUserOld.sh. Regards, -- ----------------------------- _ Julio Cesar Covolato 0v0 /(_)\ F: 55-11-3129-3366 ^ ^ PSI INTERNET ----------------------------- From michael.abbott at apple.com Tue Apr 30 02:25:24 2013 From: michael.abbott at apple.com (Mike Abbott) Date: Mon, 29 Apr 2013 18:25:24 -0500 Subject: [Dovecot] SELECT/EXAMINE don't report URLMECH Message-ID: <377B5C06-4B20-4322-B3DB-6F15E0B6A728@apple.com> In dovecot-2.2.1 neither the SELECT nor the EXAMINE commands include an untagged URLMECH reply. (Note, this is not the one mandated by the RESETKEY command.) AFAICT RFC 4467 does not require an URLMECH reply to SELECT or EXAMINE but without it clients have no way of knowing about authorization mechanisms other than INTERNAL. Now I know dovecot-2.2 supports only the INTERNAL mechanism at present so this is probably harmless, but still I think it's worthwhile to ask: Is the absence of the URLMECH reply intentional or an oversight? For comparison Apple's enhanced dovecot replies: c1 select inbox [...] * OK [URLMECH INTERNAL] Mechanisms supported c1 OK [READ-WRITE] Select completed. From jeep at rahul.net Tue Apr 30 03:48:48 2013 From: jeep at rahul.net (Jeff Lacki) Date: Mon, 29 Apr 2013 17:48:48 -0700 Subject: [Dovecot] help with LMTP setup In-Reply-To: <20130429193654.87F29129FC6@aqua.rahul.net> References: <20130429172629.50F3C129F60@aqua.rahul.net> <517EB5BC.2010000@sys4.de> <20130429193654.87F29129FC6@aqua.rahul.net> Message-ID: <20130430004848.65D8A129EF1@aqua.rahul.net> jeep at rahul.net (Jeff Lacki) wrote: > > Thanks Robert, unfortunately I still get the same error after > making those modifications. Any other suggestions? > > Thanks! > > /mf/home/jeep/shell/.signature Ok I changed the permissions on the directory: /opt/imapdata/j/jeff/INBOX to 777: total 20 drwxrwxrwx 2 postfix postfix 4096 Apr 29 17:46 ./ drwxr-xr-x 3 postfix postfix 4096 Apr 27 14:21 ../ -rw------- 1 2000 2000 8490 Apr 29 17:46 inbox I realize this isnt the most secure, but it is working. If anyone has the proper suggestion for me please let me know. I forgot to mention that the uid/gid are coming from the database. Thanks for any help, Jeff /mf/home/jeep/shell/.signature From michael.abbott at apple.com Tue Apr 30 04:07:04 2013 From: michael.abbott at apple.com (Mike Abbott) Date: Mon, 29 Apr 2013 20:07:04 -0500 Subject: [Dovecot] imap crash during URLFETCH Message-ID: Dovecot-2.2.1's imap processes crash reliably when they use an IMAP URL with an invalid access specifier. A backtrace and some debug output follows. The crash is likely caused by imap_urlauth_fetch_parsed() returning 0 without having set *mpurl_r to NULL, and then imap_urlauth_fetch_local() freeing an uninitialized pointer. Exception Type: EXC_BAD_ACCESS (SIGSEGV) Exception Codes: KERN_INVALID_ADDRESS at 0x0000000000001059 0 libdovecot-storage.0.dylib 0x000000010b06a383 imap_msgpart_url_free + 17 1 imap 0x000000010afc71cc imap_urlauth_fetch_local + 770 2 imap 0x000000010afc6dcf imap_urlauth_fetch_url + 439 3 imap 0x000000010afbb489 cmd_urlfetch + 580 4 imap 0x000000010afbdf4d command_exec + 55 5 imap 0x000000010afbdabb client_command_input + 34 6 imap 0x000000010afbdc7c client_command_input + 483 7 imap 0x000000010afbd351 client_handle_input + 239 8 imap 0x000000010afbc613 client_input + 119 9 libdovecot.0.dylib 0x000000010b111c74 io_loop_call_io + 46 10 libdovecot.0.dylib 0x000000010b112c85 io_loop_handler_run + 214 11 libdovecot.0.dylib 0x000000010b111e1f io_loop_run + 77 12 libdovecot.0.dylib 0x000000010b0d10c6 master_service_run + 24 13 imap 0x000000010afc5aba main + 1010 14 libdyld.dylib 0x00007fff89e5f7bd start + 1 Apr 29 20:00:31 imap(pid 82429 user mja): Debug: Fetching local URLAUTH imap://mja at duck.example.com/INBOX;uidvalidity=1366726248/;uid=19;urlauth=submit+mja:internal:012c9c6a3d74db6509e4a3802a0f5edf64546608b8 Apr 29 20:00:31 imap(pid 82429 user mja): Debug: Failed to fetch URLAUTH "imap://mja at duck.example.com/INBOX;uidvalidity=1366726248/;uid=19;urlauth=submit+mja:internal:012c9c6a3d74db6509e4a3802a0f5edf64546608b8": No 'submit+mja' access allowed for user mja Apr 29 20:00:31 imap(pid 82429 user mja): Fatal: master: service(imap): child 82429 killed with signal 11 (core dumps disabled) From tim at timgws.com.au Tue Apr 30 04:28:32 2013 From: tim at timgws.com.au (Tim Groeneveld) Date: Mon, 29 Apr 2013 21:28:32 -0400 (EDT) Subject: [Dovecot] Mail deduplication Message-ID: <971614.566.1367285312578.JavaMail.root@timgws.com.au> Hi Guys, I am wondering about mail deduplication. I am looking into the possibility of seperating out all of the message bodies with multiple parts inside mail that is recived from `dovecot` and hashing them all. The idea is that by hashing all of the parts inside the email, I will be able to ensure that each part of the email will only be saved once. This means that attachments & common parts of the body will only be saved once inside the storage. How achievable would this be with the current state of dovecot? Would it even be worth doing? Thanks, Tim From rs at sys4.de Tue Apr 30 08:47:34 2013 From: rs at sys4.de (Robert Schetterer) Date: Tue, 30 Apr 2013 07:47:34 +0200 Subject: [Dovecot] last login timestamp In-Reply-To: <517EF6D4.2080701@psi.com.br> References: <9b8130bbd8137a4bc9c53bc65281b5ea@frsf.utn.edu.ar> <517E8BBA.2090406@heinlein-support.de> <517E995D.3060606@sys4.de> <517E9E6A.4080704@heinlein-support.de> <517EA416.2030108@sys4.de> <63705f37f1119f6b090f8ac478b55409@frsf.utn.edu.ar> <517EB3EE.1080908@sys4.de> (sfid-H20130429-145556-+035.14-1@spamfilter.osbf.lua) <517EF6D4.2080701@psi.com.br> Message-ID: <517F5AF6.5050402@sys4.de> Am 30.04.2013 00:40, schrieb Julio Cesar Covolato: > My aproach is just find the oldest message in the folder > mailbase/domain/user/Maildir/new/ for every user once a day yes that works too, used this years ago, but i think its not working with mdbox etc Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From rs at sys4.de Tue Apr 30 08:49:22 2013 From: rs at sys4.de (Robert Schetterer) Date: Tue, 30 Apr 2013 07:49:22 +0200 Subject: [Dovecot] help with LMTP setup In-Reply-To: <20130430004848.65D8A129EF1@aqua.rahul.net> References: <20130429172629.50F3C129F60@aqua.rahul.net> <517EB5BC.2010000@sys4.de> <20130429193654.87F29129FC6@aqua.rahul.net> <20130430004848.65D8A129EF1@aqua.rahul.net> Message-ID: <517F5B62.2080401@sys4.de> Am 30.04.2013 02:48, schrieb Jeff Lacki: > jeep at rahul.net (Jeff Lacki) wrote: > >> >> Thanks Robert, unfortunately I still get the same error after >> making those modifications. Any other suggestions? >> >> Thanks! >> >> /mf/home/jeep/shell/.signature > > Ok I changed the permissions on the directory: > > /opt/imapdata/j/jeff/INBOX to 777: > > total 20 > drwxrwxrwx 2 postfix postfix 4096 Apr 29 17:46 ./ > drwxr-xr-x 3 postfix postfix 4096 Apr 27 14:21 ../ > -rw------- 1 2000 2000 8490 Apr 29 17:46 inbox > > I realize this isnt the most secure, but it is working. > > If anyone has the proper suggestion for me please let me know. > I forgot to mention that the uid/gid are coming from the database. > > Thanks for any help, > Jeff > > /mf/home/jeep/shell/.signature > depends what you wanna goal, you shouldnt use user postfix better create a seperate new user vmail group vmail in virtual setups Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From amateo at um.es Tue Apr 30 09:05:06 2013 From: amateo at um.es (Angel L. Mateo) Date: Tue, 30 Apr 2013 08:05:06 +0200 Subject: [Dovecot] Mail deduplication In-Reply-To: <971614.566.1367285312578.JavaMail.root@timgws.com.au> References: <971614.566.1367285312578.JavaMail.root@timgws.com.au> Message-ID: <517F5F12.9070505@um.es> El 30/04/13 03:28, Tim Groeneveld escribi?: > > Hi Guys, > > I am wondering about mail deduplication. I am looking into the possibility > of seperating out all of the message bodies with multiple parts inside mail > that is recived from `dovecot` and hashing them all. > > The idea is that by hashing all of the parts inside the email, I will be > able to ensure that each part of the email will only be saved once. > > This means that attachments & common parts of the body will only be > saved once inside the storage. > > How achievable would this be with the current state of dovecot? Would it > even be worth doing? > I asked the same question recently. As Timo responsed at http://kevat.dovecot.org/list/dovecot/2013-March/089072.html it seems that this feature is production stable in recent versions of dovecot. And I think it is worth. My estimations (with just about 10 users of my organization, they are no accurate) is that you can save more than 30% of total mail storage. To configure it you need to use options: * mail_attachment_dir * mail_attachement_min_size * mail_attachment_fs * mail_attachment_hash -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337 From arnaud.abelard at univ-nantes.fr Tue Apr 30 10:04:51 2013 From: arnaud.abelard at univ-nantes.fr (=?UTF-8?B?QXJuYXVkIEFiw6lsYXJk?=) Date: Tue, 30 Apr 2013 09:04:51 +0200 Subject: [Dovecot] Mail deduplication In-Reply-To: <517F5F12.9070505@um.es> References: <971614.566.1367285312578.JavaMail.root@timgws.com.au> <517F5F12.9070505@um.es> Message-ID: <517F6D13.9000207@univ-nantes.fr> On 04/30/2013 08:05 AM, Angel L. Mateo wrote: > El 30/04/13 03:28, Tim Groeneveld escribi?: >> >> Hi Guys, >> >> I am wondering about mail deduplication. I am looking into the >> possibility >> of seperating out all of the message bodies with multiple parts inside >> mail >> that is recived from `dovecot` and hashing them all. >> >> The idea is that by hashing all of the parts inside the email, I will be >> able to ensure that each part of the email will only be saved once. >> >> This means that attachments & common parts of the body will only be >> saved once inside the storage. >> >> How achievable would this be with the current state of dovecot? Would it >> even be worth doing? >> > I asked the same question recently. As Timo responsed at > http://kevat.dovecot.org/list/dovecot/2013-March/089072.html it seems > that this feature is production stable in recent versions of dovecot. > > And I think it is worth. My estimations (with just about 10 users > of my organization, they are no accurate) is that you can save more than > 30% of total mail storage. > > To configure it you need to use options: > > * mail_attachment_dir > * mail_attachement_min_size > * mail_attachment_fs > * mail_attachment_hash > Hello, Is it just working or is it working in a optimal way? back in October 2011 we noticed that the deduplication wasn't working as well as we were expecting as some files weren't properly deduplicated (http://markmail.org/message/ymfdwng7un2mj26z). Timo did you ever hit that bug and got it fixed if there was anything to fix on your side? Since we are very interrested in this feature I am very eager to hear about admins using it on a similar scale (around 80,000 mailboxes). Thanks, Arnaud -- Arnaud Ab?lard (jabber: arnaud.abelard at univ-nantes.fr) Administrateur Syst?me - Responsable Services Web Direction des Syst?mes d'Informations Universit? de Nantes - ne pas utiliser: trapemail at univ-nantes.fr From ravi_kanchan2004 at yahoo.com Tue Apr 30 11:00:05 2013 From: ravi_kanchan2004 at yahoo.com (Ravi Kanchan) Date: Tue, 30 Apr 2013 16:00:05 +0800 (SGT) Subject: [Dovecot] Dovecot Antispam Plugin is not working Message-ID: <1367308805.90245.YahooMailNeo@web194003.mail.sg3.yahoo.com> Hi All, I am using dovecot? version 2.0.9 DSPAM Anti-Spam Suite 3.10.2 (agent/library) ClamAV 0.97.7/17102 and dspam antispam plugin ?dovecot-antispam-plugin-43880985e3dd and plugin configuration is given below: protocol imap { ? mail_plugins = " antispam autocreate" } protocol pop3 { ? mail_plugins = antispam autocreate } plugin { ? antispam_allow_append_to_spam = YES ? antispam_backend = dspam ? antispam_crm_args = --config=/home/vmail ? antispam_dspam_args = --client;--user vmail ? antispam_dspam_binary = /usr/bin/dspam ? antispam_dspam_notspam = --class=innocent ? antispam_dspam_result_header = X-DSPAM-Result ? antispam_dspam_spam = --class=spam ? antispam_mail_tmpdir = /tmp ? antispam_signature = X-DSPAM-Signature ? antispam_signature_missing = error ? antispam_spam = Spam } dspam bin path: [root at sogo ~]# which dspam /usr/bin/dspam and dspam.conf has attached with this mail. but my dspam plugin configuration is not working. and also I am not getting any log from dspam. My dspam server is working prefect. but I guess plugin is not working properly can anyone helpme. and my configuration for this is following:Regard's Ravi Kanchan Sharma Sr. System Administrator Infinite Computer Solutions (I) Ltd. Bglr. Mo. 9997154666? -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: dspam.conf URL: From janfrode at tanso.net Tue Apr 30 12:22:39 2013 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Tue, 30 Apr 2013 11:22:39 +0200 Subject: [Dovecot] Mail deduplication In-Reply-To: <517F6D13.9000207@univ-nantes.fr> References: <971614.566.1367285312578.JavaMail.root@timgws.com.au> <517F5F12.9070505@um.es> <517F6D13.9000207@univ-nantes.fr> Message-ID: Wasn't there also some issue with cleanup of attachments ? Not being able to delete the last copy, or something. I did some testing of using SIS on a backup dsync destination a year (or two) ago, and got quite confused.. Don't quite remember the problems I had, but I did lose confidence in it and decided having the attachement together with the messages felt safest. I would also love to hear from admins using it on large scale (100K+ active users). Maybe we should reconsider using it.. -jf On Tue, Apr 30, 2013 at 9:04 AM, Arnaud Ab?lard < arnaud.abelard at univ-nantes.fr> wrote: > On 04/30/2013 08:05 AM, Angel L. Mateo wrote: > >> El 30/04/13 03:28, Tim Groeneveld escribi?: >> >>> >>> Hi Guys, >>> >>> I am wondering about mail deduplication. I am looking into the >>> possibility >>> of seperating out all of the message bodies with multiple parts inside >>> mail >>> that is recived from `dovecot` and hashing them all. >>> >>> The idea is that by hashing all of the parts inside the email, I will be >>> able to ensure that each part of the email will only be saved once. >>> >>> This means that attachments & common parts of the body will only be >>> saved once inside the storage. >>> >>> How achievable would this be with the current state of dovecot? Would it >>> even be worth doing? >>> >>> I asked the same question recently. As Timo responsed at >> http://kevat.dovecot.org/list/**dovecot/2013-March/089072.htmlit seems >> that this feature is production stable in recent versions of dovecot. >> >> And I think it is worth. My estimations (with just about 10 users >> of my organization, they are no accurate) is that you can save more than >> 30% of total mail storage. >> >> To configure it you need to use options: >> >> * mail_attachment_dir >> * mail_attachement_min_size >> * mail_attachment_fs >> * mail_attachment_hash >> >> Hello, > > Is it just working or is it working in a optimal way? back in October 2011 > we noticed that the deduplication wasn't working as well as we were > expecting as some files weren't properly deduplicated ( > http://markmail.org/message/**ymfdwng7un2mj26z). > Timo did you ever hit that bug and got it fixed if there was anything to > fix on your side? > > Since we are very interrested in this feature I am very eager to hear > about admins using it on a similar scale (around 80,000 mailboxes). > > Thanks, > > Arnaud > > > > > > -- > Arnaud Ab?lard (jabber: arnaud.abelard at univ-nantes.fr) > Administrateur Syst?me - Responsable Services Web > Direction des Syst?mes d'Informations > Universit? de Nantes > - > ne pas utiliser: trapemail at univ-nantes.fr > From radikn at seznam.cz Tue Apr 30 12:23:59 2013 From: radikn at seznam.cz (=?UTF-8?Q?Radek_Novotn=C3=BD?=) Date: Tue, 30 Apr 2013 11:23:59 +0200 Subject: [Dovecot] Mail deduplication In-Reply-To: <971614.566.1367285312578.JavaMail.root@timgws.com.au> References: <971614.566.1367285312578.JavaMail.root@timgws.com.au> Message-ID: Dne 30.4.2013 03:28, Tim Groeneveld napsal: > Hi Guys, > > I am wondering about mail deduplication. I am looking into the > possibility > of seperating out all of the message bodies with multiple parts inside > mail > that is recived from `dovecot` and hashing them all. > > The idea is that by hashing all of the parts inside the email, I will > be > able to ensure that each part of the email will only be saved once. > > This means that attachments & common parts of the body will only be > saved once inside the storage. > > How achievable would this be with the current state of dovecot? Would > it > even be worth doing? > > Thanks, > Tim Hi Tim, thank you for your question. I am pleasure, because I can help you. I had the same problem in past and there wasn?t solution. So, I have written script which count md5 hashes from receive date and message body. Then script compare md5 hashes and delete duplicated messages. Script uses doveadm for message manipulation and openssl for counting md5 hashes. Deduplication is done through all user?s mailboxes. Syntax is dedup , for example: dedup name at domain.cz INBOX. If you want dedup all mailboxes, enter ?A instead of mailbox name: dedup name at domain.cz ?A. Script is attached. I made it for my own use, so it isn?t stupid proof. If I can advise to you, work with care and make a backup ;-) Good luck #! /bin/sh # Remove duplicate messages from mainbox function dedup_mailbox () { local uids=( $(doveadm -f flow fetch -u $1 "uid" mailbox "$2" all | cut -f 2 -d =) ) if [ ${#uids[@]} -eq 0 ]; then echo " No messages" return elif [ ${#uids[@]} -eq 1 ]; then echo " Only one message" return fi for (( i=0; i<${#uids[@]}; i++ )); do local md5s_u[$i]=$(echo $(doveadm -f flow fetch -u $1 "date.received body" mailbox "$2" uid ${uids[$i]} | openssl md5)",${uids[$i]}") echo -en " Compute hashes: $i/${#uids[@]}(${md5s_u[$i]})\r" done echo -en " \r" local md5s=( $(echo ${md5s_u[@]} | sed 's/ /\n/g' | sort) ) x=0 i=0 while [ $i -lt $((${#md5s[@]} - 1)) ]; do A=$(echo ${md5s[$i]} | cut -f 1 -d ,) for (( j=$(($i + 1)); j<${#md5s[@]}; j++ )); do B=$(echo ${md5s[$j]} | cut -f 1 -d ,) if [ $A == $B ]; then doveadm expunge -u $1 mailbox "$2" uid $(echo ${md5s[$j]} | cut -f 2 -d ,) x=$(($x + 1)) else break fi done echo -en " Expunged $x message(s) from $(($j + 1))/${#md5s[@]}\r" i=$j done echo "" } if [ $2 == "-A" ]; then eval boxes=( $(doveadm mailbox list -u $1 | sed 's/.*/"&"/') ); else boxes[0]=$2 fi for (( k=0; k<${#boxes[@]}; k++ )); do echo "${boxes[$k]}:" dedup_mailbox $1 "${boxes[$k]}" done -------------- next part -------------- A non-text attachment was scrubbed... Name: dedup Type: text/x-shellscript Size: 1538 bytes Desc: not available URL: From ravi_kanchan2004 at yahoo.com Tue Apr 30 12:36:44 2013 From: ravi_kanchan2004 at yahoo.com (Ravi Kanchan) Date: Tue, 30 Apr 2013 17:36:44 +0800 (SGT) Subject: [Dovecot] dovecot antispam plugin is not woking Message-ID: <1367314604.74732.YahooMailNeo@web194001.mail.sg3.yahoo.com> ?Hi All, I am using dovecot? version 2.0.9 DSPAM Anti-Spam Suite 3.10.2 (agent/library) ClamAV 0.97.7/17102 and dspam antispam plugin ?dovecot-antispam-plugin-43880985e3dd and plugin configuration is given below: protocol imap { ? mail_plugins = " antispam autocreate" } protocol pop3 { ? mail_plugins = antispam autocreate } plugin { ? antispam_allow_append_to_spam = YES ? antispam_backend = dspam ? antispam_crm_args = --config=/home/vmail ? antispam_dspam_args = --client;--user vmail ? antispam_dspam_binary = /usr/bin/dspam ? antispam_dspam_notspam = --class=innocent ? antispam_dspam_result_header = X-DSPAM-Result ? antispam_dspam_spam = --class=spam ? antispam_mail_tmpdir = /tmp ? antispam_signature = X-DSPAM-Signature ? antispam_signature_missing = error ? antispam_spam = Spam } dspam bin path: [root at sogo ~]# which dspam /usr/bin/dspam but my dspam plugin configuration is not working. and I am not getting any log from dspam. My dspam server is working prefect. cna anyone help me Regard's Ravi Kanchan Sharma From forum at decotrain.de Tue Apr 30 12:49:59 2013 From: forum at decotrain.de (forum) Date: Tue, 30 Apr 2013 11:49:59 +0200 Subject: [Dovecot] Dovecot has no understandable configuration any more Message-ID: <70805cb6bdf07e7dcaae649b7ad0c594@decotrain.de> Hello, for many years i used an mailserver with dovecot V1 very satisfied! http://mailserver.decotrain.de/ One of the reasons to use dovecot was a simply configuration. Dovecot was the best choice for IMAP for me! Now i updated the server to Debian testing with dovecot 2.1.7. It's not possible for me to get a running authentication for virtual mail users! I recently found this mailing and have the same problem: http://www.dovecot.org/list/dovecot/2012-March/064181.html The documentation says *nothing* about my problem how to authenticate with mysql! http://wiki2.dovecot.org/VirtualUsers I can solve the problem only with try and error without a chance in this complex system. It's nice to have all this possibilites but they are not useful if not documented. There should be some clear examples for different scenarios to be found in your wiki. My problem at this time: I don't know how to configure the userdb to work with mysql authentification? All mail is running under the special user mail. dovecot.conf ============ disable_plaintext_auth = yes passdb { driver = sql # Path for SQL configuration file, see example-config/dovecot-sql.conf.ext args = /etc/dovecot/dovecot-sql.conf } userdb { driver = prefetch } first_valid_uid = 8 last_valid_uid = 8 first_valid_gid = 8 last_valid_gid = 8 mail_location = maildir:/srv/mail/%d/%n dovecot-sql.conf ================ driver = mysql connect = host=/var/run/mysqld/mysqld.sock dbname=... => WORKS! default_pass_scheme = SHA1 password_query = SELECT password, '/srv/mail/%d/%n' AS home, 'mail' AS uid, 'mail' AS gid FROM user WHERE username = '%n' AND domain = '%d' AND IMAP_allowed = 'YES' Errors ====== Apr 30 10:28:22 auth: Debug: client out: OK 1 user=xxxx at yyyy home=/srv/mail/yyyy/xxxx uid=mail gid=mail Apr 30 10:28:22 auth: Debug: master in: REQUEST 3163291649 5347 1 87066c907eef8f4e5ed71319b560dd2a Apr 30 10:28:22 auth: Error: prefetch(xxxx at yyyy,::1,): userdb lookup not possible with only userdb prefetch Apr 30 10:28:22 auth: Error: userdb(xxxx at yyyy,::1,): user not found from userdb prefetch Apr 30 10:28:22 auth: Debug: master out: NOTFOUND 3163291649 Apr 30 10:28:22 imap: Error: Authenticated user not found from userdb, auth lookup id=3163291649 (client-pid=5347 client-id=1) Apr 30 10:28:22 imap-login: Info: Internal login failure (pid=5347 id=1) (internal failure, 1 succesful auths): user=, method=PLAIN, rip=::1, lip=::1, mpid=5352, secured, session= I have no idea how to solve the problem and up to know i could not find an example with google. Please help. Best regards Karsten From forum at decotrain.de Tue Apr 30 12:50:16 2013 From: forum at decotrain.de (forum) Date: Tue, 30 Apr 2013 11:50:16 +0200 Subject: [Dovecot] Dovecot has no understandable configuration any more Message-ID: Hello, my last problem could be solved now with userdb { driver = static args = uid=mail gid=mail home=/srv/mail/%d/%n } I can connect to dovecot locally with an webmailer. But there is no listener process to be seen outside of the server? Locally this ports are working, but not outside: # netstat -tulpn | grep dove tcp6 0 0 :::110 :::* LISTEN 5741/dovecot tcp6 0 0 :::143 :::* LISTEN 5741/dovecot tcp6 0 0 :::993 :::* LISTEN 5741/dovecot tcp6 0 0 :::995 :::* LISTEN 5741/dovecot Is this a configuration problem inside dovecot? Another problem is the migration from the existant emails from V1 to V2: In the log i can find: Apr 30 11:14:57 imap(xxxx at yyyy): Error: Broken file /srv/mail/yyyy/xxxx/.INBOX.dir.09/dovecot-uidlist line 1: Broken header (uidvalidity = 0, next_uid=697) How can i recover this? Delete all the index files? Has someone an idea how to migrate the emails from charset ISO8859-1 to UTF-8? Best regards Karsten From radikn at seznam.cz Tue Apr 30 12:53:36 2013 From: radikn at seznam.cz (=?UTF-8?Q?Radek_Novotn=C3=BD?=) Date: Tue, 30 Apr 2013 11:53:36 +0200 Subject: [Dovecot] Mail deduplication In-Reply-To: <971614.566.1367285312578.JavaMail.root@timgws.com.au> References: <971614.566.1367285312578.JavaMail.root@timgws.com.au> Message-ID: <3684f17abad34f968c364b6d4fa0fde6@r-n.cz> Tim, oops, I read your message again and carefully. I see my mistake. You don't want delete whole duplicated messages but only their parts. So sorry for my reply, because It is quite out of topic. Radek Dne 30.4.2013 03:28, Tim Groeneveld napsal: > Hi Guys, > > I am wondering about mail deduplication. I am looking into the > possibility > of seperating out all of the message bodies with multiple parts inside > mail > that is recived from `dovecot` and hashing them all. > > The idea is that by hashing all of the parts inside the email, I will > be > able to ensure that each part of the email will only be saved once. > > This means that attachments & common parts of the body will only be > saved once inside the storage. > > How achievable would this be with the current state of dovecot? Would > it > even be worth doing? > > Thanks, > Tim From eugene at raptor.kiev.ua Tue Apr 30 14:47:40 2013 From: eugene at raptor.kiev.ua (Eugene Paskevich) Date: Tue, 30 Apr 2013 14:47:40 +0300 Subject: [Dovecot] dovecot antispam plugin is not woking In-Reply-To: <1367314604.74732.YahooMailNeo@web194001.mail.sg3.yahoo.com> References: <1367314604.74732.YahooMailNeo@web194001.mail.sg3.yahoo.com> Message-ID: On Tue, 30 Apr 2013 12:36:44 +0300, Ravi Kanchan wrote: > I am using dovecot version 2.0.9 > DSPAM Anti-Spam Suite 3.10.2 (agent/library) > ClamAV 0.97.7/17102 > > and dspam antispam plugin > dovecot-antispam-plugin-43880985e3dd That is quite an old revision. However, there were no significant changes since then. If you update to the latest revision you might need to revert 5e8351bcfb29, given your dovecot version. > and plugin configuration is given below: > > protocol imap { > mail_plugins = " antispam autocreate" > } > protocol pop3 { > mail_plugins = antispam autocreate > } I'm not sure this plugin could be used with POP3. > plugin { > antispam_allow_append_to_spam = YES > antispam_backend = dspam > antispam_crm_args = --config=/home/vmail This line isn't used for dspam backend. > antispam_dspam_args = --client;--user vmail "--user vmail" is treated like a single argument due to missing semicolon. That is definitely not what you want. Put it like "--client;--user;vmail". Also, you might consider adding these two: "--source=error;--signature=%%s". But I've never used dspam, so can't know for sure. > antispam_dspam_binary = /usr/bin/dspam > antispam_dspam_notspam = --class=innocent These are default, could be removed. > antispam_dspam_result_header = X-DSPAM-Result > antispam_dspam_spam = --class=spam This last line could also be removed because it's default. > antispam_mail_tmpdir = /tmp No such setting at all for this plugin. > antispam_signature = X-DSPAM-Signature > antispam_signature_missing = error Again, default. > antispam_spam = Spam > } > > dspam bin path: > > [root at sogo ~]# which dspam > /usr/bin/dspam > > but my dspam plugin > configuration is not working. and I am not getting any log from > dspam. My dspam server is working prefect. > > cna anyone help me Please fix antispam_dspam_args and let me know whether it works. -- Eugene Paskevich | *==)----------- | Plug me into eugene at raptor.kiev.ua | -----------(==* | The Matrix From ravi_kanchan2004 at yahoo.com Tue Apr 30 15:56:19 2013 From: ravi_kanchan2004 at yahoo.com (Ravi Kanchan) Date: Tue, 30 Apr 2013 20:56:19 +0800 (SGT) Subject: [Dovecot] dovecot antispam plugin is not woking In-Reply-To: References: <1367314604.74732.YahooMailNeo@web194001.mail.sg3.yahoo.com> Message-ID: <1367326579.27068.YahooMailNeo@web194002.mail.sg3.yahoo.com> Dear Eugene thank you for your valuable response I have changed the configuration as per your suggestion. plugin { ? antispam_backend = dspam ? antispam_crm_args = --config=/home/vmail ? antispam_dspam_args = --client;--user=vmail; --source=error;--signature=%%s ? antispam_dspam_binary = /usr/bin/dspamc ? antispam_signature = X-DSPAM-Signature } but in mail debug ouput it is displaying the following error and mail receive in inbox: Apr 30 18:29:18 sogo dovecot: imap(kanchan): Error: antispam plugin folders are not configured for this user ?can you give me hints whats I do in next step. Regard's Ravi Kanchan Sharma Sr. System Administrator Infinite Computer Solutions (I) Ltd. Bglr. Mo. 9997154666 ? ________________________________ From: Eugene Paskevich To: "dovecot at dovecot.org" ; Ravi Kanchan Sent: Tuesday, 30 April 2013 5:17 PM Subject: Re: [Dovecot] dovecot antispam plugin is not woking On Tue, 30 Apr 2013 12:36:44 +0300, Ravi Kanchan? wrote: > I am using dovecot? version 2.0.9 > DSPAM Anti-Spam Suite 3.10.2 (agent/library) > ClamAV 0.97.7/17102 > > and dspam antispam plugin >? dovecot-antispam-plugin-43880985e3dd That is quite an old revision. However, there were no significant changes since then. If you update to the latest revision you might need to revert 5e8351bcfb29, given your dovecot version. > and plugin configuration is given below: > > protocol imap { >? mail_plugins = " antispam autocreate" > } > protocol pop3 { >? mail_plugins = antispam autocreate > } I'm not sure this plugin could be used with POP3. > plugin { >? antispam_allow_append_to_spam = YES >? antispam_backend = dspam >? antispam_crm_args = --config=/home/vmail This line isn't used for dspam backend. >? antispam_dspam_args = --client;--user vmail "--user vmail" is treated like a single argument due to missing semicolon. That is definitely not what you want. Put it like "--client;--user;vmail". Also, you might consider adding these two:? "--source=error;--signature=%%s". But I've never used dspam, so can't know for sure. >? antispam_dspam_binary = /usr/bin/dspam >? antispam_dspam_notspam = --class=innocent These are default, could be removed. >? antispam_dspam_result_header = X-DSPAM-Result >? antispam_dspam_spam = --class=spam This last line could also be removed because it's default. >? antispam_mail_tmpdir = /tmp No such setting at all for this plugin. >? antispam_signature = X-DSPAM-Signature >? antispam_signature_missing = error Again, default. >? antispam_spam = Spam > } > > dspam bin path: > > [root at sogo ~]# which dspam > /usr/bin/dspam > > but my dspam plugin > configuration is not working. and I am not getting any log from > dspam. My dspam server is working prefect. > > cna anyone help me Please fix antispam_dspam_args and let me know whether it works. -- Eugene Paskevich? ? ? ? ? ? |? *==)-----------? |? ? Plug me into eugene at raptor.kiev.ua? ? ? ? |? -----------(==*? |? ? ? The Matrix From CMarcus at Media-Brokers.com Tue Apr 30 16:52:22 2013 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Tue, 30 Apr 2013 09:52:22 -0400 Subject: [Dovecot] Mail deduplication In-Reply-To: <517F5F12.9070505@um.es> References: <971614.566.1367285312578.JavaMail.root@timgws.com.au> <517F5F12.9070505@um.es> Message-ID: <517FCC96.3050105@Media-Brokers.com> On 2013-04-30 2:05 AM, Angel L. Mateo wrote: > El 30/04/13 03:28, Tim Groeneveld escribi?: >> I am wondering about mail deduplication. I am looking into the >> possibility >> of seperating out all of the message bodies with multiple parts >> inside mail >> that is recived from `dovecot` and hashing them all. >> >> The idea is that by hashing all of the parts inside the email, I will be >> able to ensure that each part of the email will only be saved once. >> >> This means that attachments & common parts of the body will only be >> saved once inside the storage. >> >> How achievable would this be with the current state of dovecot? Would it >> even be worth doing? >> > I asked the same question recently. As Timo responsed at > http://kevat.dovecot.org/list/dovecot/2013-March/089072.html it seems > that this feature is production stable in recent versions of dovecot. > > And I think it is worth. My estimations (with just about 10 users > of my organization, they are no accurate) is that you can save more > than 30% of total mail storage. > > To configure it you need to use options: > > * mail_attachment_dir > * mail_attachement_min_size > * mail_attachment_fs > * mail_attachment_hash This only dedupes attachments - which, in my opinion, is the only part of deduplicating email that is really worth it. Yes, you might be able to recapture a miniscule amount of storage space as a percentage of total mailstore size by deduping the other mime parts (headers, body, etc), but the complexity of doing this for each message part in my opinion overkill, way too error-prone for my comfort level, and just not enough bang for the buck. Deduping attachments on the other hand can have a dramatic impact (depending on your system usage and requirements), and is reliable enough to make it well worth it for some. I am expecting at least a 40-60% reduction in our storage when I implement this on my new server soon (will report back once it is completed). We use a lot of large attachments, and our idiot users save multiple copies, resending the same one sometimes many multiple times to different people (so, maybe 3 or sometimes even 10+ copies of the same 20MB attachment in their Sent folder). Anyway, thats my .02 -- Best regards, Charles From skdovecot at smail.inf.fh-brs.de Tue Apr 30 17:34:16 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 30 Apr 2013 16:34:16 +0200 (CEST) Subject: [Dovecot] Dovecot has no understandable configuration any more In-Reply-To: <70805cb6bdf07e7dcaae649b7ad0c594@decotrain.de> References: <70805cb6bdf07e7dcaae649b7ad0c594@decotrain.de> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 30 Apr 2013, forum wrote: > for many years i used an mailserver with dovecot V1 very satisfied! > http://mailserver.decotrain.de/ > One of the reasons to use dovecot was a simply configuration. > Dovecot was the best choice for IMAP for me! Hmm, there not many changes in how to configure Dovecot. > The documentation says *nothing* about my problem how to authenticate with > mysql! > http://wiki2.dovecot.org/VirtualUsers Funny, that the link had the answer. Did you configured Dovecot v1 differently then? The static userdb had not changed since v1. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUX/WaV3r2wJMiz2NAQK36Af9EjydgVte2ChWWV7sXc0UCiP0o+3VgcGG 89uMAWdimcuZRWAs5JyvSFuh1FSbXBm6LR0MSVIq60oGJtkpNeCb+YKaEgtz74vs KGEnJxyBfmrF3RxKyvjwWcfQ4nifzDLOCTLfEakQSXRhW2+8OuTfE9pzhOq2DwLP p4D8Q5Jc1wtidm65DkKp3UFBubAdmU+PTrRMmTNMkjENKiXM4h1HuklCJ0/HtERZ gfi8QXRXdTTi6tT5PQnC821IM/PUVLU+m4aCObztiu2Fgr982ruz7kCQjyaaLio7 1OZo2nbg3lRoAtFcTSCFqliDa+rFDxYA31xmfhppG203n0xOwhRxpw== =viiU -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Tue Apr 30 17:38:36 2013 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 30 Apr 2013 16:38:36 +0200 (CEST) Subject: [Dovecot] Dovecot has no understandable configuration any more In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 30 Apr 2013, forum wrote: > I can connect to dovecot locally with an webmailer. > But there is no listener process to be seen outside of the server? > > Locally this ports are working, but not outside: > > # netstat -tulpn | grep dove > tcp6 0 0 :::110 :::* LISTEN > 5741/dovecot > tcp6 0 0 :::143 :::* LISTEN > 5741/dovecot > tcp6 0 0 :::993 :::* LISTEN > 5741/dovecot > tcp6 0 0 :::995 :::* LISTEN > 5741/dovecot Where is: a) the listener on IPv4 b) the output of dovecot -n ? > Is this a configuration problem inside dovecot? That knows your doveconf -n output. > Apr 30 11:14:57 imap(xxxx at yyyy): Error: Broken file > /srv/mail/yyyy/xxxx/.INBOX.dir.09/dovecot-uidlist line 1: Broken header > (uidvalidity = 0, next_uid=697) > > How can i recover this? Does this error persists or do you see it just once per mailbox? > > Has someone an idea how to migrate the emails from charset ISO8859-1 to > UTF-8? The mailbody? recode Latin1..utf8 < in > out, but IMAP defines, that you cannot change messages inplace. The client need to redownload them. The directory name? Probably there is some tool. Otherwise: for dir in ...; do mv "$dir" "$(echo "$dir"| recode latin1..utf8)" done - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUX/XbV3r2wJMiz2NAQJLZQgAp/ty1I+h7lIBuUOM8+qKcSs8GjVTjrIX lrNEyJAh3FNL9ARlXqfGsu2bP+jOr/4nHde1H/9E215zBSzTk0XVXBr1xXSCMFv7 kWxkyUPug+YGOTkKipaaLIhwD0R5DcPx4F3oYXwLj5lybbzo8/sKrn1Hb4rW098W swJZT5QScHjCN9S9RfqAiaCghv1Nfl8pSAXWU0I2lj1B2mMFJjYrpr4HFvNPq3vQ a9Wdq4dXdeZmugBTSC8tQH2O3+WViLDWsbMdZSPnV6yuBPLoKwpXQxJnVOusY/HO 0iin4sypQrM703v9y/Cg6CVG7vyxBD3sUduZFhdSUlXO/aOYtktFgg== =2HR1 -----END PGP SIGNATURE----- From forum at decotrain.de Tue Apr 30 17:55:04 2013 From: forum at decotrain.de (forum) Date: Tue, 30 Apr 2013 16:55:04 +0200 Subject: [Dovecot] Dovecot has no understandable configuration any more In-Reply-To: References: <70805cb6bdf07e7dcaae649b7ad0c594@decotrain.de> Message-ID: Am 30.04.2013 16:34, schrieb Steffen Kaiser: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Tue, 30 Apr 2013, forum wrote: > >> for many years i used an mailserver with dovecot V1 very satisfied! >> http://mailserver.decotrain.de/ >> One of the reasons to use dovecot was a simply configuration. >> Dovecot was the best choice for IMAP for me! > > Hmm, there not many changes in how to configure Dovecot. Oh - there are quiet more possibilities and the syntax slightly has changed. > >> The documentation says *nothing* about my problem how to authenticate >> with mysql! >> http://wiki2.dovecot.org/VirtualUsers > > Funny, that the link had the answer. > Did you configured Dovecot v1 differently then? The problem is to understand the dependencies. > The static userdb had not changed since v1. Then the old configuration should work. But it does not. Now i have found the solution. It seems to help to ask you. ;) The solution was to change from listen = [::] to listen = *, [::] There is no explanation for it - just try and error ... >> I can connect to dovecot locally with an webmailer. >> But there is no listener process to be seen outside of the server? >> >> Locally this ports are working, but not outside: >> >> # netstat -tulpn | grep dove >> tcp6 0 0 :::110 :::* >> LISTEN 5741/dovecot >> tcp6 0 0 :::143 :::* >> LISTEN 5741/dovecot >> tcp6 0 0 :::993 :::* >> LISTEN 5741/dovecot >> tcp6 0 0 :::995 :::* >> LISTEN 5741/dovecot > > Where is: > > a) the listener on IPv4 PC in LAN. > > b) the output of dovecot -n ? > >> Is this a configuration problem inside dovecot? > > That knows your doveconf -n output. The output seems only to be the configuration that was read. I lost many hours just to find out that i have to define e.g. service imap-login { Before there was no error, dovecot running and no ports listening. Sorry - that's foolish. > >> Apr 30 11:14:57 imap(xxxx at yyyy): Error: Broken file >> /srv/mail/yyyy/xxxx/.INBOX.dir.09/dovecot-uidlist line 1: Broken >> header (uidvalidity = 0, next_uid=697) >> >> How can i recover this? > > Does this error persists or do you see it just once per mailbox? Seems only onetime. So no problem. >> >> Has someone an idea how to migrate the emails from charset ISO8859-1 >> to UTF-8? > > The mailbody? recode Latin1..utf8 < in > out, but IMAP defines, that > you cannot change messages inplace. The client need to redownload > them. The client should left the message on the server with no local copy. > > The directory name? Probably there is some tool. Otherwise: > > for dir in ...; do > mv "$dir" "$(echo "$dir"| recode latin1..utf8)" > done That's an good idea. I will try this. > > - -- Steffen Kaiser Thank you! Karsten From gregs at sloop.net Tue Apr 30 18:04:25 2013 From: gregs at sloop.net (Gregory Sloop) Date: Tue, 30 Apr 2013 08:04:25 -0700 Subject: [Dovecot] Dovecot vs MBox Message-ID: <51672429.20130430080425@sloop.net> I'm still in the "what's wrong" stage of figuring out what's going on. But I've got a mail user who isn't getting new messages. Postfix accepts it and drops it in the users mbox. [This is verified. If I tail the Mbox, I can see the new messages.] "Mail" will see the messages too. But dovecot doesn't seem to know they exist. I don't think the MBox is corrupt, as I've tossed the first few messages in hopes that it would then read the rest, but no luck. Any ideas where to look next, what I might do to force dovecot to forget message ID's etc - that might force it to read the whole mailbox file again? [Or a pointer as to where it might be most productive to poke next?] TIA -Greg -- Gregory Sloop, Principal: Sloop Network & Computer Consulting 503.251.0452 x121 Voice | 503.251.0452 Fax www.sloop.net mailto:gregs at sloop.net From eugene at raptor.kiev.ua Tue Apr 30 18:14:46 2013 From: eugene at raptor.kiev.ua (Eugene Paskevich) Date: Tue, 30 Apr 2013 18:14:46 +0300 Subject: [Dovecot] dovecot antispam plugin is not woking In-Reply-To: <1367326579.27068.YahooMailNeo@web194002.mail.sg3.yahoo.com> References: <1367314604.74732.YahooMailNeo@web194001.mail.sg3.yahoo.com> <1367326579.27068.YahooMailNeo@web194002.mail.sg3.yahoo.com> Message-ID: On Tue, 30 Apr 2013 15:56:19 +0300, Ravi Kanchan wrote: > thank you for your valuable response > > > I have changed the configuration as per your suggestion. Try putting it this way: plugin { antispam_spam = Spam antispam_allow_append_to_spam = YES antispam_backend = dspam antispam_dspam_args = --client;--user;vmail;--source=error;--signature=%%s antispam_dspam_result_header = X-DSPAM-Result antispam_signature = X-DSPAM-Signature } -- Eugene Paskevich | *==)----------- | Plug me into eugene at raptor.kiev.ua | -----------(==* | The Matrix From eugene at raptor.kiev.ua Tue Apr 30 18:31:28 2013 From: eugene at raptor.kiev.ua (Eugene Paskevich) Date: Tue, 30 Apr 2013 18:31:28 +0300 Subject: [Dovecot] Antispam r49 breaks Dovecot v2.1 In-Reply-To: References: Message-ID: On Thu, 20 Dec 2012 12:58:23 +0200, Steffen Kaiser wrote: > patch 49 breaks compilation with Dovecot v2.1. Fixed in 5ebc6aae4d7c. -- Eugene Paskevich | *==)----------- | Plug me into eugene at raptor.kiev.ua | -----------(==* | The Matrix From timberline97 at gmail.com Tue Apr 30 19:06:53 2013 From: timberline97 at gmail.com (Kevin Bridges) Date: Tue, 30 Apr 2013 11:06:53 -0500 Subject: [Dovecot] NTLM authentication with Outlook 2010 Message-ID: All, I have a Ubuntu 12.04.2 box running Dovecot 2.0.19. I have it configured for our active directory. WBinfo and ntlm_auth work great. I am trying to get sso to work with ntlm. Gssapi with thunderbird works like it should. I just cant get ntlm with outlook 2010 to work for sso. I get prompted for my password each time I open outlook. I have attached my config for dovecot. Any help would be much appreciated. # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-39-virtual x86_64 Ubuntu 12.04.2 LTS auth_debug = yes auth_debug_passwords = yes auth_mechanisms = gssapi ntlm auth_use_winbind = yes auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot_debug.log log_path = /var/log/dovecot.log mail_location = mdbox:~/mdbox passdb { driver = pam } plugin { quota_rule = *:storage=2G quota_warning = storage=95%% quota-warning 95 %u } protocols = " imap" service auth-worker { user = root } service auth { user = root } ssl_cert = References: <51672429.20130430080425@sloop.net> Message-ID: <20130430180726.GC8773@queeg.we-be-smart.org> On Tuesday, April 30 at 08:04 AM, quoth Gregory Sloop: > Any ideas where to look next, what I might do to force dovecot to > forget message ID's etc - that might force it to read the whole > mailbox file again? Find the dovecot.index files for that mbox and delete them. They will be re-generated from the contents of the mbox. ~Kyle -- If man was meant to be nude, he would have been born that way. -- Oscar Wilde -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 842 bytes Desc: not available URL: