- dovecot - dovecot.org

Re: [Dovecot] XFS vs EXT4 for mail storage
by Reindl Harald 02 May '13

02 May '13

Am 02.05.2013 17:31, schrieb Charles Marcus: > On 2013-05-02 10:45 AM, Reindl Harald <h.reindl(a)thelounge.net> wrote: >> "man mount" is very generic and doe snot cover any option >> there is also no "man mount.ntfs" while "mount.ntfs" command exists > > ? > > man mount, at least mine, shows first the FILESYSTEM INDEPENDENT MOUNT OPTIONS, then as you scroll down, you'll get > to all of the additional filesystem specific options, ie, for xfs... > > So, not sure what you mean by 'does not cover any option'... typo - meant "does not cover ALL options" someone has to write the manpages, there are millions of options all over the software-world which did it not make into manpages google for "xfs delaylog" leads to http://xfs.org/index.php/XFS_FAQ http://xfs.org/index.php/XFS_FAQ#Q:_I_want_to_tune_my_XFS_filesystems_for_.… For mount options, the only thing that will change metadata performance considerably are the logbsize and delaylog mount options so how can it be redhat-specific if it is mentioned upstream?

1 0

[Dovecot] NTLM authentication with Outlook 2010
by Kevin Bridges 01 May '13

01 May '13

All, I have a Ubuntu 12.04.2 box running Dovecot 2.0.19. I have it configured for our active directory. WBinfo and ntlm_auth work great. I am trying to get sso to work with ntlm. Gssapi with thunderbird works like it should. I just cant get ntlm with outlook 2010 to work for sso. I get prompted for my password each time I open outlook. I have attached my config for dovecot. Any help would be much appreciated. # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-39-virtual x86_64 Ubuntu 12.04.2 LTS auth_debug = yes auth_debug_passwords = yes auth_mechanisms = gssapi ntlm auth_use_winbind = yes auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot_debug.log log_path = /var/log/dovecot.log mail_location = mdbox:~/mdbox passdb { driver = pam } plugin { quota_rule = *:storage=2G quota_warning = storage=95%% quota-warning 95 %u } protocols = " imap" service auth-worker { user = root } service auth { user = root } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } protocol imap { mail_plugins = " quota imap_quota" }

2 2

[Dovecot] Antispam r49 breaks Dovecot v2.1
by Steffen Kaiser 30 Apr '13

30 Apr '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Dear Eugene, patch 49 breaks compilation with Dovecot v2.1. Attached patch encloses the change in a #if. To feed the #if the actual Dovecot version, I've introduced an extra variable in extra.mk, but I cannot help with making the GNU configure stuff doing it right away. There will be numerous other ways to get the Dovecot version into the source ... . Maybe, Timo would add a binary version of the Dovecot version in its config.h ? In order to be able to built version-aware plugins. Regards, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUNLvT2oxLS8a3A9mAQIzfwgAvf7zcN9RwKD/kTmFkfx5djKd5H0dRXt8 423csD3bCU6qcOtR2MHR0ApNp07aXK84MPgIazbne41Iekqk0daoOhnPoc0mHy8u kj9EYFGVlQTKa2vcSUEu8Phddc/YHvzQba9m2Dg9P4STuJ6EcRqkhvufspERGphF Y+IY20BQc9/Flu8TIxtt6pSiIioq0WWntCGnyPP9BX90JYYO+5zAm5FnG4GH4Q0Z 44dZSKM7iP0/nMhmsraX/5alxy0mvx3ZfhO/Ktx/wd92WmLROAlicBClIZC9XCH2 6HD/ryr73DrEeEZdmwHcnmZrtWc++EJcAetfv45Fov8XagUtFJ0D4A== =G+d/ -----END PGP SIGNATURE-----

2 1

[Dovecot] Dovecot has no understandable configuration any more
by forum 30 Apr '13

30 Apr '13

Hello, my last problem could be solved now with userdb { driver = static args = uid=mail gid=mail home=/srv/mail/%d/%n } I can connect to dovecot locally with an webmailer. But there is no listener process to be seen outside of the server? Locally this ports are working, but not outside: # netstat -tulpn | grep dove tcp6 0 0 :::110 :::* LISTEN 5741/dovecot tcp6 0 0 :::143 :::* LISTEN 5741/dovecot tcp6 0 0 :::993 :::* LISTEN 5741/dovecot tcp6 0 0 :::995 :::* LISTEN 5741/dovecot Is this a configuration problem inside dovecot? Another problem is the migration from the existant emails from V1 to V2: In the log i can find: Apr 30 11:14:57 imap(xxxx@yyyy): Error: Broken file /srv/mail/yyyy/xxxx/.INBOX.dir.09/dovecot-uidlist line 1: Broken header (uidvalidity = 0, next_uid=697) How can i recover this? Delete all the index files? Has someone an idea how to migrate the emails from charset ISO8859-1 to UTF-8? Best regards Karsten

2 1

[Dovecot] Dovecot Antispam Plugin is not working
by Ravi Kanchan 30 Apr '13

30 Apr '13

Hi All, I am using dovecot version 2.0.9 DSPAM Anti-Spam Suite 3.10.2 (agent/library) ClamAV 0.97.7/17102 and dspam antispam plugin dovecot-antispam-plugin-43880985e3dd and plugin configuration is given below: protocol imap { mail_plugins = " antispam autocreate" } protocol pop3 { mail_plugins = antispam autocreate } plugin { antispam_allow_append_to_spam = YES antispam_backend = dspam antispam_crm_args = --config=/home/vmail antispam_dspam_args = --client;--user vmail antispam_dspam_binary = /usr/bin/dspam antispam_dspam_notspam = --class=innocent antispam_dspam_result_header = X-DSPAM-Result antispam_dspam_spam = --class=spam antispam_mail_tmpdir = /tmp antispam_signature = X-DSPAM-Signature antispam_signature_missing = error antispam_spam = Spam } dspam bin path: [root@sogo ~]# which dspam /usr/bin/dspam and dspam.conf has attached with this mail. but my dspam plugin configuration is not working. and also I am not getting any log from dspam. My dspam server is working prefect. but I guess plugin is not working properly can anyone helpme. and my configuration for this is following:Regard's Ravi Kanchan Sharma Sr. System Administrator Infinite Computer Solutions (I) Ltd. Bglr. Mo. 9997154666

1 0

[Dovecot] help with LMTP setup
by jeep＠rahul.net 30 Apr '13

30 Apr '13

Im trying to convert my dovecot-lda setup to use LMTP for better security. My setup is postfix + dovecot + mysql with virtual users. Im setting up dovecot 2.2.1 w/postfix 2.10.0 Im still learning dovecot so Im not totally sure where Im going wrong. Can someone point out why Im getting permission problems? Im also concerned with server security, so if you notice anything that should be better, please point that out. I am the only user on this Linux box. Thank you! ls -l /opt/imapdata/j/jeff/INBOX total 8 drwxr-xr-x 2 vmail vmail 4096 Apr 27 14:21 ./ drwxr-xr-x 3 vmail vmail 4096 Apr 27 14:21 ../ Dovecot is running with the following users: root 20847 0.0 0.0 15572 1108 ? Ss 10:23 0:00 /opt/optdovecot/sbin/dovecot dovenull 20848 0.0 0.0 46752 2724 ? S 10:23 0:00 dovecot/imap-login dovenull 20849 0.0 0.0 46752 2720 ? S 10:23 0:00 dovecot/imap-login vmail 20850 0.0 0.0 13408 1068 ? S 10:23 0:00 dovecot/anvil root 20851 0.0 0.0 13540 1192 ? S 10:23 0:00 dovecot/log root 20853 0.0 0.0 16504 2128 ? S 10:23 0:00 dovecot/config vmail 20854 0.0 0.0 136448 2972 ? S 10:23 0:00 dovecot/auth Im getting the following when an email comes in: Apr 29 10:11:57 fed8 postfix/virtual[20666]: D88F3DF3BD: to=<jeff(a)mydomain.com>, relay=virtual, delay=370, delays=370/0.03/0/0.07, dsn=4.2.0, status=deferred (delivery failed to mailbox ///opt/imapdata/j/jeff/INBOX/inbox: unable to create lock file ///opt/imapdata/j/jeff/INBOX/inbox.lock: Permission denied) my postfix/master.cf entry: dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/opt/dovecot/libexec/dovecot/lmtp -f ${sender} -d ${recipient} doveconf -n: # 2.2.1: /opt/dovecot221/etc/dovecot/dovecot.conf # OS: Linux 3.8.5-201.fc18.x86_64 x86_64 Fedora release 18 (Spherical Cow) auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain default_internal_user = vmail first_valid_gid = 2000 first_valid_uid = 2000 listen = * lock_method = flock login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_debug = yes mail_gid = vmail mail_privileged_group = vmail mail_uid = vmail mbox_lock_timeout = 1 mins mbox_write_locks = fcntl passdb { args = /opt/dovecot/etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size } postmaster_address = jeff(a)otherdomain.com protocols = imap lmtp sendmail_path = /usr/lib/sendmail service auth { inet_listener { port = 12345 } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0660 user = vmail } user = $default_internal_user } service imap-login { inet_listener imaps { port = 993 ssl = yes } process_min_avail = 2 service_count = 1 vsz_limit = 64 M } service lmtp { executable = lmtp -L inet_listener lmtp { address = 192.168.1.22 127.0.0.1 port = 24 } unix_listener lmtp { mode = 0666 } user = vmail } ssl = required ssl_cert = </opt/dovecot/etc/dovecot/conf.d/ssl/certs/dovecot.pem ssl_cipher_list = ALL:!LOW:!MEDIUM:!SSLv1:!SSLv2:!MD5:!SSL1:!SSL2:!EXP-ADH-DES-CBC-SHA:!EXP-EDH-RSA-DES-CBC-SHA:!EXP-DES-CBC-SHA:!EXP-EDH-RSA-DES-CBC-SHA:!EXP-ADH-DES-CBC-SHA:!EXP-DES-CBC-SHA:!ADH-AES256-SHA:!ADH-AES128-SHA:!ADH-DES-CBC3-SHA:!EXP-ADH-DES-CBC-SHA:!EXP-ADH-DES-CBC-SHA:!ADH-DES-CBC3-SHA:TLSv1 ssl_key = </opt/dovecot/etc/dovecot/conf.d/ssl/private/dovecot.pem userdb { args = uid=vmail gid=vmail home=/opt/imapdata/%1n/%n driver = static } userdb { args = /opt/dovecot/etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } userdb { args = /opt/dovecot/etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } verbose_ssl = yes protocol lmtp { info_log_path = /var/log/dovelmtp.log mail_plugins = " sieve" } protocol lda { info_log_path = /var/log/doveinfo.log log_path = /var/log/dovelda.log } protocol imap { imap_idle_notify_interval = 1 mins imap_max_line_length = 64 k mail_max_userip_connections = 5 } /mf/home/jeep/shell/.signature

2 4

[Dovecot] last login timestamp
by Oscar A. Jara 30 Apr '13

30 Apr '13

Hello, I am settiing up a dovecot (imap, pop, sieve, lda) + openldap infrastructure. I need to store the timestamp of the last login of each user in an attribute of its corresponding ldap object. I could not find a way of doing this through configuration options so I am thinking of coding this task into the dovecot-auth source code, maybe in the passdb-ldap.c file. What do you recomend about this? Thanks. __________ Information from ESET Mail Security, version of virus signature database 8278 (20130429) __________ The message was checked by ESET Mail Security. http://www.eset.com

6 9

[Dovecot] mailbox_list_index_parse_header crash
by Kyle Wheeler 29 Apr '13

29 Apr '13

Hi, I got all excited about IMAP NOTIFY support and tried enabling mailbox_list_index on my server. Unfortunately, I rather quickly ran into trouble of the segfault variety. This prevented me from doing basic things like seeing the contents of some of my folders. Disabling mailbox_list_index got me back up and running, but... darnit, that's annoying. The only message I got in my log file was this: imap(user@domain): Fatal: master: service(imap): child 6899 killed with signal 11 (core dumped) If I can help track this down, please let me know. Here's the backtrace: #0 hash_table_insert_node (table=0x10eff60, key=0x103, value=0x10fd8b0, check_existing=<value optimized out>) at hash.c:268 node = 0x69616d2d746e6573 prev = 0x10fbee0 hash = <value optimized out> __FUNCTION__ = "hash_table_insert_node" #1 0x00007fad738a11be in hash_table_insert (table=0x10eff60, key=0x1, value=0x101) at hash.c:285 node = 0x0 #2 0x00007fad73b81e68 in mailbox_list_index_parse_header (list=<value optimized out>, view=0x11095f0, force=<value optimized out>) at mailbox-list-index.c:196 data = 0x10f5f30 i = 4980 len = 1 size = 8192 id = 1 #3 mailbox_list_index_parse (list=<value optimized out>, view=0x11095f0, force=<value optimized out>) at mailbox-list-index.c:317 ilist = 0x10edc80 hdr = <value optimized out> error = 0x10f5820 "`▒\016\001" __FUNCTION__ = "mailbox_list_index_parse" #4 0x00007fad73b86b03 in mailbox_list_index_sync_begin (list=0x10ed890, sync_ctx_r=0x7fff2ad61ee0) at mailbox-list-index-sync.c:247 ilist = 0x10edc80 sync_ctx = <value optimized out> index_sync_ctx = <value optimized out> view = 0x11095f0 trans = <value optimized out> hdr = <value optimized out> #5 0x00007fad73b86ffb in mailbox_list_index_sync (list=0x10eff60) at mailbox-list-index-sync.c:382 sync_ctx = 0x1107300 ret = <value optimized out> #6 0x00007fad73b8233f in mailbox_list_index_refresh (list=0x10ed890) at mailbox-list-index.c:376 ilist = 0x10edc80 view = 0x1107300 ret = <value optimized out> #7 0x00007fad73b85e19 in index_list_update_mailbox (box=0x10f40a0) at mailbox-list-index-status.c:363 list_sync_ctx = 0x1107140 list_view = <value optimized out> list_trans = <value optimized out> changes = {status = {messages = 718675880, recent = 32767, unseen = 4294967295, uidvalidity = 0, uidnext = 68, first_unseen_seq = 0, first_recent_uid = 1, last_cached_seq = 0, highest_modseq = 3176264, highest_pvt_modseq = 17854784, keywords = 0x10f40a0, permanent_flags = 17778368, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, have_guids = 0}, guid = "p ▒*▒\177\000\000D\000\000\000\000\000\000", seq = 17750944, rec_changed = false, msgs_changed = false, hmodseq_changed = false} __FUNCTION__ = "index_list_update_mailbox" #8 0x00007fad73b86089 in index_list_sync_deinit (ctx=0x1107140, status_r=0x7fff2ad62070) at mailbox-list-index-status.c:470 box = 0x10f40a0 #9 0x00007fad73b70f4a in mailbox_sync_deinit (_ctx=0x0, status_r=0x1) at mail-storage.c:1655 ctx = 0x10eff60 box = 0x10f40a0 errormsg = <value optimized out> error = <value optimized out> ret = <value optimized out> #10 0x00007fad73b7100b in mailbox_sync (box=<value optimized out>, flags=<value optimized out>) at mail-storage.c:1681 ctx = 0x0 status = {sync_delayed_expunges = 0} #11 0x00007fad73b9af72 in index_storage_get_status (box=0x10f40a0, items=17, status_r=<value optimized out>) at index-status.c:39 No locals. #12 0x00007fad72cabde4 in fts_mailbox_get_status (box=0x10f40a0, items=17, status_r=0x7fff2ad621b0) at fts-storage.c:86 seq = <value optimized out> #13 0x00007fad73b864e6 in index_list_get_status (box=0x10f40a0, items=17, status_r=0x7fff2ad621b0) at mailbox-list-index-status.c:162 No locals. #14 0x000000000041c8da in imap_status_get (cmd=0x10f1880, ns=0x10e8b00, mailbox=0x10cc2c8 "Flight.RV", items=0x7fff2ad62240, result_r=0x7fff2ad621b0) at imap-status.c:84 client = 0x10f0ce0 box = 0x10f40a0 errstr = <value optimized out> ret = <value optimized out> #15 0x000000000041219d in cmd_status (cmd=0x10f1880) at cmd-status.c:40 client = 0x10f0ce0 args = 0x10d7a38 list_args = 0x10d7be0 items = {status = 17, metadata = 0} result = {status = {messages = 0, recent = 0, unseen = 0, uidvalidity = 0, uidnext = 0, first_unseen_seq = 0, first_recent_uid = 0, last_cached_seq = 0, highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, have_guids = 1}, metadata = {guid = "PY\r\001", '\000' <repeats 11 times>, virtual_size = 17651520, cache_fields = 0x7fad73836e40, precache_fields = 1934521552, backend_ns_prefix = 0x7fad74012000 "", backend_ns_type = 1080}, error = 4294967295, errstr = 0xffffffffffffffa8 <Address 0xffffffffffffffa8 out of bounds>} ns = <value optimized out> mailbox = 0x10cc2c8 "Flight.RV" orig_mailbox = 0x10d7b98 "Flight.RV" #16 0x00000000004160ad in command_exec (cmd=0x10f1880) at imap-commands.c:156 hook = 0x10d5d90 ret = <value optimized out> #17 0x0000000000415200 in client_command_input (cmd=0x10f1880) at imap-client.c:775 client = 0x10f0ce0 command = <value optimized out> __FUNCTION__ = "client_command_input" #18 0x00000000004152ed in client_command_input (cmd=0x10f1880) at imap-client.c:836 client = 0x10f0ce0 command = 0x0 __FUNCTION__ = "client_command_input" #19 0x000000000041556d in client_handle_next_command (client=0x10f0ce0) at imap-client.c:874 No locals. #20 client_handle_input (client=0x10f0ce0) at imap-client.c:886 _data_stack_cur_id = 3 ret = 208 remove_io = <value optimized out> handled_commands = false __FUNCTION__ = "client_handle_input" #21 0x00000000004158ef in client_input (client=0x10f0ce0) at imap-client.c:928 cmd = <value optimized out> output = 0x10f16d8 bytes = <value optimized out> __FUNCTION__ = "client_input" #22 0x00007fad738abdf6 in io_loop_call_io (io=0x10f1780) at ioloop.c:387 ioloop = 0x10d4720 t_id = 2 #23 0x00007fad738ace6f in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:215 ctx = 0x10d4aa0 event = 0x10d4b10 list = 0x10f17d0 io = 0x10eff60 tv = {tv_sec = 1799, tv_usec = 999580} msecs = <value optimized out> ret = 1 i = 0 call = false __FUNCTION__ = "io_loop_handler_run" #24 0x00007fad738abd98 in io_loop_run (ioloop=0x10d4720) at ioloop.c:406 No locals. #25 0x00007fad738621b3 in master_service_run (service=0x10d45b0, callback=0x1) at master-service.c:560 No locals. #26 0x000000000041eb67 in main (argc=1, argv=0x10d4390) at main.c:400 set_roots = {0x426200, 0x0} login_set = {auth_socket_path = 0x10cc050 "(", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x41ed60 <login_client_connected>, failure_callback = 0x41ed00 <login_client_failed>, request_auth_token = 1} service_flags = <value optimized out> storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = <value optimized out> ~Kyle -- For every complex problem, there is a solution that is simple, neat, and wrong. -- H. L. Mencken

2 4

[Dovecot] Dovecot 2.1.16 doveadm purge -A segfault
by Daniel Parthey 29 Apr '13

29 Apr '13

Hi, I know that a lot of work has been done regarding doveadm server, but I'm still experiencing easily reproducible segfault crashes of doveadm-server with 2.1.16 when running the following command in a 4 node director/mailbox cluster: /usr/bin/doveadm -c /etc/dovecot-director/dovecot-director.conf -D purge -A The dovecot-error.log shows the following errors (addresses anonymized): Apr 29 15:45:14 10.129.3.233 dovecot: doveadm: Error: purge: invalid option -- '' Apr 29 15:45:14 10.129.3.233 dovecot: doveadm(x.xxxxxx(a)xxx-xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.233 dovecot: doveadm: Error: purge: invalid option -- '�' Apr 29 15:45:14 10.129.3.233 dovecot: doveadm(x.xxxxxx(a)xxx-xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.249 dovecot: doveadm: Error: purge: invalid option -- '�' Apr 29 15:45:14 10.129.3.249 dovecot: doveadm(x.xxxxxx(a)xxx-xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.249 dovecot: doveadm: Error: purge: invalid option -- 'r' Apr 29 15:45:14 10.129.3.249 dovecot: doveadm(x.xxxxxx(a)xxx-xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.213 dovecot: doveadm: Error: purge: invalid option -- 'e' Apr 29 15:45:14 10.129.3.213 dovecot: doveadm(xxxxx(a)xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.213 dovecot: doveadm: Error: purge: invalid option -- 'g' Apr 29 15:45:14 10.129.3.213 dovecot: doveadm(xxxxx(a)xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.213 dovecot: doveadm: Error: purge: invalid option -- 'e' Apr 29 15:45:14 10.129.3.213 dovecot: doveadm(xxxxx(a)xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.213 dovecot: doveadm: Error: purge: invalid option -- '-' Apr 29 15:45:14 10.129.3.213 dovecot: doveadm(xxxxx(a)xxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.249 dovecot: doveadm: Error: purge: invalid option -- '' Apr 29 15:45:14 10.129.3.249 dovecot: doveadm(xxxxxxxxxx(a)xxxxxxxxxx.xx): Error: doveadm purge: Client sent unknown parameter: ? Apr 29 15:45:14 10.129.3.213 dovecot: doveadm(xxxxx(a)xxxxxx.xx): Fatal: master: service(doveadm): child 6316 killed with signal 11 (core dumped) There seems to something wrong with the doveadm command parser: # gdb /usr/lib/dovecot/doveadm-server /var/tmp/6316 (gdb) bt full #0 0x00007f52f0dc7cca in ?? () from /lib/libc.so.6 No symbol table info available. #1 0x00007f52f0dc8dab in ?? () from /lib/libc.so.6 No symbol table info available. #2 0x00007f52f0dc8e18 in getopt () from /lib/libc.so.6 No symbol table info available. #3 0x00000000004138ce in doveadm_mail_cmd_server_parse (conn=0xe09ad0) at client-connection.c:69 getopt_args = 0xdfa6b8 "AS:u:" c = <value optimized out> cmd = 0xe062c8 add_username_header = false #4 client_handle_command (conn=0xe09ad0) at client-connection.c:223 ctx = 0xe0dae0 flags = <value optimized out> cmd_name = <value optimized out> input = {module = 0x0, service = 0x4210f0 "doveadm", username = 0xdfa59a "xxxxxxx(a)xxxxxxxx.xx", session_id = 0x0, local_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = 0, flags_override_remove = 0, no_userdb_lookup = 0} argc = <value optimized out> #5 client_connection_input (conn=0xe09ad0) at client-connection.c:326 args = <value optimized out> _data_stack_cur_id = 3 line = <value optimized out> ok = <value optimized out> #6 0x00007f52f10e6166 in io_loop_call_io (io=0xe097e0) at ioloop.c:379 ioloop = 0xe026a0 t_id = 2 #7 0x00007f52f10e71ef in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:213 ctx = 0xe054f0 event = 0xe05560 list = 0xe09950 io = 0xdfa5c8 tv = {tv_sec = 2147483, tv_usec = 0} msecs = <value optimized out> ret = <value optimized out> i = 0 call = false #8 0x00007f52f10e6108 in io_loop_run (ioloop=0xe026a0) at ioloop.c:398 No locals. #9 0x00007f52f10d15a3 in master_service_run (service=0xe02550, callback=0) at master-service.c:544 No locals. #10 0x0000000000414111 in main (argc=1, argv=0xe02370) at main.c:90 set_roots = {0x422780, 0x0} error = 0x0 Regards Daniel -- https://plus.google.com/103021802792276734820

1 0

[Dovecot] Dovecot Solr Panic
by Andre Rodier 29 Apr '13

29 Apr '13

Hello Everyone, I have a small base of users (30), but a lot of emails. I have an error again when I am indexing a virtual folder with a large number of folders. I appreciate this is a special case, but I am using dovecot and solr as it is, according to the documentation, the favourite way. One user is using a large number of archives sub folders, by years, months and subfolders, since 5 years. I am convincing this user to give up this organisation, but in the mean time, I hope to solve this problem. The virtual folder, called Archives, references all the sub folders in the Archive folder. There is about 380 folders, and worst of all, 55k characters with their names concatenated. On solr, I have increased the value of headerBufferSize to a huge value, but I have still this error. Anyway, this is the error I have when I try to index this virtual folder: ---8<--------------------------------------------------------------------------------------------------------------------------------------- root@lapetus:/mnt/emails/indiefield.co.uk/jsmith/Mails/Virtual# doveadm -v index -u 'john smith' 'Search/Archives' doveadm(john smith): Info: Search/Archives: Caching mails seq=109580..127362 1800/17783doveadm(john smith): Panic: file solr-connection.c: line 416 (solr_connection_select): assertion failed: (!conn->posting) doveadm(john smith): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4414a) [0x7fcb7b5b014a] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7fcb7b5b020a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fcb7b58782a] -> /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(+0x754a) [0x7fcb790fa54a] -> /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(+0x4037) [0x7fcb790f7037] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_backend_get_last_uid+0x5a) [0x7fcb79b2f66a] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xc1fd) [0x7fcb79b341fd] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xc689) [0x7fcb79b34689] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xc51e) [0x7fcb79b3451e] -> doveadm(+0x16719) [0x7fcb7bf71719] -> doveadm(+0x13346) [0x7fcb7bf6e346] -> doveadm(+0x13e21) [0x7fcb7bf6ee21] -> doveadm(doveadm_mail_try_run+0x161) [0x7fcb7bf6f2e1] -> doveadm(main+0x3d1) [0x7fcb7bf6def1] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7fcb7b200ead] -> doveadm(+0x13125) [0x7fcb7bf6e125] Aborted ---8<--------------------------------------------------------------------------------------------------------------------------------------- On the solr side: ---8<--------------------------------------------------------------------------------------------------------------------------------------- 28-Apr-2013 17:13:33 org.apache.solr.update.processor.LogUpdateProcessor finish INFO: {add=[1/70af772eafc17c51fb350000812a8a77/john smith(a)indiefield.co.uk, 2/70af772eafc17c51fb350000812a8a77/john smith(a)indiefield.co.uk, 3/70af772eafc17c51fb350000812a8a 77/john smith(a)indiefield.co.uk, 4/70af772eafc17c51fb350000812a8a77/john smith(a)indiefield.co.uk, 5/70af772eafc17c51fb350000812a8a77/john smith(a)indiefield.co.uk, 6/70af772ea fc17c51fb350000812a8a77/john smith(a)indiefield.co.uk, 7/70af772eafc17c51fb350000812a8a77/john smith(a)indiefield.co.uk, 8/70af772eafc17c51fb350000812a8a77/john smith@indiefie ld.co.uk, ... (8 added)]} 0 19141 28-Apr-2013 17:13:33 org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: ParseError at [row,col]:[1188418,131] Message: Premature end of file. at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:72) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:54) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1317) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:338) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:241) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:388) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418) at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:943) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:843) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Caused by: javax.xml.stream.XMLStreamException: ParseError at [row,col]:[1188418,131] Message: Premature end of file. at com.sun.org.apache.xerces.internal.impl.XMLStreamReaderImpl.next(XMLStreamReaderImpl.java:592) at org.apache.solr.handler.XMLLoader.readDoc(XMLLoader.java:273) at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:138) at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:69) ... 22 more ---8<--------------------------------------------------------------------------------------------------------------------------------------- Kind regards, Andre Rodier

3 3