[Dovecot] Problem when indexing maildir with a large number of folders
Hello everybody,
As part of a migration from exchange 2003 to dovecot, I have converted a lot of PST files for a user. I am importing his PST files in a maildir folder called 'Archives'. Actually, I reached about 770 'Archives' folders, and the total length of their names is about 59k characters. Thanks to wc!
I am using Maildir++
I can run the doveadm index command on the private namespace, however, I am not able to do this on the virtual folders.
Here the error I have:
doveadm(john smith): Panic: file mail-index-transaction-update.c: line 875 (mail_index_update_header_ext): assertion failed: (offset <= (uint16_t)-1 && size <= (uint16_t)-1 && offset + size <= (uint16_t)-1) doveadm(gareth walters): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4414a) [0x7f9b7100714a] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f9b7100720a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f9b70fde82a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xb8079) [0x7f9b7130a079] -> /usr/lib/dovecot/modules/lib20_virtual_plugin.so(virtual_storage_sync_init+0x788) [0x7f9b6f1775a8] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x33) [0x7f9b712cf3e3] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x27) [0x7f9b712cf507] -> doveadm(+0x16618) [0x7f9b719c8618] -> doveadm(+0x13346) [0x7f9b719c5346] -> doveadm(+0x13e21) [0x7f9b719c5e21] -> doveadm(doveadm_mail_try_run+0x161) [0x7f9b719c62e1] -> doveadm(main+0x3d1) [0x7f9b719c4ef1] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f9b70c57ead] -> doveadm(+0x13125) [0x7f9b719c5125] Aborted
I can see I have reached a limit, but is there any configuration value I can use to increase this limit, please?
Kind regards, André.
Hello again,
I am sorry to be a pain, but is there any chance someone knows this problem, and how I can fix this, please?
Kind regards, André On Tuesday, 26.03.13 at 23:20, Andre Rodier wrote:
Hello everybody,
As part of a migration from exchange 2003 to dovecot, I have converted a lot of PST files for a user. I am importing his PST files in a maildir folder called 'Archives'. Actually, I reached about 770 'Archives' folders, and the total length of their names is about 59k characters. Thanks to wc!
I am using Maildir++
I can run the doveadm index command on the private namespace, however, I am not able to do this on the virtual folders.
Here the error I have:
doveadm(john smith): Panic: file mail-index-transaction-update.c: line 875 (mail_index_update_header_ext): assertion failed: (offset <= (uint16_t)-1 && size <= (uint16_t)-1 && offset + size <= (uint16_t)-1) doveadm(gareth walters): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4414a) [0x7f9b7100714a] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f9b7100720a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f9b70fde82a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xb8079) [0x7f9b7130a079] -> /usr/lib/dovecot/modules/lib20_virtual_plugin.so(virtual_storage_sync_init+0x788) [0x7f9b6f1775a8] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x33) [0x7f9b712cf3e3] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x27) [0x7f9b712cf507] -> doveadm(+0x16618) [0x7f9b719c8618] -> doveadm(+0x13346) [0x7f9b719c5346] -> doveadm(+0x13e21) [0x7f9b719c5e21] -> doveadm(doveadm_mail_try_run+0x161) [0x7f9b719c62e1] -> doveadm(main+0x3d1) [0x7f9b719c4ef1] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f9b70c57ead] -> doveadm(+0x13125) [0x7f9b719c5125] Aborted
I can see I have reached a limit, but is there any configuration value I can use to increase this limit, please?
Kind regards, André.
On 27.3.2013, at 1.20, Andre Rodier <andre.rodier@gmail.com> wrote:
doveadm(john smith): Panic: file mail-index-transaction-update.c: line 875 (mail_index_update_header_ext): assertion failed: (offset <= (uint16_t)-1 && size <= (uint16_t)-1 && offset + size <= (uint16_t)-1)
I can see I have reached a limit, but is there any configuration value I can use to increase this limit, please?
Looks like this was an easier fix than I thought: http://hg.dovecot.org/dovecot-2.1/rev/87d0c4056b4d
I didn't test it now, but the code to handle it exists.
Il 27/03/2013 00:20, Andre Rodier ha scritto:
Hello everybody,
As part of a migration from exchange 2003 to dovecot, I have converted a lot of PST files for a user. I am importing his PST files in a maildir folder called 'Archives'. Actually, I reached about 770 'Archives' folders, and the total length of their names is about 59k characters. Thanks to wc!
I am using Maildir++
Hi,
what kind of method are you using for converting PST into Maildir?
Thanks
Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it
Hello Allessio,
I am using readpst -r from libpst (http://www.five-ten-sg.com/libpst/)
André
On 27 March 2013 13:25, Alessio Cecchi <alessio@skye.it> wrote:
Il 27/03/2013 00:20, Andre Rodier ha scritto:
Hello everybody,
As part of a migration from exchange 2003 to dovecot, I have converted a lot of PST files for a user. I am importing his PST files in a maildir folder called 'Archives'. Actually, I reached about 770 'Archives' folders, and the total length of their names is about 59k characters. Thanks to wc!
I am using Maildir++
Hi,
what kind of method are you using for converting PST into Maildir?
Thanks
Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it
-- André Rodier
participants (4)
-
Alessio Cecchi
-
Andre Rodier
-
André Rodier
-
Timo Sirainen