April 2012 - dovecot - dovecot.org

[Dovecot] Dovecot/doveadm crash
by Daniel L. Miller 05 May '12

05 May '12

Having a problem with a mailbox. I've been trying to rebuild - but doveadm force-resync crashes. This is mdbox with sis. doveadm purge -u dmiller(a)amfes.com doveadm(dmiller(a)amfes.com): Panic: file istream.c: line 466 (i_stream_grow_buffer): assertion failed: (stream->max_buffer_size > 0) doveadm(dmiller(a)amfes.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x4167a) [0x7fb73465467a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7fb734654762] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fb73462c2a0] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x4949b) [0x7fb73465c49b] -> /usr/local/lib/dovecot/libdovecot.so.0(i_stream_get_buffer_space+0x82) [0x7fb73465c522] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x4b1c8) [0x7fb73465e1c8] -> /usr/local/lib/dovecot/libdovecot.so.0(i_stream_read+0x69) [0x7fb73465bb69] -> /usr/local/lib/dovecot/libdovecot.so.0(i_stream_read_next_line+0x1d) [0x7fb73465c04d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mdbox_purge+0x921) [0x7fb7348d7d71] -> doveadm() [0x40e1e6] -> doveadm() [0x40e018] -> doveadm() [0x40ea83] -> doveadm(doveadm_mail_try_run+0x141) [0x40eef1] -> doveadm(main+0x3c1) [0x415911] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xff) [0x7fb73429deff] -> doveadm() [0x40de39] -- Daniel

2 2

[Dovecot] per user sieve after filters
by Andre Rodier 05 May '12

05 May '12

Hello, Thanks for dovecot, as it's still the best mail server. I'd like to use per users sieve_after scripts. Can I put in my dovecot config file, something like that: sieve_after = %h/Mails/Sieve/After/ It would be very useful for me, as I'd like to add vacation script to be executed from this place. Kind regards, André.

2 3

[Dovecot] Log messages
by Stephen Davies 03 May '12

03 May '12

Hello. I have been on leave for several weeks and have managed to lose all emails received since December due to a server crash. I asked about log synch error back in March and have (repeatedly) deleted all .imap files but the errors continue. # 2.1.1: /usr/etc/dovecot/dovecot.conf # OS: Linux 2.6.33.5-desktop-2mnb i686 Mandriva Linux 2010.2 mail_access_groups = mail mail_location = mbox:~/Mail:INBOX=/var/spool/mail/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve sieve ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } protocol lmtp { mail_plugins = sieve } protocol lda { mail_plugins = sieve } Apr 30 09:00:12 server dovecot: imap(john): Error: Log synchronization error at seq=2,offset=929952 for /home/john/Mail/INBOX/.imap/Archive/dovecot.index: Extension header update points outside header size Apr 30 09:00:12 server dovecot: imap(john): Error: Log synchronization error at seq=2,offset=548744 for /home/john/Mail/INBOX/.imap/Davies/dovecot.index: Extension header update points outside header size Apr 30 09:00:12 server dovecot: imap(john): Error: Log synchronization error at seq=2,offset=541084 for /home/john/Mail/INBOX/.imap/FieldNET/dovecot.index: Extension header update points outside header size Apr 30 09:00:12 server dovecot: imap(john): Error: Log synchronization error at seq=2,offset=539768 for /home/john/Mail/INBOX/.imap/Invoices Out/dovecot.index: Extension header update points outside header size Apr 30 09:00:12 server dovecot: imap(john): Error: Log synchronization error at seq=2,offset=492896 for /home/john/Mail/INBOX/.imap/Lawrence and Hanson/dovecot.index: Extension header update points outside header size Apr 30 09:00:12 server dovecot: imap(john): Error: Log synchronization error at seq=2,offset=530300 for /home/john/Mail/INBOX/.imap/Logger Call/dovecot.index: Extension header update points outside header size Apr 30 09:00:12 server dovecot: imap(john): Error: Log synchronization error at seq=2,offset=524384 for /home/john/Mail/INBOX/.imap/Logger Reset/dovecot.index: Extension header update points outside header size Apr 30 09:00:12 server dovecot: imap(john): Error: Log synchronization error at seq=2,offset=500144 for /home/john/Mail/INBOX/.imap/River Murray/dovecot.index: Extension header update points outside header size Apr 30 09:00:12 server dovecot: imap(john): Error: Log synchronization error at seq=2,offset=532680 for /home/john/Mail/INBOX/.imap/SMS Emails/dovecot.index: Extension header update points outside header size Apr 30 09:00:12 server dovecot: imap(john): Error: Log synchronization error at seq=2,offset=515436 for /home/john/Mail/INBOX/.imap/Soil Moisture Alert/dovecot.index: Extension header update points outside header size Apr 30 09:00:12 server dovecot: imap(john): Error: Log synchronization error at seq=2,offset=578508 for /home/john/Mail/INBOX/.imap/Water Management Alarm/dovecot.index: Extension header update points outside header size Apr 30 09:00:12 server dovecot: imap(john): Error: Log synchronization error at seq=2,offset=648164 for /home/john/Mail/INBOX/.imap/Water Usage/dovecot.index: Extension header update points outside header size Apr 30 09:00:12 server dovecot: imap(john): Error: Log synchronization error at seq=2,offset=492876 for /home/john/Mail/INBOX/.imap/Weather Summaries/dovecot.index: Extension header update points outside header size Apr 30 09:00:12 server dovecot: imap(john): Error: Log synchronization error at seq=2,offset=495744 for /home/john/Mail/INBOX/.imap/Zerna/dovecot.index: Extension header update points outside header size Apr 30 09:00:38 server dovecot: lda(john): Error: Log synchronization error at seq=2,offset=578596 for /home/john/Mail/INBOX/.imap/Water Management Alarm/dovecot.index: Extension header update points outside header size Apr 30 09:00:38 server dovecot: lda(john): Error: Log synchronization error at seq=2,offset=578684 for /home/john/Mail/INBOX/.imap/Water Management Alarm/dovecot.index: Extension header update points outside header size Apr 30 09:00:38 server dovecot: lda(john): Error: Log synchronization error at seq=2,offset=578880 for /home/john/Mail/INBOX/.imap/Water Management Alarm/dovecot.index: Extension header update points outside header size At about the same time, I asked about fsck warnings. These also continue despite deleting all .,imap files. Apr 30 09:00:12 server dovecot: imap(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/Archive/dovecot.index Apr 30 09:00:12 server dovecot: imap(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/Davies/dovecot.index Apr 30 09:00:12 server dovecot: imap(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/FieldNET/dovecot.index Apr 30 09:00:12 server dovecot: imap(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/Invoices Out/dovecot.index Apr 30 09:00:12 server dovecot: imap(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/Lawrence and Hanson/dovecot.index Apr 30 09:00:12 server dovecot: imap(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/Logger Call/dovecot.index Apr 30 09:00:12 server dovecot: imap(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/Logger Reset/dovecot.index Apr 30 09:00:12 server dovecot: imap(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/River Murray/dovecot.index Apr 30 09:00:12 server dovecot: imap(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/SMS Emails/dovecot.index Apr 30 09:00:12 server dovecot: imap(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/Soil Moisture Alert/dovecot.index Apr 30 09:00:12 server dovecot: imap(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/Water Management Alarm/dovecot.index Apr 30 09:00:12 server dovecot: imap(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/Water Usage/dovecot.index Apr 30 09:00:12 server dovecot: imap(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/Weather Summaries/dovecot.index Apr 30 09:00:12 server dovecot: imap(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/Zerna/dovecot.index Apr 30 09:00:38 server dovecot: lda(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/Water Management Alarm/dovecot.index Apr 30 09:00:38 server dovecot: lda(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/Water Management Alarm/dovecot.index Apr 30 09:00:38 server dovecot: lda(john): Warning: fscking index file /home/john/Mail/INBOX/.imap/Water Management Alarm/dovecot.index The file system involved is local and sieve rules are now working. Cheers and thanks, Stephn -- ============================================================================= Stephen Davies Consulting P/L Voice: 08-8177 1595 Adelaide, South Australia. Fax : 08-8177 0133 Records & Collections Management. Mobile:040 304 0583

3 4

[Dovecot] question dovecot Inheritance global acl vs userfolder acl
by Robert Schetterer 01 May '12

01 May '12

Hi Timo my tests resulted in inheritance is given if a userfolder has set some acl to its new created subfolder , which is nice if some userfolder has its acl from global acl there is no inheritance to its new created subfolders, that subfolders will always created with full owner rights i am not really sure if its a good idea to have inheritance from global acl and if its hackabel what is your idea to this ? -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 2

[Dovecot] SETANNOTATION for Dovecot
by Dieter Knopf 01 May '12

01 May '12

Hello, i'm using kmail2 and for Folder Settings the SETANNOATION command is needed. Is there any way to add this command to Dovecot? I already found a dovecot-metadata-plugin but there is no Package available for Debian. Thanks Dieter

2 1

[Dovecot] 2.1.5: Panic: file mailbox-list-fs.c: line 156 (fs_list_get_path): assertion failed: (mailbox_list_is_valid_pattern(_list, name))
by Nick Urbanik 01 May '12

01 May '12

Dear Folks, We had this assertion failure on Dovecot 2.1.1 on a particular mailbox. I upgraded to 2.1.5, and we have the same assertion failure, on the same mailbox: Apr 27 16:02:03 imap(nu-imaptest00258(a)example.com): Panic: file mailbox-list-fs.c: line 156 (fs_list_get_path): assertion failed: (mailbox_list_is_valid_pattern(_list, name)) Apr 27 16:02:03 imap(nu-imaptest00258(a)example.com): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x4246a) [0x7f310c28146a] -> /usr/lib64/dovecot/libdovecot.so.0(+0x424b6) +[0x7f310c2814b6] -> /usr/lib64/dovecot/libdovecot.so.0(+0x1950a) [0x7f310c25850a] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x889b5) [0x7f310c5539b5] -> +/usr/lib64/dovecot/lib10_quota_plugin.so(+0x8a30) [0x7f3109ccea30] -> /usr/lib64/dovecot/lib10_quota_plugin.so(+0x8cdf) [0x7f3109ccecdf] -> /usr/lib64/dovecot/lib10_quota_plugin.so(+0x93c8) +[0x7f3109ccf3c8] -> /usr/lib64/dovecot/lib10_quota_plugin.so(+0x9436) [0x7f3109ccf436] -> /usr/lib64/dovecot/lib10_quota_plugin.so(quota_get_resource+0x72) [0x7f3109cca792] -> +/usr/lib64/dovecot/lib10_quota_plugin.so(quota_test_alloc+0x1bd) [0x7f3109ccaaed] -> /usr/lib64/dovecot/lib10_quota_plugin.so(+0xa870) [0x7f3109cd0870] -> +/usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_save_begin+0x4d) [0x7f310c544b9d] -> dovecot/imap [nu-imaptest00258(a)example.com 127.0.0.1 APPEND]() [0x408ac4] -> dovecot/imap +[nu-imaptest00258(a)example.com 127.0.0.1 APPEND](cmd_append+0x139) [0x408d69] -> dovecot/imap [nu-imaptest00258(a)example.com 127.0.0.1 APPEND](command_exec+0x3d) [0x410aed] -> dovecot/imap +[nu-imaptest00258(a)example.com 127.0.0.1 APPEND]() [0x40fa2e] -> dovecot/imap [nu-imaptest00258(a)example.com 127.0.0.1 APPEND]() [0x40fb1a] -> dovecot/imap [nu-imaptest00258(a)example.com +127.0.0.1 APPEND](client_handle_input+0x135) [0x40fd45] -> dovecot/imap [nu-imaptest00258(a)example.com 127.0.0.1 APPEND](client_input+0x5f) [0x41066f] -> +/usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f310c28d9d6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f310c28ea5f] -> +/usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f310c28d978] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f310c279c73] -> dovecot/imap [nu-imaptest00258(a)example.com +127.0.0.1 APPEND](main+0x29d) [0x418b3d] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f310bebccdd] -> dovecot/imap [nu-imaptest00258(a)example.com 127.0.0.1 APPEND]() [0x408449] Apr 27 16:02:03 imaptest01 perdition.imap4[15893]: Closing session: 211.29.132.209:42922->211.29.132.245:143 authorisation_id=NONE authentication_id="nu-imaptest00258" received=67 sent=53 Apr 27 16:02:03 imap(nu-imaptest00258(a)example.com): Fatal: master: service(imap): child 15894 killed with signal 6 (core not dumped) Any suggestions welcome. I guess enabling core dumps is a good start, I'll do that, but has anyone seen this before? -- Nick Urbanik http://nicku.org 808-71011 nick.urbanik(a)optusnet.com.au GPG: 7FFA CDC7 5A77 0558 DC7A 790A 16DF EC5B BB9D 2C24 ID: BB9D2C24 I disclaim, therefore I am.

2 1

[Dovecot] [PATCH] Dovecot 2.1 compiling fix for AIX
by SATOH Fumiyasu 01 May '12

01 May '12

Hi, I'm trying to build Dovecot 2.1.5 on AIX 6.1 and got the following build error: $ ./configure ... $ make ... In file included from stats-connection.c:9: stats-plugin.h:14: error: field 'user_cpu' has incomplete type stats-plugin.h:14: error: field 'sys_cpu' has incomplete type ... The attached patch fixes this problem. -- -- Name: SATOH Fumiyasu (fumiyas @ osstech co jp) -- Business Home: http://www.OSSTech.co.jp/ -- Personal Home: https://github.com/fumiyas/

2 2

[Dovecot] restoring mails and directories
by oni-neko＠gmx.net 01 May '12

01 May '12

Good day! is there an easy way to restore e.g. deleted mails and/or mail directories? let me specify: I'm running dovecot 1.2.9 on a current ubuntu lts. It is set to Maildir and I backup the folder with the users maildata nightly via rsync. now, when someone deletes a mail that they still need, and I copy it back from the backup, it will not be visible to mail clients. When I change the mailfile by a letter or so, it shows. that's easy enough, if not exactly awesome ;-) But, if said person deletes a whole folder of mails, this way to make restored mails show up becomes rather unreasonable. surely there is a better way to do this? I'd be glad for any and all hints! =) best regards silvana -- Empfehlen Sie GMX DSL Ihren Freunden und Bekannten und wir belohnen Sie mit bis zu 50,- Euro! https://freundschaftswerbung.gmx.de

3 2

[Dovecot] Dovecot dsync mail replication issues
by Reuben Farrelly 01 May '12

01 May '12

Hi, I'm trying to set up some dsync based replication between two hosts on my network. The current topology is a single server running Postfix with a single dovecot installation with a Maildir per user (only 4 users including myself). No NFS, just local system users on ext4. I am only using system users, ie no virtual users. I am using dovecot deliver to deliver mails into the Maildir's. This - being a very standard Maildir installation - all works just fine. I'm running dovecot-2.1.5 (release versions) x86_64 with Gentoo on both hosts and using key based ssh to transport the data using the root login. What I would like to do is extend the design so as to replicate the Maildirs across a second machine and in the future be able to connect via IMAP into either machine to sync mail. Two way dsync would be rather cool because I could then deliver via SMTP to either system and have changes automagically propagate - but initially just simple replication would be a good start. I was hoping that dsync would allow me to do this, but I've run into quite a number of problems while getting this to work. http://dovecot.org/list/dovecot/2012-March/064243.html ...was very useful and I've based my config on that. Initially I've tried to sync up the user Maildirs, and this has more or less worked: doveadm sync -u lyn remote:root@dustbowl.reub.net This succeeds without error on the initial sync. However if I try to run the re-sync again (such as a use case of if the sync of another Maildir takes 4 hours so I want to resync up the earlier ones again) I end up with a mysteriously named INBOX folder in both the source and destination Maildirs: drwx------ 5 lyn lyn 4096 Apr 30 19:32 .INBOX_7a86a62d465a974fb92f00003b258734 It has the basic structure of a Maildir but is empty in terms of mails: drwx------ 2 lyn lyn 4096 Apr 30 19:32 cur -rw------- 1 lyn lyn 220 Apr 30 19:32 dovecot.index.log -rw------- 1 lyn lyn 51 Apr 30 19:32 dovecot-uidlist -rw------- 1 lyn lyn 0 Apr 30 19:32 maildirfolder drwx------ 2 lyn lyn 4096 Apr 30 19:32 new drwx------ 2 lyn lyn 4096 Apr 30 19:32 tmp First question: why is this random named directory being created in the origin Maildir? Shouldn't the replication be more or less read-only in the origin Maildir? Second question: If I re-attempt a doveadm sync a second time I get this error: tornado Maildir # doveadm sync -u lyn remote:root@dustbowl.reub.net dsync-local(lyn): Error: Can't rename mailbox INBOX_7a86a62d465a974fb92f00003b258734 to INBOX: Target mailbox already exists dsync-local(lyn): Error: Can't rename mailbox INBOX to INBOX_eb15f30ea563be4b703200002bd68bb1: Renaming INBOX isn't supported. tornado Maildir # It's not clear if the second attempt has failed or succeeded, and it's a bit odd that it errors out on a directory that the dovecot sync process itself has created. Third question: Upon starting Dovecot lots of ugliness is logged in the mail log: Apr 30 19:44:59 tornado dovecot: master: Dovecot v2.1.5 starting up (core dumps disabled) Apr 30 19:44:59 tornado dovecot: doveadm(mozsync): Error: user mozsync: Initialization failed: Namespace '': mkdir(/var/www/xxx/server-full/Maildir) failed: Permission denied (euid=1016(mozsync) egid=1016(<unknown>) missing +w perm: /var/www/xxx/server-full, dir owned by 0:0 mode=0755) Apr 30 19:44:59 tornado dovecot: doveadm(mozsync): Error: sync: User init failed Apr 30 19:44:59 tornado dovecot: doveadm(mozsync): Warning: I/O leak: 0x414190 (line 102, fd 16) Apr 30 19:44:59 tornado dovecot: dsync-local(cisco): Error: remote: doveadm(cisco): Fatal: User doesn't exist Apr 30 19:44:59 tornado dovecot: dsync-local(cisco): Error: read() from worker server failed: EOF Users mozsync and cisco are not valid mail users and it's not appropriate that Dovecot tries to create a Maildir for either of them. The users are system unprivileged users only, and do not ever send or receive mail. And - I/O leak? ;) Also, user cisco is local to one box only, and does not exist (nor does it need to) on the remote host. So any complaints about this user are invalid and dovecot needs to ignore replication for this user anyway. Fourth question, upon starting dovecot again, mail.log then spews several hundred of these messages: Apr 30 19:45:06 tornado dovecot: dsync-local(reuben): Error: msg-get failed: box=Trash uid=114863 guid=1335382569.M98089P29952.tornado,S=6479,W=6625 Before aborting entirely with: Apr 30 19:45:09 tornado dovecot: imap: Server shutting down. in=328 out=2042 It seems to me that a a few of those problems logged could be solved by being able to specify which system users to synchronise, rather than Dovecot making a blind assumption that all users actually have valid Maildirs that need to be created, and all need to be sync'd between two hosts. Subsequent delivery based sync'ing fails silently (pending more investigation) but I'd like to try and fix the above listed problems first before worrying about the later stages of the sync not working. Has anyone else run into these problems or found better ways of making this type of setup all work? Thanks, Reuben

3 2

[Dovecot] Single Instance Storage management
by Daniel L. Miller 01 May '12

01 May '12

Was there a doveadm command that checks the SIS files and removes any not referenced? Will the "doveadm purge -A" catch that? -- Daniel

2 1