May 2011 - dovecot - dovecot.org

Re: [Dovecot] doveadm mailbox status 2.0.12 crashes
by Joseph Tam 10 May '11

10 May '11

On Mon, 9 May 2011, Timo Sirainen wrote: >> # dbx doveadm >> (dbx) run mailbox status -u user messages \* >> ... long list ... >> igel messages=1 >> INBOX messages=231 >> doveadm(user): Panic: Trying to deinit storage before freeing its objects > > A backtrace can't really show why it crashed with this. Something wasn't > freed for some reason. Can you still reproduce this? I'd like to know of > a way to reproduce this. Maybe you can copy this problematic user's > mailboxes to a test user and keep deleting stuff until you see what > triggers it? I started removing files as you've suggested and the minimal condition that triggers a crash is at least one non-mbox file. $ rm /var/mail/user $ rm -rf ~user/mail/* $ echo x >~user/mail/x $ doveadm mailbox status -u user messages \* doveadm(user): Error: Syncing mailbox x failed: Mailbox isn't a valid mbox file doveadm(user): Panic: Trying to deinit storage before freeing its objects doveadm(user): Error: Raw backtrace: 0xff1c296c -> 0xff2a4e20 -> 0xff29e5cc -> 0xff2a8784 -> 0xff2a89fc -> 0x168d4 -> 0x169e0 -> 0x16ef4 -> 0x1745c -> 0x1cafc -> 0x1629c Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] Dovecot very slow on a mailbox with > 700 IMAP Folders
by Becker, Ronny 10 May '11

10 May '11

Hello, I am using Dovecot 1.2.9 on a 32bit on Ubuntu 10.04.2 LTS. We got one user who uses folders in an "exessive" way. He has got 704 subscribed folders. That means about nearly 3000 folders on the filesystem. Since ~ a week the user couldn't work because of timeouts when connecting to Dovecot (IMAP). Thunderbird doesn't show any folders - timeout - the webmail System (Groupoffice) only presents the INBOX. I did some debugging and found that a lsub "" "*" that is used by Thunderbird takes > 5 minutes. Thunderbird disconnects after ~1 Minute showing the timeout. I entered the command directly via port communication. So this is no clientside problem. But there is no error message or something else in any logs. I did some debugging with strace, too. It's about 22MB only for running the lsub command !? The Mailbox size is about ~2.2GB, so this should be no problem. The maximum subfolder level is about 13 - could this be a problem? You can find the structure (simply shown) attached. Thanks for any help!! Best regards Ronny Becker -- Mit freundlichen Grüßen, Ronny Becker Institut für Medizinische Diagnostik GmbH Ingelheim / Datenverarbeitung Konrad Adenauer Strasse 17 55218 Ingelheim Telefon: 06132 781 249 Fax: 06132 781 9 249 ronny.becker(a)bioscientia.de www.bioscientia.de Gesellschaft mit beschränkter Haftung mit Sitz in 55218 Ingelheim am Rhein, eingetragen im Handelsregister des Amtsgerichts Mainz unter HRB 21166. Geschäftsführer: PD. Dr. med. Markus Nauck und Dipl.-Vw. Johannes Brill. Vorsitzender des Aufsichtsrates: Prof. Dr. med. Bernd Heicke. Diese E-Mail kann vertrauliche oder auf andere Weise geschützte Informationen enthalten. Sollten Sie diese E-Mail irrtümlich erhalten haben, löschen Sie diese bitte von Ihrem System und setzen Sie uns unverzüglich von dem Vorfall in Kenntnis. USt-ID-Nr. DE 811138229 ___ Limited liability company with registered office in 55218 Ingelheim am Rhein, registered with the commercial register of the local court of Mainz under HRB 21166. Managing directors: PD Dr. med. Markus Nauck and Dipl.-Vw. Johannes Brill. Chairman of the supervisory board: Prof. Dr. med. Bernd Heicke. This e-mail may contain confidential or otherwise privileged information. If you are not the intended recipient, please inform us immediately and delete the e-mail from your system. VAT-ID-Nr. DE 811138229

6 10

Re: [Dovecot] Posfix and Dovecot (dovecot like LDA) and no space left on the disk
by Petr Svacina 10 May '11

10 May '11

Hi, No. No any version of the sieve us used .... > On 05/09/2011 05:37 PM, Petr Svacina wrote: >> Hi, >> >> Please I have a question: >> >> If my server is out of space (disk full) and the postfix is LDA, the new messages a deffered or refused,so postfix send 450 to sender ... >> But When I use dovecot (1.2.16) like LDA, postfix accept message (even there is no space), forward to dovecot, dovecot REFUSE the message and message is lost ! >> >> How can I solve this ? I don't want tu use quota and the disk was full, because of the other problem .... >> > > Are you using any plugins, like Sieve? > > Regards, > > Stephan. > -- Tato zprava byla prohledana na vyskyt viru a nebezpecneho obsahu antivirovym systemem MailScanner a zda se byt cista.

1 0

Re: [Dovecot] Posfix and Dovecot (dovecot like LDA) and no space left on the disk
by Petr Svacina 10 May '11

10 May '11

Hi, Yes know, I know, that ANY OUT of SPACE problem is SPECIALLY administrator's problem and please check my previous answer ... Out of space on the disk is my problem, but I want to know, why postfix receive message to it's spool (another partition - lot of space) and when postfix uses dovecot to deliver message to the inbox, where is NO space, why message is lost and removed from qmgr. thanks a lot :-) Peter > > On 5/9/2011 10:37 AM, Petr Svacina wrote: >> Hi, >> >> Please I have a question: >> >> If my server is out of space (disk full) and the postfix is LDA, the new messages a deffered or refused,so postfix send 450 to sender ... >> But When I use dovecot (1.2.16) like LDA, postfix accept message (even there is no space), forward to dovecot, dovecot REFUSE the message and message is lost ! >> >> How can I solve this ? I don't want tu use quota and the disk was full, because of the other problem .... > > This is more of a mail server admin 101 issue than a Dovecot issue. > Putting your log, mail spool, and user mail directories on separate > partitions, physical disks, or SAN LUNs will prevent such a problem from > occurring 99% of the time, assuming you have planned and sized your > storage appropriately for your environment. At minimum you should have > your spool and user mail storage on different partitions. To avoid this > issue the other 1% of the time, use monitoring or log summary tools to > notify you of disk space usage so you know when you're close to running > out of space. For instance, I receive the following as part of my daily > logwatch summary on my personal domain MX: > > Filesystem Size Used Avail Use% Mounted on > /dev/sda2 33G 4.2G 28G 14% / > /dev/sda1 92M 8.4M 79M 10% /boot > /dev/sda6 94G 1.2G 92G 2% /home > /dev/sda7 94G 25G 70G 26% /samba > > Note that I have both system logs and the mail spool on / but user mail > directories in /home. This setup is acceptable for a low volume server. > For a high volume server the mail spool should be on a dedicated > partition, as well as user mail dirs. > > If you already know all of this and an unforeseen issue caused your > problem, accept my apologies for preaching to the choir. > > -- > Stan > -- Tato zprava byla prohledana na vyskyt viru a nebezpecneho obsahu antivirovym systemem MailScanner a zda se byt cista.

1 0

Re: [Dovecot] Sieve & auto_create mail_home
by Maria Arrea 10 May '11

10 May '11

Hello I am still struggling with this, any idea? Regards Maria ----- Original Message ----- From: Maria Arrea Sent: 05/09/11 12:19 PM To: Dovecot Mailing List Subject: [Dovecot] Sieve & auto_create mail_home Hello In my setup I have the following in dovecot.conf (dovecot 2.0.12) mail_home = /buzones/mydomain/%2.26Hn/%2.200Hn/%n/home_usuario/ mail_location = mdbox:/buzones/my_domain/%2.26Hn/%2.200Hn/%n:INDEX=/indices_dovecot/indices/%2.26Hn/%2.200Hn/%n My problem is with the autocreation of mail_home. We are using roundcube+sieve plugin and the first time a user tries to use sieve fails with this: May 9 12:13:52 buzon dovecot: managesieve(a_poor_user@mydomain): Error: sieve-storage: open(/buzones/my_domain/0a/94/javierdemiguel/home_usuario/sieve//tmp/roundcube-1304936032.M335644P23819.mydomain.sieve) failed: No such file or directory In the second attempt works without problems, the folder "home_usuario" is created after failing the first. How can I fix this? Regards Maria

1 0

[Dovecot] mail_max_lock_timeout setup
by Osvaldo Alvarez Pozo 10 May '11

10 May '11

hi all in wich section most mail_max_lock_timeout be set up? Thanks.

2 2

[Dovecot] Posfix and Dovecot (dovecot like LDA) and no space left on the disk
by Petr Svacina 09 May '11

09 May '11

Hi, Please I have a question: If my server is out of space (disk full) and the postfix is LDA, the new messages a deffered or refused,so postfix send 450 to sender ... But When I use dovecot (1.2.16) like LDA, postfix accept message (even there is no space), forward to dovecot, dovecot REFUSE the message and message is lost ! How can I solve this ? I don't want tu use quota and the disk was full, because of the other problem .... thanks. Peter -- Tato zprava byla prohledana na vyskyt viru a nebezpecneho obsahu antivirovym systemem MailScanner a zda se byt cista.

4 3

[Dovecot] how to cat / grep from dbox files
by Sarder Kamal 09 May '11

09 May '11

Dear List members I am new to dovecot and am looking for a solution. I have googled as much as I could, but most likely my search criteria was wrong, and hence asking here. I am familiar with maildir format, and could easily do cat / grep / sed on those files to extract data. The server I am looking at now uses dbox format, which seems to store data in a different way. just to give you an example, when I do cat Drafts/dbox-Mails/u.11 I get the following output 2 M1e C4daa51f6 N 000000000000030A �Tmo�6��_q�0`�B�r�D�� tF�5Xܵ�HI'��D��T��=*^�u��M�A�x/�=ω׋E ��4�d�鰮M_4�Z�.�ިmt��e��U�=�=1۠s�B�^�0�_�_& �"��H��eehuCA�1�I]a��p��)\�-��H ��ɋt4��E,��I�P�G��+��Iյ�K+˖�u;9Z-��)ri��վ��un ��֡�W�@�m�l�P�'��.̃�|��6�͊��)�S�C�T��>��n��U�r��݃�]X9R��u�=�T��S_�:6��]�4hak��JWpkMe%��P_��~O~MW�jOU�F}�b� 3�]�~�/��8�_"��}L��覯|L�}6hE'�7 ��^ڐq�-Y�I��Ѯ.f��҉_<��o6�~_�\z��=�gXˆ4y~1�|/~�J�7O��O&��& lt;��j�t��z�[圱��x9�zwn��T�b�k��)�p��4` ��a|�HR��*7��d)�'��?FQ�[�gp8�O&�L2O[�t̃�`�� Z20479 R47f4b88e V20ba2 G1207220366.P10687Q2.server X1358 130815 B72 7f/7d/7f7dc5d880fa44444e57c6cbe2e4fd477dab1086-4db17526fa51aa4deb5e0000453e4b91 if I do less Drafts/dbox-Mails/u.11 below is the output 00000000 32 20 4d 31 65 20 43 34 64 61 61 35 31 66 36 0a |2 M1e C4daa51f6.| 00000010 01 02 4e 20 20 20 20 20 20 20 20 20 20 30 30 30 |..N 000| 00000020 30 30 30 30 30 30 30 30 30 30 33 30 41 0a 1f 8b |000000000030A...| 00000030 08 00 00 00 00 00 00 03 9d 54 6d 6f db 36 10 fe |.........Tmo.6..| 00000040 ce 5f 71 d3 30 60 c3 42 89 72 ec 44 95 ed 20 a9 |._q.0`.B.r.D.. .| 00000050 ed 74 46 e3 35 58 dc b5 fb 48 49 27 99 a9 44 1a |.tF.5X...HI'..D.| 00000060 a4 e4 54 fd f5 3d 2a 5e d2 75 d8 d0 4d b6 41 f3 |..T..=*^.u..M.A.| 00000070 78 2f cf 3d cf 89 d7 8b 45 0a aa 91 fb 34 8a 64 |x/.=....E....4.d| 00000080 dd e9 b0 ae 4d 5f 34 c6 5a e5 2e dd de a8 1a 6d |....M_4.Z......m| 00000090 74 87 ba 65 ef f9 ba a0 55 b5 3d 7f 8d 3d 05 15 |t..e....U.=..=..| 000000a0 31 db a0 73 b2 42 be 5e a6 30 1b 9f 5f 8f 5f 26 |1..s.B.^.0.._._&| 000000b0 c9 22 1c 8b 89 48 c4 e9 65 65 0e 68 75 43 41 f8 |."...H..ee.huCA.| 000000c0 31 df 49 5d 61 98 9b b0 fb 70 c1 96 b2 c5 14 b6 |1.I]a....p......| 000000d0 bb ee 04 c4 29 5c ed 2d 8c 84 48 20 8e d3 c9 8b |....)\.-..H ....| 000000e0 74 34 86 9f 45 2c 04 bb b6 a6 49 e1 8a 50 c1 8d |t4..E,....I..P..| 000000f0 47 05 9b 01 16 cc fe 06 f4 9f 2b bd e7 1b f3 49 |G.........+....I| 00000100 d5 b5 e4 4b 2b cb 96 af 75 69 08 3b 39 5a 2d eb |...K+...ui.;9Z-.| As it is quite evident, the output is in binary format, but I need it in text (even if that means I use some other command and pipe the output to cat / grep / sed) -- can this be done? This server was configured and maintained by someone else, and I am very new to dovecot or this dbox format (I used to use courier-imap). would appreciate if anyone could please suggest what could/should be done to get to my objectives. All pointers/suggestions appreciated. Thanks and regards Sarder ______________________________________________________________________ Centre for Parliamentary Studies This email and its attachments are intended only for disclosure to the recipients to whom they are addressed. Should you have received it in error, we regret any inconvenience and would request that you notify postmaster(a)parlicentre.org. Any opinions presented are solely those of its author and do not necessarily represent those of the company. Recipients are advised to check for the presence of malware as the company accepts no liability for the accidental transmission thereof. Centre for Parliamentary Studies is a trading name of CPS Framework Ltd. Registered Office: Unit N0002, Westminster Business Square, 1-45 Durham Street, London, SE11 5JH Registered in England & Wales, No. 6926090

3 4

[Dovecot] Renaming maildir files, UIDs and mail clients
by Helge Milde 09 May '11

09 May '11

Hi! First a little background: I'm thinking of compressing my Maildir's using dovecot's zlib support, and have run into a couple of problems. First of all, my files use the following formats: 1. 1260386673.000002.mbox:2,S 2. 1304920966.M241434P17342.mail,W=3152:2,S As you can see, both lack the S=<size> "basename flag", but the latter does have W=. Reading http://wiki.dovecot.org/Plugins/Zlib, I get the impression that I really need S= in the filenames (".. otherwise there will be problems with quota calculation as well as other potential random failures."). I have made a script that compresses my files, adds S=<size> if it's missing (using wc -c before gzip), and appends the Z flag. As I understand it, adding S=<size> will change the UID of the email, while appending Z won't. Now for my questions: 1. How crucial is it to have the S= in the basename when using zlib? The wiki page mentions quota problems, which we're not using, but also "random failures"... 2. Would W= suffice in this regard? I.e. would I be able to compress files of the latter format safely, without adding S= (only appending the Z flag)? 3. If S=<size> *is* needed, is there a way to minimize the effect from the mail client's perspective? From my testruns, it seems Mutt have no problems after I rename the basename, but Thunderbird will refetch the emails, and not delete the old ones, showing duplicate emails. Refetching emails is not a big problem, I think, but only if the email clients understand that the old ones doesn't exist anymore. And if anyone has ideas on how to convert to using zlib without the users knowing, I would be glad to hear it! -- Helge Milde www.monsternett.no

2 1

[Dovecot] Post-login scripting with mail_drop_priv_before_exec in dovecot2
by Mark Zealey 09 May '11

09 May '11

Hi, I'm in the process of upgrading from dovecot v1.1 to dovecot 2. We fetch uid/gid user information from a database and also use post-login scripting with mail_drop_priv_before_exec = yes which means the postlogin script is executed with the permissions of the user we have found in the database. According to the dovecot2 wiki page, to get this behaviour in version 2 we have to set the post-login script to run as root and then su to the user. This seems a bit of a strange (and insecure as you might forget) way of doing this. Are there any other options, such as fetching a certain column name from the database to set the value of service imap-postlogin { user } or setting something like user = $user in the configuration? (or is the configuration only read at startup so such dynamic configuration can't be done in the service section?) Cheers, Mark

2 2