- dovecot - dovecot.org

[Dovecot] how to cat / grep from dbox files
by Sarder Kamal 09 May '11

09 May '11

Dear List members I am new to dovecot and am looking for a solution. I have googled as much as I could, but most likely my search criteria was wrong, and hence asking here. I am familiar with maildir format, and could easily do cat / grep / sed on those files to extract data. The server I am looking at now uses dbox format, which seems to store data in a different way. just to give you an example, when I do cat Drafts/dbox-Mails/u.11 I get the following output 2 M1e C4daa51f6 N 000000000000030A �Tmo�6��_q�0`�B�r�D�� tF�5Xܵ�HI'��D��T��=*^�u��M�A�x/�=ω׋E ��4�d�鰮M_4�Z�.�ިmt��e��U�=�=1۠s�B�^�0�_�_& �"��H��eehuCA�1�I]a��p��)\�-��H ��ɋt4��E,��I�P�G��+��Iյ�K+˖�u;9Z-��)ri��վ��un ��֡�W�@�m�l�P�'��.̃�|��6�͊��)�S�C�T��>��n��U�r��݃�]X9R��u�=�T��S_�:6��]�4hak��JWpkMe%��P_��~O~MW�jOU�F}�b� 3�]�~�/��8�_"��}L��覯|L�}6hE'�7 ��^ڐq�-Y�I��Ѯ.f��҉_<��o6�~_�\z��=�gXˆ4y~1�|/~�J�7O��O&��& lt;��j�t��z�[圱��x9�zwn��T�b�k��)�p��4` ��a|�HR��*7��d)�'��?FQ�[�gp8�O&�L2O[�t̃�`�� Z20479 R47f4b88e V20ba2 G1207220366.P10687Q2.server X1358 130815 B72 7f/7d/7f7dc5d880fa44444e57c6cbe2e4fd477dab1086-4db17526fa51aa4deb5e0000453e4b91 if I do less Drafts/dbox-Mails/u.11 below is the output 00000000 32 20 4d 31 65 20 43 34 64 61 61 35 31 66 36 0a |2 M1e C4daa51f6.| 00000010 01 02 4e 20 20 20 20 20 20 20 20 20 20 30 30 30 |..N 000| 00000020 30 30 30 30 30 30 30 30 30 30 33 30 41 0a 1f 8b |000000000030A...| 00000030 08 00 00 00 00 00 00 03 9d 54 6d 6f db 36 10 fe |.........Tmo.6..| 00000040 ce 5f 71 d3 30 60 c3 42 89 72 ec 44 95 ed 20 a9 |._q.0`.B.r.D.. .| 00000050 ed 74 46 e3 35 58 dc b5 fb 48 49 27 99 a9 44 1a |.tF.5X...HI'..D.| 00000060 a4 e4 54 fd f5 3d 2a 5e d2 75 d8 d0 4d b6 41 f3 |..T..=*^.u..M.A.| 00000070 78 2f cf 3d cf 89 d7 8b 45 0a aa 91 fb 34 8a 64 |x/.=....E....4.d| 00000080 dd e9 b0 ae 4d 5f 34 c6 5a e5 2e dd de a8 1a 6d |....M_4.Z......m| 00000090 74 87 ba 65 ef f9 ba a0 55 b5 3d 7f 8d 3d 05 15 |t..e....U.=..=..| 000000a0 31 db a0 73 b2 42 be 5e a6 30 1b 9f 5f 8f 5f 26 |1..s.B.^.0.._._&| 000000b0 c9 22 1c 8b 89 48 c4 e9 65 65 0e 68 75 43 41 f8 |."...H..ee.huCA.| 000000c0 31 df 49 5d 61 98 9b b0 fb 70 c1 96 b2 c5 14 b6 |1.I]a....p......| 000000d0 bb ee 04 c4 29 5c ed 2d 8c 84 48 20 8e d3 c9 8b |....)\.-..H ....| 000000e0 74 34 86 9f 45 2c 04 bb b6 a6 49 e1 8a 50 c1 8d |t4..E,....I..P..| 000000f0 47 05 9b 01 16 cc fe 06 f4 9f 2b bd e7 1b f3 49 |G.........+....I| 00000100 d5 b5 e4 4b 2b cb 96 af 75 69 08 3b 39 5a 2d eb |...K+...ui.;9Z-.| As it is quite evident, the output is in binary format, but I need it in text (even if that means I use some other command and pipe the output to cat / grep / sed) -- can this be done? This server was configured and maintained by someone else, and I am very new to dovecot or this dbox format (I used to use courier-imap). would appreciate if anyone could please suggest what could/should be done to get to my objectives. All pointers/suggestions appreciated. Thanks and regards Sarder ______________________________________________________________________ Centre for Parliamentary Studies This email and its attachments are intended only for disclosure to the recipients to whom they are addressed. Should you have received it in error, we regret any inconvenience and would request that you notify postmaster(a)parlicentre.org. Any opinions presented are solely those of its author and do not necessarily represent those of the company. Recipients are advised to check for the presence of malware as the company accepts no liability for the accidental transmission thereof. Centre for Parliamentary Studies is a trading name of CPS Framework Ltd. Registered Office: Unit N0002, Westminster Business Square, 1-45 Durham Street, London, SE11 5JH Registered in England & Wales, No. 6926090

3 4

[Dovecot] Renaming maildir files, UIDs and mail clients
by Helge Milde 09 May '11

09 May '11

Hi! First a little background: I'm thinking of compressing my Maildir's using dovecot's zlib support, and have run into a couple of problems. First of all, my files use the following formats: 1. 1260386673.000002.mbox:2,S 2. 1304920966.M241434P17342.mail,W=3152:2,S As you can see, both lack the S=<size> "basename flag", but the latter does have W=. Reading http://wiki.dovecot.org/Plugins/Zlib, I get the impression that I really need S= in the filenames (".. otherwise there will be problems with quota calculation as well as other potential random failures."). I have made a script that compresses my files, adds S=<size> if it's missing (using wc -c before gzip), and appends the Z flag. As I understand it, adding S=<size> will change the UID of the email, while appending Z won't. Now for my questions: 1. How crucial is it to have the S= in the basename when using zlib? The wiki page mentions quota problems, which we're not using, but also "random failures"... 2. Would W= suffice in this regard? I.e. would I be able to compress files of the latter format safely, without adding S= (only appending the Z flag)? 3. If S=<size> *is* needed, is there a way to minimize the effect from the mail client's perspective? From my testruns, it seems Mutt have no problems after I rename the basename, but Thunderbird will refetch the emails, and not delete the old ones, showing duplicate emails. Refetching emails is not a big problem, I think, but only if the email clients understand that the old ones doesn't exist anymore. And if anyone has ideas on how to convert to using zlib without the users knowing, I would be glad to hear it! -- Helge Milde www.monsternett.no

2 1

[Dovecot] Post-login scripting with mail_drop_priv_before_exec in dovecot2
by Mark Zealey 09 May '11

09 May '11

Hi, I'm in the process of upgrading from dovecot v1.1 to dovecot 2. We fetch uid/gid user information from a database and also use post-login scripting with mail_drop_priv_before_exec = yes which means the postlogin script is executed with the permissions of the user we have found in the database. According to the dovecot2 wiki page, to get this behaviour in version 2 we have to set the post-login script to run as root and then su to the user. This seems a bit of a strange (and insecure as you might forget) way of doing this. Are there any other options, such as fetching a certain column name from the database to set the value of service imap-postlogin { user } or setting something like user = $user in the configuration? (or is the configuration only read at startup so such dynamic configuration can't be done in the service section?) Cheers, Mark

2 2

Re: [Dovecot] sieve filters not being invoked
by Colin Brace 09 May '11

09 May '11

On Mon, 09 May 2011 13:00:45 +0200, Colin Brace wrote: > In the dovecot-lda log, I am now seeing some action, but there is a > > permissions problem somewhere: > > May 09 12:43:13 lda: Debug: Loading modules from directory: > /usr/local/lib/dovecot > May 09 12:43:13 lda: Debug: Module loaded: > /usr/local/lib/dovecot/lib90_sieve_plugin.so > May 09 12:43:13 lda: Error: userdb lookup: > connect(/var/run/dovecot//auth-userdb) failed: Permission denied > (euid=200(vmail) egid=6(mail) missing +w perm: > /var/run/dovecot//auth-userdb, euid is not dir owner) > May 09 12:43:13 lda: Fatal: Internal error occurred. Refer to server > log for more information. Following up my earlier mail, perhaps I am being obtuse here; I've changed the permissions of auth-userdb to 666, although I have no idea what these files in /var/run/dovecot are. These appears to solve the problem above. Renabling dovecot lda in Postfix, I try sending myself a message; however it gets bounced: "user unknown" (/var/log/maillog): [...] May 9 17:33:08 venus postfix/pipe[73445]: 8BCF629F3F: to=, relay=dovecot, delay=0.34, delays=0.3/0/0/0.03, dsn=5.1.1, status=bounced (user unknown) May 9 17:33:08 venus postfix/cleanup[73442]: C61332A0AB: message-id= May 9 17:33:08 venus postfix/bounce[73447]: 8BCF629F3F: sender non-delivery notification: C61332A0AB May 9 17:33:08 venus postfix/qmgr[73435]: C61332A0AB: from=, size=3183, nrcpt=1 (queue active) May 9 17:33:08 venus postfix/qmgr[73435]: 8BCF629F3F: removed May 9 17:33:08 venus postfix/smtpd[73444]: disconnect from localhost[127.0.0.1] May 9 17:33:08 venus postfix/lmtp[73443]: C5E4729ED5: to=, relay=venus[/var/run/dspam.sock], delay=1.1, delays=0.45/0/0/0.61, dsn=2.6.0, status=sent (250 2.6.0 Message accepted for delivery) May 9 17:33:08 venus postfix/qmgr[73435]: C5E4729ED5: removed If I comment out this line in main.cf, and restart Postfix, things work again: # virtual_transport = dovecot Any ideas on what is going wrong here? I feel I am almost there. -- Colin Brace Amsterdam http://lim.nl -- Colin Brace Amsterdam http://lim.nl

2 1

[Dovecot] sieve filters not being invoked
by Colin Brace 09 May '11

09 May '11

Hi all, Similar to someone who posted here yesterday, I am having trouble getting sieve filters working. I have installed pigeonhole. I can create, edit, and save scripts from both the Thunderbird sieve extension as well as the Roundcube sieve plugin via managesieve running on port 4190. The .sieve file is properly saved in ~/sieve with a symlink from ~/.dovecot.sieve. But the filters are not being invoked on incoming mail. I have mail_debug enabled, but I don't see anything useful in /var/log/dovecot. Anyone have any ideas? Thanks $ dovecot -n # 2.0.11: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.1-RELEASE amd64 ufs auth_verbose = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_gid = 0 info_log_path = /var/log/dovecot log_path = /var/log/dovecot mail_access_groups = mail mail_debug = yes mail_location = maildir:/home/colin/vmail/%d/%n managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { args = /usr/local/etc/dovecot-passwd driver = passwd-file } plugin/sieve = ~/.dovecot.sieve plugin/sieve_dir = ~/sieve plugin/sieve_global_dir = /var/lib/dovecot/sieve/global/ plugin/sieve_global_path = /var/lib/dovecot/sieve/default.sieve protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = mail mode = 0660 user = vmail } user = root } service imap-login { executable = /usr/local/libexec/dovecot/imap-login vsz_limit = 64 M } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { executable = /usr/local/libexec/dovecot/imap-login vsz_limit = 64 M } ssl_cert = </etc/ssl/venus.crt ssl_key = </etc/ssl/venus.key userdb { driver = passwd } userdb { args = uid=vmail gid=vmail home=/home/colin/vmail/%d/%n driver = static } verbose_proctitle = yes protocol lda { mail_plugins = sieve } ----- Colin Brace Amsterdam http://lim.nl -- View this message in context: http://old.nabble.com/sieve-filters-not-being-invoked-tp31569757p31569757.h… Sent from the Dovecot mailing list archive at Nabble.com.

3 3

[Dovecot] mbox/maildir mixed setup with system/virtual mixed users
by Victor TARHON-ONU 09 May '11

09 May '11

Hello Everyone, I'm using dovecot 1.0.7 (not sure how relevant it is though) configured to handle both sytem users and virtual users. The system users are handled by default (PAM), while the virtual users are handled pretty much like this: passdb passwd-file { args = /var/spool/vmail/%d/auth/%n } ...And mailbox and folder location settings: userdb static { args = uid=mail gid=mail home=/var/spool/vmail/%d/mail/%n mail=mbox:/var/spool/vmail/%d/imap/%n:INBOX=mbox:/var/spool/vmail/%d/mail/%n } Everything works perfectly with the inbox and mail foder in mbox format. Now, what I'm trying to accomplish is to reconfigure dovecot to create and handle the secondary mail folders (/home/user/mail for system users and /var/spool/vmail/domainname/imap/user/imap for virtual users) in maildir format. I tried to define some name spaces to make this happen, but whatever I to do make one work (either the virtual users or the system users) would make the other non-functional. By example, I have these name space definitions and the virtual users work fine with maildir: namespace private { separator = / prefix = "#mbox/" location = mbox:/var/spool/vmail/%d/imap/%n:INBOX=/var/spool/vmail/%d/mail/%n inbox = yes hidden = yes } namespace private { separator = / prefix = location = maildir:/var/spool/vmail/%d/imap/%n hidden = yes } Maybe I didn't fully understand the namespace concept, but I was unable to make them apply only to one location of the imap folders locations or another. Can anyone give me a hand with this, if this setup is even possible? --

2 1

[Dovecot] Spelling error in #define ?
by Peter Mogensen 09 May '11

09 May '11

Hi, I stumbled over this define in lazy-expunge-plugin.h: #ifndef LAZY_EXPUNGE_PLUGIN_H #define TLAZY_EXPUNGE_PLUGIN_H Isn't there a "T" too much? http://hg.dovecot.org/dovecot-2.0/file/036260ae0261/src/plugins/lazy-expung… /Peter

2 1

[Dovecot] Saving mails to +detail failed: Namespace error
by Peer Heinlein 09 May '11

09 May '11

We have the following namespace: namespace { inbox = yes list = yes location = prefix = INBOX/ separator = / subscriptions = yes type = private } namespace { list = children location = maildir:%%h:INDEX=%h/shared/%%u:CONTROL=%h/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } and we set: lmtp_save_to_detail_mailbox = yes recipient_delimiter = + But sending Mails to user+detail is failing: May 3 12:40:06 dobby2 postfix/cleanup[8245]: 12E787756C: message- id=<201105031239.40804.p.heinlein(a)heinlein-support.de> May 3 12:40:06 dobby2 postfix/qmgr[23304]: 12E787756C: from=<p.heinlein(a)heinlein-support.de>, size=1963, nrcpt=1 (queue active) May 3 12:40:06 dobby2 dovecot: lmtp(6537): Debug: auth input: p.heinlein(a)jpberlin.de home=/mail/jpberlin.de/p.heinlein/Maildir/ uid=10000 gid=10000 May 3 12:40:06 dobby2 dovecot: lmtp(6537, p.heinlein(a)jpberlin.de) Debug: Effective uid=10000, gid=10000, home=/mail/jpberlin.de/p.heinlein/Maildir/ May 3 12:40:06 dobby2 dovecot: lmtp(6537, p.heinlein(a)jpberlin.de) Debug: Namespace : type=private, prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~:INDEX=/cache/jpberlin.de/p.heinlein May 3 12:40:06 dobby2 dovecot: lmtp(6537, p.heinlein(a)jpberlin.de) Debug: maildir++: root=/mail/jpberlin.de/p.heinlein/Maildir/, index=/cache/jpberlin.de/p.heinlein, control=, inbox=/mail/jpberlin.de/p.heinlein/Maildir/ May 3 12:40:06 dobby2 dovecot: lmtp(6537, p.heinlein(a)jpberlin.de) Debug: Namespace : type=shared, prefix=shared/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir: %h:INDEX=/mail/jpberlin.de/p.heinlein/Maildir//shared/%u:CONTROL=/mail/jpberlin.de/p.heinlein/Maildir//shared/%u May 3 12:40:06 dobby2 dovecot: lmtp(6537, p.heinlein(a)jpberlin.de) Debug: shared: root=/var/run/dovecot/, index=, control=, inbox= May 3 12:40:06 dobby2 dovecot: lmtp(6537, p.heinlein(a)jpberlin.de) Debug: Pg/fKrHav02JGQAAir+T1Q: sieve: user's script path /mail/jpberlin.de/p.heinlein/Maildir//../.dovecot.sieve doesn't exist (using global script path in stead) May 3 12:40:06 dobby2 dovecot: lmtp(6537, p.heinlein(a)jpberlin.de) Debug: Pg/fKrHav02JGQAAir+T1Q: sieve: user has no valid personal script May 3 12:40:06 dobby2 dovecot: lmtp(6537, p.heinlein(a)jpberlin.de) Debug: Pg/fKrHav02JGQAAir+T1Q: sieve: no scripts to execute: reverting to default delivery. May 3 12:40:06 dobby2 dovecot: lmtp(6537, p.heinlein(a)jpberlin.de) Pg/fKrHav02JGQAAir+T1Q: msgid=<201105031239.40804.p.heinlein@heinlein- support.de>: save failed to Cong: Unknown namespace May 3 12:40:06 dobby2 dovecot: lmtp(6537, p.heinlein(a)jpberlin.de) Pg/fKrHav02JGQAAir+T1Q: msgid=<201105031239.40804.p.heinlein@heinlein- support.de>: saved mail to INBOX May 3 12:40:06 dobby2 postfix/lmtp[8338]: 12E787756C: to=<p.heinlein+Cong(a)jpberlin.de>, relay=dobby.heinlein- support.de[private/lmtp-dovecot], delay=0.1, delays=0.06/0.02/0/0.02, dsn=2.0.0, status=sent (250 2.0.0 <p.heinlein+Cong(a)jpberlin.de> Pg/fKrHav02JGQAAir+T1Q Saved) But a folder named "Cong" exists: # ls -la .Cong -d drwx------ 5 vmail vmail 4096 30. Apr 04:46 .Cong # What's going wrong? My mistake or is it a bug? peer -- Die Mailserver-Konferenz: Das Know-how-Update für Postmaster 26./27. Mai 2011 - http://www.heinlein-support.de/mk Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030 / 40 50 51 - 0 Fax: 030 / 40 50 51 - 19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

[Dovecot] Restricting IMAP
by Matt 09 May '11

09 May '11

I want to restrict IMAP use too 127.0.0.1 and to only certain usernames. Such as fred(a)my777domain.com would be allowed to use IMAP. How would I do that with Dovecot or can I? Basically I want webmail to work with IMAP regardless of username but I only want certain usernames allowed to use IMAP remotely.

3 2

[Dovecot] example-config mail_log plugin options
by Lutz Preßler 09 May '11

09 May '11

Hello, dovecot-2.0.12/doc/example-config/conf.d/10-logging.conf contains # mail_log plugin provides more event logging for mail processes. plugin { # Events to log. Also available: flag_change append #mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename # Group events within a transaction to one line. #mail_log_group_events = no # Available fields: uid, box, msgid, from, subject, size, vsize, flags # size and vsize are available only for expunge and copy events. #mail_log_fields = uid box msgid size } "mail_log_group_events" seems to be gone (when and why?). And it's now "save" instead of "append", with "mailbox_create" also available. Greetings, Lutz Pressler -- Lutz Preßler <Lutz.Pressler(a)SerNet.DE> http://www.SerNet.DE/ SerNet Service Network GmbH, Bahnhofsallee 1b, D-37081 Göttingen Tel.: +49-551-370000-2, FAX: +49-551-370000-9 AG Göttingen, HRB 2816, GF: Dr. Johannes Loxen

2 1