- dovecot - dovecot.org

[Dovecot] Core dump in 2.2.rc2 with FETCH 1 BODY.PEEK[ALL]
by Steffen Kaiser 20 Mar '13

20 Mar '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Usingt ./sbin/dovecot --version 2.2.rc2 (7a08461c5559) with Maildir, 2 FETCH 1 BODY.PEEK[ALL] dumps core, bt full is: #0 0x00007fa166e721b5 in raise () from /lib/libc.so.6 No symbol table info available. #1 0x00007fa166e74fc0 in abort () from /lib/libc.so.6 No symbol table info available. #2 0x00007fa16721ac47 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:191 backtrace = 0x181e2d0 "/usr/local/dovecot-2.2.rc2/lib/dovecot/libdovecot.so.0(+0x78c20) [0x7fa16721ac20] -> /usr/local/dovecot-2.2.rc2/lib/dovecot/libdovecot.so.0(+0x7a0dd) [0x7fa16721c0dd] -> /usr/local/dovecot-2.2.rc2/lib"... #3 0x00007fa16721c0dd in i_internal_fatal_handler (ctx=0x7fffa3de5d90, format=0x7fa1675bbde1 "file %s: line %d: unreached", args=0x7fffa3de5d70) at failures.c:652 status = 0 #4 0x00007fa16721af90 in i_panic (format=0x7fa1675bbde1 "file %s: line %d: unreached") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 24, fp_offset = 48, overflow_arg_area = 0x7fffa3de5e70, reg_save_area = 0x7fffa3de5da0}} #5 0x00007fa16759d415 in imap_msgpart_parse (section=0x181e278 "ALL", msgpart_r=0x18476c0) at imap-msgpart.c:291 msgpart = 0x1851c40 pool = 0x1851c20 i = 0 next_digit = true ret = 0 #6 0x000000000041e734 in imap_fetch_body_section_init (ctx=0x7fffa3de5fa0) at imap-fetch-body.c:358 body = 0x18476b8 list_args = 0x7fa1672152a7 list_count = 0 str = 0x0 p = 0x181e26e "" error = 0x7fffa3de6460 "\001" __FUNCTION__ = "imap_fetch_body_section_init" #7 0x000000000041d064 in fetch_body_init (ctx=0x7fffa3de5fa0) at imap-fetch.c:670 No locals. #8 0x000000000041b6b5 in imap_fetch_init_handler (init_ctx=0x7fffa3de5fa0) at imap-fetch.c:62 handler = 0x1827e10 lookup_name = 0x181e270 "BODY" p = 0x181e264 ".PEEK[ALL]" __FUNCTION__ = "imap_fetch_init_handler" #9 0x000000000040e6f5 in imap_fetch_cmd_init_handler (ctx=0x1847068, cmd=0x1846f60, name=0x181e260 "BODY.PEEK[ALL]", args=0x7fffa3de5fe8) at cmd-fetch.c:36 init_ctx = {fetch_ctx = 0x1847068, pool = 0x1846f40, name = 0x181e260 "BODY.PEEK[ALL]", args = 0x1829978, error = 0x0} __FUNCTION__ = "imap_fetch_cmd_init_handler" #10 0x000000000040e86d in fetch_parse_args (ctx=0x1847068, cmd=0x1846f60, arg=0x1829978, next_arg_r=0x7fffa3de6078) at cmd-fetch.c:69 str = 0x181e260 "BODY.PEEK[ALL]" macro = 0x0 #11 0x000000000040eef3 in cmd_fetch (cmd=0x1846f60) at cmd-fetch.c:258 client = 0x1846380 ctx = 0x1847068 args = 0x1829918 next_arg = 0x7fa166e75130 list_arg = 0x1847048 search_args = 0x1850c30 qresync_args = {qresync_sample_seqset = 0x1, qresync_sample_uidset = 0x41a22c} messageset = 0x1829a78 "1" send_vanished = false ret = 1 #12 0x000000000041a18f in command_exec (cmd=0x1846f60) at imap-commands.c:156 hook = 0x1827d70 ret = false #13 0x00000000004190f2 in client_command_input (cmd=0x1846f60) at imap-client.c:775 client = 0x1846380 command = 0x20041a274 __FUNCTION__ = "client_command_input" #14 0x00000000004193f2 in client_command_input (cmd=0x1846f60) at imap-client.c:836 client = 0x1846380 command = 0x1827858 __FUNCTION__ = "client_command_input" #15 0x0000000000419512 in client_handle_next_command (client=0x1846380, remove_io_r=0x7fffa3de61bd) at imap-client.c:874 No locals. #16 0x0000000000419592 in client_handle_input (client=0x1846380) at imap-client.c:886 _data_stack_cur_id = 3 ret = false remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #17 0x0000000000419725 in client_input (client=0x1846380) at imap-client.c:928 cmd = 0x183c8a8 output = 0x1846d98 bytes = 26 __FUNCTION__ = "client_input" #18 0x00007fa167231e1b in io_loop_call_io (io=0x1846e60) at ioloop.c:387 ioloop = 0x1826700 t_id = 2 #19 0x00007fa167233aaa in io_loop_handler_run (ioloop=0x1826700) at ioloop-epoll.c:215 ctx = 0x1826a80 events = 0x1826af0 event = 0x1826af0 list = 0x1846eb0 io = 0x1846e60 tv = {tv_sec = 1725, tv_usec = 816704} events_count = 6 msecs = 1725817 ret = 1 i = 0 j = 0 call = true __FUNCTION__ = "io_loop_handler_run" #20 0x00007fa167231ebe in io_loop_run (ioloop=0x1826700) at ioloop.c:406 No locals. #21 0x00007fa1671caa45 in master_service_run (service=0x18265a0, callback=0x4262c6 <client_connected>) at master-service.c:550 No locals. #22 0x00000000004265df in main (argc=1, argv=0x1826390) at main.c:400 set_roots = {0x42f700, 0x0} login_set = {auth_socket_path = 0x181e048 "\200\340\201\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x426078 <login_client_connected>, failure_callback = 0x426252 <login_client_failed>, request_auth_token = 1} service_flags = MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUThQFl3r2wJMiz2NAQI+zwf8CLsphLKRsB2pgFAuoNT9UAcs74DVC5CT JqNw1X4IOau9fY+m0fyZC/xOowjZiPn0yz8ZIYG/6l5dFZxNKzuyUBwh1pHVqcP7 WOrM71+ZW43gT6hibCtaxyW61BQ3XoK/nIDVZM67eVcy7G/DFuGd9RJsV4Bh3iuO g3lXqaeFAeghukMKrvU/YwIXFVyjXsjjy8ZPm3QEtUEKWN8OXaveJ3O4VT/K0VWG 234D47rBT3KFt/kqwTn95LIp10DZzzch2i/QBe992acGi78Mz4F0+VT+lJFa6nlO ZIzAeqhQRXoM8a86N0RJHri4xIMCzPHXjx/5lWL0TDe6N4ITfzEMCQ== =PrvL -----END PGP SIGNATURE-----

3 3

[Dovecot] Lot of dovecot process writes
by Angel L. Mateo 20 Mar '13

20 Mar '13

Hello, While monitoring my servers' behaviour (ubuntu 12.04 with dovecot 2.1.9, with about 70000 users) I have found that lots of disk usage is done by dovecot process (the parent process). Since lmtp, imap and pop3 connections are handle by their own process, what could be the reason of this? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

3 4

[Dovecot] Maildir or Mdbox and expunge messages.
by Evgeny Basov 20 Mar '13

20 Mar '13

Hello. I tested dovecot's work with expunge messages on Mdbox over strace (see at tail of message). As I can see dovecot process opens old storage m.* file, reads it content, opens new temporary file, writes in this one content and rename this new one to m.(*+1). How fast this algorithm works on system with about 10000 users and 5Tb data? I will use mdbox_rotate_interval for delayed expunge but I think that simple delete file in Maildir must be faster than expunge from Mdbox. Please, tell me about real experience work with Mdbox on big loaded systems. ++++++++++++++++ 0.000017 open("/var/vmail/example.org/user/storage/.temp.1362474108.P7152Q0M909647.mailsys", O_RDWR|O_CREAT|O_TRUNC, 0666) = 11 0.000063 umask(077) = 066 0.000015 fallocate(11, 01, 0, 10485760) = 0 0.000054 fstat(11, {st_mode=S_IFREG|0600, st_size=0, ...}) = 0 0.000043 pread(10, "\1\2N 0000000000000285\nFC"..., 8192, 16) = 1465 0.000025 write(11, "2 M1e C5135b47c\n\1\2N 000"..., 691) = 691 0.000041 stat("/var/vmail/example.org/user/indexes/storage/dovecot.map.index.log.2", 0x7fff235b34c0) = -1 ENOENT (No such file or directory) 0.000026 alarm(180) = 0 0.000018 fcntl(9, F_SETLKW, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}) = 0 0.000020 alarm(0) = 180 0.000018 stat("/var/vmail/example.org/user/indexes/storage/dovecot.map.index.log", {st_mode=S_IFREG|0600, st_size=3656, ...}) = 0 0.000031 fstat(9, {st_mode=S_IFREG|0600, st_size=3656, ...}) = 0 0.000041 write(11, "\n\1\3\nR5135ad97\nV29b\nG5840870697ad"..., 62) = 62 0.000023 fdatasync(11) = 0 0.079275 stat("/var/vmail/example.org/user/storage/m.8", 0x7fff235b3640) = -1 ENOENT (No such file or directory) 0.000061 rename("/var/vmail/example.org/user/storage/.temp.1362474108.P7152Q0M909647.mailsys", "/var/vmail/example.org/user/storage/m.8") = 0 0.000164 write(9, "\200\200\200\203\0\0\10\20\210\0\0\0\200\200\200\207@\0\0\20\0\0\0\0\0\0\0\0\10\0\0\0"..., 152) = 152 0.000094 fcntl(9, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 0.000042 unlink("/var/vmail/example.org/user/storage/m.7") = 0 0.000059 stat("/var/vmail/example.org/user/indexes/storage/dovecot.map.index.log", {st_mode=S_IFREG|0600, st_size=3808, ...}) = 0 0.000055 fstat(9, {st_mode=S_IFREG|0600, st_size=3808, ...}) = 0

2 1

[Dovecot] Stability of extraction of attachment
by Angel L. Mateo 20 Mar '13

20 Mar '13

Hello, We are migrating our dovecot servers from 2.1.9 to 2.1.15 (or 2.2 if there is a stable version soon) and maildir format to mdbox. Looking for mdbox options I have found options: * mail_attachment_dir * mail_attachement_min_size * mail_attachment_fs * mail_attachment_hash but this options are described with the message: # WARNING: This feature hasn't been tested much yet. Use at your own risk. What is the state of these options? Could I use it in a production environment? In case of yes, what is the best deduplicating option? Let it to the FS? Or configuring with "sis posix" or "sis-queue posix"? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

2 1

[Dovecot] Exposing masteruser info to cllients via lmtp-proxy connections
by Alexandr Sabitov 20 Mar '13

20 Mar '13

Hello, Please somebody suggest me how to remove the "*masteruser" appendix from the dovecot director database while using masteruser authentication. My situation is: - all users get authenticated in LDAP on the dovecot-director frontend - then they are forwarded to dovecot backend as username*masteruser ( this is a way how to proxy users with encrypted passwords). To enable it a added an extra field in LDAP-dovecot configuration: destuser=%u*masteruser This works OK, but problems are: - I have lmtp-proxy on the dovecot frontend and I have to use the same "%u*masteruser" field in lmtp passdb because the director thinks that me(a)mail.com and me(a)mail.com*masteruser are different users and would send lmtp-proxy connections to other dovecot backend. Here is a problem: "Delivery-To" and "Received" fields in any email contains "*masteruser" ! I need to remove any mentions about "masteruser" authentication from client emails. Also another little problem: - If I run "doveadm status" tool then to get user's data I need to specify user as "username*masteruser" Thank you in advance. Alexandr Sabitov Netregistry

2 1

[Dovecot] Imaptest: Fatal: opendir(/usr/local/lib/dovecot) failed: No such file or directory
by Steffen Kaiser 20 Mar '13

20 Mar '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, is it possible to build imaptest ( http://imapwiki.org/ImapTest ) that the binary has no external dependencies? I followed the Install page: 1) downloaded both "latest" tgz 2) cd dovecot-* && ./configure --without-shared-libs && make 3) cd ../imaptest-* && ./configure --without-shared-libs \ - --with-dovecot=$(dirname $(pwd))/dovecot-20130221 && make 4) strace -e open -f -o log src/imaptest Fatal: opendir(/usr/local/lib/dovecot) failed: No such file or directory 5) cat log 4534 open("/etc/ld.so.cache", O_RDONLY) = 3 4534 open("/lib/libdl.so.2", O_RDONLY) = 3 4534 open("/lib/librt.so.1", O_RDONLY) = 3 4534 open("/lib/libc.so.6", O_RDONLY) = 3 4534 open("/lib/libpthread.so.0", O_RDONLY) = 3 4534 open("/usr/local/lib/dovecot", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = -1 ENOENT (No such file or directory) Kind regards, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUS84zV3r2wJMiz2NAQInNwf/bJmjQaBxzjr/dmVDMwN2ptBvm5mFmUFy YYVwdQMfr1oDf8Jr9XIuag4gYCrgdzIxppUo+7scu+F72dCEF7uNvh2h1EdVhY+i Dy+z8fWLwyl332dGsL1XW93wtY8CJ/ybd34fEh/15M7uKaWYioocp2kyb8uZ4CPJ faIJ8Xaqpem8Rx1Erthkw+YKrVqMQiO7cnPgsCSdoxCFTFU3wJW7+mq2DVjyUUqv bIVgH8RSF79u5xKa54YAZBxW/KaQtkhcCWZAzEQFxmUl6qvOiAs/5/HmYDeftihS jp0ApB05mdsPQ/hCYd9f9Vt8Wyk5b4/QEeh4rzGeqOPn3boo7dp9Nw== =D56V -----END PGP SIGNATURE-----

2 4

[Dovecot] v2.2 status update
by Timo Sirainen 20 Mar '13

20 Mar '13

So, I'm still planning on getting v2.2.0 out Really Soon now. Unfortunately I've had to quickly develop some rather large features still at this stage. I was initially planning on leaving them for v2.3, but they were a requirement for one project and implementing them now to v2.2 was the least amount of trouble for me. (And yes, I'm aware I haven't replied to a lot of emails in this list. There are about 60 unread ones. Hopefully I'll have time to go through them this week.) So, what we have now: * dsync can sync ACLs * dsync can sync Sieve scripts - Slightly unfinished patch for Pigeonhole at http://dovecot.org/patches/2.2/doveadm-sieve-plugin.diff * dsync does the ACL/Sieve syncing by having implemented generic mailbox attribute syncing. (The ACLs/Sieve scripts are transparently mapped into the attribute hierarchy.) ACL plugin also supports now restricting attribute set/get/iteration. IMAP METADATA extension can be implemented using mailbox attributes. The dsync/ACL support was the main reason why I had planned on delaying native IMAP METADATA support until v2.3, but there's really no reason for that anymore. So expect IMAP METADATA support also early in v2.2.x (disabled by default). I'll still need to figure out how to do quota for it. * LDAP values can now have DN pointers to other entries that are queried. (Support for LDAP URLs could probably also be added with little trouble.) The configuration becomes a bit more complex again, but until the whole LDAP configuration is redesigned this will work. Example: user_attrs = \ =user=%{ldap:uid}, \ @mail=%{ldap:mailDN}, \ =uid=%{ldap:uidNumber@mail}, \ =gid=%{ldap:gidNumber@mail}, \ =home=%{ldap:rootPath@mail}/%d/%n

2 4

[Dovecot] dovecot 2 in ubuntu 12.04 or Debian Squeeze
by pvsuja 20 Mar '13

20 Mar '13

Dear sir, I have to set up a mail gateway which will be explored to Internet and a secure mail server in the Intranet. I need a smart imap proxy in the mail gateway which will fetch the mail from server and present to user through either a stand alone mail client or a web mail client. All authentication is through ldap server. I have installed Dovecot 2.2 Unstable in my Ubuntu 12.04 with ssl enabled But when I am starting dovecot, I am getting the following error *doveconf: Fatal: Error in configuration file /usr/local/etc/dovecot/conf.d/10-ssl.conf line 12: Unknown setting: ssl_cert* I couldn't figure out what is wrong. Please help me to sort it out. Thanks & Regards, Suja PV LEOS -- View this message in context: http://dovecot.2317879.n4.nabble.com/dovecot-2-in-ubuntu-12-04-or-Debian-Sq… Sent from the Dovecot mailing list archive at Nabble.com.

5 14

Re: [Dovecot] Question regarding Postfix and Dovecot
by Daniel Reinhardt 19 Mar '13

19 Mar '13

Replying back to the list. On Thu, Mar 14, 2013 at 10:51 AM, mourik jan c heupink < heupink(a)merit.unu.edu> wrote: > please reply to the list > > > On 3/14/2013 11:38 AM, Daniel Reinhardt wrote: > >> Yes I have read everything on that, and yet postfix does not even see >> the dovecot virtual transport. >> >> >> On Thu, Mar 14, 2013 at 10:37 AM, mourik jan c heupink >> <heupink(a)merit.unu.edu <mailto:heupink@merit.unu.edu>**> wrote: >> >> Hi Daniel, >> >> I'm new to dovecot myself, but did you read this: >> http://wiki2.dovecot.org/LDA/_**_Postfix<http://wiki2.dovecot.org/LDA/__Postfix> >> >> <http://wiki2.dovecot.org/LDA/**Postfix<http://wiki2.dovecot.org/LDA/Postfix> >> > >> >> I'm guessing that perhaps you need to configure your virtual >> transport? So, in master.cf <http://master.cf>, include a line like: >> >> >> dovecot unix - n n - - pipe >> flags=DRhu user=vmail:vmail >> argv=/usr/local/libexec/__**dovecot/dovecot-lda -f ${sender} -d >> ${recipient} >> >> and configure virtual_transport = dovecot in main.cf <http://main.cf> >> >> >> But again... I'm very new to all this myself, but perhaps it helps? >> >> Regards, >> MJ >> >> >> >> >> -- >> Daniel Reinhardt >> cryptodan(a)cryptodan.net <mailto:cryptodan@cryptodan.**net<cryptodan(a)cryptodan.net> >> > >> http://www.cryptodan.net >> 301-875-7018(c) >> 410-455-0488(h) >> > -- Daniel Reinhardt cryptodan(a)cryptodan.net http://www.cryptodan.net 301-875-7018(c) 410-455-0488(h)

20 53

Re: [Dovecot] Dovecot - Sieve script loaded but filtering doesn't works ?
by Clement PAULET 19 Mar '13

19 Mar '13

Hello Steffen, Thanks for your help, your message has reminds me that I forget the header specification. This new sieve script works for me : require ["fileinto"]; if allof (header :contains "To" "abuse(a)info.xx.com") { fileinto "INBOX.Test"; redirect "clement.xx(a)xx.net"; stop; } Thanks, Clement ----- Date: Mon, 18 Mar 2013 14:28:17 +0100 (CET) From: Steffen Kaiser <skdovecot(a)smail.inf.fh-brs.de> To: Dovecot Mailing List <dovecot(a)dovecot.org> Subject: Re: [Dovecot] Dovecot - Sieve script loaded but filtering doesn't works ? Message-ID: <alpine.DEB.2.02.1303181419590.3303(a)pc-2m63.inf.fh-bonn-rhein-sieg.de> Content-Type: TEXT/PLAIN; format=flowed; charset=US-ASCII -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 18 Mar 2013, Clement PAULET wrote: Dear Clement, This is my script (using for my test) : require "fileinto"; if address "To" "info(a)info.xx.com" { fileinto "Test"; } Works for me in v2.2. Did you verified that the header "To" really exists in the message and that "info(a)info.xx.com" is part of it? The log you've posted displays the envelope information, which is not necessary the same as the header information. Also, remove the precompiled Sieve script, in order to ensure that the pre-compiled one is really one from the script. You could also decompile it to make sure, it has been created from your test script. You'll find sieve-dump in src/sieve-tools/, if you compile from sources, or maybe in /usr/local/bin.

1 0