- dovecot - dovecot.org

[Dovecot] fts-solr indexer-worker connects to wrong solr host dovecot-2.2.4
by Richard Platel 26 Oct '13

26 Oct '13

Hello. We're setting up fts solr and want to have the solr server host be set per-user via UserDB. It looks like if a user connects and fts indexes mail, and then another user connects and indexes mail, indexer-worker is connecting to the first user's fts host: User1, hammer(a)rp-auth-test.com connects, does a SEARCH for the first time, indexer-worker gets UserDB settings and correctly indexes mail on ftsvs01: [...] auth-worker(2195): Debug: dict(hammer(a)rp-auth-test.com): lookup shared/userdb/hammer(a)rp-auth-test.com auth-worker(2195): Debug: dict(hammer(a)rp-auth-test.com): result: {"uid":"8","fts":"solr","quota_rule4":"Spam:ignore","_session":"talk15_590ec6d100042","quota_rule3":"Trash:ignore","quota_rule2":"*:messages=2684354","quota_rule":"*:storage=5242880k","mail":"maildir:/mail/mailstore01/215/573/hammer@rp-auth-test.com/:INDEX=/mail/index01/215/573/hammer@rp-auth-test.com/","fts_solr":"debug url=http://ftsvs01:8080/solr/","gid":"8"} auth: Debug: userdb out: USER 1 hammer(a)rp-auth-test.com uid=8 fts=solr quota_rule4=Spam:ignore _session=talk15_590ec6d100042 quota_rule3=Trash:ignore quota_rule2=*:messages=2684354 quota_rule=*:storage=5242880k mail=maildir:/mail/mailstore01/215/573/hammer@rp-auth-test.com/:INDEX=/mail/index01/215/573/hammer@rp-auth-test.com/ fts_solr=debug url=http://ftsvs01:8080/solr/ gid=8 indexer-worker: Debug: auth input: hammer(a)rp-auth-test.com uid=8 fts=solr quota_rule4=Spam:ignore _session=talk15_590ec6d100042 quota_rule3=Trash:ignore quota_rule2=*:messages=2684354 quota_rule=*:storage=5242880k mail=maildir:/mail/mailstore01/215/573/hammer@rp-auth-test.com/:INDEX=/mail/index01/215/573/hammer@rp-auth-test.com/ fts_solr=debug url=http://ftsvs01:8080/solr/ gid=8 indexer-worker: Debug: Added userdb setting: plugin/_session=talk15_590ec6d100042 indexer-worker: Debug: Added userdb setting: plugin/fts=solr indexer-worker: Debug: Added userdb setting: plugin/fts_solr=debug url=http://ftsvs01:8080/solr/ indexer-worker: Debug: Added userdb setting: mail=maildir:/mail/mailstore01/215/573/hammer@rp-auth-test.com/:INDEX=/mail/index01/215/573/ha mmer(a)rp-auth-test.com/ indexer-worker: Debug: Added userdb setting: plugin/quota_rule=*:storage=5242880k indexer-worker: Debug: Added userdb setting: plugin/quota_rule2=*:messages=2684354 indexer-worker: Debug: Added userdb setting: plugin/quota_rule3=Trash:ignore indexer-worker: Debug: Added userdb setting: plugin/quota_rule4=Spam:ignore indexer-worker(hammer(a)rp-auth-test.com): Debug: Effective uid=8, gid=8, home= indexer-worker(hammer(a)rp-auth-test.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions =yes location=maildir:/mail/mailstore01/215/573/hammer@rp-auth-test.com/:INDEX=/mail/index01/215/573/hammer@rp-auth-test.com/ indexer-worker(hammer(a)rp-auth-test.com): Debug: maildir++: root=/mail/mailstore01/215/573/hammer(a)rp-auth-test.com, index=/mail/index01/215/ 573/hammer(a)rp-auth-test.com, indexpvt=, control=, inbox=/mail/mailstore01/215/573/hammer(a)rp-auth-test.com, alt= indexer-worker(hammer(a)rp-auth-test.com): Debug: Ignoring unknown cache field: pop3.order indexer-worker(hammer(a)rp-auth-test.com): Debug: Ignoring unknown cache field: binary.parts indexer-worker(hammer(a)rp-auth-test.com): Warning: Created dotlock file's timestamp is different than current time (1380294685 vs 1380294612 ): /mail/index01/215/573/hammer(a)rp-auth-test.com/.INBOX/dovecot.index.log indexer-worker(hammer(a)rp-auth-test.com): Debug: http-client: request [POST http://ftsvs01:8080/solr/update] Submitted [...] User1 index finishes and imap searches against ftsvs01 [...] imap(hammer(a)rp-auth-test.com): Debug: http-client: request [GET http://ftsvs01:8080/solr/select?fl=uid,score&rows=2&sort=uid+asc&q=(hdr:%22…] Submitted [...] User2 grant(a)rp-auth-test.com connects and does a SEARCH, index worker gets gets UserDB settings, including fts host ftsvs02, but connects to ftsvs01 (also note index-worker initially shows wrong user in loglines) [...] auth-worker(2195): Debug: dict(grant(a)rp-auth-test.com): lookup shared/userdb/grant(a)rp-auth-test.com auth-worker(2195): Debug: dict(grant(a)rp-auth-test.com): result: {"uid":"8","fts":"solr","quota_rule4":"Spam:ignore","_session":"cow80_609fed7600001","quota_rule3":"Trash:ignore","quota_rule2":"*:messages=2684354","quota_rule":"*:storage=5242880k","mail":"maildir:/mail/mailstore01/812/023/grant@rp-auth-test.com/:INDEX=/mail/index01/812/023/grant@rp-auth-test.com/","fts_solr":"debug url=http://ftsvs02:8080/solr/","gid":"8"} auth: Debug: userdb out: USER 2 grant(a)rp-auth-test.com uid=8 fts=solr quota_rule4=Spam:ignore _session=cow80_609fed7600001 quota_rule3=Trash:ignore quota_rule2=*:messages=2684354 quota_rule=*:storage=5242880k mail=maildir:/mail/mailstore01/812/023/grant@rp-auth-test.com/:INDEX=/mail/index01/812/023/grant@rp-auth-test.com/ fts_solr=debug url=http://ftsvs02:8080/solr/ gid=8 indexer-worker(hammer(a)rp-auth-test.com): Debug: auth input: grant(a)rp-auth-test.com uid=8 fts=solr quota_rule4=Spam:ignore _session=cow80_609fed7600001 quota_rule3=Trash:ignore quota_rule2=*:messages=2684354 quota_rule=*:storage=5242880k mail=maildir:/mail/mailstore01/812/023/grant@rp-auth-test.com/:INDEX=/mail/index01/812/023/grant@rp-auth-test.com/ fts_solr=debug url=http://ftsvs02:8080/solr/ gid=8 indexer-worker(hammer(a)rp-auth-test.com): Debug: Added userdb setting: plugin/_session=cow80_609fed7600001 indexer-worker(hammer(a)rp-auth-test.com): Debug: Added userdb setting: plugin/fts=solr indexer-worker(hammer(a)rp-auth-test.com): Debug: Added userdb setting: plugin/fts_solr=debug url=http://ftsvs02:8080/solr/ indexer-worker(hammer(a)rp-auth-test.com): Debug: Added userdb setting: mail=maildir:/mail/mailstore01/812/023/grant@rp-auth-test.com/:INDEX=/mail/index01/812/023/grant@rp-auth-test.com/ indexer-worker(hammer(a)rp-auth-test.com): Debug: Added userdb setting: plugin/quota_rule=*:storage=5242880k indexer-worker(hammer(a)rp-auth-test.com): Debug: Added userdb setting: plugin/quota_rule2=*:messages=2684354 indexer-worker(hammer(a)rp-auth-test.com): Debug: Added userdb setting: plugin/quota_rule3=Trash:ignore indexer-worker(hammer(a)rp-auth-test.com): Debug: Added userdb setting: plugin/quota_rule4=Spam:ignore indexer-worker(grant(a)rp-auth-test.com): Debug: Effective uid=8, gid=8, home= indexer-worker(grant(a)rp-auth-test.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/mail/mailstore01/812/023/grant@rp-auth-test.com/:INDEX=/mail/index01/812/023/grant@rp-auth-test.com/ indexer-worker(grant(a)rp-auth-test.com): Debug: maildir++: root=/mail/mailstore01/812/023/grant(a)rp-auth-test.com, index=/mail/index01/812/023/grant(a)rp-auth-test.com, indexpvt=, control=, inbox=/mail/mailstore01/812/023/grant(a)rp-auth-test.com, alt= indexer-worker(grant(a)rp-auth-test.com): Debug: Ignoring unknown cache field: pop3.order indexer-worker(grant(a)rp-auth-test.com): Debug: Ignoring unknown cache field: binary.parts indexer-worker(grant(a)rp-auth-test.com): Warning: Created dotlock file's timestamp is different than current time (1380294736 vs 1380294664): /mail/index01/812/023/grant(a)rp-auth-test.com/.INBOX/dovecot.index.cache indexer-worker(grant(a)rp-auth-test.com): Warning: Created dotlock file's timestamp is different than current time (1380294736 vs 1380294664): /mail/index01/812/023/grant(a)rp-auth-test.com/.INBOX/dovecot.index.log indexer-worker(grant(a)rp-auth-test.com): Warning: Created dotlock file's timestamp is different than current time (1380294736 vs 1380294664): /mail/index01/812/023/grant(a)rp-auth-test.com/.INBOX/dovecot.index.cache indexer-worker(grant(a)rp-auth-test.com): Debug: http-client: request [POST http://ftsvs01:8080/solr/update] Submitted [...] indexer-worker indexes User2's mail on wrong fts host: [...] indexer-worker(grant(a)rp-auth-test.com): Debug: http-client: request [POST http://ftsvs01:8080/solr/update] Sent header indexer-worker(grant(a)rp-auth-test.com): Debug: http-client: request [POST http://ftsvs01:8080/solr/update] Partially sent payload indexer-worker(grant(a)rp-auth-test.com): Debug: http-client: request [POST http://ftsvs01:8080/solr/update] Partially sent payload indexer-worker(grant(a)rp-auth-test.com): Debug: http-client: request [POST http://ftsvs01:8080/solr/update] Partially sent payload indexer-worker(grant(a)rp-auth-test.com): Debug: http-client: request [POST http://ftsvs01:8080/solr/update] Partially sent payload indexer-worker(grant(a)rp-auth-test.com): Debug: http-client: request [POST http://ftsvs01:8080/solr/update] Partially sent payload indexer-worker(grant(a)rp-auth-test.com): Debug: http-client: request [POST http://ftsvs01:8080/solr/update] Partially sent payload [...] indexer-worker finishes and imap searches against correct fts host ftsvs02 [...] imap(grant(a)rp-auth-test.com): Debug: http-client: request [GET http://ftsvs02:8080/solr/select?fl=uid,score&rows=194&sort=uid+asc&q=(hdr:%…] Submitted [...]

2 3

[Dovecot] Dovecot proxy hooks
by dac＠getodata.ro 26 Oct '13

26 Oct '13

I am interested in the possibility of using Dovecot IMAP/POP proxying capabilities to analyze emails that are passing through and possibly modify content on the fly. This subject has been discussed here [1] before. I have tried the mail-filter plugin [2], but the hooks it uses are only called in a non-proxy setup. Is there a practical way of doing this, or plans to add such a feature? Links: [1]: http://dovecot.org/list/dovecot/2006-February/011704.html [2]: http://www.dovecot.org/patches/2.2/mail-filter.tar.gz

2 1

[Dovecot] Plugin issue with update from 2.0.19 to 2.1.17
by Reinaldo Matukuma 26 Oct '13

26 Oct '13

Hello. Probably only Timo can help-me with this. I have a self-made plugin based on the zlib plugin that i use to cryptograph the messages at inbox. As a side-effect of the cryptography, my plugin changes the size of the message, but until 2.0.19 this works well with dovecot index and the W/S flags. But now, i'm going to upgrade to 2.1.17 and now i have these messages on log at my test ambiance: Oct 15 20:19:25 test dovecot: imap(reinaldo(a)exemplo.com.br): Error: Cached message size smaller than expected (367 < 529) Oct 15 20:19:25 test dovecot: imap(reinaldo(a)exemplo.com.br): Error: Maildir filename has wrong S value, renamed the file from /storage/test/messages/exemplo.com.br/reinaldo/Maildir/.Sent/cur/1381879158.M634385P5208.test,S=367,W=378:2,S to /storage/test/messages/exemplo.com.br/reinaldo/Maildir/.Sent/cur/1381879158.M634385P5208.test,S=529:2,S Oct 15 20:19:25 test dovecot: imap(reinaldo(a)exemplo.com.br): Error: Corrupted index cache file /storage/test/messages/exemplo.com.br/reinaldo/Maildir/.Sent/dovecot.index.cache: Broken physical size for mail UID 6 I understood with these messages that the dovecot is arguing to get the real size of the file now, overriding the return of size from my crypto plugin. But i don't understood if this is a consequence from the changes to correct the index issue (the dovecot.index.cache issue). So... I want know if the correct way to fix this would be change my plugin to return the real size of the file (that will be larger than the effective message that the plugin returne after the de-cryptography) or if i need use some new function to the plugin replace the expected size based on the real size of the message, not of the file. Thanks Reinaldo

3 4

[Dovecot] unusual dsync lines
by Anand Kumria 26 Oct '13

26 Oct '13

Hi, Another day, another dysnc attempt. Using Dovecot v2.2.5.4; I see: # doveadm -v -o imapc_user=user(a)example.com -o imapc_password=password -o imapc_host=imap.example.com -o imapc_port=993 -o imapc_ssl=imaps -o imapc_ssl_dir=/etc/ssl -o imapc_feature=rfc822.size -o imapc_ssl_verify=no sync -1 -R -u user(a)example.com imapc: dsync(user(a)example.com): Info: copy from Drafts: box=Drafts, uid=8343, msgid=<4F387A25.5010900(a)example.com>, size=2954969 dsync(user(a)example.com): Info: copy from Drafts: box=Drafts, uid=8344, msgid=<5237B0BF.7030402(a)example.com>, size=3371710 dsync(user(a)example.com): Info: copy from Drafts: box=Drafts, uid=8345, msgid=<5237B588.6040009(a)example.com>, size=3266 dsync(user(a)example.com): Info: copy from Drafts: box=Drafts, uid=8346, msgid=<5237B6B4.2030203(a)example.com>, size=4201 dsync(user(a)example.com): Info: copy from Drafts: box=Drafts, uid=8347, msgid=<5237B888.7030807(a)example.com>, size=3371445 dsync(user(a)example.com): Info: copy from Drafts: box=Drafts, uid=8348, msgid=<5237C224.9010608(a)example.com>, size=3371745 dsync(user(a)example.com): Info: copy from Drafts: box=Drafts, uid=8349, msgid=<5237C350.5080608(a)example.com>, size=3371700 dsync(user(a)example.com): Info: copy from Drafts: box=Drafts, uid=8350, msgid=<5237C5EE.5030408(a)example.com>, size=3371619 dsync(user(a)example.com): Info: expunge: box=Drafts, uid=8209, msgid=< 4F387A25.5010900(a)example.com>, size=2954969 The interesting lines being uid=8209 and uid=8343; why would dsync both copy and then expunge the same message from the same mailbox? Regards, Anand

2 3

[Dovecot] Strange output from LIST command
by azurIt 26 Oct '13

26 Oct '13

Hi, i'm using Dovecot 2.1.7 (Debian Wheezy) and output from LIST command looks strange: C: 4 LIST () "" (INBOX INBOX.Karantena INBOX.Spam) RETURN (STATUS (UNSEEN)) S: * LIST () "." "INBOX" S: * LIST () "." "INBOX.Karantena" S: * STATUS "INBOX.Karantena" (UNSEEN 0) S: * LIST () "." "INBOX.Spam" S: * STATUS "INBOX.Spam" (UNSEEN 0) S: 4 OK List completed. The UNSEEN information for INBOX is completely missing. It is correct behavior? If not, is this a known bug in 2.1.7? Thank you. azur

9 21

[Dovecot] Login into other user's account // master user for non-master users // chroot to users.<user>
by Steffen Kaiser 26 Oct '13

26 Oct '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Currently some of our organizational roles uses shared secrets (aka the password) to access the mail account of an organizational role, say "sales" for example. For one, I don't like shared secrets, for second, there had been some changes to shared mailboxes, I can only say "user sales has deleted the message at then and then". Therefore I would like to access the mailboxes of organizational roles with the accounts of the humans performing the role currently. Using sharing and ACLs it is possible to map the mailboxes of "sales" to "users.sales" namespace for specific other users, actually the human ones, say userA and userB for example. However, userB does not like managing identities in its MUA and refuses to acknowledge the messages in users.sales for various reasons. One reason was that userB wants to visibly separate strictly both mail accounts, the private messages in "userB" and the role's ones in "sales". Now, I came into thinking that it would be good in such case, if userB could authentificate as, say "sales*userB" - much like a master user - and ends in "sales"'s home, but with access permissions of "userB", well, like a chroot. Would it be an interesting feature to add to Dovecot's core? If I simulate "sales*userB" with password of userB and let the userdb return the home of sales, userB would gain "owner" privilegues of sales implicitly. So there seems to exist no workaround. Kind regards, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUmDx3l3r2wJMiz2NAQLgVwgAw/RgAll9QPEwEPAY4hNHrTcieyZoCMUc iTGBDYcfaELnlLZJupbM4fRPyVYMe4uRmuy2pBKXwDplCriW9FIETQ36Jx6oppZn Ojf1+ZLjBUwr0OBpGMXyDd0XpNWgaEOiEzvvpOykO+pJJCKEJR7uR0usQ5cV6JRt z7qiY3t7n7H0j12Oas7w+IsRrTgMe9FsJ4D37SwxeZCpM12y17E2T2mX10ycvnTM 27/Gai8iyp/4dlO0NqBZ+qU/txqs2h+y5SARngj4Ru9YkmwutC9b8/4kBObTzzdx w1ahO3sYPTH0KmQ0Voc63H6T6U6CkBmYr9kqplkTdEiwtdg9AJSSfQ== =1arj -----END PGP SIGNATURE-----

5 7

[Dovecot] LMTP, TLS/SSL, authentication, proxy
by Jogi Hofmüller 26 Oct '13

26 Oct '13

Folks, Several questions packed into one email ;) Can dovecot use TLS/SSL on LTMP inet socket? Can I configure dovecot to only let an authenticated user deliver mail via LMTP? Can I tell dovecot to use a user/password for proxying LMTP connections? All this is related to my quest to move from cyrus to dovecot transparently to our users. And if any of the above questions can be answered with yes, I would appreciate the odd hint on howto configure that :) Thanks in advance! -- j.hofmüller aka Thesix http://users.mur.at/thesix/

2 1

[Dovecot] Problems with userdb lookup
by Mario Arnold 26 Oct '13

26 Oct '13

Hello, since few days there are problems with the userdb lookup. The problem occur if the recipient user is unknown (here test(a)xtlv.cn) doveconf -n # 2.2.6 (f89e645cba90): /etc/dovecot/dovecot.conf # OS: Linux 3.2.45.stk32 i686 Debian jessie/sid ext3 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = digest-md5 cram-md5 auth_username_translation = %Lu auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot/dov_debug.log hostname = kyoto.vtlx.cn login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_debug = yes mail_gid = vmail mail_home = /var/mail/vhosts/%Ld/%Ln mail_location = sdbox:/var/mail/vhosts/%Ld/%Ln:DIRNAME=DbOx-mAiLs mail_plugins = " quota mail_log notify expire zlib" mail_privileged_group = vmail mail_uid = vmail mailbox_list_index = yes ... passdb { args = scheme=PLAIN username_format=%Lu /etc/dovecot/user_pw/passwd driver = passwd-file } postmaster_address = postmaster(a)xtlv.cn protocols = " imap lmtp sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } } service config { unix_listener config { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { address = 84.38.75.44 port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { address = 84.38.75.44 port = 4190 } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { address = 84.38.75.44 port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener /var/spool/postfix/private/quota-status { group = postfix mode = 0660 user = postfix } } ... userdb { args = username_format=%Lu /etc/dovecot/user_pw/passwd driver = passwd-file } ... > gdb /usr/lib/dovecot/auth core_dbg GNU gdb (GDB) 7.6 (Debian 7.6-5) Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/lib/dovecot/auth...Reading symbols from /usr/lib/debug/usr/lib/dovecot/auth...done. done. [New LWP 26466] warning: Could not load shared library symbols for linux-gate.so.1. Do you need "set solib-search-path" or "set sysroot"? [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/i386-linux-gnu/i686/cmov/libthread_db.so.1". Core was generated by `dovecot/auth'. Program terminated with signal 6, Aborted. #0 0xb779d424 in __kernel_vsyscall () (gdb) bt full #0 0xb779d424 in __kernel_vsyscall () No symbol table info available. #1 0xb74ec80f in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 resultvar = <optimized out> resultvar = <optimized out> pid = -1218015232 selftid = 26466 #2 0xb74efcc3 in __GI_abort () at abort.c:90 save_stage = 2 act = {__sigaction_handler = {sa_handler = 0xb7794ff4, sa_sigaction = 0xb7794ff4}, sa_mask = {__val = {0, 3077744103, 3216056844, 3078348800, 3078207408, 1, 3078184664, 3078275225, 3078207848, 3077070192, 1, 1, 0, 0, 159279448, 3077360220, 3077743598, 3078180852, 3075085960, 3077367868, 159354316, 3077744683, 3078186032, 3075227880, 3216056948, 3077897967, 0, 3078180852, 0, 0, 159354316, 3078300704}}, sa_flags = 1, sa_restorer = 0xb74efb80 <__GI_abort>} sigs = {__val = {32, 0 <repeats 31 times>}} #3 0xb772abf9 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:192 backtrace = 0x97e6978 "/usr/lib/dovecot/libdovecot.so.0(+0x67bcf) [0xb772abcf] -> /usr/lib/dovecot/libdovecot.so.0(+0x67c51) [0xb772ac51] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb76de1d6] -> /usr/lib/dovecot/libdo"... #4 0xb772ac51 in i_internal_fatal_handler (ctx=0xbfb122e4, format=0xb7757344 "file %s: line %d (%s): assertion failed: (%s)", args=0xbfb12304 "") at failures.c:653 status = 0 #5 0xb76de1d6 in i_panic (format=format@entry=0xb7757344 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:264 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = 0xbfb12304 "" #6 0xb7751886 in p_strndup (pool=0xb7796544 <static_unsafe_data_stack_pool>, str=str@entry=0x0, max_chars=max_chars@entry=4294967295) at strfuncs.c:74 mem = <optimized out> len = <optimized out> __FUNCTION__ = "p_strndup" #7 0xb7751d7f in t_strndup (str=0x0, max_chars=4294967295) at strfuncs.c:236 No locals. #8 0x08057003 in auth_request_append_password (str=str@entry=0x97e68a8, request=0x97f8da8, request=0x97f8da8) at auth-request.c:1799 p = <optimized out> log_type = <optimized out> max_len = 4294967295 #9 0x08058cf2 in auth_request_log_unknown_user (request=request@entry=0x97f8da8, subsystem=subsystem@entry=0x807a0cc "passwd-file") at auth-request.c:1846 str = 0x97e68a8 #10 0x0806268c in db_passwd_file_lookup (db=0x97f4430, request=request@entry=0x97f8da8, username_format=0x97ef148 "%Lu") at db-passwd-file.c:466 pw = 0x97f4470 pu = <optimized out> table = <optimized out> username = 0x97e6598 dest = <optimized out> #11 0x0806d8bf in passwd_file_lookup (auth_request=0x97f8da8, callback=0x80599b0 <auth_request_userdb_callback>) at userdb-passwd-file.c:45 _module = <optimized out> module = <optimized out> pu = <optimized out> table = <optimized out> str = <optimized out> key = <optimized out> value = <optimized out> p = <optimized out> #12 0x08059c94 in auth_request_lookup_user (request=0x97f8da8, callback=callback@entry=0x8054ce0 <user_callback>) at auth-request.c:1072 userdb = 0x97ef150 cache_key = <optimized out> #13 0x08055612 in master_input_user (args=0x97f8751 "7\ttest(a)xtlv.cn\tservice=quota-status", conn=0x97f8b48) at auth-master-connection.c:314 auth_request = 0x97f8da8 error = 0xbfb125ac "\244\325s\267H\213\177\t" ret = <optimized out> -- 中華人民共和國

2 1

[Dovecot] Empty Mails from MAILER-DAEMON with Dovecot-Antispam and DSPAM
by Anna Christina Naß 26 Oct '13

26 Oct '13

Hallo, I've installed the dovecot-Antispam extension to my dovecot IMAP installation in conjunction with DSPAM. But when moving Mails from e.g. INBOX to Spam or vice versa, empty mails from MAILER-DAEMON appear after the original mail has been moved. This happens using Thunderbird 17esr, K-9 Mail on Android and Apple Mail (Mountain Lion). (Perhaps also when using a Webmail IMAP client) The source from one of these empty mails looks like this: ----snip---- Return-Path: <MAILER-DAEMON> X-Original-To: acn Delivered-To: acn(a)mydomain.name Received: from localhost (localhost.localdomain [127.0.0.1]) by <my host name> (Postfix) with SMTP id CB81B140011 for <acn>; Thu, 24 Oct 2013 09:23:33 +0200 (CEST) X-DSPAM-Reclassified: Spam Message-Id: <20131024072333.CB81B140011@<my host name>> Date: Thu, 24 Oct 2013 09:23:33 +0200 (CEST) From: MAILER-DAEMON ----/snip---- Do you have any idea why these mails appear and how I can prevent it? I'm using these Debian packages: ii dovecot-antispam 2.0+20120225-3 ii dovecot-core 1:2.1.7-7 ii dovecot-imapd 1:2.1.7-7 ii dovecot-ldap 1:2.1.7-7 ii dovecot-lmtpd 1:2.1.7-7 ii dovecot-managesieved 1:2.1.7-7 ii dovecot-sieve 1:2.1.7-7 ii dspam 3.10.1+dfsg-11 ii postfix 2.9.6-2 ii postfix-ldap 2.9.6-2 DSPAM is integrated in Postfix via master.cf: ----snip---- smtp inet n - - - - smtpd -o content_filter=dspam dspam unix - n n - - pipe flags=u user=vmail:vmail argv=/usr/bin/dspamc --deliver=innocent,spam --user $user Mails go to dovecot via this 'virtual'-transport: dovecot unix - n n - - pipe flags=ODRhu user=vmail:vmail argv=/usr/lib/dovecot/dovecot-lda -e -f ${sender} -d ${user} ----/snip---- The rest of my configuration follows: dovecot -n: ----snip---- # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-686-pae i686 Debian 7.2 ext4 auth_cache_size = 1 M auth_mechanisms = plain login auth_worker_max_count = 5 listen = *, [::] log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:/var/vmail/%u/Maildir mail_privileged_group = mail mailbox_idle_check_interval = 15 secs managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify passdb { args = /etc/dovecot/ldap-passdb.conf.ext driver = ldap } plugin { antispam_allow_append_to_spam = no antispam_backend = dspam antispam_dspam_args = --user;%Lu;--deliver=spam,innocent;--source=error antispam_dspam_binary = /usr/bin/dspamc antispam_dspam_notspam = --class=innocent antispam_dspam_spam = --class=spam antispam_signature = X-DSPAM-Signature antispam_signature_missing = move antispam_spam = Spam;Junk antispam_trash = Trash;Deleted Items;Deleted Messages sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve-before.d sieve_extensions = +notify +imapflags sieve_storage = ~/sieve } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } user = $default_internal_user } service imap-login { process_min_avail = 2 service_count = 0 vsz_limit = 32 M } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } user = vmail } ssl_cert = </etc/ssl/mycerts/my.imzadi.de.pem ssl_cipher_list = HIGH:MEDIUM:+TLSv1:!SSLv2:+SSLv3:!EXP:!aNULL:!ADH ssl_key = </etc/ssl/mycerts/my.imzadi.de.key userdb { args = /etc/dovecot/ldap-userdb.conf.ext default_fields = uid=vmail gid=vmail home=/var/vmail/%u driver = ldap } protocol imap { mail_max_userip_connections = 20 mail_plugins = antispam } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = sieve postmaster_address = postmaster(a)my.imzadi.de } ----/snip---- My dspam.conf looks like: ----snip---- Home /var/spool/dspam StorageDriver /usr/lib/i386-linux-gnu/dspam/libmysql_drv.so DeliveryHost 127.0.0.1 DeliveryPort 10026 DeliveryIdent localhost DeliveryProto SMTP OnFail error Trust vmail Trust root Trust dspam TrainingMode teft TestConditionalTraining on Feature noise Feature whitelist Algorithm graham burton Tokenizer osb PValue bcr WebStats off Preference "trainingMode=TEFT" # { TOE | TUM | TEFT | NOTRAIN } -> default:teft Preference "spamAction=deliver" # { quarantine | tag | deliver } -> default:quarantine Preference "spamSubject=[SPAM]" # { string } -> default:[SPAM] Preference "statisticalSedation=5" # { 0 - 10 } -> default:0 Preference "enableBNR=on" # { on | off } -> default:off Preference "enableWhitelist=on" # { on | off } -> default:on Preference "signatureLocation=headers" # { message | headers } -> default:message Preference "tagSpam=off" # { on | off } Preference "tagNonspam=off" # { on | off } Preference "showFactors=off" # { on | off } -> default:off Preference "optIn=off" # { on | off } Preference "optOut=off" # { on | off } Preference "whitelistThreshold=10" # { Integer } -> default:10 Preference "makeCorpus=off" # { on | off } -> default:off Preference "storeFragments=off" # { on | off } -> default:off Preference "localStore=" # { on | off } -> default:username Preference "processorBias=on" # { on | off } -> default:on Preference "fallbackDomain=off" # { on | off } -> default:off Preference "trainPristine=off" # { on | off } -> default:off Preference "optOutClamAV=off" # { on | off } -> default:off Preference "ignoreRBLLookups=off" # { on | off } -> default:off Preference "RBLInoculate=off" # { on | off } -> default:off Preference "notifications=off" # { on | off } -> default:off AllowOverride enableBNR AllowOverride enableWhitelist AllowOverride fallbackDomain AllowOverride ignoreGroups AllowOverride ignoreRBLLookups AllowOverride localStore AllowOverride makeCorpus AllowOverride optIn AllowOverride optOut AllowOverride optOutClamAV AllowOverride processorBias AllowOverride RBLInoculate AllowOverride showFactors AllowOverride signatureLocation AllowOverride spamAction AllowOverride spamSubject AllowOverride statisticalSedation AllowOverride storeFragments AllowOverride tagNonspam AllowOverride tagSpam AllowOverride trainPristine AllowOverride trainingMode AllowOverride whitelistThreshold AllowOverride dailyQuarantineSummary AllowOverride notifications IgnoreHeader DKIM-Signature IgnoreHeader X-Spam-Status IgnoreHeader X-Spam-Scanned IgnoreHeader X-Virus-Scanner-Result Notifications off PurgeSignatures 14 # Stale signatures PurgeNeutral 90 # Tokens with neutralish probabilities PurgeUnused 90 # Unused tokens PurgeHapaxes 30 # Tokens with less than 5 hits (hapaxes) PurgeHits1S 15 # Tokens with only 1 spam hit PurgeHits1I 15 # Tokens with only 1 innocent hit LocalMX 127.0.0.1 SystemLog on UserLog on Opt out ClamAVPort 3310 ClamAVHost 127.0.0.1 ClamAVResponse spam ServerMode auto ServerPass.Relay1 "<pwd>" ServerParameters "--deliver=innocent,spam --user %u" ServerIdent "localhost.localdomain" ServerDomainSocketPath "/var/run/dspam/dspam.sock" ClientHost /var/run/dspam/dspam.sock ClientIdent "<pwd>@Relay1" ProcessorURLContext on ProcessorBias off StripRcptDomain off Include /etc/dspam/dspam.d/ ----/snip---- Thanks a lot! Kind regards, Anna Christina Naß

2 1

[Dovecot] UIDL conversion courier -> dovecot
by Will Yardley 25 Oct '13

25 Oct '13

I've got a weird split setup where POP3 is currently handled by Courier (courier-imap-3.0.2 distribution), and IMAP is currently handled by the RHEL 5 version of Dovecot (1.0.7) I'm trying to figure out a way to convert the POP3 UIDLs (in cases where the courierpop3dsizelist is newer than dovecot-uidlist, at least) to something that Dovecot will read, or to configure Dovecot's pop3 to use a UIDL format that will work, as mentioned in the migration wiki. We have some "squeaky wheel" users who don't have their POP clients set to delete messages, and are likely to complain about re-downloading their several GB of mail. Thus far, the migration scripts haven't seemed to work properly, maybe because of the versions I'm using. I'm not sure whether the Courier versions there refer to Courier MTA version or Courier IMAP version, but adjusting the UIDL format to %v-%u (as suggested for early Courier 3 / Dovecot 1.0) hasn't worked (I saw %u-%v online, but that also didn't work). Since the Courier system doesn't seem to report validity, I also tried just '%u' - this works *if* I delete the header line as well as rename the courierpop3dsizelist to dovecot-uidlist, but I still don't get the exact same UIDLs as before. I'm willing to write my own migration tool, or to adapt the existing one, but I could use some assistance knowing how to do the translation. Dovecot -n for that instance is below, slightly sanitized, obviously I can change pop3_uidl_format; I also tried getting rid of pop3_reuse_xuidl: Basically, to give a concreate example, the Courier system seems to use the filename as the UIDL, with this courierpop3dsizelist: /2 45 1382654636 1199751891.13891_0.water-ox:2,Sa 2412 0:1382654636 1199927364.22870_0.fire-ox:2,S 2440 0:1382654636 1199936486.3332_0.wood-ox:2,Sa 2074 0:1382654636 1199985712.27745_0.water-ox:2,RS 4007 0:1382654636 1199993867.23139_0.fire-ox:2,S 1550 0:1382654636 producing this UIDL output: UIDL +OK 1 1199751891.13891_0.water-ox 2 1199927364.22870_0.fire-ox 3 1199936486.3332_0.wood-ox 4 1199985712.27745_0.water-ox 5 1199993867.23139_0.fire-ox [...] Dovecot's dovecot-uidlist: 3 V1199747645 N606 562 W2412 :1199751891.13891_0.water-ox:2,Sa 563 W2440 :1199927364.22870_0.fire-ox:2,S 564 W2074 :1199936486.3332_0.wood-ox:2,Sa 565 W4007 :1199985712.27745_0.water-ox:2,RS 566 W1550 :1199993867.23139_0.fire-ox:2,S producing: UIDL +OK 1 1199747645-562 2 1199747645-563 3 1199747645-564 4 1199747645-565 5 1199747645-566 (or, if I change the format to just %u): +OK 1 650 2 651 3 652 4 653 5 654 # dovecot --version 1.0.7 # 1.0.7: /etc/dovecot.d/XXX.cfg base_dir: /var/run/dovecot/pop-its syslog_facility: local4 protocols: pop3 pop3s listen: *:110 ssl_listen: *:995 ssl_ca_file: /etc/pki/dovecot/certs/XX.pem ssl_cert_file: /etc/pki/dovecot/certs/XXXX.pem ssl_key_file: /etc/pki/dovecot/private/XXXX.key disable_plaintext_auth: yes login_dir: /var/run/dovecot/pop-its/login login_executable: /usr/libexec/dovecot/pop3-login login_greeting_capability: yes login_processes_count: 4 login_max_processes_count: 512 verbose_proctitle: yes mail_location: maildir:/var/spool/maildir/%1Ln/%Ln:INDEX=/var/spool/dovecot/indexes/%1Ln/%Ln mail_debug: yes mmap_disable: yes maildir_copy_with_hardlinks: yes mail_executable: /usr/libexec/dovecot/pop3 mail_plugin_dir: /usr/lib/dovecot/pop3 pop3_reuse_xuidl: yes pop3_uidl_format: %v-%u pop3_client_workarounds: outlook-no-nuls oe-ns-eoh namespace: type: private separator: . prefix: Mail. inbox: yes auth default: mechanisms: plain login passdb: driver: ldap args: /etc/dovecot.conf-ldap userdb: driver: static args: uid=vmail gid=mail home=/var/spool/maildir/%1Ln/%Ln socket: type: listen master: path: /var/run/dovecot/pop-its/auth-master mode: 384 user: vmail group: mail TIA! /wby

1 1