- dovecot - dovecot.org

doveadm index message-decoder assertion failed
by cs+dovecot＠ctzen.com 05 Nov '14

05 Nov '14

Hi, I've setup FTS using lucene and it should be working, the lucene index is updated when mail arrives. I also managed to reindex my INBOX: doveadm index -u foo -q INBOX However, when I try to index an Archives folder: doveadm index -u foo -q Archives, the index-work crashed with this log message: dovecot: indexer-worker(foo): Panic: file message-decoder.c: line 363 (message_decode_body): assertion failed: (ctx->translation_size <= sizeof(ctx->translation_buf)) dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for foo dovecot: indexer-worker(foo): Fatal: master: service(indexer-worker): child 28730 killed with signal 6 (core dumps disabled) The Archives folder has 22317 messages. Please help. dovecot --version 2.2.15 dovecot -n # 2.2.15: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.0-STABLE i386 auth_username_format = %Ln first_valid_gid = 1000 first_valid_uid = 1000 login_trusted_networks = xxx.xxx.xxx.x/24 mail_location = maildir:~/Maildir mail_plugins = " fts fts_lucene" mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { antispam_backend = spool2dir antispam_spam = Junk antispam_spool2dir_notspam = /var/spool/dovecot-antispam/queue/ham-%%020lu-%u-%%05lu antispam_spool2dir_spam = /var/spool/dovecot-antispam/queue/spam-%%020lu-%u-%%05lu antispam_trash = Trash fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@. } protocols = imap lmtp sieve service imap-login { inet_listener imap { address = xxx.xxx.xxx.x } inet_listener imaps { address = xxx.xx.xx.xx } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { address = xxx.xx.xx.xx xxx.xxx.xx.x port = 4190 } } ssl_cert = </var/ssl/crts/mail.crt ssl_key = </var/ssl/keys/ssl-npp.key userdb { driver = passwd } protocol lmtp { mail_plugins = " fts fts_lucene sieve" } protocol imap { mail_max_userip_connections = 20 mail_plugins = " fts fts_lucene antispam" }

2 2

calling post-login script with doveadm
by Héctor Moreno Blanco 05 Nov '14

05 Nov '14

Hello everyone, I'm trying to execute some commands with doveadm but I need some information loaded in a post-login script before running these commands. Is possible to run the post-login script while executing doveadm? I've found how to do something similar with -o key=value to override settings, but I want to change a namespace location, as done in the post-login script: ... export USERDB_KEYS="$USERDB_KEYS namespace/archivo/location" exec env "NAMESPACE/ARCHIVO/LOCATION=$location" "$@" ... Thank you very much in advanced. Kind regards. Héctor Moreno P Please consider the environment before printing this e-mail. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________

1 1

Re: Example records for SQL AUTH
by James 05 Nov '14

05 Nov '14

On 03/11/2014 22:29, Jorge Bastos wrote: > Password_query: > > password_query = select username, domain,password from users where > username='%u' and domain='%d' and active='true' > Try "... username='%n' ..." not %u From doc/dovecot/example-config/dovecot-sql.conf # Commonly used available substitutions (see http://wiki.dovecot.org/Variables # for full list): # %u = entire user@domain # %n = user part of user@domain # %d = domain part of user@domain James.

1 0

Public mailbox confusion
by Stefan G. Weichinger 05 Nov '14

05 Nov '14

greets, I am quite sure I ask some faq here ... sorry, but I am confused by the many options and choices here. What I want to do is: I migrate lots of public folders from a MS Exchange Server ... The customer wants that there is a "Public" folder containing all these hundreds of folders, the public folder should be visible for all the dovecot-users and all the subfolders should be automatically subscribed as soon a new user logs in. What I have now: namespace { type = private separator = / prefix = inbox = yes } namespace { type = public separator = / prefix = Public/ location = maildir:/home/vmail/public:INDEXPVT=/home/vmail/public/index/%d/%u/index subscriptions = yes } As far as I see from testing this doesn't yet work that way. When I open the mailbox with eg. roundcube I see "Public" but nothing below it ... Could someone please give me a good pointer here? Thanks! Stefan

2 4

sieve replication and .dovecot.lda-dupes
by Jan Behrend 05 Nov '14

05 Nov '14

Hello list, I have a replicated dovecot with two servers. People seem to get vacation responses more often then it is specified in "days: XX", depending on which dovecot instance they receive the incoming mail. Is ".dovecot.lda-dupes" replicated? The other problem is that the vacation response is coming from the wrong address depending on which field the recipient was listed: "to:" or "cc:" Here is my test example: g9-rz has the vacation rule set up: date | mail -s test -r jbehrend(a)mpifr-bonn.mpg.de -c g9-rz(a)mpifr-bonn.mpg.de jan(a)flatpick.de and this returns this vacation response: ### snip ### Return-Path: <> Delivered-To: <jbehrend(a)mpifr-bonn.mpg.de> Received: from mail2.mpifr-bonn.mpg.de ([134.104.18.60]) by mailbox2.mpifr-bonn.mpg.de (Dovecot) with LMTP id +pgPDzm1WFSn9wAAvl5QjA for <jbehrend(a)mpifr-bonn.mpg.de>; Tue, 04 Nov 2014 12:16:13 +0100 X-Sieve: Pigeonhole Sieve 0.4.2 Message-ID: <dovecot-sieve-1415099773-541512-0(a)mailbox1.mpifr-bonn.mpg.de> Date: Tue, 04 Nov 2014 12:16:13 +0100 From: jan(a)flatpick.de To: <jbehrend(a)mpifr-bonn.mpg.de> Subject: Vacation In-Reply-To: <E1Xlc5t-0001LT-Bu(a)jb1.mpifr-bonn.mpg.de> References: <E1Xlc5t-0001LT-Bu(a)jb1.mpifr-bonn.mpg.de> Auto-Submitted: auto-replied (vacation) Precedence: bulk MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Evolution-Source: 1385020682.6450.3@jb1 Ain't here! Go away or something ... Cheers ### snip ### I would expect "g9-rz(a)mpifr-bonn.mpg.de" in the from: field. Is this correct? Cheers Jan -- MAX-PLANCK-INSTITUT fuer Radioastronomie Jan Behrend - Rechenzentrum ---------------------------------------- Auf dem Huegel 69, D-53121 Bonn Tel: +49 (228) 525 359, Fax: +49 (228) 525 229 jbehrend(a)mpifr-bonn.mpg.de http://www.mpifr-bonn.mpg.de

2 1

error using fts/tika
by Infoomatic 04 Nov '14

04 Nov '14

Hi, I played around a bit and tried to get tika to run with dovecot. In the end I was at least a bit successful. However, when I tried to index my inbox with "doveadm index -A '*'" I get: doveadm(infoomatic): Error: fts_tika: PUT http://localhost:8081/tika failed: 500 Server Error doveadm(infoomatic): Warning: I/O leak: 0x7f4f697bb170 (line 127, fd 24) doveadm(infoomatic): Panic: file ioloop-iolist.c: line 22: unreached doveadm(infoomatic): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x67f30) [0x7f4f697e8f30] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f4f697e8f9a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4f6979c515] -> /usr/lib/dovecot/libdovecot.so.0(+0x79b0d) [0x7f4f697fab0d] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handle_add+0x3b) [0x7f4f697fb2ab] -> /usr/lib/dovecot/libdovecot.so.0(+0x78cf1) [0x7f4f697f9cf1] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_move_io+0x3e) [0x7f4f697fa93e] -> /usr/lib/dovecot/libdovecot.so.0(connection_switch_ioloop+0x14) [0x7f4f697e6df4] -> /usr/lib/dovecot/libdovecot.so.0(http_client_switch_ioloop+0x28) [0x7f4f697bf8e8] -> /usr/lib/dovecot/libdovecot.so.0(+0x36a86) [0x7f4f697b7a86] -> /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(solr_connection_post_more+0x29) [0x7f4f68d9f069] -> /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(+0x3547) [0x7f4f68d9b547] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_build_mail+0x35c) [0x7f4f68faaffc] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xd3ee) [0x7f4f68fb03ee] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x19) [0x7f4f69ac3c39] -> doveadm() [0x419501] -> doveadm() [0x4153c3] -> doveadm(doveadm_mail_try_run+0x48c) [0x4162ac] -> doveadm(main+0x3d8) [0x412588] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f4f693dcec5] -> doveadm() [0x4127a4] Aborted (core dumped) The last messages of the tika-server: Nov 04, 2014 10:18:17 PM org.apache.tika.server.TikaResource logRequest INFO: tika (video/x-ms-wmv) Nov 04, 2014 10:18:17 PM org.apache.tika.server.TikaResource$3 write WARNING: tika: Text extraction failed org.apache.tika.exception.TikaException: Unexpected RuntimeException from org.apache.tika.server.TikaResource$1@44742f73 Nov 04, 2014 10:18:17 PM org.apache.cxf.jaxrs.utils.JAXRSUtils logMessageHandlerProblem SEVERE: Problem with writing the data, class org.apache.tika.server.TikaResource$3, ContentType: text/plain Nov 04, 2014 10:18:17 PM org.apache.cxf.jaxrs.impl.WebApplicationExceptionMapper toResponse WARNING: javax.ws.rs.WebApplicationException: HTTP 415 Unsupported Media Type dovecot -n: # 2.2.15: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-39-generic x86_64 Ubuntu 14.04.1 LTS ext4 auth_username_format = %n disable_plaintext_auth = no mail_gid = vmail mail_home = /var/lib/vmail/home/%u mail_location = mdbox:/var/lib/vmail/mail/%u mail_plugins = fts fts_solr mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate imapflags mdbox_rotate_size = 32 M namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { fts = solr fts_autoindex = yes fts_solr = url=http://localhost:8080/solr/ break-imap-search fts_tika = http://localhost:8081/tika sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags } protocols = " imap sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail user = vmail } } service managesieve-login { inet_listener sieve_deprecated { port = 2000 } } ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lda { mail_plugins = fts fts_solr sieve } Has anyone hints? Or do the devs want some more information for debugging? best regards, infoomatic

1 0

Re: authentication issues with ipad / mac email client
by Rajesh M. 04 Nov '14

04 Nov '14

hi i am using dovecot version2.2.7 provided by qmailtoaster - 64 bit on centos 6.5 64 bit system - 16 gb ram with a hex core processor. i was using qmail pop3 on a 32 bit system for the past over 7 years and had absolutely no issues. with dovecot pop3 i have started receiving a variety of problems mac machines and ipads -- port 110 does not work at all. i have to use port 995 only. i have allowed plain text auth. thunderbird works perfectly -- both imap and pop3 with port 110 and port 995 outlook 2010 also works but incase of one customer the mail download is very slow. i have a windows servers with mailenable mail server and the same customer could download perfectly from those windows servers. i am using the default "service pop3" settings Do i need to increase the memory settings / for pop3 login similar to imap login which i am missing out like what is configured for imap. (pl see config file below) My mail server is busy with around 4000 mailboxes and transacting over 200k emails per day. atleast around 250 simultaneous pop3 connections during peak hours. # dovecot -a | grep pop3_uidl_format pop3_uidl_format = %08Xu%08Xv [root@ns1 spamassassin]# dovecot -n # 2.2.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.29.2.el6.x86_64 x86_64 CentOS release 6.5 (Final) auth_cache_negative_ttl = 0 auth_cache_size = 32 M auth_cache_ttl = 30 mins auth_mechanisms = plain login digest-md5 cram-md5 default_login_user = vpopmail disable_plaintext_auth = no first_valid_gid = 89 first_valid_uid = 89 log_path = /var/log/dovecot.log login_greeting = ready. mail_max_userip_connections = 50 mail_plugins = " quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = . type = private } passdb { args = cache_key=%u webmail=127.0.0.1 driver = vpopmail } plugin { quota = maildir:ignore=Trash quota_rule = ?:storage=0 } protocols = imap pop3 service imap-login { client_limit = 256 process_limit = 400 process_min_avail = 4 service_count = 0 vsz_limit = 384 M } ssl_cert = </var/qmail/control/servercert.pem ssl_dh_parameters_length = 2048 ssl_key = </var/qmail/control/servercert.pem userdb { args = cache_key=%u quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol imap { imap_client_workarounds = delay-newmail mail_plugins = " quota imap_quota" } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes pop3_lock_session = no pop3_no_flag_updates = yes } i am really puzzled because dovecot was highly recommended by all. thanks for all your help rajesh ----- Original Message ----- From: Daniel Parthey [mailto:pada@posteo.de] To: 24x7server@24x7server.net,dovecot@dovecot.org Sent: Sat, 01 Nov 2014 09:34:53 +0100 Subject: Re: authentication issues with ipad / mac email client Hi, please post * output of "doveconf -n" * error log messages from dovecot for failed vs. succeeded login Regards Daniel

1 0

Re: Example records for SQL AUTH
by deoren 04 Nov '14

04 Nov '14

On 11/3/2014 4:29 PM, Jorge Bastos wrote: > Hi, > > > > Where can I get examples for the records for the "users" table? If I understand your question properly and you're looking for examples of creating new virtual users, then this guide covers that: https://www.linode.com/docs/email/email-with-postfix-dovecot-and-mysql You would have to adjust to fit your chosen schema of course as theirs is a much simpler setup that excludes the uid, gid, and home values. > > For SHA512-CRYPT, I tried: > > > > replace into users values ('a(a)a.com','a.com',ENCRYPT('b', CONCAT('$6$', > SUBSTRING(SHA(RAND()), -16))),'',0,0,'true'); > > > > schema is: > > CREATE TABLE `users` ( > > `username` varchar(255) NOT NULL, > > `domain` varchar(255) NOT NULL, > > `password` varchar(255) NOT NULL, > > `home` varchar(255) NOT NULL, > > `uid` int(11) NOT NULL, > > `gid` int(11) NOT NULL, > > `active` enum('true','false') NOT NULL DEFAULT 'true', > > PRIMARY KEY (`username`) > > ) ENGINE=InnoDB DEFAULT CHARSET=utf8 > > > > Password_query: > > password_query = select username, domain,password from users where > username='%u' and domain='%d' and active='true' What does your auth-sql-conf.ext file look like? With as much information as you already have in your database schema you may want to look at using the Prefetch userdb. http://wiki2.dovecot.org/UserDatabase/Prefetch P.S. Apologies for the duplication. I forgot to reply to the list with my last response.

1 0

SSL Client authentication with trustcenter-certificate
by dovecot.pkoch＠dfgh.net 04 Nov '14

04 Nov '14

Dear reader, we are using dovecot 2.2.7 and like it very much. Authentication is done via a checkpassword program that does two things: 1) check wether the client has connected via SSL using a client certificate 2) check wether the client is using a one time password generator Most of our users are using certificates that we have created ourself. These certificates contain a x500uniqueidentifier. But some users are using certificates from a german trust center and these certificates do not contain a x500uniqueIdentifier nor something similar. I would like to map these certificates to user accounts and my first idea was to do so from my checkpassword programm. But how do I find out the client-certificate from within a checkpassword script. I tried to add an additional entry to auth_request_var_expand_static_tab and fill in that environment variable in auth_request_get_var_expand_table_full() (both in src/auth/auth-request.c). But where do I find the SSL-context from which I can extract the client certificate? Kind regards Peter Koch

1 0

Example records for SQL AUTH
by Jorge Bastos 04 Nov '14

04 Nov '14

Hi, Where can I get examples for the records for the "users" table? For SHA512-CRYPT, I tried: replace into users values ('a(a)a.com','a.com',ENCRYPT('b', CONCAT('$6$', SUBSTRING(SHA(RAND()), -16))),'',0,0,'true'); schema is: CREATE TABLE `users` ( `username` varchar(255) NOT NULL, `domain` varchar(255) NOT NULL, `password` varchar(255) NOT NULL, `home` varchar(255) NOT NULL, `uid` int(11) NOT NULL, `gid` int(11) NOT NULL, `active` enum('true','false') NOT NULL DEFAULT 'true', PRIMARY KEY (`username`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8 Password_query: password_query = select username, domain,password from users where username='%u' and domain='%d' and active='true' What could I be missing? but logs says user is not found in userdb: Nov 3 22:17:24 fastmail dovecot: auth: Error: sql(a(a)a.com,127.0.0.1,<JIsTtvsGZwB/AAAB>): user not found from userdb Nov 3 22:17:24 fastmail dovecot: pop3: Error: Authenticated user not found from userdb, auth lookup id=3938844673 (client-pid=10240 client-id=1) Nov 3 22:17:24 fastmail dovecot: pop3-login: Internal login failure (pid=10240 id=1) (internal failure, 1 successful auths): user=<a(a)a.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=10247, secured, session=<JIsTtvsGZwB/AAAB>

1 0