- dovecot - dovecot.org

[Dovecot] dovecot 2.2.10 & fts_lucene: Failed to initialize backend
by Benjamin Podszun 03 Apr '14

03 Apr '14

Hey there. (Lesson to self: Don't try to be cute. Somehow a trademark sign breaks my setup and the rest of the mail is discarded? Sorry for the previous, incomplete post) Lurking most of the time here, currently I'm trying to make FTS work. As far as I understand [1], squat is deprecated, solr is a rather big dependency for my 'friends & family' type of installation: Lucene it is! My problem: The lucene backend isn't working, I get this error whenever I try to access it (be it doveadm fts or a search, triggering an index): # doveadm fts rescan -u dar(a)darklajid.de doveadm(dar(a)darklajid.de): Error: fts: Failed to initialize backend 'lucene': Unknown backend doveadm(dar(a)darklajid.de): Error: fts not enabled for user's namespace (null) Any ideas what I might be doing wrong here? All the details I could think of are below, any help would be appreciated. Regards, Ben -- Package information # pkg info dovecot2 dovecot2-2.2.10 Name : dovecot2 Version : 2.2.10 Installed on : Mon Mar 31 17:14:26 CEST 2014 Origin : mail/dovecot2 Architecture : freebsd:10:x86:64 Prefix : /usr/local Categories : mail ipv6 Licenses : MIT or LGPL21 Maintainer : bra(a)fsn.hu WWW : http://www.dovecot.org/ Comment : Secure and compact IMAP and POP3 servers Options : DOCS : off EXAMPLES : off GSSAPI : off KQUEUE : on LDAP : off LIBWRAP : off LUCENE : on MYSQL : off PGSQL : on SOLR : off SQLITE : off SSL : on VPOPMAIL : off Shared Libs required: libssl.so.8 libpq.so.5 libdovecot.so.0 libdovecot-storage.so.0 libdovecot-login.so.0 libdovecot-lda.so.0 libcrypto.so.8 libclucene-shared.so.1 libclucene-core.so.1 Shared Libs provided: libssl_iostream_openssl.so libdovecot.so.0 libdovecot-storage.so.0 libdovecot-sql.so.0 libdovecot-login.so.0 libdovecot-lda.so.0 libdovecot-compression.so.0 libauthdb_imap.so lib95_imap_stats_plugin.so lib90_stats_plugin.so lib30_imap_zlib_plugin.so lib21_fts_squat_plugin.so lib21_fts_lucene_plugin.so lib20_zlib_plugin.so lib20_virtual_plugin.so lib20_replication_plugin.so lib20_mailbox_alias_plugin.so lib20_mail_log_plugin.so lib20_listescape_plugin.so lib20_fts_plugin.so lib20_expire_plugin.so lib20_doveadm_fts_plugin.so lib20_doveadm_fts_lucene_plugin.so lib20_autocreate_plugin.so lib15_notify_plugin.so lib11_trash_plugin.so lib11_imap_quota_plugin.so lib10_quota_plugin.so lib10_doveadm_quota_plugin.so lib10_doveadm_expire_plugin.so lib10_doveadm_acl_plugin.so lib05_snarf_plugin.so lib05_pop3_migration_plugin.so lib02_lazy_expunge_plugin.so lib02_imap_acl_plugin.so lib01_acl_plugin.so -- Sure enough, the libraries are there/in places that look fine to me: # pkg info -l dovecot2 | grep -i fts /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.a /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.la /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.a /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.la /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so /usr/local/lib/dovecot/lib20_fts_plugin.a /usr/local/lib/dovecot/lib20_fts_plugin.la /usr/local/lib/dovecot/lib20_fts_plugin.so /usr/local/lib/dovecot/lib21_fts_lucene_plugin.a /usr/local/lib/dovecot/lib21_fts_lucene_plugin.la /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so /usr/local/lib/dovecot/lib21_fts_squat_plugin.a /usr/local/lib/dovecot/lib21_fts_squat_plugin.la /usr/local/lib/dovecot/lib21_fts_squat_plugin.so -- Doveconf: # 2.2.10: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.0-RELEASE amd64 ufs first_valid_uid = 1 login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_home = /var/vmail/%d/%n mail_location = maildir:/var/vmail/%d/%n/Maildir mail_plugins = fts mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = mailbox Drafts { auto = no special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = create special_use = \Trash } prefix = separator = / } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { antispam_backend = dspam antispam_dspam_args = --user;%Lu;--source=error;--signature=%%s antispam_dspam_binary = /usr/local/bin/dspamc antispam_dspam_notspam = --class=innocent antispam_dspam_result_header = X-DSPAM-Result antispam_dspam_spam = --class=spam antispam_signature = X-DSPAM-Signature antispam_signature_missing = error antispam_spam = Spam;Junk antispam_trash = trash;Trash fts = lucene fts_lucene = whitespace_chars=@. sieve = ~/.dovecot.sieve sieve_before = /usr/local/etc/dovecot/sieve/before sieve_dir = ~/sieve } postmaster_address = postmaster(a)ben.sh protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/prosody/private/auth { group = prosody mode = 0660 user = prosody } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { process_limit = 128 } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl = required ssl_cert = </usr/local/etc/dovecot/ssl/certs/ben.sh.pem ssl_cipher_list = EECDH+ECDSA+AESGCM EECDH+aRSA+AESGCM EECDH+ECDSA+SHA384 EECDH+ECDSA+SHA256 EECDH+aRSA+SHA384 EECDH+aRSA+SHA256 EECDH+aRSA+RC4 EECDH EDH+aRSA RC4 !aNULL !eNULL !LOW !3DES !MD5 !EXP !PSK !SRP !DSS !RC4 ssl_key = </usr/local/etc/dovecot/ssl/private/ben.sh.key userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol sieve { mail_max_userip_connections = 10 managesieve_max_compile_errors = 5 } protocol lmtp { mail_plugins = quota sieve } protocol imap { mail_plugins = fts fts_lucene quota imap_quota antispam } 1: http://wiki2.dovecot.org/Plugins/FTS

2 3

[Dovecot] Disable maildir indexing and dovecot-uidlist on LMTP/LDA delivery
by Jouko Nikula 03 Apr '14

03 Apr '14

Hello all, Is there a way to use LMTP (or LDA) so that maildir index and dovecot-uidlist are not updated? My setup is such that mail delivery sees user's maildir as write only. This setup works well when using postfix for mail delivery, but when I try to switch to dovecot LMTP the lmtp process wants to read the dovecot-uidlist and fails on insufficient privileges. Is there a way around this without exposing the maildir and mail home for read access? Regards, Jouko Nikula

5 4

Re: [Dovecot] Is replication broken?
by IT geek 31 03 Apr '14

03 Apr '14

> > Honestly, for most setups I would recommend LMTP nowadays. >> > I don't use Postfix, but that page looks good: > http://wiki2.dovecot.org/HowTo/PostfixDovecotLMTP I followed the guide, but I received the following error: Apr 3 08:41:31 server1 postfix/lmtp[4084]: DE4321F83A: to=<user1(a)test.com>, relay=server1.test.com[private/dovecot-lmtp], delay=491, delays=490/0.21/0.02/0.02, dsn=5.1.1, status=bounced (host server1.test.com[private/dovecot-lmtp] said: 550 5.1.1 <user1(a)test.com> User doesn't exist: user1(a)test.com (in reply to RCPT TO command)) The solution was to add the following line to my dovecot.conf: auth_username_format = %Ln All is now working as expected. Now to crack on with replication... :-) -Mark

1 0

[Dovecot] dovecot 2.2.10 & fts_lucene: Failed to initialize backend
by Benjamin Podszun 03 Apr '14

03 Apr '14

Hey there. Lurking most of the time here, currently I'm trying to make FTS work™

1 0

Re: [Dovecot] Is replication broken?
by IT geek 31 03 Apr '14

03 Apr '14

> > Honestly, for most setups I would recommend LMTP nowadays. > I don't use Postfix, but that page looks good: > http://wiki2.dovecot.org/HowTo/PostfixDovecotLMTP > > You do not need to do anything special in postfix, if you use Dovecot's > LDA or LMTP, when you change the storage backend. Most importantly, that > way you can let UserDB return a different mail_location per recipient > without postfix knowing anything about the difference. > Thank you Steffen, I shall give that a go and report back with how I get on. -Mark

1 0

[Dovecot] nfs flush/fsync config settings problem
by Troton_admin 03 Apr '14

03 Apr '14

Hi, I need to place a maildir storage on a NFS filesystem, so I set up the config like this: mmap_disable = yes mail_nfs_storage = yes mail_nfs_index = yes mail_fsync = always lock_method = dotlock (also tried fcntl - local lockd is running, no success, now using dotlock, to be sure while debugging) The problem is that Dovecot (2.2.9/2.2.10 - the relevant code in mail-index.c is the same) logs a fatal error and quits the session (no daemon crash/coredump). Jan 07 14:13:31 auth: Debug: client in: AUTH 1 PLAIN service=pop3 session=fRCRJGHvbADDUKU9 lip=192.168.100.102 rip=IP_ADDR lport=1110 rport=48236 resp=AHRyb3RvbjEAdHJvdG9uMQ== (previous base64 data may contain sensitive data) Jan 07 14:13:31 auth: Debug: passwd-file(troton1,IP_ADDR,<fRCRJGHvbADDUKU9>): lookup: user=troton1 file=/usr/local/etc/dovecot/passwd-file Jan 07 14:13:31 auth: Debug: client passdb out: OK 1 user=troton1 Jan 07 14:13:31 auth: Debug: master in: REQUEST 1289355265 29049 1 4f9fdd9e4069fa503e8e6bcc09d4cf30 session_pid=29089 Jan 07 14:13:31 auth: Debug: passwd-file(troton1,IP_ADDR,<fRCRJGHvbADDUKU9>): lookup: user=troton1 file=/usr/local/etc/dovecot/passwd-file Jan 07 14:13:31 auth: Debug: master userdb out: USER 1289355265 troton1 uid=81 gid=81 home=/home/troton1 mail=maildir:~/Maildir Jan 07 14:13:31 pop3-login: Info: Login: user=<troton1>, method=PLAIN, rip=IP_ADDR, lip=192.168.100.102, mpid=29089, session=<fRCRJGHvbADDUKU9> Jan 07 14:13:31 pop3: Debug: Added userdb setting: mail=maildir:~/Maildir Jan 07 14:13:31 pop3(troton1): Debug: Effective uid=81, gid=81, home=/home/troton1 Jan 07 14:13:31 pop3(troton1): Debug: Namespace inbox: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir Jan 07 14:13:31 pop3(troton1): Debug: maildir++: root=/home/troton1/Maildir, index=, indexpvt=, control=, inbox=/home/troton1/Maildir, alt= Jan 07 14:13:31 pop3(troton1): Info: DEBUG1: fsync_mode=2 , mask=0 Jan 07 14:13:31 pop3(troton1): Info: DEBUG2: fsync_mode=2 flags=85 Jan 07 14:13:31 pop3(troton1): Debug: Namespace : Using permissions from /home/troton1/Maildir: mode=0700 gid=default Jan 07 14:13:31 pop3(troton1): Info: DEBUG2: fsync_mode=0 flags=85 The user/passdb is just a plaintext file, for debugging purposes. But what is strange, the messages system log shows: Jan 7 14:13:31 mailhub2 dovecot: pop3(troton1): Fatal: nfs flush requires mail_fsync=always That is obviously wrong, even its own doveconf -n utility shows the correct value. # doveconf -n | grep -E 'sync|nfs' mail_fsync = always mail_nfs_index = yes mail_nfs_storage = yes maildir_very_dirty_syncs = yes Affected code seems to be in the lib-index/mail-index.c file, mail_index_file function - around line 585 : // my custom debug line i_info("DEBUG2: fsync_mode=%u flags=%u", (unsigned int)(index->fsync_mode),(unsigned int)flags); if ((flags & MAIL_INDEX_OPEN_FLAG_NFS_FLUSH) != 0 && index->fsync_mode != FSYNC_MODE_ALWAYS) i_fatal("nfs flush requires mail_fsync=always"); The first time it sees fsync_mode=2 (which is correct value of FSYNC_MODE_ALWAYS), but next function call is with index->fsync_mode=0 and an error is raised, see the logfile above. Dovecot correctly creates its working files in user's home directory - dovecot-uidlist, dovecot-uidvalidity, dovecot-uidvalidity.52cbfd7b, dovecot.index.log . The complete (testing, not production) doveconf -n is: == # 2.2.10: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 7.3-RELEASE-p3 amd64 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = sha1 default_process_limit = 200 disable_plaintext_auth = no first_valid_uid = 81 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep info_log_path = /var/log/dovecot.log last_valid_uid = 81 listen = 192.168.100.102 lock_method = dotlock mail_debug = yes mail_fsync = always mail_gid = 81 mail_location = maildir:%h/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_prefetch_count = 5 mail_uid = 81 mailbox_list_index = yes maildir_stat_dirs = yes maildir_very_dirty_syncs = yes mmap_disable = yes namespace inbox { inbox = yes location = mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . type = private } passdb { args = scheme=plain username_format=%n /usr/local/etc/dovecot/passwd-file driver = passwd-file } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid subject size } pop3_enable_last = yes pop3_save_uidl = yes protocols = imap pop3 service doveadm { inet_listener { port = 9292 } } service imap-login { inet_listener imap { port = 1143 } } service imap { process_limit = 250 } service pop3-login { inet_listener pop3 { port = 1110 } } service pop3 { process_limit = 200 } ssl = no userdb { args = username_format=%n /usr/local/etc/dovecot/passwd-file default_fields = uid=81 gid=0 home=/home/%n driver = passwd-file } protocol imap { mail_max_userip_connections = 5 } protocol pop3 { mail_max_userip_connections = 5 } == OS: 7.3-RELEASE-p3 FreeBSD 7.3-RELEASE-p3 #1 amd64 Affected Dovecot version: 2.2.9, 2.2.10 How to repeat: Anytime I enter the correct username/pass pair And I tried to place the homedir on a local disk too, and I got the same error as on NFS. Any ideas, what could possibly be wrong ? Is it a feature or a bug ? Thanks for your help. Regards, Troton

3 2

[Dovecot] how to enable debugging in imapc
by Tobias Oetiker 03 Apr '14

03 Apr '14

Hi Net, How can I enable debug messages in the imap-proxy client? Trying to figure why the imap-proxy mode does not work towards ngnix. specifically, how can i set conn->client->set.debug in ./src/lib-imap-client/imapc-connection.c cheers tobi -- Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten, Switzerland www.oetiker.ch tobi(a)oetiker.ch +41 62 775 9902 *** We are hiring IT staff: www.oetiker.ch/jobs ***

2 3

[Dovecot] Is replication broken?
by IT geek 31 03 Apr '14

03 Apr '14

Hi, Apologies for this being my 248th post about replication... The current error I'm getting is: Jan 30 12:10:54 Server1 dovecot: dsync-local(MailUser1): Error: dsync( Server2.test.com) read() failed: read((fd)) failed: Connection reset by peer Subsequent errors are: Jan 30 12:15:47 Server1 dovecot: dsync-local(MailUser1): Error: read( Server2.test.com) failed: EOF The above error is seen on Server1, after the initial sync completes of the first mailbox (Sent folder to be precise). Does anyone have an ideas as to what might be causing it? These are brand new rebuilds, running the latest build - I just can't seem to get this working. Bug maybe? Configs are as follows: Server1: # 2.2.10: /usr/pkg/etc/dovecot/dovecot.conf # OS: NetBSD 5.2 cobalt auth_mechanisms = plain login doveadm_password = secret doveadm_port = 12345 first_valid_uid = 1003 last_valid_uid = 1020 listen = 192.168.1.1 login_greeting = test.com mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_plugins = " notify replication" passdb { driver = passwd } plugin { mail_replica = tcp:Server2.test.com } protocols = imap service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0600 } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service imap-login { inet_listener imap { port = 0 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl_cert = </etc/openssl/certs/Server1.test.crt ssl_key = </etc/openssl/private/Server1.test.key userdb { driver = passwd } protocol lda { postmaster_address = postmaster(a)test.com } ServerB: # 2.2.10: /usr/pkg/etc/dovecot/dovecot.conf # OS: NetBSD 5.1 cobalt auth_mechanisms = plain login doveadm_password = secret doveadm_port = 12345 listen = 192.168.1.2 login_greeting = test.com mail_location = mbox:~/mail:INBOX=/var/mail/%u passdb { driver = passwd } protocols = imap service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0600 } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service doveadm { inet_listener { port = 12345 } } service imap-login { inet_listener imap { port = 0 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl_cert = </etc/openssl/certs/Server2.test.com.crt ssl_key = </etc/openssl/private/Server2.test.com.key userdb { driver = passwd } protocol lda { postmaster_address = postmaster(a)test.com }

4 15

[Dovecot] Test outgoing email on director setup
by Murray Trainer 03 Apr '14

03 Apr '14

HI All, I have a several Exim MTA's relaying mail to a pair of director proxies via LMTP which then relayi to several mailstores via LMTP Incoming mail is working fine. My outgoing mail uses LMTP also in the reverse of above. How do I manually test outgoing mail on the mailstores and proxies as I only have dovecot and not exim installed on them? I have the following set in dovecot.conf for LMTP submission_host = mailproxy01:24 mailproxy02:24 Hopefully that works with multiple submission hosts to give redundancy? Thanks Murray

1 0

[Dovecot] Info on Config Sharing or Unfied Config?
by Jeffrey Walton 02 Apr '14

02 Apr '14

Is there a wiki page or other resource on configuration sharing between Postfix and Dovecot? Or is there a unified config file somewhere that I can use for mail components (like Postfix, Dovecot, Clam, and Spam Assassin)? I'm finding that I need to add the same information in multiple places. For example, Postfix users go in /etc/postif/vmailboxes, but Dovecot uses a user/password database stored in /var/mail/%d/%u (or other methods). And the same certificates and keys get entered multiple times. I think (or hope) there's something better, but I have not come across the resource.

2 1