- dovecot - dovecot.org

[Dovecot] xz compression
by T.B. 04 Apr '14

04 Apr '14

Hello Timo, I've successfully setup xz compression for my Dovecot installation using the version 2.2.12 from Debian unstable. Together with the activation of the "Single Instance Attachment Storage", this reduced the mail storage utilization for 20 mail accounts by 74%. *My question:* (For this test just one user was logged in. OS = Debian Wheezy, AMD64) After conversion of my mail storage, IMAP read by Thunderbird worked perfectly. But IMAP write and LMTP write was not possible.* *xz compression seems to need a higher vsz_limit than its default value of 256M without compression. Before the conversion, 256M was enough with the plugins "**acl fts fts_solr" and " imap_zlib". 512M was still not enough for xz compression, 1024M works OK but I'm not sure since this is a relative large increase. My new setting: /etc/dovecot/conf.d/10-master.conf: service imap { vsz_limit=1024M } The absolute minimum to successfully send an empty mail is 710MB (700MB still produces out of memory)! _*Is this normal behaviour? What is a recommended value for "service imap {vsz_limit = }"?*_ I recommend to add this "_vsz_limit"_-increase to the wiki (http://wiki2.dovecot.org/Plugins/Zlib) to make others life easier. Error log below. * **My config & how I converted:* /etc/dovecot/conf.d/10-mail.conf: mail_plugins = *zlib *acl fts fts_solr /etc/dovecot/conf.d/90-plugin.conf: # Enable these only if you want compression while saving: zlib_save_level = 9 # 1..9 zlib_save = xz For "Single Instance Attachment Storage": /etc/dovecot/conf.d/10-mail.conf: # Directory root where to store mail attachments. Disabled, if empty. mail_attachment_dir = /srv/vmail/mail_attachments For compressed IMAP access ( to reduce the bandwidth usage of IMAP ) (has nothing to do with storage space): /etc/dovecot/conf.d/20-imap.conf: protocol imap { mail_plugins = $mail_plugins *imap_zlib* } Previous storage format was standard mdbox Format. To convert a single user, I used dsync from the command line: dsync -u user(a)domain.de mirror mdbox:/srv/converted_vmail/user@domain.de/ After conversion (~2 hours per account), I moved the original mail folder of the user to a backup location and replaced it by the converted folders from "/srv/converted_vmail/user(a)domain.de/". (Pay attention that the directory structure matches!, I had to adjust ist.) *My Problem:* *After conversion IMAP read by Thunderbird worked perfectly**. But IMAP write and **LMTP write was not possible**.** **/var/log/dovecot.log showed that vsz_limit**was to restrictive:* Log: Apr 03 14:13:14 imap(user(a)domain.de): Fatal: lzma: Out of memory Apr 03 14:13:14 imap(user(a)domain.de): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x674f0) [0x7f8538fd54f0] -> /usr/lib/dovecot/libdovecot.so.0(+0x675ce) [0x7f8538fd55ce] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f8538f90678] -> /usr/lib/dovecot/modules/lib20_zlib_plugin.so(o_stream_create_lzma+0xeb) [0x7f8538393ecb] -> /usr/lib/dovecot/modules/lib20_zlib_plugin.so(+0x2c14) [0x7f8538390c14] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_begin+0x43) [0x7f85392bdc23] -> dovecot/imap [user(a)domain.de 192.168.1.42 append](+0xd824) [0x7f8539788824] -> dovecot/imap [user(a)domain.de 192.168.1.42 append](cmd_append+0x10e) [0x7f8539788a6e] -> dovecot/imap [user(a)domain.de 192.168.1.42 append](command_exec+0x3c) [0x7f853979390c] -> dovecot/imap [user(a)domain.de 192.168.1.42 append](+0x178ff) [0x7f85397928ff] -> dovecot/imap [user(a)domain.de 192.168.1.42 append](+0x179b5) [0x7f85397929b5] -> dovecot/imap [user(a)domain.de 192.168.1.42 append](client_handle_input+0x125) [0x7f8539792cd5] -> dovecot/imap [user(a)domain.de 192.168.1.42 append](client_input+0x75) [0x7f8539793065] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7f8538fe55c7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7f8538fe6357] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f8538fe5168] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f8538f95723] -> dovecot/imap [user(a)domain.de 192.168.1.42 append](main+0x2c4) [0x7f8539787324] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f8538be6b45] -> dovecot/imap [user(a)domain.de 192.168.1.42 append](+0xc490) [0x7f8539787490] Apr 03 14:13:14 imap-login: Debug: SSL alert: close notify [192.168.1.42] Apr 03 14:13:14 imap(user(a)domain.de): Fatal: master: service(imap): child 23995 returned error 83 (Out of memory (service imap { vsz_limit=256 MB }, you may need to increase it) - set CORE_OUTOFMEM=1 environment to get core dump) ==============================================

3 2

[Dovecot] Crash in pop3 with version 2.2.12
by Urban Loesch 04 Apr '14

04 Apr '14

Hi, today I upgraded to version 2.2.12 under Debian Squeeze. I saw some people on the list they had the same problems with version 2.2.11, but which should have been fixed in version 2.2.12. My logfile shows: .. Mar 28 08:25:01 mailstore dovecot: pop3-login: Login: user=<ul(a)domain.net>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=34568, secured, session=<Jp6RmaX1YAB/AAAB> Mar 28 08:25:06 mailstore dovecot: pop3(ul(a)domain.net pid:34568 session:<Jp6RmaX1YAB/AAAB>): Fatal: master: service(pop3): child 34568 killed with signal 11 (core dumped) ... I made some more dubugging and I found that the pop3 process crashed on the "uidl" command. Here my output from telnet session: .. root@mailstore: # telnet localhost 110 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. +OK Dovecot ready. user ul(a)domain.net +OK pass PASS +OK Logged in. list +OK 5 messages: 1 3492 2 21924 3 3525 4 3472 5 3273 . uidl Connection closed by foreign host. ... Listing massages or retrieving messages works normally. Only on "uidl" command the services crashes. I made a backtrace. -----> start backtrace <----- Core was generated by `dovecot/pop3'. Program terminated with signal 11, Segmentation fault. #0 0x00007f9dd8ca488d in vfprintf () from /lib/libc.so.6 (gdb) bt full #0 0x00007f9dd8ca488d in vfprintf () from /lib/libc.so.6 No symbol table info available. #1 0x00007f9dd8cc6732 in vsnprintf () from /lib/libc.so.6 No symbol table info available. #2 0x00007f9dd904d0db in str_vprintfa (str=0x11aa4f8, fmt=0x409184 "%u %s", args=0x7ffffab4fff0) at str.c:155 args2 = {{gp_offset = 16, fp_offset = 48, overflow_arg_area = 0x7ffffab500e0, reg_save_area = 0x7ffffab50010}} init_size = 4231558 pos = 0 ret = <value optimized out> ret2 = <value optimized out> __FUNCTION__ = "str_vprintfa" #3 0x00000000004055ff in client_send_line (client=0x11d1e50, fmt=<value optimized out>) at pop3-client.c:678 str = 0x11aa4f8 _data_stack_cur_id = 4 va = {{gp_offset = 32, fp_offset = 48, overflow_arg_area = 0x7ffffab500e0, reg_save_area = 0x7ffffab50010}} ret = <value optimized out> __FUNCTION__ = "client_send_line" #4 0x00000000004073cd in list_uidls_saved_iter (client=0x11d1e50, ctx=0x11da3c0) at pop3-commands.c:666 found = true #5 list_uids_iter (client=0x11d1e50, ctx=0x11da3c0) at pop3-commands.c:693 str = <value optimized out> permanent_uidl = <value optimized out> found = <value optimized out> failed = <value optimized out> #6 0x0000000000407d88 in cmd_uidl (client=0x11d1e50, name=<value optimized out>, args=0x408880 "") at pop3-commands.c:874 ctx = 0x0 seq = <value optimized out> #7 client_command_execute (client=0x11d1e50, name=<value optimized out>, args=0x408880 "") at pop3-commands.c:938 No locals. #8 0x0000000000405870 in client_handle_input (client=0x11d1e50) at pop3-client.c:739 _data_stack_cur_id = 3 line = <value optimized out> args = 0x408880 "" ret = <value optimized out> #9 0x00007f9dd903c3d6 in io_loop_call_io (io=0x11d2760) at ioloop.c:388 ioloop = 0x11b2740 t_id = 2 #10 0x00007f9dd903d45f in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:220 ctx = 0x11b2aa0 event = 0x11b3900 list = 0x11b44d0 io = 0x51 tv = {tv_sec = 9, tv_usec = 999326} msecs = <value optimized out> ret = 1 i = 0 call = false __FUNCTION__ = "io_loop_handler_run" #11 0x00007f9dd903c348 in io_loop_run (ioloop=0x11b2740) at ioloop.c:412 __FUNCTION__ = "io_loop_run" #12 0x00007f9dd8fea953 in master_service_run (service=0x11b25d0, callback=0x409186) at master-service.c:566 No locals. #13 0x0000000000404ac7 in main (argc=1, argv=0x11b2390) at main.c:277 set_roots = {0x4094e0, 0x0} login_set = {auth_socket_path = 0x11aa050 "/var/run/dovecot/auth-master", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x404ca0 <login_client_connected>, failure_callback = 0x404c50 <login_client_failed>, request_auth_token = 0} service_flags = <value optimized out> storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = <value optimized out> (gdb) quit -----> end backtrace <----- And at least my pop3 configuration part: -----> start config <----- protocol pop3 { mail_plugins = " quota mail_log notify acl zlib stats" pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_lock_session = yes pop3_logout_format = bytes_sent=%o top=%t/%p, retr=%r/%b, del=%d/%m, size=%s uidl_hash=%u session=<%{session}> pop3_reuse_xuidl = yes } -----> end config <----- Setting "pop3_reuse_xuidl = no" has noe effect. Always the same crash. Thanks and regards Urban Loesch

4 6

[Dovecot] Use 1 userdb and LDAP passdb for mailbox without allow_all_users
by VALLIN Quentin 04 Apr '14

04 Apr '14

Hello everybody, I have a little pb with dovecot. I have been read on archive of dovecot mailing list that it's possible to have 1 static userdb with LDAP passdb (http://www.dovecot.org/list/dovecot/2010-November/055193.html) but when I try it I have an error message and my message is on the queue with "temporary failure" auth: Debug: master in: USER#0111#011quentinv#011service=lda auth: Debug: password(quentinv): passdb doesn't support credential lookups auth: Error: static(quentinv): passdb doesn't support lookups, can't verify user's existence auth: Debug: userdb out: FAIL#0111 lda: Error: user quentinv: Auth USER lookup failed lda: Fatal: Internal error occurred. Refer to server log for more information. auth: Debug: master in: USER#0111#011quentinv#011service=lda auth: Debug: password(quentinv): passdb doesn't support credential lookups auth: Error: static(quentinv): passdb doesn't support lookups, can't verify user's existence auth: Debug: userdb out: FAIL#0111 lda: Error: user quentinv: Auth USER lookup failed lda: Fatal: Internal error occurred. Refer to server log for more information. My imap connexion havn't any pb but LDA yes. Here is my dovecot.conf # 2.2.10: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 7.4 ext3 auth_debug = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_gid = 8 first_valid_uid = 15 listen = * login_greeting = Bienvenue sur courriel login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c mail_fsync = never mail_gid = 8 mail_location = maildir:/var/mail/%n:CONTROL=/var/mail/%n/control:INDEX=/var/mail/%n/index mail_log_prefix = "%Us(%u): " mail_privileged_group = mail mail_uid = 15 passdb { args = /usr/local/dovecot/etc/dovecot-ldap.conf driver = ldap } plugin { quota = maildir quota_rule = *:storage=3145728 quota_rule2 = Trash:storage=+102400 quota_warning = storage=90%% /usr/local/dovecot/bin/quota-warning.sh 90 } protocols = imap service auth { executable = /usr/local/dovecot/libexec/dovecot/auth } service imap-login { chroot = login executable = /usr/local/dovecot/libexec/dovecot/imap-login process_limit = 400 process_min_avail = 3 service_count = 1 user = dovecot vsz_limit = 32 M } service imap { drop_priv_before_exec = no executable = /usr/local/dovecot/libexec/dovecot/imap process_limit = 512 } service pop3-login { chroot = login process_limit = 256 process_min_avail = 3 service_count = 1 user = dovecot vsz_limit = 32 M } service pop3 { drop_priv_before_exec = no process_limit = 512 } ssl_cert = ssl_cipher_list = ssl_key = </ userdb { args = uid=vmail gid=mail home=/var/mail/%n driver = static } valid_chroot_dirs = /var/mail protocol imap { imap_logout_format = bytes=%i/%o imap_max_line_length = 64 k mail_max_userip_connections = 5 mail_plugins = quota imap_quota } protocol lda { deliver_log_format = msgid=%m: %$ hostname = courriel2.coria.fr mail_fsync = optimized mail_plugins = quota postmaster_address = postmaster(a)coria.fr<mailto:postmaster@coria.fr> rejection_reason = Your message to <%t> was automatically rejected : %n%r rejection_subject = Automatically rejected mail sendmail_path = /usr/lib/sendmail } And my dovecot-ldap.conf tls = no uris = ldap://x.x.x.x:389 ldap_version = 3 auth_bind = yes dn = userdn dnpass = pass base = ou=Users,dc=quentin,dc=local scope = subtree deref = never pass_filter = (&(SamAccountName=%n)(objectClass=person)(!(userAccountControl=514))) pass_attrs =uid=user, userPassword=password default_pass_scheme = CRYPT Sincerly, Quentin. [signature]

1 0

Re: [Dovecot] Disable maildir indexing and dovecot-uidlist on LMTP/LDA delivery
by Joseph Tam 04 Apr '14

04 Apr '14

Jouko Nikula <jonikula(a)gmail.com> writes: > Is there a way to use LMTP (or LDA) so that maildir index and > dovecot-uidlist are not updated? > > My setup is such that mail delivery sees user's maildir as write only. This > setup works well when using postfix for mail delivery, but when I try to > switch to dovecot LMTP the lmtp process wants to read the dovecot-uidlist > and fails on insufficient privileges. Is there a way around this without > exposing the maildir and mail home for read access? You could create MEMORY indices e.g. mail_location = maildir:~/Maildir:INDEX=MEMORY which will allow all the other processing like sieve to work. However, I would look at the cause of the "insufficient privileges": it is a symptom of something that could lead to other problems. Joseph Tam <jtam.home(a)gmail.com>

2 3

[Dovecot] dovecot 2.2.10 & fts_lucene: Failed to initialize backend
by Benjamin Podszun 03 Apr '14

03 Apr '14

Hey there. (Lesson to self: Don't try to be cute. Somehow a trademark sign breaks my setup and the rest of the mail is discarded? Sorry for the previous, incomplete post) Lurking most of the time here, currently I'm trying to make FTS work. As far as I understand [1], squat is deprecated, solr is a rather big dependency for my 'friends & family' type of installation: Lucene it is! My problem: The lucene backend isn't working, I get this error whenever I try to access it (be it doveadm fts or a search, triggering an index): # doveadm fts rescan -u dar(a)darklajid.de doveadm(dar(a)darklajid.de): Error: fts: Failed to initialize backend 'lucene': Unknown backend doveadm(dar(a)darklajid.de): Error: fts not enabled for user's namespace (null) Any ideas what I might be doing wrong here? All the details I could think of are below, any help would be appreciated. Regards, Ben -- Package information # pkg info dovecot2 dovecot2-2.2.10 Name : dovecot2 Version : 2.2.10 Installed on : Mon Mar 31 17:14:26 CEST 2014 Origin : mail/dovecot2 Architecture : freebsd:10:x86:64 Prefix : /usr/local Categories : mail ipv6 Licenses : MIT or LGPL21 Maintainer : bra(a)fsn.hu WWW : http://www.dovecot.org/ Comment : Secure and compact IMAP and POP3 servers Options : DOCS : off EXAMPLES : off GSSAPI : off KQUEUE : on LDAP : off LIBWRAP : off LUCENE : on MYSQL : off PGSQL : on SOLR : off SQLITE : off SSL : on VPOPMAIL : off Shared Libs required: libssl.so.8 libpq.so.5 libdovecot.so.0 libdovecot-storage.so.0 libdovecot-login.so.0 libdovecot-lda.so.0 libcrypto.so.8 libclucene-shared.so.1 libclucene-core.so.1 Shared Libs provided: libssl_iostream_openssl.so libdovecot.so.0 libdovecot-storage.so.0 libdovecot-sql.so.0 libdovecot-login.so.0 libdovecot-lda.so.0 libdovecot-compression.so.0 libauthdb_imap.so lib95_imap_stats_plugin.so lib90_stats_plugin.so lib30_imap_zlib_plugin.so lib21_fts_squat_plugin.so lib21_fts_lucene_plugin.so lib20_zlib_plugin.so lib20_virtual_plugin.so lib20_replication_plugin.so lib20_mailbox_alias_plugin.so lib20_mail_log_plugin.so lib20_listescape_plugin.so lib20_fts_plugin.so lib20_expire_plugin.so lib20_doveadm_fts_plugin.so lib20_doveadm_fts_lucene_plugin.so lib20_autocreate_plugin.so lib15_notify_plugin.so lib11_trash_plugin.so lib11_imap_quota_plugin.so lib10_quota_plugin.so lib10_doveadm_quota_plugin.so lib10_doveadm_expire_plugin.so lib10_doveadm_acl_plugin.so lib05_snarf_plugin.so lib05_pop3_migration_plugin.so lib02_lazy_expunge_plugin.so lib02_imap_acl_plugin.so lib01_acl_plugin.so -- Sure enough, the libraries are there/in places that look fine to me: # pkg info -l dovecot2 | grep -i fts /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.a /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.la /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.a /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.la /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so /usr/local/lib/dovecot/lib20_fts_plugin.a /usr/local/lib/dovecot/lib20_fts_plugin.la /usr/local/lib/dovecot/lib20_fts_plugin.so /usr/local/lib/dovecot/lib21_fts_lucene_plugin.a /usr/local/lib/dovecot/lib21_fts_lucene_plugin.la /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so /usr/local/lib/dovecot/lib21_fts_squat_plugin.a /usr/local/lib/dovecot/lib21_fts_squat_plugin.la /usr/local/lib/dovecot/lib21_fts_squat_plugin.so -- Doveconf: # 2.2.10: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.0-RELEASE amd64 ufs first_valid_uid = 1 login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_home = /var/vmail/%d/%n mail_location = maildir:/var/vmail/%d/%n/Maildir mail_plugins = fts mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = mailbox Drafts { auto = no special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = create special_use = \Trash } prefix = separator = / } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { antispam_backend = dspam antispam_dspam_args = --user;%Lu;--source=error;--signature=%%s antispam_dspam_binary = /usr/local/bin/dspamc antispam_dspam_notspam = --class=innocent antispam_dspam_result_header = X-DSPAM-Result antispam_dspam_spam = --class=spam antispam_signature = X-DSPAM-Signature antispam_signature_missing = error antispam_spam = Spam;Junk antispam_trash = trash;Trash fts = lucene fts_lucene = whitespace_chars=@. sieve = ~/.dovecot.sieve sieve_before = /usr/local/etc/dovecot/sieve/before sieve_dir = ~/sieve } postmaster_address = postmaster(a)ben.sh protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/prosody/private/auth { group = prosody mode = 0660 user = prosody } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { process_limit = 128 } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl = required ssl_cert = </usr/local/etc/dovecot/ssl/certs/ben.sh.pem ssl_cipher_list = EECDH+ECDSA+AESGCM EECDH+aRSA+AESGCM EECDH+ECDSA+SHA384 EECDH+ECDSA+SHA256 EECDH+aRSA+SHA384 EECDH+aRSA+SHA256 EECDH+aRSA+RC4 EECDH EDH+aRSA RC4 !aNULL !eNULL !LOW !3DES !MD5 !EXP !PSK !SRP !DSS !RC4 ssl_key = </usr/local/etc/dovecot/ssl/private/ben.sh.key userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol sieve { mail_max_userip_connections = 10 managesieve_max_compile_errors = 5 } protocol lmtp { mail_plugins = quota sieve } protocol imap { mail_plugins = fts fts_lucene quota imap_quota antispam } 1: http://wiki2.dovecot.org/Plugins/FTS

2 3

[Dovecot] Disable maildir indexing and dovecot-uidlist on LMTP/LDA delivery
by Jouko Nikula 03 Apr '14

03 Apr '14

Hello all, Is there a way to use LMTP (or LDA) so that maildir index and dovecot-uidlist are not updated? My setup is such that mail delivery sees user's maildir as write only. This setup works well when using postfix for mail delivery, but when I try to switch to dovecot LMTP the lmtp process wants to read the dovecot-uidlist and fails on insufficient privileges. Is there a way around this without exposing the maildir and mail home for read access? Regards, Jouko Nikula

5 4

Re: [Dovecot] Is replication broken?
by IT geek 31 03 Apr '14

03 Apr '14

> > Honestly, for most setups I would recommend LMTP nowadays. >> > I don't use Postfix, but that page looks good: > http://wiki2.dovecot.org/HowTo/PostfixDovecotLMTP I followed the guide, but I received the following error: Apr 3 08:41:31 server1 postfix/lmtp[4084]: DE4321F83A: to=<user1(a)test.com>, relay=server1.test.com[private/dovecot-lmtp], delay=491, delays=490/0.21/0.02/0.02, dsn=5.1.1, status=bounced (host server1.test.com[private/dovecot-lmtp] said: 550 5.1.1 <user1(a)test.com> User doesn't exist: user1(a)test.com (in reply to RCPT TO command)) The solution was to add the following line to my dovecot.conf: auth_username_format = %Ln All is now working as expected. Now to crack on with replication... :-) -Mark

1 0

[Dovecot] dovecot 2.2.10 & fts_lucene: Failed to initialize backend
by Benjamin Podszun 03 Apr '14

03 Apr '14

Hey there. Lurking most of the time here, currently I'm trying to make FTS work™

1 0

Re: [Dovecot] Is replication broken?
by IT geek 31 03 Apr '14

03 Apr '14

> > Honestly, for most setups I would recommend LMTP nowadays. > I don't use Postfix, but that page looks good: > http://wiki2.dovecot.org/HowTo/PostfixDovecotLMTP > > You do not need to do anything special in postfix, if you use Dovecot's > LDA or LMTP, when you change the storage backend. Most importantly, that > way you can let UserDB return a different mail_location per recipient > without postfix knowing anything about the difference. > Thank you Steffen, I shall give that a go and report back with how I get on. -Mark

1 0

[Dovecot] nfs flush/fsync config settings problem
by Troton_admin 03 Apr '14

03 Apr '14

Hi, I need to place a maildir storage on a NFS filesystem, so I set up the config like this: mmap_disable = yes mail_nfs_storage = yes mail_nfs_index = yes mail_fsync = always lock_method = dotlock (also tried fcntl - local lockd is running, no success, now using dotlock, to be sure while debugging) The problem is that Dovecot (2.2.9/2.2.10 - the relevant code in mail-index.c is the same) logs a fatal error and quits the session (no daemon crash/coredump). Jan 07 14:13:31 auth: Debug: client in: AUTH 1 PLAIN service=pop3 session=fRCRJGHvbADDUKU9 lip=192.168.100.102 rip=IP_ADDR lport=1110 rport=48236 resp=AHRyb3RvbjEAdHJvdG9uMQ== (previous base64 data may contain sensitive data) Jan 07 14:13:31 auth: Debug: passwd-file(troton1,IP_ADDR,<fRCRJGHvbADDUKU9>): lookup: user=troton1 file=/usr/local/etc/dovecot/passwd-file Jan 07 14:13:31 auth: Debug: client passdb out: OK 1 user=troton1 Jan 07 14:13:31 auth: Debug: master in: REQUEST 1289355265 29049 1 4f9fdd9e4069fa503e8e6bcc09d4cf30 session_pid=29089 Jan 07 14:13:31 auth: Debug: passwd-file(troton1,IP_ADDR,<fRCRJGHvbADDUKU9>): lookup: user=troton1 file=/usr/local/etc/dovecot/passwd-file Jan 07 14:13:31 auth: Debug: master userdb out: USER 1289355265 troton1 uid=81 gid=81 home=/home/troton1 mail=maildir:~/Maildir Jan 07 14:13:31 pop3-login: Info: Login: user=<troton1>, method=PLAIN, rip=IP_ADDR, lip=192.168.100.102, mpid=29089, session=<fRCRJGHvbADDUKU9> Jan 07 14:13:31 pop3: Debug: Added userdb setting: mail=maildir:~/Maildir Jan 07 14:13:31 pop3(troton1): Debug: Effective uid=81, gid=81, home=/home/troton1 Jan 07 14:13:31 pop3(troton1): Debug: Namespace inbox: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir Jan 07 14:13:31 pop3(troton1): Debug: maildir++: root=/home/troton1/Maildir, index=, indexpvt=, control=, inbox=/home/troton1/Maildir, alt= Jan 07 14:13:31 pop3(troton1): Info: DEBUG1: fsync_mode=2 , mask=0 Jan 07 14:13:31 pop3(troton1): Info: DEBUG2: fsync_mode=2 flags=85 Jan 07 14:13:31 pop3(troton1): Debug: Namespace : Using permissions from /home/troton1/Maildir: mode=0700 gid=default Jan 07 14:13:31 pop3(troton1): Info: DEBUG2: fsync_mode=0 flags=85 The user/passdb is just a plaintext file, for debugging purposes. But what is strange, the messages system log shows: Jan 7 14:13:31 mailhub2 dovecot: pop3(troton1): Fatal: nfs flush requires mail_fsync=always That is obviously wrong, even its own doveconf -n utility shows the correct value. # doveconf -n | grep -E 'sync|nfs' mail_fsync = always mail_nfs_index = yes mail_nfs_storage = yes maildir_very_dirty_syncs = yes Affected code seems to be in the lib-index/mail-index.c file, mail_index_file function - around line 585 : // my custom debug line i_info("DEBUG2: fsync_mode=%u flags=%u", (unsigned int)(index->fsync_mode),(unsigned int)flags); if ((flags & MAIL_INDEX_OPEN_FLAG_NFS_FLUSH) != 0 && index->fsync_mode != FSYNC_MODE_ALWAYS) i_fatal("nfs flush requires mail_fsync=always"); The first time it sees fsync_mode=2 (which is correct value of FSYNC_MODE_ALWAYS), but next function call is with index->fsync_mode=0 and an error is raised, see the logfile above. Dovecot correctly creates its working files in user's home directory - dovecot-uidlist, dovecot-uidvalidity, dovecot-uidvalidity.52cbfd7b, dovecot.index.log . The complete (testing, not production) doveconf -n is: == # 2.2.10: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 7.3-RELEASE-p3 amd64 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = sha1 default_process_limit = 200 disable_plaintext_auth = no first_valid_uid = 81 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep info_log_path = /var/log/dovecot.log last_valid_uid = 81 listen = 192.168.100.102 lock_method = dotlock mail_debug = yes mail_fsync = always mail_gid = 81 mail_location = maildir:%h/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_prefetch_count = 5 mail_uid = 81 mailbox_list_index = yes maildir_stat_dirs = yes maildir_very_dirty_syncs = yes mmap_disable = yes namespace inbox { inbox = yes location = mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . type = private } passdb { args = scheme=plain username_format=%n /usr/local/etc/dovecot/passwd-file driver = passwd-file } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid subject size } pop3_enable_last = yes pop3_save_uidl = yes protocols = imap pop3 service doveadm { inet_listener { port = 9292 } } service imap-login { inet_listener imap { port = 1143 } } service imap { process_limit = 250 } service pop3-login { inet_listener pop3 { port = 1110 } } service pop3 { process_limit = 200 } ssl = no userdb { args = username_format=%n /usr/local/etc/dovecot/passwd-file default_fields = uid=81 gid=0 home=/home/%n driver = passwd-file } protocol imap { mail_max_userip_connections = 5 } protocol pop3 { mail_max_userip_connections = 5 } == OS: 7.3-RELEASE-p3 FreeBSD 7.3-RELEASE-p3 #1 amd64 Affected Dovecot version: 2.2.9, 2.2.10 How to repeat: Anytime I enter the correct username/pass pair And I tried to place the homedir on a local disk too, and I got the same error as on NFS. Any ideas, what could possibly be wrong ? Is it a feature or a bug ? Thanks for your help. Regards, Troton

3 2