- dovecot - dovecot.org

Fatal: lazy_expunge: Unknown namespace: '.EXPUNGED/'
by Philipp Faeustlin 21 Aug '14

21 Aug '14

Hello List, with dovecot version 2.2.13.9, I actually have a problem using lazy_expunge and acl together. Shared/Public Folders work fine with lazy_expunge disabled. If lazy_expunge is enabled and userA got a shared folder form userB, then there is the error shown in subject. My test case to reproduce the error. doveadm mailbox list -u userA@domain --> Output Fine. doveadm acl set -u userB@domain INBOX user=userA@domain lookup read write write-seen write-deleted insert expunge create --> Fine. doveadm mailbox list -u userA@domain --> Some output and then: --> doveadm(userA@domain): Fatal: lazy_expunge: Unknown namespace: '.EXPUNGED/' I think this is a bug in dovecot, can someone of the dovecot developers or someone else confirm this? If it is not please show me the fault in my configuration. In May 2014 there was a thread with the same issue on this mailing list, but with no solution. http://dovecot.org/pipermail/dovecot/2014-May/096355.html Best regards Philipp Fäustlin --------------------------------------------- # 2.2.13.9 (19befd72d9d8): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.11.2.el6.x86_64 x86_64 Scientific Linux release 6.5 (Carbon) auth_debug = yes auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %Ln auth_verbose = yes listen = * mail_debug = yes mail_gid = vmail mail_location = maildir:~/maildir mail_plugins = " acl lazy_expunge mail_log notify zlib notify replication" mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace { hidden = no ignore_on_failure = no inbox = no list = children location = maildir:%%h/maildir:INDEX=%h/Shared/%%u:CONTROL=%h/Shared/%%u prefix = Shared/%%u/ separator = / subscriptions = yes type = shared } namespace { location = maildir:/vmail/%d/public:INDEXPVT=~/index/%d/public prefix = Groups/ separator = / subscriptions = no type = public } namespace { hidden = yes list = no location = maildir:~/expunged prefix = .EXPUNGED/ separator = / subscriptions = no type = private } namespace inbox { inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db lazy_expunge = .EXPUNGED/ lazy_expunge_only_last_instance = yes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = tcps:mailhost1.rz.uni-hohenheim.de:12345 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } protocols = imap pop3 lmtp sieve replication_dsync_parameters = -d -l 30 -U service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service doveadm { inet_listener { port = 12345 ssl = yes } } service imap-login { process_min_avail = 16 service_count = 0 } service imap-postlogin { executable = script-login /usr/local/bin/postlogin.sh user = $default_internal_user } service imap { executable = imap imap-postlogin process_limit = 8192 } service lmtp { unix_listener /var/spool/postfix/private/lmtp-dovecot { group = postfix user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { process_min_avail = 16 service_count = 0 } service pop3 { process_limit = 8192 } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = vmail mode = 0660 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_client_ca_file = /etc/openldap/cacerts/chain.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = " acl lazy_expunge mail_log notify zlib notify replication sieve" } protocol imap { mail_plugins = " acl lazy_expunge mail_log notify zlib notify replication imap_acl imap_zlib" }

1 1

New user mailbox permission
by Gionatan Danti 21 Aug '14

21 Aug '14

Hi all, I have a problem with my Dovecot installation. First, some informations: - OS: CentOS 6.5 x86_64 - Dovecot: dovecot-2.0.9-7.el6.x86_64 Config: mail_location = sdbox:~/dbox user_query = SELECT username, password, 'vmail' as uid, 'vmail' as gid, '/var/vmail/%d/%n' as home, CONCAT('*:storage=', (quota DIV 1000)) as quota_rule FROM mailbox WHERE username='%u' What I want to do is to create a backup user to rsync the mailstore to a remote location. If possible, I don't want to use the root user for this operation. I already added the backup user to "vmail" group. The problem is that when a new user is created, it's base directory permission are 0700 (vmail:vmail). From what I read here (http://wiki2.dovecot.org/SharedMailboxes/Permissions, "Permissions to new /domain/user directories"), simply using the setgid bit is not sufficient because I am not using an absolute path for mail_location. My questions are: 1) all I need to do is to switch to an absolute mail_location? 2) it is possibile to solve my problem _without_ altering mail_location? Thanks. -- Danti Gionatan Supporto Tecnico Assyoma S.r.l. - www.assyoma.it email: g.danti(a)assyoma.it - info(a)assyoma.it GPG public key ID: FF5F32A8

2 2

How to configure read-only access during a migration?
by Jeffrey Tunison 20 Aug '14

20 Aug '14

Hi. I would appreciate your advice about these TWO PROBLEMS: ======================================================= Find the simplest way to A) configure a Dovecot 2.2.10 IMAP server to access (existing) email users' (mbox-format) mail folders ****in read-only mode.**** B) Do the above while allowing a master_user to access mail on behalf of real users. (I've got master_user access working in read-write mode.) Simplest because while I'm proficient at UNIX systems administration, I'm under time pressure and dovecot has a lot of configuration flexibility. Identifying the right way to do this is proving time- consuming. Namespaces? ACL's? passdb's? I thought it was time to bring in the dovecot wizards. You! GOAL: ======================================================= Without knowing or changing users' passwords, migrate several hundred users of dovecot IMAP to MS Exchange using the commercial product Transend. I'm manging the dovecot side, someone else is doing the Transend/Exchange piece. Migration would occur in batches due to slowness of the Transend side when dealing with users with email collections over a few gigabytes. I have a production IMAP server (dovecot 1.0.13 on 32-bit RHEL 4.9). Let's call it PROD for short. Users INBOXes are stored locally on PROD. Their other mail folders are stored on a second machine and accessed via NFS. Those other folders contain the great majority of the email to be migrated. Let's call the NFS server MIGR for short. On MIGR, I've set up a migration IMAP server (dovecot 2.2.10 on 64-bit RHEL 5.10). MIGR is a dedicated NFS server with newer hardware than PROD. It has an unused Ethernet NIC I can tell Transend to use. Both PROD and MIGR use NIS for authentication. Therefore PAM is consulted for passdb information, normally. No SQL db's used. I set up the second server (MIGR) for several reasons: 1) there are some users mail folders larger than the 32-bit file size limit found on the PROD server. 2) the bulk of the email is stored locally on the MIGR server. 3) the version of dovecot is much newer and therefore more likely to have fewer bugs and more configuration options. 4) I don't want to modify the production environment except where really necessary. Pointing Transend at MIGR instead of PROD seems like it will be faster and better. Telling end-users to use MIGR instead of PROD would allow them to verify that their email came across okay (into MS Exchange) without being able to modify the original copy of email (in Dovecot). In the days and weeks after migration. I may need to re-enable write access on PROD for certain users if the migration does not succeed. Transend has been dying on a number of test users despite tweaking its parameters in consultation with the vendor. "Corrupt" messages seem to be the issue. Users (or sysadmins) might be required to identify and delete the offending messages before we retry their migration. (Which folders and which messages are causing problems will hopefully be discernible in Transend logs.) Ha! If you've read this far, then I'd also say that I welcome any advice on changes to increase performance on MIGR, such as whether trying to minimize indexing as I've done is useful. Current configurations of the two servers follow. =========================================================================== PRODUCTION: =========================================================================== # 1.0.13: /etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot.log protocols: imaps imap listen: *:143 ssl_listen: *:993 ssl_cert_file: /etc/pki/dovecot/certs/dovecot.pem ssl_key_file: /etc/pki/dovecot/private/dovecot.key login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login login_processes_count: 20 login_max_processes_count: 500 max_mail_processes: 1524 first_valid_uid: 100 mail_location: mbox:~/Mail:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot-indexes/%u/ mbox_read_locks: dotlock mbox_write_locks: dotlock mbox_dotlock_change_timeout: 60 mbox_min_index_size: 2048 namespace: type: private separator: / inbox: yes namespace: type: private separator: / prefix: Mail/ hidden: yes namespace: type: private separator: / prefix: ~/Mail/ hidden: yes namespace: type: private separator: / prefix: mail/ hidden: yes namespace: type: private separator: / prefix: ~/mail/ hidden: yes auth default: master_user_separator: * verbose: yes debug: yes debug_passwords: yes passdb: driver: passwd-file args: /etc/dovecot.transend master: yes passdb: driver: shadow passdb: driver: pam userdb: driver: passwd =========================================================================== MIGRATION: =========================================================================== # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-348.18.1.el5 x86_64 Scientific Linux release 5.10 (Boron) auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_verbose = yes auth_verbose_passwords = plain first_valid_uid = 100 log_path = /var/log/dovecot.log mail_debug = yes mail_location = mbox:~/Mail:INBOX=/var/spool/concmail/%u:INDEX=MEMORY mbox_min_index_size = 50048 B mbox_write_locks = fcntl namespace four { hidden = yes location = prefix = ~/mail/ separator = / } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } namespace one { hidden = yes location = prefix = Mail/ separator = / } namespace three { hidden = yes location = prefix = mail/ separator = / } namespace two { hidden = yes location = prefix = ~/Mail/ separator = / } passdb { args = /etc/dovecot/dovecot.transend driver = passwd-file master = yes } passdb { driver = pam } protocols = imap service imap-login { process_min_avail = 15 service_count = 10 } service imap { process_limit = 2048 } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } verbose_proctitle = yes protocol imap { mail_max_userip_connections = 1000 }

1 0

LMTP re-reading all messages
by Florent Bautista 20 Aug '14

20 Aug '14

Hi all, I have a little problem with Dovecot 2.1.17 and MailDir accounts. I was using a shared file system (MooseFS), and all was pretty stable. Now I'm switching to CephFS, and Dovecot LMTP have problem to deliver mails. Very often, on large accounts, LMTP processes are running for a few hours before delivering the message. When I strace it, I can see that they are reading (open and stat operations) ALL the messages of the account. I was thinking to an index problem, but I think that after hundreds of delivered mails, indexes are rebuilded and problem should be solved. But not. The same way, If user connects to IMAP, a lot of IMAP processes get stuck on "getquotaroot" command (multiple processes for a single account). The previous FS didn't support mmap, so I disabled it. The new one supports it, so I enabled it, but it does not solve the problem. Do you have an idea of why Dovecot (LMTP or IMAP) spend a lot of time on large accounts ? Thank you a lot. Florent

2 2

antispam plugin crash
by Thomas Witt 20 Aug '14

20 Aug '14

Hi, the dovecot antispam plugin crahses here on a nullpointer dereference in antispam_copy() at mailbox.c The crash tracks back to a call of antispam_classify_copy(asms->box_class, asmb->box_class) At that point in time asmb is set to 0x0, causing the process to crash with SIGSEGV. Regards, Thomas GDB output: Program received signal SIGSEGV, Segmentation fault. antispam_copy (ctx=0x14ed9f0, mail=0x14c6cc0) at mailbox.c:107 107 enum mailbox_copy_type copy_type = (gdb) bt #0 antispam_copy (ctx=0x14ed9f0, mail=0x14c6cc0) at mailbox.c:107 #1 0x00007fdadb627fcd in mailbox_copy () from /usr/lib64/dovecot/libdovecot-storage.so.0 #2 0x00007fdada6cdba0 in act_store_execute () from /usr/lib64/dovecot/libdovecot-sieve.so.0 #3 0x00007fdada6c59d9 in sieve_result_execute () from /usr/lib64/dovecot/libdovecot-sieve.so.0 #4 0x00007fdada6d4a2a in sieve_execute () from /usr/lib64/dovecot/libdovecot-sieve.so.0 #5 0x00007fdada9212cb in lda_sieve_deliver_mail () from /usr/lib64/dovecot/lib90_sieve_plugin.so #6 0x00007fdadb8cae1a in mail_deliver () from /usr/lib64/dovecot/libdovecot-lda.so.0 #7 0x0000000000405ebd in client_input_data_handle () #8 0x00007fdadb34e9bf in io_loop_call_io () from /usr/lib64/dovecot/libdovecot.so.0 #9 0x00007fdadb34f8b7 in io_loop_handler_run_internal () from /usr/lib64/dovecot/libdovecot.so.0 #10 0x00007fdadb34ea29 in io_loop_handler_run () from /usr/lib64/dovecot/libdovecot.so.0 #11 0x00007fdadb34eaa8 in io_loop_run () from /usr/lib64/dovecot/libdovecot.so.0 #12 0x00007fdadb2fe803 in master_service_run () from /usr/lib64/dovecot/libdovecot.so.0 #13 0x0000000000404995 in main () (gdb) p asms $3 = (struct antispam_mailbox *) 0x0

3 9

Panic: file istream.c: line 167 with 2.2.13 + istream.c/.h from dovecot-2-2-dffc6dd2be0d
by Toni Mattila 20 Aug '14

20 Aug '14

Hi, Getting following panics with traces: Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Error: Cached message size smaller than expected (1782 < 1872) Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Error: Maildir filename has wrong S value, renamed the file from /path/cencored/Maildir/cur/1201713258.3136.host.cencored.fi,S=1782:2,S to /path/cencored/Maildir/cur/1201713258.3136.host.cencored.fi,S=1872:2,S Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Error: Corrupted index cache file /path/cencored/Maildir/dovecot.index.cache: Broken physical size for mail UID 5758 Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Error: read(/path/cencored/Maildir/cur/1201713258.3136.host.cencored.fi,S=1782:2,S) failed: Invalid argument Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Error: read(/path/cencored/Maildir/cur/1201713258.3136.host.cencored.fi,S=1782:2,S) failed: Invalid argument (uid=5758) Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Error: Cached message size smaller than expected (1781 < 1869) Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Error: Maildir filename has wrong S value, renamed the file from /path/cencored/Maildir/cur/1201767850.29173.host.cencored.fi,S=1781:2,S to /path/cencored/Maildir/cur/1201767850.29173.host.cencored.fi,S=1869:2,S Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Error: Corrupted index cache file /path/cencored/Maildir/dovecot.index.cache: Broken physical size for mail UID 5767 Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Error: read(/path/cencored/Maildir/cur/1201767850.29173.host.cencored.fi,S=1781:2,S) failed: Invalid argument Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Error: read(/path/cencored/Maildir/cur/1201767850.29173.host.cencored.fi,S=1781:2,S) failed: Invalid argument (uid=5767) Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Error: Cached message size smaller than expected (9252 < 9346) Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Error: Maildir filename has wrong S value, renamed the file from /path/cencored/Maildir/cur/1205131753.12346.host.cencored.fi,S=9252:2,RS to /path/cencored/Maildir/cur/1205131753.12346.host.cencored.fi,S=9346:2,RS Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Error: Corrupted index cache file /path/cencored/Maildir/dovecot.index.cache: Broken physical size for mail UID 6296 Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Panic: file istream.c: line 167 (i_stream_read): assertion failed: (old_size <= _stream->pos - _stream->skip) Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0x575c1f] -> /usr/lib/dovecot/libdovecot.so.0 [0x575c9d] -> /usr/lib/dovecot/libdovecot.so.0 [0x575514] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x13b) [0x57f99b] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x2b) [0x57fbfb] -> /usr/lib/dovecot/libdovecot.so.0 [0x565b5e] -> /usr/lib/dovecot/libdovecot.so.0 [0x567469] -> /usr/lib/dovecot/libdovecot.so.0(message_parser_parse_next_block+0x43) [0x565cd3] -> /usr/lib/dovecot/libdovecot.so.0(message_parser_parse_body+0x2c) [0x565e4c] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x944dd2] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_parts+0x6a) [0x945c7a] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_parts+0x16) [0x91ad76] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x94aa7c] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x94ba89] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblo Jul 6 08:11:52 dovecot: imap(user(a)domain.tld): Fatal: master: service(imap): child 31268 killed with signal 6 (core dumps disabled) These can of course be fixed with maildir-size-fix.pl and deleting dovecot index files, but there are thousands like these. Dovecot 1.2 didn't have any issues with these old maildirs transfered over from courierimap. Best Regards, Toni Mattila

2 9

Dovecot v2.2 FTS is not indexing "text/html" emails...
by Akash 20 Aug '14

20 Aug '14

Hi, I am not sure its intended or a fault in the newest Dovecot versions. I have been using Dovecot v1.2.15 on Debian squeeze and FTS is working as expected. When I search a quoted string "very good", I get 107 results including plain and HTML emails which have this phrase. In order to compare the benefits of lucene over squat, I recently started testing dovecot v2.2.13 on Debian Sid with the same maildir content. But now the same search "very good" yielded just 8 results. I thought it could be some problem with lucene so I tried switching to squat and got 107 results again. After this I deleted the old squat search index files created by v1.2.15 and re-indexed the mail-box by using doveadm index command. Now the same squat search is giving 8 results just as lucene. So I have realized that its not a problem with just lucene but FTS in newer dovecot isn't indexing those emails which have Content-type as text/html. Thus if a mail is like this: Content-Type: text/html <b>He is very good.</b> It isn't shown in search by the squat indexes created using dovecot v2.2.13. I have done further testing on some sample emails which confirmed this behavior. Why is this so? -Regards, Akash

2 2

2.2.13 + hg: Panic: file ioloop.c: line 39 (io_add_file): assertion failed: (fd >= 0)
by Toni Mattila 20 Aug '14

20 Aug '14

Hi, Found this in logfiles: Jul 25 14:12:38 dovecot: pop3(cen(a)so.red): Error: UIDL: File name lookup failed: Message was expunged Jul 25 14:12:38 dovecot: pop3(cen(a)so.red): Disconnected: POP3 UIDLs couldn't be listed top=187/356348, retr=0/0, del=0/1207, size=789346199 Jul 25 14:12:38 dovecot: pop3(cen(a)so.red): Panic: file ioloop.c: line 39 (io_add_file): assertion failed: (fd >= 0) Jul 25 14:12:38 dovecot: pop3(cen(a)so.red): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0xbdfc1f] -> /usr/lib/dovecot/libdovecot.so.0 [0xbdfc9d] -> /usr/lib/dovecot/libdovecot.so.0 [0xbdf514] -> /usr/lib/dovecot/libdovecot.so.0 [0xbf162d] -> /usr/lib/dovecot/libdovecot.so.0(io_add_istream+0x3f) [0xbf272f] -> dovecot/pop3 [0x804d149] -> /usr/lib/dovecot/libdovecot.so.0 [0xbff17a] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x48) [0xbf1d88] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xff) [0xbf375f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x1e) [0xbf1e2e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x48) [0xbf1eb8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x2d) [0xb9842d] -> dovecot/pop3(main+0x2a9) [0x804b3b9] -> /lib/i686/nosegneg/libc.so.6(__libc_start_main+0xdc) [0x6f7dec] -> dovecot/pop3 [0x804aeb1] Jul 25 14:12:38 dovecot: pop3(cen(a)so.red): Fatal: master: service(pop3): child 27510 killed with signal 6 (core dumped) (gdb) bt #0 0x00b1a402 in __kernel_vsyscall () #1 0x0070af30 in raise () from /lib/i686/nosegneg/libc.so.6 #2 0x0070c911 in abort () from /lib/i686/nosegneg/libc.so.6 #3 0x00bdfc14 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:193 #4 0x00bdfc9d in i_internal_fatal_handler (ctx=0xbf82cd34, format=0xc0c784 "file %s: line %d (%s): assertion failed: (%s)", args=0xbf82cd54 "\202\232�") at failures.c:657 #5 0x00bdf514 in i_panic (format=0xc0c784 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 #6 0x00bf162d in io_add_file (fd=-1, condition=IO_READ, source_linenum=816, callback=0x804d150 <client_input>, context=0x83ba628) at ioloop.c:40 #7 0x00bf272f in io_add_istream (input=0x83ba960, source_linenum=816, callback=0x804d150 <client_input>, context=0x83ba628) at ioloop.c:86 #8 0x0804d149 in client_output (client=0x83ba628) at pop3-client.c:815 #9 0x00bff17a in stream_send_io (fstream=0x83baa48) at ostream-file.c:468 #10 0x00bf1d88 in io_loop_call_io (io=0x83baaf8) at ioloop.c:441 #11 0x00bf375f in io_loop_handler_run_internal (ioloop=0x83a5498) at ioloop-epoll.c:220 #12 0x00bf1e2e in io_loop_handler_run (ioloop=0x83a5498) at ioloop.c:488 #13 0x00bf1eb8 in io_loop_run (ioloop=0x83a5498) at ioloop.c:465 #14 0x00b9842d in master_service_run (service=0x83a53c0, callback=0x804b4e0 <client_connected>) at master-service.c:566 #15 0x0804b3b9 in main (argc=Cannot access memory at address 0x0 ) at main.c:277 (gdb) Thanks, Toni

2 1

[Patch] mail_log plugin supports remote, local ip addresses
by Vitaliy T 20 Aug '14

20 Aug '14

Hello, In attached file you will find patch for mail_log plugin to output local, remote ip addresses. It may be usefull for somebody. To enable support for dovecot 2.2.x versions change the line 'include "net.h"' instead of 'include "network.h"'. Thank you. P.S. Sorry, for previous empty message. -- With Best Regards, Vitaliy T.

2 1

auth_username_translation and LTMP problem
by Arkadiusz Miśkiewicz 20 Aug '14

20 Aug '14

auth_username_translation seems to be appliet on RCPT TO address of LTMP transport. Why dovecot is doing that? And better question - is there a way to disable auth_username_translation for LTMP but leave enabled for the rest (imap, pop3 etc) ? Background: I'm doing auth_username_translation = @= to allow logins like aaa(a)bbb.pl to be internally translated to aaa=bbb.pl. That works fine. Now my exim delivers mail to dovecot using LTMP and it does translation or it own, so it does: RCPT TO: <aaa=bbb.pl(a)mymbox.pl> Unfortunately looks like dovecot it doing translation one more time and looking in user database for aaa=bbb.pl=mymbox.pl where such user doesn't exist. Only aaa=bbb.pl user exists. Thanks, -- Arkadiusz Miśkiewicz, arekm / maven.pl

2 2

Mail Archiving/Lucene Indexes/mbox
by Larry Rosenman 20 Aug '14

20 Aug '14

I have a script (available on demand) that moves all my mail for a given month to a separate NAMESPACE (#ARCHIVE). When I do that, the lucene-indexes folder in the PRIMARY namespace seems to get cleaned out, and NOTHING gets put in the lucene-indexes folder (although it gets created) in the #ARCHIVE namespace. Is this to spec? the archiving is done via doveadm move commands. Thanks! -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 108 Turvey Cove, Hutto, TX 78634-5688

2 3

Segfault with indexer-worker using Tika/Solr
by G H 20 Aug '14

20 Aug '14

Using Dovecot 2.2.13 with Tika 1.5 on Centos 5 64bit Tika is throwing an exception for some reason, which seems to be causing Dovecot's indexer to segfault. I'm using mdbox/gzipped compressed mail and private indexes for the shared folder. I'm importing mail via formail/dovecot-lda: formail -s /usr/libexec/dovecot/dovecot-lda -d admin -m Public/TestSubFolder < /tmp/Inbox.mbox dovecot -n and the GDB backtrace are attached. # find /var/mail/ -maxdepth 2 /var/mail/_public /var/mail/_public/dovecot.mailbox.log /var/mail/_public/dovecot-uidvalidity /var/mail/_public/dovecot-uidvalidity.53ecade1 /var/mail/_public/storage /var/mail/_public/subscriptions /var/mail/_public/mailboxes /var/mail/admin /var/mail/admin/dovecot-uidvalidity.53ecade2 /var/mail/admin/dovecot.mailbox.log /var/mail/admin/public /var/mail/admin/dovecot-uidvalidity /var/mail/admin/storage /var/mail/admin/subscriptions /var/mail/admin/mailboxes

2 1

BUG: Solr FTS engine appends domain name to index records
by G H 20 Aug '14

20 Aug '14

The Solr FTS engine appends domain names to the "user" and "id" fields inside Solr when indexing. However, when an IMAP search is performed, the domain name is not appended, resulting in 0 results, 100% of the time. You can reproduce this by setting up dovecot to have user names like "admin", "james", etc (as opposed to admin(a)example.com) Then import some mail (ie: "dovecot-lda -d admin < /tmp/mymail.txt"). Now attempt to search for that mail and it will not be returned as a result. You can see in the Solr GUI (http://xxxx:8983/solr/) that record is indexed as: { "uid": 1, "box": "7dff0b0d4f84df53f25300003d823887", "user": "admin(a)example.com", "id": "1/7dff0b0d4f84df53f25300003d823887/admin(a)example.com", "_version_": 1475511406809841700 } However, the IMAP search is sent to Solr performed with user:"admin" instead of user:"admin(a)example.com". Either the Solr FTS plugin needs to not append the domain name or the search does need to do so.

2 2

Trouble getting public folders working
by Bjarne Mark Kondrup 20 Aug '14

20 Aug '14

Hi i have trouble getting my public folders working properly. I have a few issues atm with them. First off i'm using version 2.0.9 as it came with CentOS and would greatly prefer to keep this version. Here is my dovecot.conf file # dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.23.3.el6.centos.plus.x86_64 x86_64 CentOS release 6.5 (Final) ext4 auth_debug = yes auth_verbose = yes disable_plaintext_auth = no first_valid_uid = 101 last_valid_uid = 101 login_greeting = Dovecot ready. CEGO webmail server mail_debug = yes mail_gid = vmail mail_location = maildir:/home/vmail/domains/%d/%n mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl namespace { inbox = yes location = prefix = separator = / type = private } namespace { location = maildir:/home/vmail/shared:LAYOUT=fs:INDEX=/home/vmail/shared/ prefix = shared/ separator = / subscriptions = no type = public } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { sieve = /home/vmail/domains/%d/%n/dovecot.sieve sieve_dir = /home/vmail/domains/%d/%n/sieve_scripts sieve_global_dir = /etc/dovecot/sieve/global/ } protocols = imap lmtp sieve service auth { unix_listener auth-client { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = root } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl = no ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } valid_chroot_dirs = /home/vmail/domains verbose_ssl = yes protocol lmtp { log_path = /var/log/dovecot-deliver.log mail_plugins = quota sieve sieve acl postmaster_address = postmaster(a)cegotest.dk } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } And my dovecot-ldap file hosts = localhost dn = cn=dovecot,dc=cegotest,dc=dk dnpass = password auth_bind = yes ldap_version = 3 base = o=hosting,dc=cegotest,dc=dk deref = never scope = subtree user_filter = (&(objectClass=JammMailAccount)(mail=%u)(accountActive=TRUE)(delete=FALSE)) pass_attrs = mail,userPassword pass_filter = (&(objectClass=JammMailAccount)(mail=%u)(accountActive=TRUE)(delete=FALSE)) default_pass_scheme = CRYPT Here is my current issues. 1. I cannot get shared folders to work with pr. user settings. What i want is a public folder that all my users can see but each user marks mail as read individually. Atm no matter how i set it up if user1 marks a mail as read, then user2 will also see that mail as read :( 2. ACL to control the permissions. Right now all users can move mail and remove mail from the shared folders. I want people (except a few specific users) to be read only on this public folders. 3. Need to know if i'm creating the folders correctly. Right now i'm under my shared folder directory creating shared_folder and 3 subfolders beneath it (cur, new and tmp). After this it shows up in eg. roundcube and i can subscribe to it. I have read all the documentation and tried all the solutions i can. Mostly moving the index and/or config files to seperate dirs and from my understanding that should give each user their own index file marking what mails have been read ect. But this doesn't happen. Hope you guys are able to help me out a little here. -Bjarne

2 1

Huge difference between the lucene index size created by v2.1 and v2.2
by Akash 20 Aug '14

20 Aug '14

Hi everyone, While examining dovecot versions v2.1 and v2.2 for their lucene search performances, I have noticed a huge difference in the index sizes created by them. Both versions were compiled on same system, against same libclucene, same configure options and were used with same dovecot.conf during run-time. I deleted the lucene-indexes folder and dovecot* files in the Maildir prior to indexing with both versions. The tests were performed on a untouched mail archive folder containing 300000 mails without any dovecot* files in it: root@server:/home/admin/mails/.Archive# ls -l total 78640 drwx------ 2 2500 2500 14098432 Aug 17 22:16 cur drwx------ 2 2500 2500 12435456 Jul 30 09:46 new drwx------ 2 2500 2500 4096 Aug 2 13:02 tmp The command used was: doveadm -v index -u admin Archive After search indexing on v2.1 resulted in: root@server:/home/admin/mails# ls -lh lucene-indexes total 390M -rw------- 1 2500 2500 390M Aug 18 07:03 _25.cfs -rw------- 1 2500 2500 20 Aug 18 07:03 segments.gen -rw------- 1 2500 2500 46 Aug 18 07:03 segments_4d Whereas dovecot v2.2 resulted in: root@server:/home/admin/mails# ls -lh lucene-indexes total 1.5G -rw------- 1 2500 2500 1.5G Aug 18 06:41 _5g.cfs -rw------- 1 2500 2500 20 Aug 18 06:41 segments.gen -rw------- 1 2500 2500 46 Aug 18 06:41 segments_az 390M vs 1.5G. That is a huge difference in size. Why is that? Thanks in advance. -Regards, Akash

2 5

Problems with dovecot 2.2.13 and monit
by Hanno Böck 20 Aug '14

20 Aug '14

Hello, When I upgraded my servers to dovecot 2.2.13 the monitoring tool monit started to send out warnings that it couldn't reach my imap/pop3 servers through ssl any more. The same problem didn't happen on non-ssl-connections. According to people on the monit list this is likely a dovecot issue: https://lists.gnu.org/archive/html/monit-general/2014-06/msg00031.html Let me quote: > the root cause of the error is, that dovecot 2.2.13 closes the > connection if SSL is used in response to LOGOUT command instead of > sending usual response. When no SSL is enabled, dovecot responses to > LOGOUT command normally. [...] > According to RFC 3501 (http://tools.ietf.org/html/rfc3501) LOGOUT is > any-state command, where the server MUST send response before closing > the connection: http://tools.ietf.org/html/rfc3501#section-3.4 > > => the problem is caused by dovecot 2.2.13 bug ... its behaviour is > inconsistent (LOGOUT in non-authenticated state works per RFC > requirement if no SSL is used and doesn't conform to RFC if SSL is > used). It is possible that the problem is related to their DoS-attack > modification, which has most probably unexpected side-effect. Maybe this is related to the DDoS-protection measures that have been added in dovecot 2.2.13. Would apprechiate if someone could have a look. cu, -- Hanno Böck http://hboeck.de/ mail/jabber: hanno(a)hboeck.de GPG: BBB51E42

3 3

Designing a Dovecot Replicate cluster
by Minhas Listas 19 Aug '14

19 Aug '14

Hi all! Do I need one Dovecot Proxy/Director for each Dovecot Replicate Cluster ? Isn't possible to put a Dovecot Proxy/Director on the border of multiple clusters ? Thanks! -- Thiago Henrique www.adminlinux.com.br

1 0

Health monitoring of backend servers
by Minhas Listas 19 Aug '14

19 Aug '14

Does Dovecot Director health monitoring of backend servers ? Or is poolmon (http://www.dovecot.org/list/dovecot/2010-August/051946.html) the best option for this? Maybe Ldirectord? Thanks! -- Thiago Henrique www.adminlinux.com.br

2 4

[SOLVED] Re: Trying Dovecot Replication with dsync
by Minhas Listas 19 Aug '14

19 Aug '14

> > 1) > Aug 14 15:39:34 ceph1 dovecot: imap(account=domaintest.com): Error: > open(/var/run/dovecot/replication-notify-fifo) failed: Permission denied > > What is the correct perms for /var/run/dovecot/replication-notify-fifo ? > Currently: > # ll /var/run/dovecot/replication-notify-fifo > prw------- 1 root root 0 Aug 14 15:57 > /var/run/dovecot/replication-notify-fifo| > > Solved with: # chown dovemail:dovemail /var/run/dovecot/replication-notify-fifo dovemail is the user for imap processes. > 2) > Aug 14 16:02:34 ceph1 dovecot: dsync-server(account=domaintest.com): > Error: Couldn't create lock */var/lib/imap/account=domaintest.com > <http://domaintest.com>/*.dovecot-sync.lock: No such file or directory > Aug 14 16:02:34 ceph1 dovecot: dsync-local(account=domaintest.com): > Error: Couldn't create lock */var/lib/imap/account=domaintest.com > <http://domaintest.com>/*.dovecot-sync.lock: No such file or directory > > In my production cluster, it is automatically created by dovecot when the > user performs the first login: > */var/lib/imap/*<account> for INDEX > */var/spool/imap/*<account> for Mdbox > This was fixed with correct permission on /var/run/dovecot/replication-notify-fifo Thanks! -- Thiago Henrique www.adminlinux.com.br

2 1

IMAP on 993/SSL or 143/STARTTLS?
by Alex 18 Aug '14

18 Aug '14

Hi, I have a postfix+dovecot-2.2.13 system and have configured it to support IMAPS on 993 with SSL/TLS. I'm noticing with users using Thunderbird, the autodetect defaults to IMAPS on 143 with STARTTLS. Which is preferred? Which is more secure? Which is more common? Why would someone choose one over the other? Can I ask the same question about SMTP and submission? Why would one choose 587 with STARTTLS versus 465 with SSL/TLS? Thanks, Alex

4 3

Segmentation fault while indexing a large mailbox using doveadm..
by Akash 18 Aug '14

18 Aug '14

Hi, I am having the same issue as: http://www.dovecot.org/list/dovecot/2014-April/095681.html although I am using the latest dovecot-core and dovecot-lucene packages from the debian sid repo which already has the patch (http://hg.dovecot.org/dovecot-2.2/rev/5e42a8c18b51) mentioned in the above thread implemented. doveadm(admin): Info: Old.All: Caching mails seq=1..300332 9400/300332 Program received signal SIGSEGV, Segmentation fault. (gdb) bt #0 __wcslen ( s=s@entry=0xb93887a8 L" btnToggle: \"Change size\"}</script>\r\n<link href=\"http://s26 ucoz net/src/ulightbox/ulightbox css\" rel=\"stylesheet\" type=\"text/css\" /><script type=\"text/javascript\" src=\"http://s26 ucoz net/src/ulightb"...) at wcslen.c:36 #1 0xb7c026fd in wcsdup ( s=0xb93887a8 L" btnToggle: \"Change size\"}</script>\r\n<link href=\"http://s26 ucoz net/src/ulightbox/ulightbox css\" rel=\"stylesheet\" type=\"text/css\" /><script type=\"text/javascript\" src=\"http://s26 ucoz net/src/ulightb"...) at wcsdup.c:29 #2 0xb7a65660 in lucene::document::Field::Field(wchar_t const*, wchar_t const*, int, bool) () from /usr/lib/i386-linux-gnu/libclucene-core.so.1 #3 0xb7b5cd48 in lucene_index_build_more () from /usr/lib/dovecot/modules/lib21_fts_lucene_plugin.so #4 0xb7b5b7b9 in ?? () from /usr/lib/dovecot/modules/lib21_fts_lucene_plugin.so #5 0xb7b6ac2a in fts_backend_update_build_more () from /usr/lib/dovecot/modules/lib20_fts_plugin.so #6 0xb7b6b674 in ?? () from /usr/lib/dovecot/modules/lib20_fts_plugin.so #7 0xb7b6bbf4 in fts_build_mail () from /usr/lib/dovecot/modules/lib20_fts_plugin.so #8 0xb7b713cc in ?? () from /usr/lib/dovecot/modules/lib20_fts_plugin.so #9 0xb7e4969b in mail_precache () from /usr/lib/dovecot/libdovecot-storage.so.0 #10 0xb7fa1c7f in ?? () #11 0xb7f9d133 in _start () (gdb) # dovecot --version 2.2.13 Please help.. -Thanks, Akash

2 2

Dovecot failing with exit code 19200 in cron job
by Murray Trainer 18 Aug '14

18 Aug '14

Hi All, I am synchronizing a few hundred dovecot mailboxes with a perl script via a crontab. It works for a while (ie exit status=0) but the rest then start failing with exit code 19200. I tried redirecting STDERR but showed nothing. I suspect the cron job is hitting some sort of resource limit? If I run the perl script from the command line it appears to dsync all the accounts OK. The relevant part of my Perl code is below. Any ideas? Thanks, Murray foreach (@userlist) { my $email = $_; chomp ($email); # get rid of CR logit("Started sync of mailbox $email") if $debug; my $dsync_command="dsync -v -D -u $email mirror ssh -C root@$mailstore dsync -u $email"; logit("dsync_command=$dsync_command"); # Run dsync of mailbox logit("Started secondary sync of $mailbox to $mailstore") if $debug; my $exit_status = system ( $dsync_command ); logit("Dsync exit status: $exit_status") if $debug; logit("Finished secondary sync of $mailbox to $mailstore") if $debug; }

2 1

NFS INTR mount option
by Murray Trainer 18 Aug '14

18 Aug '14

Hi again, We have our mailboxes on several NFS filesystems mounted with the options below. 10.11.0.238:/mailbox_store_01 on /home1 type nfs4 (rw,noatime,vers=4.0,rsize=65536,wsize=65536,namlen=255,hard,nordirplus,proto=tcp,port=0,timeo=600,retrans=2,sec=sys,clientaddr=10.11.0.95,local_lock=none,addr=10.110.238) On the rare occasions that the NFS mounts hang, the system load goes through the roof and I often have to reboot the mailstore server as dovecot process are hung and can't be killed. Will the NFS INTR mount option help in this situation? Thanks Murray Send EMAIL [1] Links: ------ [1] https://webmail.westnet.com.au/index.php/mail#

1 0

Manage Sieve Security?
by Chris 18 Aug '14

18 Aug '14

Dear All, can I expose Dovecot's Manage Sieve port to the internet or should I restrict access (e.g. by IP address or VPN)? -- Christian

2 1

virtual plugin in HG unaware of namespaces
by Thomas Leuxner 17 Aug '14

17 Aug '14

The latest changes to the virtual plugin seem to have a negative effect on name space rules: $ cat dovecot-virtual * Public/* flagged While flagged messages inside the mailbox still show up, messages flagged in 'Public' are not picked up anymore. Regards Thomas

1 1

INBOX subfolders not showing up
by Matthias Sitte 16 Aug '14

16 Aug '14

Hi, I have a problem with INBOX subfolders and subscriptions which I can't solve... Maybe somebody has seen this, too... I can create regular subfolders (not in INBOX) and (un-)subscribe to them with Thunderbird. If I create subfolders in the INBOX with TB this seems to work now in v31 (just found this out), but with v24.6 neither INBOX subfolder creation nor subscriptions worked. When I modified the `subscriptions' file manually on the server, the folders would show up in TB, though. Maybe this was a TB bug, but quite similarly INBOX subfolders don't show up on iPhones (iOS up-to-date), but all other subfolders do. Any ideas what's going on? Best, Matthias ====================================================================== # dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.6 ext4 hostname = familie-sitte.org log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:/srv/mail/%d/%n/Maildir:LAYOUT=fs managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = maildir:User quota quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)familie-sitte.org protocols = " imap sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl_cert = </etc/dovecot/ssl/mail_cert.pem ssl_cipher_list = SSDH+ECDSA+AESGCM:EECDH+aRSA+AESGCM:EECDH+ECDSA+SHA256:EECDH+aRSA+RC4:EDH+aRSA:EECDH:RC4:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS ssl_key = </etc/dovecot/ssl/mail_key.pem userdb { args = uid=vmail gid=vmail home=/srv/mail/%d/%n driver = static } protocol lda { mail_plugins = " quota sieve" } protocol imap { mail_plugins = " imap_quota quota" }

3 4

Server dovecot: auth: Warning: sql: Ignoring changed iterate_quer
by Joseph Malloy 16 Aug '14

16 Aug '14

Hello, I am having an issue with Dovecot. I am using Roundcube to access my mailboxes, which I have set up using ViMbAdmin. However when I go to the Roundcube, I get login Failed. So looking in the mail.log I can see the following: Aug 15 13:20:09 Server dovecot: auth: Warning: sql: Ignoring changed iterate_query in /etc/dovecot/dovecot-sql.conf.ext, because userdb sql not used. (If this is intentional, set userdb_warning_disable=yes) Aug 15 13:20:11 Server dovecot: imap-login: Disconnected (auth failed, 1 attempts in 2 secs): user=<joe(a)anoblequest.co.uk>, method=PLAIN, rip=62.49.15.89, lip=192.168.0.90, TLS, session=<su7WCqoALAA+MQ9Z> I am most greatful for the support Joe :)

2 1

namspace management
by A. Schulze 15 Aug '14

15 Aug '14

Hello, since some weeks I'm playing with namespaces. But I still did nod found a solution for all faces of different problems. Current issue: Public namespace. I have users inbox as follow: mail_home = /data/mail/%Ln/ mail_location = maildir:~/Maildir:INDEX=~/.dovecot.index namespace { inbox = yes separator = / prefix = INBOX/ } Public namespace: namespace { location = maildir:/data/mail_public/Maildir/:INDEXPVT=~/.dovecot.index.public/ prefix = PUBLIC/ separator = / type = public } that way only one subscription file is possible. Any use could subscribe/unsubscribe any folder and that match all users. If I add "subscription=no" the parent namespace' subscription is used. In fact there is no parent namespace an no subscription management is possible at all. On the other side I tried to change the PUBLIC namespace prefix to "INBOX/PUBLIC" but now the namespace is *below* the inbox. That's also not what I want. How do other users organise the namespaces INBOX, PUBLIC, SHARED and VIRTUAL (via virtual plugin) ? Thanks Andreas

3 4

(Again) Some trouble with dovecot 2.1(.7) and SASL
by admin 15 Aug '14

15 Aug '14

The parentheses in the subject are due to referral to this discussion on the mailing list: http://dovecot.org/list/dovecot/2012-February/063851.html At first I thought I found the problem, but then realized this was 2012 and the suggested patch already is applied in dovecot. I also have segault messages in my kernel log; not too many, but it was enough to dig for it: > Wed Jun 25 08:29:05 2014 auth[17590]: segfault at 10 ip 00007f02ad5e8e56 sp 00007fff932f9250 error 4 in auth[7f02ad5d3000+40000] > Mon Jun 30 16:11:41 2014 auth[12501]: segfault at 10 ip 00007fc6a1fefe56 sp 00007fff276e6ea0 error 4 in auth[7fc6a1fda000+40000] > Sat Jul 5 13:11:32 2014 auth[15603]: segfault at 10 ip 00007f6447a6be56 sp 00007fff09c48020 error 4 in auth[7f6447a56000+40000] > Tue Jul 8 05:08:21 2014 auth[30071]: segfault at 10 ip 00007ff22656ae56 sp 00007fff26b017f0 error 4 in auth[7ff226555000+40000] > Mon Jul 21 14:25:28 2014 auth[30918]: segfault at 10 ip 00007fe1fc817e56 sp 00007fff7e654f20 error 4 in auth[7fe1fc802000+40000] <--- > Wed Aug 13 18:56:31 2014 auth[27593]: segfault at 10 ip 00007ffbf8ce8e56 sp 00007fffe0157f70 error 4 in auth[7ffbf8cd3000+40000] > Wed Aug 13 18:57:59 2014 auth[24264]: segfault at 10 ip 00007f2df31bde56 sp 00007fff094263c0 error 4 in auth[7f2df31a8000+40000] The last 2 entries are a result of me being able to reproduce the problem, the 3rd last is the only one I was able to track down (due to log rotation) I tracked the problem down to a contact form of a website of one of my customers. whenever used, the segfault gets triggered. Nevertheless, the message always gets delivered. So we are talking about the marked line; the corresponding log entries from mail.info: > Jul 21 14:25:29 mail postfix/smtpd[27590]: connect from unknown[<webserver ip>] > Jul 21 14:25:29 mail dovecot: auth: Fatal: master: service(auth): child 30918 killed with signal 11 (core dumps disabled) > Jul 21 14:25:29 mail postfix/smtpd[27590]: warning: unknown[<webserver ip>]: SASL DIGEST-MD5 authentication failed: Connection lost to authentication server > Jul 21 14:25:29 mail dovecot: auth-worker(27595): mysql(127.0.0.1): Connected to database mail > Jul 21 14:25:29 mail postfix/smtpd[27590]: D4D8E44752: client=unknown[<webserver ip>], sasl_method=CRAM-MD5, sasl_username=<existing account and working account> > Jul 21 14:25:29 mail postfix/cleanup[27598]: D4D8E44752: message-id=<id(a)doma.in> > Jul 21 14:25:29 mail postfix/qmgr[13349]: D4D8E44752: from=<server(a)doma.in>, size=2680, nrcpt=1 (queue active) > Jul 21 14:25:29 mail postfix/smtpd[27590]: disconnect from unknown[<webserver ip>] > Jul 21 14:25:29 mail dovecot: lmtp(27600): Connect from local > Jul 21 14:25:30 mail postfix/lmtp[27599]: D4D8E44752: to=<info(a)doma.in>, orig_to=<contact(a)doma.in>, relay=<mailserver fqdn>[private/dovecot-lmtp], delay=0.19, delays=0.07/0.04/0.04/0.04, dsn=2.0.0, status=sent (250 2.0.0 <info(a)doma.in> MrY+OdkizVPQawAAMrkmwA Saved) > Jul 21 14:25:30 mail postfix/qmgr[13349]: D4D8E44752: removed > Jul 21 14:25:30 mail dovecot: lmtp(27600, info(a)doma.in) MrY+OdkizVPQawAAMrkmwA: msgid=<id(a)doma.in>: saved mail to INBOX > Jul 21 14:25:30 mail dovecot: lmtp(27600): Disconnect from local: Client quit (in reset) contact(a)doma.in is a virtual address which gets forwarded to info(a)doma.in (/etc/postfix/virtual). The used CMS is PyroCMS (v2.2.3) - the version is not up2date, but nevertheless the CMS might be the one to blame, a service should not segfault. Some packages are to be updated, as well as the CMS; but I am willing to wait to provide information, which leads to the problem, as I cannot switch between different versions on my productive system for the sake of gaining debug information. I hope that someone has any kind of clue and is willing to resolve that issue with me, asking me for the necessary information to do so. Thanks in advance!

2 1

Multiple Passdb's - Order
by Jean-Louis Dupond 15 Aug '14

15 Aug '14

Hi, Today I upgraded my dovecot to a newer version (2.2.9 debian wheezy-backports) At that moment I also reconfigured the whole thing a bit nicer. Now I stumbled on the following issue. In my configuration I use 2 backends (LDAP & passwd-file). passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/%n driver = static } Now this worked fine before. But if I tested it, LDAP logins worked, and passwd-file logins failed. Failed log (user is only in the passwd-file): Aug 01 21:31:55 auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 01 21:31:55 auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Aug 01 21:31:55 auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_pgsql.so Aug 01 21:31:55 auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_sqlite.so Aug 01 21:31:55 auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 01 21:31:55 auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so Aug 01 21:31:55 auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat Aug 01 21:31:55 auth: Debug: passwd-file /etc/dovecot/users: Read 10 users in 0 secs Aug 01 21:31:55 auth: Debug: auth client connected (pid=5516) Aug 01 21:31:55 auth: Debug: client in: AUTH 1 PLAIN service=imap secured session=c34kcZb/uwBbtKLu lip=xxx rip=xxxx lport=993 rport=52411 Aug 01 21:31:55 auth: Debug: client passdb out: CONT 1 Aug 01 21:31:55 auth: Debug: client in: CONT 1 xxxxx (previous base64 data may contain sensitive data) Aug 01 21:31:55 auth: Debug: cache(info(a)xxx.com,xxx,<c34kcZb/uwBbtKLu>): miss Aug 01 21:31:55 auth: Debug: ldap(info(a)xxx.com,xxx,<c34kcZb/uwBbtKLu>): pass search: base=uid=info(a)xxx.com,ou=mail,dc=dupie,dc=be scope=subtree filter=(&(objectClass=posixAccount)(uid=info(a)xxx.com)) fields=uid,userPassword Aug 01 21:31:55 auth: Debug: cache(info(a)xxx.com,xxx,<c34kcZb/uwBbtKLu>): miss Aug 01 21:31:55 auth: Debug: cache(info(a)xxx.com,xxx,<c34kcZb/uwBbtKLu>): miss Aug 01 21:31:55 auth: Debug: passwd-file(info(a)xxx.com,xxx,<c34kcZb/uwBbtKLu>): lookup: user=info(a)xxx.com file=/etc/dovecot/users Aug 01 21:31:57 auth: Debug: client passdb out: FAIL 1 user=info(a)xxx.com temp Aug 01 21:31:57 auth: Debug: client in: AUTH 2 PLAIN service=imap secured session=c34kcZb/uwBbtKLu lip=xxx rip=xxx lport=993 rport=52411 resp=xxx (previous base64 data may contain sensitive data) Aug 01 21:32:01 auth: Debug: cache(info(a)xxx.com,xxx,<c34kcZb/uwBbtKLu>): miss Aug 01 21:32:01 auth: Debug: ldap(info(a)xxx.com,xxx,<c34kcZb/uwBbtKLu>): pass search: base=uid=info(a)xxx.com,ou=mail,dc=dupie,dc=be scope=subtree filter=(&(objectClass=posixAccount)(uid=info(a)xxx.com)) fields=uid,userPassword Aug 01 21:32:01 auth: Debug: cache(info(a)xxx.com,xxx,<c34kcZb/uwBbtKLu>): miss Aug 01 21:32:01 auth: Debug: cache(info(a)xxx.com,xxx,<c34kcZb/uwBbtKLu>): hit: {CRAM-MD5}19192922..... Aug 01 21:32:03 auth: Debug: client passdb out: FAIL 2 user=info(a)xxx.com temp As you see it returned a FAIL, but the password was retrieved from the users file (see the cache hit). Now I changed the order of the passdb's in my config, to make passwd-file come first, and then LDAP. And what happend now, it started working ... Logs: Aug 01 21:30:23 auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 01 21:30:23 auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Aug 01 21:30:23 auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_pgsql.so Aug 01 21:30:23 auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_sqlite.so Aug 01 21:30:23 auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 01 21:30:23 auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so Aug 01 21:30:23 auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat Aug 01 21:30:23 auth: Debug: passwd-file /etc/dovecot/users: Read 10 users in 0 secs Aug 01 21:30:23 auth: Debug: auth client connected (pid=5459) Aug 01 21:30:24 auth: Debug: client in: AUTH 1 PLAIN service=imap secured session=TTm6a5b/swBbtKLu lip=xxx rip=xxx lport=993 rport=52403 Aug 01 21:30:24 auth: Debug: client passdb out: CONT 1 Aug 01 21:30:24 auth: Debug: client in: CONT 1 xxxx (previous base64 data may contain sensitive data) Aug 01 21:30:24 auth: Debug: cache(info(a)xxx.com,xxx,<TTm6a5b/swBbtKLu>): miss Aug 01 21:30:24 auth: Debug: passwd-file(info(a)xxx.com,xxx,<TTm6a5b/swBbtKLu>): lookup: user=info(a)xxx.com file=/etc/dovecot/users Aug 01 21:30:24 auth: Debug: client passdb out: OK 1 user=info(a)xxx.com Aug 01 21:30:24 auth: Debug: master in: REQUEST 1973682177 5459 1 9976303da4c6eb55a008b0cae6ab12a1 session_pid=5462 request_auth_token Aug 01 21:30:24 auth: Debug: master userdb out: USER 1973682177 info(a)xxx.com uid=1001 gid=1001 home=/var/vmail/xxx.com/info auth_token=31afcf6ff0c5ed5150beb96ad3718cff452badae The only thing I changed here was the order the passdb backends. It works fine now, but it not clear to me why the order is so important. Could somebody explain this? Or is this some bug? Thanks Jean-Louis

2 5

Cannot use dovecot with vpopmail and sendmail
by Matthias Fechner 15 Aug '14

15 Aug '14

Hi, I setup a configuration that will use sendmail with dovecot as imap/pop3 service and vpopmail as backend to handle virtual users and store email there. For this I created a dovecot.m4 as described in the wiki, it looks like: ######################*****############## ### DOVECOT Mailer specification ### ##################*****################## Mdovecot, P=/usr/local/libexec/dovecot/dovecot-lda, F=l59DFMPhnu, S=EnvFromSMTP/HdrFromSMTP, R=EnvToSMTP/HdrFromSMTP, M=51200000, U=vpopmail:vchkpw, T=DNS/RFC822/X-Unix, A=/usr/local/libexec/dovecot/dovecot-lda -d $u Then I added to my .mc file: MAILER(dovecot) I added to my mailertable: dovecot.fechner.net dovecot:dovecot I create one entry in the virtusertable to catch a email and forward it to dovecot (all other email have to handled by another imap server till dovecot is running fine): dovecot(a)fechner.net idefix(a)dovecot.fechner.net I created a domain and a user in vpopmail to catch idefix(a)dovecot.fechner.net. If I execute: doveadm auth test idefix(a)dovecot.fechner.net Password: passdb: idefix(a)dovecot.fechner.net auth succeeded extra fields: user=idefix(a)dovecot.fechner.net So I think the first part is fine. But if I try to sent an email to dovecot(a)fechner.net I get the error message: Aug 14 21:48:34 anny dovecot: lda(idefix(a)dovecot.fechner.net): Fatal: setuid(89(vpopmail) from userdb lookup) failed with euid=1002(idefix): Operation not permitted (This binary should probably be called with process user set to 89(vpopmail) instead of 1002(idefix)) Aug 14 21:48:34 anny sendmail[94303]: s7EJXgma087740: to=<dovecot(a)fechner.net>, ctladdr=<idefix(a)anny.lostinspace.de> (1002/0), delay=00:14:52, xdelay=00:00:00, mailer=dovecot, pri=120389, relay=dovecot, dsn=4.0.0, stat=Deferred: dovecot mailer (/usr/local/libexec/dovecot/dovecot-lda) exited with EX_TEMPFAIL It seems to be a problem with dovecot-lda but I have no idea what is wrong. The user is set in the .m4 file and permission/group/user is set in the auth socket correctly. The output of doveconf -n is: # 2.2.13: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.0-STABLE amd64 zfs auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes first_valid_uid = 10 mail_debug = yes mail_location = maildir:/usr/local/vpopmail/domains/%d/%n/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = cache_key=%u%r%l webmail=127.0.0.1 driver = vpopmail } service auth-worker { unix_listener auth-worker { group = vchkpw user = vpopmail } } service auth { unix_listener auth-userdb { group = vchkpw mode = 0666 user = vpopmail } user = vpopmail } service imap-login { inet_listener imap { port = 22143 } inet_listener imaps { port = 22993 } } service pop3-login { inet_listener pop3 { port = 22110 } inet_listener pop3s { port = 22995 } } userdb { args = quota_template=quota_rule=*:backend=%q driver = vpopmail } Thanks for any ideas who this could be fixed. Matthias -- "Programming today is a race between software engineers striving to build bigger and better idiot-proof programs, and the universe trying to produce bigger and better idiots. So far, the universe is winning." -- Rich Cook

1 0

Trying Dovecot Replication with dsync
by Minhas Listas 14 Aug '14

14 Aug '14

Hi, I have a failover cluster for mail server with: Ubuntu12.04 + DRBD (for block replication) + Ext4 filesystem + Dovecot-2.0.19-2 with Mdbox It works fine with ~50k accounts. My cluster design: http://adminlinux.com.br/cluster_design.txt I plan to test Dovecot Replication with dsync to build an active/active cluster with load balancing. Can anyone direct me to some literature? A tutorial for example. I'm installing a cluster (for tests) with Ubuntu 14.04 + Ext4 filesystem (without Drbd) + Dovecot-2.2.9-1ubuntu2.1. My conf is in: http://adminlinux.com.br/replication-doveconf.txt I'm following this doc http://wiki2.dovecot.org/Replication but I'm getting some errors: 1) Aug 14 15:39:34 ceph1 dovecot: imap(account=domaintest.com): Error: open(/var/run/dovecot/replication-notify-fifo) failed: Permission denied What is the correct perms for /var/run/dovecot/replication-notify-fifo ? Currently: # ll /var/run/dovecot/replication-notify-fifo prw------- 1 root root 0 Aug 14 15:57 /var/run/dovecot/replication-notify-fifo| 2) Aug 14 16:02:34 ceph1 dovecot: dsync-server(account=domaintest.com): Error: Couldn't create lock */var/lib/imap/account=domaintest.com <http://domaintest.com>/*.dovecot-sync.lock: No such file or directory Aug 14 16:02:34 ceph1 dovecot: dsync-local(account=domaintest.com): Error: Couldn't create lock */var/lib/imap/account=domaintest.com <http://domaintest.com>/*.dovecot-sync.lock: No such file or directory In my production cluster, it is automatically created by dovecot when the user performs the first login: */var/lib/imap/*<account> for INDEX */var/spool/imap/*<account> for Mdbox Thanks! -- Thiago Henrique

1 0

panic: dsync and imapc
by Alex Ha 14 Aug '14

14 Aug '14

Hi Dovecot list! I try to sync from a remote imap server to my local dovecot server via the dsync tool with imapc. Here is my command: # /usr/local/dovecot/bin/dsync -c /usr/local/dovecot/etc/dovecot/dovecot.conf -D -o imapc_user= test(a)example.com -o imapc_password=pwd backup -R -u test(a)example.com imapc: Here the error message: dsync(test(a)example.com): Panic: file quota-maildir.c: line 827: unreached Please see the attached debug.txt for a full debug messages and stacktrace. System info OS: Ubuntu 14.04 Server 64 Bit Dovecot: 2.2.13 Thanks, Alex

1 0

Quota Help
by user7743 14 Aug '14

14 Aug '14

Hi all, First post here so hopefully I get all the required information correct. I am running a mail server on Debian, its consists of Postfix (2.9.6-2), Dovecot (2.1.7) and MySQL (5.5). Basic stuff is all working find so I decided to try and implement quotas. This is working to an extent but not properly and I am a little lost so looking for some help. In my configuration the default mailbox quota is set to "*:storage=100M". When I create a mailbox with 250M specified in the database, dovecot is applying the default quota rather than that specified in the database. So in the database I have a test user with the following entry password,email,quota_kb [hash], test(a)example.org, 25000 If I turn debugging on for mail and auth I see the following logged when the user logs in (logs pasted at the end in a bid to maintain some readability) If I check the quota with doveadm I get the limit back of 102400 which is the default mailbox size rather than that from the database. doveadm quota get -u test(a)example.org Quota, name, Type, Value, Limit, % User quota, STORAGE, 19139, 102400, 18 User quota, MESSAGE, 567, - I can't quite figure out where I am going wrong in terms of getting the database value to supersede the default value set in 90-quota.conf. I did read one thing in the quota documentation on the dovecot website (http://wiki2.dovecot.org/Quota/Configuration) that I didn't get and this might be where I am going wrong but can't check. It says "Check that dovecot-lda is called with -d parameter." Where would this be configured and where could I check? Below are some other inputs - hopefully they help. ### Debug logs at login Aug 14 14:06:24: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 14 14:06:24: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Aug 14 14:06:24: auth: Debug: auth client connected (pid=8090) Aug 14 14:06:24: auth: Debug: auth client connected (pid=8093) Aug 14 14:06:24: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=2QDLu5UAKAAuBSdf#011lip=99.99.99.99#011rip=55.55.55.55#011lport=993#011rport=50216 Aug 14 14:06:24: auth: Debug: client out: CONT#0111#011 Aug 14 14:06:24: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=ZBnLu5UAKQAuBSdf#011lip=99.99.99.99#011rip=55.55.55.55#011lport=993#011rport=50217 Aug 14 14:06:24: auth: Debug: client out: CONT#0111#011 Aug 14 14:06:24: auth: Debug: client in: CONT<hidden> Aug 14 14:06:24: auth-worker(8095): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 14 14:06:24: auth-worker(8095): Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Aug 14 14:06:24: auth-worker(8095): mysql(127.0.0.1): Connected to database mailserver Aug 14 14:06:24: auth-worker(8095): Debug: sql(test.example.org,55.55.55.55): query: SELECT email as user, password FROM users WHERE email='test.example.org'; Aug 14 14:06:24: auth: Debug: client out: OK#0111#011user=test.example.org Aug 14 14:06:24: auth: Debug: master in: REQUEST#0111720057857#0118090#0111#0114bf45b372441751900d7d967578b0e03 Aug 14 14:06:24: auth-worker(8095): Debug: sql(test.example.org,55.55.55.55): SELECT CONCAT('/var/vmail/',CONCAT(SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1))) AS home, 5000 AS uid, 5000 AS gid, CONCAT('maildir:storage=+',quota_kb) AS quota_rule FROM users WHERE email='test.example.org'; Aug 14 14:06:24: auth: Debug: master out: USER#0111720057857#011test.example.org#011home=/var/vmail/contriveit.com/te… Aug 14 14:06:24: imap-login: Login: user=<test.example.org>, method=PLAIN, rip=55.55.55.55, lip=99.99.99.99, mpid=8097, TLS, session=<2QDLu5UAKAAuBSdf> Aug 14 14:06:24: auth: Debug: client in: CONT<hidden> Aug 14 14:06:24: auth-worker(8095): Debug: sql(test.example.org,55.55.55.55): query: SELECT email as user, password FROM users WHERE email='test.example.org'; Aug 14 14:06:24: auth: Debug: client out: OK#0111#011user=test.example.org Aug 14 14:06:24: imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules Aug 14 14:06:24: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Aug 14 14:06:24: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so Aug 14 14:06:24: imap: Debug: Added userdb setting: plugin/quota_rule=maildir:storage=+250000 Aug 14 14:06:24: imap(test.example.org): Debug: Effective uid=5000, gid=5000, home=/var/vmail/contriveit.com/test Aug 14 14:06:24: imap(test.example.org): Debug: Quota root: name=User quota backend=maildir args= Aug 14 14:06:24: imap(test.example.org): Debug: Quota rule: root=User quota mailbox=maildir bytes=+256000000 messages=0 Aug 14 14:06:24: imap(test.example.org): Debug: Quota rule: root=User quota mailbox=Trash bytes=+10485760 messages=0 Aug 14 14:06:24: imap(test.example.org): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/contriveit.com/test/Maildir Aug 14 14:06:24: auth: Debug: master in: REQUEST#011635830273#0118093#0111#011316aed6aaba731b5f79c78d2664a7c99 Aug 14 14:06:24: imap(test.example.org): Debug: maildir++: root=/var/vmail/contriveit.com/test/Maildir, index=, control=, inbox=/var/vmail/contriveit.com/test/Maildir, alt= Aug 14 14:06:24: auth-worker(8095): Debug: sql(test.example.org,55.55.55.55): SELECT CONCAT('/var/vmail/',CONCAT(SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1))) AS home, 5000 AS uid, 5000 AS gid, CONCAT('maildir:storage=+',quota_kb) AS quota_rule FROM users WHERE email='test.example.org'; Aug 14 14:06:24: auth: Debug: master out: USER#011635830273#011test.example.org#011home=/var/vmail/contriveit.com/tes… Aug 14 14:06:24: imap-login: Login: user=<test.example.org>, method=PLAIN, rip=55.55.55.55, lip=99.99.99.99, mpid=8098, TLS, session=<ZBnLu5UAKQAuBSdf> Aug 14 14:06:24: imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules Aug 14 14:06:24: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Aug 14 14:06:24: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so Aug 14 14:06:24: imap: Debug: Added userdb setting: plugin/quota_rule=maildir:storage=+250000 Aug 14 14:06:24: imap(test.example.org): Debug: Effective uid=5000, gid=5000, home=/var/vmail/contriveit.com/test Aug 14 14:06:24: imap(test.example.org): Debug: Quota root: name=User quota backend=maildir args= Aug 14 14:06:24: imap(test.example.org): Debug: Quota rule: root=User quota mailbox=maildir bytes=+256000000 messages=0 Aug 14 14:06:24: imap(test.example.org): Debug: Quota rule: root=User quota mailbox=Trash bytes=+10485760 messages=0 Aug 14 14:06:24: imap(test.example.org): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/contriveit.com/test/Maildir Aug 14 14:06:24: imap(test.example.org): Debug: maildir++: root=/var/vmail/contriveit.com/test/Maildir, index=, control=, inbox=/var/vmail/contriveit.com/test/Maildir, alt= ### doveconf -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab084.17 x86_64 Debian 7.6 simfs auth_debug = yes auth_mechanisms = plain login dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } mail_debug = yes mail_location = maildir:/var/vmail/%d/%n/Maildir mail_plugins = " quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = create special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = maildir:User quota quota_rule = *:storage=100M quota_rule2 = Trash:storage=+10M sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)example.org protocols = " imap sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/dovecot/cert.pem ssl_key = </etc/dovecot/key.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = " quota sieve quota" } protocol imap { mail_max_userip_connections = 15 mail_plugins = " quota imap_quota" } ### /etc/dovecot/dovecot-dict-sql.conf.ext connect = host=127.0.0.1 dbname=db user=user password=password map { pattern = priv/quota/storage table = virtual_users username_field = email value_field = quota_kb } map { pattern = priv/quota/messages table = quota username_field = username value_field = messages } map { pattern = shared/expire/$user/$mailbox table = expires value_field = expire_stamp fields { username = $user mailbox = $mailbox } } #### /etc/dovecot/dovecot-sql.conf.ext default_pass_scheme = PLAIN-MD5 password_query = SELECT email as user, password FROM users WHERE email='%u'; user_query = SELECT CONCAT('/var/vmail/',CONCAT(SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1))) AS home, 5000 AS uid, 5000 AS gid, CONCAT('maildir:storage=+',quota_kb) AS quota_rule FROM users WHERE email='%u'; Any help appreciated.

2 2

Domain name lost for SASL
by Dominic Wong 13 Aug '14

13 Aug '14

Hi, I'm trying to set up Postfix + Dovecot (2.0.9) + PostfixAdmin on CentoOS (the standard amazon machine image) and am having problems with my SMTP user authentication. Turning on auth debugging I can see the username is losing the first part of the domain so one(a)two.three becomes one.three dovecot: auth: Debug: sql(one.three, ... ): query: SELECT username AS user,password FROM mailbox WHERE username = 'one.three' AND active='1' I don't know if it's postfix or dovecot which is trimming the username, any tips on what causes this would be greatly appreciated. Thanks

1 0

Test / can you see my mail??
by Michael Ludwig 12 Aug '14

12 Aug '14

Hi! I have to excuse my behave and I am really sorry. Yesterday I wrote two mails to this list and they never showed up in the online archives where I checked it. So that's the reason for this testmail. I hope this mail is readable to all of you? Cheers, Michael

6 5

Defer email via LMTP when there is 'no space left on device' instead of rejecting it
by Christian Rohmann 12 Aug '14

12 Aug '14

Hello dovecot-users, (This problem was being discussed a little in this thread from 2011: http://www.dovecot.org/list/dovecot/2011-May/059009.html) I noticed (using LMTP) that Dovecot handles 'no space left on device' just like an 'over-quota', if I read this part of method "static int client_deliver(struct client *client, const struct mail_recipient *rcpt, struct mail *src_mail, struct mail_deliver_session *session)" "lmtp/commands.c" correctly: --- cut --- [...] else if (storage != NULL) { error = mail_storage_get_last_error(storage, &mail_error); if (mail_error == MAIL_ERROR_NOSPACE) { client_send_line(client, "%s <%s> %s", dctx.set->quota_full_tempfail ? "452 4.2.2" : "552 5.2.2", rcpt->address, error); } else { client_send_line(client, "451 4.2.0 <%s> %s", rcpt->address, error); } ret = -1; [...] --- /cut --- In consequence this means the configuration option quota_full_tempfail is applied in both cases. But to me there is a major difference between a full disk (a.k.a "admin fucked up") and over-quota (a.k.a. "user has simply too much stuff in his mailbox"). So I would like to be able tell Dovecot to reject messages due to full mailboxes, but simply defer those that cannot be stored due to a full disk (which I am to blame for). To me this should result in two separate configuration options for the two problem root-causes: quota_full_tempfail storage_full_tempfail Or did I simply miss or completely misunderstood anything here? Regards Christian

10 18

doveadm pw with SHA512-CRYPT won't roundtrip
by Jon Hulatt 12 Aug '14

12 Aug '14

Hi, Not sure if this is a PBKAC or not:- root@ds3:/usr/share/postfixadmin# doveadm pw -s SHA512-CRYPT -p password {SHA512-CRYPT}$6$aUgGXP0UshkMj7hY$9JV4yMRsjIe/98CzmglYrMjf.9NJ.FXzxcLE9B0v3doCRUWo2wRncc6hg6VCs0DCUHQbeC/bRDZdGCge/nB/h/ root@ds3:/usr/share/postfixadmin# doveadm pw -t {SHA512-CRYPT}$6$aUgGXP0UshkMj7hY$9JV4yMRsjIe/98CzmglYrMjf.9NJ.FXzxcLE9B0v3doCRUWo2wRncc6hg6VCs0DCUHQbeC/bRDZdGCge/nB/h/ -p password doveadm(root): Fatal: reverse password verification check failed: Password mismatch root@ds3:/usr/share/postfixadmin# dovecot --version 2.2.9 It works ok with other schemes that i’ve tried (e.g. SSHA-512). Is this a bug, or my mistake? thanks Jon

4 3

Frequent error: unknown namespace Trash
by Michael Ludwig 12 Aug '14

12 Aug '14

Hello to all of you! ;-) My first post on this list. I frequently get this error in dovecot.log every time a user logs in and out: ============================= imap(mailaddress): Error: quota: Unknown namespace: Trash ============================= When I change my conf.d/90-quota.conf from "Trash" to ".Trash" (as this is the imap/maildir folder name, the error stays the same, but with the ".Trash" in dovecot.log This is what my 90-quoato.conf looks like: ============================= plugin { quota_rule = *:storage=2G quota_rule2 = Trash:storage=+100M quota_grace = 10%% } ============================= Where can I start my search, what is going wrong? Just for letting you know: This mailserver is a fresh and clean setup. I am using postfix/dovecotvimbadmin/mysql/spamassassin/clamsmtp. Cheers, Michael

2 1

Sieve: Saving "pristine" messages for backups and spam training
by Jeff Rice 12 Aug '14

12 Aug '14

Hello, I'm trying to work out a way to have my Sieve filter save a "pristine" version of email messages as a backup, primarily to use for training the spam filter. I would like is to have every message saved into a single, site-wide directory (in the global sieve) before being processed additionally and delivered. The messages in that directory will be used to train the spam filter without having to worry about removing Spamassassin headers and so forth. I thought fileinto :copy might do what I wanted, but this creates a backup directory individually for each user. That's unmanageable for the spam training process I use. redirect *could* work, but that adds a header during the process so the email saved would not be "pristine". I'm thinking of using the extprograms plugin to pipe to a program that will do a simple copy. That feels very hackish, however, and I'm hoping there is a more elegant solution. Am I missing something obvious here? Thanks! Jeff

4 4

Re: Throttling pop3-login connections
by Joseph Tam 12 Aug '14

12 Aug '14

Alex <mysqlstudent(a)gmail.com> writes: > Okay, that makes sense, and is in line with what I was also thinking. This > is like 30 concurrent requests, then nothing for a minute or two, then > another 30 concurrent requests. 30 concurrent requests at 1 or 2 minute intervals? This seems weird, as I would expect it to be more or less randomly distributed over that interval. Does this happen at the top of each minute? If what you observe is true, the only situation I can think of that would cause this is a bunch of POP3 fetch clients running as a cron job synchronized to a minute grid (i.e seconds=0). Joseph Tam <jtam.home(a)gmail.com>

1 0

Options mail_nfs_storage and mail_nfs_index not in 2.2(.13) example config anymore?
by Christian Rohmann 11 Aug '14

11 Aug '14

Hey dovecot-users, did I miss anything anywhere about the configuration variables "nfs_storage" and "mail_nfs_index" being removed from the example configuration in 2.2? In 2.1 they where both in 10-mail.conf commented out and set to their default "no". But with 2.2 they are not in any of the exmaple config files anymore. doveadm is still showing the variables and they can be used as ever still. Just wondering if I missed something and this should be configured differently on 2.2 now. Regards Christian

2 1

poolmon improvements
by Timo Sirainen 11 Aug '14

11 Aug '14

I've been planning to improve poolmon failure checking for a long time already, but I still haven't managed to get to it. Maybe somebody else has more time, so here's a feature request for anyone to implement: poolmon currently gives up immediately if the first check to any service fails. It really should be trying multiple times over multiple seconds before giving up. I think ideally it would be: - Individual check timeout could still be the default 5 seconds - Add full check time setting, which could be e.g. 15 seconds. If all checks fail during this time then disable the host. - If request fails because connection gets rejected, retry quickly, e.g. after 0,1 seconds - If check fails because of protocol errors, wait for a long time, e.g. 1 second So this would avoid backend being removed in situations where it really shouldn't be removed: - Dovecot restarts - Dovecot reloads - load spikes and other random issues that cause temporary problems Especially the load spike is an annoying issue which my plan doesn't even fully solve. The solution to fix a heavily overloaded cluster isn't really to start removing all of its backends that are busy working..

1 0

Frequent error: unknown namespace Trash
by Michael Ludwig 11 Aug '14

11 Aug '14

Hello to all of you! ;-) My first post on this list. I frequently get this error in dovecot.log every time a user logs in and out: ============================= imap(mailaddress): Error: quota: Unknown namespace: Trash ============================= When I change my conf.d/90-quota.conf from "Trash" to ".Trash" (as this is the imap/maildir folder name, the error stays the same, but with the ".Trash" in dovecot.log This is what my 90-quoato.conf looks like: ============================= plugin { quota_rule = *:storage=2G quota_rule2 = Trash:storage=+100M quota_grace = 10%% } ============================= Where can I start my search, what is going wrong? Just for letting you know: This mailserver is a fresh and clean setup. I am using postfix/dovecotvimbadmin/mysql/spamassassin/clamsmtp. Cheers, Michael

1 0

postfix-dovecot Auth USER lookup failed
by Timothy Murphy 10 Aug '14

10 Aug '14

I'm running postfix + dovecot on my CentOS-7 home server. When I send myself a message I get this error message in /var/log/maillog: Aug 9 12:59:57 alfred postfix/lmtp[31336]: B0D02220748: to=<tim(a)localhost.gayleard.eu>, orig_to=<tim@localhost>, relay=alfred.gayleard.eu[private/dovecot-lmtp], delay=475, delays=474/0.03/0.02/0.09, dsn=4.3.0, status=deferred (host alfred.gayleard.eu[private/dovecot-lmtp] said: 451 4.3.0 <tim(a)localhost.gayleard.eu> Internal error occurred. Refer to server log for more information. (in reply to RCPT TO command)) and in /var/log/dovecot I read Aug 09 13:13:03 auth-worker(31472): Error: passwd(tim(a)localhost.gayleard.eu): getpwnam() failed: Address family not supported by protocol Aug 09 13:13:03 lmtp(31470): Error: user tim(a)localhost.gayleard.eu: Auth USER lookup failed It seems that USER is set to tim(a)localhost.gayleard.eu rather than tim . I am including the line mailbox_transport = lmtp:unix:private/dovecot-lmtp in /etc/postfix/main.cf . If I omit this line so that postfix sends email directly to ~/Maildir I have no problem - except that spam is not being filtered. I give the output of postconf -n below. Any advice or enlightenment gratefully received. Output of postconf -n ---------------------- [tim@alfred ~]$ cat /tmp/postconf alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases command_directory = /usr/sbin config_directory = /etc/postfix daemon_directory = /usr/libexec/postfix data_directory = /var/lib/postfix debug_peer_level = 2 debugger_command = PATH=/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin ddd $daemon_directory/$process_name $process_id & sleep 5 home_mailbox = Maildir/ html_directory = no inet_interfaces = all inet_protocols = all mail_owner = postfix mailbox_transport = lmtp:unix:private/dovecot-lmtp mailq_path = /usr/bin/mailq.postfix manpage_directory = /usr/share/man mydestination = $myhostname, localhost.$mydomain, localhost, $mydomain mydomain = gayleard.eu myhostname = alfred.gayleard.eu mynetworks = 192.168.0.0/24, 127.0.0.0/8 myorigin = $mydomain newaliases_path = /usr/bin/newaliases.postfix queue_directory = /var/spool/postfix readme_directory = /usr/share/doc/postfix-2.6.6/README_FILES relay_domains = relayhost = out.alice.it sample_directory = /usr/share/doc/postfix-2.6.6/samples sendmail_path = /usr/sbin/sendmail.postfix setgid_group = postdrop smtp_sasl_auth_enable = yes smtp_sasl_password_maps = hash:/etc/postfix/password smtp_sasl_security_options = smtpd_milters = unix:/var/run/spamass-milter/postfix/sock unknown_local_recipient_reject_code = 550 ---------------------- -- Timothy Murphy e-mail: gayleard /at/ eircom.net School of Mathematics, Trinity College, Dublin 2, Ireland

2 2

Dovecot v2.2 FTS is not indexing "text/html" emails...
by Akash 09 Aug '14

09 Aug '14

Hi, I am not sure its intended or a fault in the newest Dovecot versions. I have been using Dovecot v1.2.15 on Debian squeeze and FTS is working as expected. When I search a quoted string "very good", I get 107 results including plain and HTML emails which have this phrase. In order to compare the benefits of lucene over squat, I recently started testing dovecot v2.2.13 on Debian Sid with the same maildir content. But now the same search "very good" yielded just 8 results. I thought it could be some problem with lucene so I tried switching to squat and got 107 results again. After this I deleted the old squat search index files created by v1.2.15 and re-indexed the mail-box by using doveadm index command. Now the same squat search is giving 8 results just as lucene. So I have realized that its not a problem with just lucene but FTS in newer dovecot isn't indexing those emails which have Content-type as text/html. Thus if a mail is like this: Content-Type: text/html <b>He is very good.</b> It isn't shown in search by the squat indexes created using dovecot v2.2.13. I have done further testing on some sample emails which confirmed this behavior. Why is this so? -Regards, Akash

1 0

Converting maildir files from quoted-printable to 8bit
by Andrzej A. Filip 09 Aug '14

09 Aug '14

How to easily convert maildir files from (single part) quoted-printable to 8bit encoding? [I would like to ease access to sent/posted archives.]

1 0

Throttling pop3-login connections
by Alex 09 Aug '14

09 Aug '14

Hi, I have a fedora20 system with dovecot-2.2.13 running various services, including pop3. I'm noticing some users are frequently hamming pop3, and wondered if this was normal, or something I should be investigating? Aug 8 14:05:20 email dovecot: pop3-login: Login: user=<user1>, method=PLAIN, rip=97.77.115.121, lip=192.168.1.1, mpid=30509, session=<DnRtDCIAUQBhTXN5> Aug 8 14:05:21 email dovecot: pop3(user1): Disconnected: Logged out top=0/0, retr=0/0, del=0/15, size=5693601 So it is immediately followed by a logout, but when there are 50 of them successively in a five minute period, I wondered if it is creating unnecessary overhead on the system? I suppose this most likely is how they have their email client configured, but wondered if some throttling would be necessary? Any advice would be most appreciated. Thanks, Alex

4 5

Re: postfix-dovecot via lmtp
by Reindl Harald 08 Aug '14

08 Aug '14

STOP to post HTML and convert even plaintext messages Am 04.08.2014 um 12:50 schrieb Timothy Murphy: > On Monday, August 04, 2014 12:14:44 PM Reindl Harald wrote: > > > >> > I read in /var/log/maillog > >> > > >> > Aug 4 11:29:13 alfred postfix/lmtp[14871]: 9C04C220A99: > >> > to=<tim(a)localhost.gayleard.eu>, orig_to=<tim@localhost>, > >> > relay=alfred.gayleard.eu[private/dovecot-lmtp], delay=971, > >> > delays=971/0.03/0.02/0.1, dsn=4.3.0, status=deferred > >> > (host alfred.gayleard.eu[private/dovecot-lmtp] said: 451 4.3.0 > >> > <tim(a)localhost.gayleard.eu> Internal error occurred. > >> > Refer to server log for more information. (in reply to RCPT TO > >> > command)) > > > >> "Refer to server log for more information" comes from dovecot lmtpd > >> so look there and post the output of "doveconf -n" > > > > Thanks very much for your response. > > > > The only information in /var/log/dovecot > > (where I send dovecot debug and info logs) is > > Aug 04 11:29:13 lmtp(14872): > > Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= > > Aug 04 11:29:13 lmtp(14872): > > Info: Connect from local > > Aug 04 11:29:13 lmtp(14872): > > Debug: auth input: > > Aug 04 11:29:13 lmtp(14872): > > Info: Disconnect from local: Successful quit > > > > The output of "doveconf -n" is > > ------------------------- > > # 2.2.10: /etc/dovecot/dovecot.conf > > # OS: Linux 3.10.0-123.4.4.el7.x86_64 x86_64 CentOS Linux release 7.0.1406 (Core) > > debug_log_path = /var/log/dovecot > > info_log_path = /var/log/dovecot > > listen = * > > log_path = /var/log/dovecot > > login_trusted_networks = 192.168.2.0/24 > > mail_debug = yes > > mail_gid = 1000 > > mail_location = maildir:~/Maildir > > mail_uid = 1000 > > managesieve_notify_capability = mailto > > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress > comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date > ihave > > mbox_write_locks = fcntl > > namespace inbox { > > inbox = yes > > location = > > mailbox Drafts { > > special_use = \Drafts > > } > > mailbox Junk { > > special_use = \Junk > > } > > mailbox Sent { > > special_use = \Sent > > } > > mailbox "Sent Messages" { > > special_use = \Sent > > } > > mailbox Trash { > > special_use = \Trash > > } > > prefix = > > } > > passdb { > > driver = pam > > } > > plugin { > > sieve = ~/.sieve/dovecot.sieve > > sieve_dir = ~/.sieve > > } > > protocols = imap pop3 lmtp sieve > > service imap-login { > > inet_listener imap { > > port = 143 > > } > > inet_listener imaps { > > port = 993 > > ssl = yes > > } > > } > > service lmtp { > > unix_listener /var/spool/postfix/private/dovecot-lmtp { > > group = postfix > > mode = 0777 > > user = postfix > > } > > } > > service managesieve-login { > > inet_listener sieve { > > port = 4190 > > } > > } > > ssl = required > > ssl_cert = </etc/pki/dovecot/certs/dovecot.pem > > ssl_key = </etc/pki/dovecot/private/dovecot.pem > > userdb { > > driver = passwd > > } > > protocol lmtp { > > mail_plugins = " sieve" > > } > > protocol lda { > > mail_plugins = " sieve" > > } > > protocol sieve { > > managesieve_notify_capability = fileinto reject envelope environment mailbox date > > } > > ------------------------- > > > > > > -- > > Timothy Murphy > > e-mail: gayleard /at/ eircom.net > > School of Mathematics, Trinity College, Dublin 2, Ireland

4 3

postfix-dovecot via lmtp
by Timothy Murphy 08 Aug '14

08 Aug '14

I've been trying for some days to get postfix + dovecot + pigeonhole/sieve working on a CentOS-7 home server. I think I may have detected the problem; I read in /var/log/maillog Aug 4 11:29:13 alfred postfix/lmtp[14871]: 9C04C220A99: to=<tim(a)localhost.gayleard.eu>, orig_to=<tim@localhost>, relay=alfred.gayleard.eu[private/dovecot-lmtp], delay=971, delays=971/0.03/0.02/0.1, dsn=4.3.0, status=deferred (host alfred.gayleard.eu[private/dovecot-lmtp] said: 451 4.3.0 <tim(a)localhost.gayleard.eu> Internal error occurred. Refer to server log for more information. (in reply to RCPT TO command)) (I've split one long line here.) 1) I see that the permissions on /var/spool/postfix/private/ are [tim@alfred ~]$ ls -ls /var/spool/postfix/ 4 drwx------. 2 postfix root 4096 Aug 4 11:30 private The socket dovecot-lmtp setup by postfix is in this directory; does dovecot need permission to access this? 2) I see that this mail (a test email from me) was deferred. What exactly does this mean? Where is the mail stored? I couldn't find it anywhere. (It has already been brought to the server by fetchmail.) 3) Am I right in thinking that there are 2 alternatives to dovecot/sieve a) amavisd-new with postfix + spamassassin b) postfix + procmail ? 4) I remember seeing a posting (probably not in this mailing list) describing how one can trace the progress of email through the server. Unfortunately I didn't note the URL, and now cannot find it. Does anyone have a pointer to such a document? As will probably be obvious, I am not at all clear how postfix and dovecot fit together if one introduces lmtp. I take it that without lmtp (or similar) postfix just delivers email to ~/Maildir/cur (in my case), and dovecot is not involved at all until a client (KMail in my case) looks at email? -- Timothy Murphy e-mail: gayleard /at/ eircom.net School of Mathematics, Trinity College, Dublin 2, Ireland

2 2