May 2014 - dovecot - dovecot.org

[Dovecot] attachment sis + EMLINK (too many links) = segfault bug (2.2.12)
by Pavel Stano 05 Jun '14

05 Jun '14

Hi, we use attachment dedup with lots of emails (still migrating to it from maildir). We use netapp storage with wafl filesystem over nfs. Problem is that netapp has hard limit of 100k hardlinks to one file. And we encountered it. Problem is that dovecot start do segfault (lmtp,dsync,pop3 etc) when it happend when tried to deliver new emails with that attachment. Here is strace of dsync: 6740 link("/nfsmnt/mailatch1/f9/10/hashes/f9108ddaa156ac15738e41ed3bedec1eda50175d", "/nfsmnt/mailatch1/f9/10/f9108ddaa156ac15738e41ed3bedec1eda50175d-7bb7a20ddb598853541a000028db4a9f") = -1 EMLINK (Too many links) 6740 --- SIGSEGV (Segmentation fault) @ 0 (0) --- ls -lh: -rw------- 100000 vmail vmail 4.7K Apr 28 16:54 /nfsmnt/mailatch1/f9/10/hashes/f9108ddaa156ac15738e41ed3bedec1eda50175d We were using mail_attachment_min_size=4kb, we solve it by increasing it to 8kb. It would be nice to somehow fix this problem. Like not crash when EMLINK happend and maybe do not deduplicate attachments but deliver email without dedup. Or create second file in hashes/ and start hardlinking it instead of original. AFAIK ext4 has also hard-link limit 64k (http://en.wikipedia.org/wiki/Hard_link#Limitations_of_hard_links) So this can happen to anyone with lots of emails. Thanks -- [ Ohodnotte kvalitu mailu: http://nicereply.com/websupport/Stano/ ] Pavel Stano | Troubleshooter http://WebSupport.sk *** BERTE A VYCHUTNAVAJTE ***

1 1

[Dovecot] Plugin mail-filter tangles
by Stanislas SABATIER 05 Jun '14

05 Jun '14

System installed : Dovecot 2.2.12 as IMAP server and Postfix as MTA. Dovecot and Postfix connected via LMTP + Dovecot mail plugin 'mail-filter' to encrypt/decrypt emails on the fly with public/private users' RSA keys. Case study : You have 3 (virtuals) users belonging to 3 different domains, all managed by your Dovecot server. One of these users is connected to Dovecot with MUA Thunderbird, and he's writing an email to someone outside of yours domains, but he puts the two others users' email addresses in CC : mail from user1(a)domain1.dovecot --> to: someone@outside, CC: user2(a)domain2.dovecot, user3(a)domaine3.dovecot What happens (as far as I can understand) : The email is submitted to Postfix : one copy is delivered outside, the other is passed to Dovecot via LMTP for user2 & user3 @dovecot Dovecot is handling the final delivery, through mail-filter plugin as follow : 1. both users contexts are created from user_db queries 2. mail-filter plugin is init for user2 3. /mail_user_created/ for user2 4. mai-filter plugin arguments are parsed for user2 5. â¦/mail_allocated/ then /mail_save_begin/ for user2 (at this stage, the email is encrypted with users2 params) 6. Dovecot tells to LMTP that mail for user2 is delivered 7. then, â we are still in user2 context â, an other /mail_allocated/ is run, followed by a /istream_opened/ 8. mail user context is swithed to user3 --> /mail_user_created/ --> plugin's args parsed --> â¦ /mail_allocated/ 9. andâ¦ Dovecot tells to LMTP that mail for user3 is delivered So, it appears that Dovecot is re-using user2's email to pass it to user3 by opening an istream in user2's context. In my configuration, Dovecot can't do that because it has not the user2's private rsa key to reopen the email it has just encrypted, so it passes the email to user3 with user2 encryption params. Final result : user3 is receiving the email encrypted with user2's rsa key ! Problem : how to force Dovecot to deinit then reinit mail-filter plugin for each user to be sure that each email is encrypted with the right key before it is saved to users' mailboxes ? Thank you in advance for your help. Stan.

5 16

[Dovecot] SQL passdb, LDAP userdb
by Kristof Bajnok 05 Jun '14

05 Jun '14

Hi, in my current setup, LDAP authentication + userdb works fine. I'd like to integrate Dovecot with Shibboleth. I have a custom module at the IdP (*) that inserts short-time tokens to an SQL table at user authentication, and I want Dovecot to use the token table for passdb but keep LDAP for storing the userdb (uid, quota, etc) I thought it was simple as omitting the sql user_query, but I got: Warning: mysql: Query failed, retrying: Table 'webmail.users' doesn't exist Error: sql(user@domain,ipaddr): User query failed: Table 'webmail.users' doesn't exist (using built-in default user_query: SELECT home, uid, gid FROM users WHERE username = '%n' AND domain = '%d') Do you have any hints how to do this? Thanks, Kristof (*): in SAML there is an Identity Provider that does user authentication, which is separated from the services

2 2

[Dovecot] [dovecot]Quota per user from openldap
by Selcuk Yazar 05 Jun '14

05 Jun '14

Hi, in dovecot documentation i try to implement quota per users. i added dovecot-ldap.conf file user_attrs = homeDirectory=home, uidNumber=uid, gidNumber=gid, mailbox=mail, quota=quota_rule=*:bytes=%$ and i see in logs quota(quota_rule=*:bytes=%$)=*:bytes=241800 Debug: Added userdb setting: plugin/quota_rule=*:bytes=241800 but still mail is delivering , i'not sure other settings about 20-imap.conf and 20-pop3.conf from documentation. what is the correct steps for this? thanks in advance -- Selçuk YAZAR

3 2

[Dovecot] dovecot: lda(foo): Error: User foo doesn't have home dir set, disabling duplicate database
by Christian Hoffmann 02 Jun '14

02 Jun '14

Hello everyone, I have a small problem with dovecot installed on ubuntu-13.10. I use dovcot as LDA with a LDAP-passdb and a pam-passdb. The userdb is static. A mail to LDAP-user 'foo' is delivered with the error-message dovecot: lda(foo): Error: User foo doesn't have home dir set, disabling duplicate database A mail to the pam-user 'bar' will deliverd without this error. But both users should work with the static-userdb. Where is my mistake? Greetings Christian dovecot --version 2.1.7 ############################################ my dovecot.conf # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.11.0-22-generic i686 Ubuntu 13.10 ext4 disable_plaintext_auth = no first_valid_uid = 107 last_valid_uid = 109 listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " mail_home = /var/mail/%u mail_location = maildir:/var/mail/%u/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { driver = pam } plugin { sieve = /var/mail/%u/dovecot.sieve sieve_before = /etc/dovecot/sieve.global/spamfilter.sieve } protocols = imap pop3 sieve service auth { user = root } service managesieve-login { inet_listener sieve { port = 2000 } } ssl_cert = </etc/exim4/exim.crt ssl_key = </etc/exim4/exim.key syslog_facility = local0 userdb { args = home=/var/mail/%u uid=Debian-exim gid=Debian-exim driver = static } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master hostname = ods2.schule.de mail_plugins = sieve postmaster_address = postmaster sendmail_path = /usr/sbin/sendmail } ############################## my dovecot-ldap.conf uris = ldaps://my.ldap.host.edu dn = chief dnpass = secret auth_bind = yes ldap_version = 3 base = ou=Personen,DC=my,DC=ldap,DC=host,DC=eu scope = subtree pass_filter = (&(objectClass=user)(cn=%u)(memberOf:1.2.840.113556.1.4.1941:=cn=Mail,ou=Gruppen,DC=my,DC=ldap,DC=host,DC=eu))

2 6

[Dovecot] Disabling plus sign extension delimiter in lmtp listener (or userdb)
by Benoit Panizzon 01 Jun '14

01 Jun '14

Hello We have migrated our email services from a server, which did not support IMAP and folders, therefore threated the plus sign + as a normal character in a part of an email address. Our new server delivers the emails via lmtp to dovecot. the few users which got a + character in the username first could not log-in (fixed by adding + to auth_username_chars). Now the next problem turn out to be, that the lmtp listener stripps everything after the + sign. The MTA correctly sends the whole email address, so it's not the MTA's fault. It can easily be tested by connecting to the dovecot LMTP listener IP address by telnet: 220 grautvornix.imp.ch Dovecot ready. mail from:<nobody> 250 2.1.0 OK rcpt to:<b+enoit(a)iscan.ch> 550 5.1.1 <b+enoit(a)iscan.ch> User doesn't exist: b(a)iscan.ch I could not find any configuration parameters for the lmtp listener or userdb service to tell it what to do with the + sign. Did I miss something, or is it impossible to have the + sign accepted as a normal character in an email address? Kind regards -Benoit-

3 6

[Dovecot] Upgraded my dovecot?
by Knute Johnson 31 May '14

31 May '14

I upgraded my server from Ubuntu 12.04LTS to 14.04LTS and it upgrade my dovecot too. Probably should have thought about that a little more before I pushed the button but oh well. So it didn't work when it came back up and I had to add a "inbox=yes" line to my namespace in 15-mailboxes.conf and that fixed it. So is there anything else I should update in my config files for this newer version of dovecot? # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-30-generic x86_64 Ubuntu 14.04 LTS auth_mechanisms = plain login mail_location = mbox:~/mail:INBOX=/var/mail/%u namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = " imap" service imap-login { inet_listener imaps { port = 0 } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } protocol imap { imap_capability = IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS mail_max_userip_connections = 30 } Thanks,

1 0

[Dovecot] ot: identifying TB IMAP issues
by voytek＠sbt.net.au 31 May '14

31 May '14

I have a user with with W7/TBird/IMAP to my dovecot 2.1.17 server, the user complains whilst he is composing lengthy emails (with multiple fowrds/replies quoted in the message) he gets 'hour glass' over compose windows with some message about not being able to save drafts, he then powers off ADSL modem, which enables him to continue composing email, powers on ADSL, and sends email what if anything can I assess at server end to identify any issues? any TB tips, what to enable or disable on TB ? looking at dovecot now (past the issue) with 'doveadm who' I don't see the user listed I think the user keeps many messages open concurrently in TB tabs, could that exhaust connection limit ? I expect this to be a TB issue? but, hope for some pointers

3 2

[Dovecot] Panic: file mail-index-transaction-export.c: line 203 (log_append_ext_hdr_update): assertion failed: (u32.offset + u32.size <= ext_hdr_size)
by Andy Dills 30 May '14

30 May '14

Hi there, We recently upgraded to 2.2.12 (the current version in FreeBSD's port tree), and are seeing these errors in our logs (not super frequently, but it happens): May 30 13:20:57 mail1 kernel: pid 15752 (imap), uid 1005: exited on signal 6 May 30 13:20:57 mail1 dovecot: imap(xxx): Fatal: master: service(imap): child 15752 killed with signal 6 (core not dumped - set service imap { drop_priv_before_exec=yes }) I tried manually upgrading to 2.2.13, on the off chance that was fixed, but I couldn't get the new pigeonhole (0.4.3) to compile once I did (perhaps why the FreeBSD port maintainer hasn't updated yet?). Suggestions? Right now we just check every couple of hours for affected users, and then delete all of the dovecot files for the affected user, which ends the error. Thanks, Andy --- Andy Dills Xecunet, Inc. www.xecu.net 301-682-9972 ---

2 3

[Dovecot] doveadm fts optimize CRASH
by Larry Rosenman 30 May '14

30 May '14

thebighonker.lerctr.org /home/ler $ gdb -c doveadm.core `which doveadm` GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"...(no debugging symbols found)... Core was generated by `doveadm'. Program terminated with signal 6, Aborted. Reading symbols from /lib/libz.so.6...(no debugging symbols found)...done. Loaded symbols for /lib/libz.so.6 Reading symbols from /lib/libcrypt.so.5...(no debugging symbols found)...done. Loaded symbols for /lib/libcrypt.so.5 Reading symbols from /usr/local/lib/dovecot/libdovecot-storage.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /usr/local/lib/dovecot/libdovecot.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot.so.0 Reading symbols from /lib/libc.so.7...(no debugging symbols found)...done. Loaded symbols for /lib/libc.so.7 Reading symbols from /usr/local/lib/dovecot/lib20_fts_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/lib20_fts_plugin.so Reading symbols from /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so Reading symbols from /usr/local/lib/libclucene-core.so.1...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/libclucene-core.so.1 Reading symbols from /usr/local/lib/libclucene-shared.so.1...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/libclucene-shared.so.1 Reading symbols from /usr/lib/libc++.so.1...(no debugging symbols found)...done. Loaded symbols for /usr/lib/libc++.so.1 Reading symbols from /lib/libcxxrt.so.1...(no debugging symbols found)...done. Loaded symbols for /lib/libcxxrt.so.1 Reading symbols from /lib/libm.so.5...(no debugging symbols found)...done. Loaded symbols for /lib/libm.so.5 Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols found)...done. Loaded symbols for /lib/libgcc_s.so.1 Reading symbols from /lib/libthr.so.3...(no debugging symbols found)...done. Loaded symbols for /lib/libthr.so.3 Reading symbols from /usr/local/lib/dovecot/lib90_stats_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/lib90_stats_plugin.so Reading symbols from /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Reading symbols from /usr/local/lib/dovecot-2.2-pigeonhole/libdovecot-sieve.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot-2.2-pigeonhole/libdovecot-sieve.so.0 Reading symbols from /usr/local/lib/dovecot/libdovecot-lda.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot-lda.so.0 Reading symbols from /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so Reading symbols from /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so Reading symbols from /libexec/ld-elf.so.1...(no debugging symbols found)...done. Loaded symbols for /libexec/ld-elf.so.1 #0 0x00000008013cc0da in kill () from /lib/libc.so.7 [New Thread 801c2b800 (LWP 101632/doveadm)] (gdb) bt #0 0x00000008013cc0da in kill () from /lib/libc.so.7 #1 0x00000008013ca809 in abort () from /lib/libc.so.7 #2 0x0000000802cf7b39 in __cxa_pure_virtual () from /lib/libcxxrt.so.1 #3 0x00000008025159dc in lucene::store::BufferedIndexOutput::~BufferedIndexOutput () from /usr/local/lib/libclucene-core.so.1 #4 0x000000080251717a in lucene::store::FSDirectory::FSIndexOutput::FSIndexOutput () from /usr/local/lib/libclucene-core.so.1 #5 0x0000000802518983 in lucene::store::FSDirectory::createOutput () from /usr/local/lib/libclucene-core.so.1 #6 0x0000000802544c9d in lucene::index::CompoundFileWriter::close () from /usr/local/lib/libclucene-core.so.1 #7 0x0000000802558b32 in lucene::index::SegmentMerger::createCompoundFile () from /usr/local/lib/libclucene-core.so.1 #8 0x0000000802566b2d in lucene::index::IndexWriter::mergeMiddle () from /usr/local/lib/libclucene-core.so.1 #9 0x00000008025620f8 in lucene::index::IndexWriter::merge () from /usr/local/lib/libclucene-core.so.1 #10 0x0000000802527738 in lucene::index::SerialMergeScheduler::merge () from /usr/local/lib/libclucene-core.so.1 #11 0x000000080255ff45 in lucene::index::IndexWriter::optimize () from /usr/local/lib/libclucene-core.so.1 #12 0x000000080221bfd9 in lucene_index_optimize () from /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so ---Type <return> to continue, or q <return> to quit--- #13 0x000000080400a2b0 in doveadm_fts_plugin_deinit () from /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so #14 0x0000000000413617 in doveadm_mail_single_user () #15 0x0000000000413c60 in doveadm_mail_try_run () #16 0x000000000041c897 in main () (gdb) -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 108 Turvey Cove, Hutto, TX 78634-5688

1 0