- dovecot - dovecot.org

mdbox + sis + altstorage: error in attachments-connector (file not found)
by Paolo Cravero 26 Feb '15

26 Feb '15

Hello, first time here. I am playing with Dovecot because of its mdbox storage, SIS feature and altstorage ability. I authenticate against LDAP (passdb), but I don't fetch operational data from LDAP (mail_locations are static from config files and "user_attrs = =uid=500, =gid=500, =home=/maildata1/home/%d/%1n/%n"). On a daily basis I run "doveadm altmove -A savedbefore 5d" Thunderbird apparently works 100%, but only apparently. When accessing one of those mailboxes through Open-Xchange IMAP I got an error for the first time. Then I could reproduce it with Thunderbird as well, I simply had to open the message mentioned in the log: Feb 26 14:06:02 tst-msg03 dovecot: imap(paolo.cravero(a)csi.it): Error: read(attachments-connector(/maildata1/altstorage/csi.it/p/paolo.cravero/storage/m.35)) failed: read(/maildata1/attachments/40/68/40683f07fcbf1f95f09b273e472b3c7067f43210641baf6e3cce333a27b36e11-4a235a29fd05db54fd6800001117ea21[base64:19 b/l]) failed: open(/maildata1/attachments/40/68/40683f07fcbf1f95f09b273e472b3c7067f43210641baf6e3cce333a27b36e11-4a235a29fd05db54fd6800001117ea21) failed: No such file or directory (uid=5940, box=INBOX) Feb 26 14:06:02 tst-msg03 dovecot: imap(paolo.cravero(a)csi.it): Error: read(attachments-connector(/maildata1/altstorage/csi.it/p/paolo.cravero/storage/m.35)) failed: read(/maildata1/attachments/40/68/40683f07fcbf1f95f09b273e472b3c7067f43210641baf6e3cce333a27b36e11-4a235a29fd05db54fd6800001117ea21[base64:19 b/l]) failed: open(/maildata1/attachments/40/68/40683f07fcbf1f95f09b273e472b3c7067f43210641baf6e3cce333a27b36e11-4a235a29fd05db54fd6800001117ea21) failed: No such file or directory (uid=5940, box=INBOX) Feb 26 14:06:02 tst-msg03 dovecot: imap(paolo.cravero(a)csi.it): Disconnected: Internal error occurred. Refer to server log for more information. [2015-02-26 14:06:02] in=182 out=1266 This happens on many messages sitting in the altstorage that had an attachment. The detached attachment file does not exist. Sometimes not even the path is there (anymore?). At some point in time I have run "doveadm purge" on the mailbox in error, but I am not sure that is the culprit. Have I hit a bug or done something wrong? Please suggest tests to verify where I stand. Config dump follows. Paolo # 2.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.5 (Santiago) ext3 auth_mechanisms = plain login disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep lmtp_save_to_detail_mailbox = yes mail_attachment_dir = /maildata1/attachments mail_attachment_hash = %{sha256} mail_debug = yes mail_gid = 500 mail_location = mdbox:/maildata1/main/%d/%1n/%n:ALT=/maildata1/altstorage/%d/%1n/%n:INDEX=/maildata1/indexes/%d/%1n/%n mail_plugins = quota mail_log notify lazy_expunge mail_uid = 500 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate mbox_write_locks = fcntl mdbox_rotate_size = 50 M namespace { hidden = no list = yes location = mdbox:/maildata1/main/%d/%1n/%n:INDEX=/maildata1/indexes/%d/%1n/%n:MAILBOXDIR=expunged prefix = .EXPUNGED/ subscriptions = no } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { lazy_expunge = .EXPUNGED/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid size flags vsize quota = dict:User quota::file:%h/dovecot-quota quota_grace = 10%% quota_rule = *:storage=10G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = vmail user = vmail } } service lmtp { inet_listener lmtp { address = 10.102.42.114 port = 24 } process_min_avail = 2 user = vmail } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = quota mail_log notify lazy_expunge sieve } protocol lda { mail_plugins = quota mail_log notify lazy_expunge sieve } protocol imap { mail_plugins = quota mail_log notify lazy_expunge imap_quota }

1 0

dsync backup touch source index files.
by Anton Chevychalov 26 Feb '15

26 Feb '15

Hi everyone, Can someone explain me why dsync need read-write access to source box when pulling data (dsync -R backup)? I am working on migration from Dovecot 1.x with maildir to latest Dovecot 2.2.15 with mdbox and found that there is no way to do this from ro filesystem (got "failed: Read-only file system" on access to /dovecot.index.log). I am wondering is it bug or feature? I am not sure that this is save to allow dsync v2.2.15 to have write access to v1.x indexes. -- Anton Chevychalov

3 2

btrfs for mail_attachment_dir
by Hardy Flor 26 Feb '15

26 Feb '15

Hello, I don't find any indication, that no btrfs for then filesystem for the path in "mail_attachment_dir" is to be used. but btrfs has a big problem with hard links in the same directory. Nuisance is the only deal with a different file system? Hardy

3 3

Mail migration / dsync
by Giedrius Tuminauskas 25 Feb '15

25 Feb '15

Hello, I am trying to migrate emails from: Mountain Lion OSX 10.8.5 (dovecot: 2.0.19apple1) to: RHEL 7.0 (dovecot: 2.2.10) Using command: dsync -m /Library/Server/Mail/Data/mail/XYZWXYZW-XYZW-XYZW-XYW-XYZXYZXYZXYZ/ -u giedriust mirror giedriust(a)192.168.xx.xx root(a)192.168.xx.xx's password: dsync-remote(giedriust(a)domainname.com): Error: dsync(local): Remote dsync doesn't use compatible protocol dsync-remote(giedriust(a)domainname.com): Error: dsync(local): Remote dsync doesn't use compatible protocol dsync-local(giedriust): Error: Invalid server handshake: VERSION dsync 3 2 Is there a way to synchronise all the emails and convert them from simple Maildir to Maildir (layout=fs) format? -- * Giedrius Tuminauskas*

2 1

"Temporary authentication failure" ? Cant connect with ldap user
by David Scheele 25 Feb '15

25 Feb '15

Hello there, first time writing. I'm relatively new to linux and have been tasked with setting up the following configuration: Debian Wheezy Server Postfix Dovecot OpenLDAP So, I set up the Server, installed and configured postfix, ldap and dovecot (in that order) and now simply try to log into the mail account with a used from the LDAP over telnet. The test looks like this: *|> telnet localhost 143* *| a bunch of stuff ending with:* *| OK [**] Dovecot ready.* *|> a login username userpassword* *| a NO [UNAVAILABLE] Temporary authentication failure. [host and date here]* In the logs it says *|[date] mailserver dovecot: auth: Error: LDAP: binding failed (dn cn=admin): Invalid credentials* But I KNOW the admin password I entered into the dovecot-lda.conf.ext is correct as I use it to log into the LDAP directory over jxplorer I also know the password for the user i try to log in with is correct as i set it myself over and over just to be sure there are no typos. I'm at a loss, I've been at this end for a few days now and can't find good tutorials online because its either always an old dovecot, postfix, ldap or debian version and somewhere in the middle it just stops because some file is completely missing. I get the impression I'm just not able-brained for linux useage. Anyway, here are a few more informations about the system: *Dovecot version 2.1.7* Output of grep -v '^ *$#.*$\?$' dovecot-sql.conf: *hosts = localhost* *dn = cn=admin* *dnpass = [password]* *sasl_bind = no* *tls = no* *auth_bind = yes* *ldap_version = 3* *base = dc=[domainname],dc=de* *user_attrs = uidNumber=uid,gidNumber=gid* *user_filter = (&(objectClass=posixAccount)(uid=%u))* *pass_attrs = uid=user,userPassword=password* Output of dovecot -n: *disable_plaintest_auth = no* *mail_location = mbox:~/mail:INBOX=/var/mail/%u* *[namespace config here]* *passdb {* *args = /etc/dovecot/dovecot-ldap.conf.ext* *driver = ldap* *}* *plugin {* *sieve = ~/.dovecot.sieve* *sieve_dir = ~/sieve* *}* *protocols = " imap pop3"* *ssl_cert = </etc/dovecot/dovecot.pem* *ssl_key = </etc/dovecot/private/dovecot.pem* *userdb {* *args = /etc/dovecot/dovecot-ldap.conf.ext* *driver =ldap* *}* *protocol pop3 {* *pop3_client_workarounds = outlook-no-nuls oe-ns-eoh* *pop3_uidl_format = %08Xu%08Xv* *}* Any help would be greatly apprechiated.... I'm going crazy over here. Thanks in advance, David

4 16

Metadata suport for public mailboxes
by Sergio Talens-Oliag 25 Feb '15

25 Feb '15

I'm using the latest version of dovecot (2.2.15) and I was trying to use a public namespace with metadata; I've found that it works for the users with enough permissions to set the metadata, but the values are set per user, that is, each user has its own metadata and does not see the values set by others. That sounds OK, as my mail_attribute_dict is configured as follows: mail_attribute_dict = file:/srv/vmail/%d/spool/%n/dovecot-metadata But for public mailboxes it would make sense to set the metadata in a user independent mode. Searching around I've found the following on the dovecot changelog: 2013-11-02 Timo Sirainen <tss(a)iki.fi> [...] TODO: - Metadata doesn't work for public namespaces. There should probably be a mail_attribute_public_dict setting for that. [...] So my guess that the mail_attribute_public_dict is not available. Is that the case or has it been implemented in a different way? Thanks in advance, Sergio -- Sergio Talens-Oliag <sto(a)iti.es> <http://www.iti.es/> Key fingerprint = FF77 A16B 9D09 FC7B 6656 CFAD 261D E19A 578A 36F2

1 0

Updating Dovecot
by Luca Bertoncello 25 Feb '15

25 Feb '15

Hi all! Currently I use Dovecot 1.2.9 from Ubuntu repositories. I'll try to upgrade Dovecot (to 2.2.15), compiling from sources. It seems not too difficult... :) Well, I see, that I have to recreate the configuration, since the old one can not be used with Dovecot2, OK, not a problem. Now: is there something special to be done to upgrade Dovecot or can I just stop the old version and start the new one and all runs without problem? Thanks a lot! Luca Bertoncello (lucabert(a)lucabert.de)

2 1

Re: Dovecot fsync question
by Christian Binder Stadt Freilassing 25 Feb '15

25 Feb '15

Hi list, is there a reason why nobody answers an my topics? Greetings Christian

1 0

Conditional SASL authentication
by Luciano Mannucci 25 Feb '15

25 Feb '15

Hello, I have a few users that are often hit by a trojan virus that steals e-mail user and password. Having a very little (if not null) power on their machines, I need to be able to block the outgoing mail wich is handled by postfix via dovecot SASL. Blocking it at dovecot level would be optimal, for the virus doesn't necessarily use the e-mail of the user as its from, just the user and password for the authentication phase. Is it feasible? AdvThanksAnce, Luciano. -- /"\ /Via A. Salaino, 7 - 20144 Milano (Italy) \ / ASCII RIBBON CAMPAIGN / PHONE : +39 2 485781 FAX: +39 2 48578250 X AGAINST HTML MAIL / E-MAIL: posthamster(a)sublink.sublink.ORG / \ AND POSTINGS / WWW: http://www.lesassaie.IT/

6 15

FTS Solr = No search results for Body Search - (serious issue, please help)
by Kevin Laurie 24 Feb '15

24 Feb '15

Hi, I have been trying to get FTS to work with dovecot. When I search from my client (roundcube webmail) I am able to get results for From, To and Subject fields expect Body on my Apache Solr engine. Could this be a schema related problem? This is output for the Subject: 8025 [main] INFO org.eclipse.jetty.server.AbstractConnector ? Started SocketConnector@0.0.0.0:8983 9001 [searcherExecutor-6-thread-1] INFO org.apache.solr.core.SolrCore ? [collection1] Registered new searcher Searcher@7dfcb28[collection1] main{StandardDirectoryReader(segments_4g:789:nrt _6z(4.10.2):C16672 _44(4.10.2):C6996 _56(4.10.2):C3672 _64(4.10.2):C4000 _8y(4.10.2):C3143 _7v(4.10.2):C673 _7b(4.10.2):C830 _85(4.10.2):C3754 _7k(4.10.2):C3975 _8f(4.10.2):C1516 _7n(4.10.2):C67 _9a(4.10.2):C677 _8o(4.10.2):C38 _8v(4.10.2):C40 _9l(4.10.2):C2705 _8x(4.10.2):C43 _90(4.10.2):C16 _9b(4.10.2):C22 _9d(4.10.2):C44 _9f(4.10.2):C84 _9h(4.10.2):C83 _9i(4.10.2):C356 _9j(4.10.2):C84 _9k(4.10.2):C296 _9m(4.10.2):C83 _9n(4.10.2):C57)} 155092 [qtp433527567-13] INFO org.apache.solr.core.SolrCore ? [collection1] webapp=/solr path=/select params={sort=uid+asc&fl=uid,score&q=subject:"price"&fq=%2Bbox:ac553604f7314b54e62300003555fc1a+%2Buser:"user(a)domain.net"&rows=107178} hits=1237 status=0 QTime=1918 This is output for the From / To: 3374412 [qtp1728413448-16] INFO org.apache.solr.core.SolrCore ? [collection1] webapp=/solr path=/select params={sort=uid+asc&fl=uid,score&q=subject:"dave"+OR+from:"dave"+OR+to:"dave"&fq=%2Bbox:ac553604f7314b54e62300003555fc1a+%2Buser:"bob(a)email.net"&rows=107161} hits=571 status=0 QTime=706 3379438 [qtp1728413448-18] INFO org.apache.solr.servlet. SolrDispatchFilter ? [admin] webapp=null path=/admin/info/logging params={_=1424714397078&since=1424711021771&wt=json} status=0 QTime=0 When I search the body text, the client searches for a little time before it stops and I have no results .

1 0