- dovecot - dovecot.org

Full text search indexes not used for header/body OR queries?
by Robert L Mathews 09 May '15

09 May '15

I've noticed that when using Lucene full text search, most queries use the indexes and/or header cache and are fast: . SEARCH BODY test . OK Search completed (0.001 secs). . SEARCH SUBJECT test . OK Search completed (0.053 secs). . SEARCH BODY test SUBJECT test . OK Search completed (0.002 secs). . SEARCH OR SUBJECT test FROM test . OK Search completed (0.093 secs). But an OR query that mixes headers and body does not use the available FTS indexes for the BODY part and is slow: . SEARCH OR BODY test SUBJECT test * OK Searched 62% of the mailbox, ETA 0:05 * OK Searched 70% of the mailbox, ETA 0:04 . OK Search completed (15.147 secs). Is this the expected behavior? Since the FTS code can handle an AND of header and body searches, I'm surprised it doesn't do the same for an OR. I noticed this while tracking down poor performance in Thunderbird, which issues searches like this: UID SEARCH RETURN (ALL) (OR FROM "Evelyn" (OR SUBJECT "Evelyn" (OR TO "Evelyn" (OR CC "Evelyn" BODY "Evelyn")))) NOT DELETED These are slow even with FTS enabled because of this behavior. I'm using Dovecot 2.1.7 from Debian wheezy. (I know this is outdated; however, I've examined the 2.1.x and 2.2.x changelogs and found no mention of it.) -- Robert L Mathews, Tiger Technologies, http://www.tigertech.net/

1 1

PublicFolders using Maildir and INDEXPVT in Dovecot v2.2.13
by Panayiotis Fafakos 08 May '15

08 May '15

Dear all, we have succesfully configured Dovecot v2.2.13 in debian wheezy 7.8 (using backports) using Maildir structure, to use private index files for the \Seen flag on a per user basis. All users access their emails and Public Folders using IMAP protocol. The problem is that when a user moves an email from publicFolderA to publicFolderB under the same namespace the other users see this message as unread, although they have actually read it when it was in publicFolderA. Please note that this is an old message which has been moved , it was not copied, so the actual UID should be the same... Is there a way to keep the \Seen flag for the messages that are moved from folder to folder? Is there a way to keep the \Seen flag in a database, so that we can ignore the folder structure and only check the message UIDs? We could use MySQL, PgSQL or even SQLite... Below follows the Public-Folder namespace declaration: ------------------------------------------ namespace { inbox = no location = maildir:/var/vmail/Public-Folders:LAYOUT=fs:INDEXPVT=~/Maildir/public/%u prefix = Public-Folders/ separator = / subscriptions = no type = public } ------------------------------------------ With the above system configuration we have the complete folder structure under ~/Maildir/public/%u, and many log files, one for each folder a user has accessed. Could we only have one index file for each user for all the public folder structure under the same namespace? Kind regards to all, Panayiotis Fafakos

2 3

Different mdbox_rotate_size for primary and alternate storage
by Paolo Cravero 08 May '15

08 May '15

Hello. In order to speed up backups of very very old messages I would like to set two different limits for mdbox_rotate_size. Like, 50M for primary storage and 100M or larger for alternate storage. There is no mention in docs or such a possibility, so I assume it is not possible. Is that correct? While I am at it, is it possible to configure primary storage as maildir (sturdy indexes) and altstorage as mdbox (more delicate indexes)? Thanks, Paolo

1 0

Prebuilt Binaries xi.rename-it.nl down ?
by Nathan Schultheiss 07 May '15

07 May '15

Hello, Since several days the repo (xi.rename-it.nl (217.119.238.14)) is no longer accessible. I'd found here for Debian/Ubuntu => http://wiki2.dovecot.org/PrebuiltBinaries Is it off, or temporarily down ? Could not connect to xi.rename-it.nl:80 (217.119.238.14). - connect (110: Connection timed out) Bests Regards, Nathan

2 1

Dovecot and data migration
by Alain BERNARD 07 May '15

07 May '15

Hi, Our legacy data store retains a single copy of a message regardless of the number of mailboxes in which that message resides. It does this by creating hard links to that message in the mailboxes containing that message. Thus, when we perform data migration to the server target (Dovecot), the copies of the same message are copied over with the migration process (imapsync). We use the storage format maildir. With a small message store, this means that a lot of messages are duplicated unnecessarily. How to reduce message store size due to duplicate storage of identical messages ? Does a relinking function exist and can be run in real-time mode ? how can we configure Dovecot to deduplicate for all users using a hash to determine whether the file could be already exist ? Thanks in advance. Memo

2 2

Mapping other Inbox method (symlink vs ACL)
by Kevin Laurie 07 May '15

07 May '15

Hi, I am trying to map a account(bob(a)mydomain.com) to help(a)mydomain.com. I would like him to see/access Inbox,Sent,Junk,Trash of help(a)mydomain.com . What would you reckon would be the best way to do this? ACL or Symlink? With symlink, I dont think I will be able to set permissions. Is it possible to use ACL to get the entire email account access(the inbox, junk, sent etc.)?

2 6

lmpt director and ldap userdb
by Angel L. Mateo 06 May '15

06 May '15

Hello, I've been using dovecot for a long time, but now I'm having troubles with I change I need to make. I have a director server in front of two backend servers. All of these servers are running dovecot 2.1.16. Redirection to backend servers are based in an attribute of a ldap server. My users are defined in this same ldap server. At this moment, for user authentication we use password lookups. My current configuration at both frontend and backend servers is attached. But now I need to change it to bind authentication, so the only change I've made is changing "auth_bind=no" to "auth_bind=yes". After this change, backend servers are working fine. Director servers are also working for POP and IMAP connections, but for LMTP they are returning: May 6 10:23:35 myotis40 dovecot: lmtp(48026): Error: user myuser(a)um.es: Auth PASS lookup failed This error is returned without any ldap lookup, neither connection to backend servers. Any help? thanks in advance. -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337

1 1

only mark as deleted when deleted as default for some mailboxes
by zucca＠systemschmiede.com 06 May '15

06 May '15

Hi list, i wonder if this is possible with some dovecot configuration. Selected mailboxusers will only mark their mails as deleted, when a mail is being deleted through any client. No automatic expunge. This is default behaviour in Outlook, and i think in Thunderbird too, but unfortunately not in Open-Xchange for example. So i was asking myself if it would be possible to simply turn this feature on maybe globally and as a default for some users. Thank you very much for your reply. Sascha -- Systemschmiede IT-Lösungen Zucca & Teves GbR August-Thyssen-Straße 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: +49 (0)2451 - 9088390 Fax: +49 (0)2451 - 9124070 Mobil: +49 (0)178 - 4073254 Ust.ID: DE248030393

2 2

dovecot-proxy with managesieve, director and backend dovecot imap
by George Vieira 06 May '15

06 May '15

hi all, I've been tasked to add sieve/managesieve to an existing dovecot cluster running 2.1.7 on debian wheezy which is made up of 2 dovecot-proxy hosts as directors and some back end dovecot imap hosts all running the same version. My problem is that I thought to put the service on the director/proxy hosts since they wouldn't have too much load on it, but when I do I get the following error: Apr 28 11:00:28 master: Info: Dovecot v2.1.7 starting up (core dumps disabled) Apr 28 11:00:28 config: Warning: service auth { client_limit=50000 } is lower than required under max. load (60000) Apr 28 11:00:34 managesieve-login: Error: proxy: host not given: user=<mailchannel(a)mydomain.net>, method=PLAIN, rip=192.168.100.207, lip=192.168.100.119, TLS, session=<3/zPY74UOgDAqGTP> Apr 28 11:00:34 managesieve-login: Info: Aborted login (internal failure, 1 succesful auths): user=<mailchannel(a)mydomain.net>, method=PLAIN, rip=192.168.100.207, lip=192.168.100.119, TLS, session=<3/zPY74UOgDAqGTP> From searching around, only ever saw 1 result which was to add "executable = managesieve-login director" to the managesieve service, but this made no difference at all and the error is the same. So I tried to instead use the back end imap servers, but they throw errors expecting the users password to be the common proxy/director password as below: passdb { driver = static args = user=%u password=crypticpasswordagain } Apr 28 12:03:37 auth: Debug: static(mailchannel(a)mydomain.net,192.168.100.207,<17RTRb8UpADAqGTP>): lookup Apr 28 12:03:37 auth: Info: static(mailchannel(a)mydomain.net,192.168.100.207,<17RTRb8UpADAqGTP>): Password mismatch Apr 28 12:03:37 auth: Debug: static(mailchannel(a)mydomain.net,192.168.100.207,<17RTRb8UpADAqGTP>): PLAIN(85387v92394jks) != 'crypticpasswordagain' Apr 28 12:03:39 auth: Debug: client out: FAIL 1 user=mailchannel(a)mydomain.net So with configs below, how is it best to run managesieve that takes the correct login/password without directing to the cluster (or direct if it's easier but must use real user password)? -- dovecot proxy config -- # dovecot version 2.1.7 instance_name = dovecot-proxy protocols = imap pop3 lmtp sieve mail_location = maildir:~/ #listen = 192.168.101.119 listen = 0.0.0.0 # = dovecot-proxy-1 director_servers = 192.168.101.119 # = dovecot-shared-7 director_mail_servers = 192.168.100.101 base_dir = /var/run/dovecot-proxy login_greeting = Welcome to IMAP. default_internal_user = webmail lmtp_proxy = yes disable_plaintext_auth = no auth_mechanisms = plain login cram-md5 auth_verbose=yes auth_debug=yes auth_debug_passwords=yes mail_debug=yes verbose_ssl=yes auth_verbose_passwords=no #log_path = syslog log_path = /var/log/dovecot.log default_process_limit = 10000 default_client_limit = 50000 ssl = no ssl_cert = </etc/ssl/private/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem director_user_expire = 15 min doveadm_proxy_port = 9292 doveadm_password = somecrypticpassword auth_worker_max_count = 90 passdb { driver = ldap args = /etc/dovecot/dovecot-proxy-ldap.conf.ext } passdb { driver = checkpassword args = /etc/dovecot/checkpassword_migration.py } userdb { driver = prefetch } userdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext } service director { unix_listener login/director { mode = 0666 } fifo_listener login/proxy-notify { mode = 0666 } unix_listener director-userdb { mode = 0600 } inet_listener { port = 9191 } } service imap-login { process_min_avail = 2 service_count = 0 executable = imap-login director inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service pop3-login { process_min_avail = 2 service_count = 0 executable = pop3-login director inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service imap { process_min_avail = 2 process_limit = 0 service_count = 0 } service pop3 { process_min_avail = 2 process_limit = 0 service_count = 0 } service lmtp { inet_listener lmtp { port = 24 } } service auth { client_limit=65000 inet_listener { port = 5451 } } service auth-worker { user = webmail } service doveadm { inet_listener { port = 9292 } } protocol imap { mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 10 } protocol lmtp { auth_socket_path = director-userdb passdb { driver = ldap args = /etc/dovecot/dovecot-proxy-ldap.conf.ext } } protocol doveadm { auth_socket_path = director-userdb } plugin { # Used by both the Sieve plugin and the ManageSieve protocol sieve = file:~/sieve;active=~/.dovecot.sieve } -- dovecot backend config -- # dovecot version 2.1.7 protocols = imap pop3 lmtp #sieve # OLDTEMP listen = 192.168.100.95 listen = 192.168.100.101 mail_location = maildir:~/ namespace { prefix = INBOX. separator = . inbox = yes } base_dir = /var/run/dovecot/ login_greeting = Dovecot ready. default_login_user = dovenull default_internal_user = webmail mail_access_groups = mail postmaster_address = postmaster(a)mydomain.net disable_plaintext_auth = no auth_mechanisms = plain login auth_verbose=yes auth_debug=yes auth_debug_passwords=yes mail_debug=yes verbose_ssl=yes auth_verbose_passwords=no #log_path = syslog log_path = /var/log/dovecot.log default_process_limit = 10000 default_client_limit = 50000 mmap_disable = yes mail_fsync = always mail_nfs_storage = no mail_nfs_index = no #mail_plugin_dir = /usr/lib/dovecot mail_plugin_dir = /usr/lib/dovecot/modules # OLDTEMP mail_plugins = $mail_plugins quota fts fts_lucene mail_plugins = $mail_plugins quota fts fts_squat sieve ssl = no # OLDTEMP ssl_cert = </usr/local/dovecot/ssl/dovecot.pem # OLDTEMP ssl_key = </usr/local/dovecot/ssl/dovecot.pem ssl_cert = </etc/ssl/private/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem doveadm_password = somecrypticpassword userdb { driver = ldap # OLDTEMP args = /usr/local/dovecot/etc/dovecot/dovecot-ldap.conf.ext args = /etc/dovecot/dovecot-ldap.conf.ext } passdb { driver = static args = user=%u password=crypticpasswordagain } service imap-login { process_min_avail = 2 service_count = 0 inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service pop3-login { process_min_avail = 2 service_count = 0 inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service imap { process_min_avail = 2 process_limit = 0 executable = imap #imap-postlogin vsz_limit = 384M } service pop3 { process_min_avail = 2 process_limit = 0 executable = pop3 #pop3-postlogin vsz_limit = 384M } service lmtp { inet_listener lmtp { port = 24 } vsz_limit = 384M } service doveadm { inet_listener { port = 9292 } } service director { unix_listener director-admin { mode = 0 } } service quota-warning { executable = script /etc/dovecot/quota-warning.sh unix_listener quota-warning { user = webmail } } protocol imap { mail_plugins = $mail_plugins quota imap_quota mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 10 } plugin { fts = fts_squat fts_squat = partial=4 full=10 # fts_lucene = whitespace_chars=@. quota = maildir:User quota quota_warning = storage=75%% quota-warning 75 %u quota_warning2 = storage=95%% quota-warning 95 %u } -- managesieve config -- service managesieve-login { executable = managesieve-login director service_count = 0 process_min_avail = 0 vsz_limit = 64M } service managesieve { process_count = 100 } # Service configuration protocol sieve { managesieve_max_line_length = 32768 executable = managesieve-login director mail_max_userip_connections = 5 managesieve_max_compile_errors = 5 }

1 0

[sieve] extracting address behavior changes beetwen 2.2.13 and 2.2.16
by Marcin Mirosław 05 May '15

05 May '15

Hi all! After upgrading dovecot from 2.2.13 to 2.2.16 I noticed that my sieve filters doesn't catch some emails. I used sieve-test with tracing (it's great tool!) and I can see as below: part of sieve filter: [...] elsif address :is "From" "backup(a)areda.pl" { [...] dovecot-2.2.13: 36: address test 36: starting `:is' match with `i;ascii-casemap' comparator: 36: extracting `From' headers from message 36: parsing address header value `=?UTF-8?B?QmFjdWxhQEFUTQ==?= <backup(a)areda.pl>' 36: extracting `all' part from address `backup(a)areda.pl' 36: matching value `backup(a)areda.pl' 36: with key `backup(a)areda.pl' => 1 36: finishing match with result: matched 36: jump if result is false 36: not jumping dovecot-2.2.16: 36: address test 36: starting `:is' match with `i;ascii-casemap' comparator: 36: extracting `From' headers from message 36: parsing address header value `Bacula@ATM <backup(a)areda.pl>' 36: extracting `all' part from address `Bacula@ATM' 36: matching value `Bacula@ATM' 36: with key `backup(a)areda.pl' => 0 36: finishing match with result: not matched 36: jump if result is false 36: jumping to line 43 So in newer dovecot sieve uses comment not exact email address. Did I wrongly wrote my sieve script? Thanks, Marcin.

2 2