- dovecot - dovecot.org

Re: [Dovecot] Solr 4.0 - lucene - FTS
by Paul Freeman 20 Jan '13

20 Jan '13

On 2012-11-07 15:14, Timo Sirainen wrote: > On 7.11.2012, at 15.01, Charles Marcus wrote: > >> As one who is interested in implementing FTS sometime in the future, >> I'm curious about what is in store as far as improvements go... >> >> Specifically, any plans for implementing immediate/automatic index >> updates at delivery time? The lack of automatically updated indexes is >> one downside for its implementation... > > Nothing really prevents from adding that very easily .. trivial ? :) > I guess it > would need a new setting, which is always the most annoying part of > small changes. :) I think it would have to have a setting equivalent > to doveadm index -n parameter, which allows indexing most users, > except those who pretty much never read their emails. So with doveadm > index -n 1000 you could set that if the mailbox's \Recent count is > over 1000, don't index the mailbox. So .. hmm. I guess two settings > would be cleaner: > > plugin { > fts_autoindex = yes > fts_autoindex_max_recent = 1000 > } sounds nice, any plans on the roadmap to actually implement this yet ? :) > Or maybe there's a better name than "autoindex" for this feature. > SEARCH always autoindexes anyway. > >> Also, does the release of Solr 4.0 mean anything for the lucene >> library used by dovecot? > > No, fts-lucene and fts-solr are separate backends. But I do have some > small plans to add a few more features to fts-solr.

1 0

[Dovecot] %d in configuration file does not work
by Jens Tobiska 19 Jan '13

19 Jan '13

I am trying to set up dovecot in a postfix virtual account/domains setting. In the configuration file I would like to use %d in two places, for: mail_location = /var/mail/vhosts/%d/%n and to specify the location of the respective passwd file: passdb passwd-file { args = /etc/auth/%d/shadow } Looking at the logs, %d is empty while %n works, so dovecot is looking for something in /var/mail/vhosts//myname and /etc/auth//shadow which don't exist. Replacing %d in dovecot.conf with the actual domain name works. So, the quesiton is, why is %d empty, and from where does it take its value?

2 8

[Dovecot] anti-spam
by Spyros Tsiolis 19 Jan '13

19 Jan '13

Chaps, What's the story with anti-spam on dovecot ? Do we have something working out of the box, so to speak ? Any guidance / ideas ? s. ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis

2 1

[Dovecot] [PATCH] LMTP: Permit user IDs containing recipient_delimiter
by Ulrich Zehl 18 Jan '13

18 Jan '13

The Dovecot 2.1 LMTP server currently always strips the address extension from a recipient address (if recipient_delimiter is set), meaning user IDs cannot contain the recipient delimiter character, e.g. "user+foo" is not supported. This was surprising for me, as Postfix behaves differently in this regard: It first looks up "user+foo", and only then "user". The attached patch works for me and brings Dovecot's behavior in line with Postfix. Please let me know what you think about it.

2 2

[Dovecot] users = virual + system (both with ldap backend) => Fatal: setgid(12(mail)) failed with euid=501(...
by lejeczek 18 Jan '13

18 Jan '13

dear all probably something trivial, just cannot get my way around it, my goal is to get sieve on local-system users too, so postfix hands lda over to dovecot errors with mail for system users: lda(me): Fatal: setgid(12(mail)) failed with euid=501(me), gid=513(Domain Users), egid=513( Domain Users): Operation not permitted (This binary should probably be called with process group set to 12(mail) instead of 513(Doma in Users)) mail storage is in users' homes and these are on nfs3 which bits am I missing, please advise? regards

1 0

[Dovecot] dovecot + antispam plugin - no retraining
by Michael Moerz 17 Jan '13

17 Jan '13

Hi, dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.8.0-0-generic x86_64 Ubuntu Raring Ringtail (development branch) listen = 10.10.200.39 login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_debug = yes mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = prefix = } passdb { driver = pam } plugin { antispam_backend = pipe antispam_mail_notspam = ham(a)example.org antispam_mail_sendmail = /usr/sbin/sendmail antispam_mail_sendmail_args = -f;%u(a)example.org antispam_mail_spam = spam(a)example.org antispam_mail_tmpdir = /tmp antispam_signature = X-DSPAM-Signature antispam_signature_missing = error antispam_spam_pattern_ignorecase = SPAM;Junk antispam_trash = trash;Trash;Deleted Items; Deleted Messages mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap sieve pop3" service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } ssl_cert = </etc/ssl/certs/mail.dmz.example.org.cert.pem ssl_key = </etc/ssl/private/mail.dmz.example.org.key.pem userdb { driver = passwd } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 15 mail_plugins = " antispam" } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve postmaster_address = postmaster quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r } filesystem is ext4 antispam util is dspam I'm trying to utilize the imap plugin antispam for retraining spam/ham when moving mail from/to spam folders. antispam plugin is loaded and imap service itself runs correctly logfile excerp for login: Jan 16 21:04:33 mailhost dovecot: imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules Jan 16 21:04:33 mailhost dovecot: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib90_antispam_plugin.so Jan 16 21:04:33 mailhost dovecot: imap(user): Debug: Effective uid=1001, gid=1001, home=/home/user Jan 16 21:04:33 mailhost dovecot: imap(user): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir Jan 16 21:04:33 mailhost dovecot: imap(user): Debug: maildir++: root=/home/user/Maildir, index=, control=, inbox=/home/user/Maildir, alt= Jan 16 21:04:34 mailhost dovecot: imap-login: Login: user=<user>, method=PLAIN, rip=10.10.99.205, lip=10.10.200.39, mpid=5936, TLS Jan 16 21:04:34 mailhost dovecot: imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules Jan 16 21:04:34 mailhost dovecot: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib90_antispam_plugin.so Jan 16 21:04:34 mailhost dovecot: imap(user): Debug: Effective uid=1001, gid=1001, home=/home/user Jan 16 21:04:34 mailhost dovecot: imap(user): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir Jan 16 21:04:34 mailhost dovecot: imap(user): Debug: maildir++: root=/home/user/Maildir, index=, control=, inbox=/home/user/Maildir, alt= When I move mail into or out of imap folders named Junk or SPAM I would expect, that the antispam plugin kicks in and pipes the mail to dspam. Apparently this does not happen, nothing gets piped, though the mail is still moved to the folder. I've already tried dspam-exec as a backend as well, but that fails even ealier right after imap login with: Jan 16 19:26:15 mailhost dovecot: master: Dovecot v2.1.7 starting up (core dumps disabled) Jan 16 19:26:45 mailhost dovecot: imap-login: Login: user=<user>, method=PLAIN, rip=10.10.99.205, lip=10.10.200.39, mpid=4701, TLS Jan 16 19:26:45 mailhost dovecot: imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules Jan 16 19:26:45 mailhost dovecot: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib90_antispam_plugin.so Jan 16 19:26:45 mailhost dovecot: imap(user): Debug: Effective uid=1001, gid=1001, home=/home/user Jan 16 19:26:45 mailhost dovecot: imap(user): Fatal: master: service(imap): child 4701 returned error 3 settings were: antispam_backend = dspam-exec antispam_dspam_binary = /usr/bin/dspam antispam_dspam_args = --client;--source=error;--user;%u;--signature=%%s I've also tried with: antispam_backend = dspam-exec antispam_dspam_binary = /usr/bin/dspam antispam_dspam_args = --source=error;--user;%u those settings actually do not produce the problem after the imap login, but they still do not react to moving mail into/from spam folders. I've also tried to utilize antispam_spam = Junk or antispam_spam_pattern = SPAM instead of antispam_spam_pattern_ignorecase = SPAM;Junk but neither makes a difference. Thx in advance for any advice. kind regards, Michael Moerz

2 2

[Dovecot] possible: two private namespaces with different quota?
by Steffen Kaiser 17 Jan '13

17 Jan '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, in thread "how to setup different quota for multiple namespaces" I tried to get an additional, private namespace "archive" with yet another quota. Every message, regardless if delivered to INBOX or archive, counts for both namespaces, the default one and the archive one. Furthermore the dict records the quota of the archive namespace as user "ns=archive". Because the quota_rules does not accept "*", I see no way to have two or more private quota roots. Could one improve quota_root_rule_find(struct quota_root_settings *root_set, const char *name) { struct quota_rule *rule; array_foreach_modifiable(&root_set->rules, rule) { char *p = strchr(rule->mailbox_name, '\0'); if(p && p > rule->mailbox_name + 1 && p[-1] == '*' ) { /* compare box* */ if(memcmp(rule->mailbox_name, name, p - rule->mailbox_name - 2) == 0) return rule; } else if (strcmp(rule->mailbox_name, name) == 0) return rule; } return NULL; } So one could add a relative rule for the default private namespace. Kind regards, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUPgKuF3r2wJMiz2NAQJRbAf/Rb993MR/j6NeLqxqqaqkry6BU2Kw2Sti xVwU9P6hAK/tb4o647PO1015Pd5XbbUpY0itqNzHguqof8+PuT4bGeECT33Y9mKA l0+Soq0Pi9war+ZHKYoQZizNDSb+fQkyGPSi3AsuHDapSpxwc6zj9v/HjxpHkr7+ l1ln8NcFG9gKZ/dB+eIM14GNHOsVKVI/lKfR4b50CFabIX871KIyXP8GEGyl9mUC te6ROCzcNTbRpyksQEjCh/UQ8PVWz8GNKAzreLMqGfdxp9SRkhSKiJYSGL9i8Rn6 CTKBmLy0Gq5MoF+7roAMBLzJe1TC0mxCkeT6s0G/iJB5vCVnYyo9BQ== =K3ko -----END PGP SIGNATURE-----

1 0

[Dovecot] Benchmarking: Dovecot vs Courier. Courier wins as POP3 server
by Alexandr Sabitov 17 Jan '13

17 Jan '13

Hi All, I have compared Dovecot performance to Courier and it appears that as a POP3 server Dovecot is slower in 2 times but as an IMAP server it is faster in 1.5 times. The same node (16CPUs), testing time is 30 min, please see results and dovecot configs attached. Benchmark software is MStone used by Sendmail Inc so is is quite reliable. I do not see anything else to tweak in Dovecot to increase POP3 performance. Can we all have some tips to improve it please ? This is how my Dovecot set up: (LDAP user) -> Dovecot Director -> (Master user) -> Dovecot Dovecot Director: dovecot-shared-4:~# /usr/local/dovecot/bin/doveconf -n -c /usr/local/dovecot/etc/dovecot/dovecot-proxy.conf # 2.1.12: /usr/local/dovecot/etc/dovecot/dovecot-proxy.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.6 auth_debug = yes auth_mechanisms = plain login cram-md5 ntlm auth_verbose = yes base_dir = /var/run/dovecot-proxy default_internal_user = webmail director_mail_servers = 192.168.100.102 director_servers = 192.168.100.101 disable_plaintext_auth = no doveadm_password = blah doveadm_proxy_port = 9292 instance_name = dovecot-proxy listen = 192.168.100.101 log_path = /var/log/dovecot-proxy.log login_greeting = Dovecot Proxy ready. mail_location = maildir:~/ passdb { args = /usr/local/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } service auth-worker { user = webmail } service auth { client_limit = 2400 } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9191 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 9292 } } service imap-login { executable = imap-login director inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service imap { service_count = 0 } service lmtp { inet_listener lmtp { port = 24 } } service pop3-login { executable = pop3-login director inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { service_count = 0 } ssl_cert = </usr/local/dovecot/ssl/dovecot.pem ssl_key = </usr/local/dovecot/ssl/dovecot.pem userdb { args = /usr/local/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol imap { mail_max_userip_connections = 100 } protocol doveadm { auth_socket_path = director-userdb } Dovecot (back-end): dovecot-shared-4:~# /usr/local/dovecot/bin/doveconf -n # 2.1.12: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.6 auth_debug = yes auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes base_dir = /var/run/dovecot/ default_internal_user = webmail disable_plaintext_auth = no doveadm_password = blah listen = 192.168.100.102 log_path = /var/log/dovecot.log mail_fsync = always mail_location = maildir:~/ mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " quota fts fts_lucene" mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. separator = . } passdb { args = /usr/local/dovecot/etc/dovecot/passwd.masterusers driver = passwd-file master = yes pass = yes } passdb { driver = static } plugin { fts = lucene fts_lucene = whitespace_chars=@. quota = maildir:User quota } service director { unix_listener director-admin { mode = 00 } } service doveadm { inet_listener { port = 9292 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 20 process_min_avail = 8 } service imap-postlogin { executable = script-login /usr/local/dovecot/bin/imap-postlogin.sh user = webmail } service imap { executable = imap imap-postlogin } service lmtp { inet_listener lmtp { port = 24 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_limit = 20 process_min_avail = 8 } service pop3-postlogin { executable = script-login /usr/local/dovecot/bin/pop3-postlogin.sh user = webmail } service pop3 { executable = pop3 pop3-postlogin } ssl_cert = </usr/local/dovecot/ssl/dovecot.pem ssl_key = </usr/local/dovecot/ssl/dovecot.pem userdb { args = /usr/local/dovecot/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol imap { mail_plugins = " quota fts fts_lucene imap_quota" } Best Regards, Alexandr Sabitov Netregistry

4 4

[Dovecot] failure trying to autocreate an Inbox that already exists
by Kurt Snyder 17 Jan '13

17 Jan '13

I have a new installation of Dovecot 2.1.12 and cannot select the Inbox without getting this error: c select inbox c NO [SERVERBUG] Internal error occurred. Refer to server log for more information. [2013-01-16 18:22:13] Here's the server log: dovecot[15643]: imap(u1): Error: Failed to autocreate mailbox INBOX: Mailbox already exists Auto create settings are currently set to 'no' -- when they were set to create, the problem was the same. Passwords are currently plaintext for testing purposes -- Imap authentication works. It's running on OS/X 10.7.3 Our config is below. Thanks for any suggestions... # 2.1.12: /usr/local/etc/dovecot/dovecot.conf # OS: Darwin 11.3.0 x86_64 auth_debug_passwords = yes auth_username_chars = disable_plaintext_auth = no mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox INBOX { auto = no } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=plain /etc/passwd-imap driver = passwd-file } protocols = imap ssl = no userdb { args = username_format=%n /etc/passwd-imap driver = passwd-file }

1 0

[Dovecot] dovecot-2.2.beta1: do not removes e-mail with enabled replication
by Евгений Басов 16 Jan '13

16 Jan '13

Hello. I'm created two installations of dovecot-2.2.beta1 with identical config. Without replication each server works good. With replication enabled every changes are replicated between these ones. When I probe remove or move some email in another folder it is disappears and reappears again and again in source folder and appears in destination folder. Thus increasing number of letters like with copy. Possible reasons cause of the problem: - bug - configuration settings of dovecot - users with wich dovecot works and users rights. Which version is true? If this not a bug, what should be corrected in the configuration? Configuration: auth_debug = yes auth_mechanisms = plain login auth_verbose = yes import_environment = TZ lock_method = flock mail_debug = yes mail_location = mdbox:/var/vmail/%d/%n:INDEX=/var/vmail_indexes/%d/%n/ mail_plugins = " quota notify replication" mail_temp_dir = /var/spool/lmtp-dovecot mdbox_preallocate_space = yes mdbox_rotate_interval = 1 days mdbox_rotate_size = 50 M namespace inbox { inbox = yes location = mailbox Шаблоны { auto = create } mailbox Archive { auto = create special_use = \Archive } mailbox Archives { auto = create special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_replica = remote:vmail@mailsys.office.megagroup.ru quota = dict:Domain quota:%d:redis:host=127.0.0.1:prefix=domain/ quota2 = dict:User quota::redis:host=127.0.0.1:prefix=user/ quota2_rule = *:storage=0 quota2_rule2 = Trash:storage=+5%% quota_rule = *:storage=0 quota_rule2 = Trash:storage=+5%% } service aggregator { fifo_listener replication-notify-fifo { mode = 0600 user = vmail } unix_listener replication-notify { mode = 0600 user = vmail } } service auth-worker { user = $default_internal_user } service auth { unix_listener auth-userdb { group = $default_internal_user mode = 0666 user = $default_internal_user } } service config { unix_listener config { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = $default_internal_user } } service doveadm { user = vmail } service imap-login { process_min_avail = 5 service_count = 1 } service imap-postlogin { executable = script-login /usr/local/bin/imaptrackLastLogin.sh user = $default_internal_user } service imap { executable = imap imap-postlogin process_limit = 1024 } service lmtp { inet_listener lmtp { address = *, :: port = 24 } process_min_avail = 5 } service pop3-login { process_min_avail = 5 service_count = 1 } service pop3-postlogin { executable = script-login /usr/local/bin/pop3trackLastLogin.sh user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin process_limit = 1024 } service replicator { process_limit = 1024 process_min_avail = 3 } ssl_cert = </etc/ssl/dovecot/server.pem ssl_key = </etc/ssl/dovecot/server.key userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { mail_plugins = " quota notify replication imap_quota" } Filesystem permissions: # ls -l /var/ drwxr-xr-x 3 vmail vmail 24 Jan 16 16:14 vmail drwxr-xr-x 3 vmail vmail 24 Jan 16 16:14 vmail_indexes # ls -l /var/spool/ drwxrwx--- 2 dovecot dovecot 6 Jan 16 15:11 lmtp-dovecot Users: dovecot:x:97:97:added by portage for dovecot:/dev/null:/sbin/nologin uid=97(dovecot) gid=97(dovecot) groups=97(dovecot) dovenull:x:102:102:added by portage for dovecot:/dev/null:/sbin/nologin uid=102(dovenull) gid=102(dovenull) groups=102(dovenull) vmail:x:999:999:User for work with local mail storage:/home/vmail:/bin/bash uid=999(vmail) gid=999(vmail) groups=999(vmail),97(dovecot) Selects from user database are rights because isolated installations are works and not get errors.

2 1