- dovecot - dovecot.org

many imap connections issue
by Бауыржан Сахариев 05 Jul '16

05 Jul '16

I'm using dovecot 2.1.7 I'm trying to connect to dovecot by imap via Java mail api. My approach described here <http://stackoverflow.com/questions/37991025/why-iterating-over-all-java-mai…>. Bill Shannon, author of the Java Mail api recommended me to check carefully my server side (I have dovecot at server side). Actually, imap login in loop works but very slow. Each store.connect(login,password) takes about 1 minute. I tried to increase mail_max_userip_connections client_limit and process limit but it didn't help. My dovecot sometimes performs query, sometimes not! My logs: Jul 04 18:23:25 auth: Error: pgsql: Query failed, aborting: SELECT email, 'maildir:/home/mailboxes/maildir/'||maildir as mail,'/home/mailboxes/home/'||maildir as home, 500 as uid, 500 as gid FROM users WHERE email = 'test(a)test.domain.com' Jul 04 18:23:25 auth: Error: sql(test(a)test.domain.com,127.0.0.1,<HGiPY842jgB/AAAB>): User query failed: ERROR: permission denied for relation users My user and password queries: password_query = SELECT email as user, password FROM users WHERE email = '%u' user_query = SELECT email as user, 'maildir:/home/mailboxes/maildir/'||maildir as mail, '/home/mailboxes/home/'||maildir as home, 500 as uid, 500 as gid FROM users WHERE email = '%u' My master conf *Please note, that I'm using same uid!* service imap-login { inet_listener imap { #port = 143 } inet_listener imaps { #port = 993 #ssl = yes } # Number of connections to handle before starting a new process. Typically # the only useful values are 0 (unlimited) or 1. 1 is more secure, but 0 # is faster. <doc/wiki/LoginProcess.txt> #service_count = 1 # Number of processes to always keep waiting for more connections. #process_min_avail = 0 # If you set service_count=0, you probably need to grow this. #vsz_limit = $default_vsz_limit } service imap { # Most of the memory goes to mmap()ing files. You may need to increase this # limit if you have huge mailboxes. #vsz_limit = $default_vsz_limit # Max. number of IMAP processes (connections) #process_limit = 1024 } service auth { unix_listener auth-userdb { #mode = 0666 #user = #group = } # Postfix smtp-auth #unix_listener /var/spool/postfix/private/auth { # mode = 0666 #} # Auth process is run as this user. #user = $default_internal_user } service auth-worker { # Auth worker process is run as root by default, so that it can access # /etc/shadow. If this isn't necessary, the user should be changed to # $default_internal_user. #user = root } I'm sure that long login *reason is poor dovecot config* but some things are not clear to me and I can't improve it. 1. Which service are being used when Java connects to dovecot? imap-login,imap or auth? My assumption - imap-login. Imap user for dealing with folders *after* login, auth is for delivery (my assotioations here are postfix,lmtp,lda) =) Is my assumptions about imap-login and other services correct? 2. Which user are being used when I login? One that specified in connection code(one of 50K users in loop) or uid(500) user? I suggested that only one user and increased mail_max_userip_connections is it correct? 3. May some troubles in connection (which I showed above) caused by mode(0660) bad config in master.cf services? 4. Almost each loop iteration connects to dovecot in 60 seconds and rarely connects in a few milliseconds. Is that fact somehow connected with deafult_idle_kill which equlas to 1 mins?

1 0

v2.2.25 released
by Timo Sirainen 04 Jul '16

04 Jul '16

http://dovecot.org/releases/2.2/dovecot-2.2.25.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.25.tar.gz.sig Some minor fixes and (mainly logging) improvements since rc1. * lmtp: Start tracking lmtp_user_concurrency_limit and reject already at RCPT TO stage. This avoids MTA unnecessarily completing DATA only to get an error. * doveadm: Previously only mail settings were read from protocol doveadm { .. } section. Now all settings are. + quota: Added quota_over_flag_lazy_check setting. It avoids checking quota_over_flag always at startup. Instead it's checked only when quota is being read for some other purpose. + auth: Added a new auth policy service: http://wiki2.dovecot.org/Authentication/Policy + auth: Added PBKDF2 password scheme + auth: Added %{auth_user}, %{auth_username} and %{auth_domain} + auth: Added ":remove" suffix to extra field names to remove them. + auth: Added "delay_until=<timestamp>[+<max random secs>]" passdb extra field. The auth will wait until <timestamp> and optionally some randomness and then return success. + dict proxy: Added idle_msecs=<n> parameter. Support async operations. + Performance improvements for handling large mailboxes. + Added lib-dcrypt API for providing cryptographic functions. + Added "doveadm mailbox update" command + imap commands' output now includes timing spent on the "syncing" stage if it's larger than 0. + cassandra: Added metrics=<path> to connect setting to output internal statistics in JSON format every second to <path>. + doveadm mailbox delete: Added -e parameter to delete only empty mailboxes. Added --unsafe option to quickly delete a mailbox, bypassing lazy_expunge and quota plugins. + doveadm user & auth cache flush are now available via doveadm-server. + doveadm service stop <services> will stop specified services while leaving the rest of Dovecot running. + quota optimization: Avoid reading mail sizes for backends which don't need them (count, fs, dirsize) + Added mailbox { autoexpunge_max_mails=<n> } setting. + Added welcome plugin: http://wiki2.dovecot.org/Plugins/Welcome + fts: Added fts_autoindex_exclude setting. - v2.2.24's MIME parser was assert-crashing on mails having truncated MIME headers. - auth: With multiple userdbs the final success/failure result wasn't always correct. The last userdb's result was always used. - doveadm backup was sometimes deleting entire mailboxes unnecessarily. - doveadm: Command -parameters weren't being sent to doveadm-server. - If dovecot.index read failed e.g. because mmap() reached VSZ limit, an empty index could have been opened instead, corrupting the mailbox state. - imapc: Fixed EXPUNGE handling when imapc_features didn't have modseq. - lazy-expunge: Fixed a crash when copying failed. Various other fixes. - fts-lucene: Fixed crash on index rescan. - auth_stats=yes produced broken output - dict-ldap: Various fixes - dict-sql: NULL values crashed. Now they're treated as "not found".

6 8

Shared mailboxes not showing up in shared namespace
by Marti Markov 04 Jul '16

04 Jul '16

Hi, I think I have configured everything correctly but for some reason I can’t get a list of the shared mailboxes to show up. When I run: doveadm acl debug -u m.markov Shared/d.marteva/INBOX doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) doveadm(m.markov): Debug: Added userdb setting: plugin/=yes doveadm(m.markov): Debug: Effective uid=1000, gid=1000, home=/home/vmail/domain.com/m.markov doveadm(m.markov): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir doveadm(m.markov): Debug: maildir++: root=/home/vmail/domain.com/m.markov/Maildir, index=, indexpvt=, control=, inbox=/home/vmail/domain.com/m.markov/Maildir, alt= doveadm(m.markov): Debug: acl: initializing backend with data: vfile doveadm(m.markov): Debug: acl: acl username = m.markov(a)domain.com doveadm(m.markov): Debug: acl: owner = 1 doveadm(m.markov): Debug: acl vfile: Global ACLs disabled [ Read 8 lines ] doveadm(m.markov): Debug: Namespace : type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/Public:INDEXPVT=~/Maildir/Publics doveadm(m.markov): Debug: maildir++: root=/home/vmail/Public, index=, indexpvt=/home/vmail/domain.com/m.markov/Maildir/Public, control=, inbox=, alt=ext ^T To Spell doveadm(m.markov): Debug: acl: initializing backend with data: vfile doveadm(m.markov): Debug: acl: acl username = m.markov(a)domain.com doveadm(m.markov): Debug: acl: owner = 0 doveadm(m.markov): Debug: acl vfile: Global ACLs disabled doveadm(m.markov): Debug: Namespace : type=shared, prefix=Shared/%u/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/domain.com/%u/Maildir:INDEXPVT=~/Maildir/share… doveadm(m.markov): Debug: shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= doveadm(m.markov): Debug: acl: initializing backend with data: vfile doveadm(m.markov): Debug: acl: acl username = m.markov(a)domain.com doveadm(m.markov): Debug: acl: owner = 0 doveadm(m.markov): Debug: acl vfile: Global ACLs disabled doveadm(m.markov): Debug: maildir++: root=/home/vmail/domain.com/d.marteva/Maildir, index=, indexpvt=/home/vmail//d.marteva/Maildir/shared/d.marteva, control=, inbox=/home/vmail/domain.com/d.marteva/Maildir, alt= doveadm(m.markov): Debug: acl: initializing backend with data: vfile doveadm(m.markov): Debug: acl: acl username = d.marteva doveadm(m.markov): Debug: acl: owner = 1 doveadm(m.markov): Debug: acl vfile: Global ACLs disabled doveadm(m.markov): Debug: maildir++: root=/home/vmail/domain.com/d.marteva/Maildir, index=, indexpvt=/home/vmail/domain.com/m.markov/Maildir/shared/d.marteva, control=, inbox=/home/vmail/domain.com/d.marteva/Maildir, alt= doveadm(m.markov): Debug: acl: initializing backend with data: vfile doveadm(m.markov): Debug: acl: acl username = m.markov(a)domain.com doveadm(m.markov): Debug: acl: owner = 0 doveadm(m.markov): Debug: acl vfile: Global ACLs disabled doveadm(m.markov): Info: Mailbox 'INBOX' is in namespace 'Shared/d.marteva/' doveadm(m.markov): Info: Mailbox path: /home/vmail/domain.com/d.marteva/Maildir doveadm(m.markov): Info: Per-user private flags in mailbox: \Seen doveadm(m.markov): Debug: acl vfile: reading file /home/vmail/domain.com/d.marteva/Maildir/dovecot-acl doveadm(m.markov): Info: User m.markov(a)domain.com has rights: lookup read write create doveadm(m.markov): Info: Mailbox found from dovecot-acl-list doveadm(m.markov): Info: User d.marteva found from ACL shared dict doveadm(m.markov): Info: Mailbox Shared/d.marteva/INBOX is visible in LIST Here is how I have defined the namespace: namespace { type = shared separator = / prefix = Shared/%%u/ # a) Per-user seen flags. Maildir indexes are shared. (INDEXPVT requires v2.2+) location = maildir:/home/vmail/domain.com/%%u/Maildir:INDEXPVT=~/Maildir/shared/%%u # b) Per-user seen flags. Maildir indexes are not shared. If users have direct filesystem level access to their mails, this is a safer option: #location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u:INDEXPVT=~/Maildir/shared/%%u subscriptions = yes # list = children list=yes } And here is the ACL config: plugin { #acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl = vfile } # To let users LIST mailboxes shared by other users, Dovecot needs a # shared mailbox dictionary. For example: plugin { #acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes acl_shared_dict = file:/home/vmail/domain.com/shared-mailboxes2 #acl_lookup_dict = file:/home/vmail/domain.com/shared-mailboxes } Any suggestions?

3 7

RE: quota-status service
by Michael Fox 03 Jul '16

03 Jul '16

??? From: Michael Fox [mailto:news@mefox.org] Sent: Thursday, June 30, 2016 1:59 PM To: Dovecot Mailing List (dovecot(a)dovecot.org) <dovecot(a)dovecot.org> Subject: quota-status service I'm trying to understand the quota-status service, but I can't find complete documentation. The quota-status service is mentioned here: http://wiki.dovecot.org/Quota And an example configuration is shown: service quota-status { executable = quota-status -p postfix inet_listener { port = 12340 # You can choose any port you want } client_limit = 1 } But I can't find any information on quota-status. "man quota-status" returns nothing. I am unable to find a "quota-status" file on my machine. Where is the executable located? What does the "-p postfix" option do? Are there any other command line options? The above wiki page shows three quota_status_* options in use: quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is full" Where are their meanings documented? What are the allowed values? Are there other quota_status_* options? Thanks in advance. Thanks, Michael

2 3

Re: FW: quota-status service
by Aki Tuomi 03 Jul '16

03 Jul '16

If you need fast and timely support you can contact OX sales for an support agreement . It is somewhat impolite to except such from a public mailing list over weekend. ---Aki TuomiDovecot oy -------- Original message --------From: Michael Fox <news(a)mefox.org> Date: 03/07/2016 09:00 (GMT+02:00) To: Dovecot Mailing List <dovecot(a)dovecot.org> Subject: FW: quota-status service ??? 3rd request -----Original Message----- From: dovecot [mailto:dovecot-bounces@dovecot.org] On Behalf Of Michael Fox Sent: Friday, July 1, 2016 5:56 PM To: Dovecot Mailing List <dovecot(a)dovecot.org> Subject: RE: quota-status service ??? From: Michael Fox [mailto:news@mefox.org] Sent: Thursday, June 30, 2016 1:59 PM To: Dovecot Mailing List (dovecot(a)dovecot.org) <dovecot(a)dovecot.org> Subject: quota-status service I'm trying to understand the quota-status service, but I can't find complete documentation. The quota-status service is mentioned here: http://wiki.dovecot.org/Quota And an example configuration is shown: service quota-status { executable = quota-status -p postfix inet_listener { port = 12340 # You can choose any port you want } client_limit = 1 } But I can't find any information on quota-status. "man quota-status" returns nothing. I am unable to find a "quota-status" file on my machine. Where is the executable located? What does the "-p postfix" option do? Are there any other command line options? The above wiki page shows three quota_status_* options in use: quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is full" Where are their meanings documented? What are the allowed values? Are there other quota_status_* options? Thanks in advance. Thanks, Michael

4 4

Error on upgrade to 2.2.25 from 2.2.24
by Goetz R Schultz 02 Jul '16

02 Jul '16

Hi, I have compiled the latest version with those flags: ./configure --with-pgsql --with-sql under FreeBSD/amd64. This worked fine with the previous version. Compilation also works without errors. Yet when I start DC I get this error: Jul 1 22:48:55 section31 dovecot: master: Dovecot v2.2.25 () starting up for imap Jul 1 22:48:55 section31 dovecot: master: Panic: kevent(EV_ADD, READ, 55) failed: Bad file descriptor This does not hapen with the previous version. I could not find any change note that would point in that direction. Any clues? Did I miss something to set? -- Thanks and regards Goetz "I intend to live forever - so far, so good." =============================================== /"\ Get the rootcertificate at www.cacert.org \ / ASCII Ribbon Campaign against HTML e-mail X / \ Verify the cert @ CaCert.Com =============================================== "Si forte in alienas manus oberraverit hec peregrina epistola incertis ventis dimissa, sed Deo commendata, precamur ut ei reddatur cui soli destinata, nec preripiat quisquam non sibi parata."

1 0

Re: Looking for GSSAPI config [was: Looking for NTLM config example]
by Mark Foley 01 Jul '16

01 Jul '16

Aki - made your suggested changes, but no joy :( My /etc/krb5.conf: ------SNIP-------- [libdefaults] default_realm = HPRS.LOCAL dns_lookup_realm = false dns_lookup_kdc = true [libdefaults] default_realm = HPRS.LOCAL dns_lookup_kdc = true kdc_timesync = 1 ccache_type = 4 forwardable = true proxiable = true fcc-mit-ticketflags = true [realms] HPRS.LOCAL = { default_domain = hprs.local auth_to_local_names = { Administrator = root } } [domain_realm] hprs.local = HPRS.LOCAL # this is not a mistake .hprs.local = HPRS.LOCAL ------PINS----------- you wrote: > You can remove the krb4_ stuff I've remove krb4_ stuff from the [libdefaults] and eliminated the [login] section altogether. Question on [realms]Administrator: should that really be root or should it be my AD Administrator? my doveconf -n is exactly the same as posted below, but in particular: auth_krb5_keytab = /etc/krb5.keytab auth_mechanisms = plain login gssapi When I reloaded dovecot no mail was delivered to anyone (even though everyone was still using plain/ssl, no one yet configured for gssapi). In /var/log/maillog I got (repeatedly): Jun 28 09:43:36 mail dovecot: imap-login: Warning: Auth process not responding, delayed sending initial response (greeting): user=<>, rip=192.168.0.54, lip=192.168.0.2, session=<Jy/e0lY2WADAqAA2> Jun 28 09:43:37 mail dovecot: auth: Fatal: Unknown authentication mechanism 'gssapi' Jun 28 09:43:37 mail dovecot: master: Error: service(auth): command startup failed, throttling for 60 secs Jun 28 09:43:37 mail dovecot: imap-login: Warning: Auth process not responding, delayed sending initial response (greeting): user=<>, rip=166.170.27.161, lip=98.102.63.107, TLS, session=</GXn0lY22wCmqhuh> This looks pretty bad right off. Why "Unknown authentication mechanism 'gssapi'"? Do you have any idea from the configs I've posted? I'm rather depressed about this. I thought I'd finally able to get AD authentication going for Dovecot. Not ready to give up though! Suggestions? THX -- Mark -----original Message----- > Subject: Re: Looking for GSSAPI config [was: Looking for NTLM config example] > To: dovecot(a)dovecot.org > From: Aki Tuomi <aki.tuomi(a)dovecot.fi> > Date: Tue, 28 Jun 2016 15:13:11 +0300 > > On 28.06.2016 09:27, Mark Foley wrote: > > Aki, > > > > To review your 5 points: > > > > On Mon, 27 Jun 2016 09:18:54 +0300 Aki Tuomi <aki.tuomi(a)dovecot.fi> wrote: > > > >> 1. Functional AD or Kerberos environment > >> 2. Time synced against your KDC (which is your Domain Controller on Windows) > >> 3. /etc/krb5.conf configured > >> 4. Both forward / reverse DNS names correct for clients and servers. > >> Reverse is only mandatory for servers, but having them right will work > >> wonders. Most kerberos problems are about DNS problems. > >> 5. You need a keytab. This keytab needs to hold entries like > >> IMAP/your.host.name@REALM and IMAP/$HOSTNAME@REALM. You can generate > >> these on any Windows DC server (at least). > > I believe I am good on 1,2 and 4. I downloaded and installed kerberos and tested it with kinit > > and klist according to the instructions at > > https://wiki.samba.org/index.php/Setup_a_Samba_Active_Directory_Domain_Cont… > > > > As to the the keytab (#5) I did the following: > > > > $ samba-tool domain exportkeytab /etc/krb5.keytab > > > > which created the file. I made this owned and readable by group dovecot, per instructions at > > http://wiki2.dovecot.org/Authentication/Kerberos. Running `klist -k /etc/krb5.keytab` shows me > > configuration listing all the users and computers in the domain, mostly in triplicate. A > > partial list: > > > > Keytab name: FILE:/etc/krb5.keytab > > KVNO Principal > > ---- -------------------------------------------------------------------------- > > 18 COMMON$(a)HPRS.LOCAL > > 18 COMMON$(a)HPRS.LOCAL > > 18 COMMON$(a)HPRS.LOCAL > > 1 MAIL$(a)HPRS.LOCAL > > 1 MAIL$(a)HPRS.LOCAL > > 1 MAIL$(a)HPRS.LOCAL > > 1 charmaine(a)HPRS.LOCAL > > 1 charmaine(a)HPRS.LOCAL > > 1 charmaine(a)HPRS.LOCAL > > > > where COMMON and MAIL are hosts and charmaine is a user. I don't really understand the listing, > > but am assuming it is OK. > > Strange that you do not have any host/ entries. Maybe it works without. > > >> setspn -q is helpful here, also setspn command in general. > > I have no such command in my system. Is that a Windows thing? > > > > Yes, but you can do those kind of things in Samba too. > > > As to the /etc/krb5.conf, the default one generated by samba is: > > > > [libdefaults] > > default_realm = HPRS.LOCAL > > dns_lookup_realm = false > > dns_lookup_kdc = true > > > > I'd like to modify that to your suggestions, but I need more help. You have (with my questions): > > > >> Here is a *SAMPLE* configuration: > >> > >> [libdefaults] > >> default_realm = YOUR.REALM > >> dns_lookup_kdc = true > >> krb4_config = /etc/krb.conf > >> krb4_realms = /etc/krb.realms > > Here, you have krb4_*. Do you mean that? My config file is krb5.conf. Should I rather have: > > You can remove the krb4_ stuff > > > krb5_config = /etc/krb5.conf > > > > Also, I have no /etc/krb*.realms file. Do I need this? If so, what should be in there? > You don't necessarely require that. > > >> kdc_timesync = 1 > >> ccache_type = 4 > >> forwardable = true > >> proxiable = true > >> fcc-mit-ticketflags = true > >> > >> [realms] > >> YOUR.REALM = { > >> default_domain = your.domain.name > >> auth_to_local_names = { > >> Administrator = root > >> } > >> } > > I suppose my "YOUR.REALM" is HPRS.LOCAL, right? Is my "your.domain.name" my FQDN for my AD > > server: mail.hprs.local, or is it just hprs.local? (or something else!) > > HPRS.LOCAL is your REALM, hprs.local is your domain name. > > > >> [domain_realm] > >> your.domain.name = YOUR.REALM > >> # this is not a mistake > >> .your.domain.name = YOUR.REALM > >> [login] > >> krb4_convert = true > >> krb4_get_tickets = false > > Likewise here a question on the whole krb4 versus krb5 thing. > > > > Your closing comment: > > > >> Also, note that kerberos can only act as AUTHENTICATION system. It > >> cannot act as USER DATABASE. For that you need to configure LDAP or > >> something else. With Active Directory LDAP is probably a damn good idea. > > I have the following doveconf -n: > > > > # 2.2.15: /usr/local/etc/dovecot/dovecot.conf > > # OS: Linux 3.10.17 x86_64 Slackware 14.1 > > auth_debug_passwords = yes > > auth_krb5_keytab = /etc/krb5.keytab > > auth_mechanisms = plain login gssapi > > auth_verbose = yes > > auth_verbose_passwords = plain > > disable_plaintext_auth = no > > info_log_path = /var/log/dovecot_info > > mail_location = maildir:~/Maildir > > passdb { > > driver = shadow > > } > > protocols = imap > > ssl_cert = </etc/ssl/certs/OHPRS/GoDaddy/Apache/2015-08-14/57aa6ed6ae98b4c7.crt > > ssl_key = </etc/ssl/certs/OHPRS/GoDaddy/mail.ohprs.org.key > > userdb { > > driver = passwd > > } > > verbose_ssl = yes > > > > I assume the passwd driver for the userdb is OK? Seems to me it should work with gssapi, but in > > any case I still have all but this test workstation NOT using gssapi, so I still need to > > accomodate them. > > > > Thanks, --Mark > passwd driver is fine, yes, if you ensure that users can be found. > > Aki >

5 12

Suggestions? Moving maildir to new storage and may be switch to mdbox
by Götz Reinicke - IT Koordinator 01 Jul '16

01 Jul '16

Hi, we got a new storage for our mails and now we think about the best way to use it. Currently about 1TB is stored in maildirs, some mail has been moved to client side local storage temporarily to get space on the old storage. I think of different options, some downtime in mind: a) stay with maildir and just rsync/move all mail to the new storage, mount the new storage at the old mountpoint (or may be new mountpoint and edit the dovecot config). b) "dsync backup" users maildir to mdboxes at a temp mountpoint and change the dovecot config afterwords. c) your suggestions or best practice Thanks for feedback . Götz

1 0

v2.2.25 release candidate released
by Timo Sirainen 01 Jul '16

01 Jul '16

http://dovecot.org/releases/2.2/rc/dovecot-2.2.25.rc1.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.25.rc1.tar.gz.sig Quite a lot of changes. Please test out before the final v2.2.25 release, which I'm planning for tomorrow. Especially the new lib-dcrypt might have compiling problems with some OpenSSL versions. * lmtp: Start tracking lmtp_user_concurrency_limit and reject already at RCPT TO stage. This avoids MTA unnecessarily completing DATA only to get an error. * doveadm: Previously only mail settings were read from protocol doveadm { .. } section. Now all settings are. + quota: Added quota_over_flag_lazy_check setting. It avoids checking quota_over_flag always at startup. Instead it's checked only when quota is being read for some other purpose. + auth: Added a new auth policy service: http://wiki2.dovecot.org/Authentication/Policy + auth: Added PBKDF2 password scheme + auth: Added %{auth_user}, %{auth_username} and %{auth_domain} + auth: Added ":remove" suffix to extra field names to remove them. + auth: Added "delay_until=<timestamp>[+<max random secs>]" passdb extra field. The auth will wait until <timestamp> and optionally some randomness and then return success. + dict proxy: Added idle_msecs=<n> parameter. Support async operations. + Performance improvements for handling large mailboxes. + Added lib-dcrypt API for providing cryptographic functions. + Added "doveadm mailbox update" command + imap commands' output now includes timing spent on the "syncing" stage if it's larger than 0. + cassandra: Added metrics=<path> to connect setting to output internal statistics in JSON format every second to <path>. + doveadm mailbox delete: Added -e parameter to delete only empty mailboxes. Added --unsafe option to quickly delete a mailbox, bypassing lazy_expunge and quota plugins. + doveadm user & auth cache flush are now available via doveadm-server. + doveadm service stop <services> will stop specified services while leaving the rest of Dovecot running. + quota optimization: Avoid reading mail sizes for backends which don't need them (count, fs, dirsize) + Added mailbox { autoexpunge_max_mails=<n> } setting. + Added welcome plugin: http://wiki2.dovecot.org/Plugins/Welcome + fts: Added fts_autoindex_exclude setting. - v2.2.24's MIME parser was assert-crashing on mails having truncated MIME headers. - auth: With multiple userdbs the final success/failure result wasn't always correct. The last userdb's result was always used. - doveadm backup was sometimes deleting entire mailboxes unnecessarily. - doveadm: Command -parameters weren't being sent to doveadm-server. - If dovecot.index read failed e.g. because mmap() reached VSZ limit, an empty index could have been opened instead, corrupting the mailbox state. - imapc: Fixed EXPUNGE handling when imapc_features didn't have modseq. - lazy-expunge: Fixed a crash when copying failed. Various other fixes. - fts-lucene: Fixed crash on index rescan. - auth_stats=yes produced broken output - dict-ldap: Various fixes - dict-sql: NULL values crashed. Now they're treated as "not found".

6 9

Fwd: Re: Dictionary quota with Flat file database
by Sam 01 Jul '16

01 Jul '16

Hello Aki, Finally I am using maildir as quota backend and it works! I set the second way like it was write here http://wiki2.dovecot.org/Quota/Maildir With this method The quota can be personalized per user manually. I only have to create the file once for the new users. But I don't know if these following options in 90-quota.ext works again : quota_rule2 = Trash:storage=+100M quota_grace = 10%% I'm going to test that. Thanks a lot! Sam Le 30/06/2016 à 16:13, aki.tuomi(a)dovecot.fi a écrit : >> On June 30, 2016 at 4:41 PM Sam <sr42354(a)gmail.com> wrote: >> >> >> Hello, >> >> I want specific quotas for certain users and I looking for doing that >> with dictionary quota backend and Flat file. >> >> Because I am using "active directory" with PAM for authenticate, I can't >> get per-user quota limits with set/override them by returning >> "quota_rule" extra field from userdb. >> >> I started reading http://wiki1.dovecot.org/Quota/Dict, saw some good >> stuff... >> >> The problem is that I don't understand how to set the limit in the users >> files. >> >> If I open one created file I only see the current number of messages and >> the actual size. Not the quota limits... >> >> vi /home/vmail/john.doe/Maildir/dovecot-quota : >> priv/quota/messages >> 13 >> priv/quota/storage >> 600201 >> >> Here is /etc/dovecot/conf.d/90-quota.conf file details : >> plugin { >> # I think I have to set the default limits here >> quota_rule = *:storage=10G:messages=10000 >> } >> ... >> plugin { >> quota = dict:user::file:%h/Maildir/dovecot-quota >> # same result with : >> # quota = dict:User::file:%h/Maildir/dovecot-quota >> } >> >> my server : CentOS Linux release 7.2.1511 >> dovecot : dovecot-2.2.10-5.el7.x86_64 >> >> Thanks for helping. >> Sam > Hi! > > You can use passwd-file userdb for setting additional attributes. > > Aki

1 0

Released Pigeonhole v0.4.15.rc1 for Dovecot v2.2.25.rc1.
by Stephan Bosch 01 Jul '16

01 Jul '16

Hello Dovecot users, This upcoming release is all about bug fixes, of which only one is really important. It affects the new imapsieve plugin. Changelog v0.4.15: - imapsieve plugin: For any mail transaction, the mailbox was opened a second time, even if no mailbox rule matched. This was unintentional, useless and caused problems when the imapsieve plugin was used with other plugins like acl. - extprograms plugin: Significantly improved error handling. No stream errors were logged. - Several small fixes based on static analysis. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.15… http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.15… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release candidate and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

quota-status service
by Michael Fox 30 Jun '16

30 Jun '16

I'm trying to understand the quota-status service, but I can't find complete documentation. The quota-status service is mentioned here: http://wiki.dovecot.org/Quota And an example configuration is shown: service quota-status { executable = quota-status -p postfix inet_listener { port = 12340 # You can choose any port you want } client_limit = 1 } But I can't find any information on quota-status. "man quota-status" returns nothing. I am unable to find a "quota-status" file on my machine. Where is the executable located? What does the "-p postfix" option do? Are there any other command line options? The above wiki page shows three quota_status_* options in use: quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is full" Where are their meanings documented? What are the allowed values? Are there other quota_status_* options? Thanks in advance. Thanks, Michael

1 0

quota_full_tempfail
by Felipe Gasper 30 Jun '16

30 Jun '16

Hi all, What specifically does this flag do? Does it affect what happens: -------------- - when the drive is full? - when the system user’s disk quota is full? - when the mailbox’s quota is full? -------------- Also, does it work with both LDA and LMTP? I don’t see much on this option in the docs. Thank you! -Felipe Gasper Houston, TX

1 0

Re: Error when searching in mailfolders
by Christoph Pleger 30 Jun '16

30 Jun '16

Hello, >>> Lucene library is throwing an error, which crashes Dovecot. Maybe Dovecot >>> should catch the error, but it would still be broken. Try deleting the lucene indexes and rebuilding them? >> Deleting the indexes helped, but after they had been rebuilt, the error occurred again. > Could you enable core dumps and run bt full in gdb? I attached the result. Regards Christoph

2 2

Remove my email id from mailing list
by Mayuri AgarwAl 30 Jun '16

30 Jun '16

Sent from my iPhone

2 1

Dictionary quota with Flat file database
by Sam 30 Jun '16

30 Jun '16

Hello, I want specific quotas for certain users and I looking for doing that with dictionary quota backend and Flat file. Because I am using "active directory" with PAM for authenticate, I can't get per-user quota limits with set/override them by returning "quota_rule" extra field from userdb. I started reading http://wiki1.dovecot.org/Quota/Dict, saw some good stuff... The problem is that I don't understand how to set the limit in the users files. If I open one created file I only see the current number of messages and the actual size. Not the quota limits... vi /home/vmail/john.doe/Maildir/dovecot-quota : priv/quota/messages 13 priv/quota/storage 600201 Here is /etc/dovecot/conf.d/90-quota.conf file details : plugin { # I think I have to set the default limits here quota_rule = *:storage=10G:messages=10000 } ... plugin { quota = dict:user::file:%h/Maildir/dovecot-quota # same result with : # quota = dict:User::file:%h/Maildir/dovecot-quota } my server : CentOS Linux release 7.2.1511 dovecot : dovecot-2.2.10-5.el7.x86_64 Thanks for helping. Sam

2 1

Unread Mail flag being reset frequently with dovecot -git master-2.2
by Reuben Farrelly 30 Jun '16

30 Jun '16

Hi again, I'm experiencing problems with the Dovecot git master-2.2 branch, in which mails that have been previously read are randomly appearing as unread. This happens slowly and affects more and more emails the more changes that occur to a mailbox. I am using Maildir format and on Gentoo Linux x86_64 on local disks. Usually only a few at a time change their status - and it seems to be random which ones lose their read status. Typically though they are the most recent emails that have been delivered in the past few months (I haven't yet seen this occur with any really old emails). This problem is MUA independent, it can be observed with Thunderbird as well as Roundcube. If I go in and mark all mails as read then they will show as read for a short while until they too slowly start become 'unread' again. Currently I'm running git rev from https://github.com/dovecot/core/commits/master-2.2 : f292589f4b85e02d97d974dfe34324c6c0bb9d9f (I can't run anything newer due to an SSL symbol error which I reported earlier). This rev: b1254dfe442639236f881afae85e0739520ab409 Is known to be good, so the problem started happening somewhere between these two. (I know there are a lot of in-between revisions, but bisecting that could take days of time). Dovecot config is up at: http://www.reub.net/files/dovecot/thunderstorm-dovecot.conf Rawlog debug files are at http://www.reub.net/files/dovecot/rawlogs/ Hopefully someone else may have seen this happen before. Are there any other debugs I can gather which will help get to the bottom of this? Reuben

2 2

Re[2]: External mail attachments storage cleanup
by Николай Мананков 30 Jun '16

30 Jun '16

Yes "dovecot purge" is certainly my mistake in the script but it really works completely analogous "doveadm purge" probably why I did not notice the difference before :) It looks like it just launches the doveadm in this case. Adding slashes after asterisks unfortunately they also adds to the variable and the script gives an error like "doveadm(user/(a)example.org/): Error: User doesn't exist" Thanks for the idea , I think it will be now more correctly : === #!/bin/sh cd /backup/MailRoot/dovecot/domains || exit 1 for i in * do if [ -d $i ]; then cd $i for j in * do if [ -d $j ]; then dovecot purge -u $j@$i fi done cd .. fi done === >Четверг, 30 июня 2016, 13:53 +03:00 от Alexander Moisseev <moiseev(a)mezonplus.ru>: > >On 30.06.16 12:51, Николай Мананков wrote: >> -----screenshot begin----- >> >> mail:/etc/cron.daily # cat ./dovepurge.sh >> #!/bin/sh >> >> cd /MailRoot/dovecot/domains >> >> for i in * >> do >> cd $i >> for j in *; do dovecot purge -u $j@$i; done >> cd .. >> done >> >> -----screenshot end ----- >> >It might be worth to add slashes after asterisks to process only directories. >Does "dovecot purge" actually work? > >-----screenshot begin----- > >#!/bin/sh > >cd /MailRoot/dovecot/domains || exit 1 > >for i in */ > do > cd $i > for j in */; do doveadm purge -u $j@$i; done > cd .. >done > >-----screenshot end ----- > >> It is strange that the daemon does not do this automatically, and even setting up autoexpunge option does not help. Also IMHO certainly evident mistake in the documentation about the wildcards processing by purge command.. > >I don't know how the developers themselves use Dovecot, but it lacks some obvious features like automatic purge or SIS cleanup on mailbox deletion. >

1 0

Re[2]: External mail attachments storage cleanup
by Николай Мананков 30 Jun '16

30 Jun '16

Yes "dovecot purge" is certainly my mistake in the script but it really works completely analogous "doveadm purge" probably why I did not notice the difference before :) It looks like it just launches the doveadm in this case. Adding slashes after asterisks unfortunately they also adds to the variable and the script gives an error like "doveadm(user/(a)example.org/): Error: User doesn't exist" Thanks for the idea , I think it will be now more correctly : === #!/bin/sh cd /backup/MailRoot/dovecot/domains || exit 1 for i in * do if [ -d $i ]; then cd $i for j in * do if [ -d $j ]; then dovecot purge -u $j@$i fi done cd .. fi done === >Четверг, 30 июня 2016, 13:53 +03:00 от Alexander Moisseev <moiseev(a)mezonplus.ru>: > >On 30.06.16 12:51, Николай Мананков wrote: >> -----screenshot begin----- >> >> mail:/etc/cron.daily # cat ./dovepurge.sh >> #!/bin/sh >> >> cd /MailRoot/dovecot/domains >> >> for i in * >> do >> cd $i >> for j in *; do dovecot purge -u $j@$i; done >> cd .. >> done >> >> -----screenshot end ----- >> >It might be worth to add slashes after asterisks to process only directories. >Does "dovecot purge" actually work? > >-----screenshot begin----- > >#!/bin/sh > >cd /MailRoot/dovecot/domains || exit 1 > >for i in */ > do > cd $i > for j in */; do doveadm purge -u $j@$i; done > cd .. >done > >-----screenshot end ----- > >> It is strange that the daemon does not do this automatically, and even setting up autoexpunge option does not help. Also IMHO certainly evident mistake in the documentation about the wildcards processing by purge command.. > >I don't know how the developers themselves use Dovecot, but it lacks some obvious features like automatic purge or SIS cleanup on mailbox deletion. >

1 0

[patch] Support redis AUTH
by Dave 30 Jun '16

30 Jun '16

A very minor patch to support redis AUTH (for all that's worth) using an extra password= field. I'm not sure if this will be of any value to anyone here. We're testing it in development and "it works for us" but it's yet to be used in anger. Sorry if I'm going about this the wrong way, I tried emailing this directly but heard nothing back; so I'm reposting to the list as I'm honestly not sure what established protocol is regarding code contribution. -- Dave

2 1

filtering ssl_cert
by Russell Stuart 30 Jun '16

30 Jun '16

In dovecot 1 I was able to do something like this: protocol imap { ssl_cert = cert-imap.pem ssl_key = key-imap.pem } local ww.xx.yy.zz { protocol imap { ssl_cert = cert-imap-ww.xx.yy.zz.pem ssl_key = key-imap-ww.xx.yy.zz.pem } } The intent is ww.xx.yy.zz is an externally routable IP address which has a Cert signed by a real CA, other addresses are internal which have a variety of domain names, signed by a self-signed cert. That worked in dovecot 1, but in dovecot 2 I get the error: "Conflict in setting ssl_cert found from filter". Weirdly, this works in dovecot 2: local 0.0.0.0/0 { ssl_cert = cert-imap.pem ssl_key = key-imap.pem } local ww.xx.yy.zz { ssl_cert = cert-imap-ww.xx.yy.zz.pem ssl_key = key-imap-ww.xx.yy.zz.pem } But this doesn't: local 0.0.0.0/0 { protocol imap { ssl_cert = cert-imap.pem ssl_key = key-imap.pem } } local ww.xx.yy.zz { protocol imap { ssl_cert = cert-imap-ww.xx.yy.zz.pem ssl_key = key-imap-ww.xx.yy.zz.pem } } It smells like a bug. Anyway, does anybody know of a way to port my config to dovecot 2?

1 0

External mail attachments storage cleanup
by Николай Мананков 30 Jun '16

30 Jun '16

Hi, I have set up mdbox backend witch saving mail attachments to external files option. Dovecot store attachments to external files but never delete them. Why?

3 4

ltmp, quota and quota grace
by Sylvain Allemand 30 Jun '16

30 Jun '16

Hi, i try to configure quota in dovecot. 1) I test quota with postfix and quota-status : quota is respected but quota grace is ignored... 2) i test quota with Dovecot LMTP : quota (and quota grace) are ignored i can see in log file : Jun 30 11:36:39 mail1 dovecot: lmtp(24424, sallemantest(a)test.fr) Debug: Quota root: name=User quota sallemantest(a)test.fr backend=count args= Jun 30 11:36:39 mail1 dovecot: lmtp(24424, sallemantest(a)test.fr) Debug: Quota rule: root=User quota sallemantest(a)test.fr mailbox=* bytes=1073741824 messages=0 Jun 30 11:36:39 mail1 dovecot: lmtp(24424, sallemantest(a)test.fr) Debug: Quota rule: root=User quota sallemantest(a)test.fr mailbox=Trash bytes=+104857600 messages=0 Jun 30 11:36:39 mail1 dovecot: lmtp(24424, sallemantest(a)test.fr) Debug: Quota grace: root=User quota sallemantest(a)test.fr bytes=107374182 (10%) Jun 30 11:36:39 mail1 dovecot: lmtp(sallemantest(a)test.fr): Debug: replication: Replication requested by 'transaction commit', priority=2 Jun 30 11:36:39 mail1 dovecot: lmtp(sallemantest(a)test.fr): /z7gBifodFdoXwAAs3/TQA: msgid=<fdf98d16-c557-4e15-42a6-ea019a3bae1e(a)math.u-bordeaux.fr>: saved mail to INBOX Jun 30 11:36:39 mail1 dovecot: lmtp(24424): Disconnect from 127.0.0.1: Successful quit my quota : root@mail1:~# doveadm -v quota get -u sallemantest(a)test.fr Quota name Type Value Limit % User quota sallemantest(a)test.fr STORAGE 29 10 290 User quota sallemantest(a)test.fr MESSAGE 11 - 0 my config for lmtp and quota : protocol lmtp { mail_plugins = " acl notify replication quota sieve" userdb { args = /etc/dovecot/dovecot-lmtp-ldap-userdb.conf.ext default_fields = uid=vmail gid=vmail driver = ldap name = } } plugin { quota = count:User quota %u quota_grace = 10%% quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_vsizes = yes } root@mail1:/etc/dovecot# dovecot --version 2.2.24 (a82c823) Help please ! Sylvain ps : sorry for my poor english

1 0

Error when searching in mailfolders
by Christoph Pleger 30 Jun '16

30 Jun '16

Hello, I just found that with my dovecot 2.2.21, when I use squirrelmail to search for something in my mailfolders, that fails with ERROR: Connection dropped by IMAP server. Query: SEARCH CHARSET ISO-8859-1 ALL FROM "someone" That happens for searches in any folder, except from INBOX. When I search in all folders, only results from INBOX are found, then the error message is shown. The log says: imap: Error: terminate called after throwing an instance of 'CLuceneError' imap(christoph): Fatal: master: service(imap): child 2834 killed with signal 6 (core dumps disabled) What can I do about that? Regards Christoph

3 3

SSL Problem with -git master-2.2 tip (24 June 16)
by Reuben Farrelly 30 Jun '16

30 Jun '16

Current master-2.2 branch of Dovecot compiles for me on Gentoo x86_64 but experiences symbol errors when starting up: Jun 24 08:38:00 thunderstorm dovecot: lmtp(8180): Fatal: Couldn't load required plugin /usr/lib64/dovecot/libssl_iostream_openssl.so: dlopen() failed: /usr/lib64/dovecot/libssl_iostream_openssl.so: undefined symbol: SSL_COMP_free_compression_methods Jun 24 08:38:00 thunderstorm dovecot: master: Error: service(lmtp): command startup failed, throttling for 16 secs I suspect that this is because I have libressl installed on my systems instead of OpenSSL. A known commit point which does not work is: f5e6b05684328b9800ccd973c73027300c832d65 However a few commits earlier this problem does not occur: f292589f4b85e02d97d974dfe34324c6c0bb9d9f Looks like commit bff052bd29dbf7175ee6cd14bd14bcea1900b869 : "lib-dcrypt, lib-ssl-iostream: Share OpenSSL init/deinit code." may have broken the tree for LibreSSL/non OpenSSL users. Reuben

2 5