- dovecot - dovecot.org

How to configure read-only access during a migration?
by Jeffrey Tunison 22 Oct '14

22 Oct '14

Hi. I would appreciate your advice about this PROBLEM: ======================================================= Find the simplest way to configure a Dovecot 2.2.10 IMAP server to access existing email users' (mbox-format) mail folders via a master_user ****in read-only mode.**** (I've got the master_user access working.) Simplest because while I'm proficient at UNIX systems administration, I'm under time pressure and dovecot has a lot of configuration flexibility. Identifying the right way to do this is proving time- consuming. Namespaces? ACL's? Passdb's? Mounting the mail-containing file systems in read-only mode did not work. (Would it have worked if I had disabled all file-locking rules (if so, how?)?) I thought it was time to bring in the dovecot wizards. You! GOAL: ======================================================= Without knowing or changing users' passwords, migrate several hundred users of dovecot IMAP to MS Exchange using the commercial product Transend. I'm manging the dovecot side, someone else is doing the Transend/Exchange piece. Migration would occur in batches due to slowness of the Transend side when dealing with users with email collections over a few gigabytes. I have a production IMAP server (dovecot 1.0.13 on 32-bit RHEL 4.9). Let's call it PROD for short. Users INBOXes are stored locally on PROD. Their other mail folders are stored on a second machine and accessed via NFS. Those other folders contain the great majority of the email to be migrated. Let's call the NFS server MIGR for short. On MIGR, I've set up a migration IMAP server (dovecot 2.2.10 on 64-bit RHEL 5.10). MIGR is a dedicated NFS server with newer hardware than PROD. It has an unused Ethernet NIC I can tell Transend to use. Both PROD and MIGR use NIS for authentication. Therefore PAM is consulted for passdb information, normally. No SQL db's used. I set up the second server (MIGR) for several reasons: 1) there are some users mail folders larger than the 32-bit file size limit found on the PROD server. 2) the bulk of the email is stored locally on the MIGR server. 3) the version of dovecot is much newer and therefore more likely to have fewer bugs and more configuration options. 4) I don't want to modify the production environment except where really necessary. Pointing Transend at MIGR instead of PROD seems like it will be faster and better. Telling end-users to use MIGR instead of PROD would allow them to verify that their email came across okay (into MS Exchange) without being able to modify the original copy of email (in Dovecot). In the days and weeks after migration. I'd like to disable access ***for a batch of users*** on the PROD server at the time the migration begins for that batch. I may need to re-enable access on PROD for certain users if the migration does not succeed. Transend has been dying on a number of test users despite tweaking its parameters in consultation with the vendor. "Corrupt" messages seem to be the issue. Users (or sysadmins) might be required to identify and delete the offending messages before we retry their migration. (Which folders and which messages are causing problems will hopefully be discernible in Transend logs.) Ha! If you've read this far, then I'd also say that I welcome any advice on changes to increase performance on MIGR, such as whether trying to minimize indexing as I've done is useful. Current configurations of the two servers follow. =========================================================================== PRODUCTION: =========================================================================== # 1.0.13: /etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot.log protocols: imaps imap listen: *:143 ssl_listen: *:993 ssl_cert_file: /etc/pki/dovecot/certs/dovecot.pem ssl_key_file: /etc/pki/dovecot/private/dovecot.key login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login login_processes_count: 20 login_max_processes_count: 500 max_mail_processes: 1524 first_valid_uid: 100 mail_location: mbox:~/Mail:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot-indexes/%u/ mbox_read_locks: dotlock mbox_write_locks: dotlock mbox_dotlock_change_timeout: 60 mbox_min_index_size: 2048 namespace: type: private separator: / inbox: yes namespace: type: private separator: / prefix: Mail/ hidden: yes namespace: type: private separator: / prefix: ~/Mail/ hidden: yes namespace: type: private separator: / prefix: mail/ hidden: yes namespace: type: private separator: / prefix: ~/mail/ hidden: yes auth default: master_user_separator: * verbose: yes debug: yes debug_passwords: yes passdb: driver: passwd-file args: /etc/dovecot.deny deny: yes passdb: driver: passwd-file args: /etc/dovecot.transend master: yes passdb: driver: shadow passdb: driver: pam userdb: driver: passwd =========================================================================== MIGRATION: =========================================================================== # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-348.18.1.el5 x86_64 Scientific Linux release 5.10 (Boron) auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no first_valid_uid = 100 log_path = /var/log/dovecot.log mail_debug = yes mail_location = mbox:~/Mail:INBOX=/var/spool/concmail/%u:INDEX=MEMORY mbox_min_index_size = 50048 B mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } namespace one { hidden = yes location = prefix = Mail/ separator = / } namespace three { hidden = yes location = prefix = mail/ separator = / } passdb { args = /etc/dovecot/deny-users deny = yes driver = passwd-file } passdb { args = /etc/dovecot/dovecot.transend driver = passwd-file master = yes } passdb { driver = pam } protocols = imap service imap-login { process_min_avail = 15 service_count = 10 } service imap { executable = imap postlogin process_limit = 2048 } service postlogin { executable = script-login -d rawlog } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } deny = yes driver = passwd-file } passdb { args = /etc/dovecot/dovecot.transend driver = passwd-file master = yes } passdb { driver = pam } protocols = imap service imap-login { process_min_avail = 15 service_count = 10 } service imap { executable = imap postlogin process_limit = 2048 } service postlogin { executable = script-login -d rawlog } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } verbose_proctitle = yes protocol imap { mail_max_userip_connections = 1000 }

1 0

dictionary attack defense
by Cliff Hayes 22 Oct '14

22 Oct '14

Does dovecot have any dictionary attack defenses yet? In the past I have had to implement defense from outside dovecot, but since dovecot is at the front lines and therefore is the first to know I'm hoping by now there is something we can set. For example, a limit on access failures per minut/hour/day or some such. If not why not?

4 8

authenticate plain, and virtual users
by Eric Abrahamsen 22 Oct '14

22 Oct '14

I'm running dovecot 2.2.14 on Archlinux. I've been using it with the isync syncing utility for quite some time with no problems, using the LOGIN authentication mechanism. Recently Isync was updated to support PLAIN, and I'm having trouble moving to that. The authenticate string that isync is sending is not the one that dovecot is expecting. I suspect this is because of how I have virtual users set up on my machine. This is a personal laptop, no other users, and so I didn't want to go through the rigmarole of creating more system users just for mail accounts. I also wanted everything stored under my home directory. So my dovecot config looks like this: # 2.2.14: /etc/dovecot/dovecot.conf # OS: Linux 3.16.4-1-ARCH i686 auth_verbose = yes disable_plaintext_auth = no info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log mail_plugins = " fts fts_lucene" passdb { args = username_format=%u /etc/dovecot/passwd driver = passwd-file } plugin { fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@. } protocols = imap ssl = no userdb { args = uid=eric gid=users home=/home/eric/.mail/%d/%n username_format=%u default_fields = mail=maildir:/home/eric/.mail/%d/%n/mail driver = static } My /etc/dovecot/passwd looks like this: eric@ericabrahamsen.net:{PLAIN}password1 eric@paper-republic.org:{PLAIN}password2 When isync tries to log into the local dovecot using PLAIN, it sends the base64-encoded version of this string: eric(a)paper-republic.org\0eric\0password2 With my current dovecot config, telnet experimentation shows that dovecot will accept either of these two: \0eric(a)paper-republic.org\0password2 eric@paper-republic.org\0eric@paper-republic.org\0password2 Ie, either with or without the authorization ID, just like it says at http://wiki2.dovecot.org/Debugging/Authentication Given that I'm unlikely to be able to change how isync sends the string (and that it's really doing the right thing), are there alterations I can make to my dovecot config to get it to accept the authenticate string that isync is sending? Ideally, can I do that without having to set up system users? I've already tried using the other fields in the passwd file, putting "eric" and "eric(a)paper-republic.org" into the UID fields, just in case. No dice. Thanks in advance for any advice! Eric

1 0

Multiple user attributes in LDAP userdb query strings
by BINOTTO Luis SIDOR 21 Oct '14

21 Oct '14

Hello list, I have an issue with dovecot and Ldap... Any help will be grateful... I have my virtual users stored in an Active Directory database. I am using 2 attributes in AD to locate the user account: mail (their primary email address) and proxyAddresses (a multivalue attribute containing their mail aliases). I also control the mount point in which the mail is located with another attribute in AD, in this case I used "pager". I have dovecot 1.2.15 and there are no immediate plans to upgrade it. I configured Dovecot's deliver process in order to integrate sieve capability. I have configured userdb ldap and passdb ldap in Dovecot and have set up master and client sockets. I am using maildir format for directory layout. The problem is to set the variables home and mail that will define the mail location. The format must be like this: home: /Mailboxes/<mount point>/<user login>/ mail: /Mailboxes/<mount point>/<user login>/Maildir So, for a particular user (Login: user1, smtp: user1(a)domain1.com, alias smtp: user1_alias(a)domain1.com) the variables will be: home: /Mailboxes/AdmUsers/user1/ mail: /Mailboxes/AdmUsers/user1/Maildir Active Directory has the values in: mail:(user1@domain1.com), proxyAddresses:(user1_alias@domain1.com), sAMAaccountName(user1). I have defined home and mail in dovecot-ldap.conf. # User attributes are given in LDAP-name=dovecot-internal-name list. The # internal names are: # uid - System UID # gid - System GID # home - Home directory # mail - Mail location # # There are also other special fields which can be returned, see # http://wiki.dovecot.org/UserDatabase/ExtraFields user_attrs = pager=home=/mailboxes/%$/%u,mobile=quota_rule=*:storage=%$M If the mail is sent to the Principal SMTP (user1(a)domain1.com) in which the user part (%u) is the same as sAMAccountName, it works. The variable home is set correctly (home: /Mailboxes/AdmUsers/user1/). The problem is when the mail is sent to the smtp alias, in which the variable home is set incorrectly (home: /Mailboxes/AdmUsers/user1_alias/). There is a way to set two values to user_attrs?, in this case I would need to set pager and sAMAccountName (instead of %u), to it. Thanking you in anticipation... Attached is the out of dovecot -n # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.7 log_path: /var/log/dovecot.log protocols: imap imaps pop3 pop3s disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_uid: 16343 mail_gid: 16343 mail_location: maildir:~/Maildir mail_debug: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): autocreate deleted_to_trash quota imap_quota expire mail_plugins(imap): autocreate deleted_to_trash quota imap_quota expire mail_plugins(pop3): quota expire mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh lda: postmaster_address: postmaster(a)domain1.com mail_plugins: quota expire log_path: /var/log/dovecot.log auth default: mechanisms: gssapi gss-spnego login ntlm plain username_format: %Ln use_winbind: yes passdb: driver: pam userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: autocreate: Deleted Items autocreate: Sent Items autosubscribe: Deleted Items autosubscribe: Sent Items deleted_to_trash_folder: Sent Items quota: maildir:User quota quota_rule: *:storage=100M quota_rule2: Deleted Items:ignore quota_warning: storage=80%% /etc/dovecot/scripts/quota-warning.sh 80 quota_warning2: storage=90%% /etc/dovecot/scripts/quota-warning.sh 90 quota_warning3: storage=99%% /etc/dovecot/scripts/quota-exceeded.sh 100 expire: "Deleted Items" 1 "Deleted Items/*" 1 expire_dict: proxy::expire dict: expire: pgsql:/etc/dovecot/dovecot-dict-expire.conf " Notificacion Automatica: Este mensaje y cualquier archivo que se adjunte contiene informacion privilegiada y confidencial. Es para uso exclusivo del destinatario. Si usted ha recibido esta comunicacion por error, por favor avisenos inmediatamente. Automatic notification: This e-mail and any file transmitted with it are confidential and may be legally privileged. It is intended solely for the addressee and may not be disclosed to or used by anyone other than the addressee. If you have received this e-mail by mistake , please advise the sender immediately"

1 0

Proxy problem: "imap-login: Error: proxy(USERNAME): connect(10.x.x.178, 993) failed: Cannot assign requested address (after 0 secs, local=10.x.x.104)"
by Ralf Hildebrandt 21 Oct '14

21 Oct '14

After fixing the "duplicate compression" problem, we're now encountering "imap-login: Error: proxy(USERNAME): connect(10.x.x.178, 993) failed: Cannot assign requested address (after 0 secs, local=10.x.x.100)" in the logs. We already tried raising the ulimit, the max number of open files. Once we reach about 25k connections, we're getting the error above... for all local addresses. It seems as if the system cannot create any more outgoing connections. We already optimized: ---- snip ---- net.ipv4.tcp_fin_timeout=5 # down from 30s net.ipv4.tcp_tw_reuse=1 net.ipv4.tcp_tw_recycle=1 # http://redis4you.com/articles.php?id=012&name=Redis+high+traffic+connection… net.ipv4.ip_local_port_range=10000 65000 # http://www.fromdual.com/huge-amount-of-time-wait-connections net.ipv4.netfilter.ip_conntrack_max=524288 ---- snip ---- But still we get (once the load is rising beyond some point): # fgrep "Cannot assign requested address" /var/log/dovecot/dovecot.log |awk '{print $NF}' | sort | uniq -c | sort -n 142 local=10.x.x.100) 147 local=10.x.x.107) 148 local=10.x.x.106) 151 local=10.x.x.104) 151 local=10.x.x.109) 152 local=10.x.x.105) 156 local=10.x.x.110) 162 local=10.x.x.102) 165 local=10.x.x.101) 178 local=10.x.x.103) 189 local=10.x.x.108) We're using multiple local addresses when proxying to the backends -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

4 7

only inbox folder after courier-imap migration
by Luciano Gabriel Andino 21 Oct '14

21 Oct '14

Hello, after courier-dovecot-migrate.pl, the only folder appears in webmail menu is "Inbox". The others still are in Maildir "Maildir/.myfolder" and contains its "dovecot-uidlist" and "dovecot-keywords" files. May I need to edit some file? -- Saludos!! Luciano Andino GNU/Linux user #185103 Santa Fe - Argentina -----------------------------------------------

1 0

Dovecot Auth Issue
by Austin Einter 21 Oct '14

21 Oct '14

Dear All I have been able to setup postfix and dovecot. Through command line, I can send mail out. Now I have installed roundcube in mail server side, and I am able to access like https://mydomain/webmail.com Login was failing. Then I debugged and modified settings in dovecot and using PAM for authentication. Now I trying to login to email server. I am not sure if authentication by dovecot and pam is successful. I enabled logging for dovecot. The below logs I get when a user "try" logs in. Oct 21 07:44:55 auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Oct 21 07:44:55 auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Oct 21 07:44:55 auth: Debug: auth client connected (pid=15357) Oct 21 07:44:55 auth: Debug: client in: AUTH 1 PLAIN service=imap secured lip=128.199.214.27 rip=128.199.214.27 lport=993 rport=43323 resp=AHRyeUBsb2FkbXVsdGlwbGllci5jb20AdHJ5MTIz Oct 21 07:44:55 auth-worker: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Oct 21 07:44:55 auth-worker: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Oct 21 07:44:55 auth-worker: Debug: pam(try,128.199.214.27): lookup service=dovecot Oct 21 07:44:55 auth-worker: Debug: pam(try,128.199.214.27): #1/1 style=1 msg=Password: Oct 21 07:44:55 auth: Debug: client out: OK 1 user=try Oct 21 07:44:55 auth: Debug: master in: REQUEST 1571291137 15357 1 b3cc155dfd3bb2fd576bfeeceaf1ce3d Oct 21 07:44:55 auth: Debug: passwd(try,128.199.214.27): lookup *Oct 21 07:44:55 auth: Debug: master out: USER 1571291137 try home=/var/mail/ mail=maildir:/var/mail/try system_groups_user=try uid=5001 gid=5001*Oct 21 07:44:55 imap-login: Info: Login: user=<try>, method=PLAIN, rip=128.199.214.27, lip=128.199.214.27, mpid=15361, TLS *Oct 21 07:44:55 imap(try): Info: Disconnected: Logged out bytes=29/399* >From the logs above (in bold), I hope auth is successful, then in last line why it is logging out.., I am confused , not sure if auth is completely successful or not. Kindly experts please help. Best Regards, Austin

1 0

SMTP authentication setup
by Brian 21 Oct '14

21 Oct '14

At my company we've had a longstanding problem of not being able to send email from devices outside of our internal network and any specific IP address that we open the relay to. As it turns out, SASL has never been set up. I need to set up SASL ASAP but none of the guides I've found seem to work. This is the latest guide I tried: http://wiki2.dovecot.org/HowTo/PostfixAndDovecotSASL I did everything on here minus the last part because it's on the same server. Also, instead of submission inet n - - - - smtpd I did: 127.0.0.1:1025 inet n - - - - smtpd After all is done, however, I'm unable to send any mail. Thunderbird just says sending message but doesn't send and I don't even get an error. I end up having to disable SASL again before I can send mail. Dovecot version 2.0.9 Postfix version 2.6.6 CentOS 6 I have Postfix, Dovecot, and ASSP on the same server. Thanks everyone. -- This email was Virus checked by Astaro Security Gateway. http://www.sophos.com

4 5

90-sieve.conf syntax - moving from v2.0.x to v2.2.x
by deoren 21 Oct '14

21 Oct '14

Hi, I'm currently running version v2.0.x in production (using Maildir storage) and it's been working well. I'm interested in moving to version 2.2.x and am preparing a test server to do so. As I have been merging the conf file changes between the two versions I noticed syntax changes for the 90-sieve.conf file. There are now 'locations' and presumably to keep referring to local content I'll need to use the 'file:' location type. On my production box (v2.0.x) I have 90-sieve.conf configured like so: sieve = /var/vmail/sieve/%d/%n/.dovecot.sieve sieve_default = /var/vmail/sieve/global.sieve sieve_dir = /var/vmail/sieve/%d/%n/sieve_dir Inside of the /var/vmail/sieve/%d/%n/ directory (i.e., /var/vmail/sieve/example.com/testuser/) I find: drwxr-xr-x 3 vmail vmail 64 Oct 19 12:07 . drwxr-xr-x 9 vmail vmail 101 Jun 21 10:47 .. lrwxrwxrwx 1 vmail vmail 25 Jun 21 11:10 .dovecot.sieve -> sieve_dir/roundcube.sieve -rw------- 1 vmail vmail 3694 Oct 19 12:07 .dovecot.svbin drwx------ 3 vmail vmail 38 Oct 19 11:58 sieve_dir and that works well. I look at the current wiki documentation: http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration and I find that the 'seive_dir' conf option is still listed, but the comments for it appear very similar to the comments that precede the 'sieve' conf option in the stock 90-sieve.conf file: # The location of the user's main Sieve script or script storage. The LDA # Sieve plugin uses this to find the active script for Sieve filtering at # delivery. The "include" extension uses this location for retrieving # :personal" scripts. This is also where the ManageSieve service will store # the user's scripts, if supported. Assuming that the 'sieve' and 'sieve_dir' conf settings have not been merged into just 'sieve' (and that I need to use the 'file:' location specifier), is this how I would configure the two settings for Dovecot 2.2.x? sieve = file:/var/vmail/sieve/%d/%n;active=~/.dovecot.sieve sieve_dir = file:/var/vmail/sieve/%d/%n/sieve_dir If the two have been merged, how would I go about configuring the 90-sieve.conf file to get the same results? Thanks for your help.

1 1

Re: last_login plugin with MySQL
by Joseph Tam 21 Oct '14

21 Oct '14

Michael Cramer <michael(a)bigmichi1.de> writes: > anybody knows how this can be achieved with postgresql, because 'ON > DUPLICATE KEY UPDATE' syntax is mysql specific A clear, concise explanation of consistency problems with SQL update-or-insert ("upsert") operation, including a PostgreSQL implementation: http://www.depesz.com/2012/06/10/why-is-upsert-so-complicated/ Joseph Tam <jtam.home(a)gmail.com>

1 0

replication sieve settings
by Martin Schmidt 20 Oct '14

20 Oct '14

Hello, can someone give me a hint, where to find an info, how to setup dovecote replication with sieve? On my active.active setup, it replicates the user mdboxes and sieve works also, on the active destination fileserver. Client changes the sieve, tests work fine. But the sieve file won't get replicated to the replica server. As i've researched, it was introduced in dovecot v2.2.rc3 Is it default, that doveadm replicator replicate '*' includes the sieve and i made a config error? Or is there an option to set for the replication service? On dovecot director server, i've set director in conf.d/20-managesieve.conf service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 4190 } } and added sieve to plugins in conf.d/20-lmtp.conf protocol lmtp { mail_plugins = $mail_plugins sieve } doveconf -n ... director_mail_servers = 192.168.200.10 192.168.200.11 director_servers = 192.168.200.1:9090 192.168.200.2:9090 disable_plaintext_auth = no doveadm_port = 24245 lmtp_proxy = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = " imap lmtp sieve pop3" ... service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 4190 } } ... protocol lmtp { auth_socket_path = director-userdb mail_plugins = " sieve" } ... Thank you Martin Schmidt Germany

1 0

fixes for quota support on NetBSD
by Thomas Klausner 20 Oct '14

20 Oct '14

Hi! dovecot-2.2.13 already has quota support for NetBSD, but it's buggy. The attached patches by Manuel Bouyer <bouyer(a)NetBSD.org> fix the issues. There is one thing that's not nice in them: one include is now for "/usr/include/quota.h" since dovecot comes with its own file "quota.h" which is earlier in the search path. Perhaps dovecot's copy can be renamed to dovecot-quota.h or to some other non-conflicting name? Cheers, Thomas

1 1

2.2.14 Panic in imap_fetch_more()
by Hans Morten Kind 20 Oct '14

20 Oct '14

This panic happens with different users, and it also occured in 2.2.13 Panic: file imap-fetch.c: line 556 (imap_fetch_more): assertion failed: (ctx->client->output_cmd_lock == NULL || ctx->client->output_cmd_lock == cmd) hmk GNU gdb 6.8 Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i386-pc-solaris2.10"... Reading symbols from /datapool/local/dovecot-2.2.14/lib/dovecot/libdovecot-storage.so.0...done. Loaded symbols for /local/dovecot-2.2.14/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /datapool/local/dovecot-2.2.14/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /local/dovecot-2.2.14/lib/dovecot/libdovecot.so.0 Reading symbols from /datapool/local/program/lib/libssl.so.1.0.0...done. Loaded symbols for /local/program/lib/libssl.so.1.0.0 Reading symbols from /datapool/local/program/lib/libcrypto.so.1.0.0...done. Loaded symbols for /local/program/lib/libcrypto.so.1.0.0 Reading symbols from /datapool/local/program/lib/libz.so...done. Loaded symbols for /local/program/lib/libz.so Reading symbols from /lib/libm.so.2...done. Loaded symbols for /lib/libm.so.2 Reading symbols from /datapool/local/program/lib/libiconv.so.2...done. Loaded symbols for /local/program/lib/libiconv.so.2 Reading symbols from /lib/librt.so.1...done. Loaded symbols for /lib/librt.so.1 Reading symbols from /lib/libnsl.so.1...done. Loaded symbols for /lib/libnsl.so.1 Reading symbols from /lib/libsocket.so.1...done. Loaded symbols for /lib/libsocket.so.1 Reading symbols from /lib/libsendfile.so.1...done. Loaded symbols for /lib/libsendfile.so.1 Reading symbols from /lib/libc.so.1...done. Loaded symbols for /lib/libc.so.1 Reading symbols from /lib/libdl.so.1...done. Loaded symbols for /lib/libdl.so.1 Reading symbols from /usr/lib/libz.so...done. Loaded symbols for /usr/lib/libz.so Reading symbols from /lib/libaio.so.1...done. Loaded symbols for /lib/libaio.so.1 Reading symbols from /lib/libmd.so.1...done. Loaded symbols for /lib/libmd.so.1 Reading symbols from /lib/ld.so.1...done. Loaded symbols for /lib/ld.so.1 Core was generated by `dovecot/imap imap-postlogin'. Program terminated with signal 6, Aborted. [New process 79111 ] #0 0xfe7fc8e5 in _lwp_kill () from /lib/libc.so.1 #0 0xfe7fc8e5 in _lwp_kill () from /lib/libc.so.1 No symbol table info available. #1 0xfe7f7765 in thr_kill () from /lib/libc.so.1 No symbol table info available. #2 0xfe7a376f in raise () from /lib/libc.so.1 No symbol table info available. #3 0xfe7829e1 in abort () from /lib/libc.so.1 No symbol table info available. #4 0xfeda13ba in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:152 backtrace = 0x8093560 "0xfeda22d7 -> 0xfeda15d3 -> 0x806d60b -> 0x805d326 -> 0x806aa61 -> 0x80699d2 -> 0x8069cb7 -> 0x8069d15 -> 0x8069e57 -> 0x8069fe0 -> 0xfedba96d -> 0xfedbc0cc -> 0xfedbab06 -> 0xfedbaa5d -> 0xfed41db1 -"... #5 0xfeda22d7 in i_internal_fatal_handler (ctx=0x80479e0, format=0x807f310 "file %s: line %d (%s): assertion failed: (%s)", args=0x8047a04 "\236ó\a\b,\002") at failures.c:152 status = 0 #6 0xfeda15d3 in i_panic (format=0x807f310 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:152 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = 0x8047a04 "\236ó\a\b,\002" #7 0x0806d60b in imap_fetch_more (ctx=0x80c20e0, cmd=0x80c2018) at ../../src/lib/array.h:158 ret = 135365712 __FUNCTION__ = "imap_fetch_more" #8 0x0805d326 in cmd_fetch (cmd=0x80c2018) at cmd-fetch.c:37 client = (struct client *) 0x80b17b8 ctx = (struct imap_fetch_context *) 0x80c20e0 args = (const struct imap_arg *) 0x80c99f0 next_arg = (const struct imap_arg *) 0x80c9a20 list_arg = (const struct imap_arg *) 0x8047a98 search_args = (struct mail_search_args *) 0x0 qresync_args = {qresync_sample_seqset = 0x80c20a8, qresync_sample_uidset = 0x807ee7e} messageset = 0x80c9ab8 "1899" send_vanished = false ret = 1 #9 0x0806aa61 in command_exec (cmd=0x80c2018) at imap-commands.c:101 hook = (const struct command_hook *) 0x809bfd8 ret = 8 #10 0x080699d2 in client_command_input (cmd=0x80c2018) at imap-client.c:130 client = (struct client *) 0x80b17b8 command = (struct command *) 0x3 __FUNCTION__ = "client_command_input" #11 0x08069cb7 in client_command_input (cmd=0x80c2018) at imap-client.c:130 client = (struct client *) 0x80b17b8 command = (struct command *) 0x809d41c __FUNCTION__ = "client_command_input" #12 0x08069d15 in client_handle_next_command (client=0x80b17b8, remove_io_r=0x8047b9d) at imap-client.c:130 No locals. #13 0x08069e57 in client_handle_input (client=0x80b17b8) at imap-client.c:130 _data_stack_cur_id = 3 ret = 10 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #14 0x08069fe0 in client_input (client=0x80b17b8) at imap-client.c:130 cmd = (struct client_command_context *) 0x80aa9ac output = (struct ostream *) 0x80abe10 bytes = 1143 __FUNCTION__ = "client_input" #15 0xfedba96d in io_loop_call_io (io=0x80b7fc8) at ioloop.c:28 ioloop = (struct ioloop *) 0x809bf20 t_id = 2 __FUNCTION__ = "io_loop_call_io" #16 0xfedbc0cc in io_loop_handler_run_internal (ioloop=0x809bf20) at ioloop-poll.c:96 ctx = (struct ioloop_handler_context *) 0x809ca10 pollfd = (struct pollfd *) 0x809e0a8 tv = {tv_sec = 299, tv_usec = 996793} io = (struct io_file *) 0x80b7fc8 msecs = 299997 ret = 0 call = true #17 0xfedbab06 in io_loop_handler_run (ioloop=0x809bf20) at ioloop.c:28 No locals. #18 0xfedbaa5d in io_loop_run (ioloop=0x809bf20) at ioloop.c:28 __FUNCTION__ = "io_loop_run" #19 0xfed41db1 in master_service_run (service=0x809be68, callback=0x80771da <client_connected>) at master-service.c:75 No locals. #20 0x08077577 in main (argc=2, argv=0x809bc78) at main.c:72 set_roots = {0x8092fe0, 0x0} login_set = {auth_socket_path = 0x80930e8 "\2201\t\b\200", postlogin_socket_path = 0x8093120 "UID FETCH UID FETCH UID FETCH", postlogin_timeout_secs = 60, callback = 0x8076f4e <login_client_connected>, failure_callback = 0x807715d <login_client_failed>, request_auth_token = 1} service_flags = MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = -1

1 0

last_login plugin with MySQL
by Luigi Rosa 20 Oct '14

20 Oct '14

Hi, I have a Dovecot test installation with MySQL userbase and authentication where I am trying to setup last_login plugin with SQL dictionary I read http://wiki2.dovecot.org/Plugins/LastLogin and I addes this to my configuration plugin { last_login_dict = sql:/etc/dovecot/dovecot-sql.conf.ext } mail_plugins = $mail_plugins stats protocol imap { mail_plugins = $mail_plugins imap_stats last_login } When I log in with IMAP I get this error: Error: last_login_dict: dict_init(sql:/etc/dovecot/dovecot-sql.conf.ext) failed: Unknown dict module: sql /etc/dovecot/dovecot-sql.conf.ext is the file taht contains the SQL configuration. If I put mysql instead of sql the result is the same: Error: last_login_dict: dict_init(mysql:/etc/dovecot/dovecot-sql.conf.ext) failed: Unknown dict module: mysql The output of doveconf -n follows. Do you have any idea on how to use MySQL for last_login? Ciao, luigi # 2.2.14: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.29.2.el6.x86_64 x86_64 CentOS release 6.5 (Final) auth_cache_negative_ttl = 0 auth_cache_size = 100 k auth_cache_ttl = 8 hours auth_mechanisms = plain login digest-md5 cram-md5 auth_verbose = yes base_dir = /var/run/dovecot/ listen = 127.0.0.1, 10.19.67.253 login_greeting = Ready. login_trusted_networks = 10.xx.xx.0/24, 2001:xxxx:xxxx:xxxx::/64 mail_plugins = " stats" mailbox_list_index = yes maildir_stat_dirs = yes passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { last_login_dict = mysql:/etc/dovecot/dovecot-sql.conf.ext sieve = ~/.dovecot.sieve sieve_dir = ~/sieve stats_refresh = 10s stats_track_cmds = yes } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service stats { fifo_listener stats-mail { mode = 0666 } } ssl_cert = </etc/xxxxx/xxxxxx.luigirosa.com.crt ssl_dh_parameters_length = 2048 ssl_key = </etc/xxxxx/xxxxx.luigirosa.com.key ssl_parameters_regenerate = 202 hours ssl_protocols = !SSLv2 !SSLv3 syslog_facility = local5 userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = sieve } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = " stats imap_stats last_login" } protocol pop3 { pop3_client_workarounds = outlook-no-nuls pop3_uidl_format = %08Xu%08Xv } -- / +--[Luigi Rosa]-- \ Microsoft launches site to help those with H1N1. No help for those with Windows 7 --fark.com

5 16

Re: doveadm-move(1)
by Joseph Tam 19 Oct '14

19 Oct '14

Pascal Volk writes: >> Cut&pasted off the terminal man page output. Looking into >> man1/doveadm-move.1, I see >> >> .B doveadm move \-u jane Archive/2011/09 mailbox INBOX BEFORE \(rs >> .B 2011-10-01 SINCE 01-Sep-2011 >> >> so it's a problem with my nroff, not dovecot's man pages. (Hmm, it >> happens with groff too -- it appears to be some sort of line length bug.) > > Well, there was a problem with non-escaped dashes. But that was fixed 10 > months ago: > http://hg.dovecot.org/dovecot-2.2/diff/8a3d0426f514/doc/man/doveadm-move.1.… Nope, that didn't fix it. > I'm not sure, if that is the reason for the problem. > > Which OS, *roff are you using? Maybe I'm able to reproduce the problem. :-) It's Solaris10 nroff, and GNU groff 1.19.1. Ancient stuff so I wouldn't spend too much time looking at it. It's weird that two independent software implementations would do the same thing. Joseph Tam <jtam.home(a)gmail.com>

2 1

Fwd: Re: Wiki advice on running getmail on INBOX access - how does that work?
by c128 mail 19 Oct '14

19 Oct '14

Just re-tried this, and it doesn't seem to fire getmail on access for me. My incrontab is as follows: /home/user/Maildir/cur/ IN_ALL_EVENTS,IN_ONESHOT /home/user/bin/mvmail.sh The incrontab rule does work, but only if I make a physical change in /home/user/Maildir/cur/ e.g. by moving a mail from another folder in there. Just accessing the particular inbox doesn't seem to trigger anything. On 18/10/14 19:54, c128 mail wrote: > Yeah, I see what you mean - it should trigger by IN_ACCESS (from > IN_ALL_EVENTS) shouldn't it. I hadn't previously scanned over the full > set of events: > http://manpages.ubuntu.com/manpages/intrepid/man5/incrontab.5.html > > I'll set this up again and report back one way or another. > > Thanks. > > On 18/10/14 19:50, Gedalya wrote: >> On 10/18/2014 02:38 PM, c128 mail wrote: >>> > What exactly did happen? >>> >>> Oh, yeah, didn't make that clear ;-) >>> >>> Nothing happened...not without coaxing. >>> >>> If I forced a change to the directory, then it worked - but there >>> wouldn't be a change to the directory in normal operation, other than >>> by mail population? >> It's not supposed to require changes. Note the IN_ALL_EVENTS definition. >> This would include any attempt to open the directory and take a peek. >> If you configured it according to the wiki and it's not working then we >> have troubleshooting to do, but that's the theory. >> I'm not familiar with incron but I've worked with Linux's inotify. >> >>> >>> On 18/10/14 19:28, Gedalya wrote: >>>> On 10/18/2014 01:24 PM, c128 mail wrote: >>>>> Hi, >>>>> >>>>> I'm currently running getmail in a cron job every 2 minutes, so I was >>>>> quite intrigued by this on the wiki: >>>>> >>>>> http://wiki2.dovecot.org/HowTo/TriggerGetmailOnIMAPAccess >>>>> >>>>> Thing is - I couldn't see how it would work and, when I tried it, it >>>>> didn't work (at least not for me). >>>> What exactly did happen? >>>> >>>>> >>>>> It details using incrontab to monitor /home/username/.maildir/cur in >>>>> order to trigger getmail. >>>>> >>>>> However, "cur" won't change unless populated with mail...as an initial >>>>> result of actually running getmail? Seems like a chicken and egg >>>>> situation. >>>> access != change >>>> >>>>> >>>>> I reckon I'm missing something fundamental :-), but what is it? >>>>> >>>>> Ta. >>>> >>

3 7

sieve folder separator
by Thomas Koch 19 Oct '14

19 Oct '14

Hi, I'm moving from one email provider (me) to another (mailbox.org) and observed that the new provider uses "/" instead of "." as a folder separator. Now I need to adapt my sieve script. It's not too much work and I can even just define a variable at the beginning of my script: set "SEP" "/" But it would be great, if SIEVE would come with a predefined constant for the folder separator. Or does this already exists and I didn't find it? Thank you, Thomas Koch

2 1

Wiki advice on running getmail on INBOX access - how does that work?
by c128 mail 18 Oct '14

18 Oct '14

Hi, I'm currently running getmail in a cron job every 2 minutes, so I was quite intrigued by this on the wiki: http://wiki2.dovecot.org/HowTo/TriggerGetmailOnIMAPAccess Thing is - I couldn't see how it would work and, when I tried it, it didn't work (at least not for me). It details using incrontab to monitor /home/username/.maildir/cur in order to trigger getmail. However, "cur" won't change unless populated with mail...as an initial result of actually running getmail? Seems like a chicken and egg situation. I reckon I'm missing something fundamental :-), but what is it? Ta.

2 4

Recap: last_login plugin with MySQL
by Luigi Rosa 18 Oct '14

18 Oct '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 With many thanks to Gedalya and Sven Hartge Situation: Dovecot installation with userbase in a MySQL table with the same structure described in Postfix.Admin installation; filesystem permission is flat with a single user (vmail) who owns maildir mailbox files and directories. Procedure to implement last-login plugin to update mailbox table. The lastlogin value is an integer in time() format Alter mailbox SQL table to add a `lastlogin` unsigned int field Add this to 10-master.conf service dict { unix_listener dict { mode = 0660 user = vmail } } In 90-plugin.conf add this: plugin { last_login_dict = proxy::lastlogin last_login_key = last-login/%u # default } dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } Enable last login for IMAP and POP3: protocol imap { mail_plugins = $mail_plugins last_login } protocol pop3 { mail_plugins = $mail_plugins last_login } Finally edit dovecot-dict-sql.conf.ext and add this lines: connect = {same values as dovecot-sql.conf.ext} map { pattern = shared/last-login/$user table = mailbox username_field = username value_field = lastlogin fields { username = $user } } Ciao, luigi - -- / +--[Luigi Rosa]-- \ After things have gone from bad to worse, the cycle will repeat itself. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJUQp/PAAoJEO5WT/qgw4yKLscP/1ysmNOP23fQeqN2I7gxfhKp 4TF0Buf0rxKjxzjE5jcw4T/vDKhdjj2uaYtpUkE188l+tmGdeQ55ENyXEml/Svvw eEs9Kc2UJTlSQpQFpspUezvOtPwgb0L3720rCqs61BshGFgpZsiUEpPW8mHeVoo1 j5zmo9TVdrSPr8XqLzoR+fdIamZRzZH2pLA9x9cgzsVMmqSlMm4Xv3f/JMloNs98 fwWo13Ji5uFCRbbMmNUDCDOpd4wPYZ7ASS64Jf9nR4DZ75fnQmRgvsbl3EWicrqT 94Z4hlSEkOYWxDzooFta37+Sp61IjQWkWFiM+0260Q5u8IArpatW+tT2eD3jzaxP Gu0HB8jg+bT9cXXtfo1HyA+JYswEtwKiUvUKa/09j6oDGgBD2KR1yhDJNsZsJXkB bEKsACdSztEvfe9j91AzW8S/W3Uk5c7l9RH1CXVNTCbQXaeagScAguh94KKP0oiW P43mBkuFg2mM+5+bXz0U8EYfswt/zYkp/pKFajEwyXIWdeUICPmFJA+GKpBXeJPn CL8nJCnUpKNsy85+Z6MXYXIv6a0D0utocdsQzR8gjG2whNnv7EFeHa2hyagKfG5g ydOSG6tKlWHCOSFaTogmUVZVXEGsE1gUmJZMeoyZVI5jEl3b3KJSTxB7QHtMsm5q NOyZ+PdNJtyDC8n4T48t =MJj6 -----END PGP SIGNATURE-----

1 0

[Dovecot] Disk Encryption
by Simon Brereton 17 Oct '14

17 Oct '14

Hi As I understand it email headers need to be unencrypted (otherwise DKIM doesn't work). From the MUA to either Postfix, or Dovecot the connection is (or can/should be) secured with TLS/SSL. What I would like to know is if it is possible to encrypt the mailstore? Postfix is using Dovecot for delivery so it's only Dovecot that would need to encrypt/decrypt the mailstore. Is this possible? Is there a terrible reason to do it even if it is possible? I realise that from MTA to MTA there's no guarantee of encryption (and in fact it's very unlikely unless keys have been exchanged), but my primary goal is supplement the physical security of the mail store of mails we already have or have sent. Mostly just idle curiosity as to what has been done, or what could be done. What is worth doing is a separate thread entirely. Thanks. Simon

11 28

High memory usage
by Hanna Ruotsalainen 17 Oct '14

17 Oct '14

Hi I recently (about 2 weeks ago) moved over my users over to a new version of dovecot (2.0.9) and now the memory usage on the new server seems much higher than it was before. The new server is a CentOS 6 VM with 4 GB of RAM and 4 CPUs and according to top, it's used up all of the RAM and all of the Swap. Here's a sample of the output from top (sorted by allocated memory). top - 10:42:36 up 22 days, 21:57, 1 user, load average: 1.04, 1.40, 1.52 Tasks: 1643 total, 1 running, 1642 sleeping, 0 stopped, 0 zombie Cpu(s): 0.7%us, 0.7%sy, 0.0%ni, 93.3%id, 5.1%wa, 0.0%hi, 0.1%si, 0.0%st Mem: 3924432k total, 3779236k used, 145196k free, 23740k buffers Swap: 4063228k total, 3181164k used, 882064k free, 156420k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 16738 root 20 0 399m 182m 436 S 0.0 4.8 5:50.58 config 18790 dovenull 20 0 54528 11m 2036 S 0.0 0.3 0:00.05 imap-login 22277 dovenull 20 0 54528 11m 2156 S 0.0 0.3 0:00.04 imap-login 22796 dovenull 20 0 54528 11m 2140 S 0.0 0.3 0:00.03 imap-login 22749 dovenull 20 0 54528 11m 2148 S 0.0 0.3 0:00.03 imap-login 22825 dovenull 20 0 54528 11m 2156 S 0.0 0.3 0:00.03 imap-login This is with 1015 imap processes and 484 imap-login processes. The old version was 1.0.rc15 and running on a CentOS 4 box with 2GB of RAM. It was overloaded but the RAM usage wasn't maxed out like this one is (not much swap usage and a large amount of cached memory). Is this amount of memory usage normal? What could be causing it, if it isn't? Thanks for your help, Hanna Here is the output of dovecot -n: # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.29.2.el6.x86_64 x86_64 CentOS release 6.5 (Final) nfs auth_verbose = yes disable_plaintext_auth = no listen = * login_greeting = Ready. mail_debug = yes mail_location = maildir:/mail/%1Lu/%u:INDEX=/var/cache/dovecot/indexes/%1Lu/%u mail_plugins = " mail_log notify" maildir_very_dirty_syncs = yes mbox_lazy_writes = no namespace { inbox = yes location = prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap-pass.conf driver = ldap } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size } protocols = imap pop3 service anvil { client_limit = 1250 } service auth { client_limit = 4300 user = root } service imap-login { process_limit = 600 service_count = 1 } service imap { process_limit = 1536 } service pop3-login { process_limit = 600 service_count = 1 } service pop3 { process_limit = 1536 } ssl_ca = </etc/pki/tls/certs/ca-bundle.crt ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-ldap-user.conf driver = ldap } version_ignore = yes protocol imap { mail_max_userip_connections = 10 ssl_cert = </etc/pki/dovecot/certs/imap.ecuad.ca.pem ssl_key = </etc/pki/dovecot/private/imap.ecuad.ca.pem } protocol pop3 { pop3_uidl_format = %08Xv%08Xu ssl_cert = </etc/pki/dovecot/certs/pop.ecuad.ca.pem ssl_key = </etc/pki/dovecot/private/pop.ecuad.ca.pem } protocol lda { postmaster_address = _postmaster(a)example.com_ } -- Hanna Ruotsalainen Coordinator of Information Applications, IT Services | tel 604 844 3875 local 3875 emily carr university of art + design <http://www.ecuad.ca> | 1399 Johnston Street, Vancouver BC V6H 3R9

1 0

replicating (manage)sieve - no symlink on replica?
by Philipp 17 Oct '14

17 Oct '14

2.2.13/0.4.2, both from source-tarball, no fancy options. tcp-replication between two nodes and following plugin parameters (same on both sides, except the ip-addr) plugin { sieve_before = /home/ssfn/etc/dovecot/sieve.default sieve_global_dir = /home/ssfn/etc/dovecot sieve = ~/.dovecot.sieve sieve_dir = ~/.sieve sieve_extensions = +vnd.dovecot.duplicate sieve_duplicate_period = 6h mail_replica = tcp:10.66.50.15:9993 } mail_location = sdbox:/home/ssfn/var/mail/boxes/%n mail_home = /home/ssfn/var/mail/boxes/%n Testbed: user getting first email delivered, the subdir %n/.sieve/tmp is automatically created as expected. User logs into managesieve on node1 and uploads a script. The %n/.sieve/managesieve.sieve and the symlink .dovecot.sieve -> .sieve/managesieve.sieve is created as expected. One node2 (via replica) happens: automatically create %n/.sieve/tmp automatically create/sync %n/.sieve/managesieve.sieve just NOT the symlink .dovecot.sieve -> .sieve/managesieve.sieve Logfiles for lmtp,doveadm,dsync-local dont indicate an error why it could not create the link or such, to me it looks like it wouldnt even try. mail-syncing works flawlessly (for delivery, just read about the expunge .. hum.) I tried to force a full-resync via doveadm replicator afterwards, to no change on the matter. Any input? Log from node2 after the moment managesieve saves everything correctly on node1: Sep 11 15:20:12 doveadm(10.66.30.15,ssfntest): Debug: auth input: user=ssfntest Sep 11 15:20:12 doveadm(10.66.30.15,ssfntest): Debug: auth input: ssfntest Sep 11 15:20:12 doveadm(10.66.30.15,ssfntest): Debug: Added userdb setting: plugin/=yes Sep 11 15:20:12 doveadm(10.66.30.15,ssfntest): Debug: Effective uid=993, gid=993, home=/home/ssfn/var/mail/boxes/ssfntest Sep 11 15:20:12 doveadm(10.66.30.15,ssfntest): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:/home/ssfn/var/mail/boxes/ssfntest:INDEX=/home/ssfn/var/mail/index/ssfntest:ALT=/home/ssfn/var/mail/alternate/ssfntest Sep 11 15:20:12 doveadm(10.66.30.15,ssfntest): Debug: fs: root=/home/ssfn/var/mail/boxes/ssfntest, index=/home/ssfn/var/mail/index/ssfntest, indexpvt=, control=, inbox=, alt=/home/ssfn/var/mail/alternate/ssfntest Sep 11 15:20:12 dsync-server(ssfntest): Debug: Namespace : Using permissions from /home/ssfn/var/mail/boxes/ssfntest: mode=0700 gid=default Sep 11 15:20:12 dsync-server(ssfntest): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Sep 11 15:20:12 dsync-server(ssfntest): Debug: sieve: Pigeonhole version 0.4.2 initializing Sep 11 15:20:12 dsync-server(ssfntest): Debug: sieve-storage: using active sieve script path: /home/ssfn/var/mail/boxes/ssfntest/.dovecot.sieve Sep 11 15:20:12 dsync-server(ssfntest): Debug: sieve-storage: using sieve script storage directory: /home/ssfn/var/mail/boxes/ssfntest/.sieve Sep 11 15:20:12 dsync-server(ssfntest): Debug: sieve-storage: permission lookup failed from /home/ssfn/var/mail/boxes/ssfntest/.sieve Sep 11 15:20:12 dsync-server(ssfntest): Debug: sieve-storage: created storage directory /home/ssfn/var/mail/boxes/ssfntest/.sieve/tmp Sep 11 15:20:12 dsync-server(ssfntest): Debug: sieve-storage: relative path to sieve storage in active link: .sieve/ Sep 11 15:20:12 dsync-server(ssfntest): Debug: sieve: script file /home/ssfn/var/mail/boxes/ssfntest/.sieve/managesieve.sieve not found Sep 11 15:20:12 dsync-server(ssfntest): Debug: doveadm-sieve: Value missing for key `vendor/vendor.dovecot/pvt/server/sieve/files/managesieve' (last change: 1970-01-01 01:00:00) Sep 11 15:20:13 dsync-server(ssfntest): Debug: doveadm-sieve: Assigned value for key `vendor/vendor.dovecot/pvt/server/sieve/files/managesieve' FS tree node2 after that: [..boxes]# find ssfntest -ls|grep -v mailb 24442 4 drwx------ 4 ssfnimp dlagimp 4096 Sep 11 15:20 ssfntest 21048 4 drwx------ 3 ssfnimp dlagimp 4096 Sep 11 15:20 ssfntest/.sieve 21052 4 drwx------ 2 ssfnimp dlagimp 4096 Sep 11 15:20 ssfntest/.sieve/tmp 21056 4 -rw------- 1 ssfnimp dlagimp 69 Sep 11 15:20 ssfntest/.sieve/managesieve.sieve 21016 0 lrwxrwxrwx 1 ssfnimp dlagimp 38 Sep 11 15:05 ssfntest/dbox-alt-root -> /home/dlag/var/mail/alternate/ssfntest FS tree node1 "before": [..boxes]# find ssfntest -ls|grep -v mailb 1835841 4 drwx------ 4 ssfnimp ssfnimp 4096 Sep 11 15:20 ssfntest 1835861 0 lrwxrwxrwx 1 ssfnimp ssfnimp 24 Sep 11 15:05 ssfntest/.dovecot.sieve -> .sieve/managesieve.sieve 1835854 4 -rw------- 1 ssfnimp ssfnimp 8 Sep 11 15:05 ssfntest/dovecot-uidvalidity 1835856 4 drwx------ 3 ssfnimp ssfnimp 4096 Sep 11 15:20 ssfntest/.sieve 1835857 4 drwx------ 2 ssfnimp ssfnimp 4096 Sep 11 15:20 ssfntest/.sieve/tmp 1835860 4 -rw------- 1 ssfnimp ssfnimp 69 Sep 11 15:20 ssfntest/.sieve/managesieve.sieve 1835846 0 lrwxrwxrwx 1 ssfnimp ssfnimp 38 Sep 11 15:05 ssfntest/dbox-alt-root -> /home/ssfn/var/mail/alternate/ssfntest

3 2

Re: Unable to get virtual users set up with database auth
by Gedalya 17 Oct '14

17 Oct '14

When you reply, try to make sure you reply to the list (dovecot(a)dovecot.org) in Thunderbird you should have a Reply List button, or just use reply to all. btw I meant: the output of the 'dovecot -n' command, sorry :D OK so, first of all, lda doesn't do any passdb lookup at all, only userdb. It doesn't have any password to check. Just as a comment, your password query could just as well be: password_query = SELECT uPass as password FROM users WHERE uName = '%n' AND uDomain = '%d' auth_username_format = %Lu -- which I believe is set by default, would lowercase the username for you on the way in from the client, so if all your usernames are meant to be purely lowercase, there is no need to return these fields from the database. Set it explicitly just to be sure. You're using a somewhat old version, I'm not sure how it was back then. Either way, this shouldn't be affecting lda. Now, this seems to be wrong. mail_location = mbox:/var/spool/mail/%u:INBOX=/var/spool/mail/%u You probably want it more like: mbox:~/mail:INBOX=/var/spool/mail/%u The first value, ~/mail, will be a /mail directory under the 'home' directory set in your static userdb, and that's where mailboxes (folders) other than INBOX will be stored. It must be a directory, not a file! I'm a little confused about some of the other details in your log. Let's try to correct your mail_location first and see where that takes us. Also, under namespace, you might as well comment out the 'location = ' and 'prefix = ' lines, though I'm not sure it matters. On 10/16/2014 12:51 PM, Cliff Hayes wrote: > Here it is: > > [root@avalon dovecot]# dovecot -n output > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-431.29.2.el6.x86_64 x86_64 Scientific Linux release > 6.5 (Carbon) ext4 > auth_debug = yes > auth_debug_passwords = yes > auth_verbose = yes > auth_verbose_passwords = plain > first_valid_uid = 496 > mail_access_groups = mail > mail_debug = yes > mail_location = mbox:/var/spool/mail/%u:INBOX=/var/spool/mail/%u > mbox_write_locks = fcntl > namespace { > hidden = no > inbox = yes > list = yes > location = > prefix = > separator = . > subscriptions = yes > type = private > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > protocols = imap > ssl_ca = </etc/pki/dovecot/certs/intermediate.crt > ssl_cert = </etc/pki/dovecot/certs/avalon20140929.crt > ssl_key = </etc/pki/dovecot/private/avalon20140929.key > userdb { > args = uid=497 gid=12 home=/var/email/%u > driver = static > } > verbose_ssl = yes > protocol imap { > imap_id_log = * > } > > [root@avalon dovecot]# cat dovecot-sql.conf.ext > > driver = mysql > > default_pass_scheme = PLAIN > > connect = host=localhost dbname=email user=blah password=blah > > password_query = SELECT uName as user, uNameDomain as username, > uDomain as domain, uPass as password FROM users WHERE uName = '%n' AND > uDomain = '%d' > > > > > On 10/16/2014 11:24 AM, Gedalya wrote: >> On 10/16/2014 12:19 PM, Cliff Hayes wrote: >>> well i don't want to use system users. but how do I assign a UID and >>> GID to virtual users to eliminate the permissions errors? >>> >> For dovecot, it is like this: >> http://wiki2.dovecot.org/AuthDatabase/SQL#User_database_lookups >> >> I don't know if this would be OK with your sendmail side. >> >> You should really post your complete dovecot config (dovecot -n output + >> any ".ext" files) so that we can get a better picture. >>

2 1

ssd for /home
by Luciano Gabriel Andino 16 Oct '14

16 Oct '14

Hi, I am thinking to change sata disk for /home and I want to know if change to a SSD hd, is a good option. I have 30-40 accounts with 30-50K email in boxes. -- Saludos!! Luciano Andino GNU/Linux user #185103 Santa Fe - Argentina -----------------------------------------------

4 3

dsync duplicating identical messages
by Bruno Viaris 16 Oct '14

16 Oct '14

Dear list, I’m trying to setup dovecot/postfix/getmail for a single user application: I have 3 email accounts and 2 main computers (home and work). I want to have an imap server on each machine with sync/replication so that read/reply/delete status and sorting into folders are identical. This part is achieved via dsync and seems to work. Messages are fetched from my ISPs with getmail on both machines. The problem I have is that dsync does not see that a message already fetched on both sides is identical, and duplicates it. I use sdbox (because I like the compression option and the separate storage of attachments). The content of the messages (headers and body) are identical, but the sdbox files have differences in the header and/or trailer. In fact, for each incoming message, I get 4 slightly different files (2 on each machine). Do you know where I could find documentation on how dsync compares messages, and also on sdbox file format ? If you explain me that there is no way to prevent this duplication and that anyway dsync does the right thing, I will probably use getmail only on one machine and let dsync propagate the messages to the other site, but I will miss the redundancy (and some speed) of my wished setup... Thanks -- Bruno P.S. : Background: Home has DSL with 10 MBit/s down and 1 MBit/s up, and full control over NAT / firewall Work internet access is limited by the 100 MBit LAN and has strict firewall and complicated VPN. So it is not easy for my home email client to access the imap server of my work machine, and it is slow for my work email client to access my home imap server. I don’t trust any company for archiving my emails.

2 1