- dovecot - dovecot.org

[Dovecot] mmap in GFS2 on rhel 6.1
by Aliet Santiesteban Sifontes 13 Jun '11

13 Jun '11

Hello list, we continue our tests using Dovecot on a RHEL 6.1 Cluster Backend with GFS2, also we are using dovecot as a Director for user node persistence, everything was ok until we started stress testing the solution with imaptest, we had many deadlocks, cluster filesystems corruptions and hangs, specially in index filesystem, we have configured the backend as if they were on a NFS like setup but this seems not to work at least on GFS2 on rhel 6.1. We have a two node cluster sharing two GFS2 filesystem - Index GFS2 filesystem to store users indexes - Mailbox data on a GFS2 filesystem The specific configs for NFS or cluster filesystem we used: mmap_disable = yes mail_fsync = always mail_nfs_storage = yes mail_nfs_index = yes fsync_disable=no lock_method = fcntl mail location : mail_location = mdbox:/var/vmail/%d/%3n/%n/mdbox:INDEX=/var/indexes/%d/%3n/%n But this seems not to work for GFS2 even doing user node persistence, maillog is plagged of errors and GFS2 hangs on stress testing with imaptest, many corrupted index for example, transaction logs etc, at this point we have many questions, first mmap... In Redhat GFS2 docs we read: Gold rules for performance: An inode is used in a read only fashion across all nodes An inode is written or modified from a single node only. We have succesfull archived this using dovecot director Now, for mmap rh says: ... If you mmap() a file on GFS2 with a read/write mapping, but only read from it, this only counts as a read. On GFS though, it counts as a write, so GFS2 is much more scalable with mmap() I/O... But in our config we are using mmap_disable=yes, do we have to use mmap_disable=no with GFS2??? Also, how dovecot manage the cache flush on GFS2 filesystem??? Why, if we are doing user node persistence, dovecot indexes gets corrupted??? What lock method do we have to use?? How fsync should be used?? We know we have many questions, but this is really a very complex stuff and we are going to appreciate any help you can give us. Thank you all for a great work, specially Timo... best regards

3 3

[Dovecot] Unable to compile --with-mysql on Solaris
by Jesse Reynolds 13 Jun '11

13 Jun '11

Hello I'm hoping someone can give me a pointer as to how to compile Dovecot with MySQL support on Solaris. I am trying to compile dovecot 2.0.13 (also tried 2.0.9) on Solaris (OpenSolaris 2009-06, snv_111b) with the OpenSolaris provided MySQL 5.1.30 under /usr/mysql. The server is a Sun X2100 M2, which has a dual core AMD Opteron processor (amd64). Running "./configure --with-mysql" stops here: ... checking for mysql_config... mysql_config checking for mysql_init in -lmysqlclient... no configure: error: Can't build with MySQL support: libmysqlclient not found the libmysqlclient.so is to be found here: /usr/mysql/5.1/lib/mysql/ or for the amd64 version: /usr/mysql/5.1/lib/amd64/mysql/ And include is at: /usr/mysql/5.1/include/ I have tried various combinations of things in CFLAGS, CPPFLAGS and LDFLAGS, but it doesn't change the configure error above at all. Eg: export CPPFLAGS="-I/usr/mysql/5.1/include/mysql" export CFLAGS="-I/usr/mysql/5.1/include/mysql" export LDFLAGS="-R/usr/mysql/5.1/lib/amd64/mysql -L/usr/mysql/5.1/lib/amd64/mysql" ./configure --prefix=/opt/dovecot --with-ldap --with-mysql Looking at config.log this section seems relevant: configure:22993: checking for mysql_config configure:23009: found /usr/mysql/bin/mysql_config configure:23021: result: mysql_config configure:23055: checking for mysql_init in -lmysqlclient configure:23080: gcc -o conftest -std=gnu99 -I/usr/mysql/5.1/include/mysql -Wall -W -Wmissing-prototypes -Wmissin g-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -I/usr/mysql/5.1/include/mysql -R /usr/mysql/5.1/lib/amd64/mysql -L/usr/mysql/5.1/lib/amd64/mysql conftest.c -lmysqlclient -lnsl -lsocket -lrt -l sendfile -L/opt/SUNWspro/lib -lCrun -lrt -L/usr/mysql/5.1/lib/mysql -R/usr/mysql/5.1/lib/mysql -lmysqlclient -lz -lgen -lsocket -lnsl -lm -lz -lm >&5 ld: fatal: library -lCrun: not found ld: fatal: file processing errors. No output written to conftest collect2: ld returned 1 exit status configure:23080: $? = 1 configure: failed program was: | /* confdefs.h */ ...snip... configure:23089: result: no configure:23198: error: Can't build with MySQL support: libmysqlclient not found Note, I have not installed the Sun C compiler, so am compiling with gcc (/usr/bin/gcc 3.4.3). gmake is at /usr/bin/gmake and sun make is at /usr/bin/make. Perhaps I would more more luck with Sun's C compiler? Thank you Jesse -- Jesse Reynolds Carbon Planet Limited - http://www.carbonplanet.com/ Virtual Artists Pty Ltd - http://www.va.com.au/

1 1

[Dovecot] thunderbird not receiving new incoming mail: Timeout while waiting for lock for transaction log file
by Noah Garrett Wallach 12 Jun '11

12 Jun '11

Hi there, I am running dovecot 1.0.10 and thunderbird 3.1.10 for OSX 10.6.7 and I am finding that new imap mail is not coming into my INBOX folder on thunderbird. there is an error message "Timeout while waiting for lock for transaction log file" in the syslog here is my INBOX .imap dir ~/mail/.imap/INBOX$ ls -l total 75100K -rw------- 1 blah blah 1462024 Jun 11 20:17 dovecot.index -rw------- 1 blah blah 75153408 Jun 11 20:17 dovecot.index.cache -rw------- 1 blah blah 1464 Jun 11 20:17 dovecot.index.log -rw------- 1 blah blah 195812 Jun 11 17:23 dovecot.index.log.2 what is the best way to troubleshoot this problem? what else can I look at? Cheers, Noah

3 2

Re: [Dovecot] postfix dovecot spamassassin question
by Dhaval Patel 12 Jun '11

12 Jun '11

So I setup amavis-new and configured postfix/spamassassin/amavis. Mail is still delivered properly but I do not see the spamassassin info in the headers of the email. I configured amavis-new and set "sa_tag_level_deflt" to -999 so that it would always show up but no luck. I updated the spamassassin config and enabled it. I also tested spamassassin manually running "spamassassin -t < someemail" and that returns the email with the X-Spam in the headers. If this is not the correct place to ask, I apologize. Please direct me where I can find the answer. Thanks, Dhaval Simone Caruso <info(a)simonecaruso.com> wrote: >On 11/06/2011 18:53, Dhaval Patel wrote: >> I have an old server with postfix -> maildrop -> spamassassin -> courier setup. >> I am installing a new server and would like to use dovecot instead of courier. >> Currently I have postfix -> dovecot lda -> dovecot setup and emails are >> delivered as expected. The problem is that I do not know how to get spamassassin >> integrated into the mix since I am using the dovecot lda rather than maildrop. > >The simplest, and maybe fastest, is to use amavis-new as postfix contentfilter. > > >-- >Simone Caruso >IT Consultant >+39 349 65 90 805 >p.iva: 03045250838

2 1

[Dovecot] postfix dovecot spamassassin question
by Dhaval Patel 11 Jun '11

11 Jun '11

I have an old server with postfix -> maildrop -> spamassassin -> courier setup. I am installing a new server and would like to use dovecot instead of courier. Currently I have postfix -> dovecot lda -> dovecot setup and emails are delivered as expected. The problem is that I do not know how to get spamassassin integrated into the mix since I am using the dovecot lda rather than maildrop. I would rather keep things as simple as possible and not use maildrop + sendmail just to use spamassasin but will if I have to. So my question to the list is, how do you recommend me doing this? Are there any documentation, howtos or tutorials which can help me configure this? Below is the output of dovecot -n Thanks, Dhaval ------------dovecot -n--------------- # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686-bigmem i686 Debian 6.0.1 xfs log_timestamp: %Y-%m-%d %H:%M:%S ssl_cert_file: /etc/ssl/certs/secure.consoe.com.pem ssl_key_file: /etc/ssl/certs/secure.consoe.com.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail mail_location: maildir:/home/vmail/%u mbox_write_locks: fcntl dotlock namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes lda: postmaster_address: postmaster(a)patel.sh auth_socket_path: /var/run/dovecot/auth-master log_path: /home/vmail/dovecot-deliver.log mail_plugins: sieve global_script_path: /home/vmail/globalsieverc auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail

2 1

[Dovecot] migration scenario
by Alexandre Chapellon 10 Jun '11

10 Jun '11

Hello, I'd like to know if anybody have an experience with migrating mailboxes from mirapoint mail system to dovecot? If so how was it done and what were the difficulties? regards.

2 1

[Dovecot] Sub-Subfolder from public folders
by Torsten Harenberg 10 Jun '11

10 Jun '11

Dear all, I just moved from an old cyrus instance to a brand new dovecot installation. Everything worked pretty well so far. The only small problem I have is: we have public folders, so I defined namespace { type = public separator = . prefix = public. location = maildir:/var/mail/public:INDEX=%u/public subscriptions = no list = children } And I define ACLs for the folders inside. This works, but the some of these folders have sub-folders and these cannot be seen by (what I have tested is Apple Mail, Thunderbird, Outlook and squirrelmail). File system looks like this: mail# cd /var/mail/public/.icecube-c mail# ls -l .ice* .icecube-hard: total 232 drwxrwxrwx 2 root wheel 512 Jun 9 13:07 cur -rwxrwxrwx 1 root wheel 167 Jun 9 13:07 dovecot-keywords -rwxrwxrwx 1 root wheel 105179 Jun 9 13:07 dovecot-uidlist drwxrwxrwx 2 root wheel 123904 Jun 9 13:07 new drwxrwxrwx 2 root wheel 512 Jun 9 13:07 tmp .icecube-soft: total 2214 drwxrwxrwx 2 root wheel 512 Jun 9 13:06 cur -rwxrwxrwx 1 root wheel 167 Jun 9 13:07 dovecot-keywords -rwxrwxrwx 1 root wheel 1019250 Jun 9 13:07 dovecot-uidlist -rwxrwxrwx 1 root wheel 0 Jun 9 13:06 maildirfolder drwxrwxrwx 2 root wheel 1195008 Jun 9 13:07 new drwxrwxrwx 2 root wheel 512 Jun 9 13:07 tmp mail# ls .icecube-hard .icecube-soft cur dovecot-acl dovecot-keywords dovecot-uidlist new subscriptions tmp Maybe anybody can help with this? Full dovecot -n attached. Thanks again and best regards, Torsten -- <><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><> <> <> <> Dr. Torsten Harenberg harenberg(a)physik.uni-wuppertal.de <> <> Bergische Universitaet <> <> FB C - Physik Tel.: +49 (0)202 439-3521 <> <> Gaussstr. 20 Fax : +49 (0)202 439-2811 <> <> 42097 Wuppertal <> <> <> <><><><><><><>< Of course it runs NetBSD http://www.netbsd.org ><> mail# dovecot -n # 2.0.13: /usr/pkg/etc/dovecot/dovecot.conf # OS: NetBSD 5.1 amd64 ffs auth_debug = yes auth_verbose = yes base_dir = /var/run/dovecot/ mail_debug = yes mail_gid = 6 mail_location = maildir:/var/mail/user/%u/Maildir mail_plugins = acl managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace { inbox = yes location = prefix = separator = . type = private } namespace { list = children location = maildir:/var/mail/public:INDEX=%u/public prefix = public. separator = . subscriptions = no type = public } passdb { args = /usr/pkg/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = dovecot user = dovecot } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl_cert = </etc/certificates/mail.physik.uni-wuppertal.de.crt ssl_key = </etc/certificates/mail.physik.uni-wuppertal.de.key userdb { args = /usr/pkg/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = sieve } protocol lda { mail_plugins = sieve } protocol imap { mail_plugins = acl imap_acl } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole }

2 2

[Dovecot] On-delivery deduplication?
by Xin LI 10 Jun '11

10 Jun '11

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Hi, A feature of Cyrus-IMAPd I really missed after migrated to Dovecot is their optional "duplicate suppression", which eliminates duplicate message at deliver time, if their envelope sender, recipient and message-id matches. For example, if one subscribes to a mailing list, and someone hit "Reply All" to reply to him, there will be two different SMTP deliveries, one from the replier's server and one from the mailing list. Is it possible to do the same on latest Dovecot? (Looking at the documentation it seems not?) Or is there some better ways to implement the same functionality? Thanks in advance! Cheers, - -- Xin LI <delphij(a)delphij.net> http://www.delphij.net/ FreeBSD - The Power to Serve! Live free or die -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.17 (FreeBSD) iQEcBAEBCAAGBQJN79XjAAoJEATO+BI/yjfBCO0IAMLNZ9Rkargb6bQqILAcbobt 2ZFb6cO8f4vJu/BPO7Dq3TZoIEmfR+/pbruwgV+FSslTL+5TjkB5Rd5Yb+HYgvZT Qdbk8Jshgq1XBj2MvbLQugHKhNcN37oDI9eGCDPttYe/C4Jb2hh1W+RtqGpfS6ud jXUTUzS4yr7HWRRYcyDMvL4HuG/VnKEuFYmX2T/mT8oHfz5FckIPM+k+0prbgMSx IGTdkKpSMnqYnyUjxQklSmMJ5iJMM7Lr6FMS2c6ORKwG8rD0w1GKrU77saHqJJLQ YJqqIwJcr5753US6Q1Rk4gK+/L4JmJ+2BUXDdNMYBIfPOFjH9nOLlE5HIfSskBg= =fo5J -----END PGP SIGNATURE-----

11 22

[Dovecot] possible bug leading to lmtp crashes
by Trever L. Adams 10 Jun '11

10 Jun '11

I have been using Samba 4 kerberos and ldap with dovecot. Samba 4 changed a while back (resulting in me asking for help) which requires kerberos auth for ldap lookups. My setup worked perfectly before hand. Before and after were with dovecot-2.0.11 and the after also happens with 2.0.11. The only changes were (in my ldap.conf for dovecot -- changes are new lines starting with *, * is not in the conf, just showing changes): hosts = example.org base = dc=example,dc=org ldap_version = 3 user_attrs = userPrincipalName=user user_filter = (&(objectClass=person)(|(mail=%u)(sAMAccountName=%u)(userPrincipalName=%u))) *dn = MACHINEACCOUNT$(a)EXAMPLE.ORG *sasl_bind = yes *sasl_mech = GSSAPI *sasl_realm = EXAMPLE.ORG *#sasl_authz_id = MACHINEACCOUNT$(a)EXAMPE.ORG # For using doveadm -A: iterate_attrs = userPrincipalName=user iterate_filter = (objectClass=person) in dovecot.conf: import_environment = TZ KRB5CCNAME=/etc/dovecot/krb5.cc With that do any of the following lines from the referenced hg rev set mean I am missing anything on my import_environment variable? Or is it all good? 10.15 +/* <settings checks> */ 10.16 +#ifdef HAVE_SYSTEMD 10.17 +# define ENV_SYSTEMD " LISTEN_PID LISTEN_FDS" 10.18 +#else 10.19 +# define ENV_SYSTEMD "" 10.20 +#endif 10.21 +#ifdef DEBUG 10.22 +# define ENV_GDB " GDB" 10.23 +#else 10.24 +# define ENV_GDB "" 10.25 +#endif 10.26 +/* </settings checks> */ 10.27 + 10.28 static const struct master_settings master_default_settings = { 10.29 .base_dir = PKG_RUNDIR, 10.30 .libexec_dir = PKG_LIBEXECDIR, 10.31 + .import_environment = "TZ" ENV_SYSTEMD ENV_GDB, If I am not missing anything, then there seems to be a problem with kerberos sasl with ldap lookups. Thank you, Trever Adams Reference: http://hg.dovecot.org/dovecot-2.0/rev/cec7fa92ff48 Reference: https://bugzilla.redhat.com/show_bug.cgi?id=697325 (backtrace via abrtd is included here) -- "Avert misunderstanding by calm, poise, and balance." -- Unknown

2 14

Re: [Dovecot] Error: file_dotlock_create failed: Permission denied
by M. Fioretti 09 Jun '11

09 Jun '11

On Fri, Jun 03, 2011 16:51:06 PM +0300, Timo Sirainen wrote: > > On Wed, 2011-05-25 at 13:49 +0200, M. Fioretti wrote: > > > /home/z/email/marco isn't owned by marco? Alternatively you have SELinux > > enabled, which is preventing this. Yes, it was indeed selinux. I realized it (with help from the fedora list) the day after posting to this one, but then I started to restore other files from the backup and forgot to confirm that this was the problem, sorry. Marco

1 0