- dovecot - dovecot.org

[Dovecot] Problem with allow_nets passdb parameter and Postfix
by Неворотин Вадим 18 Feb '10

18 Feb '10

I use Dovecot for SASL authentication from Postfix. In Postfix main.cf I have: smtpd_sasl_type = dovecot It works good, but now I need to allow users to connect by IMAP only from given IP adresses. I've added extra field allow_nets to passdb in Dovecot, and IMAP authentication works fine. But now I can't connect to my SMTP server because when smtpd ask dovecot about user authentification, dovecot always denied it. Even if I try to connect to SMTP from correct IP, listed in allow_nets for user. In dovecot log I have messages about incorrect ip like this: dovecot: 2010-02-15 13:28:51 Info: auth(default): passwd-file(malamut): lookup: user=malamut file=/etc/dovecot/temp.users dovecot: 2010-02-15 13:28:51 Info: auth(default): passdb(malamut): allow_nets check failed: Remote IP not known dovecot: 2010-02-15 13:28:53 Info: auth(default): client out: FAIL 7 user=malamut Problem is clear: smtpd don't send client IP to dovecot authentication socket. But I need to limit the ability of connection to users only from specific IP. Both for SMTP and IMAP. How can I do that? I use dovecot 1.0.15 and Postfix 2.5.5 on Debian Lenny.

2 3

[Dovecot] deliver problem ( Error: file_dotlock_create )
by Frank Bonnet 18 Feb '10

18 Feb '10

Hello all ( Postfix and Dovecot ) Trying to use deliver as mailbox_command with Postfix I get this error each time an email is arriving deliver(xxxxxxxx): Error: file_dotlock_create(/var/mail/xxxxxxxx) failed: Permission denied (euid=3003(xxxxxxxx) egid=3010(smig) missing +w perm: /var/mail) (set mail_privileged_group=mail) Doea this means I have to chmod 777 the /var/mail directory ? Thanks a lot

2 1

[Dovecot] dovecot v1.2.10 + unknown mail_uid parameter
by maximatt 18 Feb '10

18 Feb '10

hi... i upgrading dovecot from v1.0.7 to v1.2.10, so i perform some modifications (http://wiki.dovecot.org/Upgrading/1.1 and http://wiki.dovecot.org/Upgrading/1.2) but i have the following problem when i want to test installation: in dovecot.conf, i set the user mail: mail_uid= 72940 mail_gid= 72941 but when i try to start dovecot i have the following error: # sbin/dovecot Error: Error in configuration file /etc/dovecot/etc/dovecot.conf line 962: Unknown setting: mail_uid Fatal: Invalid configuration in /etc/dovecot/etc/dovecot.conf # sbin/dovecot --version 1.2.10 i try, but i dont know how to fix them :( thanks in advance! :) -- Salu2 ;)

2 1

[Dovecot] quick question
by David Halik 18 Feb '10

18 Feb '10

Timo (and anyone else who feels like chiming in), I was just wondering if you'd be able to tell me if the amount of corruption I see on a daily basis is what you consider "average" for our current setup and traffic. Now that we are no longer experiencing any core dumps with the latest patches since our migration from courier two months ago, I'd like to know what is expected as operational norms. Prior to this we had never used Dovecot, so I have nothing to go on. Our physical setup is 10 Centos 5.4 x86_64 IMAP/POP servers, all with the same NFS backend where the index, control, and Maildir's for the users reside. Accessing this are direct connections from clients, plus multiple squirrelmail webservers, and pine users, all at the same time with layer4 switch connection load balancing. Each server has an average of about 400 connections, for a total of around concurrent 4000 during a normal business day. This is out of a possible user population of about 15,000. All our dovecot servers syslog to one machine, and on average I see about 50-75 instances of file corruption per day. I'm not counting each line, since some instances of corruption generate a log message for each uid that's wrong. This is just me counting "user A was corrupted once at 10:00, user B was corrupted at 10:25" for example. Examples of the corruption are as follows: ########### Corrupted transaction log file ..../dovecot/.INBOX/dovecot.index.log seq 28: Invalid transaction log size (32692 vs 32800): ...../dovecot/.INBOX/dovecot.index.log (sync_offset=32692) Corrupted index cache file ...../dovecot/.Sent Messages/dovecot.index.cache: Corrupted physical size for uid=624: 0 != 53490263 Corrupted transaction log file ..../dovecot/.INBOX/dovecot.index.log seq 66: Unexpected garbage at EOF (sync_offset=21608) Corrupted transaction log file ...../dovecot/.Trash.RFA/dovecot.index.log seq 2: indexid changed 1264098644 -> 1264098664 (sync_offset=0) Corrupted index cache file ...../dovecot/.INBOX/dovecot.index.cache: invalid record size Corrupted index cache file ...../dovecot/.INBOX/dovecot.index.cache: field index too large (33 >= 19) Corrupted transaction log file ..../dovecot/.INBOX/dovecot.index.log seq 40: record size too small (type=0x0, offset=5788, size=0) (sync_offset=5812) ########## These are most of the unique messages I could find, although the majority are the same as the first two I posted. So, my question, is this normal for a setup such as ours? I've been arguing with my boss over this since the switch. My opinion is that with a setup such as ours where a user can be logged in using Thunderbird, Squirrelmail, and their Blackberry all concurrently at the same time, there will always be the occasional index/log corruption. Unfortunately, he is of the opinion that there should rarely be any and there is a design flaw in how Dovecot is designed to work with multiple services with an NFS backend. What has been your experience so far? Thanks, -Dave -- ================================ David Halik System Administrator OIT-CSS Rutgers University dhalik(a)jla.rutgers.edu ================================

7 44

[Dovecot] Anyone successfully setup Continous Backup of mailboxes using rsync ?
by CoolAtt NNA 18 Feb '10

18 Feb '10

Hi All.. Am working on continous backup of mailboxes using rsync(for e.g by running rsync every 2 min) Things gets more complicated when users create Subfolders in INBOX , SENT , etc.. If anyone among you did that plz guide & advise. Thanks CoolAtt _________________________________________________________________ Your E-mail and More On-the-Go. Get Windows Live Hotmail Free. https://signup.live.com/signup.aspx?id=60969

17 41

[Dovecot] dovecot-sieve vacation vs qmail-ldap
by Lazy 18 Feb '10

18 Feb '10

Helloo, We are using dovectot lda with qmail-ldap, dovecot 1.2.10, sieve 0.1.15 lda is executed as exec /var/qmail/bin/preline -f /usr/local/dovecot/libexec/dovecot/deliver -s preline adds Delivered-To: header, everything works fine except vacation Feb 9 16:07:16 thebe dovecot: deliver(lazy): sieve: msgid=unspecified: discarding vacation response for message implicitly delivered to <lazy(a)thebe.org> Feb 9 16:07:16 thebe dovecot: deliver(lazy): sieve: msgid=unspecified: stored mail into mailbox 'INBOX' thebe.org is the hostname of the machine, oryginal recipient address has other domain .dovecot.sieve file looks like this require ["vacation"]; #autoresponder vacation :days 1 :subject "Auto Reply / Odpowiedz automatyczna" "aaaaaaaaaaaaaaaaaaaaa"; I did experiments with :addresses ["*"] without any luck. deliver only gets user and HOME directory form env variables provided by qmail, so it's unaware of the target email address. How to fix it ? I was thinking about deliver extracting target address from Delivered-To: header added by qmail's preline, or use DTLINE env variable, whitch qmail populates with Delivered-To header.

2 2

[Dovecot] Dovecot 1.2.8 problem on AIX
by Jonathan Siegle 18 Feb '10

18 Feb '10

Running revision 9492:3efdbaab2960(Mon Nov 23) on AIX 5.3. I run dovecot out of inetd. Every once in a while I get the following error: Dovecot is already running with PID 2592842 (read from /usr/ladmin/dovecot-1.2.8/var/run/dovecot/master.pid) when I try to connect to the imap port. -Jonathan

3 2

[Dovecot] using signed certificates for TLS/SSL
by Leonardo Rodrigues 18 Feb '10

18 Feb '10

Hi, I have, in one customer, a web server running on a Verisign-signed certificate SSL certificate. Everything works fine, IE and Firefox connects on https without asking anything, which usually happens on self-signed certificates. I'm trying to use that certificate on dovecot, but clients (Thunderbird basically) keeps saying the certificate is not valid. yes i'm using, when configuring Thunderbird, the same CN that was signed by Verisign for the web usage i've enabled verbose_ssl and got when thunderbird tries to connect: Feb 18 12:32:02 correio dovecot: imap-login: Disconnected (no auth attempts): rip=201.86.xxx.xxx, lip=192.168.1.2, TLS handshaking: SSL_accept() failed: error:14094418:SSL routines:SSL3_READ_BYTES:tlsv1 alert unknown ca unknown CA ??? is that Thunderbird that is not recognizing the Verisign-signed certificate ? Do i need to, somehow, install some Verisign CA certificate in dovecot.conf ? when using a self-signed certificate, i also get an SSL_accept failed, but with different message: Feb 18 12:41:45 correio dovecot: imap-login: Disconnected (no auth attempts): rip=201.86.191.114, lip=192.168.1.2, TLS handshaking: SSL_accept() failed: error:14094412:SSL routines:SSL3_READ_BYTES:sslv3 alert bad certificate despite the fact my certificates were generated for use with Apache, i can 'print' them, both of them, with the same commands i use to print dovecot generated certificates, with mkcert.sh. So, it seems they are compatible. if i click OK on Thunderbird, when using my Verisign-signed certificates, everything works and i do got TLS logs: Feb 18 12:23:36 correio dovecot: imap-login: Login: user=<user(a)domain.com.br>, method=PLAIN, rip=201.86.xx.xx, lip=192.168.1.2, TLS, TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits) Feb 18 12:31:43 correio dovecot: imap-login: Login: user=<user(a)domain.com.br>, method=PLAIN, rip=201.86.xx.xx, lip=192.168.1.2, TLS, TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits) what am i doing wrong ?? or using a signed-certificate for WEB usage is not possible on dovecot ? -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, NÃO mandem email gertrudes(a)solutti.com.br My SPAMTRAP, do not email it

3 3

[Dovecot] revision control on maildir possible?
by Markus Beyer 18 Feb '10

18 Feb '10

Hi, I was wondering if it is possible to put a dovecot managed maildir under a vcs like system, for example git or bzr. I'd like to have a seamless history of all mail going in and out of my mailboxes, so a vcs like system seams a good choice for me. I'm not quite sure however if that would cause any problems to dovecot and what the best way of handling commits would be. If anyone on the list got any pointers regarding this, it would be much apprechiated. Best regards, Markus -- Sicherer, schneller und einfacher. Die aktuellen Internet-Browser - jetzt kostenlos herunterladen! http://portal.gmx.net/de/go/atbrowser

3 2

[Dovecot] tls not working on ubuntu
by zhong ming wu 18 Feb '10

18 Feb '10

Hello List, I'm new to dovecot. I have sucessfully configured dovecot with just virtual users on a centos linux box to my satisfaction; I can connect with TLS with disable_plaintext_auth = yes. This dovecot is also version > 1. Can't post exact version right now but it's what comes with Centos 5.4. On a Ubuntu 9.10 box here, I cannot connect with TLS (port 110) but I can connect with plain SSL (port 995). The config files between centos and ubuntu boxes are the same except for minor details. The following is the log entry Feb 17 21:38:18 ubuntu dovecot: pop3-login: Disconnected (no auth attempts): rip=192.168.0.101, lip=192.168.0.108 The output below is from a binary compiled from source. I have also tested with 1.1.11 (that I get from apt-get install) with the same config file. I have tested ubuntu with both Thunderbird 3 and thunderbird 2. I have also searched google as well as dovecot website. Thanks mr.wu # 1.2.10: /usr/local/etc/dovecot.conf # OS: Linux 2.6.31-14-server x86_64 Ubuntu 9.10 ext4 base_dir: /var/run/dovecot/ protocols: pop3 pop3s listen: 192.168.0.108 ssl_cert_file: /usr/local/etc/pop.crt ssl_key_file: /usr/local/etc/pop.key ssl_parameters_regenerate: 29 disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot//login login_executable: /usr/local/libexec/dovecot/pop3-login mail_location: maildir:/var/vmail/%d/%n mail_executable: /usr/local/libexec/dovecot/pop3 mail_plugin_dir: /usr/local/lib/dovecot/pop3 auth default: user: authdove debug: yes passdb: driver: passwd-file args: /usr/local/etc/%d/passwd userdb: driver: static args: uid=2000 gid=2000 home=/var/vmail/%d/%n

2 1

[Dovecot] Sieve libexec /usr/lib/dovecot/deliver
by Filip Dvořák 17 Feb '10

17 Feb '10

Hi, I have installed dovecot(1.2.10) with --libexecdir=/usr/lib . Dovecot sieve(0.1.15) is compiled with --with-dovecot but still uses /usr/libexec/dovecot/deliver instead of /usr/lib/dovecot/deliver. How should be dovecot sieve configured to use /usr/lib/dovecot/deliver thanks in advance Filip # dovecot configuration: ./configure --prefix=/usr --sysconfdir=/etc/dovecot --localstatedir=/var \ --libexecdir=/usr/lib --with-moduledir=/usr/lib/dovecot/modules \ --with-db --with-mysql --with-pgsql --with-sqlite \ --with-ssl=openssl --with-ssldir=/etc/dovecot/ssl \ --with-gssapi --with-ldap=plugin --enable-header-install --with-docs # dovecot sieve configuration: ./configure --prefix=/usr --with-dovecot=/usr/lib/dovecot # /usr/lib/dovecot/dovecot-config: CFLAGS="-std=gnu99 -march=i686 -mtune=generic -O2 -pipe -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 " LIBS=" -lrt" SSL_LIBS="-lssl -lcrypto -ldl -lz " STORAGE_LIBS="$(top_builddir)/src/lib-storage/register/libstorage-register.a $(top_builddir)/src/lib-storage/list/libstorage_list.a $(top_builddir)/src/lib-storage/index/cydir/libstorage_cydir.a $(top_builddir)/src/lib-storage/index/dbox/libstorage_dbox.a $(top_builddir)/src/lib-storage/index/maildir/libstorage_maildir.a $(top_builddir)/src/lib-storage/index/mbox/libstorage_mbox.a $(top_builddir)/src/lib-storage/index/raw/libstorage_raw.a $(top_builddir)/src/lib-storage/index/shared/libstorage_shared.a $(top_builddir)/src/lib-storage/index/libstorage_index.a $(top_builddir)/src/lib-storage/libstorage.a $(top_builddir)/src/lib-index/libindex.a $(top_builddir)/src/lib-imap/libimap.a $(top_builddir)/src/lib-mail/libmail.a $(top_builddir)/src/lib-auth/libauth.a $(top_builddir)/src/lib-charset/libcharset.a $(top_builddir)/src/lib/liblib.a" LIBICONV="" MODULE_LIBS="-export-dynamic -ldl" dovecot_incdir=/usr/include/dovecot moduledir=/usr/lib/dovecot/modules CFLAGS="-std=gnu99 -march=i686 -mtune=generic -O2 -pipe -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscri LIBS=" -lrt" SSL_LIBS="-lssl -lcrypto -ldl -lz " STORAGE_LIBS="$(top_builddir)/src/lib-storage/register/libstorage-register.a $(top_builddir)/src/lib-storage/list/libstorage_list.a $(top_ LIBICONV="" MODULE_LIBS="-export-dynamic -ldl" dovecot_incdir=/usr/include/dovecot moduledir=/usr/lib/dovecot/modules # end of dovecot-config dovecot -n output: # 1.2.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.27-lts i686 ext3 protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/mail.pruda.com/cert.pem ssl_key_file: /etc/ssl/mail.pruda.com/key.pem disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_location: maildir:/home/vmail/%u mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 lda: postmaster_address: postmaster(a)pruda.com mail_plugins: sieve sieve_global_path: /home/vmail/dovecot-global.sieve sendmail_path: /usr/sbin/sendmail auth default: user: nobody passdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf userdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: vmail plugin: sieve: /home/vmail/%u/dovecot.sieve home: /home/vmail/%u

1 1

[Dovecot] Special user
by Daniel L. Miller 17 Feb '10

17 Feb '10

Not sure what to call this - I'm actually working out the details as I type this. I want to have a valid username/password for an account for sending purposes - but when receiving this is an alias that broadcasts to several users. Example: accountspayable(a)mydomain.com - is an alias for jane(a)mydomain.com, june(a)mydomain.com, and john(a)mydomain.com. However - any mails sent (from a particular client software) should all only show "accountspayable" as the sender. How would I implement this? I'm asking here because Dovecot serves as the authentication mechanism for my SMTP server (Postfix) via LDAP lookups. -- Daniel

4 4

[Dovecot] salted passwords
by Leonardo Rodrigues 17 Feb '10

17 Feb '10

The idea of salted hash algorithms is to generate a different hash even if the same text is entered. That can be easily seen with dovecotpw: using NON-salted SHA256, same hash is generated for a given password [root@correio ~]# dovecotpw -s SHA256 -p 123 {SHA256}pmWkWSBCL51Bfkhn79xPuKBKHz//H6B+mY6G9/eieuM= [root@correio ~]# dovecotpw -s SHA256 -p 123 {SHA256}pmWkWSBCL51Bfkhn79xPuKBKHz//H6B+mY6G9/eieuM= [root@correio ~]# dovecotpw -s SHA256 -p 123 {SHA256}pmWkWSBCL51Bfkhn79xPuKBKHz//H6B+mY6G9/eieuM= [root@correio ~]# using SALTED SHA256, a different hash is generated for the same given password [root@correio ~]# dovecotpw -s SSHA256 -p 123 {SSHA256}FpJZqafpEVKp2heepp9Z7+OeHaX+DBVpLzd6GKg3BW1XqDS0 [root@correio ~]# dovecotpw -s SSHA256 -p 123 {SSHA256}6lWmvtO3SKG5RMET5n89WMIp0xeCg3U14xH1xnAXbvkr8Yjk [root@correio ~]# dovecotpw -s SSHA256 -p 123 {SSHA256}7fXVjC7Iiu0Ko9SgyBpbDvbwMSkoxMILRjDUE0nNpCHBFaIa [root@correio ~]# This ideia is OK to me ... but i'm having a hard time trying to figure out how my dovecot-sql.conf would be in the case i store salted SHA256 passwords on the database. The idea is to use a RANDOM salt, not a fixed one, just like dovecotpw does. would it be as simple as changing the 'password', which today is plaintext, by something like concat('{SHA256}',password) ??? dont i have to give the salt, somehow ?? Or should i store the salt used in the password, for example first or last N characters .... is there anyone using dovecot with MySQL and SSHA256 passwords that can share me the dovecot-sql.conf file ? -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, NÃO mandem email gertrudes(a)solutti.com.br My SPAMTRAP, do not email it

5 6

[Dovecot] zlib plugin trouble
by Stéphane Cottin 16 Feb '10

16 Feb '10

Hi, I have error with dovecot 1.2.10 + compress on deliver patch and zlib plugin. logfile sample: [...] mail.err: Feb 16 14:22:25 dovecot: IMAP(hidden(a)domain.com): zlib_istream.seek() failed: Invalid argument mail.err: Feb 16 14:22:25 dovecot: IMAP(hidden(a)domain.com): FETCH for mailbox Meursault UID 101 failed to read message input: Invalid argument mail.err: Feb 16 14:22:26 dovecot: IMAP(hidden(a)domain.com): gzread() failed: DATA_ERROR_MAGIC mail.err: Feb 16 14:22:26 dovecot: IMAP(hidden(a)domain.com): zlib_istream.seek() failed: Invalid argument mail.err: Feb 16 14:22:26 dovecot: IMAP(hidden(a)domain.com): FETCH for mailbox Meursault UID 101 failed to read message input: Invalid argument mail.err: Feb 16 14:22:26 dovecot: IMAP(hidden(a)domain.com): gzread() failed: DATA_ERROR_MAGIC [...] mail.err: Feb 16 14:36:24 dovecot: IMAP(hidden2(a)domain.com): gzread() failed: UNEXPECTED_EOF mail.err: Feb 16 14:36:24 dovecot: IMAP(hidden2(a)domain.com): FETCH for mailbox Sent.MARKETING.DAG ALLEMAAL UID 1 failed to read message input: Invalid argument mail.err: Feb 16 14:59:18 dovecot: IMAP(hidden2(a)domain.com): gzread() failed: UNEXPECTED_EOF [...] mail.info: Feb 16 14:08:35 dovecot: IMAP(hidden2(a)domain.com): Disconnected: BUG: Unknown internal error bytes=1099335/4103 mail.info: Feb 16 14:16:40 dovecot: IMAP(hidden(a)domain.com): Disconnected: BUG: Unknown internal error bytes=15193/2552616 mail.info: Feb 16 14:16:41 dovecot: IMAP(hidden(a)domain.com): Disconnected: BUG: Unknown internal error bytes=295/6715 mail.info: Feb 16 14:16:41 dovecot: IMAP(hidden(a)domain.com): Disconnected: BUG: Unknown internal error bytes=295/6715 mail.info: Feb 16 14:16:42 dovecot: IMAP(hidden(a)domain.com): Disconnected: BUG: Unknown internal error bytes=295/6715 mail.info: Feb 16 14:16:42 dovecot: IMAP(hidden(a)domain.com): Disconnected: BUG: Unknown internal error bytes=295/6715 [...] dovecot -n : # 1.2.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-6-xen-vserver-amd64 x86_64 Debian 5.0.4 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s managesieve login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_greeting: Dovecot ready. login_process_per_connection: no mail_max_userip_connections(default): 30 mail_max_userip_connections(imap): 30 mail_max_userip_connections(pop3): 10 mail_max_userip_connections(managesieve): 10 mail_privileged_group: mail maildir_copy_preserve_filename: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): zlib antispam quota imap_quota fts fts_squat mail_plugins(imap): zlib antispam quota imap_quota fts fts_squat mail_plugins(pop3): zlib quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve lda: postmaster_address: hidden(a)noc.com mail_plugins: autocreate quota sieve fts fts_squat zlib quota_full_tempfail: yes sieve_global_dir: /etc/dovecot/sieve/ auth default: mechanisms: plain login cram-md5 cache_size: 1024 passdb: driver: vpopmail userdb: driver: vpopmail socket: type: listen master: path: /var/run/dovecot/auth-master mode: 438 group: vchkpw plugin: quota: maildir:User quota quota_rule: Trash:ignore quota_rule2: Junk:ignore quota_rule3: &AMk-l&AOk-ments supprim&AOk-s:ignore quota_rule4: Deleted Items:ignore quota_rule5: Deleted Messages:ignore quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 quota_warning2: storage=80%% /usr/local/bin/quota-warning.sh 80 antispam_signature: X-DSPAM-Signature antispam_signature_missing: error antispam_trash: trash;Trash;Deleted Items;Deleted Messages;&AMk-l&AOk-ments supprim&AOk-s antispam_spam: Junk antispam_dspam_args: --mode=teft;;--user;%u fts: squat fts_squat: partial=4 full=10 sieve: ~/.dovecot.sieve sieve_storage: ~/sieve zlib_save_level: 9 zlib_save: gz

3 7

Re: [Dovecot] Dovecot+Postfix+Maildir with ActiveDirectory userbase
by Wayne Thursby 16 Feb '10

16 Feb '10

> Wayne Thursby put forth on 2/15/2010 10:24 AM: > > > My Setup: > > Postfix and Dovecot running on the same virtual machine on a Dell 2950 > > with 1x Xeon E5440 on ESXi 4. Maildirs served up by 10x146GB SCSI drives > > on RAID-10 via direct attached Dell MD-1000. > > Interesting setup Wayne. > The same ESXi/RAID combo are also running several other VMs using 7 of its 8GB of RAM. > > Serving 600+ users, mailbox sizes up to 14GiB with constant heavy > > searching (no fts yet) and filtering (sieve and IMAP clients). 80,000 > > messages delivered per week, 95,000 messages rejected, 17,000 spam. 15 > > minute Load average stays under .50 all day with 4 CPU cores. > > How many CPUs are listed in /proc/cpuinfo under that Ubuntu VM? ESX by > default only exposes one CPU(core) to a VM guest OS. Any chance you didn't > tweak the VM config and that your Ubuntu guest is only running on time slices > of a single core? Your results are even more impressive if that's the case. Sorry if it's less impressive, but I've certainly configured the VM for 4 cores. The cores are shared equally between all VMs, I've done no prioritization because I've not had any performance issues related to resource contention. Having 10x15k RPM spindles to seek across, and 512MB of cache on the controller, means I can give Postfix/Amavis/Dovecot 3GB of RAM to use, and 1GB of it is always used for cache, without ever dipping into swap. I get occasional spikes to 30ms of disk latency, but it stays below 5ms for most of the workday. > Also, are you seeing the classic system clock drift of ESX guests, > and if so, is it causing problems with smtp and imap? Not at all, that's what the VMware tools are for. The ESXi host is configured to use our NTP server inside the VPN, and the VMware tools package synchronizes the guest clock with the host. I ran into this on our webmail client as well, then I discovered how easy it really is to install the VMware tools on Ubuntu, so it's no longer a problem. Don't want to stray off topic, so I'll start a new thread, but I'm now attempting to bring High Availability to the mix, and could use some suggestions. -- Wayne Thursby System Administrator Physicians Group, LLC

1 0

[Dovecot] sieve addflag has stopped working
by Andrew Schulman 16 Feb '10

16 Feb '10

Dovecot 1.2.10 in Debian, using Dovecot sieve. I have a sieve script, generated by Ingo, that's supposed to mark spam messages as "Seen" and file them into the Junk folder. In part it reads: require ["regex", "body", "imapflags", "fileinto"]; if exists "X-Spam-Flag" { addflag "\\Seen"; fileinto "Junk"; removeflag "\\Seen"; stop; } This has been working correctly for a long time, but since about 2 weeks ago now, the "Seen" flag isn't being set, although the messages are still being filed into the Junk folder. In two different mail clients, new messages in the Junk folder show up as being unread. Looking at the mail files that hold those messages, the file names don't have an "S" flag appended, while older messages all have the "S" and show up as already seen in the mail clients. I don't believe that I've updated dovecot recently, so I'm not sure why the behavior has changed. Note that I do have plugin { sieve_extensions = +imapflags } in dovecot.conf. I know that imapflags is deprecated, but it is still supposed to be supported. Unfortunately ingo1 doesn't support imap4flags yet (http://bugs.horde.org/ticket/8784) I'm trying to find log information that might indicate an error, but I'm not finding much. /var/log/exim4/mainlog just says: 2010-02-15 14:22:14 1Nh6WK-000200-8z <xxx(a)xxx.xxx>: deliver_pipe transport output: deliver(andrex): Info: sieve: msgid=<ad58db2a42700ec0e5c924c8882d48c2(a)yourmailnews.net>: stored mail into mailbox 'Junk' The wiki says that there should be a log file ~/.dovecot.sieve.log, but there isn't one, which I guess means there are no error messages. Output of dovecot -a is below. Any ideas why the Seen flag isn't being set any more? Thanks, Andrew. # dovecot -a # 1.2.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26 x86_64 Debian squeeze/sid base_dir: /var/run/dovecot log_path: info_log_path: log_timestamp: %Y-%m-%d %H:%M:%S syslog_facility: mail protocols: imap imaps managesieve listen(default): localhost listen(imap): localhost listen(managesieve): localhost:2000 ssl_listen: imap ssl: yes ssl_ca_file: ssl_cert_file: /etc/dovecot/helium-imaps.cert.pem ssl_key_file: /etc/dovecot/helium-imaps.key.pem ssl_key_password: ssl_parameters_regenerate: 0 ssl_cipher_list: ssl_cert_username_field: commonName ssl_verify_client_cert: no disable_plaintext_auth: yes verbose_ssl: no shutdown_clients: yes nfs_check: yes version_ignore: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_user: dovecot login_greeting: Dovecot ready. login_log_format_elements: user=<%u> method=%m rip=%r lip=%l %c login_log_format: %$: %s login_process_per_connection: yes login_chroot: yes login_trusted_networks: login_process_size: 64 login_processes_count: 3 login_max_processes_count: 128 login_max_connections: 256 valid_chroot_dirs: mail_chroot: max_mail_processes: 512 mail_max_userip_connections: 10 verbose_proctitle: no first_valid_uid: 500 last_valid_uid: 0 first_valid_gid: 1 last_valid_gid: 0 mail_access_groups: mail_privileged_group: mail mail_uid: mail_gid: mail_location: maildir:~/.mail mail_cache_fields: mail_never_cache_fields: imap.envelope mail_cache_min_mail_count: 0 mailbox_idle_check_interval: 30 mail_debug: no mail_full_filesystem_access: yes mail_max_keyword_length: 50 mail_save_crlf: no mmap_disable: yes dotlock_use_excl: yes fsync_disable: no mail_nfs_storage: no mail_nfs_index: no mailbox_list_index_disable: yes lock_method: fcntl maildir_stat_dirs: no maildir_copy_with_hardlinks: yes maildir_copy_preserve_filename: no maildir_very_dirty_syncs: no mbox_read_locks: fcntl mbox_write_locks: fcntl dotlock mbox_lock_timeout: 300 mbox_dotlock_change_timeout: 120 mbox_min_index_size: 0 mbox_dirty_syncs: yes mbox_very_dirty_syncs: no mbox_lazy_writes: yes dbox_rotate_size: 2048 dbox_rotate_min_size: 16 dbox_rotate_days: 1 mail_drop_priv_before_exec: no mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_process_size: 256 mail_plugins: mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve mail_log_prefix: %Us(%u): mail_log_max_lines_per_sec: 10 imap_max_line_length: 65536 imap_capability: imap_client_workarounds: imap_logout_format: bytes=%i/%o imap_id_send: imap_id_log: imap_idle_notify_interval: 120 pop3_no_flag_updates: no pop3_enable_last: no pop3_reuse_xuidl: no pop3_save_uidl: no pop3_lock_session: no pop3_uidl_format: %08Xu%08Xv pop3_client_workarounds: pop3_logout_format: top=%t/%p, retr=%r/%b, del=%d/%m, size=%s dict_db_config: dict_process_count: 1 managesieve_max_line_length: 65536 managesieve_logout_format: bytes=%i/%o managesieve_implementation_string: dovecot lda: postmaster_address: postmaster(a)xxx.xxx mail_plugin_dir: /usr/lib/dovecot/modules/lda mail_plugins: sieve log_path: /dev/stderr log_timestamp: auth default: mechanisms: plain realms: default_realm: cache_size: 0 cache_ttl: 3600 cache_negative_ttl: 3600 executable: /usr/lib/dovecot/dovecot-auth user: root chroot: username_chars: abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ username_translation: username_format: master_user_separator: anonymous_username: anonymous krb5_keytab: gssapi_hostname: winbind_helper_path: /usr/bin/ntlm_auth failure_delay: 2 verbose: no debug: no debug_passwords: no ssl_require_client_cert: no ssl_username_from_cert: no use_winbind: no count: 1 worker_max_count: 30 process_size: 256 passdb: driver: pam args: deny: no pass: no master: no userdb: driver: passwd args: plugin: sieve_extensions: +imapflags sieve_dir: ~/.mail/sieve

2 2

[Dovecot] Dovecot+Postfix+Maildir with ActiveDirectory userbase
by Wayne Thursby 15 Feb '10

15 Feb '10

> Luigi Rosa <lists(a)luigirosa.com> uttered: > Hi, > has anyone implemented a mail server with maildir, Postfix and Dovecot > using > Active Directory ad userbase and password authentication? > > Do I need Samba to authenticate users? > > Can I use credential caching just like mysql? > > > Ciao, > luigi > > -- > / > +--[Luigi Rosa]-- > \ Hi Luigi, I am running a Postfix/Dovecot setup that is authenticating against a Windows 2000 domain. It is possible to authenticate several different ways, including Kerberos/Winbind and NTLM via Samba. I used the following article as a guide. It is for FreeBSD, but the configuration instructions apply equally to any Postfix/Dovecot setup. I am running mine on Ubuntu 8.10. http://blog.al-shami.net/index.php/freebsd-postfix-dovecot-and-active-direc… The above article covers most of the setup, however I have changed a few things for my purposes. In short, I am using LDAP to communicate with the Active Directory server. I am looking up email addresses and aliases from AD in Postfix and using Dovecot as LDA. Postfix uses Dovecot's SASL for authentication, and Dovecot in turn authenticates against AD. My Setup: Postfix and Dovecot running on the same virtual machine on a Dell 2950 with 1x Xeon E5440 on ESXi 4. Maildirs served up by 10x146GB SCSI drives on RAID-10 via direct attached Dell MD-1000. Serving 600+ users, mailbox sizes up to 14GiB with constant heavy searching (no fts yet) and filtering (sieve and IMAP clients). 80,000 messages delivered per week, 95,000 messages rejected, 17,000 spam. 15 minute Load average stays under .50 all day with 4 CPU cores. IMAP clients include Outlook 2007, Thunderbird 2 and 3, in addition to webmail via Group Office (yuck). dovecot-ldap.conf: # Include multiple domain controllers for redundancy, first one is # at the same facility as the Dovecot server. hosts = 10.0.1.12:389 10.0.2.12:389 10.0.3.12:389 # Specify the full DN of a user to authenticate against dn = cn=Internal, ou=People, dc=example, dc=com dnpass = some_secure_password auth_bind = yes ldap_version = 3 base = ou=People, dc=example, dc=com # Specify the base storage for email here user_attrs = sAMAccountName=home=/var/vmail/example.com/%$ # The following user_filter should all be on a single line. # The ugly userAccountControl param means "Exclude disabled users" user_filter = (&(sAMAccountName=%Ln)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) pass_filter = (&(sAMAccountName=%Ln)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) For the Postfix side of things, the article explains how to set Postfix to use Dovecot's SASL for authentication. It also specifies separate confs for Postfix to lookup users and aliases from. For my purposes, I decided not to modify the AD schema, and to instead utilize an unused field to store aliases in. This field had to be able to store multiple values in a way that I could query easily via LDAP. I chose the "IP Phone" field for this purpose. In the AD GUI it is easily accessible, and allows for multiple values to be stored. Note its usage in the queries that follow. /etc/postfix/ldap-users.cf: # Same list of DCs as in dovecot-ldap.conf server_host = ldap://10.0.1.12:389 ldap://10.0.2.12:389 ldap://10.0.3.12:389 search_base = dc=example, dc=com bind = yes bind_dn = EXAMPLE\internal bind_pw = a_secure_password # Use this lookup for email addresses matching the following domains # corresponds with virtal_mailbox_domains in main.cf domain = example.com, examplelegacy.com, exmple.com # The following query has been modified a bit from the above article. # First, the userAccountControl param specifies the exclusion of # disabled users. # The other change is from objectClass to objectCategory. query_filter = (&(&(objectCategory=person)(sAMAccountName=%u))(!(userAccountControl:1.2.840.113556.1.4.803:=2))) result_attribute = sAMAccountName version = 3 # I was having trouble with referrals not resolving properly due to a # misconfigured domain controller. I turned this option off and have # not had a problem since. chase_referrals = no result_format=example.com/%s/ debuglevel = 0 timeout = 30 /etc/postfix/ldap-aliases.cf: # Same list of DCs as in dovecot-ldap.conf server_host = ldap://10.0.1.12:389 ldap://10.0.2.12:389 ldap://10.0.3.12:389 search_base = dc=example, dc=com bind = yes bind_dn = EXAMPLE\internal bind_pw = a_secure_password domain = example.com, examplelegacy.com, exmple.com # This query looks up aliases from the otherIPPhone field. query_filter = (&(&(objectCategory=person)(|(otherIPPhone=%u)(sAMAccountName=%u)))(!(userAccountControl:1.2.840.113556.1.4.803:=2))) result_attribute = sAMAccountName version = 3 chase_referrals = no result_format=%s(a)example.com debuglevel = 0 timeout = 30 The objectCategory replacement for objectClass is a *huge* performance increase. objectClass is not indexed in Active Directory, forcing a lot of CPU cycles to be wasted for every lookup. The way I have implemented things, this means two of these expensive lookups per incoming email (even if it was undeliverable!). At first this was using around 50% CPU on a dual Xeon domain controller. This was acceptable at the time, but after my optimizations we were able to move authentication to a virtual machine with 640MB of RAM and a single CPU core where it now stays below 20% all day. Changing the lookup to an indexed field probably cut the initial load by 90%. Adding auth_cache settings to dovecot.conf then further reduced load by more than 50%. Well, I suppose that screed should suffice for my first post. I've gained much from just lurking in this list, just trying to contribute where I can. -- Wayne Thursby System Administrator Physicians Group, LLC

2 1

Re: [Dovecot] [RCU] Dovecot managesieve
by Frank Bonnet 15 Feb '10

15 Feb '10

Well I've looked forward into the wiki and did not found my server have only system users ( no virtual domain ) and the wiki says : System users If you wish you use deliver for all system users on a single domain mail host you can do it by editing mailbox_command parameter in /etc/postfix/main.cf (postconf(5)): That's what I did but then I have this problem with DOTLOCK If I chmod 777 /var/mail directory it works but I do not feel comfortable with that kind of access rights ... On 02/12/10 20:39, Joseph Kolb wrote: > Hi Frank, > > the question is, do you use the LDA of dovecot (LocalDeliveryAgent)? > If so, then yes, you must add/modify some stuff in master.cf. This is good > described in dovecot wiki :-). > > Regards, > Joseph > > Am Freitag 12 Februar 2010 15:42:12 schrieben Sie: >> Hi Joseph >> >> Thanks for your answer >> >> did you modify something in Postfix main.cf file ? >> >> >> Frank >> >> On 02/12/10 11:57, Joseph Kolb wrote: >>> On Fri, 12 Feb 2010 10:13:53 +0100, "A.L.E.C"<alec(a)alec.pl> wrote: >>>> Frank Bonnet wrote: >>>>>> protocol lda { >>>>>> >>>>>> # Address to use when sending rejection mails. >>>>>> postmaster_address = postmaster(a)esiee.fr >>>> >>>> In dovecot-1.1 I've got in "protocol lda" section: >>>> >>>> mail_plugins = cmusieve >>> >>> Hi Frank, >>> >>> i use also dovecot 1.2.10 >>> >>> and here is my part of dovecot.conf >>> >>> -->snip<--- >>> protocol imap { >>> >>> ssl_listen = *:993 >>> mail_plugins = quota imap_quota >>> >>> } >>> >>> protocol lda { >>> >>> postmaster_address = postmaster(a)xxxx.xx >>> log_path = /var/log/dovecot-lda.log >>> info_log_path = /var/log/dovecot-info-lda.log >>> mail_plugins = sieve >>> >>> } >>> -->snip<--- >>> >>> Regards, >>> Joseph >>> _______________________________________________ >>> List info: http://lists.roundcube.net/users/ >

2 3

[Dovecot] Capability COMPRESS implemented?
by Ed W 15 Feb '10

15 Feb '10

Hi, I just read that http://tools.ietf.org/html/rfc4978 ..is being implemented in Thunderbird 3. This is great news! It's been a long time since we last discussed this and I don't think it's currently implemented in Dovecot, but since Cyrus just added it, any chance of getting support in Dovecot please? (Fastmail seems to be supporting this effort) On a similar note we had a previous thread about supporting TLS deflate - any chance you could investigate this again and add support on the Dovecot side so at least it would be feasible to submit a bug fix on the Thunderbird side? (It looked like a one liner change back when we last discussed it?) Thanks Ed W (Obviously for those looking for an external high performance compressor you can use our compressing email proxy from http://www.mailasail.com ...)

3 14

[Dovecot] So, what about clustering and load balancing?
by Stefan Foerster 15 Feb '10

15 Feb '10

Hello world, so, with beta2 of Dovecot 2.0 being available, what is the preferred way to achieve load balancing and fault tolerance? As far as I can see it, there are basically two options: 1) Use a HA shared storage, export either a cluster filesystem or NFS, and have your dovecot servers mount that file system. Load balance these servers (Cisco ACE, ldirectord, ...) and there you go. Overall performance is limited by the speed of the shared storage and may further decrease due to locking issues, imperformant cluster filesystems and so on. 2) Set up every dovecot server with local storage and trigger a dsync after each change (pyinotfiy, incron, parse LMTP delivery logs, ...). Load balance these servers as before. Depending on the number of syncs that have to be done, mailbox replication may lag behind. The need to constantly spawn dsync processes may further decrease performance if you don't do it right (stickiness of established connections, replicating at most every xyz seconds). What are your opinions on that matter? Stefan P.S: I've set up option two in a test setup, though the incron/inotify part is still giving me a headache.

6 12

[Dovecot] POP3 with dovecot LDA and sieve
by Arthur Titeica 14 Feb '10

14 Feb '10

Hello. I'm using Postfix with Dovecot as IMAP, POP3 and LDA. With sieve rules I successfully move mails to specific mailboxes and this is great if accessing the account thru IMAP. However, when accessing thru POP3 I only get mails from Inbox. I wonder if it's possible to get real new mails, regardless of the folder they're in. Thanks for any thoughts. Arthur

3 3

[Dovecot] comprehensive info on search capabilities?
by Kārlis Repsons 14 Feb '10

14 Feb '10

People, where to read about how to make the most of the current Dovecot search capabilities, including squat and possibly also the related future plans? There are many aspects like IMAP protocol itself, extensions, current support into Dovecot, support among MUAs... Could you post some good links, please?

2 3

[Dovecot] Virtual plugin and user_query
by Arthur Titeica 14 Feb '10

14 Feb '10

Hello, As per a previous reply regarding POP3 I'm now trying to configure the virtual plugin. However I don't really understand how to modify the sql user_query to properly indicate inbox=yes. I created 3 namespaces as per wiki instructions and I've modified the password and user queries as bellow: password_query = \ SELECT email, password, login , concat('*:bytes=', quota) \ AS userdb_quota_rule, \ CASE '%s' WHEN 'pop3' THEN NULL ELSE 'yes' \ END AS namespace_1_inbox, \ CASE '%s' WHEN 'pop3' THEN 'yes' ELSE NULL \ END AS namespace_2_inbox \ FROM users \ WHERE email = '%u' AND login = 'active' user_query = SELECT \ concat('*:bytes=', quota) AS quota_rule, \ CASE '%s' WHEN 'pop3' THEN NULL ELSE 'yes' \ END AS namespace_1_inbox, \ CASE '%s' WHEN 'pop3' THEN 'yes' ELSE NULL \ END AS namespace_2_inbox \ FROM users \ WHERE email = '%u' After that all I get in the logs is: IMAP(arthur(a)psw.ro): Error: namespace configuration error: inbox=yes namespace missing IMAP(arthur(a)psw.ro): Fatal: Namespace initialization failed As I don't really understand those case sql queries is there something I should add in the mysql tables? Any thoughts will be greatly appreciated. Thanks!

2 1

[Dovecot] deliver and cloning file permissions
by Alexander 'Leo' Bergolth 14 Feb '10

14 Feb '10

Hi! I'd like to use deliver (dovecot-1.2.10) as LDA to deliver mails to my local users on my postfix-system. However, deliver tries to copy the filesystem permissions of the mail-spool-files to the user's index files, which doesn't work, since the files in /var/mail/ belong to the group 'mail'. Feb 13 00:21:19 leo-x61 dovecot: deliver(leo): fchown(/home/leo/mail/.imap/INBOX/dovecot.index.log.newlock, -1, 12(mail)) failed: Operation not permitted (egid=100(users), group based on /var/mail/leo) I know that dovecot tries to clone the mailbox permissions in order to support shared folders but it would be nice if there was an option to disable this (or to just try it and ignore the fchown error). I could manually change group ownership of all mailboxes from mail to each user's primary group or set the mailbox-modes to 0600 but I'd also have to do that for every new user. (Tools to create users like useradd from shadow-utils use hardcoded file modes and group ownership.) Is there any workaround? Thanks, --leo -- e-mail ::: Leo.Bergolth (at) wu.ac.at fax ::: +43-1-31336-906050 location ::: IT-Services | Vienna University of Economics | Austria

3 5

[Dovecot] Plugin question
by Valery Gorbunov 14 Feb '10

14 Feb '10

Hi All I needs to write plugin which converting messages by replacing entier message by one of parts of this message. In another words I need show part of multipart message instead entire message. Stream substitution in *mail->v.get_stream()* function gives incorrect results because mail indexed and cached before. Therefore I should wrap email during indexing too. something like: ----- struct index_transaction_context * it; it->ibox->mail_vfuncs->get_stream = convert_get_stream; ----- Is it enough or idea to replace mail stream by another will don't work anyway? Could you suggest how to show one mail instead another in Dovecot environment? Thank you Valery Gorbunov

2 1