- dovecot - dovecot.org

[Dovecot] Why imap_open function doesn't work while getting a mailbox through telnet works perfectly?
by I M 20 Dec '11

20 Dec '11

Hi, everybody! Question: Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? Note: imap.so is loaded! imap.ini is parsed!php flags is checked! Is it a bug?

2 1

[Dovecot] Why imap_open doesn't work as is expected to?
by I M 20 Dec '11

20 Dec '11

Hi, everybody! Question: Why imap_open function doesn't work while getting a mailbox through telnet works perfectly? Note: imap.so is loaded! imap.ini is parsed!

1 0

[Dovecot] Sieve too rfc compliant ;-)
by Jan-Frode Myklebust 20 Dec '11

20 Dec '11

It seems we have a few email addresses that are not RFC 5322 compliant, and now that we've started using sieve these are failing. The problem is that we have a few addresses with leading, trailing or double dots in the local part: jan..frode(a)tanso.net .janfrode(a)tanso.net janfrode.(a)tanso.net I believe these has been working fine with everything else in dovecot (lda, lmtp, imap, pop), but that sieve is more strict. I think it's fair enough that it's strict with messages generated by sieve scripts, but it would be nice if it could be more tolerant with messages addressed for the sieve script. So, is there any setting for making it more tolerant ? -jf

2 1

Re: [Dovecot] Question about index reset in dovecot 2.0.15
by Maria Arrea 20 Dec '11

20 Dec '11

Hello Timo, thank you in advance. Full log here (1 hour time range) Dec 14 21:19:43 buzon postfix/pipe[27103]: 4423BC7C31: to=<fmcarrasco@domain>, relay=dovecot, delay=0.24, delays=0.03 /0/0/0.2, dsn=2.0.0, status=sent (delivered via dovecot service) Dec 14 21:20:59 buzon dovecot: imap(fmcarrasco): Disconnected: Logged out bytes=556/2245 Dec 14 21:44:30 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 21:44:30 buzon dovecot: imap(fmcarrasco): Disconnected: IMAP session state is inconsistent, please relogin. bytes=42402/3153543 Dec 14 21:45:30 buzon dovecot: imap-login: Login: user=<fmcarrasco>, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=20035, TLS Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Disconnected: IMAP session state is inconsistent, please relogin. bytes=343/8671 Dec 14 22:02:58 buzon dovecot: imap-login: Login: user=<fmcarrasco>, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=2685, TLS Dec 14 22:13:46 buzon dovecot: lda(fmcarrasco): sieve: msgid=<f81a253ebaceca9bf0a6635027e4d747s>: stored mail into mailbox 'INBOX' Dec 14 22:13:46 buzon postfix/pipe[21152]: AAD36C8501: to=<fmcarrasco>, relay=dovecot, delay=0.34, delays=0.03/0.01/0/0.31, dsn=2.0.0, status=sent (delivered via dovecot service) The other one: Dec 14 20:53:38 buzon dovecot: pop3(cfp): Connection closed top=0/0, retr=0/0, del=0/3605, size=446902389 Dec 14 21:38:34 buzon postfix/qmgr[4015]: A90CFC7C31: from=<scet2012a(a)confcfp.org>, size=23256, nrcpt=1 (queue active) Dec 14 21:43:00 buzon postfix/qmgr[4015]: E7E61C7DED: from=<scet2012a(a)confcfp.org>, size=23244, nrcpt=1 (queue active) Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=32118/127014 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox Trash Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Trash/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=38097/309083 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox Preinscripcion Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Preinscripcion/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=33263/164275 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Emagister/dovecot.index reset, view is now inconsistent Dec 14 21:50:38 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=35437/111594 Dec 14 21:50:38 buzon dovecot: imap-login: Login: user=<cfp>, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=24811, TLS Dec 14 21:50:39 buzon dovecot: imap-login: Login: user=<cfp>, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=24822, TLS Dec 14 21:52:12 buzon postfix/cleanup[21212]: 9A22CC816C: message-id=<CAP3xem+Vzw4b_dmDnr=ajn9cfpA8TNotxAVbkM5xoBzxPfu_bQ(a)mail.gmail.com> Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=554/169764 Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Trash/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=533/10963 Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Preinscripcion/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=629/39790 Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Disconnected: IMAP session state is inconsistent, please relogin. bytes=613/496956 Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=<cfp>, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=464, TLS Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=<cfp>, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=465, TLS Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=<cfp>, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=466, TLS Dec 14 22:00:27 buzon dovecot: imap-login: Login: user=<cfp>, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=467, TLS Dec 14 22:30:28 buzon dovecot: pop3-login: Login: user=<cfp>, method=PLAIN, rip=192.168.1.13, lip=192.168.4.80, mpid=25194 I do not see any pattern about this problem of index reset, logs from other day, maybe the problem is I/O load based: Dec 15 13:16:06 buzon dovecot: imap(ehlers): Connection closed bytes=357/20249 Dec 15 13:16:06 buzon dovecot: imap(ehlers): Connection closed bytes=70/12804 Dec 15 13:16:12 buzon dovecot: imap-login: Login: user=<ehlers>, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=1005 Dec 15 13:16:12 buzon dovecot: imap(ehlers): Connection closed bytes=103/818 Dec 15 13:16:19 buzon dovecot: imap-login: Login: user=<ehlers>, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=1419 Dec 15 13:16:19 buzon dovecot: imap(ehlers): Error: Mailbox Archivador/Facultad/curso whiteboard: Corrupted index, uidvalidity=0 Dec 15 13:16:19 buzon dovecot: imap(ehlers): Warning: mdbox /buzones/domain/11/53/ehlers/storage: rebuilding indexes Dec 15 13:16:19 buzon dovecot: imap-login: Login: user=<ehlers>, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=1426 Dec 15 13:16:19 buzon dovecot: imap(ehlers): Connection closed bytes=459/3205 Dec 15 13:16:32 buzon dovecot: imap(ehlers): Error: /indices_dovecot/indices/11/53/ehlers/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 15 13:16:32 buzon dovecot: imap(ehlers): Disconnected: IMAP session state is inconsistent, please relogin. bytes=195/963 Dec 15 13:16:32 buzon dovecot: imap-login: Login: user=<ehlers>, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=2006 Dec 15 13:16:32 buzon dovecot: imap(ehlers): Connection closed bytes=274/80860 Dec 15 13:16:49 buzon dovecot: imap-login: Login: user=<ehlers>, method=PLAIN, rip=192.168.1.150, lip=192.168.4.80, mpid=2735 Any idea? Regards Maria On Wed, 2011-12-14 at 22:10 +0100, Maria Arrea wrote: > I have seen some strange error log messages in our dovecot server (2.0.15, RHEL 5.7x64, mdbox+zlib, local storage, high load) > > Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent > Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent These messages shouldn't appear alone. Is there anything else logged about them? > Dec 14 20:56:46 buzon dovecot: imap(rcam): Error: Corrupted index cache file /indices_dovecot/indices/03/6b/rcam/mailboxes/INBOX/dovecot.index.cache: Broken virtual size for mail UID 132197 Possibly related to zlib.. Again it should have logged another error message just before this. > Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox INBOX Possibly related to other errors. So .. none of the errors above really were what I'd call the actual cause of the problems. They were just after effects. > I have been googling without luck, why does this happen? I have tried with doveadm force-resync, maybe this could solve this issues. All of those should be fixed automatically. Do they keep happening if you don't do force-resync? How often do they happen anyway? Do they happen at any specific times (e.g. during doveadm purge)?

2 1

[Dovecot] dovecot penalties and anvil
by Leonardo Rodrigues 20 Dec '11

20 Dec '11

Hi, I'm strugling to find some documentation on dovecot's anvil service and/or its penalties (that can be checked with doveadm penalty) ... but i'm not finding anything on that. is there any documentation on anvil/penalties that i should check other than a few messages on the mailing list archive ? thanks ! -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, NÃO mandem email gertrudes(a)solutti.com.br My SPAMTRAP, do not email it

2 1

[Dovecot] Dovecot 2.1rc1 + 2.0.16 woes regarding fts_squat
by Robin 20 Dec '11

20 Dec '11

I can confirm the report posted in http://dovecot.org/list/dovecot/2011-November/062263.html that fts_squat no longer seems to be used after moving from 2.0.16->2.1 rc 1. I don't see crash reports in the logs, just "0 messages indexed". My search test tool just does a normal IMAP SEARCH for a long non-existent string. If there's another way to trigger re-indexing in 2.1, I don't see anything in the documentation for it. I've enabled mail_debug, but no log entries that shed light on the problem are available. Has the configuration for fts_squat changed? If anyone has a working fts_squat setup with Dovecot 2.1rc1, I'd appreciate hearing how you have it setup and working. During a large mail import with 2.0.16 today, I ran across a worrying message in the logs during an fts_squat reindex: out of memory. The plugin doesn't obey the mmap_disable configuration directive, which I've confirmed in the plugin source. The mailbox in question has only 17GB (mdbox style), with about 90,000 emails in it. Its "index" (for the purposes of normal IMAP retrieval as opposed to IMAP TEXT/BODY searching) is fine and uncorrupted. I freshly import these mailboxes between test iterations and any version changes anyway, so if there's corruption, it's happening within dovecot only. I'm using use Mail::IMAPClient to create + append mail over localhost, not any direct mdbox conversion trickery. In looking through the code, I see that mmap() is called for the *ENTIRE FILE*, which is guaranteed to fail on large indexes. I assume this was done out of expedience, but it's a "risky" sort of thing to do in a server process, even if 8GB RAM systems do seem to grow on trees. I intend to put this to work in a large installation (>10K users), so this IS of some concern for me in the long-term. Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: mremap_anon(188084224) failed: Cannot allocate memory Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: read(.../mdbox/mailboxes/INBOX2010/dbox-Mails/dovecot.index.search.uids) failed: Cannot allocate memory Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: mremap_anon(188280832) failed: Cannot allocate memory Dec 12 22:48:52 linuxcode dovecot: imap(user1001): Error: read(.../mdbox/mailboxes/INBOX2010/dbox-Mails/dovecot.index.search.uids) failed: Cannot allocate memory Dec 12 22:50:47 linuxcode dovecot: imap(user1001): Error: Corrupted squat uidlist file .../mdbox/mailboxes/INBOX2010/dbox-Mails/dovecot.index.search.uids: uidlist not found ================ dovecot -n output: # 2.0.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.35.7-smp i686 Slackware 13.1.0 auth_mechanisms = plain cram-md5 digest-md5 apop default_vsz_limit = 192 M disable_plaintext_auth = no first_valid_gid = 100 hostname = linuxcode info_log_path = /tmp/dovecot.log last_valid_gid = 60000 last_valid_uid = 60000 listen = * mail_location = mdbox:~/mdbox mail_plugins = " zlib acl" mdbox_preallocate_space = yes mdbox_rotate_interval = 1 days mmap_disable = yes passdb { args = scheme=plain /etc/cram-md5.pwd driver = passwd-file } plugin { acl = vfile } postmaster_address = postmaster@linuxcode quota_full_tempfail = yes service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 0 vsz_limit = 64 M } service imap { vsz_limit = 512 M } service lmtp { unix_listener lmtp { mode = 0666 } } ssl = no userdb { args = blocking=no driver = passwd } protocol lmtp { mail_plugins = " zlib acl" } protocol imap { mail_plugins = " zlib acl fts fts_squat imap_acl imap_zlib" plugin { fts = squat fts_squat = partial=4 full=10 } } ================ CONFIGURE ================ LIBS=-lnsl CFLAGS='-O2 -march=core2 -mtune=core2 -fstack-protector -fomit-frame-pointer' \ CXXFLAGS='-O2 -march=core2 -mtune=core2 -fstack-protector -fomit-frame-pointer' \ LDFLAGS=-s ./configure --prefix=/usr --sysconfdir=/etc \ --with-mysql --with-sqlite --with-pgsql --without-pam --with-sql \ --with-libwrap --with-libcap -with-ssl=openssl --with-solr \ --with-mem-align=16 --with-bzlib --with-zlib --localstatedir=/var ================ OS: Slackware 13.1 (32-bit, 2GB physical RAM, kernel setup for 2G/2G split) fully patched up =R=

2 1

[Dovecot] Question about index reset in dovecot 2.0.15
by Maria Arrea 20 Dec '11

20 Dec '11

I have seen some strange error log messages in our dovecot server (2.0.15, RHEL 5.7x64, mdbox+zlib, local storage, high load) Dec 14 22:01:27 buzon dovecot: imap(fmcarrasco): Error: /indices_dovecot/indices/07/47/fmcarrasco/mailboxes/INBOX/dovecot.index reset, view is now inconsistent Dec 14 22:00:27 buzon dovecot: imap(cfp): Error: /indices_dovecot/indices/16/58/cfp/mailboxes/Sent/dovecot.index reset, view is now inconsistent Dec 14 20:56:46 buzon dovecot: imap(rcam): Error: Corrupted index cache file /indices_dovecot/indices/03/6b/rcam/mailboxes/INBOX/dovecot.index.cache: Broken virtual size for mail UID 132197 Dec 14 21:50:38 buzon dovecot: imap(cfp): Error: Recent flags state corrupted for mailbox INBOX I have been googling without luck, why does this happen? I have tried with doveadm force-resync, maybe this could solve this issues. doveconf -n output # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-274.7.1.el5 x86_64 Red Hat Enterprise Linux Server release 5.7 (Tikanga) ext4 auth_cache_negative_ttl = 10 secs auth_cache_size = 10 M auth_cache_ttl = 2 mins auth_master_user_separator = * auth_mechanisms = plain login auth_worker_max_count = 3500 base_dir = /var/run/dovecot/ default_client_limit = 5000 default_process_limit = 6500 disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep delay-newmail tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_fsync = never mail_gid = entrega mail_home = /buzones/domain/%2.26Hn/%2.200Hn/%n/home_usuario/ mail_location = mdbox:/buzones/domain/%2.26Hn/%2.200Hn/%n:INDEX=/indices_dovecot/indices/%2.26Hn/%2.200Hn/%n mail_max_userip_connections = 15000 mail_plugins = " zlib acl quota autocreate" mail_uid = entrega managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mdbox_rotate_interval = 1 days mdbox_rotate_size = 60 M passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/usuario_maestro.txt driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { acl = vfile autocreate = SPAM autocreate2 = Sent autocreate3 = Drafts autocreate4 = Trash autosubscribe = SPAM autosubscribe2 = Sent autosubscribe3 = Drafts autosubscribe4 = Trash lda_mailbox_autosubscribe = yes quota = dict:Cuota de usuario::file:/buzones/cuotas/%n quota_rule2 = Trash:storage=+10%% quota_warning = storage=90%% aviso_cuota 90 %u sieve = /buzones/domain/%2.26Hn/%2.200Hn/%n/home_usuario/dovecot.sieve sieve_dir = /buzones/domain/%2.26Hn/%2.200Hn/%n/home_usuario/sieve/ zlib_save = gz zlib_save_level = 9 } pop3_no_flag_updates = yes protocols = pop3 imap sieve service anvil { client_limit = 25000 } service auth { client_limit = 28000 unix_listener auth-master { user = entrega } unix_listener auth-userdb { user = entrega } user = root } service aviso_cuota { executable = script /usr/local/bin/quota-warning.sh unix_listener aviso_cuota { mode = 0666 } user = entrega } service imap-login { executable = /usr/libexec/dovecot/imap-login group = dovenull service_count = 0 vsz_limit = 1 G } service imap { executable = /usr/libexec/dovecot/imap process_limit = 6000 } service managesieve-login { executable = /usr/libexec/dovecot/managesieve-login inet_listener sieve { port = 2000 } process_limit = 2000 vsz_limit = 1 G } service managesieve { executable = /usr/libexec/dovecot/managesieve process_limit = 5000 } service pop3-login { executable = /usr/libexec/dovecot/pop3-login process_limit = 4000 service_count = 0 vsz_limit = 1 G } service pop3 { executable = /usr/libexec/dovecot/pop3 process_limit = 4000 } ssl_ca = </etc/pki/generico/cacert.crt.pem ssl_cert = </etc/pki/generico/wildcard-us_es.crt ssl_key = </etc/pki/generico/wildcard-key.pem userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf driver = ldap } verbose_proctitle = yes protocol sieve { managesieve_implementation_string = dovecot managesieve_logout_format = bytes=%i/%o managesieve_max_line_length = 65536 } protocol lda { hostname = domain info_log_path = log_path = mail_fsync = optimized mail_plugins = sieve zlib quota postmaster_address = evcorreo@domain syslog_facility = mail } protocol imap { mail_plugins = zlib autocreate quota imap_quota } protocol pop3 { mail_plugins = zlib pop3_enable_last = yes pop3_uidl_format = %g } Regards Maria

2 1

[Dovecot] doveadm quota does not list all accounts
by Nikolaos Milas 20 Dec '11

20 Dec '11

Hello, I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7. All accounts are virtual, hosted on LDAP Server. My problem is that the command: doveadm quota get -A stopped listing all accounts. I think this problem started after I changed in LDAP lookup configuration from "scope = subtree" to "scope = onelevel", because it did not occur before (I did no other changes). Now, the above command only lists 12 accounts. If I query for a particular user: doveadm quota get -u userx this works fine, but userx (and all users except those 12) is NOT listed when trying to display all users. How can I run the above command without problems again? Thanks in advance, Nick

3 12

[Dovecot] Quota PostgreSQL INSERT trigger
by Adis Nezirovic 20 Dec '11

20 Dec '11

Wiki instructions for creating insert trigger for PostgreSQL are wrong http://wiki.dovecot.org/Quota/Dict Calling INSERT on the table from within BEFORE INSERT trigger creates cascading trigger. http://www.postgresql.org/docs/current/interactive/trigger-definition.html Instead, one should return NEW record from the trigger, and it will be inserted after trigger execution. --- CREATE OR REPLACE FUNCTION merge_quota2() RETURNS TRIGGER AS $$ BEGIN IF NEW.messages < 0 OR NEW.messages IS NULL THEN -- ugly kludge: we came here from this function, really do try to insert IF NEW.messages IS NULL THEN NEW.messages = 0; ELSE NEW.messages = -NEW.messages; END IF; return NEW; END IF; LOOP UPDATE quota2 SET bytes = bytes + NEW.bytes, messages = messages + NEW.messages WHERE username = NEW.username; IF found THEN RETURN NULL; END IF; BEGIN IF NEW.messages = 0 THEN RETURN NEW; ELSE NEW.messages = - NEW.messages; RETURN NEW; END IF; EXCEPTION WHEN unique_violation THEN -- someone just inserted the record, update it END; END LOOP; END; $$ LANGUAGE plpgsql; DROP TRIGGER IF EXISTS mergequota2 ON quota2; CREATE TRIGGER mergequota2 BEFORE INSERT ON quota2 FOR EACH ROW EXECUTE PROCEDURE merge_quota2(); --- Best regards, Adis

2 1

[Dovecot] Tuning Login processes for High-performance Mode
by Alessio Cecchi 20 Dec '11

20 Dec '11

Hi, I'm working for tuning a busy cluster of dovecot servers. Heach server as 4 core, 8GB of RAM and provide POP3 and IMAP access to mailbox. OS is Debian 6.0 and dovecot version is 1.2.15. I am unsure how to set "login_max_processes_count" and "login_max_connections" for reach the best situation when login_process_per_connection is set to no. I don't know what value to set login_max_processes_count. For example is better the first or the second configuration? login_process_per_connection=no login_processes_count=4 login_max_processes_count=8 login_max_connections=512 login_process_size=128 login_process_per_connection=no login_processes_count=4 login_max_processes_count=16 login_max_connections=256 login_process_size=128 Which is a suggested ratio from login_max_processes_count and login_max_connections ? Other values are correct? Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it @ LOLUG -> Socio http://www.lolug.net

2 4

[Dovecot] Calculation of suggested vsz_limit values
by Nikolaos Milas 20 Dec '11

20 Dec '11

Hello, I would like to ask on suggested vsz_limit values. Is there any way of calculating such values? How should we determine them? I don't want to risk wrong values (and possible errors) on a production system, if I upgrade to 2.0.16 where vsz_limit values are enforced (I read release notes)! If there is no standard way of calculation, could someone please check the following info and suggest some values? I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7 (as a VM on a KVM Host). All accounts are virtual, hosted on LDAP Server. We have about 250 mailboxes of 4GB each (in practice, only a couple of mailboxes ever reach 1GB so we are "over-booking"). It is a relatively low-load server. Memory status and config follows below. Thanks, Nick The server memory condition is as follows: # vmstat procs -----------memory---------- ---swap-- -----io---- --system-- -----cpu------ r b swpd free buff cache si so bi bo in cs us sy id wa st 0 0 92 62400 212324 1299604 0 0 397 235 70 39 4 2 89 4 0 # free -m total used free shared buffers cached Mem: 2010 1951 59 0 207 1269 -/+ buffers/cache: 474 1536 Swap: 2015 0 2015 ---------- Config Start ------------- # 2.0.13: dovecot.conf protocols = imap pop3 mail_location = maildir:~/Maildir/ mail_gid = 500 mail_uid = 500 auth_mechanisms = plain login auth_username_format = %Lu auth_verbose = yes disable_plaintext_auth = no mail_plugins = quota protocol imap { imap_client_workarounds = "delay-newmail " mail_plugins = quota imap_quota } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = log_path = mail_plugins = quota postmaster_address = sysadmin(a)example.com sendmail_path = /usr/lib/sendmail } userdb { args = /etc/dovecot/dovecot-usrdb-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-passdb-ldap.conf driver = ldap } plugin { quota = maildir:User quota quota_rule = *:storage=4G quota_rule2 = Trash:storage=+3%% quota_warning = storage=75%% quota-warning 75 %u quota_warning2 = storage=90%% quota-warning 90 %u } service quota-warning { executable = script /opt/mail1.sh user = vmail unix_listener quota-warning { user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = root } service imap-login { service_count = 1 vsz_limit = 64 M } service pop3-login { service_count = 1 vsz_limit = 64 M } ssl_ca = </etc/pki/CA/certs/chain.pem ssl_cert = </etc/pki/CA/certs/cert.pem ssl_key = </etc/pki/CA/private/key.pem syslog_facility = local1 ---------- Config End -------------

3 4

[Dovecot] Strange Login / Timeout Sessions
by Carlos Mennens 20 Dec '11

20 Dec '11

I have my webmail application tied to Postfix / Dovecot server & now for some reason the IMAP sessions oddly time out throughout the day and then logging back into the mail system over the web is painfully slow. The only thing I've seen that fixes it is to reload the Dovecot daemon in Linux: /etc/init.d/dovecot reload Once that command is ran, my webmail login is super fast and moving from folder to folder is extremely fast again. Then in about a few hours, the session will time out and this problem repeats. The problem is the same for everyone and not just a few user accounts. Anyone have any idea what I should be looking for or looking at? My Dovecot logs or mixed in /var/log/maillog which is extremely hard to watch live & gets mixed with Postfix, Amavisd, and Postgrey. Any ideas or suggestions to narrow this problem out? I'm running Dovecot-1.0.7-7.el5_7.1. I saw this load on the console today: Error: Dovecot is already running with PID 2334 (read from /var/run/dovecot/master.pid) Fatal: Invalid configuration in /etc/dovecot.conf Below is my configuration file: [root@mail ~]# dovecot -n # 1.0.7: /etc/dovecot.conf protocols: imap ssl_ca_file: /etc/ssl/certs/digicert.crt ssl_cert_file: ***OMIT*** ssl_key_file: ***OMIT*** login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: maildir:~/Maildir auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix

2 1

[Dovecot] One important question!
by I M 19 Dec '11

19 Dec '11

Hello!Please, give me a feedback as soon as you can! I need some advice regarding "dovecot self signed certificate" configuration!If you have any experience in working with php IMAP-module that would be useful for me to know what would you say about below: Problem: I can connect to my INBOX through telnet, but I cannot do it through imap-functions (Certificate failure for ...)? My best,Edward.

3 3

[Dovecot] Two important new Pigeonhole v0.3 features
by Stephan Bosch 19 Dec '11

19 Dec '11

Hello Dovecot users, Pigeonhole v0.3 for Dovecot v2.1 has two new features I would like you to play with before I make a first release: 1) The new Sieve editheader extension (http://tools.ietf.org/html/rfc5293) This allows modifying the headers of the message before delivery. This is actually the first implemented extension that can modify the message itself in any way. This feature adds quite a bit of new code that I'd like to see tested more thoroughly. 2) The new sieve-filter tool (documented in the sieve-filter(1) man page upon installation). This allows (re-)filtering messages that are already stored in a particular mailbox. It preserves the assigned IMAP flags and keywords and using the imap4flags extension these can also be modified. It also plays nice with the editheader extension. Judging by postings in this mailing list from the last few years, this is a highly-demanded feature and I'm glad that I finally got around to finish this thing. If the new sieve-filter tool is lacking certain features in your opinion, just let me know. Needless to say: read the man page carefully and watch out with important mail. This is currently only available from the mercurial repository, but if you prefer to have an .rc1 release first, just tell me and I'll make one. The automatic Debian repository already includes these features. Regards, Stephan.

3 4

[Dovecot] IMAP and sieve
by moozer 19 Dec '11

19 Dec '11

I am currently setting up an IMAP server for archiving purposes. The goal is to drag an email to the IMAP folder, and then have a server-side sieve script to put it in the right folder. One of the sources used was this wiki entry http://wiki.dovecot.org/LDA/Sieve/Dovecot I added the mail_plugins = sieve to /etc/dovecot/15-lda.conf and after some exim4 fiddling, mails delivered are filtered by my sieve script. Doing the same for imap delivery (in /etc/dovecot/20-imap.conf) give the following error Dec 19 10:22:09 leon dovecot: imap: Error: dlopen(/usr/lib/dovecot/modules/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_save_open Dec 19 10:22:09 leon dovecot: imap: Error: Can't load plugin sieve_plugin: Plugin is intended to be used only by binaries: lda lmtp (we're imap) Dec 19 10:22:09 leon dovecot: imap: Fatal: Couldn't load required plugins Dec 19 10:22:10 leon dovecot: imap: Error: dlopen(/usr/lib/dovecot/modules/lib90_sieve_plugin.so) failed: /usr/lib/dovecot/libdovecot-sieve.so.0: undefined symbol: mail_deliver_save_open Dec 19 10:22:10 leon dovecot: imap: Error: Can't load plugin sieve_plugin: Plugin is intended to be used only by binaries: lda lmtp (we're imap) Dec 19 10:22:10 leon dovecot: imap: Fatal: Couldn't load required plugins I notice this part: "plugin is intended to be used only by binaries: lda lmtp (we're imap)" So the question is if it is possible to run sieve server-side sieve scripts on emails copied using IMAP. Suggestions are most welcome. Moozer -- I am running debian testing # dovecot --version 2.0.15

2 2

[Dovecot] DKIM Verification failures
by Nikolaos Milas 18 Dec '11

18 Dec '11

Hi, -- This message refers to the maillist itself rather than to dovecot software -- I have noticed that when I post to this list (only), I get DKIM Verification failure reports from: root(a)moncton.sidefx.com (e.g. for my last post: "DKIM failure report for job 4D27B5DC4E on mail.sidefx.com") root(a)mail.rmacd.com (e.g. for my last post: "DKIM failure report for job B69B3187F1 on mail.rmacd.com") root(a)mx0.roessner-net.de (e.g. for my last post: "DKIM failure report for job 6103B52092 on mx0.roessner-net.de") I have not had other DKIM failure reports from anywhere and I know that we should not have issues with it. An example from gmail: Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of nmilas(a)noa.gr designates 195.251.204.235 as permitted sender) smtp.mail=nmilas(a)noa.gr; dkim=pass header.i=(a)noa.gr So, whom should I contact to investigate this problem? Thanks, Nick

3 3

[Dovecot] logging deletion of emails through IMAP?
by John Brock 16 Dec '11

16 Dec '11

Version 1.2.16: Is there some way to enable logging for when emails are deleted via IMAP? All I see are log entries for users logging in/logging out. It would be nice to know when an email is deleted, and from which IP address the user was logged in when s/he deleted the email. -- John Brock Adeptive Software 303-554-0301 x1

2 1

[Dovecot] simultaneous scripts not running via sieve_before
by Scott Lewis 16 Dec '11

16 Dec '11

Hi again everyone, So I've finally got sieve integration happening on my REHL Postfix/Dovecot server, with private user scripts happily running when users create them. (we user SquirrelMail, so the avelsieve plugin runs the sieve integration). Now I'd like to utilise additional per-user scripts (probably via sieve_before), but I've not been able to get my additional scripts to execute. I am doing the following: a) getting avelsieve to write my redirect script (ie. logging on as user, completing private script wizard, and activating it) b) compiling .dovecot.sieve with sievec c) copying the resultant .dovecot.svbin to sieve/ directory (and renaming it eg redirect.svbin still, it appears that each /home/%u/.dovecot.sieve file is the only one taking effect. Any thoughts on how to make the other ones active? (The idea behind this is to automatically forward all of joeuser@mydomain's incoming mail to somewhere like joeusersbackup(a)gmail.com, for backup reasons. One day, I'll work out how to configure postfix to do this for all outgoing email too, but that's for another day :) Below are what my .conf files look like. Thanks in advance, Scott /etc/dovecot.conf: [code] protocols = imap imaps managesieve listen = * protocol imap { #mail_plugins = sieve quota } ## ## ManageSieve specific settings ## protocol managesieve { # debugging mail_debug = yes #login_executable = /usr/libexec/dovecot/managesieve-login #mail_executable = /usr/libexec/dovecot/managesieve #managesieve_max_line_length = 65536 #managesieve_logout_format = bytes ( in=%i : out=%o ) #managesieve_implementation_string = Cyrus timsieved v2.2.13 } protocol lda { mail_plugins = sieve quota sieve=~/.dovecot.sieve sieve_extentions = +include sieve_dir=~/sieve sieve_before = /home/%u/sieve/redirect.svbin sieve_global_path = /etc/globalsieverc.svbin [/code]

3 3

[Dovecot] Autosubscribe new folders
by For＠ll 15 Dec '11

15 Dec '11

Hi, I have a sieve filter: require ["fileinto","reject","body"]; if header :contains "subject" "NOTE" { if body :content "application/pdf" :contains "" { redirect "notes(a)domena.com"; } else { reject text: Lack attachment PDF! . ; stop; } } When I get a new message, in user folder is automaticly created folder like subject but is not subscribed. What I must settings in dovecot to automaticly subscribe folders to subscriptions files.?

3 4

[Dovecot] dovecot-antispam: pipe backend with spamc failing to parse args
by Micah Anderson 15 Dec '11

15 Dec '11

I'm trying to get the pipe backend to work with the new dovecot-antispam (I was very pleased to see the new version, thanks Johannes!) Before I would run the following over the maildir: spamc -d 10.0.1.109 -L ham < $file 2>&1 > /dev/null now, i'm using dovecot-antispam and mdbox and have the following configured: antispam_backend = pipe antispam_signature = X-Spam-Flag antispam_signature_missing = error antispam_trash_pattern = trash;Trash;Deleted * antispam_spam_pattern_ignorecase = SPAM antispam_pipe_tmpdir = /var/tmp antispam_pipe_program_spam_arg = -L spam antispam_pipe_program_notspam_arg = -L ham antispam_pipe_program = /usr/bin/spamc antispam_pipe_program_args = -d 10.0.1.109 Now, when I move a message to Spam, dovecot-antispam detects it and attempts to run, but it fails: Dec 14 16:22:45 grosbeak [username 10.0.1.74 uid]: antispam: run program failed with exit code 64 Exit code 64 is spamc's exit code for "command line usage error" - but I can't see exactly the command that is being constructed by dovecot-antispam to know where the error is. Any ideas? micah --

2 1

[Dovecot] Quota warnings not being sent
by Nikolaos Milas 14 Dec '11

14 Dec '11

Hello, I am running dovecot-2.0.13-1_128.el5 x86_64 RPM on CentOS 5.7 with the config shown below. All accounts are virtual, hosted on LDAP Server. My problem is that the quota warning mail is not sent as expected. For example, in the logs I get: Dec 12 08:42:40 vmail dovecot: lda(imaptester): Error: quota: net_connect_unix(/var/run/dovecot/quota-warning) failed: Permission denied (euid=500(vmail) egid=500(vmail) missing +r perm: /var/run/dovecot/quota-warning, euid is not dir owner) Here is /var/run/dovecot/: # ls -la /var/run/dovecot/ total 32 drwxr-xr-x 4 root dovecot 4096 Dec 9 21:27 . drwxr-xr-x 23 root root 4096 Dec 14 12:27 .. srw------- 1 root root 0 Dec 9 21:27 anvil srw------- 1 root root 0 Dec 9 21:27 anvil-auth-penalty srw------- 1 root root 0 Dec 9 21:27 auth-client srw------- 1 dovecot root 0 Dec 9 21:27 auth-login srw-rw---- 1 vmail vmail 0 Dec 9 21:27 auth-master srw------- 1 root root 0 Dec 9 21:27 auth-userdb srw------- 1 dovecot root 0 Dec 9 21:27 auth-worker srw------- 1 root root 0 Dec 9 21:27 config srw------- 1 root root 0 Dec 9 21:27 dict srw------- 1 root root 0 Dec 9 21:27 director-admin srw-rw-rw- 1 root root 0 Dec 9 21:27 dns-client srw------- 1 root root 0 Dec 9 21:27 doveadm-server lrwxrwxrwx 1 root root 25 Dec 9 21:27 dovecot.conf -> /etc/dovecot/dovecot.conf drwxr-xr-x 2 root root 4096 May 17 2011 empty drwxr-x--- 2 root dovenull 4096 Dec 9 21:27 login -rw------- 1 root root 5 Dec 9 21:27 master.pid srw------- 1 root root 0 Dec 9 21:27 quota-warning Follows my config (at the end of this message). How should I change permissions to resolve the issue? Would it be enough to change ownership of the whole directory /var/run/dovecot/ and its contents to vmail:vmail? What configuration directives determine the ownership and the access permissions for these sockets? Please advise. Thanks in advance, Nick ------------------------------------------ # 2.0.13: dovecot.conf protocols = imap pop3 mail_location = maildir:~/Maildir/ mail_gid = 500 mail_uid = 500 auth_mechanisms = plain login auth_username_format = %Lu auth_verbose = yes disable_plaintext_auth = no mail_plugins = quota protocol imap { imap_client_workarounds = "delay-newmail " mail_plugins = quota imap_quota } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = log_path = mail_plugins = quota postmaster_address = sysadmin(a)example.com sendmail_path = /usr/lib/sendmail } userdb { args = /etc/dovecot/dovecot-usrdb-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-passdb-ldap.conf driver = ldap } plugin { quota = maildir:User quota quota_rule = *:storage=4G quota_rule2 = Trash:storage=+3%% quota_warning = storage=75%% quota-warning 75 %u quota_warning2 = storage=90%% quota-warning 90 %u } service quota-warning { executable = script /opt/mail1.sh user = root unix_listener quota-warning { } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = root } service imap-login { service_count = 1 vsz_limit = 64 M } service pop3-login { service_count = 1 vsz_limit = 64 M } ssl_ca = </etc/pki/CA/certs/chain.pem ssl_cert = </etc/pki/CA/certs/cert.pem ssl_key = </etc/pki/CA/private/key.pem syslog_facility = local1 ---------------------------------------------

4 7

Re: [Dovecot] Backing Up To Windows File Server
by Luigi Rosa 14 Dec '11

14 Dec '11

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Asai said the following on 14/12/11 17:52: > Thanks, Luigi, I may fall back to that. Should you need it, here's the script I use to do it. In my configurations /var/spool/mail contains one dir for each domain and each of that dir contains a maildir for each domain. So the email of foobar(a)acme.com is in /var/spool/mail/acme.com/foobar/ The 4th line checks lost&found because /bar/spool/mail is a different file system. I create the .tgz file on local /tmp for performance reasons. TARGET=/backup for DOMAINPATH in /var/spool/mail/* do if [ "${DOMAINPATH}" != "/var/spool/mail/lost+found" ] then DOMAIN=`echo $DOMAINPATH | cut -d '/' -f 5` for USERPATH in ${DOMAINPATH}/* do USER=`echo $USERPATH | cut -d '/' -f 6` tar cvzf /tmp/$DOMAIN-$USER.tgz $USERPATH > /dev/null cp -f /tmp/$DOMAIN-$USER.tgz $TARGET/mail rm -f /tmp/$DOMAIN-$USER.tgz done fi done Ciao, luigi - -- / +--[Luigi Rosa]-- \ I don't think we have the right or the wisdom to interfere, however a planet is evolving. --James Kirk, "The Omega Glory" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk7o3jYACgkQ3kWu7Tfl6ZSfpQCgvzhOJH6mnJMu8ZzvKu5y8um+ 46wAoKd0eXxBNPad9EZao7VKjZBkACer =dhk0 -----END PGP SIGNATURE-----

1 0

[Dovecot] Two recent issues
by Brad Schuetz 14 Dec '11

14 Dec '11

I've been using dovecot for years, been working great. However recently I've come across two issues. The first issue unfortunately I have little information on, mail_debug hasn't provided anything useful either (in fact it looks like the login request that fails doesn't even get logged at all). During the morning rush of email, this server has around 11k mailboxes on it, it *appears* that one of the auth processes dies resulting in "dovecot: imap-login: Error: read(imap) failed: Connection reset by peer" errors followed by "dovecot: imap-login: Internal login failure ..." in the logs. I've yet to get any useful debugging information on this error so I'm not expecting much/any help on this one, but if anyone has any ideas on how I can get more debug besides running strace 24/7 in the hopes it catches something before the hard drive is full of strace output I'd love to hear it. The best I've gotten was a lucky strace once (at the time I didn't realize it was so lucky or I would have saved the output) that indicated the imap-login daemon was failing to connect to the auth process. The second issue is lmtp/lda (tried both) delivery to a mailbox that has filesystem quotas enabled and the group quota is maxed is resulting in the below panic and crash. This issue happens with 2.0.13, 2.0.15 and 2.0.16. Here's the logs showing that it knows the disk quota is exceeded and then a subsequent zlib panic. Like it's trying to deliver it anyway. --------------------- 11:21:07 [err] dovecot: lmtp(29691, admin(a)[redacted].com) Error: o_stream_send_istream(/email/d/r/[redacted]/[redacted]/admin/Maildir/tmp/1323458467.M245978P29691.fenrir.omnis.com) failed: Disk quota exceeded 11:21:07 [crit] dovecot: lmtp(29691, admin(a)[redacted].com) Panic: file ostream-zlib.c: line 144 (o_stream_zlib_send_flush): assertion failed: (zs->avail_in == 0) 11:21:07 [err] dovecot: lmtp(29691, admin(a)[redacted].com) Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 [0x345443ca90] -> /usr/lib64/dovecot/libdovecot.so.0 [0x345443cae6] -> /usr/lib64/dovecot/libdovecot.so.0 [0x345443c4a3] -> /usr/lib64/dovecot/lib20_zlib_plugin.so [0x2ba2d31547f6] -> /usr/lib64/dovecot/lib20_zlib_plugin.so [0x2ba2d315481b] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_flush+0x2a) [0x345444f0ea] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_save_finish+0x6b) [0x3451c63b6b] -> /usr/lib64/dovecot/lib10_quota_plugin.so [0x2ba2d2f4ce7a] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_save_finish+0x30) [0x3451c2fbb0] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xb3) [0x3451c2aae3] -> /usr/lib64/dovecot/libdovecot-storage.so.0(maildir_copy+0x56) [0x3451c6fd36] -> /usr/lib64/dovecot/lib10_quota_plugin.so [0x2ba2d2f4d0ba] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_copy+0x5a) [0x3451c301ba] -> /usr/lib64/dovecot/li 11:21:07 [err] dovecot: master: Error: service(lmtp): child 29691 killed with signal 6 (core dumps disabled) --------------------- Attached is the current "doveadm config" output. -- Brad Schuetz

2 2

Re: [Dovecot] Questions about single intance storage
by Maria Arrea 13 Dec '11

13 Dec '11

Hello Timo. If we can not safely restore from backup a user's mailbox with SiS enabled, we can not enable SiS. Any plan to include this backup recovery tool in dovecot 2.0.X or 2.1? Regards Maria > 5º We use bacula to save indexes & mdboxes, and we recover mailboxes using doveadm import when a user "makes a fatal mistake" wiping all her Inbox. If we enable SiS I am not really sure how can we safely restore a user's INBOX if that user has SiS attachments. Hm. Yes, that is problematic.. Even if you knew what SIS files were used, there's no simple way to restore those with proper refcounts. I think what really should be done is writing a tool that can create/restore backups, possibly de-SISing the attachments..

9 17

[Dovecot] Panic when attempting index with Apache Solr : fts_solr plugin
by A Dovecot User 13 Dec '11

13 Dec '11

Dovecot version: 2.1.rc1 Expat version: expat-2.0.1-10 Libcurl version: libcurl-7.21.0-10 OS: Fedora 14 i686 Configure command: ./configure --with-solr Solr version: 1.4.1 (also tried 3.5.0) Java version: java-1.6.0-openjdk-1.6.0.0-55.1.9.10 (also tried Oracle Java 6u29) [root@mymailserver ~]# doveadm -D index -u username mailbox inbox doveadm(username): Info: INBOX: Caching mails seq=1..466 doveadm(username): Panic: file solr-connection.c: line 545 (solr_connection_post_more): assertion failed: (maxfd >= 0) doveadm(username): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3b9b1) [0x14b9b1] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x47) [0x14bac7] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x1211ae] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x293) [0xb1a7d3] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x2599) [0xb16599] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_build_more+0x31) [0x2273f1] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x3b2) [0x228272] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xa74e) [0x22d74e] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_precache+0xf) [0x937a6f] -> doveadm() [0x80520b6] -> doveadm() [0x804f4b5] -> doveadm(doveadm_mail_single_user+0x5b) [0x804f8db] -> doveadm() [0x804fd3f] -> doveadm(doveadm_mail_try_run+0x12e) [0x805019e] -> doveadm(main+0x3a4) [0x8056444] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x729e36] -> doveadm() [0x804f2c1] ---------------------- mail_plugins = acl antispam fts fts_solr plugin { fts = solr fts_solr = break-imap-search debug url=http://127.0.0.1:8983/solr/ }

2 3

Re: [Dovecot] Prevent re-download mails
by Francisco Wagner C. Freire 12 Dec '11

12 Dec '11

Hello, The clients re-download the messages on every connection, i current looking for the client versions with this problem. On Mon, Dec 12, 2011 at 3:15 PM, Wouter van der Schagt <wouter(a)vdschagt.com>wrote: > > Looking for more info. > > Even with the same UIDL values, some e-mail clients will still redownload > the messages if a hostname changed. > > Anyway, annoying as it is, after the second download it will stop, you can > ask your users to simply delete the duplicates, it won't download a 3rd > time. > > - WS > >

2 1

[Dovecot] v2.1.rc1 managesieve TLS
by Mike Constabel 12 Dec '11

12 Dec '11

Hi, TLS on imap port 143 works. But if I try TLS on managesieve port 4190, I get no connection. Dec 12 21:16:10 managesieve-login: Info: Disconnected (no auth attempts in 5 secs): rip=192.168.10.117, lip=192.168.10.117, secured Dec 12 21:16:20 managesieve-login: Info: Disconnected (no auth attempts in 5 secs): rip=192.168.10.117, lip=192.168.10.117, TLS handshaking: Disconnected # gnutls-cli --starttls -p 4190 192.168.10.117 Resolving '192.168.10.117'... Connecting to '192.168.10.117:4190'... - Simple Client Mode: "IMPLEMENTATION" "Dovecot Pigeonhole" "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave" "NOTIFY" "mailto" "SASL" "PLAIN LOGIN CRAM-MD5" "STARTTLS" "VERSION" "1.0" OK "Dovecot ready." STARTTLS NO "Begin TLS negotiation now." ^ There is a NO and not an OK... Possible something wrong with my config, but I cannot find something... # doveconf -n # 2.1.rc1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 6.0.3 auth_cache_size = 1 M auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login cram-md5 auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot/dovecot-debug.log default_client_limit = 2600 dict { expire = sqlite:/etc/dovecot/dovecot-dict-expire.conf.ext } disable_plaintext_auth = no hostname = mx4.constabel-it.de info_log_path = /var/log/dovecot/dovecot-info.log log_path = /var/log/dovecot/dovecot.log mail_debug = yes mail_location = mdbox:~/mdbox mail_plugins = quota notify mail_log expire acl mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Archive/2011 { auto = subscribe } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = scheme=PLAIN username_format=%u /etc/imap.userdb driver = passwd-file } plugin { expire = Trash expire2 = Trash/* expire3 = Spam expire_dict = proxy::expire quota = dict:User quota::file:/mailspool1/%d/%n/dovecot-quota quota_rule = *:storage=9000M:messages=1000000 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster@localhost protocols = " imap lmtp sieve pop3" service auth { inet_listener { address = 192.168.10.117 port = 12345 } } service dict { unix_listener dict { group = vmail mode = 0666 } } service imap-login { inet_listener imap { address = 192.168.10.117 port = 143 } inet_listener imaps { address = 192.168.10.117 port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = 192.168.10.117 port = 24 } } service managesieve-login { inet_listener sieve { address = 192.168.10.117 port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { address = 192.168.10.117 port = 110 } inet_listener pop3s { address = 192.168.10.117 port = 995 ssl = yes } } ssl_ca = </etc/postfix/psw-ssl/ssl.ca-bundle ssl_cert = </etc/postfix/psw-ssl/ssl.crt ssl_key = </etc/postfix/psw-ssl/ssl.key userdb { args = username_format=%Lu /etc/imap.userdb driver = passwd-file } protocol lmtp { mail_plugins = quota notify mail_log expire acl sieve } protocol lda { mail_plugins = quota notify mail_log expire acl } protocol imap { imap_logout_format = bytes=%i/%o mail_plugins = quota notify mail_log expire acl imap_quota imap_acl } protocol sieve { mail_debug = yes managesieve_logout_format = bytes=%i/%o } protocol pop3 { mail_plugins = quota notify mail_log expire acl } regards, Mike

2 1

[Dovecot] Saving archive copy of all mail sent/received w/Dovecot+Postfix?
by Andrew M 12 Dec '11

12 Dec '11

I'm running Dovecot 2.0.15 and Postfix 2.7.7 with postfix handing off to Dovecot's LDA. I am hosting multiple virtual domains with multiple users and everything is working. I would now like to create a permanent archive of all sent/received mail with each virtual user's mail saved to its own sent file and received file. This needs to be independent of the user's regular Maildir store since he can't delete or modify the permanent archive. Any suggestions on how to best accomplish this either via postfix or dovecot? Postfix has in main.cf virtual_transport = dovecot and in master.cf dovecot unix - n n - - pipe flags=DRhu user=virtual:virtual argv=/usr/libexec/dovecot /dovecot-lda -d ${recipient} -f ${sender} dovecot uses this: [root@xxx andrew]# dovecot -n # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.35.14-103.fc14.x86_64 x86_64 Fedora release 14 (Laughlin) ext4 auth_mechanisms = plain login cram-md5 disable_plaintext_auth = no mail_location = maildir:/home/vmail/%d/%n/Maildir mbox_write_locks = fcntl passdb { args = scheme=plain username_format=%u /etc/postfix/passwd driver = passwd-file } protocols = imap lmtp service auth { inet_listener { port = 12345 } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0666 } } ssl_cert = </etc/pki/tls/certs/xxx.com.crt ssl_key = </etc/pki/tls/private/xxx.com.key userdb { args = username_format=%u uid=5000 gid=5000 home=/home/vmail/%d/%n driver = static } Thanks, Andrew

1 0

[Dovecot] mail_max_userip_connections=10
by Tom Clark 12 Dec '11

12 Dec '11

Hi, A couple of questions rather than a problem for once! We've got our Dovecot server running smoothly now apart from our MD. He's having problems with mail_max_userip_connections. He has 3 (Phone/Laptop/Tablet) items that all connect to the server at about the same time. Which means he's frequently running over the max_userip_connections. My questions are: Is there anyway of whitelisting an IP so that it can ignore mail_max_userip_connections=10? What should we set mail_max_userip_connections too realistically? 10 seems a bit low? Thanks Tom

6 10

[Dovecot] question regarding postfixadmin
by oni-neko＠gmx.net 12 Dec '11

12 Dec '11

Hello! I hope someone here is already using postfixadmin with dovecot and can help me out =) the install-readme for postfixadmin mentions, that the mail-home should be set to default_mail_env = maildir:/var/mail/vmail/%u/ but my dovecot is already installed and working with another config, namely mail_location = maildir:/var/dovecotmail/%n/Maildir. Do i have to change this, or is postfixadmin able to read this or can i set this value in postfixadmin somewhere? i´d rather avoid moving all mailfolders around just because of that, and unfortunately the paths don´t really lend themself to an easy solution via symlink ^_^ thanks for any replies best regards sil -- Empfehlen Sie GMX DSL Ihren Freunden und Bekannten und wir belohnen Sie mit bis zu 50,- Euro! https://freundschaftswerbung.gmx.de

1 0

[Dovecot] Prevent re-download mails
by Selcuk Yazar 12 Dec '11

12 Dec '11

Hi, today we have a problem our mail server about user accounts. (something about prefetch) anyway i corrected, but some clients re-download emails again. how can i stop this .I've read about some forums about UIDVALIDITY ? is it posibble prevent clients redownload emails with pop3 ? thanks in advance. -- Selçuk YAZAR

3 2

[Dovecot] postlogin script
by Selcuk Yazar 12 Dec '11

12 Dec '11

Hi, I have Postfix + OpenLdap + DoveCot configuration, and it's running succesfuly, i wantto convert users pop3 password NTPassword and LMPassword, so i ne plain passwor dof users, how can i do that. (Normaly using perl's ntlmgen function i convert password , but in plain) thanks in advance

2 5

Re: [Dovecot] IMAP SPECIAL-USE extension
by Alan Brown 12 Dec '11

12 Dec '11

> Date: Wed, 07 Dec 2011 00:49:49 +0200 > From: Timo Sirainen <tss(a)iki.fi> > Subject: Re: [Dovecot] IMAP SPECIAL-USE extension > > I did this: http://hg.dovecot.org/dovecot-2.1/rev/9b9a206395f7 Just to add to the confusion: Pine/Alpine uses "sent-mail" :(

1 0

[Dovecot] Documentation clarifiction on mmap_disable
by Marcio Merlone 12 Dec '11

12 Dec '11

Greetings, On http://wiki.dovecot.org/MainConfig I read: "mmap_disable = no Don't use mmap() at all. This is required if you store indexes to shared filesystems (NFS or clustered filesystem). " Does that mean: 1. mmap is required when using NFS or 2. it is required to don't use mmap at all when using NFS? Sorry if this is obvious. Best regards. -- *Marcio Merlone*

2 1

[Dovecot] database failover
by Nick Edwards 12 Dec '11

12 Dec '11

Trying to get dovecot to _only_ use local copy of database, only querying another database server (same database, just replicated) if local copy is not responding, I have google fu'd a bit and found my only answer in so far as dovecot did this once upon as time, but it was only due to a dovecot bug, that has since been fixed, is that so? The wiki shows no information of failover, just load sharing, or is it an undocumented feature, or can dovecot not do failover, if not, can it be made so? Trying to cut down on network traffic, postfix does this nicely, I thought dovecot did too.

4 5

[Dovecot] dovecot 2.1.rc1: sieve and folders with umlauts
by Mike Constabel 12 Dec '11

12 Dec '11

Hi, now the umlauts problem with sieve: # cat /mailspool1/in-preetz.de/test1/.dovecot.sieve ## Generated by Roundcube Webmail SieveRules Plugin ## require ["fileinto"]; # rule:[Test] if anyof (header :contains "Subject" "test") { fileinto "m&APY-"; } Error: DBBjDsXL5U7mIAAA/TNBsA: sieve: execution of script /mailspool1/in-preetz.de/test1/.dovecot.sieve failed, but implicit keep was successful (user logfile /mailspool1/in-preetz.de/test1/.dovecot.sieve.log may reveal additional details) # cat /mailspool1/in-preetz.de/test1/.dovecot.sieve.log sieve: info: started log at Dec 12 10:40:04. error: msgid=<20111212094004.DB86918594(a)mx4.constabel-it.de>: failed to store into mailbox 'm&APY-': Mailbox doesn't exist: m&-APY-. Here the same: 'm&APY-' != "m&-APY-" Mike

3 5

[Dovecot] dovecot 2.1.rc1 and folders with umlauts
by Mike Constabel 12 Dec '11

12 Dec '11

Hi, if I try to crate a folder in Thunderbird 8 which contains umlauts this happens: - Create folder "Tür" - Thunderbird show T&APw-r in folder list In log: Dec 07 17:45:39 imap(test1(a)in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/T&APw-r doesn't exist yet, using default permissions Dec 07 17:45:39 imap(test1(a)in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 # ll /mailspool1/in-preetz.de/test1/mdbox/mailboxes/ insgesamt 32K drwx------ 8 vmail vmail 4,0K 7. Dez 17:45 . drwx------ 4 vmail vmail 4,0K 7. Dez 17:45 .. drwx------ 3 vmail vmail 4,0K 29. Nov 11:11 Drafts drwx------ 3 vmail vmail 4,0K 29. Nov 11:04 INBOX drwx------ 3 vmail vmail 4,0K 29. Nov 11:11 Junk drwx------ 3 vmail vmail 4,0K 29. Nov 11:11 Sent drwx------ 3 vmail vmail 4,0K 7. Dez 17:45 T&APw-r drwx------ 4 vmail vmail 4,0K 7. Dez 17:44 Trash If I click in TB on the folder, TB gives an empty message, the log shows: Dec 07 17:42:53 imap(test1(a)in-preetz.de): Debug: Effective uid=1000, gid=1000, home=/mailspool1/in-preetz.de/test1 Dec 07 17:42:53 imap(test1(a)in-preetz.de): Debug: quota: No quota setting - plugin disabled Dec 07 17:42:53 imap(test1(a)in-preetz.de): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mdbox Dec 07 17:42:53 imap(test1(a)in-preetz.de): Debug: fs: root=/mailspool1/in-preetz.de/test1/mdbox, index=, control=, inbox=, alt= Dec 07 17:42:53 imap(test1(a)in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 Dec 07 17:43:02 imap(test1(a)in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/&ANY-de doesn't exist yet, using default permissions Dec 07 17:43:02 imap(test1(a)in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 Dec 07 17:44:19 imap(test1(a)in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/&-ANY-de doesn't exist yet, using default permissions Dec 07 17:44:19 imap(test1(a)in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 Dec 07 17:44:19 imap(test1(a)in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/Trash/&-ANY-de doesn't exist yet, using default permissions Dec 07 17:44:24 imap(test1(a)in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/Trash/T&APw-r doesn't exist yet, using default permissions Dec 07 17:45:39 imap(test1(a)in-preetz.de): Debug: Namespace : /mailspool1/in-preetz.de/test1/mdbox/mailboxes/T&APw-r doesn't exist yet, using default permissions Dec 07 17:45:39 imap(test1(a)in-preetz.de): Debug: Namespace : Using permissions from /mailspool1/in-preetz.de/test1/mdbox: mode=0700 gid=-1 On another server with # 2.0.13 (537d4b6d9a7a): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.2 an an server with # 1.2.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 5.0.9 umlauts are working. Is there an problem with my config or with the rc1? thanks, Mike dovecot -n for not working 2.1.rc1: # 2.1.rc1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-xen-amd64 x86_64 Debian 6.0.3 auth_cache_size = 1 M auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login cram-md5 auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot/dovecot-debug.log default_client_limit = 2600 disable_plaintext_auth = no hostname = mx4.constabel-it.de info_log_path = /var/log/dovecot/dovecot-info.log log_path = /var/log/dovecot/dovecot.log mail_debug = yes mail_location = mdbox:~/mdbox mail_plugins = quota notify mail_log mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = prefix = separator = / type = private } passdb { args = scheme=PLAIN username_format=%u /etc/imap.userdb driver = passwd-file } plugin { autocreate = Trash autocreate2 = Junk autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Sent autosubscribe4 = Drafts sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster@localhost protocols = " imap lmtp sieve pop3" service auth { inet_listener { address = 192.168.10.117 port = 12345 } } service imap-login { inet_listener imap { address = 192.168.10.117 port = 143 } inet_listener imaps { address = 192.168.10.117 port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = 192.168.10.117 port = 24 } } service managesieve-login { inet_listener sieve { address = 192.168.10.117 port = 4190 } } service pop3-login { inet_listener pop3 { address = 192.168.10.117 port = 110 } inet_listener pop3s { address = 192.168.10.117 port = 995 ssl = yes } } ssl_ca = </etc/postfix/psw-ssl/ssl.ca-bundle ssl_cert = </etc/postfix/psw-ssl/ssl.crt ssl_key = </etc/postfix/psw-ssl/ssl.key userdb { args = username_format=%Lu /etc/imap.userdb driver = passwd-file } protocol lda { mail_plugins = quota notify mail_log } protocol imap { imap_logout_format = bytes=%i/%o mail_plugins = quota notify mail_log imap_quota } protocol pop3 { mail_plugins = quota notify mail_log } dovecot -n for working 2.0.13: # 2.0.13 (537d4b6d9a7a): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.2 auth_debug = yes auth_mechanisms = plain login cram-md5 auth_verbose = yes debug_log_path = /var/log/dovecot/dovecot-debug.log lmtp_save_to_detail_mailbox = yes log_path = /var/log/dovecot/dovecot.log mail_location = mdbox:~/mdbox managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } passdb { args = /etc/imap.userdb driver = passwd-file } plugin { autocreate = Trash autocreate2 = Junk autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Sent autosubscribe4 = Drafts sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/imap.userdb driver = passwd-file } protocol imap { mail_plugins = " autocreate" }

2 7

[Dovecot] 2.1.rc1 (51d87deb5c26): %{gid} modification problem
by Pascal Volk 12 Dec '11

12 Dec '11

I tried to apply the X modifier to the %{gid} variable: 'mail_attachment_dir = /srv/mail/.SiS/%X{gid}'. But the name of the created directory is '0', instead of '11172'. Regards, Pascal -- The trapper recommends today: c01dcofe.1134416(a)localdomain.org

2 3

Re: [Dovecot] using dsync to convert mailboxes looses caching options
by Mark Zealey 10 Dec '11

10 Dec '11

With 2.0.16 hdr.xxx fields get copied fine (but of course without timestamp). With the patch you provided they don't get copied whether using mirror or backup & starting from scratch. I'm doing a Maildir to sdbox migration otherwise don't think I'm doing anytihng strange. Mark ________________________________________ From: Mark Zealey Sent: 08 December 2011 09:35 To: Timo Sirainen Cc: Dovecot Mailing List Subject: RE: [Dovecot] using dsync to convert mailboxes looses caching options OK I'll test the header copying more fully. The reason we want to preserve caching decisions is to avoid an IO storm when users log in to their mailboxes after an sdbox upgrade so it would be great to be able to have some way to warm caches. Mark

3 5

[Dovecot] using dsync to convert mailboxes looses caching options
by Mark Zealey 10 Dec '11

10 Dec '11

Hi there, We're trying to convert users from Maildir to sdbox at present; I'm using dsync to achieve this (2.0.16) however when the user's have been converted we only get minimal information in the caching files. Is there some way to preserve all the caching decisions that were previously made so that when the user logs in to the new mailbox we don't have to cause an io storm rebuilding the cache that we know was good? Dovecot seems to be partially doing this - if i remove the logs/cache from the source mailbox no cache files are built in the conversion; if i put them back then we get a cache file built but it only contains a few bits of information (guid, date.save). Looking into this a bit further i find that when the caches are present at source the fields are preserved but the 'last used' date and caching decisions are not which I suspect means dsync doesn't bother caching on import - only fields with a yes decision in the source are copied (but their decision is only copied as a tmp with the date of import). For example: Source idxview cache: -- Cache fields -- # Name Type Size Dec Last used 0: flags bit 4 tmp 2011-11-25 16:09 1: date.received fix 4 yes 2011-11-26 16:17 2: size.virtual fix 8 tmp 2011-11-25 16:09 3: imap.bodystructure str - tmp 2011-11-25 16:09 4: mime.parts var - tmp 2011-11-25 16:09 5: hdr.IMPORTANCE hdr - tmp 2011-11-25 16:09 6: hdr.X-PRIORITY hdr - tmp 2011-11-25 16:09 7: hdr.CONTENT-TYPE hdr - tmp 2011-11-25 16:09 ... 18: date.sent fix 8 no 1970-01-01 01:00 19: date.save fix 4 yes 2011-11-26 16:17 20: size.physical fix 8 no 1970-01-01 01:00 21: imap.body str - no 1970-01-01 01:00 ... (24 total entries. stripped ones are just hdr. with a tmp decision) dst cache: # Name Type Size Dec Last used 0: flags bit 4 tmp 1970-01-01 01:00 1: date.sent fix 8 no 1970-01-01 01:00 2: date.received fix 4 tmp 1970-01-01 01:00 3: date.save fix 4 tmp 2011-11-26 16:19 4: size.virtual fix 8 tmp 1970-01-01 01:00 5: size.physical fix 8 no 1970-01-01 01:00 6: imap.body str - no 1970-01-01 01:00 7: imap.bodystructure str - tmp 1970-01-01 01:00 8: imap.envelope str - no! 1970-01-01 01:00 9: pop3.uidl str - no 1970-01-01 01:00 10: guid str - tmp 2011-11-26 16:19 11: mime.parts var - tmp 1970-01-01 01:00 12: hdr.IMPORTANCE hdr - tmp 1970-01-01 01:00 13: hdr.X-PRIORITY hdr - tmp 1970-01-01 01:00 ... and dst cached message for example: RECORD: seq=57, uid=12207, flags=0x09 (Seen Answered) - ext 1 modseq : 1 (0100000000000000) - ext 3 cache : 5516 (8c150000) - cache offset=5516 size=92, prev_offset = 0 - guid: 1321895282.XXXt,S=7399760,W=7496225 - date.save: 1322324286 (3e11d14e) src idx record for this message contains pretty much all fields. Thanks, Mark

3 9

[Dovecot] POP - preventing re-download with server move
by Trutwin, Joshua 10 Dec '11

10 Dec '11

Hi, Curious if anyone has any good suggestions to handle this. I try to get my hosting users to use IMAP but most use Outhouse and the IMAP support is somewhat annoying for many so I typically have them change their settings when using POP to leave copies on the server. That way when they get the inevitable virus or wanna use webmail they have a backup copy and webmail sees their saved mail. So now I have to move my sites to a new server and I'm trying to avoid having all these messages re-downloaded by POP clients. Some of the sites I've moved with low email usage have just dealt with the re-download and cleaned up afterwards. I have a few other accounts though that I'm more concerned about that have massive amounts of stored email. The mail is stored in Maildirs - a sample file: 1280409166.23580.foo:2,S If I move this to server "bar" would renaming the file to 1280409166.23580.bar:2,S prevent this somehow? Old server uses qmail-pop, new server uses dovecot 2.0. Thanks for any tips, Josh

3 2

[Dovecot] noaclright
by Knud Dombrowsky 10 Dec '11

10 Dec '11

Hi, I recently upgraded to openSuse 12.1 which comes with dovecot 2.0.14. Because of mail-client-problems I am running one dovecot which requires authentication via a client-certificate and another one which can be used without a certificate. (Configurations can be found below.) Since the upgrade our shared mailbox is no longer visible. I tried to repair this by setting the ACLs once again (using imap-acl in Thunderbird) but every time I try to set a new ACL the tool says "noaclright" and dovecot logs the following messages: Dec 7 14:31:14 mailbox dovecot: imap(<sharing-user>): Error: fstat(/home/<sharing-user>/Maildir/.<shared-folder>/dovecot-acl.lock) failed: No such file or directory Dec 7 14:31:14 mailbox dovecot: imap(<sharing-user>): Error: file_dotlock_open(/home/<sharing-user>/Maildir/.<shared-folder>/dovecot-acl) failed: No such file or directory Needless to say the file exists and its contents looks like it should. (Every line is an ACL like "user=testuser ilrws") I took a look at the changelog from 2.0.14 onwards and since it says nothing about my problem I am not looking forward to compiling dovecot myself and installing it. Any ideas why this is happening? Is this a known problem? Any help is appreciated, Knud ------------Dovecot-on-port-992----------------------------------------- mailbox:~ # dovecot -n # 2.0.14: /etc/dovecot/dovecot.conf # OS: Linux 3.1.0-1.2-desktop x86_64 openSUSE 12.1 (x86_64) auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-master default_client_limit = 1600 default_process_limit = 512 listen = * mail_location = maildir:~/Maildir:INBOX=~/Maildir/.INBOX managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { driver = pam } plugin { acl = vfile:/etc/dovecot/acls:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes quota = maildir:alle Nutzer quota_rule = *:storage=1GB sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 992 ssl = yes } } ssl_ca = </etc/ssl/certs/graband-ca.pem ssl_cert = </etc/ssl/certs/mailbox5.crt ssl_key = </etc/ssl/private/mailbox.gpbs.net.key.pem userdb { driver = passwd } protocol imap { mail_plugins = acl imap_acl quota imap_quota } ------------Dovecot-on-port-993----------------------------------------- mailbox:~ # dovecot -c /etc/dovecot-cert/dovecot.conf -n # 2.0.14: /etc/dovecot-cert/dovecot.conf # OS: Linux 3.1.0-1.2-desktop x86_64 openSUSE 12.1 (x86_64) auth_mechanisms = plain login auth_socket_path = /var/run/dovecot-cert/auth-master auth_ssl_require_client_cert = yes base_dir = /var/run/dovecot-cert/ default_client_limit = 1600 default_process_limit = 512 listen = * mail_location = maildir:~/Maildir:INBOX=~/Maildir/.INBOX managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { driver = pam } plugin { acl = vfile:/etc/dovecot/acls:cache_secs=300 acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes quota = maildir:alle Nutzer quota_rule = *:storage=1GB sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap quota_full_tempfail = yes service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } ssl_ca = </etc/ssl/certs/graband-ca.pem ssl_cert = </etc/ssl/certs/mailbox5.crt ssl_key = </etc/ssl/private/mailbox.gpbs.net.key.pem ssl_verify_client_cert = yes userdb { driver = passwd } protocol imap { mail_plugins = acl imap_acl quota imap_quota } -----------------------------------------------------------------

2 1

[Dovecot] overriding userdb connection host for doveadm-user
by Micah Anderson 10 Dec '11

10 Dec '11

I've got my users in a replicated database setup and dovecot configured with two connect lines in dovecot-sql.conf: connect = host=127.0.0.1 port=3306 dbname=users user=user password=pass connect = host=127.0.0.2 port=3306 dbname=users user=user password=pass this works really well to help balance the load. However, when a new user is created, the replication information sometimes has not made it to the slave database before my user creation process tries to send that new user an email about their new email account. If it hasn't and the email gets sent, then it bounces because postfix thinks the user doesn't exist yet. Replication usually happens within seconds, but could be delayed due to problems. I would like a way to see if the new user's information has been replicated yet before sending the email. I was thinking I could use 'doveadm user' to lookup the user, but I am not sure that I can specify one of the specific 'connect' lines in my configuration to check. Is there a way to override that configuration variable to do this test? I tried various incarnations of passing '-o connect=host='... but doveadm user would just ignore them. thanks for any suggestions! micah ps - yes, I can make my user creation process just 'sleep' for an arbitrary amount of time and by that time the replication should have occured, but that is a bit of a shot in the dark, and doesn't handle longer replication delays that could potentially happen. --

3 3

[Dovecot] lmtp panic in proxy lmtp director
by Xavier Pons 10 Dec '11

10 Dec '11

Hi, we are getting some core dumps with signal 6 in ltmp on a dovecot director proxy server, like this: Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Panic: file lmtp-proxy.c: line 376 (lmtp_proxy_output_timeout): assertion failed: (proxy->data_input->eof) Dec 5 14:31:51 sproxy1 dovecot: lmtp(29999): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0() [0x363323d99a] -> /usr/lib64/dovecot/libdovecot.so.0() [0x363323d9e6] -> /usr/lib64/dovecot/libdovecot.so.0(i_error+0) [0x3633216f8f] -> dovecot/lmtp() [0x406e57] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xd4) [0x3633248ff4] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x5b) [0x3633249bdb] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x3633248c58] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x3633236fc3] -> dovecot/lmtp(main+0x154) [0x403f84] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x373cc1ec5d] -> dovecot/lmtp() [0x403d69] Dec 5 14:31:51 sproxy1 abrt[30067]: saved core dump of pid 29999 (/usr/libexec/dovecot/lmtp) to /var/spool/abrt/ccpp-1323091911-29999.new/coredump (1368064 bytes) Dec 5 14:31:51 sproxy1 dovecot: master: Error: service(lmtp): child 29999 killed with signal 6 (core dumped) we have something misconfigured or it's a bug on this dovecot version? our doveconf -n is: # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-71.29.1.el6.x86_64 x86_64 CentOS Linux release 6.0 (Final) auth_cache_size = 3 k auth_cache_ttl = 15 mins auth_verbose = yes base_dir = /var/run/dovecot/ default_client_limit = 30000 default_process_limit = 5000 director_doveadm_port = 990 director_mail_servers = 10.80.82.21 10.80.82.22 director_servers = 10.80.82.11 10.80.82.12 doveadm_proxy_port = 24245 lmtp_proxy = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = proxy=y nopassword=y starttls=any-cert driver = static } postmaster_address = xavier.pons(a)uib.es protocols = imap pop3 lmtp sieve service auth { client_limit = 27048 unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = dovecot mode = 0660 } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 991 } inet_listener director-doveadm { port = 990 } unix_listener director-userdb { mode = 0660 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap-login { executable = imap-login director inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { port = 30025 } } service managesieve-login { executable = managesieve-login director } service pop3-login { executable = pop3-login director inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_cert = </etc/pki/tls/certs/imap.crt ssl_key = </etc/pki/tls/private/imap.uib.es_privatekey.pem syslog_facility = local1 verbose_proctitle = yes protocol lmtp { auth_socket_path = director-userdb passdb { args = /etc/dovecot/dovecot-ldap-pass.conf.lmtp driver = ldap } } protocol doveadm { auth_socket_path = director-userdb } protocol imap { mail_max_userip_connections = 20 } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } Xavier -- xavier.pons(a)uib.es Centre de Tecnologies de la Informació Universitat Illes Balears

4 3

[Dovecot] Make entire mailbox read-only (ACLs?)
by David Jonas 10 Dec '11

10 Dec '11

Hello, Is there a way of locking a mailbox, effectively making it read-only to IMAP clients? I've read through http://wiki2.dovecot.org/ACL. I created dovecot-acl with the content "owner lr" in .INBOX which seems to keep me from copying messages into the folder, but not out. I have the plugin configured correctly, it seems, since MYRIGHTS command shows the correct value: 30 MYRIGHTS "INBOX" * MYRIGHTS "INBOX" lr Am I barking up the wrong tree? Is there an easier way to lock a mailbox? post-login scripting perhaps? Thanks!

2 3

[Dovecot] Major bug with hardlinks and lmtp
by Brad Schuetz 10 Dec '11

10 Dec '11

In working on trying to fix the crash issue from my last email I had enabled LMTP delivery to try it out instead of using the LDA. I have discovered that when a single piece of email is to be delivered to multiple users the message is being hard linked instead of copied into each mail box. This is a major problem that makes LMTP unusable in an environment where each mailbox has it's own UID since the hard linked file will only be readable by one of the users. I assume this is related to "maildir_copy_with_hardlinks=yes", however this setting doesn't say anything about hardlinking across different email accounts. -- Brad Schuetz

2 1

[Dovecot] Per-User MySQL Quota (postfixadmin)
by Sehic, Haris 09 Dec '11

09 Dec '11

Hi, need some help setting per-user quota and postfixadmin. Setup is working on 1.2 dovecot. Tryin 2.1 dovecot now, quota is working but overriden quota rule set by 'user_query =' in /etc/dovecot/dovecot-sql.conf.ext takes no efffekt. What's wrong here? Greets Haris

2 2

[Dovecot] Wish list item: %g/%{gid} variable
by Pascal Volk 09 Dec '11

09 Dec '11

I think it would be very useful to have a user's GID in a variable. So i could use for example: mail_attachment_dir = /srv/mail/.SiS/%{gid} I use one GID per domain and the aliases fqhns of the domain. When for example example.com would be an alias for exmaple.net (gid: 12345), the attachments would be stored inside /srv/mail/.SiS/12345/, no matter if a message was sent to john.doe(a)example.com or to john.doe(a)example.net. "quota = dict:domain:%{gid}:proxy::quota" would then also work. Regards, Pascal -- The trapper recommends today: c01dcofe.1134217(a)localdomain.org

2 1

[Dovecot] "Unstable" vs "Development" vs "Nightly"
by Terry Carmen 09 Dec '11

09 Dec '11

I'm currently running v2.1rc1, but have been seeing errors like: Dec 8 11:31:55 it kernel: auth[18914]: segfault at 48 ip 00fe2f74 sp bfcaccd0 error 4 in libauthdb_imap.so[fdd000+f000] The unstable and nightly builds are newer, but are they likely to be more or less stable than the version I'm currently running? I'd like to install a newer version, but am trying to get a feel for how usable they're likely to be. Thanks, Terry

2 2

[Dovecot] Error: Corrupted index cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid record size
by florent＠coppint.com 09 Dec '11

09 Dec '11

Hi all, I got a problem with a Dovecot IMAP/POP installation. Since a recent failure of our distributed file system (no loss of data btw), Dovecot seems to have a problem with index cache files. For a lot of accounts, I have this error in logs: Error: Corrupted index cache file /xxx/yyy/zzz/indexes/.INBOX/dovecot.index.cache: invalid record size If I delete all files from /indexes/ directory, it still occurs... Do you see what can cause this problem ? Or what information can I provide to help ? Our distributed FS is MooseFS. Dovecot is configured like if it was NFS (no mmap, etc...). Thank you for your help :) Flo

2 1