- dovecot - dovecot.org

[Dovecot] Errors from dovecot 1.1
by wenjie zheng 15 Aug '07

15 Aug '07

I downloaded and installed dovecot 1.1 nightly build yesterday. Here is a the errors I collected from the log file. dovecot: Aug 15 14:19:29 Error: IMAP(use@doamin): Log synchronization error at seq=7,offset=24 for /data2/mail/we/webmail.us/ji/jing/dovecot.index: Extension introduction for unknown id 2 dovecot: Aug 15 14:19:29 Error: IMAP(use@doamin): Log synchronization error at seq=7,offset=52 for /data2/mail/we/webmail.us/ji/jing/dovecot.index: Extension introduction for unknown id 2 dovecot: Aug 15 14:19:29 Error: IMAP(use@doamin): Log synchronization error at seq=7,offset=80 for /data2/mail/we/webmail.us/ji/jing/dovecot.index: Extension record updated without intro prefix dovecot: Aug 15 14:19:29 Error: IMAP(use@doamin): Log synchronization error at seq=7,offset=416 for /data2/mail/we/webmail.us/ji/jing/dovecot.index: Extension introduction for unknown id 0 dovecot: Aug 15 14:19:29 Error: IMAP(use@doamin): Log synchronization error at seq=7,offset=444 for /data2/mail/we/webmail.us/ji/jing/dovecot.index: Extension header update without intro prefix dovecot: Aug 15 14:19:29 Error: IMAP(use@doamin): Log synchronization error at seq=7,offset=528 for /data2/mail/we/webmail.us/ji/jing/dovecot.index: Extension introduction for unknown id 0 dovecot: Aug 15 14:19:29 Error: IMAP(use@doamin): Log synchronization error at seq=7,offset=556 for /data2/mail/we/webmail.us/ji/jing/dovecot.index: Extension header update without intro prefix dovecot: Aug 15 14:19:29 Error: IMAP(use@doamin): Log synchronization error at seq=7,offset=776 for /data2/mail/we/webmail.us/ji/jing/dovecot.index: Extension introduction for unknown id 2 dovecot: Aug 15 14:19:29 Error: IMAP(use@doamin): Log synchronization error at seq=7,offset=804 for /data2/mail/we/webmail.us/ji/jing/dovecot.index: Extension introduction for unknown id 3 dovecot: Aug 15 14:19:29 Error: IMAP(use@doamin): Log synchronization error at seq=7,offset=832 for /data2/mail/we/webmail.us/ji/jing/dovecot.index: Extension introduction for unknown id 2 dovecot: Aug 15 14:19:29 Error: IMAP(use@doamin): Log synchronization error at seq=7,offset=876 for /data2/mail/we/webmail.us/ji/jing/dovecot.index: Extension introduction for unknown id 3 dovecot: Aug 15 14:19:29 Error: IMAP(use@doamin): Sending log messages too fast, throttling.. dovecot: Aug 15 14:19:29 Error: child 8898 (imap) killed with signal 6 dovecot: Aug 15 14:19:29 Info: IMAP(use@doamin): Disconnected: Logged out bytes=36/238 dovecot: Aug 15 14:19:30 Error: IMAP(use@doamin): Log synchronization error at seq=7,offset=920 for /data2/mail/we/webmail.us/ji/jing/dovecot.index: Extension introduction for unknown id 2 dovecot: Aug 15 14:19:30 Error: IMAP(use@doamin): Log synchronization error at seq=7,offset=948 for /data2/mail/we/webmail.us/ji/jing/dovecot.index: Extension introduction for unknown id 2 dovecot: Aug 15 14:19:30 Error: IMAP(use@doamin): file mail-index-sync-keywords.c: line 285 (mail_index_sync_keywords): assertion failed: (rec->modify_type == MODIFY_REMOVE) dovecot: Aug 15 14:19:30 Error: IMAP(use@doamin): Raw backtrace: imap [0x80badb6] -> imap [0x80ba903] -> imap(mail_index_sync_keywords+0xee) [0x80ac3e6] -> imap(mail_index_sync_record+0x393) [0x80a0437] -> imap(mail_index_sync_map+0x208) [0x80a075c] -> imap(mail_index_map+0x89) [0x809b059] -> imap [0x8098907] -> imap [0x8098b39] -> imap(mail_index_open+0x133) [0x8098c73] -> imap(index_storage_mailbox_open+0x75) [0x8092e71] -> imap [0x806de18] -> imap [0x806dfb6] -> /usr/lib/dovecot/imap/lib10_quota_plugin.so [0x119de8] -> imap(mailbox_open+0x50) [0x80ae1ec] -> imap(_cmd_select_full+0x76) [0x805da4e] -> imap(cmd_select+0x10) [0x805dcbc] -> imap [0x805fa22] -> imap [0x805f941] -> imap [0x805fab1] -> imap(_client_input+0x56) [0x805fb6e] -> imap(io_loop_handler_run+0x100) [0x80bff0c] -> imap(io_loop_run+0x2d) [0x8066b21] -> imap(main+0x64) [0x8066518] -> /lib/tls/libc.so.6(__libc_start_main+0xda) [0x6db78a] -> imap(__fxstat64+0x71) [0x8059605] Thanks, Wenjie

2 1

[Dovecot] MANAGESIEVE patch v5 for dovecot 1.0.2
by Stephan Bosch 15 Aug '07

15 Aug '07

Hello dovecot users, I have finally updated the MANAGESIEVE patch to fix the currently known small problems with the protocol implementation. Also, I included a proxy implementation based on imap-proxy.c. This patch is designed for dovecot release 1.0.2 and it will not apply cleanly to the 1.1 versions yet. Change Log V5 ------------- - Applied patch by Uldis Pakuls to fix master_dump_settings bug - Added some compilation/installation info to the README - Moved README to source tree's root as README.managesieve - Fixed minor error handling bug in sieve_storage.c with respect to a missing root directory. - Now sieve capabilities are reported as they are specified by the implementing library and not in forced upper case. The sieve RFC now explicitly states that sieve capability identifiers are case-sensitive. This broke compatibility with SquirrelMail/Avelsieve. - Disabled ANONYMOUS login entirely until proper support is implemented. V4 claimed to do so as well, but in fact it only stopped announcing it. - Implemented managesieve-proxy. It is not so much a clean copy of imap-proxy, since the managesieve greeting is much more complex and requires parsing. Configuration is identical to imap-proxy. This seems to be a little under-documented however (http://wiki.dovecot.org/PasswordDatabase/ExtraFields) This patch still includes (yet another) instance of the CMU Sieve source, as explained in one of my previous e-mails (http://dovecot.org/list/dovecot/2006-July/015016.html) Current plans include merging src/lib-managesieve with src/lib-imap, updating the patch for dovecot-1.1 and fixing any problems you might find. The patch can be downloaded at: http://sinas.rename-it.nl/~sirius/dovecot-1.0.2-MANAGESIEVE-v5.diff.gz The README.managesieve is located in the root of the dovecot source tree after applying the patch. Have fun testing the patch. Notify me when there are problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl IRC: Freenode, #dovecot, S[r]us

5 13

[Dovecot] Dovecot deliver + sieve + postfix virtual + mysql ?
by Radek Slavicinsky 15 Aug '07

15 Aug '07

Hey there guys. I have successful postfix + mysql + sagator + clamav + spamassassin + dovecot setup (it was a really crazy month full of tweaking :]) and the only thing i miss is some per maildir specific filtering. i decided to use sieve. everything is fine except that dovecot's deliver process doesn't see the actual .dovecot.sieve file with filtering rules in the root of a maildir. description of the situation follows: from /var/log/dovecot.log: deliver(support{the_at_symbol}support.etnetera.cz): "2007-08-15 13:32:11 "Error: userdb(support{the_at_symbol}support.etnetera.cz) didn't return a home directory or sieve script location, can't find it deliver(support{the_at_symbol}support.etnetera.cz): "2007-08-15 13:32:11 "Info: msgid=<200708151330.22021.radek.slavicinsky{the_at_symbol}etnetera.cz>: saved mail to INBOX /etc/dovecot/dovecot.conf: protocols = imap imaps pop3 pop3s listen = * disable_plaintext_auth = no shutdown_clients = yes log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " ssl_cert_file = /etc/certs/sponka.etnetera.cz.crt ssl_key_file = /etc/certs/sponka.etnetera.cz.key ssl_ca_file = /etc/certs/CA.crt login_process_size = 64 login_processes_count = 32 login_max_processes_count = 256 login_max_connections = 512 mail_location = maildir:/srv/vmail/domains/%d/%n/ #mail_location = maildir:/ namespace private { separator = . prefix = INBOX. inbox = yes } namespace private { separator = . prefix = inbox = yes hidden = yes } mail_extra_groups = vmail verbose_proctitle = yes mbox_read_locks = fcntl mbox_write_locks = fcntl protocol imap { } protocol pop3 { pop3_uidl_format = UID%u-%v } protocol lda { hostname = sponka.etnetera.cz postmaster_address = postmaster{the_at_symbol}etnetera.cz auth_socket_path = /var/run/dovecot/auth-master mail_plugins = cmusieve } auth default { mechanisms = plain login digest-md5 cram-md5 passdb sql { args = /etc/dovecot/dovecot-sql.conf } userdb sql { args = /etc/dovecot/dovecot-sql.conf } user = dovecot-auth socket listen { client { path = /var/spool/postfix/private/auth mode = 0666 user = postfix group = postfix } master { path = /var/run/dovecot/auth-master mode = 0600 user = vmail group = vmail } } } dict { } plugin { } /etc/dovecot/dovecot-sql.conf: driver = mysql default_pass_scheme = PLAIN connect = host=127.0.0.1 dbname=postfix user=postfix password=averysecretpass password_query = SELECT password FROM mailbox WHERE username = '%u' AND active = '1' user_query = SELECT maildir, 65500 AS uid, 65500 AS gid FROM mailbox WHERE username = '%u' AND active = '1' the user_query gives: mysql> SELECT maildir, 65500 AS uid, 65500 AS gid FROM mailbox WHERE username = 'radek.slavicinsky(a)etnetera.cz' AND active = '1'; +--------------------------------+-------+-------+ | maildir | uid | gid | +--------------------------------+-------+-------+ | etnetera.cz/radek.slavicinsky/ | 65500 | 65500 | +--------------------------------+-------+-------+ 1 row in set (0.00 sec) the sieve rules file # ls /srv/vmail/domains/support.etnetera.cz/support/.dovecot.sieve -lha -rw-r--r-- 1 vmail vmail 957 Aug 15 13:30 /srv/vmail/domains/support.etnetera.cz/support/.dovecot.sieve i think there should be some specific settings for the cmusieve plugin, but i didnt find much docs about that thx for any help ;] blue4 :p

3 4

[Dovecot] Dovecot on OpenBSD stalls
by Bert Koelewijn 15 Aug '07

15 Aug '07

Hello list, I'm using dovecot 1.0.2 on OpenBSD 4.1. About every month, dovecot will just stall, without any error messages. The processes are still running, the network ports are open, but the login just hangs. The following error message does occur on a very regular basis: Aug 15 00:52:37 mail dovecot: auth(default): LDAP: ldap_result() failed: Can't contact LDAP server Aug 15 01:08:08 mail dovecot: auth(default): LDAP: ldap_result() failed: Can't contact LDAP server Aug 15 01:23:38 mail dovecot: auth(default): LDAP: ldap_result() failed: Can't contact LDAP server Aug 15 01:38:39 mail dovecot: auth(default): LDAP: ldap_result() failed: Can't contact LDAP server Aug 15 01:54:09 mail dovecot: auth(default): LDAP: ldap_result() failed: Can't contact LDAP server Aug 15 02:09:10 mail dovecot: auth(default): LDAP: ldap_result() failed: Can't contact LDAP server Aug 15 02:24:40 mail dovecot: auth(default): LDAP: ldap_result() failed: Can't contact LDAP server Aug 15 02:39:41 mail dovecot: auth(default): LDAP: ldap_result() failed: Can't contact LDAP server Aug 15 02:55:12 mail dovecot: auth(default): LDAP: ldap_result() failed: Can't contact LDAP server (stalling from here) The LDAP directory is Active Directory and is not used as userdb, only as passdb. Thanks, Bert # 1.0.2: /etc/dovecot.conf base_dir: /var/dovecot/ ssl_cert_file: /etc/ssl/server.pem ssl_key_file: /etc/ssl/private/server.key login_dir: /var/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_user: _dovecot mail_location: maildir:~/Maildir mbox_write_locks: fcntl imap_client_workarounds: delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep auth default: mechanisms: plain login passdb: driver: ldap args: /etc/dovecot-ldap.conf userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: _postfix group: _postfix /etc/dovecot-ldap.conf hosts = xxx.xxx.xxx.xxx:389 #uris = #dn = #dnpass = #sasl_bind = no #sasl_mech = #sasl_realm = #sasl_authz_id = #tls = no auth_bind = yes auth_bind_userdn = cn=%u,cn=Users,dc=koelewijn,dc=bz #ldap_version = 2 base = dc=bz #deref = never #scope = subtree #user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid #user_filter = (&(objectClass=posixAccount)(uid=%u)) #pass_attrs = uid=user,userPassword=password #pass_attrs = uid=user,userPassword=password,homeDirectory=userdb_home,uidNumber=userdb_uid,gidNumber=userdb_gid #pass_filter = (&(objectClass=posixAccount)(uid=%u)) #default_pass_scheme = CRYPT #user_global_uid = #user_global_gid =

1 0

[Dovecot] Sieve Vacation cause deliver to die
by M1 15 Aug '07

15 Aug '07

When a user enable vacation in sieve deliver die and the mail lost. I am using 1.0.3 Thanks ------------------------------------------------------------------------------------------------------------------------------------------- in syslog postfix/pipe[16060]: 8E33017D4: to=<vivi(a)abc.com.hk>, relay=dovecot, delay=0.17, delays=0.13/0.01/0/0.03, dsn=5.3.0, status=bounced (Command died with signal 11: "/usr/libexec/dovecot/deliver") ------------------------------------------------------------------------------------------------------------------------------------------- .dovecot.sieve # Sieve Filter # Generated by Ingo (http://www.horde.org/ingo/) (August 6, 2007, 9:56 am) require ["vacation", "fileinto"]; # Whitelisted Addresses if address :all :comparator "i;ascii-casemap" :is ["From", "Sender", "Resent-From"] "juscotsushin(a)juscocityhk.com" { keep; stop; } # Vacation if allof ( not exists ["list-help", "list-unsubscribe", "list-subscribe", "list-owner", "list-post", "list-archive", "list-id"], not header :comparator "i;ascii-casemap" :is "Precedence" "list,bulk" ) { vacation :days 7 :addresses "vivi(a)abc.com.hk" :subject "Autoreply : OUT OF OFFICE" "I will not be in Hong Kong from August 6-11. While I will check my mailbox from time to time, I may respond with some delay. Regards, Vivi"; } # Blacklisted Addresses if address :all :comparator "i;ascii-casemap" :is ["From", "Sender", "Resent-From"] ["store-news(a)amazon.com", "uschinaasset(a)aol.com", "janvqvogel(a)bible.org", "info(a)bichk.net", "anmhk(a)biznetvigator.com"] { discard; stop; } # dspam if header :comparator "i;ascii-casemap" :contains "X-DSPAM-Result" "Spam" { fileinto "INBOX.Spam"; } ------------------------------------------------------------------------------------------------------------------------------------------- mail / # dovecot -n # 1.0.3: /etc/dovecot/dovecot.conf protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/dovecot/server.pem ssl_key_file: /etc/ssl/dovecot/server.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login last_valid_uid: 500 first_valid_gid: 500 last_valid_gid: 500 mail_location: maildir:/home/mail/%d/%n mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota dspam mail_plugins(imap): quota imap_quota dspam mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 384 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: maildir trash: /etc/dovecot/dovecot-trash.conf

3 2

[Dovecot] use of deliver from procmail advisable?
by martin f krafft 15 Aug '07

15 Aug '07

Hi list, I understand that dovecot's deliver does a little more than deliver: it also updates the dovecot metadata stored with each Maildir. Thus, if I use deliver as opposed to procmail's internal Maildir delivery, it seems that the IMAP server later has less work to do since the metadata is can use are up to date. Doing this, however, incurs an extra process for each mail delivered. I thus wonder whether the two balance each other out, or whether there is a strong difference. What do you think will be less resource-heavy: calling deliver for every mail received *in addition to* procmail, or letting the IMAP server update the metadata on access? -- martin; (greetings from the heart of the sun.) \____ echo mailto: !#^."<*>"|tr "<*> mailto:" net@madduck EARTH smog | bricks AIR -- mud -- FIRE soda water | tequila WATER spamtraps: madduck.bogus(a)madduck.net

4 8

[Dovecot] namespaces and creation of folders that contain folders...
by bhayden＠umn.edu 14 Aug '07

14 Aug '07

Hi Timo and all. imap/cmd-create.c contains the following bit of code: len = strlen(full_mailbox); if (len == 0 || full_mailbox[len-1] != ns->sep) directory = FALSE; else { /* name ends with hierarchy separator - client is just informing us that it wants to create children under this mailbox. */ directory = TRUE; mailbox = t_strndup(mailbox, len-1); full_mailbox = t_strndup(full_mailbox, strlen(full_mailbox)-1); i_info("Z CREATE NAME: YYY%sYYY", mailbox); } We've been having trouble with people not being able to create a mail folder that will contain other folders. Tried it both with users using mbox (where this would be a filesystem directory) and maildir. Failed everytime because of a test which rejects folder names that end with MAILDIR_FS_SEP. Looks like the above bit of code is supposed to catch these, make a note of the fact that the client wants a directory, and strip off that trailing separator. In fact, it does this in the case of 'full_mailbox'. However, for 'mailbox' (it seems to me) the code is incorrect as its using the len-1 which is the length of 'full_mailbox', not 'mailbox'. This means that when 'mailbox' and 'full_mailbox' are the same length--that is, for the default namespace (no prefix), it happens to work. However, in any other namespace, it won't, as 'full_mailbox' will always be longer then 'mailbox' if there is a ns prefix, and hence that trailing separator won't be trimmed. (As a matter of fact, in the unlikely instance that the prefix is a single character this will trim the null character from 'mailbox', which probably isn't a good thing.) So. Am I missing something, or crazy, or is this really a bug? Thanks, -Brian

2 2

[Dovecot] about index cache
by Joe Wong 14 Aug '07

14 Aug '07

Hi Timo, Is the dovecot index cache stored only standard header fields (from, to, cc, subject, content-type... )? What happen if there is non standard header, will it be cached? - Joe May the force be with you..

3 9

[Dovecot] Failed to compile dovecot 1.1 nightly build
by wenjie zheng 14 Aug '07

14 Aug '07

I downloaded the 1.1 night build from here: http://hg.dovecot.org/dovecot/archive/tip.tar.gz autogen.sh ./configure (with a long list of options) make I got this error information: ... rpcgen -c /usr/include/rpcsvc/rquota.x | \ -e 's/IXDR_PUT/(void)IXDR_PUT/g' \ -e 's/int32_t \*buf/int32_t *buf __attr_unused__/' > rquota_xdr.c /bin/sh: line 1: -e: command not found make[4]: *** [rquota_xdr.c] Error 127 make[4]: Leaving directory `/var/home/wzheng/code/vendor/src/plugins/quota' make[3]: *** [all-recursive] Error 1 make[3]: Leaving directory `/var/home/wzheng/code/vendor/src/plugins' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/var/home/wzheng/code/vendor/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/var/home/wzheng/code/vendor' make: *** [all] Error 2 Am I using the correct nightly build? Thanks, Wenjie

2 1

Re: [Dovecot] dovecot Digest, Vol 52, Issue 52
by Jerry Yeager 14 Aug '07

14 Aug '07

From the digest: On Aug 14, 2007, at 1:04 PM, dovecot-request(a)dovecot.org wrote: other messages cut out… > > > Message: 9 > Date: Tue, 14 Aug 2007 19:03:58 +0200 > From: martin f krafft <madduck(a)madduck.net> > Subject: Re: [Dovecot] use of deliver from procmail advisable? > To: dovecot(a)dovecot.org > Message-ID: <20070814170358.GA17390(a)piper.oerlikon.madduck.net> > Content-Type: text/plain; charset="us-ascii" > > also sprach Kyle Wheeler <kyle-dovecot(a)memoryhole.net> > [2007.08.14.1833 +0200]: >>> I understand that dovecot's deliver does a little more than >>> deliver: >> >> It also understands the 'seive' filter language (an alternative to >> procmail). > > I don't consider it an alternative to procmail because you cannot > pass mail to external programmes, like spamassassin or vacation. > Sure, sieve has its own vacation module, but I find that to be > rather limited. See this thread: > > http://dovecot.org/list/dovecot/2007-August/024686.html > >>> What do you think will be less resource-heavy: calling deliver >>> for every mail received *in addition to* procmail, or letting the >>> IMAP server update the metadata on access? >> >> Unless you're cutting it close to the limit on what your server >> can handle, that's probably the wrong question to ask. A better >> question is: which gives my users better performance? > > Good point. The users, however, as far as I know, all use tools like > offlineimap to synchronise in the background, so it hardly matters. > >> your users aren't paying attention. Dovecot will *seem* snappier >> if you do the indexing work on delivery rather than on access, >> even though it may spend more CPU cycles overall to do so. > > Does anyone have hard facts on how much the server process loses if > it encounters a folder with an index inconsistency? > > -- > martin; (greetings from the heart of the sun.) > \____ echo mailto: !#^."<*>"|tr "<*> mailto:" net@madduck > > mulutlitithtrhreeaadededd s siigngnatatuurere > > spamtraps: madduck.bogus(a)madduck.net >

1 0