November 2011 - dovecot

[Dovecot] 1.2.15 can't get zlib working
by Stan Hoeppner 24 Nov '11

24 Nov '11

Following these instructions: http://wiki.dovecot.org/Plugins/Zlib I enabled zlib and restarted Dovecot. I made a backup copy of a 68MB mbox file and moved it to a non mail directory. The mbox file is an existing TBird IMAP folder in my UNIX user mail directory. It is an archive of a defunct mailing list. It was a regular IMAP folder prior to attempting this. I was able to access all emails in the folder. It worked fine. I gzipped the original mbox file down to 14MB and removed the write flag with chmod. I launched TBird and received the following error in Activity Manager when accessing this IMAP folder: The current operation on '1-Spam-l' did not succeed. The mail server for account stan(a)hardwarefreak.com responded: Mailbox doesn't exist: 1-Spam-l I deleted the Dovecot index files and the TBird 1-Spam-l.msf file which didn't help. Curiously, there are no entries in either dovecot.err or dovecot.log, giving not even the slightest hint as to where I should troubleshoot. Kinda sucks when one follows instructions exactly, simple instructions at that, and it doesn't work, and generates zero log errors. A bit frustrating... Any ideas? /$ la /home/stan/mail/1-Spam-l.gz -r-------- 1 stan stan 14M Oct 28 2010 /home/stan/mail/1-Spam-l.gz # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.38.6 i686 Debian 6.0.3 xfs log_path: /var/log/dovecot.err info_log_path: /var/log/dovecot.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap ssl_parameters_regenerate: 0 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_process_per_connection: no login_process_size: 16 login_processes_count: 1 login_max_processes_count: 1 login_max_connections: 8 max_mail_processes: 4 mail_privileged_group: mail mail_location: mbox:/home/%u/mail:INBOX=/var/mail/%u mailbox_idle_check_interval: 15 mbox_write_locks: fcntl mbox_very_dirty_syncs: yes mbox_lazy_writes: no mail_plugins: fts fts_squat zlib imap_client_workarounds: tb-extra-mailbox-sep lda: postmaster_address: postmaster(a)hardwarefreak.com mail_plugins: sieve auth default: worker_max_count: 1 process_size: 16 passdb: driver: pam args: max_requests=1 userdb: driver: passwd plugin: fts: squat fts_squat: partial=4 full=10 -- Stan

2 5

[Dovecot] doveadm import assertion failed
by Micah Anderson 24 Nov '11

24 Nov '11

Restoring a user's mailbox yesterday resulted in 'doveadm import' panic'ing with an assertion failure and giving a backtrace: /usr/bin/doveadm import -u <user> mdbox:/maildir/riseup.net/a/<user>/.daily.1/mdbox restored_from_backups/daily1 all doveadm(<user>): Error: Transaction log /maildir/riseup.net/a/<user>/.daily.1/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.log: duplicate transac tion log sequence (3) doveadm(<user>): Error: Transaction log /maildir/riseup.net/a/<user>/.daily.1/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.log: duplicate transac tion log sequence (3) doveadm(<user>): Panic: file mail-transaction-log-file.c: line 187 (mail_transaction_log_file_add_to_list): assertion failed: ((*p)->hdr.file_se q < file->hdr.file_seq) doveadm(<user>): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x3fd1a) [0x7f05152bbd1a] -> /usr/lib/dovecot/libdovecot.so.0(default_f atal_handler+0x32) [0x7f05152bbe02] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f051529519f] -> /usr/lib/dovecot/libdovecot-storage.so .0(+0xa596a) [0x7f05159e696a] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_file_open+0x1f8) [0x7f05159e7bc8] -> /usr/lib/ dovecot/libdovecot-storage.so.0(mail_transaction_log_find_file+0xd0) [0x7f05159e46e0] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_transa ction_log_view_set+0xcb) [0x7f05159e8bdb] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0xbe) [0x7f05159dff6e] -> /usr/lib/ dovecot/libdovecot-storage.so.0(mail_index_map+0x86) [0x7f05159d1816] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9a6da) [0x7f05159db6da] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_begin_to+0x56) [0x7f05159db956] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_ index_sync_begin+0x1e) [0x7f05159dc21e] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_sync_begin+0x121) [0x7f05159bbb41] -> /usr/lib/dove cot/libdovecot-storage.so.0(mdbox_sync+0x46) [0x7f05159bc1f6] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_storage_sync_init+0x43) [0x7f 05159bc293] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x31) [0x7f0515974031] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x27) [0x7f05159748b7] -> /usr/bin/doveadm(doveadm_mail_iter_init+0x8b) [0x40c9db] -> /usr/bin/doveadm() [0x40c284] -> /usr/bin/doveadm() [0x40a673] -> /usr/bin/doveadm(doveadm_mail_single_user+0x61) [0x40a731] -> /usr/bin/doveadm() [0x40a95d] -> /usr/bin/doveadm(doveadm_mail_try_run+0x141) [0x40ad71] -> /usr/bin/doveadm(main+0x381) [0x4107e1] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f0514b2dc4d] -> /usr/bin/doveadm() [0x409e59] This is with 2.0.15. Micah --

2 1

[Dovecot] v2.1.beta1 released
by Timo Sirainen 23 Nov '11

23 Nov '11

http://dovecot.org/releases/2.1/beta/dovecot-2.1.beta1.tar.gz http://dovecot.org/releases/2.1/beta/dovecot-2.1.beta1.tar.gz.sig Here's the first beta release of Dovecot v2.1. This version has already been tested quite a lot, so I'm not expecting any major bugs. So please upgrade and see if you can find any problems. I'm optimistic about getting rc1 released this year and perhaps even v2.1.0. Since alpha2 there have been a lot of fixes, especially to imapc backend. There are probably also some small new features, but nothing huge. As a reminder, here's the largest changes since v2.0: * Plugins now use UTF-8 mailbox names rather than mUTF-7: acl, autocreate, expire, trash, virtual * auth_username_format default changed to %Lu. If you really want case sensitive usernames, set it back to empty. * Solr full text search backend changed to use mailbox GUIDs instead of mailbox names, requiring reindexing everything. solr_old backend can be used with old indexes to avoid reindexing, but it doesn't support some newer features. + imapc (= IMAP client) storage allows using a remote IMAP server to be used as storage. This allows using Dovecot as a smart (caching) proxy or using dsync to do migration from remote IMAP server. + Mailbox indexing via queuing indexer service (required for Lucene) + Lucene full text search (FTS) backend rewritten with support for different languages + FTS finally supports "OR" search operation + FTS supports indexing attachments via external programs + IMAP FUZZY extension, supported by Lucene and Solr FTS backends + Mailbox list indexes + Statistics tracking via stats service. Exported via doveadm stats. + Autocreate plugin creates/subscribes mailboxes physically only when the mailbox is opened for the first time. Mailbox listing shows the autocreated mailboxes even if they don't physically exist. + Password and user databases now support default_fields and override_fields settings to specify template defaults/overrides. - listescape plugin works perfectly now

3 5

[Dovecot] dovecot as an imap "client"
by David LEROUX 23 Nov '11

23 Nov '11

Hi, I need to get emails from one of my users imap account on a server which is not managed by us to his local imap mailbox. I'm almost sure that I've read some times that dovecot would be able to do that, kind of imap relay, but I can't find it again. I'm not sure to be very clear. Thanks, -- David

4 4

[Dovecot] [PATCH] SCRAM-SHA-1 authentication
by Florian Zeitz 23 Nov '11

23 Nov '11

Hy, over the last days I have implemented SCRAM-SHA-1 in Dovecot's 2.1 branch. It does not do SCRAM-SHA-1-PLUS, but should be extendable enough to introduce it later. There are some checks for the message format which (assuming the client acts correclty) are not strictly necessary during parsing. This is partially in the hope that it might aid client implementers, partially because it (IMHO) improves readability when checking against the RFC. Also errors found in this way could be sent to the client, this is however strictly OPTIONAL in the RFC, for now they are just logged. Some of the variable names are rather long. This is in order to have them match the terms introduced in the RFC, again I expect it to help readability (maybe my recent Objective-C programming showing though). I do feel somewhat insecure about my usage of some lib functions. Hopefully no API has been abused too much. I also note that there are a lot of fields in the scram_auth_request struct. I think they are all there for a reason, however feel free to prove me wrong. Attached is a hg export. It also includes a hmac-sha1 implementation, an adaption off of the hmac-md5 implementation already in Dovecot. I guess those should eventually be merged into a hash-independent hmac implementation, but I figured this would have to do for now. The implementation has been tested against GNU SASL and does appear to work fine. (The command line was `gsasl -m SCRAM-SHA-1 -a user -p pass --imap host` for those curious) Regards Florian "Florob" Zeitz

3 5

[Dovecot] Can't delete sub-folder
by pch0317 23 Nov '11

23 Nov '11

Hi list, I have problem with deleting sub-folder. I use thunderbird 8.0 as a client and dovecot 2.0.9 with imap protocol as a server. I use dovecot with tb-extra-mailbox-sep parameter. I use mbox mailboxes and thunderbird with *not checked* option 'server supports folders that contain sub-folders and messages' so when I create sub-folder I can choose between 'folders only' and 'messages only'. When I try to delete 'parent' folder which contain 'messages only' folder, error message appear: [ALREADYEXISTS] Mailbox has children, delete them first. Ok, so I delete 'message only' folder first and try to delete parent folder, but the same error appear: [ALREADYEXISTS] Mailbox has children, delete them first. When I list mailboxes from console I see inside 'parent' folder ".imap" folder. When I delete .imap folder from console and then delete parent folder from thunderbird, parent folder is deleted correctly. Which application create this ".imap" hidden folder and how solve this problem. Thanks

2 1

[Dovecot] Problem compiling dovecot 2.1 Beta1 under Solaris 10 on SPARC
by Jürgen Obermann 23 Nov '11

23 Nov '11

Hello, compiling dovecot 2.1 Beta1 under Solaris 10 on SPARC with Sun Studio 11 stops with the following error: Making all in lib-imap-client gmake[3]: Entering directory `/net/fileserv/export/sunsrc/src/dovecot-2.1.beta1/src/lib-imap-client' source='imapc-client.c' object='imapc-client.lo' libtool=yes \ DEPDIR=.deps depmode=none /bin/bash ../../depcomp \ /bin/bash ../../libtool --tag=CC --mode=compile cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-dns -I../../src/lib-ssl-iostream -I../../src/lib-mail -I../../src/lib-imap -I/usr/local/include -fast -xarch=v8plusa -I/usr/sfw/include -c -o imapc-client.lo imapc-client.c libtool: compile: cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-dns -I../../src/lib-ssl-iostream -I../../src/lib-mail -I../../src/lib-imap -I/usr/local/include -fast -xarch=v8plusa -I/usr/sfw/include -c imapc-client.c -KPIC -DPIC -o .libs/imapc-client.o "imapc-client.h", line 21: warning: enumerator value overflows INT_MAX (2147483647) libtool: compile: cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-dns -I../../src/lib-ssl-iostream -I../../src/lib-mail -I../../src/lib-imap -I/usr/local/include -fast -xarch=v8plusa -I/usr/sfw/include -c imapc-client.c -o imapc-client.o >/dev/null 2>&1 source='imapc-connection.c' object='imapc-connection.lo' libtool=yes \ DEPDIR=.deps depmode=none /bin/bash ../../depcomp \ /bin/bash ../../libtool --tag=CC --mode=compile cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-dns -I../../src/lib-ssl-iostream -I../../src/lib-mail -I../../src/lib-imap -I/usr/local/include -fast -xarch=v8plusa -I/usr/sfw/include -c -o imapc-connection.lo imapc-connection.c libtool: compile: cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-dns -I../../src/lib-ssl-iostream -I../../src/lib-mail -I../../src/lib-imap -I/usr/local/include -fast -xarch=v8plusa -I/usr/sfw/include -c imapc-connection.c -KPIC -DPIC -o .libs/imapc-connection.o "../../src/lib-imap/imap-util.h", line 6: warning: useless declaration "imapc-client.h", line 21: warning: enumerator value overflows INT_MAX (2147483647) "imapc-connection.c", line 1446: operand cannot have void type: op "==" "imapc-connection.c", line 1446: operands have incompatible types: const void "==" pointer to struct imapc_command {pointer to struct pool {..} pool, pointer to struct buffer {..} data, unsigned int send_pos, unsigned int tag, enum imapc_command_flags {IMAPC_COMMAND_FLAG_RETRIABLE(4), IMAPC_COMMAND_FLAG_PRELOGIN(2), IMAPC_COMMAND_FLAG_SELECT(1)} flags, pointer to struct imapc_connection {..} conn, pointer to struct imapc_client_mailbox {..} box, union {..} streams, pointer to function(pointer to const struct imapc_command_reply {..}, pointer to void) returning void callback, pointer to void context, unsigned int idle :1, unsigned int wait_for_literal :1} cc: acomp failed for imapc-connection.c gmake[3]: *** [imapc-connection.lo] Error 1 gmake[3]: Leaving directory `/net/fileserv/export/sunsrc/src/dovecot-2.1.beta1/src/lib-imap-client' Viele Grüße, Jürgen Obermann Hochschulrechenzentrum der Justus-Liebig-Universität Gießen Heinrich-Buff-Ring 44 Tel. 0641-9913054

2 5

[Dovecot] Unique message IDs?
by Alexander Chekalin 23 Nov '11

23 Nov '11

Hello, I'm working with indexing my mail box. What I need is to have index in which mailing specified header string is located. I work with the messages via IMAP. I know that sounds like FTS can help me but no, I don't want to index whole message nor I want to patch FTS source to make it to index headers only. I need a way to identify message across my mail box. The idea is that I can move messages between IMAP folders and the index still should be able to identify it. What I want to know, will UID strings be unique across all my messages no matter which IMAP folder it belongs now to, or the UID can change if I move message? If I remove dovecot-uidlist from the folder will UIDs of messages in the folder be changed? What happened if I put a message to the given IMAP folder (and dovecot-uidlist will record UID for it), then shut down dovecot, and (given maildir storage model) move the message's file info another folder in the same mail box - after I start dovecot, will the UID for the message be the same or not? Thank you in advance, Alexander Chekalin

3 6

[Dovecot] dsync strange duplicate directories
by Frank 23 Nov '11

23 Nov '11

Hello, i'm testing whether dsync will help me in setting up a redundant master - master imap setup and experience this: 1. Master 1 dovecot is running, master 2 dovecot is down 2. I use rsync to create an exact copy of the master 1 maildir on master 2 3. I start up master 2 dovecot 4. I do a dsync on master 2: dsync -D -u test(a)example.com mirror ssh root@master1 dsync -D -u test(a)example.com Now what i see is this: Each mail directory is duplicated on master 1 and master 2 to a directory name with some MD5 hash value (as it seems) e.g. before dsync: ls -a /home/vmail/example.com/test/Maildir cur new .Drafts .Junk .Sent ... after dsync: ls -a /home/vmail/example.com/test/Maildir cur new .Drafts .Drafts_af61060f6f9fcb4efc0a00002691362e .Junk .Junk_b261060f6f9fcb4efc0a00002691362e .Sent .Sent_b261060f6f9fcb4efc0a00002691362e ... The new directories contain the same files as the original directories. What am i doing wrong? Thanks for the help Frank

1 0

[Dovecot] disable imap info logging
by Chris Young 22 Nov '11

22 Nov '11

Is there a way to disable the imap info logging? My logs are filling with tons of login/logout messages Nov 22 18:23:25 imap-login: Info: Login: user=<USER1>, method={method}, rip=10.86.189.79, lip=10.86.189.82, mpid=22488 Nov 22 18:23:25 imap(USER1): Info: Disconnected: Logged out bytes=54/726

2 1