- dovecot - dovecot.org

[Dovecot] Random Loss of Connection with Thunderbird and Dovecot
by Jay Welch 24 Nov '11

24 Nov '11

Hi, Dovecot Version: 1.2.16 OS: CENTOS 5.5 I am having issues with Thunderbird connecting to Dovecot at random times. Usually an error comes up and states that Thunderbird cannot connect to the server. The only way I have been able to fix this is reset/repair the network connection or reboot the computer. Is there any parameters I can change in Dovecot to fix this issue? Does anyone know what is likely going on? I have been reading forums and I cannot find anything. Thanks

2 1

[Dovecot] Excluding some system users after configuration
by Nanitous 24 Nov '11

24 Nov '11

Dear readers, Consider an installed Postfix configuration (2.3.3) on CentOS. Now I want to install Dovecot (alas only version 1.0.7.7 is available) to provide IMAP services for a few system users, but not all. Most importantly the mail delivery by postfix for some of these system user /must/ not change after the installation of Dovecot. How can I prevent the installation of Dovecot to touch some specific system user accounts? Thanks in advance, /Twan

2 1

[Dovecot] How to disable pop3 in version 2?
by Knute Johnson 24 Nov '11

24 Nov '11

I'm about to bring up a new mail server running Ubuntu 11.10 with Dovecot 2. I've been using 1.2 all along and there are a bunch more config files in 2. In 1.2 I just edited the protocols statement but I can't find one in version 2. Is there a way to disable pop3 or do I just firewall the ports? And a related question, I've been using imaps on port 993 but I hear that's not the best solution anymore, I should be using imap with STARTTLS? How do I disable imaps? Thanks, -- Knute Johnson

2 4

Re: [Dovecot] Seg fault in dovecot/auth 2.0.15
by Mark Goldey 24 Nov '11

24 Nov '11

Sorry about the HTML. I removed the string "-O2" from the /auth Makefile and, for good measure, did make clean, make and make install for all of Dovecot. Still, it crashed when trying to log in via IMAP (webmail). Core dumped, here's the backtrace. [snip] Core was generated by `dovecot/auth -w'. Program terminated with signal 11, Segmentation fault. #0 0x00000000 in ?? () (gdb) bt full #0 0x00000000 in ?? () No symbol table info available. #1 0x0805b0c7 in auth_worker_handle_user (client=0x82754d0, id=2, args=0x82601c8) at auth-worker-client.c:405 auth_request = 0x82776e8 userdb_id = 1 #2 0x0805b630 in auth_worker_handle_line (client=0x82754d0, line=0x82757da "2\tUSER\t1\tuser=mgoldXX@goldey.net\tservice=imap\toriginal_username=mgoldXX@goldey.net\trequested_login_user\tlip=127.0.0.1\trip=127.0.0.1\tlport=143\trport=47574\tsecured=1\tsuccessful=1\tmech=PLAIN") at auth-worker-client.c:534 args = 0x82601c0 id = 2 ret = false #3 0x0805b890 in auth_worker_input (client=0x82754d0) at auth-worker-client.c:614 _data_stack_cur_id = 3 line = 0x82757da "2\tUSER\t1\tuser=mgoldXX@goldey.net\tservice=imap\toriginal_username=mgoldXX@goldey.net\trequested_login_user\tlip=127.0.0.1\trip=127.0.0.1\tlport=143\trport=47574\tsecured=1\tsuccessful=1\tmech=PLAIN" ret = 183 #4 0xb7726021 in io_loop_call_io (io=0x8275688) at ioloop.c:384 ioloop = 0x8268398 t_id = 2 #5 0xb77270d3 in io_loop_handler_run (ioloop=0x8268398) at ioloop-epoll.c:213 ctx = 0x8273f38 event = 0x8273f78 list = 0x82756b0 io = 0xbf80049f tv = {tv_sec = 2147483, tv_usec = 0} msecs = 1 ret = 1 i = 0 j = 0 call = 192 #6 0xb7725fa0 in io_loop_run (ioloop=0x8268398) at ioloop.c:405 No locals. #7 0xb7711baa in master_service_run (service=0x82682e8, callback=0x805e466 <worker_connected>) at master-service.c:481 No locals. #8 0x0805e7aa in main (argc=2, argv=0x82681c0) at main.c:298 c = -1 And, for good measure: (gdb) fr 1 #1 0x0805b0c7 in auth_worker_handle_user (client=0x82754d0, id=2, args=0x82601c8) at auth-worker-client.c:405 405 auth_request->userdb->userdb->iface-> (gdb) p *auth_request->userdb->userdb $1 = {args = 0x8268d10 "", cache_key = 0x0, blocking = true, id = 1, init_refcount = 1, iface = 0x807b320} (gdb) p *auth_request->userdb->userdb->iface $2 = {name = 0x8074f3d "vpopmail", preinit = 0x8069a27 <vpopmail_preinit>, init = 0, deinit = 0, lookup = 0x806975f <vpopmail_lookup>, iterate_init = 0, iterate_next = 0, iterate_deinit = 0} This is all Greek to me, but I'm happy to do more troubleshooting. --mhg

2 1

[Dovecot] 1.2.15 can't get zlib working
by Stan Hoeppner 24 Nov '11

24 Nov '11

Following these instructions: http://wiki.dovecot.org/Plugins/Zlib I enabled zlib and restarted Dovecot. I made a backup copy of a 68MB mbox file and moved it to a non mail directory. The mbox file is an existing TBird IMAP folder in my UNIX user mail directory. It is an archive of a defunct mailing list. It was a regular IMAP folder prior to attempting this. I was able to access all emails in the folder. It worked fine. I gzipped the original mbox file down to 14MB and removed the write flag with chmod. I launched TBird and received the following error in Activity Manager when accessing this IMAP folder: The current operation on '1-Spam-l' did not succeed. The mail server for account stan(a)hardwarefreak.com responded: Mailbox doesn't exist: 1-Spam-l I deleted the Dovecot index files and the TBird 1-Spam-l.msf file which didn't help. Curiously, there are no entries in either dovecot.err or dovecot.log, giving not even the slightest hint as to where I should troubleshoot. Kinda sucks when one follows instructions exactly, simple instructions at that, and it doesn't work, and generates zero log errors. A bit frustrating... Any ideas? /$ la /home/stan/mail/1-Spam-l.gz -r-------- 1 stan stan 14M Oct 28 2010 /home/stan/mail/1-Spam-l.gz # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.38.6 i686 Debian 6.0.3 xfs log_path: /var/log/dovecot.err info_log_path: /var/log/dovecot.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap ssl_parameters_regenerate: 0 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_process_per_connection: no login_process_size: 16 login_processes_count: 1 login_max_processes_count: 1 login_max_connections: 8 max_mail_processes: 4 mail_privileged_group: mail mail_location: mbox:/home/%u/mail:INBOX=/var/mail/%u mailbox_idle_check_interval: 15 mbox_write_locks: fcntl mbox_very_dirty_syncs: yes mbox_lazy_writes: no mail_plugins: fts fts_squat zlib imap_client_workarounds: tb-extra-mailbox-sep lda: postmaster_address: postmaster(a)hardwarefreak.com mail_plugins: sieve auth default: worker_max_count: 1 process_size: 16 passdb: driver: pam args: max_requests=1 userdb: driver: passwd plugin: fts: squat fts_squat: partial=4 full=10 -- Stan

2 5

[Dovecot] doveadm import assertion failed
by Micah Anderson 24 Nov '11

24 Nov '11

Restoring a user's mailbox yesterday resulted in 'doveadm import' panic'ing with an assertion failure and giving a backtrace: /usr/bin/doveadm import -u <user> mdbox:/maildir/riseup.net/a/<user>/.daily.1/mdbox restored_from_backups/daily1 all doveadm(<user>): Error: Transaction log /maildir/riseup.net/a/<user>/.daily.1/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.log: duplicate transac tion log sequence (3) doveadm(<user>): Error: Transaction log /maildir/riseup.net/a/<user>/.daily.1/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.log: duplicate transac tion log sequence (3) doveadm(<user>): Panic: file mail-transaction-log-file.c: line 187 (mail_transaction_log_file_add_to_list): assertion failed: ((*p)->hdr.file_se q < file->hdr.file_seq) doveadm(<user>): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x3fd1a) [0x7f05152bbd1a] -> /usr/lib/dovecot/libdovecot.so.0(default_f atal_handler+0x32) [0x7f05152bbe02] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f051529519f] -> /usr/lib/dovecot/libdovecot-storage.so .0(+0xa596a) [0x7f05159e696a] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_file_open+0x1f8) [0x7f05159e7bc8] -> /usr/lib/ dovecot/libdovecot-storage.so.0(mail_transaction_log_find_file+0xd0) [0x7f05159e46e0] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_transa ction_log_view_set+0xcb) [0x7f05159e8bdb] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0xbe) [0x7f05159dff6e] -> /usr/lib/ dovecot/libdovecot-storage.so.0(mail_index_map+0x86) [0x7f05159d1816] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9a6da) [0x7f05159db6da] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_begin_to+0x56) [0x7f05159db956] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_ index_sync_begin+0x1e) [0x7f05159dc21e] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_sync_begin+0x121) [0x7f05159bbb41] -> /usr/lib/dove cot/libdovecot-storage.so.0(mdbox_sync+0x46) [0x7f05159bc1f6] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_storage_sync_init+0x43) [0x7f 05159bc293] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x31) [0x7f0515974031] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x27) [0x7f05159748b7] -> /usr/bin/doveadm(doveadm_mail_iter_init+0x8b) [0x40c9db] -> /usr/bin/doveadm() [0x40c284] -> /usr/bin/doveadm() [0x40a673] -> /usr/bin/doveadm(doveadm_mail_single_user+0x61) [0x40a731] -> /usr/bin/doveadm() [0x40a95d] -> /usr/bin/doveadm(doveadm_mail_try_run+0x141) [0x40ad71] -> /usr/bin/doveadm(main+0x381) [0x4107e1] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f0514b2dc4d] -> /usr/bin/doveadm() [0x409e59] This is with 2.0.15. Micah --

2 1

[Dovecot] v2.1.beta1 released
by Timo Sirainen 23 Nov '11

23 Nov '11

http://dovecot.org/releases/2.1/beta/dovecot-2.1.beta1.tar.gz http://dovecot.org/releases/2.1/beta/dovecot-2.1.beta1.tar.gz.sig Here's the first beta release of Dovecot v2.1. This version has already been tested quite a lot, so I'm not expecting any major bugs. So please upgrade and see if you can find any problems. I'm optimistic about getting rc1 released this year and perhaps even v2.1.0. Since alpha2 there have been a lot of fixes, especially to imapc backend. There are probably also some small new features, but nothing huge. As a reminder, here's the largest changes since v2.0: * Plugins now use UTF-8 mailbox names rather than mUTF-7: acl, autocreate, expire, trash, virtual * auth_username_format default changed to %Lu. If you really want case sensitive usernames, set it back to empty. * Solr full text search backend changed to use mailbox GUIDs instead of mailbox names, requiring reindexing everything. solr_old backend can be used with old indexes to avoid reindexing, but it doesn't support some newer features. + imapc (= IMAP client) storage allows using a remote IMAP server to be used as storage. This allows using Dovecot as a smart (caching) proxy or using dsync to do migration from remote IMAP server. + Mailbox indexing via queuing indexer service (required for Lucene) + Lucene full text search (FTS) backend rewritten with support for different languages + FTS finally supports "OR" search operation + FTS supports indexing attachments via external programs + IMAP FUZZY extension, supported by Lucene and Solr FTS backends + Mailbox list indexes + Statistics tracking via stats service. Exported via doveadm stats. + Autocreate plugin creates/subscribes mailboxes physically only when the mailbox is opened for the first time. Mailbox listing shows the autocreated mailboxes even if they don't physically exist. + Password and user databases now support default_fields and override_fields settings to specify template defaults/overrides. - listescape plugin works perfectly now

3 5

[Dovecot] dovecot as an imap "client"
by David LEROUX 23 Nov '11

23 Nov '11

Hi, I need to get emails from one of my users imap account on a server which is not managed by us to his local imap mailbox. I'm almost sure that I've read some times that dovecot would be able to do that, kind of imap relay, but I can't find it again. I'm not sure to be very clear. Thanks, -- David

4 4

[Dovecot] [PATCH] SCRAM-SHA-1 authentication
by Florian Zeitz 23 Nov '11

23 Nov '11

Hy, over the last days I have implemented SCRAM-SHA-1 in Dovecot's 2.1 branch. It does not do SCRAM-SHA-1-PLUS, but should be extendable enough to introduce it later. There are some checks for the message format which (assuming the client acts correclty) are not strictly necessary during parsing. This is partially in the hope that it might aid client implementers, partially because it (IMHO) improves readability when checking against the RFC. Also errors found in this way could be sent to the client, this is however strictly OPTIONAL in the RFC, for now they are just logged. Some of the variable names are rather long. This is in order to have them match the terms introduced in the RFC, again I expect it to help readability (maybe my recent Objective-C programming showing though). I do feel somewhat insecure about my usage of some lib functions. Hopefully no API has been abused too much. I also note that there are a lot of fields in the scram_auth_request struct. I think they are all there for a reason, however feel free to prove me wrong. Attached is a hg export. It also includes a hmac-sha1 implementation, an adaption off of the hmac-md5 implementation already in Dovecot. I guess those should eventually be merged into a hash-independent hmac implementation, but I figured this would have to do for now. The implementation has been tested against GNU SASL and does appear to work fine. (The command line was `gsasl -m SCRAM-SHA-1 -a user -p pass --imap host` for those curious) Regards Florian "Florob" Zeitz

3 5

[Dovecot] Can't delete sub-folder
by pch0317 23 Nov '11

23 Nov '11

Hi list, I have problem with deleting sub-folder. I use thunderbird 8.0 as a client and dovecot 2.0.9 with imap protocol as a server. I use dovecot with tb-extra-mailbox-sep parameter. I use mbox mailboxes and thunderbird with *not checked* option 'server supports folders that contain sub-folders and messages' so when I create sub-folder I can choose between 'folders only' and 'messages only'. When I try to delete 'parent' folder which contain 'messages only' folder, error message appear: [ALREADYEXISTS] Mailbox has children, delete them first. Ok, so I delete 'message only' folder first and try to delete parent folder, but the same error appear: [ALREADYEXISTS] Mailbox has children, delete them first. When I list mailboxes from console I see inside 'parent' folder ".imap" folder. When I delete .imap folder from console and then delete parent folder from thunderbird, parent folder is deleted correctly. Which application create this ".imap" hidden folder and how solve this problem. Thanks

2 1

[Dovecot] Problem compiling dovecot 2.1 Beta1 under Solaris 10 on SPARC
by Jürgen Obermann 23 Nov '11

23 Nov '11

Hello, compiling dovecot 2.1 Beta1 under Solaris 10 on SPARC with Sun Studio 11 stops with the following error: Making all in lib-imap-client gmake[3]: Entering directory `/net/fileserv/export/sunsrc/src/dovecot-2.1.beta1/src/lib-imap-client' source='imapc-client.c' object='imapc-client.lo' libtool=yes \ DEPDIR=.deps depmode=none /bin/bash ../../depcomp \ /bin/bash ../../libtool --tag=CC --mode=compile cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-dns -I../../src/lib-ssl-iostream -I../../src/lib-mail -I../../src/lib-imap -I/usr/local/include -fast -xarch=v8plusa -I/usr/sfw/include -c -o imapc-client.lo imapc-client.c libtool: compile: cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-dns -I../../src/lib-ssl-iostream -I../../src/lib-mail -I../../src/lib-imap -I/usr/local/include -fast -xarch=v8plusa -I/usr/sfw/include -c imapc-client.c -KPIC -DPIC -o .libs/imapc-client.o "imapc-client.h", line 21: warning: enumerator value overflows INT_MAX (2147483647) libtool: compile: cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-dns -I../../src/lib-ssl-iostream -I../../src/lib-mail -I../../src/lib-imap -I/usr/local/include -fast -xarch=v8plusa -I/usr/sfw/include -c imapc-client.c -o imapc-client.o >/dev/null 2>&1 source='imapc-connection.c' object='imapc-connection.lo' libtool=yes \ DEPDIR=.deps depmode=none /bin/bash ../../depcomp \ /bin/bash ../../libtool --tag=CC --mode=compile cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-dns -I../../src/lib-ssl-iostream -I../../src/lib-mail -I../../src/lib-imap -I/usr/local/include -fast -xarch=v8plusa -I/usr/sfw/include -c -o imapc-connection.lo imapc-connection.c libtool: compile: cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-dns -I../../src/lib-ssl-iostream -I../../src/lib-mail -I../../src/lib-imap -I/usr/local/include -fast -xarch=v8plusa -I/usr/sfw/include -c imapc-connection.c -KPIC -DPIC -o .libs/imapc-connection.o "../../src/lib-imap/imap-util.h", line 6: warning: useless declaration "imapc-client.h", line 21: warning: enumerator value overflows INT_MAX (2147483647) "imapc-connection.c", line 1446: operand cannot have void type: op "==" "imapc-connection.c", line 1446: operands have incompatible types: const void "==" pointer to struct imapc_command {pointer to struct pool {..} pool, pointer to struct buffer {..} data, unsigned int send_pos, unsigned int tag, enum imapc_command_flags {IMAPC_COMMAND_FLAG_RETRIABLE(4), IMAPC_COMMAND_FLAG_PRELOGIN(2), IMAPC_COMMAND_FLAG_SELECT(1)} flags, pointer to struct imapc_connection {..} conn, pointer to struct imapc_client_mailbox {..} box, union {..} streams, pointer to function(pointer to const struct imapc_command_reply {..}, pointer to void) returning void callback, pointer to void context, unsigned int idle :1, unsigned int wait_for_literal :1} cc: acomp failed for imapc-connection.c gmake[3]: *** [imapc-connection.lo] Error 1 gmake[3]: Leaving directory `/net/fileserv/export/sunsrc/src/dovecot-2.1.beta1/src/lib-imap-client' Viele Grüße, Jürgen Obermann Hochschulrechenzentrum der Justus-Liebig-Universität Gießen Heinrich-Buff-Ring 44 Tel. 0641-9913054

2 5

[Dovecot] Unique message IDs?
by Alexander Chekalin 23 Nov '11

23 Nov '11

Hello, I'm working with indexing my mail box. What I need is to have index in which mailing specified header string is located. I work with the messages via IMAP. I know that sounds like FTS can help me but no, I don't want to index whole message nor I want to patch FTS source to make it to index headers only. I need a way to identify message across my mail box. The idea is that I can move messages between IMAP folders and the index still should be able to identify it. What I want to know, will UID strings be unique across all my messages no matter which IMAP folder it belongs now to, or the UID can change if I move message? If I remove dovecot-uidlist from the folder will UIDs of messages in the folder be changed? What happened if I put a message to the given IMAP folder (and dovecot-uidlist will record UID for it), then shut down dovecot, and (given maildir storage model) move the message's file info another folder in the same mail box - after I start dovecot, will the UID for the message be the same or not? Thank you in advance, Alexander Chekalin

3 6

[Dovecot] dsync strange duplicate directories
by Frank 23 Nov '11

23 Nov '11

Hello, i'm testing whether dsync will help me in setting up a redundant master - master imap setup and experience this: 1. Master 1 dovecot is running, master 2 dovecot is down 2. I use rsync to create an exact copy of the master 1 maildir on master 2 3. I start up master 2 dovecot 4. I do a dsync on master 2: dsync -D -u test(a)example.com mirror ssh root@master1 dsync -D -u test(a)example.com Now what i see is this: Each mail directory is duplicated on master 1 and master 2 to a directory name with some MD5 hash value (as it seems) e.g. before dsync: ls -a /home/vmail/example.com/test/Maildir cur new .Drafts .Junk .Sent ... after dsync: ls -a /home/vmail/example.com/test/Maildir cur new .Drafts .Drafts_af61060f6f9fcb4efc0a00002691362e .Junk .Junk_b261060f6f9fcb4efc0a00002691362e .Sent .Sent_b261060f6f9fcb4efc0a00002691362e ... The new directories contain the same files as the original directories. What am i doing wrong? Thanks for the help Frank

1 0

[Dovecot] disable imap info logging
by Chris Young 22 Nov '11

22 Nov '11

Is there a way to disable the imap info logging? My logs are filling with tons of login/logout messages Nov 22 18:23:25 imap-login: Info: Login: user=<USER1>, method={method}, rip=10.86.189.79, lip=10.86.189.82, mpid=22488 Nov 22 18:23:25 imap(USER1): Info: Disconnected: Logged out bytes=54/726

2 1

[Dovecot] No duplicates on imap copy?
by Alexander Chekalin 22 Nov '11

22 Nov '11

Hello, when from my script I try to copy messages from one imap folder into another own (within the same imap mailbox). That works perfectly, but... If I copy the same message N times from one folder into another one, in the destination folder I see N copies of the same message, each with its own UID. I wonder if there any way to deduplicate folder content (so in the destination folder I'll get only one copy of each message)? I'd implement something like that myself in my script but I just don't know which part of the messages should I compare - probably md5 of headers? Thank you in advance! Yours, Alexander Chekalin

2 1

Re: [Dovecot] Solaris hardware crypto engines
by Damon Atkins 22 Nov '11

22 Nov '11

Here are some blogs on the topic. http://wikis.sun.com/display/CryptoPerf/Using+the+UltraSPARC+cryptographic+… Solaris 10 # /usr/sfw/bin/openssl engine -c -t # cc -fast*-I /usr/sfw/include -L /usr/sfw/lib -lcrypto* aes_test.c -o aes_test.out http://blogs.oracle.com/DanX/entry/sparc_t4_openssl_engine http://blogs.oracle.com/DanX/entry/where_s_the_crypto_libraries http://blogs.oracle.com/DanX/entry/solaris_x86_aesni_openssl_engine http://blogs.oracle.com/chichang1/entry/rsa_performance_of_sun_fire Here is some info from my intel box Solaris 11 # /usr/bin/openssl engine -c -t (aesni) Intel AES-NI engine (no-aesni) % no-aesni means no aes H/W acceleration [ available ] (dynamic) Dynamic engine loading support [ unavailable ] (pkcs11) PKCS #11 engine support [RSA, DSA, DH, RAND, DSA] [ available ] $ isainfo -v # My cpu does not have 'aes' support 64-bit amd64 applications cx16 sse3 sse2 sse fxsr mmx cmov amd_sysc cx8 tsc fpu 32-bit i386 applications ahf cx16 sse3 sse2 sse fxsr mmx cmov sep cx8 tsc fpu # ldd /opt/dovecot/libexec/dovecot/ssl-build-param **** libssl.so.1.0.0 => /lib/libssl.so.1.0.0 *** *** libcrypto.so.1.0.0 => /lib/libcrypto.so.1.0.0* *** libc.so.1 => /lib/libc.so.1 libnsl.so.1 => /lib/libnsl.so.1 libsocket.so.1 => /lib/libsocket.so.1 librt.so.1 => /lib/librt.so.1 libsendfile.so.1 => /lib/libsendfile.so.1 libmp.so.2 => /lib/libmp.so.2 libmd.so.1 => /lib/libmd.so.1 libm.so.2 => /lib/libm.so.2 ./configure --prefix=/opt/dovecot --with-ldap=yes --with-gssapi --with-ssldir=/etc/openssl Install prefix . : /opt/dovecot File offsets ... : 64bit I/O polling .... : poll I/O notifys .... : none SSL ............ : yes (OpenSSL) GSSAPI ......... : yes passdbs ........ : passwd passwd-file shadow pam checkpassword ldap : -bsdauth -sia -sql -vpopmail userdbs ........ : static prefetch passwd passwd-file checkpassword ldap : -sql -vpopmail -nss SQL drivers .... : : -pgsql -mysql -sqlite Note Under OpenSolaris I did the following: CPPFLAGS=-I/usr/sfw/include LDFLAGS=-R/usr/sfw/lib ./configure --prefix=/opt/dovecot --with-ldap=yes --with-gssapi --with-ssldir=/etc/openssl (most likely Solaris 10 is the same as above, openssl may look old but I believe it is patched with compatible *fixes* from current openssl so application do not break. Apparently it took 5mths to update Solaris 11 to OpenSSL 1.0 and test everything) Cheers Damon.

1 0

[Dovecot] Dovecot Log analysis
by Thomas Hummel 21 Nov '11

21 Nov '11

Hello, Before writing them myself, I'd like to figure out if some tools exist (anvil ? ...) and how to use them to extract from dovecot logs things like who is doing what and how hard or how fast in order to do some rate limiting. For instance, I'd like to be able to identify, slow or block users who . read or write to much / slice of time . login/logout too often / slice of time Note : I'm still using the 1.2.x branch. Thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Groupe Exploitation et Infrastructure

2 1

[Dovecot] Dovecot performance issues with many writes
by Andy Robbins 21 Nov '11

21 Nov '11

We are currently experiencing performance issue with our Dovecot system which we believe is caused by excessive writes to the dovecot files. The confusing thing is that we are seeing more writes than reads on our Dovecot volume when you would assume that most of the IO should be reads from customers checking their mail. We're seeing reads vs. writes similar to the following: # iostat -d 5 -x Device: rrqm/s wrqm/s r/s w/s rsec/s wsec/s avgrq-sz avgqu-sz await svctm %util dm-4 0.00 0.00 485.80 865.80 3886.40 6926.40 8.00 28.69 19.63 0.70 94.00 drbd0 0.00 0.00 485.80 865.80 3886.40 6926.40 8.00 111.42 94.44 0.74 99.60 We can't figure out why we would be seeing twice as many writes as we are reads. Could this have something to do with the index files? Appreciate any assistance on this issue.

5 10

[Dovecot] uid=error
by Paresh Chalke 21 Nov '11

21 Nov '11

Hi Timo, We are facing this issue on our mail server 1. Two email id's are mapped to a same account 2. If I send a mail to both the account simultaneously i get below error "Nov 21 12:13:37 blade8 dovecot: lda(kapil.gupta(a)qlc.in): save: box=INBOX, uid=error, msgid=<1321857820.4ec9f31ce638c(a)SwiftMailer.generated>, size=10921" 3. Due to this the mail is delivered only to 1 email id. 4. I am loosing all my mails. Kindly help in the same ASAP. Regards, Paresh Chalke

3 3

[Dovecot] Question about imaps
by jgiles＠cybermesa.com 21 Nov '11

21 Nov '11

Hi List! Had a questions about imap vs. imaps. I read the ssl article at http://wiki2.dovecot.org/SSL and from what I am reading, imaps is no longer needed as imap with initiate SSL/TLS on its own if STARTTLS is started and I have disable_plaintext_auth=yes and ssl=required settings. I do have SSL up and working, and can connect using imap (143) to my server without issue, but was not able to connect using imaps (993) using Kmail as my client. I Was getting a client error stating that the authentication failed using my password. However, there was nothing in the mail.err or mail.log file even when I enable debugging. If I specify imaps as my only protocol, then dovecot fails to even start without any error loging at all. As I stated, imap works just fine. So, is imaps deprecated as mentioned in the article and imaps no longer needed? I am running Dovecot 2.0.13 on an Ubuntu 11.10 64bit server. This server is simply an imap serer and not a MTA (No postfix or sendmail installed.) Thanks! Joe

4 4

[Dovecot] Iterate over domain
by Francisco Wagner C. Freire 21 Nov '11

21 Nov '11

Hello, We need to use doveadm commands on all accounts of a single domain, for now i need to query the database using scripts and for each one user, run doveadm. I can use iterate but, only for all server accounts, have any way to use doveadm iterate over a single domain? Thanks

2 1

[Dovecot] issues with 2.1b1 on OS X
by metro_domain_admin＠fastmail.fm 21 Nov '11

21 Nov '11

Two issues came up for me when building 2.1beta1 on OS X (10.5.8 on PPC). The first was already mentioned in an earlier thread by a BSD user (http://dovecot.org/list/dovecot/2011-September/061201.html) I just wanted to point out that the error is still occurring in spite of a new test for GNU ld in the configure script. I needed to remove "-no-undefined" specifically: #NOPLUGIN_LDFLAGS="-no-undefined" if test "$with_gnu_ld" = yes; then NOPLUGIN_LDFLAGS="$NOPLUGIN_LDFLAGS -Wl,--as-needed" fi More important, Dovecot aborts on launch with the following error: Nov 19 10:23:52 kerio2 dovecot[33553]: master: Fatal: kevent(EV_ADD, READ, 16) failed: Invalid argument I configured using the same args as I had used successfully on 2.0.15: --with-gssapi --with-ldap --with-sql --prefix=/opt/dovecot-2.X.X. I also tried an exact copy of my known-good config from 2.0.15, to no avail. Thanks, Tony

2 2

Re: [Dovecot] Mail_quota plugin and LDAP on Dovecot 1.2
by Victor 21 Nov '11

21 Nov '11

Thank a lot, your were completely in the truth Victor Onate

1 0

[Dovecot] Using google 2 step authentication
by Davide Cavion 20 Nov '11

20 Nov '11

Google authenticator has a PAM interface: http://code.google.com/p/google-authenticator/wiki/PamModuleInstructions Have someone tried implementing it onto Dovecot? It would be really great if you consider your emails important!

2 2

[Dovecot] Released Pigeonhole v0.2.5 for Dovecot v2.0.16
by Stephan Bosch 19 Nov '11

19 Nov '11

Hello Dovecot users, Before I move active development of Pigeonhole to Dovecot v2.1, I first release all the pending bug fixes and small improvements. Changelog v0.2.5: + Sieve vacation extension: made discard message for implicit delivery more verbose - The sieve-test tool: mixed up original and final envelope recipient in implementation of command line arguments. - Sieve vacation extension: resolved FIXME regarding the use of variables in the :handle argument. Variables are now handled correctly. - Sieve body extension: fixed handling of :content "message/rfc822". This now yields the headers of the embedded message as required by the specification. Handling of :content "multipart" remains to be fixed. - LDA Sieve plugin: fixed problem with recipient_delimiter configuration. Now it falls back to global recipient_delimiter setting if plugin/recipient_delimiter is not set. The release is available as follows: http://www.rename-it.nl/dovecot/2.0/dovecot-2.0-pigeonhole-0.2.5.tar.gz http://www.rename-it.nl/dovecot/2.0/dovecot-2.0-pigeonhole-0.2.5.tar.gz.sig Refer to http://pigeonhole.dovecot.org and the Dovecot v2.0 wiki for more information. Have fun testing this new release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

[Dovecot] CCing outbound IMAP mail?
by Dave Stevens 18 Nov '11

18 Nov '11

For some users on my site I'd like to be able to CC a particular user on all outgoing IMAP mails. Incoming I can do but don't see how to do outgoing. Ideas? Dave -- It is told that such are the aerodynamics and wing loading of the bumblebee that, in principle, it cannot fly...if all this be true...life among bumblebees must bear a remarkable resemblance to life in the United States. -- John Kenneth Galbraith, in American Capitalism: The Concept of Countervailing Power

3 2

[Dovecot] Mail_quota plugin and LDAP on Dovecot 1.2
by Victor 18 Nov '11

18 Nov '11

Hi, I'm new in this List, but I have 6 years using Dovecot on my debian from etch,lenny and now squeeze Package: dovecot-imapd Version: 1:1.2.15-4 Tags: squeeze -- System Information: Debian Release: 6.0 APT prefers stable APT policy: (500, 'stable') Architecture: amd64 (x86_64) Kernel: Linux 2.6.32-5-amd64 (SMP w/24 CPU cores) Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8) Shell: /bin/sh linked to /bin/dash Versions of packages dovecot-imapd depends on: ii dovecot-common 1:1.2.15-4 secure mail server that supports m ii libc6 2.11.2-10 Embedded GNU C Library: Shared lib ii libldap-2.4-2 2.4.23-7 OpenLDAP libraries ii libssl0.9.8 0.9.8o-4 SSL shared libraries the quota_imap plugin not working when I use against MailquotaSize Attribute of LDAP users. this setup works perfectly on lenny and dovecot-imapd 1:1.0.15-2.3 but on squeeze dovecot-imad 1:1.2.15-7 doesn't work, the service is up, but The quota does not display. In logs nothing happens the configuration in dovecot.conf below protocol imap { mail_plugins = quota imap_quota } protocol lda { mail_plugins = quota } userdb ldap { args = /etc/dovecot/dovecot-ldap.conf } the configuration in dovecot-ldap.conf below uris = ldap://server-ldap.com.ve auth_bind = yes ldap_version = 3 base = dc=dominio,dc=com,dc=uk deref = never scope = subtree user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid,mail=Maildir,mailQuotaSize=quota=dirsize:storage user_filter = (&(objectClass=posixAccount)(uid=%u)) pass_attrs = uid=user,userPassword=password,homeDirectory=userdb_home,uidNumber=userdb_uid,gidNumber=userdb_gid pass_filter = (&(objectClass=posixAccount)(uid=%u)) This is the same configuration in the 6 last years. So, I would really appreciate if give me a hand which are more than 15000 Users who administered easily taking the quota in the LDAP attribute. and I want to keep the scheme. Thz Victor Onate Usuario Linux

2 1

[Dovecot] setting up multiple listeners
by David Mehler 18 Nov '11

18 Nov '11

Hello, I'm using Dovecot v2 and am atempting to get webmail going. I'm trying to set up imap so that port 993 only is listening on the external interface, for both ipv4 and ipv6, but that on localhost only again for ipv4 and ipv6 unencrypted port 143 is active. I've tried various combinations but keep getting an error invalid number. I've googled and not come up with the missing point. Thanks. Dave.

2 1

[Dovecot] dsync problems
by Micah Anderson 17 Nov '11

17 Nov '11

When a user renames their username, I am using dsync to copy their mail over to the new username's mail location[0]. Some of the dsyncs are failing with errors that I dont know how to work with, for example: dsync(<username>): Error: Trying to open a non-listed mailbox with guid=41fcd40303c8a64e432300007ef44c7a dsync(<username>): Error: msg iteration failed: Couldn't open mailbox 41fcd40303c8a64e432300007ef44c7a dsync(<username>): Error: Trying to open a non-listed mailbox with guid=41fcd40303c8a64e432300007ef44c7a dsync(<username>): Error: Trying to open a non-listed mailbox with guid=42fcd40303c8a64e432300007ef44c7a dsync(<username>): Error: Trying to open a non-listed mailbox with guid=43fcd40303c8a64e432300007ef44c7a dsync(<username>): Error: Trying to open a non-listed mailbox with guid=44fcd40303c8a64e432300007ef44c7a ERROR: dsync failed, exit code: 256 The errors cause a non-zero exit code from dsync, which causes my rename script to bail out. What are these errors, and how can I fix them? Thanks, micah 0. Why use dsync instead of a simple mv operation? This seems to be necessary for two corner cases: 1. dovecot creates the new mailbox automatically when the user logs in or receives a mail, so if the user changes their mail and logs in or receives an email before the move has been done, then the mailbox is created and then a move command will fail. 2. If there has been new mail created under the new name, we can't just simply remove the stuff that is automatically created there and replace it with the old things because we could potentially be removing mail that has been delivered in the mean time. I'd be really interested if people had suggestions for a better mechanism, or perhaps a way to have dovecot not create the new mail location automatically. --

3 2

[Dovecot] 2.1: virtual plugin and lsub
by e-frog 17 Nov '11

17 Nov '11

Hi Timo, I'm using the virtual plugin and have 2 mailboxes configured in the "virtual" namespace (dovecot -n attached). Using lsub with dovecot 2.0.15 leads to the following result: 1 lsub "" "virtual/*" * LSUB () "/" "virtual/Lists" * LSUB () "/" "virtual/unread" 1 OK Lsub completed. However with dovecot 2.1 (latest hg as of today) and the same config there is a 3rd mailbox "virtual" listed which doesn't exist: 1 lsub "" "virtual/*" * LSUB () "/" "virtual" * LSUB () "/" "virtual/Lists" * LSUB () "/" "virtual/unread" 1 OK Lsub completed. Thunderbird shows the "virtual" mailbox as selectable and not grayed out as with 2.0.15. Clicking on that mailbox gives an error message "Mailbox doesn't exist: virtual". Thanks, e-frog

2 3

[Dovecot] Performance-Tuning
by Peer Heinlein 17 Nov '11

17 Nov '11

Hi, I have > 11 TB hard used Mailstorage, saved als maildir in ext3 on HP EVA. I always wanted to make some mesurements about several influences to the performance (switch to ext4, switch to mdbox), but I never had enough time to do that. At the moment I *need* more speed, we have too much waitI/O on the system and I already used all other performance and tuning-tricks (separated cache, noatime, fsync and all that stuff). I have to change my setup, maybe somebody else here have hard facts: *) Is ext4 faster? How much faster? *) Is it faster because of the ext4 kernel-module (which can be used on ext3 to) or because of the ext4 filesystem layout? *) Is mdbox really faster? I'd like to have mdbox to have better performance in running my backup-processes. But does it bring some performance boosts to? Thanks for any hints an tricks, Peer -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030/405051-42 Fax: 030/405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

13 25

[Dovecot] Port variable in LMTP userdb lookups?
by Mark Zealey 17 Nov '11

17 Nov '11

Hi all, I'm currently changing some systems to use the redirector service, which means that to get local deliveries going I need to get lmtp set up so it can be redirected as well. This is working fine, however we have a number of different ports running on our servers depending on which brand a customer is using. When the time comes to do the user look up, we use (port, user, domain) to do a unique database lookup which works fine for everything (proxied pop, imap, lmtp & straight pop, imap) but not straight lmtp - perhaps because it doesn't have a 2-stage login process unlike the pop/imap protocols. Looking at the SQL query we are issuing, the %a port variable is set to 0 even though the connection is coming in from TCP. Is there a way to change this? We are running dovecot 2.0.12 however looking through the changelogs I can't see this would be fixed in the newest version. Thanks, Mark

3 4

Re: [Dovecot] Please advise on very fast search
by Alexander Chekalin 17 Nov '11

17 Nov '11

Thanks, Robert, will take a look at. What I'm afraid for is how database storage should be planned (storage, CPU, RAM, scaling when will be over-filled). When dealing with files (I'm using maildir), it is much easy to understand and to fix just about everything. Adding database involves tune it up too, and I'll have more points of 'tune it a bit' In fact work with Dovecot is pretty nice, but I think I can tune it to work faster. I now run it on FreeBSD (on UFS2), maybe I should change OS + FS, but need to test (really hope ZFS disks on SAS drives will help; still find no benchmarks on such a setup). Will also try to use full text search, but afraid of index size (and I need no search on body, just on headers). Anyway thank your for pointing me in right directions! Yours, Alexander

3 16

[Dovecot] Getting started with sieve and conversion from procmail
by Alex 17 Nov '11

17 Nov '11

Hi, I have a fedora15 system with dovecot-v2.0.15, dovecot-pigeonhole and and amavisd-new and would like to implement it on my system using postfix. I've read the basic wiki documentation, but I really can't figure out the proper starting point in my case. I've enabled "protocol lda" in 15-lda.conf and added "sieve" to the list of mail_plugins. I'm trying to adapt postfix to use deliver as its LDA for multiple virtual domains. I've added the following to master.cf: dovecot unix - n n - - pipe flags=DRhu user=dovecot:dovecot argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${recipient} -a "${RECIPIENT}" Is that the proper format? Is it okay to use the dovecot user here, or should I create a new user? What permissions does this user need to possess? I've added the following to main.cf: dovecot_destination_recipient_limit = 1 virtual_transport = dovecot I have a number of procmail scripts and I've converted them to sieve, but they didn't convert very well. Can someone show me how to convert the following: :0 { :0 fhW | /home/alex/bin/process-mail.pl } The script skipped right over that. I'm also trying to convert the following: :0 * (RCVD_IN_DNSWL_HI|RCVD_IN_DNSWL_LOW|RCVD_IN_HOSTKARMA_W) * !USER_IN_WHITELIST * !BAYES_00 * !URIBL_ * !KHOP_RCVD_UNTRUST * !RCVD_IN_DNSWL_MED * !SPF_SOFTFAIL * SPF_HELO_PASS * SPF_PASS { LOG="DNSWL: " :0: whitelist/dnswl } The script only produced the following: if true { if true { if true { if true { if true { if true { if true { if true { if true { if true { fileinto "{"; fileinto " LOG="DNSWL: ""; fileinto " :0:"; fileinto " whitelist/dnswl"; fileinto "}"; } Any ideas greatly appreciated. Thanks, Alex

4 22

[Dovecot] v2.0.16 released
by Timo Sirainen 17 Nov '11

17 Nov '11

http://dovecot.org/releases/2.0/dovecot-2.0.16.tar.gz http://dovecot.org/releases/2.0/dovecot-2.0.16.tar.gz.sig I only now noticed that the VSZ limits weren't being enforced with earlier v2.0.x releases (or they were set 1024 times too high). So if a Dovecot process was leaking memory, it wasn't being killed by kernel. Now that this enforcing is done, some installations will probably start seeing errors about reaching these limits in normal operation. The default_vsz_limit is 256 MB. You may want to increase it in larger installations to 1 GB just in case. Besides the changes listed below, a lot of smaller fixes were done. v2.0.16 2011-11-17 Timo Sirainen <tss(a)iki.fi> * VSZ limits weren't being enforced for any processes. On server with large mailboxes you may now see errors about it if the limits aren't high enough. To fix them, either increase individual service { vsz_limit } values or simply increase the default_vsz_limit setting. * Proxying: If using ssl=yes or starttls=yes with a hostname (not IP) as proxy destination, require that the certificate matches the given hostname. * LMTP: Changed default client_limit to 1. This should improve LMTP throughput with default settings. * dsync: Quota is no longer enforced (i.e. dsync can't fail because user is over quota). + Added "auto" mail storage driver, which can be used to autodetect mailbox location and format. This behavior is already the default for empty mail_location setting, so this change is mainly useful for shared namespace's location setting. + checkpassword: Export all auth %variables to AUTH_* environment.

1 0

[Dovecot] Bus factor of dovecot / GIT
by Thomas Koch 17 Nov '11

17 Nov '11

Hi, somebody from the kolab groupware project recently explained me that the Bus- Factor[1] of around 1 would be one of their primary reasons not to use Dovecot and stick with Cyrus. What do you think about that? Is the bus factor much higher then 1? [1] http://en.wikipedia.org/wiki/Bus_factor Somehow related: Since the free software world[2] slowly converges towards GIT as the "one and only" VCS, have you thought about a switch? It's much more likely that somebody checks out your code, looks into it and provides patches if the VCS is already installed. [2] Android, Debian, Drupal, Eclipse, Fedora, Gnome, KDE, Linux Kernel, Perl, PHP (ongoing), PostgreSQL, Qt, Ruby on Rails, X.org (freedesktop.org) Best regards, Thomas Koch, http://www.koch.ro

6 6

[Dovecot] submission_host problem
by Bambero 16 Nov '11

16 Nov '11

Hello, I configured dovecot to use submission smtp host becouse of chroot. submission_host = 127.0.0.1 Unfortunatelly: Nov 12 05:11:15 myhost exim[23366]: 2011-11-12 05:11:15 SMTP protocol synchronization error (next input sent too soon: pipelining was not advertised): rejected "EHLO myhost" H=localhost [127.0.0.1] next input="MAIL FROM:<root@myhost>\\r\\n" Nov 12 05:11:15 myhost exim[23366]: 2011-11-12 05:11:15 SMTP protocol synchronization error (next input sent too soon: pipelining was not advertised): rejected "EHLO myhost" H=localhost [127.0.0.1] next input="MAIL FROM:<root@myhost>\\r\\n" Nov 12 05:11:15 myhost dovecot: lda(alias(a)apisoft.pl): Error: smtp(127.0.0.1): RCPT TO failed: 554 SMTP synchronization error Nov 12 05:11:15 myhost dovecot: lda(alias(a)apisoft.pl): Error: sieve: msgid=<E1RP4uv-00043S-L7@myhost>: failed to redirect message to <bambero(a)gmail.com> (refer to server log for more information) Does anyone know how to fix it ? Regards, Bambero

4 10

[Dovecot] Glued-together private namespaces
by Mark Moseley 16 Nov '11

16 Nov '11

I've been goofing with this all day with 2.0.15 and I'm starting to realize that either a) I'm not that smart, b) it's been so long since I messed with namespaces that I'm going about it completely wrong, or c) it's just not possible. I haven't posted 'doveconf -n' and other details, because mainly I'm just looking for 'yes, this is possible' or 'no, you're smoking crack' before posting further details. At this point, it's all maildir and moving to mdbox, while highly desirable in the future, is not possible in the near- to medium-term. I'm trying to glue a namespace underneath INBOX: namespace INBOX { type = private separator = . prefix = INBOX. # Yes, this used to be on Courier inbox = yes list = yes hidden = no subscriptions = yes location = maildir:~/Maildir } namespace archive { type = private separator = . prefix = INBOX.Archives. inbox = no list = children subscriptions = yes location = maildir:~/Maildir-Archive } I've tried putting namespace archive's 'prefix' as just "Archives", but Tbird doesn't seem to see this namespace, regardless of how much I futz with the imap settings in tbird. With the above setup, it actually seems to work correctly (provided ~/Maildir-Archive exists), though I'm sure a big gotcha is waiting in the wings. I can move messages around, create subfolders, subscribe to folders in ~/Maildir-Archive). The only thing I can't seem to get working is quotas. With my password_query like: password_query = ... CONCAT( '*:bytes=', "1M" ) AS 'userdb_quota_rule', \ CONCAT( '*:messages=10' ) AS 'userdb_quota_rule2', \ CONCAT( 'INBOX.Archives:bytes=+4900M' ) AS 'userdb_quota_rule3', \ CONCAT( 'INBOX.Archives:messages=+3900' ) AS 'userdb_quota_rule4' ... only the default quota seems to be in place for any subfolder of INBOX.Archives and for INBOX.Archives itself, i.e. *:bytes still applies to INBOX.Archives. The debug log show that: Debug: Quota root: name=User quota backend=maildir args= Debug: Quota rule: root=User quota mailbox=* bytes=1048576 messages=0 Debug: Quota rule: root=User quota mailbox=* bytes=1048576 messages=10 Debug: Quota rule: root=User quota mailbox=INBOX.Archives bytes=+5138022400 messages=0 Debug: Quota rule: root=User quota mailbox=INBOX.Archives bytes=+5138022400 messages=+3900 These are wildly stupid quotas but they're just there to test. With INBOX already at capacity (byte-wise; only set to a meg), copying large messages inside INBOX.Archives fails (only copying a 800k message but the quota should be 5gig now). Again, before I post configs, I'm just curious if what I'm trying to do isn't remotely possible, or that I'm approaching this entirely wrongly. Thanks!

2 6

Re: [Dovecot] Seg fault in dovecot/auth 2.0.15
by Timo Sirainen 16 Nov '11

16 Nov '11

Your message was discarded by mailman, probably because it was html-only. Anyway: On Wed, 2011-11-16 at 13:15 -0500, Mark Goldey wrote: > (gdb) p *auth_request->userdb->userdb->iface > $2 = {name = 0x807023e "vpopmail", preinit = 0x8065d60 > <vpopmail_preinit>, init = 0, deinit = 0, > lookup = 0x8066010 <vpopmail_lookup>, iterate_init = 0, iterate_next > = 0, iterate_deinit = 0} OK, so "auth_request->userdb->userdb->iface->lookup" should call vpopmail_lookup(), it's not NULL as this says: > > (gdb) bt full > > #0 0x00000000 in ?? () So something's going strangely wrong. Maybe gcc optimizations cause this and the real problem happens later. Try compiling auth process with optimizations: - Remove -O2 from src/auth/Makefile - cd src/auth ; make clean ; make ; make install Is the backtrace different?

1 0

[Dovecot] Missing public folder
by komodo 16 Nov '11

16 Nov '11

Hi i am using dovecot 2.0.13 and i can't see public folder in my mail client. But what is strange, it was working after instalation, and i don't know when it dissapeared. Maybe after some upgrade ? When i enable debug, then i can see in my log that folder exists and no errors. Please where should i find the problem ? Thanks Martin Here is log Nov 7 11:00:27 OVZ dovecot: imap(komodo): Debug: Namespace : type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir Nov 7 11:00:27 OVZ dovecot: imap(komodo): Debug: maildir++: root=/home/komodo/Maildir, index=, control=, inbox=/home/komodo/Maildir Nov 7 11:00:27 OVZ dovecot: imap(komodo): Debug: Namespace : type=public, prefix=spam_learner., sep=., inbox=no, hidden=no, list=yes, subscriptions=no location=maildir:/home/shared/Maildir Nov 7 11:00:27 OVZ dovecot: imap(komodo): Debug: maildir++: root=/home/shared/Maildir, index=, control=, inbox= Here is my conf # 2.0.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab037.1 x86_64 CentOS release 5.5 (Final) default_client_limit = 1300 disable_plaintext_auth = no hostname = somehost.com mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl namespace { inbox = yes location = prefix = INBOX. separator = . type = private } namespace { location = maildir:/home/shared/Maildir prefix = spam_learner. separator = . subscriptions = no type = public } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/before.d/ sieve_dir = ~/sieve } protocols = imap pop3 sieve sendmail_path = /usr/sbin/sendmail.exim service imap-login { process_limit = 1000 process_min_avail = 30 } ssl_cert = </etc/pki/dovecot/certs/host.pem ssl_key = </etc/pki/dovecot/private/host.pem userdb { driver = prefetch } protocol lda { mail_plugins = " sieve" } protocol imap { mail_max_userip_connections = 100 }

2 1

Re: [Dovecot] Please advise on very fast search
by Stan Hoeppner 16 Nov '11

16 Nov '11

On 11/16/2011 12:15 AM, Alexander Chekalin wrote: > Hello, Stan, > >> This is why I recommended mbox in the first place. If your only writes >> to these mailbox files are appends of new messages, mbox is the best >> format by far. It's faster at appending than any other format, and it's >> faster for searching than any other. > > I now seriously consider to use mdbox due to its nice self-regulation. > After all it I believe mdbox should do file compression on its own, no > cron scripts required. mbox and mdbox each has strengths and weaknesses. mbox will compress with a higher ratio than mdbox. You already have a nightly script that moves all mail from the day into a new file. Piping that through gzip or bzip2 is a no brainer. It'll add one line to your existing script, if that. Dovecot will decompress the file transparently when you access it via IMAP. And again since it's a single file searching it is much faster. With mbox you will have a single file for each day of emails. This seems ideal for archive purposes, one file per day. mdbox does fully transparent de/compression which is nice. The downside is that Dovecot does dbox compression on a per email basis, not a per file basis. So your compression ratio will be much less than with mbox, especially with bzip2 which works best on files over 900KB in size. Most emails are less than 8KB. Using mdbox will yield multiple files per day of emails instead of just one. Either format is much better than maildir for archiving. >> It's an archive. You're not going to use maildir so you don't need >> random IOPS performance. Thus RAID5/6 are a much better fit for an >> archive as you get better read performance, with more than adequate >> write performance, and you use less disks. And as this is an archive, >> you don't need real time automatic/transparent compression. Thus I >> recommend something like: >> >> 1. Debian 6 w/linux-image-2.6.39-bpo.2-amd64 or a custom rolled >> 2.6.39 or later kernel >> 2. hardware RAID5 w/large (2TB) SATA disks, 512B native sectors >> e.g. MegaRAID SAS 9261-8i, 4 Seagate Constellation ES ST2000NM0011 >> Specify a strip size of 256KB for the array >> Perma set /sys/block/sdX/read_ahead_kb to 512 so you're reading >> ahead 1024 sectors at a time instead of the default of 256. This >> will speed up your searches quite a bit. >> 3. XFS filesystem on the RAID device, created with mkfs.xfs defaults >> 4. mbox w/zlib plugin. Compress daily files each night with a script >> 5. You don't need LVM with a good RAID card (or with mdraid). This >> controller can expand the RAID5 up to 8 drives (up to 32 drives max >> using SAS expanders) > > We are considering to get HP DL180G6 server for 8 or 14 drives bays The P410 tops out at 8 drives, so get the 8 drive model. Start with 4 x 2TB drives in RAID5. Add 4 more drives when you need the capacity, and when drive prices are back down to normal (see below). http://h18004.www1.hp.com/products/quickspecs/13248_na/13248_na.html > (base model price is somewhat equal, but additional drives adds up cost) Especially right now in 2011. Flooding in Thailand, where 25% of the world's drives are produced, has doubled the cost of all hard drives worldwide. Now is a horrible time to buy spinning drives. I've read it may be 12 months before prices start coming back down... > with HP Smart Array P410 RAID controller (some servers are equipped with > this controller by default) with 256 Mb battery-backed cache, but I'll > check your suggestions! The P410 should be fine for a dedicated archive server. > What memory size should I plan in the server? You're talking about AMD64 > OS image, and 64-bit software are like to consume more memory that > 32-bit, so looks like your talking about pretty huge RAM, and I don't > believe it's necessary, or maybe I'm wrong? The memory footprint of 64bit binaries is nothing to worry about. The additional amount consumed is more than offset by the performance gained with direct access to RAM above 4GB compared to the performance of PAE. Keep in mind that 90% of your memory will be eaten by Linux buffer cache. Your binaries will account for less than 5% of your RAM consumption. If I understand correctly how you will use this archive server, then 8GB should be plenty. 8GB is standard on the 8 drive DL180 G6. http://h18004.www1.hp.com/products/quickspecs/13248_na/13248_na.html > Problem is I have no experience with XFS and not sure I can tune it in > the best way, so I'll go with mkfs.xfs defaults, I think. With only 4 drives and using a P410 w/cache and RAID5, doing manual XFS tuning isn't necessary for good performance, especially for an archive application which is data heavy, not metadata heavy. Setting sunit/swidth to match the RAID5 layout may increase performance slightly due to stripe aligned writes, but not enough that I'd worry about it. Just use the mkfs.xfs defaults. If you get the BBWC for the P410, enable the controller write cache, and mount XFS with 'nobarrier'. This will increase write performance quite a bit as fsyncs will complete instantly. > Hope we'll see Dovecot 2.1.x stable soon, as I'd like to use fts plugins > and 2.1 handle that much better, but I don't like the idea of use > unstable in production. Me neither. Speaking of archive/search, did you take look at Enkive yet? http://www.enkive.org/ > Thank you for taking your time on my case, You're welcome Alexander. -- Stan P.S. You may wish to implement dnswl.org ;)

1 0

[Dovecot] Chroot
by Bambero 16 Nov '11

16 Nov '11

Hello, I have successfully setup dovecot with chroot but there are two things yet 1. submission_host problem (I posted message 2 days ago) 2. Problem with acl's and sharing: all maildirs are located in: /var/mail/jdoe(a)example.com/Maildir so: mail_chroot=/var/mail I setup acls with: 10-mail.conf ... namespace { type = private separator = / prefix =. inbox = yes hidden = no list = yes subscriptions = yes } namespace { type = shared separator = / prefix = shared/%%u/ location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u subscriptions = yes list = yes } ... 90-acl.conf ... plugin { acl = vfile:cache_secs=5 } plugin { acl_shared_dict = file:/%i.db } ... Setting acl is no problem there are dovecot-acl dovecot-acl-list in Maildir. and dictionary /var/mail/xxx.db contains list od shares I can also see shared folder in my IMAP client but when trying to subscribe i got error: Error: userdb lookup: connect(/var/dovecot/auth-userdb) failed: No such file or directory Error: Namespace 'shared/': Could not lookup home for user jdoe(a)example.com /var/dovecot/auth-userdb is not accessible because chroot. But why userdb is necessary in this case ? I hope there is a solution without disabling chroot. Below my basic configuration. Regards, Bambero # 2.0.13: /etc/dovecot/dovecot.conf # OS: OpenBSD 5.0 i386 auth_mechanisms = plain login digest-md5 cram-md5 apop default_internal_user = _dovecot default_login_user = _dovenull first_valid_gid = 1000 first_valid_uid = 1000 last_valid_gid = 10000 last_valid_uid = 10000 mail_chroot = /var/mail mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date imapflags notify mbox_write_locks = fcntl mmap_disable = yes passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { autocreate = Trash autocreate2 = Spam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Spam autosubscribe3 = Sent autosubscribe4 = Drafts quota = maildir:User quota sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_path = /etc/sieve/default.sieve } protocols = imap pop3 sieve sieve service auth { unix_listener auth-client { mode = 0660 user = _exim } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_ca = /etc/ssl/ca-bundle.crt ssl_cert = </etc/ssl/mycert.crt ssl_key = </etc/ssl/private/mycert.key submission_host = 127.0.0.1 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } valid_chroot_dirs = /var/mail protocol lda { mail_plugins = sieve quota autocreate } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags mail_plugins = quota imap_quota autocreate } protocol pop3 { mail_plugins = quota imap_quota autocreate pop3_client_workarounds = outlook-no-nuls oe-ns-eoh }

2 5

[Dovecot] How to do SEARCH with doveadm
by Alexander Chekalin 16 Nov '11

16 Nov '11

Hello, I'm still playing with search messages from/to specified email address. In fact I need to do that to take such messages and copy it to another mailbox (so that box will contain 'Search results' and will be available to examine by any IMAP client). I've put my mailings in mdbox storage format, and use latest 2.1 beta version of Dovecot to be sure I use the freshest approach in search (and plan to use Solr FTS as well). The setup is each, I use passdb { driver = passwd-file args = /etc/dovecot/auth/%Lu } and userdb { driver = static args = uid=dovecot gid=dovecot home=/MAIL/mail_storage/%Lu } and put user:password pair in file named after my mailbox in /etc/dovecot/auth/ (let's name it test(a)domain.com) and the messages are at /MAIL/mail_storage/test(a)domain.com/... While I use it from IMAP client it works nicely. Ok, I put somewhat 5800 messages in INBOX, and IMAP pretty fast in working with it. But as I try to use doveadm to search for messages I need I simple lost my way (doing it under root): # doveadm search ALL doveadm(root): Error: chdir(/root/) failed: Permission denied (euid=104(dovecot) egid=106(dovecot) missing +x perm: /root, dir owned by 0:0 mode=0700) doveadm(root): Error: chdir(/root) failed: Permission denied Whatever cli command I try doveadv try to find messages in /root dispute it is at /MAIL/mail_storage/%Lu. How can I make doveadv use right mail path? In fact, I don't want to use system users to work with mail, it'll be simple virtual mail user, so it is pointless to set up special system user to do that search. I think I lost myself in general concept of how Dovecot handles users and credentials, so please please please push me in right direction! Thank you, Alexander

1 0

[Dovecot] Creating a password_scheme
by Jordi Llonch 16 Nov '11

16 Nov '11

Hello, I am trying to develop a password_scheme for the Django passwords. After building and installing the module in $module_dir/auth/password/djangopass.so, also tried libdjangopass.so and libdjangopass_plugin.so, Dovecot does not recognize the scheme: doveadm pw -l CRYPT MD5 MD5-CRYPT SHA SHA1 SHA256 SHA512 SMD5 SSHA SSHA256 SSHA512 PLAIN CLEARTEXT CRAM-MD5 HMAC-MD5 DIGEST-MD5 PLAIN-MD4 PLAIN-MD5 LDAP-MD5 LANMAN NTLM OTP SKEY RPA SHA256-CRYPT SHA512-CRYPT Please can you help me? Thanks -- Jordi Llonch # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.40.3-0.fc15.x86_64 x86_64 Fedora release 15 (Lovelock) ext4 ----------password-scheme-django.c-------------------------- #include <stdio.h> #include <ctype.h> #include <stdlib.h> #include <string.h> #include <dovecot/lib.h> #include <dovecot/hex-binary.h> #include <dovecot/password-scheme.h> #define uchar unsigned char static bool djangopass_verify(const char *plaintext, const char *user, const unsigned char *raw_password, size_t size) { return TRUE; } void djangopass_generate(const char *plaintext, const char *user, const unsigned char **raw_password_r, size_t *size_r) { } struct password_scheme djangopass_scheme = { "DJANGO", PW_ENCODING_BASE64, 0, djangopass_verify, djangopass_generate }; struct module; void djangopass_init(struct module *module) { password_scheme_register(&djangopass_scheme); } void djangopass_deinit(void) { password_scheme_unregister(&djangopass_scheme); } ---------------------------------------------------------------------------

2 1

[Dovecot] setting namespaces using script-login environment in 2.0
by Alexander 'Leo' Bergolth 16 Nov '11

16 Nov '11

Hi! With dovecot 1.x, I was using a post-login script to dynamically add shared mailboxes using NAMESPACE_X.. environment variables, based on filesystem permissions: After login, the post-login script was executed with user permissions (mail_drop_priv_before_exec=yes). It added all subdirectories of "/var/spool/mail/Shared" as namespaces for which the user had write permissions. E.g.: NAMESPACE_2='maildir:/var/mail/Shared/spamrep:INDEX=~/Maildir/index/Shared/spamrep' NAMESPACE_2_PREFIX=Shared/spamrep/ NAMESPACE_2_SEP=/ NAMESPACE_2_TYPE=public NAMESPACE_2_LIST=yes See the attached post-pogin-script for details. After switching to 2.0.14 (using executable script-login -d...), the script actually gets executed but the namespace settings do not seem to be honored. Besides, I don't see any pre-set NAMESPACE_ environment variables anymore. Have environment based namespace settings been abandoned in 2.0? Does Dovecot 2.0 maybe provide a better way to only display those folders, for which the user has at least read permissions? (Unix-permission based) Thanks in advance, --leo -- e-mail ::: Leo.Bergolth (at) wu.ac.at fax ::: +43-1-31336-906050 location ::: IT-Services | Vienna University of Economics | Austria

3 5

[Dovecot] Usage of director without LMTP
by Oliver Eales 16 Nov '11

16 Nov '11

Hello, we want to migrate our dovecot 1.2 installation to verison 2.0 and want to use the director feature of version 2. Currently we have a two tier archtiecture, with dovecot proxys and a mailstore togehter with indexes on NFS. (With the common problems of this setup...) For the final setup we want to utilize the director for all protocols (IMAP,POP,LMTP,SIEVE). During the transition phase we will not be able to use LMTP for mail delivery, but we are still stuck with deliver as LDA. So for mail delivery we will not have the fixed user/server assignment, but rather a random assignment. What NFS- and locking settings should be used on the backend servers in this case. And should i use different settings for the host the deliver is executed than the IMAP/POP3 hosts which are accessed through a director proxy. Thanks in advance, Oliver Eales

2 1

[Dovecot] Invalid "doveadm search" queries not rejected
by Peter Williams 16 Nov '11

16 Nov '11

Hello, I think I've encountered a bug in Dovecot 2.0.9 (as provided on CentOS 6). According to the doveadm-search-query(7) manual page, a "mailbox" specification can only come at the beginning of a search query. However, if I put a mailbox specification in the middle of a query, not only do I not get an error message, I get surprising results: $ doveadm search mailbox A |wc -l 6979 $ doveadm search mailbox B |wc -l 206 $ doveadm search mailbox A OR mailbox B |wc -l 42492 If it became possible to do boolean logic on mailbox queries, that'd be cool. But barring that, these invalid queries should be rejected. Relatedly, if I can only do simple mailbox filtering, does anyone know of a clever way to efficiently emulate more complex boolean logic? Please CC me on any replies as I'm not subscribed to the list. Thanks, Peter -- Peter Williams / peter(a)newton.cx

2 2

[Dovecot] Deleting a mailbox and all its children
by Micah Anderson 16 Nov '11

16 Nov '11

I'm looking at scripting a mechanism to delete a mailbox, which is easy with 'doveadm mailbox delete' -- however it gets complicated when there are children of arbitrary depth, for example, I may have this: restored.daily1.INBOX restored.daily1.Sent restored.daily1.Mystuff restored.daily1.Mystuff.foo I would like to delete the 'restored' mailbox and all its children (and unsubscribe the folders), but the 'doveadm mailbox delete' command wont delete any children. I'm surprised that there isn't a -r (recursive) option to 'doveadm mailbox delete', but perhaps I am missing the easier way to handle this? thanks for any ideas or suggestions! micah --

3 2

[Dovecot] Excessive imap-logins, never die
by Nick Edwards 16 Nov '11

16 Nov '11

Hiya, Today I note there are 38 imap-logins that seem to be stale on our staff imap server, they do not seem to die off, new imap-logins are created with new logins and exit accordingly. Now, these are from our monitoring software that runs on another server on our LAN. Our corporate link was taken down for 2 hours for urgent relocation of fibre (demolishing old adjoining building, and just in case, they needed to move it which we were glad about), so, this begs the question, why would imap-logins be there I guess in some sort of wait state, even with a still working internal DNS (internal view as well) the only difference is no actual internet connection in this time. A week ago when they first started to working and we lost internet for 45 minutes I also saw a few extra stale imap-logins, but after todays events, I decided this is a bigger issue that needs to be looked into, as dovecot required a restart to clear it all (I wasnt going to sit there killing individual PIDs all evening). Dovecot version 1.2.17, built from source

2 2

Re: [Dovecot] default Dovecot-LDA CHGRP/CHMOD
by Chris Young 15 Nov '11

15 Nov '11

I am familiar with this article http://wiki.dovecot.org/LDA#multipleuids I want to disable setuid-root, but I don't know the default group and permissions. sudo chgrp root /usr/libexec/dovecot/dovecot-lda sudo chmod 00750 /usr/libexec/dovecot/dovecot-lda but my delivery is still failing Nov 9 18:22:39 vl42 postfix/pipe[23039]: DEC54700B1: to=<user(a)domain.com>, orig_to=<user(a)domain.com>, relay=dovecot, delay=0.05, delays=0.04/0/0/0.01, dsn=4.3.0, status=deferred (temporary failure. Command output: pipe: fatal: pipe_command: execvp /usr/libexec/dovecot/dovecot-lda: Permission denied ) Thoughts? Thanks Chris

2 2