- dovecot - dovecot.org

Re: [Dovecot] Please advise on very fast search
by Stan Hoeppner 16 Nov '11

16 Nov '11

On 11/16/2011 12:15 AM, Alexander Chekalin wrote: > Hello, Stan, > >> This is why I recommended mbox in the first place. If your only writes >> to these mailbox files are appends of new messages, mbox is the best >> format by far. It's faster at appending than any other format, and it's >> faster for searching than any other. > > I now seriously consider to use mdbox due to its nice self-regulation. > After all it I believe mdbox should do file compression on its own, no > cron scripts required. mbox and mdbox each has strengths and weaknesses. mbox will compress with a higher ratio than mdbox. You already have a nightly script that moves all mail from the day into a new file. Piping that through gzip or bzip2 is a no brainer. It'll add one line to your existing script, if that. Dovecot will decompress the file transparently when you access it via IMAP. And again since it's a single file searching it is much faster. With mbox you will have a single file for each day of emails. This seems ideal for archive purposes, one file per day. mdbox does fully transparent de/compression which is nice. The downside is that Dovecot does dbox compression on a per email basis, not a per file basis. So your compression ratio will be much less than with mbox, especially with bzip2 which works best on files over 900KB in size. Most emails are less than 8KB. Using mdbox will yield multiple files per day of emails instead of just one. Either format is much better than maildir for archiving. >> It's an archive. You're not going to use maildir so you don't need >> random IOPS performance. Thus RAID5/6 are a much better fit for an >> archive as you get better read performance, with more than adequate >> write performance, and you use less disks. And as this is an archive, >> you don't need real time automatic/transparent compression. Thus I >> recommend something like: >> >> 1. Debian 6 w/linux-image-2.6.39-bpo.2-amd64 or a custom rolled >> 2.6.39 or later kernel >> 2. hardware RAID5 w/large (2TB) SATA disks, 512B native sectors >> e.g. MegaRAID SAS 9261-8i, 4 Seagate Constellation ES ST2000NM0011 >> Specify a strip size of 256KB for the array >> Perma set /sys/block/sdX/read_ahead_kb to 512 so you're reading >> ahead 1024 sectors at a time instead of the default of 256. This >> will speed up your searches quite a bit. >> 3. XFS filesystem on the RAID device, created with mkfs.xfs defaults >> 4. mbox w/zlib plugin. Compress daily files each night with a script >> 5. You don't need LVM with a good RAID card (or with mdraid). This >> controller can expand the RAID5 up to 8 drives (up to 32 drives max >> using SAS expanders) > > We are considering to get HP DL180G6 server for 8 or 14 drives bays The P410 tops out at 8 drives, so get the 8 drive model. Start with 4 x 2TB drives in RAID5. Add 4 more drives when you need the capacity, and when drive prices are back down to normal (see below). http://h18004.www1.hp.com/products/quickspecs/13248_na/13248_na.html > (base model price is somewhat equal, but additional drives adds up cost) Especially right now in 2011. Flooding in Thailand, where 25% of the world's drives are produced, has doubled the cost of all hard drives worldwide. Now is a horrible time to buy spinning drives. I've read it may be 12 months before prices start coming back down... > with HP Smart Array P410 RAID controller (some servers are equipped with > this controller by default) with 256 Mb battery-backed cache, but I'll > check your suggestions! The P410 should be fine for a dedicated archive server. > What memory size should I plan in the server? You're talking about AMD64 > OS image, and 64-bit software are like to consume more memory that > 32-bit, so looks like your talking about pretty huge RAM, and I don't > believe it's necessary, or maybe I'm wrong? The memory footprint of 64bit binaries is nothing to worry about. The additional amount consumed is more than offset by the performance gained with direct access to RAM above 4GB compared to the performance of PAE. Keep in mind that 90% of your memory will be eaten by Linux buffer cache. Your binaries will account for less than 5% of your RAM consumption. If I understand correctly how you will use this archive server, then 8GB should be plenty. 8GB is standard on the 8 drive DL180 G6. http://h18004.www1.hp.com/products/quickspecs/13248_na/13248_na.html > Problem is I have no experience with XFS and not sure I can tune it in > the best way, so I'll go with mkfs.xfs defaults, I think. With only 4 drives and using a P410 w/cache and RAID5, doing manual XFS tuning isn't necessary for good performance, especially for an archive application which is data heavy, not metadata heavy. Setting sunit/swidth to match the RAID5 layout may increase performance slightly due to stripe aligned writes, but not enough that I'd worry about it. Just use the mkfs.xfs defaults. If you get the BBWC for the P410, enable the controller write cache, and mount XFS with 'nobarrier'. This will increase write performance quite a bit as fsyncs will complete instantly. > Hope we'll see Dovecot 2.1.x stable soon, as I'd like to use fts plugins > and 2.1 handle that much better, but I don't like the idea of use > unstable in production. Me neither. Speaking of archive/search, did you take look at Enkive yet? http://www.enkive.org/ > Thank you for taking your time on my case, You're welcome Alexander. -- Stan P.S. You may wish to implement dnswl.org ;)

1 0

[Dovecot] Chroot
by Bambero 16 Nov '11

16 Nov '11

Hello, I have successfully setup dovecot with chroot but there are two things yet 1. submission_host problem (I posted message 2 days ago) 2. Problem with acl's and sharing: all maildirs are located in: /var/mail/jdoe(a)example.com/Maildir so: mail_chroot=/var/mail I setup acls with: 10-mail.conf ... namespace { type = private separator = / prefix =. inbox = yes hidden = no list = yes subscriptions = yes } namespace { type = shared separator = / prefix = shared/%%u/ location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u subscriptions = yes list = yes } ... 90-acl.conf ... plugin { acl = vfile:cache_secs=5 } plugin { acl_shared_dict = file:/%i.db } ... Setting acl is no problem there are dovecot-acl dovecot-acl-list in Maildir. and dictionary /var/mail/xxx.db contains list od shares I can also see shared folder in my IMAP client but when trying to subscribe i got error: Error: userdb lookup: connect(/var/dovecot/auth-userdb) failed: No such file or directory Error: Namespace 'shared/': Could not lookup home for user jdoe(a)example.com /var/dovecot/auth-userdb is not accessible because chroot. But why userdb is necessary in this case ? I hope there is a solution without disabling chroot. Below my basic configuration. Regards, Bambero # 2.0.13: /etc/dovecot/dovecot.conf # OS: OpenBSD 5.0 i386 auth_mechanisms = plain login digest-md5 cram-md5 apop default_internal_user = _dovecot default_login_user = _dovenull first_valid_gid = 1000 first_valid_uid = 1000 last_valid_gid = 10000 last_valid_uid = 10000 mail_chroot = /var/mail mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date imapflags notify mbox_write_locks = fcntl mmap_disable = yes passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { autocreate = Trash autocreate2 = Spam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Spam autosubscribe3 = Sent autosubscribe4 = Drafts quota = maildir:User quota sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_path = /etc/sieve/default.sieve } protocols = imap pop3 sieve sieve service auth { unix_listener auth-client { mode = 0660 user = _exim } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_ca = /etc/ssl/ca-bundle.crt ssl_cert = </etc/ssl/mycert.crt ssl_key = </etc/ssl/private/mycert.key submission_host = 127.0.0.1 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } valid_chroot_dirs = /var/mail protocol lda { mail_plugins = sieve quota autocreate } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags mail_plugins = quota imap_quota autocreate } protocol pop3 { mail_plugins = quota imap_quota autocreate pop3_client_workarounds = outlook-no-nuls oe-ns-eoh }

2 5

[Dovecot] How to do SEARCH with doveadm
by Alexander Chekalin 16 Nov '11

16 Nov '11

Hello, I'm still playing with search messages from/to specified email address. In fact I need to do that to take such messages and copy it to another mailbox (so that box will contain 'Search results' and will be available to examine by any IMAP client). I've put my mailings in mdbox storage format, and use latest 2.1 beta version of Dovecot to be sure I use the freshest approach in search (and plan to use Solr FTS as well). The setup is each, I use passdb { driver = passwd-file args = /etc/dovecot/auth/%Lu } and userdb { driver = static args = uid=dovecot gid=dovecot home=/MAIL/mail_storage/%Lu } and put user:password pair in file named after my mailbox in /etc/dovecot/auth/ (let's name it test(a)domain.com) and the messages are at /MAIL/mail_storage/test(a)domain.com/... While I use it from IMAP client it works nicely. Ok, I put somewhat 5800 messages in INBOX, and IMAP pretty fast in working with it. But as I try to use doveadm to search for messages I need I simple lost my way (doing it under root): # doveadm search ALL doveadm(root): Error: chdir(/root/) failed: Permission denied (euid=104(dovecot) egid=106(dovecot) missing +x perm: /root, dir owned by 0:0 mode=0700) doveadm(root): Error: chdir(/root) failed: Permission denied Whatever cli command I try doveadv try to find messages in /root dispute it is at /MAIL/mail_storage/%Lu. How can I make doveadv use right mail path? In fact, I don't want to use system users to work with mail, it'll be simple virtual mail user, so it is pointless to set up special system user to do that search. I think I lost myself in general concept of how Dovecot handles users and credentials, so please please please push me in right direction! Thank you, Alexander

1 0

[Dovecot] Creating a password_scheme
by Jordi Llonch 16 Nov '11

16 Nov '11

Hello, I am trying to develop a password_scheme for the Django passwords. After building and installing the module in $module_dir/auth/password/djangopass.so, also tried libdjangopass.so and libdjangopass_plugin.so, Dovecot does not recognize the scheme: doveadm pw -l CRYPT MD5 MD5-CRYPT SHA SHA1 SHA256 SHA512 SMD5 SSHA SSHA256 SSHA512 PLAIN CLEARTEXT CRAM-MD5 HMAC-MD5 DIGEST-MD5 PLAIN-MD4 PLAIN-MD5 LDAP-MD5 LANMAN NTLM OTP SKEY RPA SHA256-CRYPT SHA512-CRYPT Please can you help me? Thanks -- Jordi Llonch # 2.0.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.40.3-0.fc15.x86_64 x86_64 Fedora release 15 (Lovelock) ext4 ----------password-scheme-django.c-------------------------- #include <stdio.h> #include <ctype.h> #include <stdlib.h> #include <string.h> #include <dovecot/lib.h> #include <dovecot/hex-binary.h> #include <dovecot/password-scheme.h> #define uchar unsigned char static bool djangopass_verify(const char *plaintext, const char *user, const unsigned char *raw_password, size_t size) { return TRUE; } void djangopass_generate(const char *plaintext, const char *user, const unsigned char **raw_password_r, size_t *size_r) { } struct password_scheme djangopass_scheme = { "DJANGO", PW_ENCODING_BASE64, 0, djangopass_verify, djangopass_generate }; struct module; void djangopass_init(struct module *module) { password_scheme_register(&djangopass_scheme); } void djangopass_deinit(void) { password_scheme_unregister(&djangopass_scheme); } ---------------------------------------------------------------------------

2 1

[Dovecot] setting namespaces using script-login environment in 2.0
by Alexander 'Leo' Bergolth 16 Nov '11

16 Nov '11

Hi! With dovecot 1.x, I was using a post-login script to dynamically add shared mailboxes using NAMESPACE_X.. environment variables, based on filesystem permissions: After login, the post-login script was executed with user permissions (mail_drop_priv_before_exec=yes). It added all subdirectories of "/var/spool/mail/Shared" as namespaces for which the user had write permissions. E.g.: NAMESPACE_2='maildir:/var/mail/Shared/spamrep:INDEX=~/Maildir/index/Shared/spamrep' NAMESPACE_2_PREFIX=Shared/spamrep/ NAMESPACE_2_SEP=/ NAMESPACE_2_TYPE=public NAMESPACE_2_LIST=yes See the attached post-pogin-script for details. After switching to 2.0.14 (using executable script-login -d...), the script actually gets executed but the namespace settings do not seem to be honored. Besides, I don't see any pre-set NAMESPACE_ environment variables anymore. Have environment based namespace settings been abandoned in 2.0? Does Dovecot 2.0 maybe provide a better way to only display those folders, for which the user has at least read permissions? (Unix-permission based) Thanks in advance, --leo -- e-mail ::: Leo.Bergolth (at) wu.ac.at fax ::: +43-1-31336-906050 location ::: IT-Services | Vienna University of Economics | Austria

3 5

[Dovecot] Usage of director without LMTP
by Oliver Eales 16 Nov '11

16 Nov '11

Hello, we want to migrate our dovecot 1.2 installation to verison 2.0 and want to use the director feature of version 2. Currently we have a two tier archtiecture, with dovecot proxys and a mailstore togehter with indexes on NFS. (With the common problems of this setup...) For the final setup we want to utilize the director for all protocols (IMAP,POP,LMTP,SIEVE). During the transition phase we will not be able to use LMTP for mail delivery, but we are still stuck with deliver as LDA. So for mail delivery we will not have the fixed user/server assignment, but rather a random assignment. What NFS- and locking settings should be used on the backend servers in this case. And should i use different settings for the host the deliver is executed than the IMAP/POP3 hosts which are accessed through a director proxy. Thanks in advance, Oliver Eales

2 1

[Dovecot] Invalid "doveadm search" queries not rejected
by Peter Williams 16 Nov '11

16 Nov '11

Hello, I think I've encountered a bug in Dovecot 2.0.9 (as provided on CentOS 6). According to the doveadm-search-query(7) manual page, a "mailbox" specification can only come at the beginning of a search query. However, if I put a mailbox specification in the middle of a query, not only do I not get an error message, I get surprising results: $ doveadm search mailbox A |wc -l 6979 $ doveadm search mailbox B |wc -l 206 $ doveadm search mailbox A OR mailbox B |wc -l 42492 If it became possible to do boolean logic on mailbox queries, that'd be cool. But barring that, these invalid queries should be rejected. Relatedly, if I can only do simple mailbox filtering, does anyone know of a clever way to efficiently emulate more complex boolean logic? Please CC me on any replies as I'm not subscribed to the list. Thanks, Peter -- Peter Williams / peter(a)newton.cx

2 2

[Dovecot] Deleting a mailbox and all its children
by Micah Anderson 16 Nov '11

16 Nov '11

I'm looking at scripting a mechanism to delete a mailbox, which is easy with 'doveadm mailbox delete' -- however it gets complicated when there are children of arbitrary depth, for example, I may have this: restored.daily1.INBOX restored.daily1.Sent restored.daily1.Mystuff restored.daily1.Mystuff.foo I would like to delete the 'restored' mailbox and all its children (and unsubscribe the folders), but the 'doveadm mailbox delete' command wont delete any children. I'm surprised that there isn't a -r (recursive) option to 'doveadm mailbox delete', but perhaps I am missing the easier way to handle this? thanks for any ideas or suggestions! micah --

3 2

[Dovecot] Excessive imap-logins, never die
by Nick Edwards 16 Nov '11

16 Nov '11

Hiya, Today I note there are 38 imap-logins that seem to be stale on our staff imap server, they do not seem to die off, new imap-logins are created with new logins and exit accordingly. Now, these are from our monitoring software that runs on another server on our LAN. Our corporate link was taken down for 2 hours for urgent relocation of fibre (demolishing old adjoining building, and just in case, they needed to move it which we were glad about), so, this begs the question, why would imap-logins be there I guess in some sort of wait state, even with a still working internal DNS (internal view as well) the only difference is no actual internet connection in this time. A week ago when they first started to working and we lost internet for 45 minutes I also saw a few extra stale imap-logins, but after todays events, I decided this is a bigger issue that needs to be looked into, as dovecot required a restart to clear it all (I wasnt going to sit there killing individual PIDs all evening). Dovecot version 1.2.17, built from source

2 2

Re: [Dovecot] default Dovecot-LDA CHGRP/CHMOD
by Chris Young 15 Nov '11

15 Nov '11

I am familiar with this article http://wiki.dovecot.org/LDA#multipleuids I want to disable setuid-root, but I don't know the default group and permissions. sudo chgrp root /usr/libexec/dovecot/dovecot-lda sudo chmod 00750 /usr/libexec/dovecot/dovecot-lda but my delivery is still failing Nov 9 18:22:39 vl42 postfix/pipe[23039]: DEC54700B1: to=<user(a)domain.com>, orig_to=<user(a)domain.com>, relay=dovecot, delay=0.05, delays=0.04/0/0/0.01, dsn=4.3.0, status=deferred (temporary failure. Command output: pipe: fatal: pipe_command: execvp /usr/libexec/dovecot/dovecot-lda: Permission denied ) Thoughts? Thanks Chris

2 2

[Dovecot] Seg fault in dovecot/auth 2.0.15
by Mark Goldey 15 Nov '11

15 Nov '11

Folks: I've been running Dovecot 2.0.7 on a Qmail / Vpopmail installation built on Debian Squeeze, with no problems for about a year. Dovecot is used for IMAP/S auth only. Dovecot is built from source. I just upgraded to 2.0.15 but it segfaults whenever an IMAP auth is attempted, regardless of the user who tries to login, whether by webmail (Roundmail) Android phone (K-9 Mail) or iPad (Roundmail) I downgraded to 2.0.13 but the segfault persisted. Re-installed 2.0.7 and that cleared it right up. Here's the pertinent details from 2.0.15. Anything else I can provide? root@XXX:/# uname -a Linux XXX 2.6.32-5-686 #1 SMP Wed Jan 12 04:01:41 UTC 2011 i686 GNU/Linux root@XXX:/# dovecot -n # 2.0.15: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.3 auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no first_valid_uid = XXXX last_valid_uid = XXXX log_path = /var/log/dovecot.log mail_debug = yes passdb { driver = vpopmail } protocols = imap service imap-login { inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } process_limit = 128 vsz_limit = 64 M } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = vpopmail } verbose_ssl = yes Here's a failed login transaction from /var/log/dovecot [snip -- 10 lines or so. The SSL handshake completes OK] Nov 15 14:08:43 auth: Debug: client in: AUTH 1 PLAIN service=imap secured lip=192.xxx.xxx.xxx rip=174.79.xxx.xxxlport=143 rport=55437 resp=XYXYXYXYXYXXYXYXYXYXYXYXYXYX== Nov 15 14:08:43 auth-worker: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Nov 15 14:08:43 auth-worker: Debug: vpopmail(user(a)mydomain.net,174.79.xxx.xxx): lookup user=user domain=domain.net Nov 15 14:08:43 auth: Debug: client out: OK 1 user=user(a)mydomain.net Nov 15 14:08:43 auth: Debug: master in: REQUEST 2710831105 686 1 XYXYXYXYXYXXYYXYXYX Nov 15 14:08:43 auth-worker: Debug: vpopmail(user(a)domain.net,174.79.xxx.xxx): lookup user=user domain=domain.net Nov 15 14:08:43 auth: Error: auth worker: Aborted request: Worker process died unexpectedly Nov 15 14:08:43 master: Error: service(auth-worker): child 690 killed with signal 11 (core dumped) Nov 15 14:08:43 auth: Debug: master out: FAIL 2710831105 Nov 15 14:08:43 imap: Error: Internal auth failure (client-pid=686 client-id=1) Nov 15 14:08:43 imap-login: Info: Internal login failure (pid=686 id=1) (auth failed, 1 attempts): user=<user(a)domain.net>, method=PLAIN, rip=174.79.xxx.xxx, lip=192.xxx.xxx.xxx, mpid=691, TLS Nov 15 14:08:43 imap-login: Warning: SSL alert: where=0x4008, ret=256: warning close notify [174.79.xxx.xxx] Nov 15 14:08:43 auth-worker: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth I ought to mention that /usr/local/lib/dovecot/auth is empty. Here's the backtrace: root@XXX:/# gdb /usr/local/libexec/dovecot/auth /usr/local/var/run/dovecot/core GNU gdb (GDB) 7.0.1-debian [snip] Reading symbols from /usr/local/libexec/dovecot/auth...done. warning: Can't read pathname for load map: Input/output error. Reading symbols from /usr/local/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot.so.0 Reading symbols from /lib/i686/cmov/libcrypt.so.1...Reading symbols from /usr/lib/debug/lib/i686/cmov/libcrypt-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libcrypt.so.1 Reading symbols from /home/vpopmail/lib/libvpopmail.so...(no debugging symbols found)...done. Loaded symbols for /home/vpopmail/lib/libvpopmail.so Reading symbols from /lib/i686/cmov/libdl.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libdl-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libdl.so.2 Reading symbols from /lib/i686/cmov/librt.so.1...Reading symbols from /usr/lib/debug/lib/i686/cmov/librt-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/librt.so.1 Reading symbols from /lib/i686/cmov/libc.so.6...Reading symbols from /usr/lib/debug/lib/i686/cmov/libc-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libc.so.6 Reading symbols from /lib/ld-linux.so.2...Reading symbols from /usr/lib/debug/lib/ld-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /lib/i686/cmov/libpthread.so.0...Reading symbols from /usr/lib/debug/lib/i686/cmov/libpthread-2.11.2.so...done. (no debugging symbols found)...done. Loaded symbols for /lib/i686/cmov/libpthread.so.0 Reading symbols from /home/vpopmail/etc/vpopmail.authmodule...(no debugging symbols found)...done. Loaded symbols for /home/vpopmail/etc/vpopmail.authmodule Core was generated by `dovecot/auth -w'. Program terminated with signal 11, Segmentation fault. #0 0x00000000 in ?? () (gdb) bt full #0 0x00000000 in ?? () No symbol table info available. #1 0x08059890 in auth_worker_handle_user (client=0x82b34d0) at auth-worker-client.c:405 auth_request = 0x82b56e8 userdb_id = 1 #2 auth_worker_handle_line (client=0x82b34d0) at auth-worker-client.c:534 id = 2 #3 auth_worker_input (client=0x82b34d0) at auth-worker-client.c:614 _data_stack_cur_id = 3 line = <value optimized out> ret = 232 #4 0xb785f021 in io_loop_call_io (io=0x82b3688) at ioloop.c:384 ioloop = 0x82a6398 t_id = 2 #5 0xb78600d3 in io_loop_handler_run (ioloop=0x82a6398) at ioloop-epoll.c:213 ctx = 0x82b1f38 event = 0x82b1f78 list = 0x82b36b0 io = 0x829e2b0 tv = {tv_sec = 2147483, tv_usec = 0} msecs = 1 ret = 1 i = 0 j = 0 call = 192 #6 0xb785efa0 in io_loop_run (ioloop=0x82a6398) at ioloop.c:405 No locals. #7 0xb784abaa in master_service_run (service=0x82a62e8, callback=0x805c470 <worker_connected>) at master-service.c:481 No locals. #8 0x0805c828 in main (argc=2, argv=0x82a61c0) at main.c:298 c = <value optimized out> (gdb) --mhg

2 1

[Dovecot] Dovecot SASL on another machine
by Tobias Hachmer 15 Nov '11

15 Nov '11

Hello list, is there a way to use Dovecot SASL Authentication for submission on a different machine dovecot runs? e.g.: Dovecot machine <-> postfix machine(for submission) How can I authenticate my senders on a different physical machine against Dovecot SASL? Thanks, Tobias

3 6

[Dovecot] indexes permissions problem
by Mark Hanford 15 Nov '11

15 Nov '11

Hey all, I did a search but didn't find the answer to my problem, so here goes. I've got a centos 6 server running Dovecot 2.0.beta6 (3156315704ef). For legacy reasons (I'm moving mail from a Dovecot 1.1.1 and FreeBSD box with user home directories NFS mounted), my index files are setup to be in /u/indexes/ On the Dovecot 1.1.1 installation, the perms on the indexes directory is 777 with root:mail ownership. The same thing on the Dovecot 2 / Centos server results in a 'permission denied' error when Dovecot tries to create files. So, I guess my main question is, what perms and ownership should /u/indexes be set to? I've tried several different things before this cry for help... Thanks. Mark

2 1

[Dovecot] Limit the number of pop/imap requests
by wwl 15 Nov '11

15 Nov '11

Hello Group, is it possible to Limit the number of pop/imap requests to Dovecot? I read the Wiki and found max_mail_processes = 512 is this the way to limit this ? dovecot --version 1.2.15 Thanx for help Christian

2 1

[Dovecot] Dovecot 2.0.15 quota configuration with mbox
by David Ocana 15 Nov '11

15 Nov '11

Hello, I've been trying to set up dovecot 2.0.15, everything seems to work pretty well except for the quota feature. I would like to set a quota limit only for the Inbox folder. I configured two namespaces, according to some posts from Timo Sirainen (http://dovecot.org/list/dovecot/2006-July/014530.html) & (http://www.dovecot.org/list/dovecot/2011-January/056131.html) but I can't configure the quota plugin to act the way I pretend. Here's my namespace configuration: namespace { separator = / prefix = INBOX/ location = mbox:/var/empty:INBOX=/mail/%d/%n:INDEX=/var/dovecot/%d/%n inbox = yes hidden = yes } namespace { separator = / prefix = inbox = no location = mbox:/mail/%d/MAILBOXES/%n:INDEX=/var/dovecot/%d/%n } Quota config: plugin { quota = dirsize:User quota # I've tried with: quota_rule = INBOX:storage=819200K quota_rule = INBOX/*:storage=819200K quota_rule = INBOX/Inbox:storage=819200K # Works with: quota_rule = *:storage=819200K quota_rule = ?:storage=819200K (Same behavior as '*') } Using '*' and '?', is the only way I get it to work, but obviously, quota is calculated summing up all the mailbox folders. I don't know what else to change, any ideas? Is the two namespace configuration correct? Thanks in advance. David

2 3

[Dovecot] Migration From Courier Imap.
by Rajeev Sharma 15 Nov '11

15 Nov '11

Sir, I am using vpopmail,qmail along with courier-imap 4.0 i want to migrate from courier to dovecot but i have 100 shared folder under /home/vpopmail/domains/domain.com/Malidir and user shared them on the basis of rights assign. I am very much clear how to migrate from courier to dovecot but i am unable how to migrate shared folder and assign rights. Rajeev Sharma. -- Rajeev Sharma

2 1

[Dovecot] getenv() in plugin not working
by Trutwin, Joshua 15 Nov '11

15 Nov '11

Hi - new to the list, can't find much on this using google. I'm trying to setup the dovecot DRAC plugin as described here: http://wiki.dovecot.org/HowTo/PopBSMTPAndDovecot#DRAC DRAC is installed and running using this startup command: /usr/local/sbin/rpc.dracd -i -e 5 /etc/postfix/dracd.db I downloaded the drac.c file linked on the above URL: http://www.dovecot.org/patches/1.1/drac.c and built it using this command: gcc -Wall -W -shared -fPIC -DHAVE_CONFIG_H drac.c -I/usr/include/dovecot -L/usr/lib64/dovecot -o drac.so -ldrac Then I copied drac.so to /usr/lib64/dovecot (this is an x86_64 SL 6.1 system - dovecot 2.0.9) and modified my /etc/dovecot/conf.d/20-imap.conf file: mail_plugin_dir = /usr/lib64/dovecot mail_plugins = drac Restart dovecot and try to login and getting these messages for ANY login attempts: dovecot: imap-login: Login: user=<snip>, method=PLAIN, rip=<snip>, lip=<snip>, mpid=4018, TLS server dovecot: imap(<snip>: Error: DRAC: IP environment not given I traced the "IP environment not given" to the drac.c plugin file, and the code is pretty simple: void drac_init(void) { const char *ip_str; struct ip_addr ip; ip_str = getenv("IP"); if (ip_str == NULL) i_error("DRAC: IP environment not given"); Is there anything special that needs to be done for getenv("IP") to report the login IP? I tried to put getenv("RIP") for remote ip and even getenv("USER") as well but always get NULL. Is this API only for dovecot 1.x? If so is there a 2.0 equivalent? The rest of the plugin is very basic... I think this is the last step in getting this setup running. I'd have to have this one last piece force me to run that icky perl program instead. Thank you, Let me know if anything else is needed. Josh

3 3

[Dovecot] Question about pop3_reuse_xuidl
by Urban Loesch 15 Nov '11

15 Nov '11

Hi, we are in migration progress from Communigate Pro 5.0.x to Dovecot 2.0.15 with mdbox. We still migrated about 25.000 IMAP accounts from CGP to Dovecot. Also there were still added about 2000 new POP3 Accounts on Dovecot. Now we must migrate about 10.000 POP3 accounts from CGP to Dovecot. At the beginning of our migration we didn't set the "pop3_reuse_xuidl" configuration option to yes. Do you know what happens when we activate the "pop3_reuse_xuidl" option on our running dovecot? Will Dovecot change the uidl value for all existing mails which have set "X-UIDL" in its mailheader, or does Dovecot only change the uidl value for new received and still not downloaded mails? Many thanks and regards Urban Loesch

2 1

[Dovecot] XUIDL Migration problems
by Steve H 15 Nov '11

15 Nov '11

Hello All, I am new to Dovecot and the Dovecot mailing list. I am trying to migrate an existing Exim + qpopper - mbox (pop3 only) installation over to Exim + Dovecot using mdir (pop3 and imap) And am running into problems with preserving the XUIDL headers. I am running Dovecot 2.0.14 I have used the mb2md.pl script : http://dovecot.org/tools/mb2md.pl from this page http://wiki2.dovecot.org/Migration/MailFormat to migrate and import the mboxes And have the following pop3 uidl settings in my configuration . pop3_reuse_xuidl = yes pop3_save_uidl = yes protocols = imap pop3 service imap-login { inet_listener imaps { port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } protocol pop3 { pop3_reuse_xuidl = yes pop3_save_uidl = yes pop3_uidl_format = %08Xu%08Xv } The problem specifically is that when I test the migration and import a mailbox, I am able to connect via IMAP using Thunderbird and Outlook 2007 and the Read / Unread status is preserved. However when I connect via POP3 the Read/Unread status is not preserved. I am probably missing something simple, but have been unable to find anything that seems relevant on the Dovecot wiki or searching the mailing lists. Any suggestions would be appreciated. Regards, Steven Holloway IT Technical Consultant I.T. Basecamp P/L [http://www.itbasecamp.com.au/signature.gif]<http://www.itbasecamp.com.au/> Address: Office 1 Level 1/50 Owen St Huskisson NSW 2540 Phone: +61 2 44418555 ext 308 Fax: +61 2 44418551 Web: http://www.itbasecamp.com.au<http://www.itbasecamp.com.au/> Subscribe to our newsletter! Visit: IT Basecamp <http://www.itbasecamp.com.au/component/option,com_acajoom/Itemid,99999999/a…> to manage your subscription.

2 2

[Dovecot] patch for UID 0 problem
by Kai Arif 15 Nov '11

15 Nov '11

Hi all, attached you'll find a patch for cmd-thread.c which addresses a problem with certain clients in conjunction with the use of the UID THREAD REFS command: TAG5 UID THREAD REFS us-ascii SINCE 14-May-2011 * THREAD (0)(246)(247)(248)(249)(250)(252)(253)(254)(255)(256)(257)(258)(259)(260)(261)(262)(263)(264)(265)(266)(267)(268) TAG5 OK Thread completed. The first UID delivered (0) is invalid, some clients - @mail for instance - then try to fetch the invalid UID 0 subsequently and run into problems. The patch actually disables the return of (0) and seems to work for us. Please review and - if OK - incorporate it in the next version. Best Regards Kai -- Kai Arif - System Administrator Inter.net Germany GmbH Knesebeckstraße 59-61 10719 Berlin Germany Fon +49 30 25430 0 Fax +49 30 25430 499 arif(a)team.de.inter.net www.de.inter.net Legal-Information: Inter.net Germany GmbH, HRB #79136, Amtsgericht Berlin Charlottenburg, UST-IdNr:: DE 813 165 159 FA für Körperschaften I Berlin, Geschäftsführer: Jörn Lubkoll Zuständige Regulierungsbehörde: Bundesnetzagentur Chemnitz, Liselotte-Herrmann-Str. 20a, 09127 Chemnitz, Registriernummer: 06/164

2 1

[Dovecot] Managing public folder ACL files
by Keith Edmunds 14 Nov '11

14 Nov '11

We have a customer with a large public folder hierarchy. They occasionally make requests to have the public folder ACLs changed; for example: "please give user X access to all public folders" (that's nearly 1700 folders). Worse: "please give user Y access to all sales folders" (there are 1450 sales folders). The problem is that there are (naturally) spaces in the folder names, which makes command line manipulation challenging. We've ended up with some astonishingly hacky Python scripts that enter each folder starting with (for example) ".sales" and replacing the dovecot-acl file to try to fulfil the above requests. One day our script are going to get it wrong, or requests will become more complex ("give X access all sales/CustA folders, Y access to all sales/CustB folders, and Z access to all sales folders). There must be a Better Way. How do others manage divergent ACLs within large public folder hierarchies? Thanks, Keith

5 4

[Dovecot] [re] patching dovecot for managesieve/sieve
by Scott Lewis 14 Nov '11

14 Nov '11

My apologies for the repost yesterday; it was not intentional. I was attempting to post a followup from my mobile, when something went awry with the editing options on my phone. Anyway.. I have managed to download and compile my own patched dovecot/dovecot-sieve/dovecot-managesieve modules from scratch, with Thanks to this page hardc0l2e.wordpress.com/2010/02/26/managesieve-with-dovecot-on-centos-5-4/ But when I run http://mydomain.com/src/configtest.php , I am still getting the following rather non-descriptive error: "I could not determine the capabilities for Sieve Mail Filtering. Perhaps connectivity with ManageSieve server (if backend=ManageSieve) is bad?" Where else can I look to resolve this? should managesieve show up as its own /etc/init.d service? Or does dovecot simply control it? How can I confirm that deliver is being used as my LDA? Thanks again, Scott

2 1

[Dovecot] Restoring Mails from Backup Archive
by Andreas Cieslak 14 Nov '11

14 Nov '11

Hi List, i am trying to restore mails from an backup-archive which was made with rsnapshot. All the mails in the archive look similar like the following: -rw------- 2 1014 1015 3308 8. Aug 13:42 1312803768.V809I266a00aM505178.server:2,ST Now I copy the files from the archive into the Maildir/cur directory of the user. Then I set the permissions etc. and log in with the user account via Squirrelmail. The restored mails aren't in the INBOX, and when I go into the Maildir/cur dir of the user, the restored mails are gone. Possibly deleted after the login. Had anyone some similar experiences ? Any hints ? Kind regards Andreas

2 3

[Dovecot] metadata plugin problems
by Georg Martius 13 Nov '11

13 Nov '11

Hi, I have trouble with the metadata plugin. I compiled dovecot 2.0.15 from source and also the plugin [2] separately. I work on debian/lenny. I had some trouble compiling it (autoconf somehow didn't insert the DOVECOT_IMAP_INCLUDE variable, I have not idea why) Anyway, I did as described in [1]. Do I have to create: the file /var/lib/dovecot/shared-metadata ? The server starts without errors, but I get for instance the following error message: "Failed to write some annotations for 'Contacts' on the IMAP server. SetMetaData failed, server replied: A000076 NO Parsing entry failed" from my KMail. How can I test that the plugin is actually active and working? Any help would be appreciated. Regards, Georg [1]http://www.mail-archive.com/dovecot@dovecot.org/msg38887.html [2] http://hg.dovecot.org/dovecot-metadata-plugin

1 0

[Dovecot] Dovecot v2.0.13 unix_listeners
by Matthew Brown 13 Nov '11

13 Nov '11

Could somebody be able to explain to me what the various unix_listeners do in the Dovecot 2.x configuration (specifically in 10-master.conf). Currently, for postfix to use for local delivery, I have: service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } and for auth I have: service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { mode = 0666 user = vmail } } So what does each one specifically do? Also, does somebody know of a resource that can explain the mode setting? I couldn't seem to find anything on the wiki.. Sorry if these questions seem simple, Im still trying to get a grips with dovecots workings. MDA: Dovecot v2.0.13 MTA: SMTP User & Virtual Domain Management: MySQL Cheers, Matthew

2 1

[Dovecot] TLS Authentication Confusion
by Carlos Mennens 11 Nov '11

11 Nov '11

I asked a user today to make sure his incoming and outgoing email was using TLS. He told me it wasn't possible because my Dovecot / Postfix daemons were only listening on TCP 25 & 143 according to a port scan he did. He told me the only way I could enable encrypted secure sessions between the client & server is to enable port 993 (IMAPs). I told him that TLS is supported on my mail server over the default ports TCP 25 / 143 and that many consider IMAPs to be legacy. I sent him a telnet session of my PC communicating with my server & it shows TLS is available. I just wanted to be sure I was correct with the information above or am I completely wrong and I do indeed need TCP port 993? I know this is the Dovecot mailing list but since Dovecot and Postfix both use and support TLS in their configuration files, I figured I would ask here for your help! carloss@pc1:~$ telnet mail.holyghost.org 25 Trying 192.168.4.100... Connected to mail.holyghost.org. Escape character is '^]'. 220 mail.holyghost.org ESMTP Postfix EHLO pc1.holyghost.org 250-mail.holyghost.org 250-PIPELINING 250-SIZE 20480000 250-VRFY 250-ETRN 250-STARTTLS 250-ENHANCEDSTATUSCODES 250-8BITMIME 250 DSN Below is a snip from my mail logs showing TLS: Nov 9 10:26:39 mail dovecot: imap-login: Login: user=<carlos>, method=PLAIN, rip=::ffff:192.168.4.100, lip=::ffff:192.168.4.100, TLS The above snip from my log means that I'm connecting to Dovecot via TLS, correct?

8 7

[Dovecot] Restarting dovecot periodically fails with "Socket already exists: /var/run/dovecot/anvil"
by James Page 11 Nov '11

11 Nov '11

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Hello restarting dovecot regularly fails with version 2.0.13 on Ubuntu 11.10 due to a running child process exiting after the main dovecot process. Oct 13 15:04:58 ubuntu dovecot: master: Error: service(anvil): Socket already exists: /var/run/dovecot/anvil Oct 13 15:04:58 ubuntu dovecot: master: Error: service(anvil): Socket already exists: /var/run/dovecot/anvil-auth-penalty Oct 13 15:04:58 ubuntu dovecot: master: Fatal: Failed to start listeners Oct 13 15:04:58 ubuntu kernel: [11132.825253] init: dovecot main process (8668) terminated with status 89 The dovecot/anvil process appears to be the cause of the problem (snapshot of running dovecot processes just after main dovecot process stops): root 8418 8080 0 15:02 pts/0 00:00:00 stop dovecot root 8419 1 0 15:02 ? 00:00:00 dovecot/anvil root 8422 8420 0 15:02 ? 00:00:00 grep dovecot This is an Ubuntu specific issue as we use upstart to manage dovecot which monitors the status of the main dovecot process; the Debian init script appears to make provision for this happening. I can work around this in the upstart configuration but it does look like a potential bug in the sub-process handling in dovecot. Any help much appreciated - please feel free to comment on https://bugs.launchpad.net/ubuntu/+source/dovecot/+bug/873390 as well. Regards - -- James Page Ubuntu Core Developer - ----------------------------------- dovecot -n # 2.0.13: /etc/dovecot/dovecot.conf # OS: Linux 3.0.0-12-generic-pae i686 Ubuntu 11.10 mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve ssl_cert = </etc/ssl/certs/dovecot.pem ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { deliver_log_format = msgid=%m: %$ mail_plugins = sieve postmaster_address = postmaster quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r } -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQIcBAEBCAAGBQJOlwAJAAoJEL/srsug59jD1e4QAIB0/OhBhgr7HYqJNh3d1f69 8vGl6LSb2jjJb6bI+GX8QRHDDHXs6g3RadpHTEnDngJPLRPJxnnmr/mqcG+sAeYa 92shRyWnZQFEHJkl9hE1t1OS7skpLezWgSl6nOtzkRxm3yB0+w81PyQZVH2QArKf dATww3t0hMd3ybPEJnZwSlIQ/82i79qd8RZd1orERdIKN1wIyhb2uOi1XXBvGHZo hZKhO1sv3vz1RLpJXeWIVUNK8RQHJcvAOdqvTeT7kzx1gdxy3ycr7WOTUFY3Nc83 SYFyV9/miSNc45n+eDnsoknwggn0JWMkMA1jzRQz9OGCWFkJVFIuOE9jwJcFP6HY +8OnWwgdu5qNQ6nrn4+M1dB1MrFV5aFQmSuXsuAFXkCYywajdVhNyTkC8wERUBf1 NMv4PQRP0tA/UOOy9qNnNf9y3kQ1ItJ5ZhBTOO5WctnowYHDTWtnoxD7m0aEM1rA NH1TFolUgeiT6B9xFcreq42qEVYItKV60o2gv8fMDXwtkSjfDfJ2/88/45dcTOuK t+qUZnpI+AgCak7AfYShj1SjYN80BbpPpQ0WtG6MObXBZZl84paNpAUibUfN0tPy cEscYqUhkkptbfenJe3ldz0S2AhlrDTFk3cWGKwwlKY+29vBsoZtbgIamgrOKLX9 AbdvqFx8gnYe5af1k3eL =6Mfk -----END PGP SIGNATURE-----

2 2

[Dovecot] undefined symbol: o_stream_switch_ioloop
by Frank Elsner 11 Nov '11

11 Nov '11

Hi, running dovecot-2.0.14 under Fedora 14 with kernel 2.6.35.14-103.fc14.i686.PA I've found a strange error in log which I've nerver observed before when startung dovecot: auth-worker: Error: dlopen(/usr/local/dovecot/lib/dovecot/auth/libauthdb_imap.so) failed: /usr/local/dovecot/lib/dovecot/auth/libauthdb_imap.so: undefined symbol: o_stream_switch_ioloop Dovecot seems to work normal despite the error message. Any enlightment welcome. --Frank Elsner

2 3

[Dovecot] LDAP expired password
by roberto palmarin 10 Nov '11

10 Nov '11

hi all, I'm using postfix, LDAP, dovecot and horde for webmail. user and password information is stored in LDAP. I'm attempting to get password aging working properly and am not having much luck. even if password has expired user can login, can i tell dovecot to control the LDAP field shadowexpired? or is there some other way to check properly that the password is expired before allowing the user log in? thank's /roby

4 5

[Dovecot] patching dovecot for sieve/managesieve support, centos 5.6?
by Scott Lewis 10 Nov '11

10 Nov '11

Hi all, I am having real trouble when attempting to patch dovecot 1.2 to include the Pidgeonhole sieve support on my CentOS 5.6 x64 mail server. I am relatively new to the programming side of linux, but I am not having a lot of luck when trying to get this thing to compile. Here's what happens: [root@mail ~]# whereis dovecot dovecot: /usr/sbin/dovecot /etc/dovecot.conf /usr/lib/dovecot /usr/libexec/dovecot /usr/share/man/man8/dovecot.8.gz [root@mail dovecot-1.2-sieve-0.1.19]# ./configure --with-dovecot=/usr/lib/dovecot ... checking whether to build static libraries... yes dovecot-config not found from /usr/lib/dovecot, use --with-dovecot=PATH to give path to compiled Dovecot sources or to a directory with the installed dovecot-config file. configure: error: dovecot-config not found -- I get this message regardless of whether I set --with-dovecot as /usr/sbin/dovecot, or /etc, or /usr/libexec/dovecot. I have SquirrelMail 1.4.22 running, and the avelsieve front-end seems happy enough. when I visit https://mail.mydomain.com/src/configtest.php, I get: Avelsieve plugin details: backend = ManageSieve ERROR: I could not determine the capabilities for Sieve Mail Filtering. Perhaps connectivity with ManageSieve server (if backend=Managesieve) is bad? thanks in advance!

2 3

[Dovecot] Quota BUG ?
by Adrian M 10 Nov '11

10 Nov '11

Hello list, I believe I found a bug with quota. The dovecot quota replies with incorrect values when the mailbox is above 2GB. du -ks returns 2005764bytes dovecot IMAP on the same user/directory: 1 getquotaroot inbox * QUOTAROOT "INBOX" "user" * QUOTA "user" (STORAGE 1096 2000000)* QUOTAROOT "INBOX" "user" * QUOTA "user" (STORAGE 1096 2000000) 1 OK Getquotaroot completed. Is there any way to fix this ? --- linux system: dovecot 1.2.15-7 linux 2.6.32-5-amd64 dovecot.conf: dict { quotadict= mysql:/etc/dovecot/dovecot-dict-quota.conf } plugin { quota = dict:user::proxy::quotadict } dovecot-dict-quota.conf : user_query = SELECT '/home/%d/%n' as home, 'maildir:/home/%d/%n' as mail, 150 AS uid, 8 AS gid, CONCAT('*:bytes=', CAST(quota AS CHAR)) AS quota_rule FROM mailbox WHERE username = '%u' AND active = '1'

3 7

[Dovecot] Exim thru through Dovecot deliver to spec IMAP-folder
by Alexander KIper 10 Nov '11

10 Nov '11

Hello All! How can I "post" some mails from Exim trnasport through Dovecot deliver to IMAP MailBox in specific folder (for example: "Junk")? -- With best regards, Alexander KIper!

2 1

[Dovecot] Corrupted transaction log file
by Peter Mogensen 09 Nov '11

09 Nov '11

Hi, I'm experiencing a problem I need some pointers to debug. I'm running Dovecot 2.0.15 and have a client which keeps causing log-entries like: Nov 4 15:10:42 mail dovecot: imap (test(a)aaaone.net) Error: Corrupted transaction log file /mail/3340444/.TestMails/dovecot.index.log seq 2: indexid changed 1320419300 -> 1320419441 (sync_offset=0) Nov 4 15:10:42 mail dovecot: imap(test(a)aaaone.net): Error: Corrupted transaction log file /mail/3340444/.TestMails/dovecot.index.log seq 2: Invalid transaction log size (4476 vs 4360): /mail/3340444/. TestMails/dovecot.index.log (sync_offset=4476) Nov 4 15:10:42 mail dovecot: imap(test(a)aaaone.net): Disconnected: IMAP session state is inconsistent, please relogin. bytes=549/100474 The client issues a lot of IMAP connections like this: A1_0 LOGIN "test(a)aaaone.net" "password" A1_1 ENABLE QRESYNC CONDSTORE * OK Waiting for authentication process to respond.. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] Dovecot ready. A1_0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in * ENABLED QRESYNC CONDSTORE A1_1 OK Enabled. A2_0 CREATE "INBOX.folder" A2_0 OK Create completed. A3_0 SUBSCRIBE "INBOX.folder" A3_0 OK Subscribe completed. A4_0 APPEND "INBOX.folder" ($CreatedByImapClient-test) {20487+} ... more similar appends. But it only seems to be reproducible, when there's another client involved. Starting up Thunderbird with a login to the account seems to be enough to cause this. (To my knowledge this causes a series of STATUS command and then IDLE). The installation is using Maildir and lock_method = fcntl on local disks. /Peter

2 4

[Dovecot] Please advise on very fast search
by Alexander Chekalin 09 Nov '11

09 Nov '11

Hello, I try to create some kind of mail backup system. What I need is system that will store mail for the whole domain, and allow me to restore messages from/to specified email at that domain. The scheme is pretty simple: on our main mail server the SMTP server itself has a rule to send a copy of every message to 'backup(a)backupserver.host', and the backupserver.host domain is placed nearby on second server. The SMTP on second server do simple 'catchall' redirect of all messages to the single box. There is also a Dovecot that takes care for remote IMAP access to that box. And, finally, I've create some scripts to sort all messages in INBOX to folders named after message's date. So I have a lot of mailboxes inside the catchall box: INBOX 2011.11.03 2011.11.04 2011.11.05 2011.11.06 ...etc... and each folder holds messages for that day. Simply, and works perfectly. The problem is that when my archive become big (several years), it appears to be painful to find specified message(s). When someone suddenly needs to find his/her old message, it is mostly guesses like 'I think the message was between june and july of 2009, or maybe month or two before that', so I need to search all mailboxes (with 1000's messages in each). And it takes really long time. I tried to play with Dovecot indexes, but it won't help too much. The bad part is that I need to search for all emails in each message headers, not only for "From" or "To", since some messages are sent to maillists soe "To" = list address, not person's personal email. Then I tried to index messages on my own, storing info on emails into MySQL database ('email' -> 'mailbox', 'message filename'), but soon I find out that message files can be renamed by Dovecot. Could you please advice me how to speed up message search? Sorry for such a long question, hope you can help! Yours, Alexander Chekalin

3 2

Re: [Dovecot] Doveadm scrip-fu to determine alternate storage needs
by Maria Arrea 09 Nov '11

09 Nov '11

Timo, maybe you have mispelled the command? > We are using dovecot 2.0.15+mdbox+zlib and we are evaluating to buy > cheap sata-based iscsi storage / sata-NFS. We want to evaluate how > much space would be needed in alternate storage BEFORE buying it. I > have been reading about doveadm altmove. We want to move ALL messages > older than a year to alternate storage, what doveadm-script-fu could I > do to identify how much space would go from a user to alternate > storage? doveadm -A -f tab fetch size.physical before 1y would print all the message sizes. You could then sum them up with some scripting to produce the total. Unfortunately they are the uncompressed sizes, but maybe simply dividing by 2 would give approximate size? :) (You could get the compressed sizes from dovecot.map.index files with doveadm dump and mapping their contents to the older than 1 year message UIDs, but this gets difficult.)

2 1

[Dovecot] Doveadm scrip-fu to determine alternate storage needs
by Maria Arrea 09 Nov '11

09 Nov '11

Hello We are using dovecot 2.0.15+mdbox+zlib and we are evaluating to buy cheap sata-based iscsi storage / sata-NFS. We want to evaluate how much space would be needed in alternate storage BEFORE buying it. I have been reading about doveadm altmove. We want to move ALL messages older than a year to alternate storage, what doveadm-script-fu could I do to identify how much space would go from a user to alternate storage? Regards Maria

2 1

Re: [Dovecot] Bus factor of dovecot / GIT
by Peer Heinlein 09 Nov '11

09 Nov '11

Am Mittwoch, 9. November 2011, 10:29:37 schrieb Thomas Koch: Hi, > somebody from the kolab groupware project recently explained me that the > Bus- Factor[1] of around 1 would be one of their primary reasons not to > use Dovecot and stick with Cyrus. The problem is: Even it Timo will be hitten by a bus, everybody could stay on the actual Dovecot-version and everything's fine. Cyrus will IMO never reach the level, that Dovecot already has. :-) Peer P.S.: Timo! Don't leave your house. It's too dangerous for you. -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030/405051-42 Fax: 030/405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

1 0

[Dovecot] Multiple Patitions with with mdbox
by Peer Heinlein 09 Nov '11

09 Nov '11

Having > 10 TByte mailstore filesystem-checks takes too much time. At the moment we have four different partitions, but I don't like to set symlinks or LDAP-flags to sort customers and their domains to there individual mount-point. I'd like to work with mdbox:/mail/%d/%n to calculate the path automatically. How do you handle >> 10 TB mailstore? I'm very interested in the feature "alternative mailstore" with mdbox, because that makes it very easy to use at least TWO filesystems without any tricky configuration. I think I'd love to have <n> alternative mailstores. Why does dbox doesn't look for its m.*-files in more then two directorys? Sure, looking in 4 directorys would lead to four disc operations, but maybe it could be very helpful. Peer -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030/405051-42 Fax: 030/405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

3 2

[Dovecot] another sizeof tweak
by Mike Abbott 08 Nov '11

08 Nov '11

Line 776 of dovecot-2.0.15/src/lib-storage/index/maildir/maildir-sync-index.c reads: memcmp(old_rec, &new_rec, sizeof(old_rec)) != 0) { Should that be sizeof(*old_rec)?

2 2

[Dovecot] Dovecot alias and mailbox problem
by Jeroen Grusewski 08 Nov '11

08 Nov '11

Hi All, My Postfix / Dovecot / MySQL is running fine but I have the following issue: When I create the following mailboxes test(a)example.com and test1(a)example.com it is working fine. I can create an alias test2(a)examples.com => test1(a)example.com that is also working without a problem, only when I create test(a)example.com => test1(a)example.com email is only delivered to test1@.... instead to both test@.... and test1@.... I believe it is properly just a setting but please help me out here ! Let me know if you need any more information before I post configs etc. Best regards, Jeroen

2 1

[Dovecot] dsync and zlib
by Peer Heinlein 08 Nov '11

08 Nov '11

Will dsync also use zlib-compression when copying mails from one side to another? Wouldn't this be a good way to compress existing mails? http://wiki2.dovecot.org/Plugins/Zlib says, there's no way to do that. But dsync should respect the zlib-Plugin... Peer -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030/405051-42 Fax: 030/405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

[Dovecot] Failing to share folders when listescape is enabled (2.0.14)
by mailing lists 08 Nov '11

08 Nov '11

Hello, How I can share a folder with dots when the listescape plugin is enabled? In this example user001 is sharing two foders named "docs-abc" and "docs-a.b.c" to user002. The first folder (without dots) is seen by user002 but the second is not found by dovecot because it search a system folder named ".docs-a.b.c" but the system folder is ".docs-a\2eb\2ec" Nov 8 11:03:52 imap2 dovecot: imap(user002): Debug: acl vfile: file /var/virtual-maildir/user001/.docs-a.b.c/dovecot-acl not found drwx------ 2 vmail vmail 4096 2011-11-08 10:54 cur drwx------ 5 vmail vmail 4096 2011-11-08 10:57 .docs-a\2eb\2ec drwx------ 5 vmail vmail 4096 2011-11-08 10:57 .docs-abc -rw------- 1 vmail vmail 20 2011-11-08 10:57 dovecot-acl-list -rw------- 1 vmail vmail 248 2011-11-08 10:55 dovecot.index.log -rw------- 1 vmail vmail 96 2011-11-08 10:54 dovecot.mailbox.log -rw------- 1 vmail vmail 51 2011-11-08 10:55 dovecot-uidlist -rw------- 1 vmail vmail 8 2011-11-08 10:57 dovecot-uidvalidity -r--r--r-- 1 vmail vmail 0 2011-11-08 10:54 dovecot-uidvalidity.4eb8fc5b drwx------ 5 vmail vmail 4096 2011-11-08 10:57 .Drafts -rw------- 1 vmail vmail 15 2011-11-08 10:54 maildirsize drwx------ 2 vmail vmail 4096 2011-11-08 10:54 new drwx------ 5 vmail vmail 4096 2011-11-08 10:54 .Sent drwx------ 5 vmail vmail 4096 2011-11-08 10:54 .Spam -rw------- 1 vmail vmail 23 2011-11-08 10:54 subscriptions drwx------ 2 vmail vmail 4096 2011-11-08 10:54 tmp drwx------ 5 vmail vmail 4096 2011-11-08 10:54 .Trash # cat /var/virtual-maildir/user001/subscriptions Trash Sent Drafts Spam docs-abc docs-a\2eb\2ec # telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. . login user001 XXXXX . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS QUOTA ACL RIGHTS=texk] Logged in . create docs-abc . OK Create completed. . create docs-a.b.c . OK Create completed. . setacl docs-abc user002 lrsw . OK Setacl complete. . setacl docs-a.b.c user002 lrsw . OK Setacl complete. . subscribe docs-abc . OK Subscribe completed. . subscribe docs-a.b.c . OK Subscribe completed. . logout * BYE Logging out . OK Logout completed. Connection closed by foreign host. # telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. . login user002 XXXXXX . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS QUOTA ACL RIGHTS=texk] Logged in . subscribe shared/user001/docs-abc . OK Subscribe completed. . subscribe shared/user001/docs-a.b.c . NO Mailbox doesn't exist: shared/user001/docs-a.b.c . logout * BYE Logging out . OK Logout completed. Connection closed by foreign host. /-----------------/ # dovecot -n # 2.0.14: /etc/dovecot/dovecot.conf # OS: Linux 2.6.34.7-0.7-xen x86_64 openSUSE 11.3 (x86_64) auth_debug = yes auth_verbose = yes base_dir = /var/run/dovecot/ dict { expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no doveadm_proxy_port = 24244 doveadm_socket_path = localhost:24244 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_debug = yes mail_fsync = always mail_gid = 5000 mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = acl quota notify expire listescape mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mmap_disable = yes namespace { inbox = yes list = yes location = prefix = separator = / subscriptions = yes type = private } namespace { list = children location = maildir:/var/virtual-maildir/%%n:INDEX=~/shared.%%n prefix = shared/%%n/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/var/maildir/vol00/shared-mailboxes autocreate = Trash autocreate2 = Sent autocreate3 = Drafts autocreate4 = Spam autosubscribe = Trash autosubscribe2 = Sent autosubscribe3 = Drafts autosubscribe4 = Spam expire = Trash expire2 = Trash/* expire5 = Spam expire6 = Spam/* expire_dict = proxy::expire mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid from subject size vsize flags mail_plugins = " mail_log notify" quota = maildir:Quota quota_exceeded_message = Quota limit reached quota_rule2 = Trash:storage=+50M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=90%% quota-warning 90 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } service auth { unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service doveadm { inet_listener { port = 24244 } } service lmtp { inet_listener lmtp { port = 24 } unix_listener lmtp { group = vmail mode = 0666 user = vmail } } service pop3-login { inet_listener pop3 { port = 110 } } service quota-warning { executable = script /etc/dovecot/quota-warning.sh unix_listener quota-warning { user = vmail } } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = acl quota notify expire listescape sieve } protocol lda { mail_plugins = acl quota notify expire listescape sieve } protocol imap { mail_max_userip_connections = 100 mail_plugins = acl quota notify expire listescape imap_acl autocreate imap_quota } protocol pop3 { pop3_uidl_format = %v-%u } local 10.1.245.101/28/28 { doveadm_password = secret }

2 1

[Dovecot] Attachements with SIS : shauld all the same files share the same inode ?
by Yann Dupont 08 Nov '11

08 Nov '11

Hello. I configured SIS , and all seems to work well, but I noticed something strange : For exemple, this attachement : 6e/2d# ls -al 6e2df299* | sort -n 104 instance of -rw------- 104 vmail vmail 346584 16 oct. 17:47 6e2df299fa96daec9b4735d07c494046429be4d6-ffd0d1xxxx The files are hardlinked, so it seems ok, but I also see 9 others files in the same directory : -rw------- 1 vmail vmail 346584 16 oct. 17:47 6e2df299fa96daec9b4735d07c494046429be4d6-0519df2a94fc9a4e1f4100008a6b99b6 -rw------- 1 vmail vmail 346584 16 oct. 17:47 6e2df299fa96daec9b4735d07c494046429be4d6-1790b92994fc9a4e1a4100008a6b99b6 as you can see, same prefix, If I compare them with diff, they are all the same files. ls -i show that 104 have the same inode, as expected, and the 9 remaining files have different inodes. I expected all the files share the same inodes. Is there something wrong here ? My setup is debian squeeze + auto packages from http://xi.rename-it.nl/debian/ dovecot is 2:2.0.15-0~auto+21 thanks, -- Yann Dupont - Service IRTS, DSI Université de Nantes Tel : 02.53.48.49.20 - Mail/Jabber : Yann.Dupont(a)univ-nantes.fr

2 2

[Dovecot] How to define ldap connection idle
by Aliet Santiesteban Sifontes 08 Nov '11

08 Nov '11

I'm having a problem with dovecot ldap connection when ldap server is in another firewall zone, firewall kills the ldap connection after a determined period of inactivity, this is good from the firewall point of view but is bad for dovecot because it never knows the connections has been dropped, this creates longs timeouts in dovecot and finally it reconnects, meanwhile many users fails to authenticate, I have seen this kind of post in the list for a while but can't find a solution for it, so my question is how to define a idle ldap time in dovecot so it can reconnect before the firewall has dropped the connection or just close the connection under inactivity so when a user authenticate doesn't fails for a while until dovecot detects that the connection has hanged. Is this a feature request or there is already a configuration for this??? Thank's in advance and congrats tu Timo for this great app.

2 4

[Dovecot] POP3/IMAPv4 CRAM-MD5 Authentication failed.(Re-post)
by Yuuichi Ikeda (SKLC) 07 Nov '11

07 Nov '11

Hi, I'm Yuuichi Ikeda from Japan User. OS:Solaris 10 9/10 s10x_u9wos_14a X86 Mem:8GB HDD:3TB gcc:gcc (GCC) 4.1.2 gcc-prefix:/unsupported/gcc Dovecot Version:2.0.15 configure:./configure --prefix=/opt/dovecot_2 --sysconfdir=/opt/dovecot_2/conf --mandir=/opt/man --enable-shared --with-mysql --with-zlib --with-sqlite --with-sql=plugin --with-ssldir=/opt/openssl --with-rundir=/var/run --with-libiconv-prefix=/opt/libiconv Dovecot Configuration > # 2.0.15: /opt/dovecot_2/conf/dovecot/dovecot.conf > # OS: SunOS 5.10 i86pc > auth_debug = yes > auth_mechanisms = cram-md5 > auth_ssl_require_client_cert = yes > auth_ssl_username_from_cert = yes > auth_verbose = yes > base_dir = /var/run/dovecot/ > doveadm_worker_count = 10 > log_path = /var/log/dovecot/dovecot.log > login_greeting = ready. > login_trusted_networks = 192.168.1.0/24 > mail_location = maildir:~/Maildir > passdb { > driver = pam > } > passdb { > args = /opt/dovecot_2/conf/dovecot/passwd > driver = passwd-file > } > plugin { > acl = vfile:/opt/dovecot_2/conf/dovecot/global-acls:cache_secs=300 > acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes > } > protocols = imap pop3 > service auth { > executable = /opt/dovecot_2/libexec/dovecot/auth > unix_listener /var/spool/postfix/private/auth { > mode = 0666 > } > } > service imap-login { > executable = /opt/dovecot_2/libexec/dovecot/rawlog /opt/dovecot_2/libexec/dovecot/imap-login > inet_listener imap { > port = 143 > ssl = no > } > inet_listener imaps { > port = 993 > ssl = yes > } > } > service imap { > executable = /opt/dovecot_2/libexec/dovecot/rawlog /opt/dovecot_2/libexec/dovecot/imap > } > service lmtp { > unix_listener lmtp { > mode = 0666 > } > } > service pop3-login { > executable = /opt/dovecot_2/libexec/dovecot/rawlog /opt/dovecot_2/libexec/dovecot/pop3-login > inet_listener pop3 { > port = 110 > ssl = no > } > inet_listener pop3s { > port = 995 > ssl = yes > } > } > service pop3 { > executable = /opt/dovecot_2/libexec/dovecot/rawlog /opt/dovecot_2/libexec/dovecot/pop3 > } > ssl_ca = </opt/dovecot_2/conf/dovecot/ca-c.pem > ssl_cert = </opt/dovecot_2/conf/dovecot/ns-c.pem > ssl_key = </opt/dovecot_2/conf/dovecot/ns-p.pem > ssl_verify_client_cert = yes > userdb { > args = blocking=yes > driver = passwd > } > protocol imap { > imap_logout_format = bytes=%i/%o > imap_max_line_length = 64 k > mail_max_userip_connections = 10 > mail_plugins = > } > protocol lda { > hostname = mailsv.sklc.co.jp > info_log_path = /var/log/dovecot/deliver.log > log_path = /var/log/dovecot/deliver.log > mail_plugins = > postmaster_address = postmaster(a)sklc.co.jp > sendmail_path = /usr/lib/sendmail > } > protocol lmtp { > mail_plugins = > } > protocol pop3 { > mail_plugins = > pop3_save_uidl = yes > pop3_uidl_format = %v-%u > } If it attests by connecting by POP3 or IMAPv4, the following messages will be displayed and attestation will go wrong. > Nov 07 23:12:40 auth: Debug: auth client connected (pid=20018) > Nov 07 23:12:40 auth: Debug: client in: AUTH 1 CRAM-MD5 service=pop3 secured no-penalty lip=192.168.1.1 rip=192.168.1.110 lport=110 rport=57054 > Nov 07 23:12:40 auth: Info: CRAM-MD5(?,192.168.1.110): Client didn't present valid SSL certificate > Nov 07 23:12:40 auth: Debug: client out: FAIL 1 reason=Client didn't present valid SSL certificate > Nov 07 23:12:40 pop3-login: Info: Aborted login (cert required, client didn't start TLS): method=CRAM-MD5, rip=192.168.1.110, lip=192.168.1.1, secured > Nov 07 23:16:32 auth: Debug: auth client connected (pid=20126) > Nov 07 23:16:32 auth: Debug: client in: AUTH 1 CRAM-MD5 service=imap secured no-penalty lip=192.168.1.1 rip=192.168.1.1 lport=143 rport=58734 > Nov 07 23:16:32 auth: Info: CRAM-MD5(?,192.168.1.1): Client didn't present valid SSL certificate > Nov 07 23:16:32 auth: Debug: client out: FAIL 1 reason=Client didn't present valid SSL certificate > Nov 07 23:16:32 imap-login: Info: Aborted login (cert required, client didn't start TLS): method=CRAM-MD5, rip=192.168.1.1, lip=192.168.1.1, secured What will you do and will become like this? If some people know ways of coping, please let me know. ============================================================= Information-system part. Sankei-Koumuten Co.,Ltd. Yuuichi Ikeda Mail:yuichi@sklc.co.jp Tel.+81-3-3623-6474 Fax.+81-3-3623-6475 Our company promotes "Team minus 6 percent" jus, Hatena Joined member. LPIC-2 Certified. =============================================================

2 1

[Dovecot] Accessing a strange mailbox
by Micah Anderson 07 Nov '11

07 Nov '11

I have a user who has a mailbox called: A----->B It seemed to work in courier fine, they managed to create it, and there are mails in it. However, dovecot is not letting the user access it, the IMAP server gives an error. I tried to rename it but I would also get an error: # doveadm mailbox rename A-----\>B AtoB doveadm(root): Error: Can't rename mailbox A----->B to AtoB: Mailbox doesn't exist: A----->B # doveadm mailbox rename A----->B AtoB doveadm(root): Error: Can't rename mailbox A----- to AtoB: Mailbox doesn't exist: A----- # doveadm mailbox rename 'A----->B' AtoB doveadm(root): Error: Can't rename mailbox A----->B to AtoB: Mailbox doesn't exist: A----->B # doveadm mailbox rename "A----->B" AtoB doveadm(root): Error: Can't rename mailbox A----->B to AtoB: Mailbox doesn't exist: A----->B # How can I deal with this mailbox (using mdbox here)? Thanks! --

3 2

[Dovecot] Problems with password verification on a BSD box against PAM
by Michael Schinhammer 07 Nov '11

07 Nov '11

Spam detection software, running on the system "ns.089.at", has identified this incoming email as possible spam. The original message has been attached to this so you can view it (if it isn't spam) or label similar future email. If you have any questions, see The administrator of that system for details. Content preview: Hi ML, i want to use my local users database on my Freebsd 8.2 box and got the following error in the maillog. The password is ok and it working on the console. i can establish the ssl connection after login "a login ux password" the error occures i cant login. [...] Content analysis details: (6.2 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- 0.2 MR_NOT_ATTRIBUTED_IP Beta rule: an non-attributed IPv4 found in headers 0.6 J_CHICKENPOX_65 BODY: 6alpha-pock-5alpha 0.6 J_CHICKENPOX_73 BODY: 7alpha-pock-3alpha 1.3 RDNS_NONE Delivered to internal network by a host with no rDNS 0.0 NO_RDNS2 Sending MTA has no reverse DNS 3.5 TO_NO_BRKTS_DIRECT To: misformatted and direct-to-MX

1 0

[Dovecot] Converting from 1.12 to 2.0 questions about mail location?
by Knute Johnson 06 Nov '11

06 Nov '11

I'm building a new server and using a newer version of ubuntu server that uses Dovecot 2.0. I thought I would like to use Maildir instead of the mbox that was used in the previous server. What do I have to do to convert my mbox mail to Maildir? Or should I just use mbox and copy it over :-)? Thanks, -- Knute Johnson

2 1

[Dovecot] Safely restoring backups
by Micah Anderson 05 Nov '11

05 Nov '11

I'm trying to determine what the best way to restore mail with mdbox is. Restoring using maildir was trivial, I just used rsync --ignore-existing which wrote any mails that were removed and didn't touch things that already existed[1]. With mdbox things have become more complicated, and I haven't found a way to restore mail that doesn't result in many message duplicates. My backup setup is simple, I'm doing daily rsync backups of user's mailstores, as well as weekly backups, so I end up having on my backup server daily.1, daily.2, daily.3, daily.4, weekly.1, weekly.2... each containing the entire contents of the user's mdbox. The different restore methods I've tried are: 1. I tried rsyncing the different backup directories back to the mail storage host, and then doing: 'dsync -R backup -u $user mdbox:/path/to/to/daily.1/mdbox'[2] 'dsync -R backup -u $user mdbox:/path/to/to/daily.2/mdbox' This works ok, but it gives duplicates of every mail that already exists for every daily/weekly I dsync. This is what the rsync --ignore-existing avoided. This is particularly annoying if I restore the weekly, and multiple daily directories, because then you get a copy for every one you restore. I had thought that the individual message's GIDs would keep them from being duplicated? 2. I also tried to use 'doveadm import' in two different ways. The first way I created a 'restored_from_backups' folder and then import each of the daily.#, weekly.# mdboxes into their own subfolder within that folder, for example: 'doveadm import -u $username mdbox:/path/to/daily.1/mdbox restored_from_backups/daily1 all' 'doveadm import -u $username mdbox:/path/to/daily.2/mdbox restored_from_backups/daily2 all' ... etc. I then go through and subscribe the new folders[3] and the user ends up with a folder structure like this: restored_from_backups/ daily.1/ INBOX Trash folder1 folder2 daily.2 INBOX Trash folder1 folder2 etc. This works fine, except that it results in the user having a entire duplicate copies of their mailbox for each daily/weekly that I restore. That will quickly bring people over quota. 3. I also tried to use 'doveadm import' to import all the different directories all into the same restored_from_backups directory, so there are no subdirectories for each daily/weekly under restored_from_backups, like so: 'doveadm mailbox create -u $user -s restored_from_backups' 'doveadm -v -D import -u $user mdbox:/path/to/daily.1/mdbox restored_from_backups all' I then go through and subscribe the folders[3]. Using this method, the 'restored_from_backups' mailbox is created, and populated with the folders. The only problem with this method is the same as method #1: for every backup I restore, mails are duplicated. Is there a way I can restore things from backup and avoid duplicates? Is there another method I should try? thanks for any ideas, pointers, suggestions for improvement, etc. micah 1. this would of course bring back mails that were deleted, but that was fine as the user could deal with that. 2. yes, I know I could setup dsync on the backup server, and use dsync directly to pull the mails from there, but this is complicated in my situation due to how the backupserver works. 3. why doesn't doveadm import have a -s option to subscribe? --

2 1

[Dovecot] Newbie Question/Feature Request
by Michael Papet 05 Nov '11

05 Nov '11

Hi, I'm working on a plugin for qpsmtpd (a perl smtp frontend) that delivers mail via dovecot's LDA. I can only get mail delivered by writing the email to file, then calling 'deliver -d someone -f someone-else < /path/to/temp/email' All good, expected behavior. A perl snippet: local $/=undef; open FH, "< ./demo.mail"; my $stringified = <FH>; # this is roughly equivalent to how other LDA queues work. close FH; open (CMD_OUT, " /usr/lib/dovecot/deliver -f somedude\(a)someplace.com -d anotherdude\(a)destination.dom $stringified |"); my $test = <CMD_OUT>; print $test; The above code errors out because the expected behavior is $stringified is supposed to be a file name. It would be great if deliver could be fed the email as a string so I don't have to add a step of writing to file. Or, maybe there's an undocumented method? Thanks. mpapet

2 1