- dovecot - dovecot.org

[Dovecot] (slightly OT) syncing / migrating IMAP mailboxes
by Gunter Ohrner 28 Aug '07

28 Aug '07

Hi! I fear this may be slightly off-topic but it's both related to IMAP and to dovecot: Is there any good and in paticular realiable program for synching / migrating one IMAP mailbox to another? The most important features for me is that a) no mails are lost / left out silently and b) the porgram is able to sync the complete mailbox including all folders without just giving up in the middle of the transfer. If it's somehow possible, I'd like to migrate directly from one IMAP account to the other, without running the synchronizer on one of the servers and without accessing one of the Maildirs directly. I simply want to migrate my existing IMAP account from one Dovecot server (running 1.0beta5) to a new one (running 1.0rc15, as that's the version in Debian stable). Actually, a large part of the mailbox including most / all folders is already present on both servers, but I recently noticed that a few thousand mails are still missing. The current mailbox state is the result of two earlier (obviously incomplete :-( ) migrations a few months ago, from the original Dovecot 1.0beta5 server to a Cyrus server, and - shortly thereafter - from there on to the currently used Dovecot 1.0rc15. So far I've tried offlineimap, imapsync and mailsync, none of which seems to be really usuable. :-( The current state with the incomplete mailbox was caused by mailsync. When I did the first two migrations, mailsync looked like the only program which worked, but seems to have "forgotten" the missing messages. Another extremely suspicious thing is that mailsync reports "phantom changes" if run again immediately after synching a folder and will start to delete and copy / "sync" dozends of messages even if none of the folders actually changed after synching. I've read the name "imapsync" on this list several times, but I just tried it and just tried version 1.219. It happily starts synching the mailboxes and copying messages, but stops after partially synching the first folder - it simply exists, leaving no informational or error message whatsoever... Restarting imapsync will not help, it will appear to start synching the first folder again, but silently exit without doing anything. Some of you seem to use imapsync as a migration tool for production systems, how do you cope with these situations and how do you ensure a mailboxs' migration actually completed successfully? As you're probably not playing Roulette with your customers' or companie's eMails, I'm interested in your receipts to successfully use imapsync myself. As the third application I tried offlineimap (4.0.x-branch). During the migration a few months ago offlineimap (4.0.16 IIRC, synching from a Maildir to a remote IMAP account) was unusuable as it continuously and reproducibly threw exceptions at me during syncing obviously caused by specific messages in the accounts. Unfortunately, I wasn't able ti get any successful help on the offlineimap mailing list this time. :-( Now, synching from one IMAP account to another, specifiying the new server as the "local" account, offlineimap did not throw exceptions caused by mail messages so far, but it's performance is unusuable. It seems to use the "local" IMAP account on my target sevrer in a way which causes Dovecot to utilize all CPU power, copying one message every 10 to 20 seconds - this way, a sync would take ages and frequently aborts because of connection problems. The target server is an Athlon64 3700+ machine... So, does anyone have any pratical solution on how to migrate one IMAP mailbox to another? For various reasons I'd really prefer to go with a tested and working, reliable solution instead of starting to debug complex non-working programs I do not halfway understand and for which I cannot seem to get reliably support from its authors and/or its user community... :-/ Thanks a lot in advance for any pointers to a solution, Gunter -- +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ "The obvious mathematical breakthrough would be development of an easy way to factor large prime numbers." -- Bill Gates from The Road Ahead, p265 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ + PGP-verschlüsselte Mails bevorzugt! + +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+

2 1

[Dovecot] dovecot + MANAGESIEVE roadmap
by Jorge Salamero Sanz 28 Aug '07

28 Aug '07

i've seen in the wiki[0] that MANAGESIEVE patch could be added to version 1.2 is there any expected release for this version ? if i apply now the patch, the migration to 1.2 with the sieve stuff would be transparent ? [0] http://wiki.dovecot.org/LDA/Sieve

1 0

[Dovecot] deb package for dovecot-1.0.3 with MANAGESIEVE patch
by indra wardhana 28 Aug '07

28 Aug '07

download deb source http://ftp.debian.org/debian/pool/main/d/dovecot/dovecot_1.0.3-3.diff.gz http://ftp.debian.org/debian/pool/main/d/dovecot/dovecot_1.0.3.orig.tar.gz http://ftp.debian.org/debian/pool/main/d/dovecot/dovecot_1.0.3-3.dsc download managesieve patch http://sinas.rename-it.nl/~sirius/dovecot-1.0.3-MANAGESIEVE-v7.diff.gz extract deb source dpkg-source -x dovecot_1.0.3-3.dsc => this will create directory dovecot-1.0.3 n extract deb source on it extract MANAGESIEVE patch zcat dovecot-1.0.3-MANAGESIEVE-v7.diff.gz >> managesieve.dpatch add dpatch header open managesive.dpatch with ur editor add this line on top ----- cut here ----- #! /bin/sh -e . $(dirname $0)/DPATCH exit 0 @DPATCH@ ------ end cut ------ copy managesieve n add to list copy managesieve.dpatch to directory dovecot-1.0.3/debian/patches/ edit file 00list, add 'managesieve' on the top etch compatibility change to direcoty dovecot-1.0.3 edit file debian/control => change 'drac-dev (>= 1.12-5)' to 'drac-dev (>=1.12-4)' managesieve compatibility edit file debian/rules => change 'aclocal; automake-1.9; libtoolize -f -c; aclocal-1.9; autoconf' to 'aclocal; autoreconf -i; automake-1.9; libtoolize -f -c; aclocal-1.9; autoconf' party time compile with 'fakeroot dpkg-buildpackage -b' regards Indra Wardhana

1 0

[Dovecot] Some customers receiving duplicate e-mails
by Patrick - South Valley Internet 28 Aug '07

28 Aug '07

Hi all, I posted this question in the Postfix users mailing list as well - I'm not sure if this is Dovecot or Postfix related. Our old system which we migrated off of was an AIX 5.2 machine running most recent Postfix and mbox format with UW-IMAP. We've migrated to most recent Postfix, using Maildir and Dovecot v1. After we used mb2md to migrate over all our customers, some of our customers have called in to let us know they are receiving duplicate e-mails. It's not happening to everyone, it's random (well, I'm sure it's not really random, I haven't found the issue yet). I don't even know where to start. I looked at the logs, but everything looks fine. How can I troubleshoot something like this? Have any of you experienced the same issue? Thanks in advance.

2 1

[Dovecot] MANAGESIEVE patch v7 for dovecot 1.0.3
by Stephan Bosch 27 Aug '07

27 Aug '07

Hello dovecot users, I have updated the MANAGESIEVE patch to fix a recently reported problem. This is a patch against the latest stable release 1.0.3. It currently won't compile with 1.1 due to significant changes in the master code. Change Log V7 ------------- - Robin Breathe indicated that the regex capability was missing in the server's SIEVE listing. It turns out I forgot to make arrangements for setting ENABLE_REGEX in the cmu libsieve sources, so the regex extension was not compiled in. I copied the configure.in section regarding ENABLE_REGEX from dovecot-sieve-1.0.2 and that fixed the problem. This patch still includes (yet another) instance of the CMU Sieve source, as explained in one of my previous e-mails (http://dovecot.org/list/dovecot/2006-July/015016.html) The patch can be downloaded at: http://sinas.rename-it.nl/~sirius/dovecot-1.0.3-MANAGESIEVE-v7.diff.gz The README.managesieve is located in the root of the dovecot source tree after applying the patch. Have fun testing the patch. Don't hesitate to notify me when there are problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl IRC: Freenode, #dovecot, S[r]us

2 3

[Dovecot] Restoring a deleted/moved imap folder
by Oliver Schulze L. 27 Aug '07

27 Aug '07

Hi, one user of my imap server just deleted a whole folder, blame thunderbird I have the server disk and running Stellar Info for deleted files recovery. My cuestion is about how dovecot deleted an imap Maildir folder? The imap client is configured to move the deleted mails to the Trash folder, so I think dovecot would delete every Maildir email after successfully moved it. In the case a folder is deleted, is something special dovecot does to the email? Or it just run the unlink() function? In the case of compacting a folder, I think thats just a client side action. Many thanks Oliver -- Oliver Schulze L. | http://tinymailto.com/oliver Asuncion - Paraguay | http://www.solojuegos.mobi

3 3

[Dovecot] Dovecot should raise the limit of file descriptors at startup...
by Peter Eriksson 27 Aug '07

27 Aug '07

We've run into a situation where the Dovecot master process "dovecot" runs out of file descriptors on Solaris 10 since the default is only 256: # plimit 1 1: /sbin/init resource current maximum time(seconds) unlimited unlimited file(blocks) unlimited unlimited data(kbytes) unlimited unlimited stack(kbytes) 8192 unlimited coredump(blocks) unlimited unlimited nofiles(descriptors) 256 65536 vmemory(kbytes) unlimited unlimited Output from "pfiles" after we raised the limit manually: # pfiles 26378 | head -10 26378: /ifm/sbin/dovecot -c /etc/dovecot.conf Current rlimit: 16384 file descriptors 0: S_IFCHR mode:0666 dev:327,15 ino:18128 uid:0 gid:3 rdev:13,2 O_RDONLY|O_LARGEFILE /export/zones/dovecot/root/dev/null 1: S_IFCHR mode:0666 dev:327,15 ino:18128 uid:0 gid:3 rdev:13,2 O_RDONLY|O_LARGEFILE /export/zones/dovecot/root/dev/null 2: S_IFCHR mode:0666 dev:327,15 ino:18128 uid:0 gid:3 rdev:13,2 O_RDONLY|O_LARGEFILE # pfiles 26378 | tail -10 243: S_IFIFO mode:0000 dev:324,0 ino:2038192 uid:0 gid:0 size:0 O_RDWR|O_NONBLOCK FD_CLOEXEC 246: S_IFIFO mode:0000 dev:324,0 ino:2048002 uid:0 gid:0 size:0 O_RDWR|O_NONBLOCK FD_CLOEXEC 247: S_IFIFO mode:0000 dev:324,0 ino:2048441 uid:0 gid:0 size:0 O_RDWR|O_NONBLOCK FD_CLOEXEC 258: S_IFIFO mode:0000 dev:324,0 ino:2042076 uid:0 gid:0 size:0 O_RDWR|O_NONBLOCK FD_CLOEXEC 459: S_IFIFO mode:0000 dev:324,0 ino:1311426 uid:0 gid:0 size:0 O_RDWR|O_NONBLOCK FD_CLOEXEC Perhaps the Dovecot master process should raise it's own limit to the allowed maximum when it starts? (getrlimit()+setrlimit()), or be user configurable? Has this been discussed somewhere before? - Peter

4 4

[Dovecot] Fedora devel dovecot problem
by Nicolas Mailhot 27 Aug '07

27 Aug '07

Hi, You may be interested in this report: https://bugzilla.redhat.com/show_bug.cgi?id=254217 Regards, -- Nicolas Mailhot

1 0

[Dovecot] Sieve Vacation cause deliver to die
by M1 27 Aug '07

27 Aug '07

I have compile with the vacation patch (dovecot-sieve-1.0-logging.patch) and log file shown. ----------------------------------------- 2007-08-15 11:28:34 deliver(steve(a)tinchun.com): sieve_execute_bytecode(/home/mail/sieve/steve(a)tinchun.com/.dovecot.sievec) failed 2007-08-15 11:28:34 deliver(steve(a)tinchun.com): sieve runtime error: Run error ----------------------------------------- my .dovecot.sieve # Sieve Filter # 由 Ingo (http://www.horde.org/ingo/) 產生 (August 15, 2007, 10:49 am) require "vacation"; # 假期通知 if allof ( not exists ["list-help", "list-unsubscribe", "list-subscribe", "list-owner", "list-post", "list-archive", "list-id"], not header :comparator "i;ascii-casemap" :is "Precedence" "list,bulk" ) { vacation :days 7 :addresses "steve(a)tinchun.com" :subject "test" "test vacation"; }

3 5

[Dovecot] Kmail client desconnection
by Jordi Espasa Clofent 27 Aug '07

27 Aug '07

Hi all, I have a Postfix+Dovecot working in beta/testing; it seems to run very fine, but one beta-tester user says that kmail informs him about frequent desconnections. My dovecot -a shows: # /etc/dovecot.conf base_dir: /var/run/dovecot log_path: info_log_path: log_timestamp: %b %d %H:%M:%S syslog_facility: mail protocols: imaps listen: [::] ssl_listen: ssl_disable: no ssl_ca_file: ssl_cert_file: /etc/pki/dovecot/certs/dovecot.pem ssl_key_file: /etc/pki/dovecot/private/dovecot.pem ssl_key_password: ssl_parameters_regenerate: 168 ssl_cipher_list: ssl_verify_client_cert: no disable_plaintext_auth: no verbose_ssl: no shutdown_clients: yes nfs_check: yes version_ignore: no login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login login_user: dovecot login_greeting: Dovecot ready. login_log_format_elements: user=<%u> method=%m rip=%r lip=%l %c login_log_format: %$: %s login_process_per_connection: yes login_chroot: yes login_greeting_capability: no login_process_size: 32 login_processes_count: 3 login_max_processes_count: 128 login_max_connections: 256 valid_chroot_dirs: mail_chroot: max_mail_processes: 1024 verbose_proctitle: no first_valid_uid: 4444 last_valid_uid: 4444 first_valid_gid: 1 last_valid_gid: 0 mail_extra_groups: default_mail_env: mail_location: maildir:/var/vmail/%u mail_cache_fields: flags mail_never_cache_fields: imap.envelope mail_cache_min_mail_count: 0 mailbox_idle_check_interval: 30 mail_debug: no mail_full_filesystem_access: no mail_max_keyword_length: 50 mail_save_crlf: no mail_read_mmaped: no mmap_disable: no mmap_no_write: no lock_method: fcntl maildir_stat_dirs: no maildir_copy_with_hardlinks: yes mbox_read_locks: fcntl mbox_write_locks: fcntl mbox_lock_timeout: 300 mbox_dotlock_change_timeout: 120 mbox_min_index_size: 0 mbox_dirty_syncs: yes mbox_very_dirty_syncs: no mbox_lazy_writes: yes dbox_rotate_size: 2048 dbox_rotate_min_size: 16 dbox_rotate_days: 1 umask: 63 mail_drop_priv_before_exec: no mail_executable: /usr/libexec/dovecot/imap mail_process_size: 256 mail_plugins: mail_plugin_dir: /usr/lib64/dovecot/imap mail_log_prefix: %Us(%u): imap_max_line_length: 65536 imap_capability: imap_client_workarounds: outlook-idle pop3_no_flag_updates: no pop3_enable_last: no pop3_reuse_xuidl: no pop3_lock_session: no pop3_uidl_format: %08Xu%08Xv pop3_client_workarounds: pop3_logout_format: top=%t/%p, retr=%r/%b, del=%d/%m, size=%s auth default: mechanisms: plain realms: default_realm: cache_size: 0 cache_ttl: 3600 executable: /usr/libexec/dovecot/dovecot-auth user: nobody chroot: username_chars: abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ username_translation: username_format: master_user_separator: anonymous_username: anonymous krb5_keytab: verbose: no debug: no debug_passwords: no ssl_require_client_cert: no ssl_username_from_cert: no count: 1 worker_max_count: 30 process_size: 256 passdb: driver: sql args: /etc/dovecot_mysql.conf deny: no pass: no master: no userdb: driver: sql args: /etc/dovecot_mysql.conf userdb: driver: prefetch args: socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: vmail ¿How can I debbug this behaviour or how can I determine if this issue is a client or dovecot fail? TIA.

3 6