- dovecot - dovecot.org

[Dovecot] Account Migration Tool
by dmiller＠amfes.com 10 Dec '09

10 Dec '09

I don't know if this tool already exists, or if not how difficult it would be to implement, but the following is an excerpt from the man page the developer needs to write ;) - "imapcopy", a command-line utility that connects to a given IMAP account and copies the mails to a second IMAP account. This is accomplished using only IMAP commands and may be used with any IMAP compliant server - and may be used to copy mails between servers. Command line options include the ability to delete the messages after the copy (resulting in a move operation), selectively filter mail folders, and auto-folder creation. -- Daniel

5 5

[Dovecot] irregular problem on outlook + imap
by Michele Petrazzo - Unipex 10 Dec '09

10 Dec '09

Hi list, my customer say me that "sometime" he has a problem with imap server when he try to move a mail from a folder to another. The error are: """ NO [TRYCREATE] Mailbox doesn't exist: folder.with.dots and spaces and numbers""" Like now I had connected to the server for create a "tcpdump | strings" session and the results are: vj8q OK Idle completed. can9 LIST "" "INBOX" dtZ@ * LIST (\HasChildren) "." "INBOX" can9 OK List completed. zp2p LSUB "" "*" * LSUB () "." "a_folder" <-cut folder list-> * LSUB () "." " folder.with.dots and spaces and numbers" <-cut about 600 folders-> and at the end: zp2p OK Lsub completed. 3j1@ znem IDLE 2tw@ + idling (jI@ DONE Atx@ znem OK Idle completed. lylu APPEND "folder.with.dots and spaces and numbers" (\Seen) "30-Nov-2009 10:34:00 +0100" {280844} lylu NO [TRYCREATE] Mailbox doesn't exist: folder.with.dots and spaces and numbers xbci IDLE On the maildir home (maildir:~/mail/), it's present the folder.with.dots and spaces and numbers and the same into the "subscriptions" file My env: debian lenny with last dovecot (1.0.15-2.3) On the log, there is nothing special. What can be? Thanks, Michele

4 6

[Dovecot] dovecot: Fatal: Time just moved backwards by 3909 seconds.
by Udo Rader 10 Dec '09

10 Dec '09

Hi, after setting up a KVM based virtual guest on one of our virtualization servers, we see dovecot die on that virtual guest regularly because of an alleged time shift. The virtual guest is Centos 5.4 based with dovecot 1.2.8 (at first we also tried with the original 1.0.7 (?) dovecot shipped with Centos). I wrote "alleged time shift" because there is no timeshift whatsoever, or at least I don't notice it anywhere else. ntp is - of course ;-) - up and running and no other applications have time troubles and I've even disabled the local clock as a time reference. As a proof that the time did not shift see this log excerpt: ------CUT------- Nov 29 14:02:22 athesia dovecot: IMAP(atester): Connection closed Nov 29 14:04:11 athesia dovecot: imap-login: Time just moved backwards by 4397 seconds. This might cause a lot of problems, so I'll just kill myself now. http://wiki.dovecot.org/TimeMovedBackwards ------CUT------- So as you see, dovecot successfully logged a message on 14:02 and then complained about the time having shifted 4397 seconds on 14:04 ... Thanks in advance -- Udo Rader, CTO http://www.bestsolution.at http://riaschissl.blogspot.com

4 12

[Dovecot] Overriding Default Subscription Behavior
by Tony Rutherford 10 Dec '09

10 Dec '09

The subscription files we're migrating from have a "." for folder separation. We will be using Dovecot's maildir with LAYOUT=fs. It's looking for "/" as the separator in the subscription file. So, obviously we could simply write a script to swap the two characters. However, just curious if there are any options for doing this within a plugin (since we're already doing some things in a plugin) by overriding some of the subscription code.something like the "next_line()" in subscriptions.c. I don't see any vfuncs in this area, aside from set_subscribed() I believe.but maybe there's a better spot I'm not thinking of? One thing I've learned with Dovecot is that it somehow supports things I didn't believe it could/would, so I thought I'd ask. Tony

2 1

[Dovecot] PostgreSQL connection bug
by Daniel Howard 10 Dec '09

10 Dec '09

Hello, There seems to be a bug which can affect systems using PostgreSQL as a user or password database. Usually there is just one postgres connection, but if the query fails for any reason, the failed connection is left open and dovecot will keep opening new connections for each auth attempt. I discovered this with a setup using PAM, AND a database to authenticate. Most users login with an account number (integer) which is looked up in the postgres database. Some users have a unix system account, and use their system username to log in (string). Dovecot was set up to check the database first, then try PAM. When a system user logged in, the SQL query failed because it couldn't coerce the system user's username into an integer. In these cases, Dovecot would still fall back to PAM authentication, and the user would log in, but the postgres connection would remain stuck. Gradually the number of connections would increase until postgres failed. I worked around this by converting the account numbers in the database from integers to strings. Now the query never fails and there's only ever 1 dovecot connection. Hopefully this will help someone. dovecot --version 1.0.15 dovecot -n # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail mail_location: maildir:~/Maildir auth default: passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf passdb: driver: pam userdb: driver: passwd userdb: driver: prefetch cat dovecot-sql.conf | egrep -v "^#" driver = pgsql connect = host=localhost dbname=rapidgroup user=dovecot password=********* default_pass_scheme = PLAIN password_query = SELECT userid as user, password, userdb_mail, userdb_uid, userdb_gid FROM dovecotview WHERE userid='%u' Cheers, Dan

3 6

[Dovecot] dovecot.index
by Ermurachi Ion 10 Dec '09

10 Dec '09

Hello, I can't locate the dovecot.index in my ~/Maildir [root@fedora-p24 Maildir]# ls cur dovecot-uidlist new dovecot.index.cache dovecot-uidvalidity subscriptions dovecot.index.log dovecot-uidvalidity.4b1e77ef tmp Where is the dovecot.index ? This tutorial http://wiki.dovecot.org/IndexFiles tells that I should find it where the other indexes are by default under ~/Maildir I don't understand the IMAP UID mapping [root@fedora-p24 cur]# ls cur 1260490526.M622249P1489.fedora-p24.local,W=582:2,S 1260491930.M172649P1524.fedora-p24.local,W=675:2,S 1260492827.M414655P1561.fedora-p24.local,W=3390476:2,S 1260539343.M690611P1736.fedora-p24.local,W=665:2,S 1260539406.M725730P1746.fedora-p24.local,W=655:2,S 1260539465.M446296P1750.fedora-p24.local,W=689:2,S The IMAP UIDVALIDITY is 4b1e77ef (in HEX) [root@fedora-p24 Maildir]# cat dovecot-uidvalidity 4b1e77ef 4b1e77ef(HEX) = 1260287983 (DEC), I don't see in the filenames the IMAP UIDVALIDITY in HEX or DEC This tutorial tells me that I should http://wiki.dovecot.org/MailboxFormat/Maildir Please explain me why ? Here is my dovecot configuration: [root@fedora-p24 Maildir]# dovecot -n # 1.2.6: /etc/dovecot.conf # OS: Linux 2.6.31.5-127.fc12.x86_64 x86_64 Fedora release 12 (Constantine) protocols: imap imaps login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: maildir:~/Maildir lda: postmaster_address: postmaster(a)eurobluelife.ro hostname: ns1.eurobluelife.ro deliver_log_format: msgid=%m: %$ sendmail_path: /usr/lib/sendmail auth_socket_path: /var/run/dovecot/auth-master auth default: passdb: driver: pam userdb: driver: passwd

2 1

[Dovecot] Not receiving Local Mails
by Alexander 10 Dec '09

10 Dec '09

Hi, I have already set up DOVECOT + POSTFIX mail server and I can send and receive mails outside my Domain. The problem however is that LOCAL Mail is not working. When I send LOCAL mails, it leaves my system without error messages but it is not received by the recipient. How do I make LOCAL mails work? Regards Alexander

2 1

[Dovecot] SASL plain authentication failed; unable to lookup user record
by JP 10 Dec '09

10 Dec '09

i'll guess the solution to my problem will be something simple and obvious, because i know i ain't the first person to do this and it ain't all that complicated, but i've been staring at it for days and can't see what's wrong. new installation; os x snow leopard server; postfix 2.5.5; dovecot 1.1.17apple0.5 i'm trying to get SMTP auth working via SASL. using a plain password scheme and plain auth scheme over SSL. client is apple mail. deliveries are working, and dovecot's pop3s and imaps are working just fine. my configuration is the same simple config that is well documented on both the postfix and dovecot sites. when i attempt to use smtp auth from a mail client, postfix says SASL plain authentication failed unable to lookup user record smtp authentication also fails if i use the usual command line method: # telnet localhost 25 Escape character is '^]'. 220 osx-106.example.com ESMTP Postfix EHLO foobie.example.com 250-osx-106.example.com 250-PIPELINING 250-SIZE 10485760 250-VRFY 250-ETRN 250-AUTH LOGIN PLAIN CRAM-MD5 250-STARTTLS 250-ENHANCEDSTATUSCODES 250-8BITMIME 250 DSN AUTH PLAIN blah blah blah 535 Error: authentication failed i've scoured months worth of postfix and dovecot list archives and although there are many sasl related issues i didn't see anything specific to this. as expected, the socket is srw-rw---- 1 _postfix _postfix 0 Dec 4 08:51 /var/spool/postfix/private/auth lsof shows the socket is open by dovecot-auth (which is running as root): dovecot-a 63614 root 5u unix 0x0888b990 0t0 /var/spool/postfix/private/auth i have not seen the socket opened by postfix, but i'm assuming that is a transient event and would be difficult to capture (at least with lsof). so both postfix and dovecot have read/write access to the socket. the credentials sent are the same whether they're sent via a true pop3 client or via the command line. when sent via the command line, they're generated via perl -MMIME::Base64 -e 'print encode_base64("\0username\0password");'and i've verified they're correct via decode_base64 config stuff: # postconf -n biff = no command_directory = /usr/sbin config_directory = /etc/postfix content_filter = smtp-amavis:[127.0.0.1]:10024 daemon_directory = /usr/libexec/postfix debug_peer_level = 2 enable_server_options = yes header_checks = pcre:/etc/postfix/custom_header_checks html_directory = /usr/share/doc/postfix/html inet_interfaces = all mail_owner = _postfix mailbox_size_limit = 0 mailbox_transport = dovecot mailq_path = /usr/bin/mailq manpage_directory = /usr/share/man message_size_limit = 10485760 mydomain = example.com mydomain_fallback = localhost mynetworks = 127.0.0.0/8,192.168.61.0/24 newaliases_path = /usr/bin/newaliases queue_directory = /private/var/spool/postfix readme_directory = /usr/share/doc/postfix recipient_delimiter = + relayhost = sample_directory = /usr/share/doc/postfix/examples sendmail_path = /usr/sbin/sendmail setgid_group = _postdrop smtpd_client_restrictions = permit_mynetworks permit_sasl_authenticated reject smtpd_enforce_tls = no smtpd_helo_required = yes smtpd_helo_restrictions = reject_invalid_helo_hostname reject_non_fqdn_helo_hostname smtpd_pw_server_security_options = plain, login cram-md5 smtpd_recipient_restrictions = permit_sasl_authenticated permit_mynetworks reject_unauth_destination check_policy_service unix:private/policy reject smtpd_sasl_auth_enable = yes smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot smtpd_tls_CAfile = /etc/certificates/osx-106.example.com.E2FA6EFB8203E2E09C605D30A179669E4B4F69EB.chain.pem smtpd_tls_cert_file = /etc/certificates/osx-106.example.com.E2FA6EFB8203E2E09C605D30A179669E4B4F69EB.cert.pem smtpd_tls_exclude_ciphers = SSLv2, aNULL, ADH, eNULL smtpd_tls_key_file = /etc/certificates/osx-106.example.com.E2FA6EFB8203E2E09C605D30A179669E4B4F69EB.key.pem smtpd_use_pw_server = yes smtpd_use_tls = yes unknown_local_recipient_reject_code = 550 virtual_alias_maps = virtual_gid_maps = static:5000 virtual_mailbox_base = /etc/postfix/datastore virtual_mailbox_domains = osx.example.com virtual_mailbox_maps = hash:/etc/postfix/datausers virtual_minimum_uid = 100 virtual_uid_maps = static:5000 # dovecotd -n # 1.1.17apple0.5: /private/etc/dovecot/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 456). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: Darwin 10.2.0 i386 hfs base_dir: /var/run/dovecot syslog_facility: local6 protocols: pop3s imaps ssl_cert_file: /etc/certificates/osx-106.example.com.E2FA6EFB8203E2E09C605D30A179669E4B4F69EB.cert.pem ssl_key_file: /etc/certificates/osx-106.example.com.E2FA6EFB8203E2E09C605D30A179669E4B4F69EB.key.pem ssl_cipher_list: ALL:!LOW:!SSLv2:!aNULL:!ADH:!eNULL disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_user: _dovecot login_process_per_connection: no max_mail_processes: 200 mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(pop3): 10 verbose_proctitle: yes first_valid_uid: 6 first_valid_gid: 6 mail_access_groups: mail mail_location: maildir:/etc/postfix/datastore/%d/%n mail_debug: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_process_sharing: full mail_max_connections: 5 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: passwd-file args: username_format=%n /etc/postfix/datastore/%d-passwd userdb: driver: passwd-file args: username_format=%n /etc/postfix/datastore/%d-passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix plugin: quota_warning: storage=100%% /usr/libexec/dovecot/quota-exceeded.sh quota: maildir:User quota sieve: /var/spool/imap/dovecot/sieve-scripts/%u/dovecot.sieve it would seem that something's not right between postfix and dovecot. dovecot debug:yes and dovecot debug_passwords:yes and i do see debug info in the logs when i authenticate via pop3. but i don't see any debug info in the logs when doing smtp auth. i don't know if that's another symptom, or if dovecot just does not debug smtp auth connections to begin with. so any other insight would be appreciated. thanks. jeff

5 6

[Dovecot] Cannot read mdir inbox.
by Marc Dufour 10 Dec '09

10 Dec '09

Problem: Dovecot is totally and merrily oblivious to maildir INBOX installed in the usual /var/spool/mail/%u Software/system: Dovecot 1.2.8 running under Fedora 12 with 1.9 gig RAM + AMD Athlon LE-1640 CPU on a ASUS M3A78-EM motherboard (uname -a = Linux 2.6.31.6-162.fc12.x86_64 #1 SMP Fri Dec 4 00:06:26 EST 2009 x86_64 x86_64 x86_64 GNU/Linux ) Dovecot has been installed from the Fedora repositories, not recompiled from scratch. System has only one hard disk and is on one ext4 LVM partition. My configurations are http://emdx.org/Dovecot/dovecot.confA.txt for "dovecot -a" http://emdx.org/Dovecot/dovecot.confN.txt for "dovecot -n" The mail is properly delivered by Exim in the proper place. Using a client (Thunderbird 3), if I copy some messages in the INBOX, they stay there, but they are nowhere to be found in the /var/spool/mail/%u directory. User mail is in ~/Maildir. I tried to make a symlink pointing to /var/spool/mail/%u and, of course, it does not work. I also tried giving chmod 666 to all files in /var/spool/mail/%u (and chmod 777 for the directories), this makes no difference. Otherwise, Dovecot works flawlessly and without no problems whatsoever in ~/Maildir. I can transfer huge volumes of email from the future old server and everything is rock solid. I just can’t get the INBOX. I would rather not fiddle with Exim and have it deliver the mail into ~/Maildir Google has been stellarly inefficient in helping me find solutions.

2 4

[Dovecot] Virtual mailboxes not always up to date?
by Patrick Nagel 10 Dec '09

10 Dec '09

Hi, I have been experimenting with the Virtual mailboxes plugin [1] recently. This is my setup: the following dovecot-virtual file exists in a virtual mailbox called "todo": ------ dovecot-virtual ------ * -Trash -Trash/* -Spam -Spam/* OR KEYWORD $TODO KEYWORD todo ----------------------------- so if any mail in any mailbox except Trash+Spam has the keyword "$TODO" (that's what KMail sets when you mark a message as "action item") or "todo" (that's what Thunderbird sets when you put the Todo tag on a message), it should be shown in that 'todo' virtual mailbox. This works for the first time after I edit the dovecot-virtual file and then access the virtual mailbox (all mails I expect to be shown in the todo mailbox are there) - but further accesses always show the same content, even though I removed the keyword from one of the mails (and I can confirm that the keyword has actually been removed by dovecot, since the filename doesn't contain the letter corresponding to the keyword anymore). It seems that changing the dovecot-virtual file triggers the execution of the "search program" - but shouldn't simply accessing the virtual mailbox also trigger it? Or is there a (undocumented?) timeout between search program executions? Patrick. [1]: http://wiki.dovecot.org/Plugins/Virtual # dovecot -n # 1.2.6: /etc/dovecot/dovecot.conf # OS: Linux 2.6.22-vs2.2.0.7-gentoo x86_64 Gentoo Base System release 2.0.1 protocols: imaps managesieve listen: x.x.x.x ssl: required ssl_ca_file: /etc/ssl/dovecot/sub.class1.server.ca.crt ssl_cert_file: /etc/ssl/dovecot/ssl.crt ssl_key_file: /etc/ssl/dovecot/ssl.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(managesieve): 10 mail_location: maildir:~/.maildir mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_process_size: 2048 mail_plugins(default): virtual fts fts_squat mail_plugins(imap): virtual fts fts_squat mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(managesieve): /usr/lib64/dovecot/managesieve imap_client_workarounds(default): tb-extra-mailbox-sep imap_client_workarounds(imap): tb-extra-mailbox-sep imap_client_workarounds(managesieve): namespace: type: private separator: . inbox: yes list: yes subscriptions: yes namespace: type: private separator: . prefix: virtual. location: virtual:~/.maildir/virtual list: yes subscriptions: yes lda: postmaster_address: postmaster@x mail_plugins: sieve virtual auth default: passdb: driver: pam args: * userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix plugin: fts: squat fts_squat: partial=4 full=10 -- STAR Software (Shanghai) Co., Ltd. http://www.star-group.net/ Phone: +86 (21) 3462 7688 x 826 Fax: +86 (21) 3462 7779 PGP key: E883A005 https://stshacom1.star-china.net/keys/patrick_nagel.asc Fingerprint: E09A D65E 855F B334 E5C3 5386 EF23 20FC E883 A005

3 7