May 2007 - dovecot - dovecot.org

[Dovecot] Moving new email from the mail spool to the inbox
by Adrian Barker 09 May '07

09 May '07

We are considering switching from the Washington UW IMAP server to Dovecot for performance reasons, but we make use of the feature in the UW server that automatically moves new email from the mail spool to the IMAP INBOX. Has anyone implemented this in Dovecot, or considered implementing it ? We have a large number of users, so cannot easily change the way that we deliver email. -- Adrian Barker, Information Systems University College London, Gower Street, London WC1E 6BT External phone: +44 20 7679 5140, Fax (+44) 20 7388 5406 Email: A.Barker(a)ucl.ac.uk

8 11

[Dovecot] Dovecot deliver discards emails (mail loss)
by Steffen Kaiser 09 May '07

09 May '07

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, Dovecot deliver used with filesystem quota, sendmail v8.13 via .forward-mechanism causes mail loess: May 8 09:49:53 ux-2s11-9 deliver(dvtest): msgid=<200705080749.l487nclf029596(a)ux-2s11-9.inf.fh-bonn-rhein-sieg.de>: save failed to INBOX May 8 09:49:53 ux-2s11-9 deliver(dvtest): msgid=<200705080749.l487nclf029596(a)ux-2s11-9.inf.fh-bonn-rhein-sieg.de>: Return-Path missing, rejection reason: Not enough disk space May 8 09:49:53 ux-2s11-9 sendmail[29618]: l487nclf029596: to="| /etc/mail/runde", ctladdr=dvtest (31045/102), delay=00:00:15, xdelay=00:00:00, mailer=prog, pri=120033, dsn=2.0.0, stat=Sent "/etc/mail/runde" is a shell script to capture various status of the delivery attempt, incl. a strace log. Below are the last lines of the strace. Actually, I expected deliver to _tempfail_ the delivery attempt with "out of quota". However, the mail is lost, I guess, because sendmail received a return code "0". ================== brk(0x8115000) = 0x8115000 time(NULL) = 1178610593 open("/var/cache/dovecot/31045/index/.INBOX/dovecot.index", O_RDWR|O_LARGEFILE) = 7 alarm(120) = 0 fcntl64(7, F_SETLKW64, {type=F_RDLCK, whence=SEEK_SET, start=0, len=0}, 0xbfaa8c44) = 0 alarm(0) = 120 fstat64(7, {st_mode=S_IFREG|0600, st_size=2144, ...}) = 0 mmap2(NULL, 2144, PROT_READ|PROT_WRITE, MAP_SHARED, 7, 0) = 0xb7ee6000 open("/var/cache/dovecot/31045/index/.INBOX/dovecot.index.log", O_RDWR|O_LARGEFILE) = 8 fstat64(8, {st_mode=S_IFREG|0600, st_size=2984, ...}) = 0 pread64(8, "\1\0\30\0\214\267\377E\1\0\0\0\0\0\0\0\0\0\0\0\214\267"..., 24, 0) = 24 fcntl64(7, F_SETLK64, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}, 0xbfaa8ca4) = 0 time(NULL) = 1178610593 stat64("/etc/localtime", {st_mode=S_IFREG|0644, st_size=837, ...}) = 0 stat64("/home/dvtest/MailDir/new", {st_mode=S_IFDIR|0700, st_size=12288, ...}) = 0 stat64("/home/dvtest/MailDir/cur", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat64("/home/dvtest/MailDir/tmp/1178610593.P29623Q0M537288.ux-2s11-9", 0xbfaa8d90) = -1 ENOENT (No such file or directory) umask(0) = 077 open("/home/dvtest/MailDir/tmp/1178610593.P29623Q0M537288.ux-2s11-9", O_WRONLY|O_CREAT|O_EXCL|O_LARGEFILE, 0600) = 9 umask(077) = 0 _llseek(9, 0, [0], SEEK_CUR) = 0 fstat64(9, {st_mode=S_IFREG|0600, st_size=0, ...}) = 0 writev(9, [{"From root(a)ux-2s11-9.inf.fh-bonn-"..., 70}, {"\n", 1}], 2) = - -1 EDQUOT (Disk quota exceeded) utime("/home/dvtest/MailDir/tmp/1178610593.P29623Q0M537288.ux-2s11-9", [2007/05/08-09:49:53, 2007/05/08-09:49:53]) = 0 fsync(9) = 0 close(9) = 0 unlink("/home/dvtest/MailDir/tmp/1178610593.P29623Q0M537288.ux-2s11-9") = 0 time([1178610593]) = 1178610593 stat64("/etc/localtime", {st_mode=S_IFREG|0644, st_size=837, ...}) = 0 stat64("/etc/localtime", {st_mode=S_IFREG|0644, st_size=837, ...}) = 0 stat64("/etc/localtime", {st_mode=S_IFREG|0644, st_size=837, ...}) = 0 send(6, "<22>May 8 09:49:53 deliver(dvte"..., 130, MSG_NOSIGNAL) = 130 time([1178610593]) = 1178610593 stat64("/etc/localtime", {st_mode=S_IFREG|0644, st_size=837, ...}) = 0 stat64("/etc/localtime", {st_mode=S_IFREG|0644, st_size=837, ...}) = 0 stat64("/etc/localtime", {st_mode=S_IFREG|0644, st_size=837, ...}) = 0 send(6, "<22>May 8 09:49:53 deliver(dvte"..., 170, MSG_NOSIGNAL) = 170 close(8) = 0 munmap(0xb7ee6000, 2144) = 0 close(7) = 0 munmap(0xb7d6c000, 39020) = 0 munmap(0xb7ee7000, 8952) = 0 munmap(0xb7d43000, 166416) = 0 fcntl64(3, F_GETFD) = 0x1 (flags FD_CLOEXEC) close(3) = 0 close(5) = 0 exit_group(0) = ? =============== protocol lda { # Address to use when sending rejection mails. postmaster_address = postmaster@mail # Support for dynamically loadable plugins. mail_plugins is a space separated # list of plugins to load. mail_plugin_dir = /usr/local/dovecot/lib/dovecot/lda mail_plugins = quota mail_log cmusieve # Binary to use for sending mails. sendmail_path = /usr/sbin/sendmail # UNIX socket path to master authentication server to find users. auth_socket_path = /var/run/dovecot/auth-master # Log to syslog log_path = info_log_path = syslog_facility = mail } Bye, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iQEVAwUBRkAvCC9SORjhbDpvAQKXiwgAoWOhnRqlqqqcWrT0r/vPB4vklFUylxFz rgNlNklola01iqZWT3SXsraxGbbK4xnU4D2XtxoA8uwONZ3pQny+2gdnwlDlcjcY Uqme8Rmr4TQz3JiTgMlT2I2gUGeSNrgckDV3Q9VvFfUT+23kEIhOahL4aBVD9tsv SV3YZDkekP4qndrfxRfW5cVwsaaRX4YJZsk47mx2oakmaoFb3qGk3QGV0x9sZRhj AvXeIKu8SQkHMC6rbSJiwr34oYZl/aGA7Z/vB3iTxE3NgkyqE1WoUfxgdo1EiXTJ /i+E26VD/YJy6sWLy/usZibZMG/TJ3EM9kNmEk+23dLJbhX130Uk3A== =Md0l -----END PGP SIGNATURE-----

2 2

[Dovecot] troubleshooting new dovecot installation
by Ray 08 May '07

08 May '07

Hello, I'm setting up a new mail server using freebsd 6.2, postfix, dovecot with SASL and, eventually, squirrelmail. I've gone through http://wiki.dovecot.org/TestPop3Installation the program is running, plain works over telnet from local host or from a remote machine. I can do stat and retr commands. however, when I try to use the login method (that is what the command 1 login username password part is, isn't it?) all I get is: -ERR Unknown command. even with auth_verbose = yes auth_debug = yes, logs give no information. May 7 20:41:53 server dovecot: pop3-login: Disconnected: rip=1.2.3.4, lip=1.2.3.4 (IP's substituted) almost all of the users will be using outlook/outlook express so I'm only enabling plain and login methods. thanks Ray dovecot -n gives protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login verbose_proctitle: yes first_valid_gid: 0 mail_extra_groups: mail mail_location: maildir:/usr/local/mail/%d/%n mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login passdb: driver: pam passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: passwd userdb: driver: prefetch args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth user: postfix group: postfix master: I don't think it matters, but for the sake of formality: server# grep -v '^ *$#.*$\?$' dovecot-sql.conf driver = mysql connect = host=/tmp/mysql.sock dbname=******** user=******** password=******* password_query = SELECT md5(userpassword) AS password, home, virtual_uid AS userdb_uid, virtual_gid AS userdb_gid FROM virtual_users WHERE email = '%u' AND active = 1

3 5

Re: [Dovecot] What would you tell the CIO in an "ABCs of Email" overview?
by Kenneth Porter 08 May '07

08 May '07

Perhaps the first fundamental is that Internet email isn't handled by one kind of server. It's a suite of protocols that are served by distinct processes. At minimum, you have inbound (POP3, IMAP) and outbound (SMTP) servers. You may also have a separate authentication server (LDAP) and perhaps other pieces providing calendaring, web mail (HTTP), and central storage of client configuration (ACAP). The different protocols exist not because some programmer thought it would be cool to create a new protocol, but because they serve completely different needs. For example, POP3 was designed to support lightweight disconnected clients. IMAP provides server-based storage of mail folders. LDAP provides authentication not just for mail systems but for many other applications. (I'm sure experts for each of these protocols could provide better explanations. The RFC for each probably has a motivation section that you can quote.) An important "slide" in the presentation would show the plumbing that ties all these protocols and processes together and shows how mail moves through the system. In some cases the plumbing itself is variable. For example, spam and virus processing might occur within several servers or within a client.

1 0

[Dovecot] sieve parse error
by Matthias Kellermann 06 May '07

06 May '07

Hello everyone, I'm using Dovecot (v1.0.beta3-3ubuntu5.4 under Ubuntu) with postfix and LDA with virtual users. Everything is working fine. To filter mails I use the Dovecot Sieve feature. But I get some strange error for one simple Sieve script: ---------------------------------------------------------------------------------------------------- require "fileinto"; if header :contains ["to", "Cc", "Bcc"] ["freewrt-users(a)freewrt.org"] { fileinto "Mailinglists.FreeWRT"; stop; } elseif header :contains ["to", "Cc", "Bcc"] ["getmail(a)discworld.dnsalias.org"] { fileinto "Mailinglists.getmail"; stop; } ---------------------------------------------------------------------------------------------------- This is the error I get in mail.log: ---------------------------------------------------------------------------------------------------- May 6 15:47:08 gehirnschnecke deliver: sieve parse error for matthias(a)adminlife.net: line 8: syntax error, unexpected IF, expecting '{' ---------------------------------------------------------------------------------------------------- After studying sieve.info my sieve script should be correct. What could be wrong here? Thanks & best regards Matthias

2 2

Re: [Dovecot] sporadic slow/non response, problems copying to, sent folder
by Danno Coppock 06 May '07

06 May '07

>> symptoms: >> 1. Coming back to the idle client, and clicking on a newly arrived >> message, often a long delay (seems like minutes, sometimes) will >> occur before the message loads from the server. >> 2. Sending messages, as often as not, the client will stall, >> sometimes indefinitely, on "copying message to sent folder". >> > Does this happen when using a client which is on the same LAN as > the server? This kind of behavior looks like a network issue. > You called it. We access the server over the Internet. How did I forget to provide that small detail? However, that's not the slowness I speak of. Perhaps a better term is long delay, like waiting on some timeout, before message loadding (in symptom 1., above). So are there parameters to tune, that will make dovecot behave nicer? I do not believe this to be connectivity outages between our clients and the server. For one, we never experienced these symptoms with UW-IMAP. I just duplicated the stall on copying to Sent folder. This is probably the more prevalent, and annoying of the two problems. facts: * There was only one active client. * The client was T'bird, v1.5.0.10, running on XP. * This particular test had a 3Mb attachment. * The mail was delivered immediately to the single, remote recipient (after a ~20 seconds of 3Mb upload). * The "Copying to Sent Folder" dialog stayed up for (no exaggeration) 15-minutes, and then completed; the message is in the Sent folder now. suspicion, from months of experiencing the behavior: * Attachments are usually involved. How does the config look? Are the mbox lock settings appropriate? I was somewhat shooting in the dark there. * Sendmail 8.13.6/8.13.6 * $sudo sendmail -bt -d0.10 < /dev/null | grep HASFLOCK OS Defines: BSD4_4_SOCKADDR HASFCHOWN HASFCHMOD HASFLOCK mbox_read_locks = flock mbox_write_locks = flock What else can I provide? netstats? tcpdumps? Are there logs/debugging appropriate to enable? Thanks for any ideas, Danno

2 1

[Dovecot] Subfolders with IMAP
by Sophie Nicoud 05 May '07

05 May '07

Hello, How can I configure dovecot in order to allow subfolders on IMAP directories ? I dont find in the dovecot.conf file Thanks Sophie

2 1

[Dovecot] Method to globally limit network access
by Marcus O. White 05 May '07

05 May '07

G'day All, I am new to dovecot. I've run across the "allow_net" to restrict access on what seems like a per user basis. Is the a way to global limit access to one or more networks? Marcus O.

4 5

[Dovecot] Converting Courier mailboxes to Dovecot
by Andy Shellam 05 May '07

05 May '07

Hi, I have around 100 mailboxes (maildirs) to convert from Courier IMAP (4.1.3) to Dovecot. (From a recent backup) I've tested a few mailboxes on Dovecot 1.0.0, and while the client doesn't notice any difference (at least in Thunderbird) I'm hoping to get rid of the old Courier folders and convert any useful information they may have into Dovecot. I've tried Timo's migration script (http://www.dovecot.org/tools/courier-dovecot-migrate.pl) but it fails at line 230 with a "no file/directory" error. At that line, it appears to be finding Courier's keywords folder (courierimapkeywords), and looking for a file called ":list". However in my mailboxes, there's no file by that name, only what looks like a set of standard IMAP filenames, most of which are empty files. If I can't salvage anything useful, is there any adverse effects to me deleting all the "courier*" files/folders from each mailbox and subfolders so when the client connects back when Dovecot's running, it creates it's own UIDs and keywords etc? Thanks Andy.

2 1

[Dovecot] Help with LDAP authentication - user / user+domain
by Venilton Junior 04 May '07

04 May '07

Hello Folks, I've my dovecot working well and authenticating in my ldap servers. But I'd like configure my users to authenticate in two ways. One is just submitting the username and the other one is providing user(a)domain.com . I'm moving from a cyrus-imap solution to dovecot and I've implemented it with VD domains. But nowadays I still have one domain at my servers. So to no cause to much impact to users, I'd like to provide this two ways of authentication. Here follows my dovecot-ldap.conf: hosts = localhost dn = uid=admin,ou=administrators,ou=topologymanagement,o=netscaperoot dnpass = XXXXXX auth_bind = no ldap_version = 3 base = dc=domain,dc=com deref = never scope = subtree user_attrs = mail,homeDirectory,,,,quota=quota=maildir:storage user_filter = (&(objectClass=VirtualMailAccount)(mail=%u)(accountActive=TRUE)(delete=F ALSE)) pass_attrs = mail,userPassword pass_filter = (&(objectClass=VirtualMailAccount)(mail=%u)(accountActive=TRUE)(delete=F ALSE)) default_pass_scheme = SSHA user_global_uid = 100 user_global_gid = 101 My logs: Apr 30 13:47:58 server dovecot: auth(default_with_listener): client in: AUTH 1 PLAIN service=POP3 lip=xxx.xxx.xx.xx rip=xxx.xx.xxx.xxx resp=AGpveWNlLm1hcmlhbm8AbWFrdHVi Apr 30 13:47:58 server dovecot: auth(default_with_listener): ldap(user.test,xxx.xx.xxx.xxx): pass search: base=dc=domain,dc=com scope=subtree filter=(&(objectClass=VirtualMailAccount)(mail=user.test)(accountActive= TRUE)(delete=FALSE)) fields=mail,userPassword Apr 30 13:47:58 server dovecot: auth(default_with_listener): ldap(user.test,xxx.xx.xxx.xxx): unknown user Apr 30 13:47:59 server dovecot: auth(default_with_listener): client out: FAIL 1 user=user.test Apr 30 13:48:05 server dovecot: pop3-login: Aborted login: user=<user.test>, method=PLAIN, rip=xxx.xx.xxx.xxx, lip=xxx.xxx.xx.xx If I provide user.test(a)domain.com works fine. Any guesses or ideas? PS: I've suppressed some information, like IPs, server names e IPs Best Regards, Venilton C. Junior HP Certified Professional Sercompe Computadores Ltda. Office: +55 47 3431-9700 Fax: +55 47 3431-9747 Mobile: +55 47 9653-5872 www.sercompe.com.br <http://www.sercompe.com.br/>

2 2