- dovecot - dovecot.org

[Dovecot] Mail storage creation fails with virtual users
by Scott H. W. Snyder 30 Dec '09

30 Dec '09

So I have recently set up dovecot with a virtual users dovecot.passdb file, but when I attempt to telnet in, it fails because my virtual users don't have proper permissions to create mailboxes. I don't want to have to create actual users for each email account. Any idea as to what to do? The error that dovecot logs: dovecot: Dec 28 13:06:28 Error: IMAP(user1): mkdir_parents(/var/mail/ folders/user1) failed: Permission denied dovecot: Dec 28 13:06:28 Error: IMAP(user1): Mail storage creation failed with mail_location: mbox:/var/mail/folders/user1/:INBOX=/var/ mail/user1 dovecot: Dec 28 13:06:28 Error: child 27667 (imap) returned error 89 my [test] passdb file: user1:{PLAIN}pass1:2001:2001:User 1 Name:/var/mail/folders/user1:: mail_plugins=cmusieve user2:{PLAIN}pass2:2002:2002:User 2 Name:/var/mail/folders/user2:: mail_plugins=cmusieve user3:{PLAIN}pass3:2003:2003:User 3 Name:/var/mail/folders/user3:: mail_plugins=cmusieve user4:{PLAIN}pass4:2004:2004:User 4 Name:/var/mail/folders/user4:: mail_plugins=cmusieve Conf settings: -bash-3.2# /usr/local/sbin/dovecot -n # 1.0.13: /usr/local/etc/dovecot.conf base_dir: /usr/local/var/run/ log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot.info.log protocols: imap listen: *:143 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run//login login_executable: /usr/local/libexec/dovecot/imap-login login_greeting: Hi buddy, have an account ? max_mail_processes: 2048 verbose_proctitle: yes first_valid_uid: 1000 last_valid_uid: 5000 mail_location: mbox:/var/mail/folders/%u/:INBOX=/var/mail/%u mail_debug: yes mbox_read_locks: dotlock fcntl auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: passwd-file args: /usr/local/etc/dovecot.passdb userdb: driver: passwd-file args: /usr/local/etc/dovecot.passdb socket: type: listen master: path: /usr/local/var/run/dovecot-auth-master mode: 432 user: dovecot group: mail

2 5

[Dovecot] Problem with dovecot and PAM
by Joss Red 30 Dec '09

30 Dec '09

Hi, I keep having errors when I try to authenticate to my imap acount, and I can't get my email like this. Here are the logs when i try to authenticate using PLAIN or CRAM-MD5 : PLAIN Dec 24 22:06:25 domain dovecot: auth(default2): client in: AUTH^I1^IPLAIN^Iservice=IMAP^Isecured^Ilip=1.2.3.4^Irip=1.2.3.4^Iresp=<hidden> Dec 24 22:06:27 domain dovecot: auth(default2): pam(email(a)domain.com,1.2.3.4): pam_authenticate() failed: User not known to the underlying authentication module Dec 24 22:06:27 domain dovecot: auth(default2): client out: FAIL^I1^Iuser=email(a)domain.com Dec 24 22:06:27 domain dovecot: imap-login: Disconnected: user=<email(a)domain.com>, method=PLAIN, rip=1.2.3.4, lip=1.2.3.4, TLS CRAM-MD5 Dec 24 22:13:17 domain dovecot: auth(default): client in: AUTH^I1^ICRAM-MD5^Iservice=IMAP^Isecured^Ilip=1.2.3.4^Irip=1.2.3.4 Dec 24 22:13:17 domain dovecot: auth(default): client out: CONT^I1^IPDAxNDgyOTE1OTk5OTE0NTEuMTI2MTY4OTE5N0BzZC0xMjE5Mj4= Dec 24 22:13:17 domain dovecot: auth(default): client in: CONT<hidden> Dec 24 22:13:17 domain dovecot: auth-worker(default): sql(email(a)domain.com,1.2.3.4): query: SELECT email as user, password FROM view_users WHERE email='email(a)domain.com'; Dec 24 22:13:17 domain dovecot: auth-worker(default): password(email(a)domain.com,1.2.3.4): Requested HMAC-MD5 scheme, but we have only PLAIN-MD5 Dec 24 22:13:18 domain dovecot: auth(default): client out: FAIL^I1^Iuser=email(a)domain.com Dec 24 22:13:18 domain dovecot: imap-login: Disconnected: user=<email(a)domain.com>, method=CRAM-MD5, rip=1.2.3.4, lip=1.2.3.4, TLS Please Help me :)

2 1

[Dovecot] Upgrade 1.0->1.2 dbox mysql
by Bradley Giesbrecht 29 Dec '09

29 Dec '09

Hi, I just upgraded to from dovecot v1.1.15 to v1.2.9 so I can use dovecot- sieve. Most everything seems to work but my webmail (roundcube) clients are not seeing their subscribed folders. Reading over the upgrade docs at http://wiki.dovecot.org/Upgrading/1.2 I'm wondering if I have the two settings below configured correctly. dovecot.conf: mail_location = dbox:/opt/local/var/mail/%d/%n/dbox dovecot_mysql.conf user_query homedir result: /opt/local/var/mail/example.com/foo bash-3.2# dovecot -n # 1.2.9: /opt/local/etc/dovecot/dovecot.conf # OS: Darwin 9.8.0 Power Macintosh hfs log_path: /opt/local/var/serveza/log/mail/dovecot.log protocols: imap imaps pop3 pop3s disable_plaintext_auth: no verbose_ssl: yes login_dir: /opt/local/var/run/dovecot/login login_executable(default): /opt/local/libexec/dovecot/imap-login login_executable(imap): /opt/local/libexec/dovecot/imap-login login_executable(pop3): /opt/local/libexec/dovecot/pop3-login login_greeting: now what? mail_location: dbox:/opt/local/var/serveza/mail/%d/%n/dbox mail_debug: yes mail_executable(default): /opt/local/etc/dovecot/bin/log_imap_login.sh mail_executable(imap): /opt/local/etc/dovecot/bin/log_imap_login.sh mail_executable(pop3): /opt/local/etc/dovecot/bin/log_pop3_login.sh mail_plugin_dir(default): /opt/local/lib/dovecot/imap mail_plugin_dir(imap): /opt/local/lib/dovecot/imap mail_plugin_dir(pop3): /opt/local/lib/dovecot/pop3 lda: log_path: /opt/local/var/serveza/log/mail/dovecot-deliver.log auth_socket_path: /opt/local/var/run/dovecot/auth-master postmaster_address: postmaster(a)pixilla.com auth default: mechanisms: plain login cram-md5 ntlm apop verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /opt/local/etc/dovecot/dovecot_mysql.conf userdb: driver: prefetch userdb: driver: sql args: /opt/local/etc/dovecot/dovecot_mysql.conf socket: type: listen client: path: /opt/local/var/spool/postfix/private/auth mode: 432 user: _postfix group: _postfix master: path: /opt/local/var/run/dovecot/auth-master mode: 384 user: _vmail Thanks for any clues, Bradley Giesbrecht

3 3

[Dovecot] Install fails when libdir and libexecdir are the same directory
by River Tarnell 29 Dec '09

29 Dec '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I'm using Dovecot 1.2.9. I configured it like this: % ./configure --prefix=/opt/rt --libdir=/opt/rt/lib \ --libexecdir=/opt/rt/lib [other args...] It compiled fine, but failed to install, because it tries to install a directory called <libdir>/dovecot/imap, and a file called <libexecdir>/dovecat/imap, which obviously doesn't work when libdir and libexecdir are the same directory: gmake[5]: Entering directory `/home/river/hp-pkg/mail/dovecot/work/dovecot-1.2.9/src/plugins/imap-acl' gmake[5]: Nothing to be done for `install-exec-am'. test -z "/opt/rt/lib/dovecot/imap" || /opt/rt/bin/gmkdir -p "/home/river/hp-pkg/mail/dovecot/install/opt/rt/lib/dovecot/imap" /opt/rt/bin/gmkdir: cannot create directory `/home/river/hp-pkg/mail/dovecot/install/opt/rt/lib/dovecot/imap': File exists gmake[5]: *** [install-imap_moduleLTLIBRARIES] Error 1 As a workaround I used --libexecdir=/opt/rt/lib/dovecot/libexec, but perhaps one of the conflicting files could be moved or renamed. (On System Vish platforms, e.g. Solaris and HP-UX, 'libexec' isn't used -- files that other systems put into 'libexec' go into 'lib'.) - river. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (HP-UX) iEYEARECAAYFAks6OpgACgkQIXd7fCuc5vJ2IACfSXNKUbHi1r0mRWIvfTgl6ATk HMEAn1uAhwdFn+yQMAnAP/RrYx07wlIv =t1pG -----END PGP SIGNATURE-----

2 1

[Dovecot] multiple attribute templates?
by Mariano Absatz 29 Dec '09

29 Dec '09

Hi, I've been using an attribute template for some time without any problems. My accounts are on an LDAP server and I have an attribute maildropPath which is the maildir path for the user relative to /home/vmail That is, user "mabsatz(a)example.org" has, in attribute maildropPath the string "example.org/mabsatz", meaning that the maildir is in /home/vmail/example.org/mabsatz This is configured like this (taken from http://wiki.dovecot.org/AuthDatabase/LDAP/Userdb) user_attrs = maildropPath=mail=maildir:/home/vmail/%$ pass_attrs = uid=user,userPassword=password,maildropPath=userdb_mail=maildir:/home/vmail/%$ and it works OK. Now I want to start using sieve and, since all accounts are virtual, I want to use a subdirectory "sieve" within the maildir to hold the scripts, so I need (I think) a userdb home to point to the same path... being a monkey I tried to imitate (or rather, extend) the previous configuration like this: user_attrs = maildropPath=mail=maildir:/home/vmail/%$,maildropPath=home=/home/vmail/%$ pass_attrs = uid=user,userPassword=password,maildropPath=userdb_mail=maildir:/home/vmail/%$,maildropPath=userdb_home=/home/vmail/%$ Alas... this didn't work... that is, apparently, the "home" attribute works OK (I got my scripts on the /home/vmail/example.org/mabsatz/sieve directory), but the "mail" attribute got lost and mail is being delivered to /home/vmail/mabsatz. Is there a way to use more than one attribute template AND that both use the same LDAP attribute? Otherwise, can someone think of a better way to do what I'm trying to do? I'm using dovecot 1.1.11 from the standard ubuntu 9.04 package (dovecot-imapd_1.1.11-0ubuntu4.1). -- Mariano Absatz - "El Baby" el.baby(a)gmail.com www.clueless.com.ar -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Real programmers use: cat > a.out http://xkcd.com/378/ -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- * TagZilla 0.066 * http://tagzilla.mozdev.org

2 1

[Dovecot] Deliver EX_TEMPFAIL's without giving any information
by Denis Khromov 29 Dec '09

29 Dec '09

Hi all. I've had a hard time trying to find out why deliver isn't working after I've updated dovecot from v1.11 to v1.2.8. It just gave me EX_TEMPFAIL without any info in the logs. My deliver was setuid-root. Once I've made a simple shell wrapper script for the deliver executable which saves deliver's stdout+stderr, I've found the reason: /usr/local/libexec/dovecot/deliver must not be both world-executable and setuid-root. This allows root exploits. See http://wiki.dovecot.org/LDA#multipleuids Did a 'chmod o-x deliver' and fixed groups/owners and now everything works as it should. I think this error message should go to log files, not just to stdout/stderr. And it's worth to describe this behaviour in the Wiki. Cheers, Denis

2 1

[Dovecot] dovecot -n output of (default) is confusing me
by john.blue＠cox.net 29 Dec '09

29 Dec '09

Hello, I'm new to dovecot and I've been taking my time examining what makes dovecot work. If I have imap and pop3 listed as protocols, dovecot -n outputs: mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 I don't understand why imap is listed twice once as (default), and the other without (default). As a secondary question, why would you want a default of imap as opposed to pop3? Thanks. John

2 1

[Dovecot] Log rotation?
by Beto Moreno 29 Dec '09

29 Dec '09

Hi people. I had read dovecot logging info, they say something about using log rotation to help us rotate our log, with this setup: # dovecot SIGUSR1: Re-opens the log files. /var/log/dovecot*.log { missingok notifempty delaycompress sharedscripts postrotate /bin/kill -USR1 `cat /var/run/dovecot/master.pid 2>/dev/null` 2> /dev/null || true endscript } Well, my question is simple, Do we need to restart the service each time logrotation runs? In my case, is wrong this? var/log/dovecot*.log { weekly rotate 8 notifempty missingok copytruncate create 600 root start 0 } I have 2 dovecot logs: dovecot-info.log dovecot.log dovecot-info.log is the biggest, 5MB by week, is to much? Do I have to change our log rotation to "daily"? Centos 5.4 updated, dovecot 1.0.7-7.el5, thanks!!!

3 3

[Dovecot] Retrieve Physical Message Filename
by Tony Rutherford 29 Dec '09

29 Dec '09

Hi,Using Dovecot 1.2.9 with Maildir and Layout=FS.In a plugin, i'm overriding "update_flags":void my_mail_update_flags(struct mail *_mail, enum modify_type modify_type, enum mail_flags flags)For this email which is having its flags updated, I need to retrieve the physical filename of the message. I see where using:mail_get_special(_mail, MAIL_FETCH_UIDL_FILE_NAME, &fname);...I can retrieve part of the filename, but without the ":2" and the flags part.Is there a method I can use to get the whole filename (without having to reassemble it myself). I've looked around, and I'm guessing it exists, but I don't see it offhand.Thanks,...Tony RutherfordSoftware EngineerBlueTie Inc.arutherford(a)bluetie.com(585) 586-2000 x1040 This message is intended solely for the individual(s) to whom it is addressed. If you are not the intended recipient, any dissemination or copying is strictly prohibited. If you believe you received this message in error, please notify the sender and delete from your system. Thank you.

2 1

[Dovecot] Design: Optimizations for high-latency storage backend
by Timo Sirainen 29 Dec '09

29 Dec '09

Mainly intended for future support of key-value (etc.) databases, but this is probably useful even for regular disk I/O. By using async I/O for disk access, the OS could more intelligently do seeks on disk to read the wanted data with less latency. Problem #1: Accessing message body while searching (e.g. SEARCH BODY). The idea is that searching wouldn't block. Caller would typically use mailbox_search_next_nonblock() function, which can return "try again later" result. Whenever search sees a query that could potentially block (e.g. SEARCH BODY, or searching a header that might not be cached), it goes into a slightly different search mode: - the whole search would typically be run from beginning to end immediately, and the search result state would be stored for each message. - whenever search runs into a situation where the result can't be determined without opening message body, it issues a prefetch command for that message, marks the result for the message as "incomplete", and continues to the next message - once the search is done with all messages, it starts replying to the caller. if the next search result is incomplete at the time, the search returns "try again later". optimizations: - probably there should be prefetch limit (a queue) so that only maybe 10 requests are actually pending at a time. - probably the whole search shouldn't run immediately. maybe it should stop after having 10 requests pending. - prefetch could return only the needed parts of the message, such as "only header" or "only body" (or in future something like "message without attachments") There would be a new call, something like mailbox_search_set_nonblock_callback() that specifies a function to be called when next search result is available. The callback then would continue the search. This is similar to how IMAP SEARCH is already implemented, except currently when mailbox_search_next_nonblock() returns "try again later", Dovecot simply adds a 0 second timeout after which it's called again (that's enough for Dovecot to do some other pending work). Problem #2: Accessing index cache while searching. Cache file is typically in memory or in low-latency disk already. Anyway something similar to #1 could be implemented for it. "Make sure cache x..y bytes in cache file have been read to memory" call or something. Problem #3: Fetching message body (and uncached fields). The nice thing about lib-storage's fetching API is that the caller already specifies what fields it intends to access in mailbox_search_init(). So this code can use a similar technique than searching: - callers only use mailbox_search_next_nonblock() - which keeps returning "try again later" until the message body has been read to memory - trying to access a field that's not specified in wanted_fields in mailbox_search_init() could be (optionally) treated as a programming error and cause a crash instead of a blocking wait. Problem #4: How to drop latencies between IMAP commands? For example a (stupid) client issues commands: a FETCH 1 BODY.PEEK[] a FETCH 2 BODY.PEEK[] ..etc.. You really don't want to a delay between each command. So what Dovecot code needs to happen is to start processing the next command while waiting for previous one to finish reading the body to memory. A lot of this actually already works as intended, but there are some cases that don't, such as FETCH + SELECT (see #5). Problem #5: Opening mailbox index. So if your indexes are also stored in high-latency disk, how do you optimize getting STATUS for each mailbox? Again, a similar idea than before: Create a new mailbox_open_nonblock() function that calls a given callback function when the indexes are read to memory. During the wait it can continue processing more STATUS commands (hopefully client sends them all at once, instead of waiting for each reply before sending next STATUS). .. I think that's all of the problematic cases that could cause blocking. And the solution is always the same: Use prefetching and "try again later" status code with a callback function to be called when it's ready. Luckily there are only two functions that need the above behavior, implementing async callbacks for all functions would have made programming it horrible. The main problem will then be to optimize what and how much to prefetch. For example in the cache file case, should the cache be read to memory when mailbox is opened, or should it be delayed until something is actually wanted to be read from it? Should all of it be read, or should Dovecot attempt to be smarter to reduce memory usage and I/O bandwidth, so e.g. if the cache is wanted to be accessed to 3rd last message, maybe just read the cache file beginning from that message to EOF? Transaction log files have a similar problem. Actually all of this is similar to how Dovecot attempts to cache them to memory when using mmap_disable=yes, so it's not really a new problem.

2 2