February 2009 - dovecot

[Dovecot] Phone cannot receive mail suddenly
by Robin Atwood 02 Feb '09

02 Feb '09

Starting at midnight Feb 1 my phone can no longer fetch mail from Dovecot. It endlessly connects and reconnects as you can see in the log below. I have restarted dovecot, the phone, deleted /home/robinmail/mail, all to no avail. I have turned on debug output but it does not tell me anymore. I can connect and see the folder using the KMail imap client. Any idea how I can proceed with this? The phone is 192.168.1.57 (LAN) or 202.91.19.194 (GPRS) and Dovecot and KMail are on 192.168.1.2. Feb 1 20:12:58 opal dovecot: Dovecot v1.1.8 starting up Feb 1 20:13:41 opal dovecot: imap-login: Login: user=<robinmail>, method=PLAIN, rip=192.168.1.57, lip=192.168.1.2 Feb 1 20:13:41 opal dovecot: IMAP(robinmail): Effective uid=500, gid=100, home=/home/robinmail Feb 1 20:13:41 opal dovecot: IMAP(robinmail): mbox: data=~/mail:INBOX=/var/mail/robinmail Feb 1 20:13:41 opal dovecot: IMAP(robinmail): fs: root=/home/robinmail/mail, index=, control=, inbox=/var/mail/robinmail Feb 1 20:13:41 opal dovecot: IMAP(robinmail): Connection closed bytes=18/484 Feb 1 20:14:05 opal dovecot: IMAP(robinmail): Effective uid=500, gid=100, home=/home/robinmail Feb 1 20:14:05 opal dovecot: IMAP(robinmail): mbox: data=~/mail:INBOX=/var/mail/robinmail Feb 1 20:14:05 opal dovecot: IMAP(robinmail): fs: root=/home/robinmail/mail, index=, control=, inbox=/var/mail/robinmail Feb 1 20:14:05 opal dovecot: imap-login: Login: user=<robinmail>, method=PLAIN, rip=192.168.1.2, lip=192.168.1.2, TLS Feb 1 20:14:37 opal dovecot: IMAP(robinmail): Effective uid=500, gid=100, home=/home/robinmail Feb 1 20:14:37 opal dovecot: IMAP(robinmail): mbox: data=~/mail:INBOX=/var/mail/robinmail Feb 1 20:14:37 opal dovecot: IMAP(robinmail): fs: root=/home/robinmail/mail, index=, control=, inbox=/var/mail/robinmail Feb 1 20:14:37 opal dovecot: imap-login: Login: user=<robinmail>, method=PLAIN, rip=202.91.19.194, lip=192.168.1.2 Feb 1 20:14:39 opal dovecot: IMAP(robinmail): Connection closed bytes=18/453 Feb 1 20:14:43 opal dovecot: IMAP(robinmail): Effective uid=500, gid=100, home=/home/robinmail Feb 1 20:14:43 opal dovecot: IMAP(robinmail): mbox: data=~/mail:INBOX=/var/mail/robinmail Feb 1 20:14:43 opal dovecot: IMAP(robinmail): fs: root=/home/robinmail/mail, index=, control=, inbox=/var/mail/robinmail TIA -Robin -- ---------------------------------------------------------------------- Robin Atwood. "Ship me somewheres east of Suez, where the best is like the worst, Where there ain't no Ten Commandments an' a man can raise a thirst" from "Mandalay" by Rudyard Kipling ----------------------------------------------------------------------

2 2

[Dovecot] Differences when expire plugin and cronjob?
by Nicolas Letellier 02 Feb '09

02 Feb '09

Hello. I would like to see the differnces between the expire plugin and a cronjob which make a find/delete. Is there performances differences? What's the best to use? I use dovecot 1.1.8. Is expire plugin update the maildirsize and other indexes files? Thanks. Regards, -- -Nicolas.

4 5

[Dovecot] Dovecot-1.1.9 fails to work with Thunderbird
by David Favor 02 Feb '09

02 Feb '09

When Thunderbird starts up 1.1.8 log entries reflect: Jan 24 06:44:56 net1 dovecot: imap-login: Login: user=<yemiah(a)coolsurf.com>, method=PLAIN, rip=71.155.185.14, lip=69.94.137.124, TLS Jan 24 06:44:56 net1 dovecot: imap-login: Login: user=<david-xfer(a)coolsurf.com>, method=PLAIN, rip=71.155.185.14, lip=69.94.137.124, TLS Jan 24 06:44:56 net1 dovecot: imap-login: Login: user=<david-lf(a)coolsurf.com>, method=PLAIN, rip=71.155.185.14, lip=69.94.137.124, TLS Jan 24 06:44:56 net1 dovecot: imap-login: Login: user=<thea(a)coolsurf.com>, method=PLAIN, rip=71.155.185.14, lip=69.94.137.124, TLS When Thunderbird starts up with 1.1.9 server begins logging errors forever for every user of the form: Jan 24 06:34:29 net1 dovecot: uid specified multiple times for david-xfer(a)coolsurf.com Jan 24 06:34:29 net1 dovecot: imap-login: Internal login failure (auth failed, 1 attempts): user=<david-xfer(a)coolsurf.com>, method=PLAIN, rip=71.155.185.14, lip=69.94.137.124, TLS Jan 24 06:34:29 net1 dovecot: uid specified multiple times for david(a)coolsurf.com Jan 24 06:34:29 net1 dovecot: imap-login: Internal login failure (auth failed, 1 attempts): user=<david(a)coolsurf.com>, method=PLAIN, rip=71.155.185.14, lip=69.94.137.124, TLS Jan 24 06:34:29 net1 dovecot: uid specified multiple times for aaron(a)coolsurf.com Jan 24 06:34:29 net1 dovecot: imap-login: Internal login failure (auth failed, 1 attempts): user=<aaron(a)coolsurf.com>, method=PLAIN, rip=71.155.185.14, lip=69.94.137.124, TLS Jan 24 06:34:29 net1 dovecot: uid specified multiple times for yemiah(a)coolsurf.com Jan 24 06:34:29 net1 dovecot: imap-login: Internal login failure (auth failed, 1 attempts): user=<yemiah(a)coolsurf.com>, method=PLAIN, rip=71.155.185.14, lip=69.94.137.124, TLS Jan 24 06:34:29 net1 dovecot: uid specified multiple times for david-lf(a)coolsurf.com Jan 24 06:34:29 net1 dovecot: imap-login: Internal login failure (auth failed, 1 attempts): user=<david-lf(a)coolsurf.com>, method=PLAIN, rip=71.155.185.14, lip=69.94.137.124, TLS -- Love feeling your best ever, all day, every day? Click http://RadicalHealth.com/join for the easy way.

6 10

[Dovecot] Bug in Deliver v1.2
by Steffen Kaiser 02 Feb '09

02 Feb '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, if deliver is started with: deliver -f sender -d user (no -a option) and no Envelope-To header exists in the mail, two problems show up in this block in main(): if (destaddr == NULL) { destaddr = deliver_get_address(mail, "Envelope-To"); if (destaddr == NULL) { destaddr = strchr(user, '@') == NULL ? user : t_strconcat(user, "@", deliver_set->hostname, NULL); } } 1) deliver_get_address(mail, "Envelope-To") returns the argument of the -f option. 2) if no Envelope-To header is available, destaddr gets assigned user@hostname if user contains a domain already. Attached patches propose fixes for the problems. Bye, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iQEVAwUBSYbV5XWSIuGy1ktrAQJbKAgAut1Ix+lg2643lr6N6sSfRqkTPexloT7i MrUDE8R8wZUVxA/SpemebMOph4lIGEKlnSFA4R5a69oZIJT96ieyZ0Hsi4ueMO1c zNA3uBg3+0lo/9v7Ro7T7pPMvAsgybIrEWId0uq+YFAhNIQmqQp220cqNhzXwse/ G3UN7+BczhZS400uz88rgPzknewHr8Kl//bz7BBlPkQWhuVDRqk2sAezPQvUJqzI zzhccp2SHyFtBX3ija3Fc16uEbhTF+cmhNTvgIPDH1rmS7tcPhwFCM0HUGrBRwb2 zsn+JtHlSOl530pnO6ppyTdB7kac46RgbquFcLuLeHwBg1zdlh5ang== =xE9p -----END PGP SIGNATURE-----

2 1

[Dovecot] Config rewrite for v1.3
by Timo Sirainen 02 Feb '09

02 Feb '09

Still broken, but I committed the current changes to http://hg.dovecot.org/dovecot-config-rewrite/ The idea is something like: - src/config/ contains a doveconf binary which can be used to dump the current configuration. It's the only binary that reads dovecot.conf directly. Currently the code is kind of ugly because I wanted it to be able to parse the existing v1.2 dovecot.conf which required some kludging around. Perhaps in v2.0 the dovecot.conf could have larger changes and these kludges could be removed. - master currently executes doveconf 3 times: for default settings, for imap settings, for pop3 settings. The result is saved into an array of KEY=value pairs in an array. Eventually they're still sent to child processes via environment. This sending via environment is again mainly for backwards compatibility with post-login scripts. Although they are useful there, so I'm not sure if it should be kept that way. Although post-login scripting doesn't really work anymore with Apple's multiple-connections-per-mail-process code, so perhaps that needs some rethinking in any case.. - deliver also currently forks and executes doveconf. I hate this. But I don't like the alternative of having a libconfig that deliver could use to read the configuration inside the binary as is done now, because then it's not as easy anymore to update the doveconf binary (or replace it entirely). But I'm thinking about making doveconf a long running process and deliver could ask configuration from it via UNIX socket if it's running and fallback to forking doveconf. The last possibility would be not to fork, but instead just have doveconf exec() deliver, so either something like "doveconf -e deliver -deliver-params" or if calling deliver directly it could exec() doveconf which would then exec() deliver back. Hmm. Perhaps this is actually better than forking? - %variable expansion is somewhat broken with imap/pop3, but works with deliver. The annoying thing about this is that %vars from doveconf should be expanded, but if userdb returns anything containing %vars they shouldn't be (because e.g. home directory could contain %). So either master should expand everything internally or it should somehow tell child processes about what to expand and what not. It can't really expand everything because it doesn't know all the settings that should be expanded. So that only leaves the possibility of telling child process what to expand. One possibility is to prefix each environment with e.g. 0 or 1 specifying if it should be expanded. This would break all existing postlogin scripts and in general would make it kind of ugly. Another possibility would be to have an environment that lists the settings that shouldn't be expanded. Perhaps that would work better, although if postlogin script changes/adds environments they'd also potentially have to modify that environment too. - Plugins will probably have to keep using something similar to getenv() to get their settings. It would be possible to have them use the nice new pre-filled settings structures, but that would require configuration changes. For example instead of quota=.. quota2=.. you'd have two quota {} blocks. Probably better to leave that change to v2.0. - I'm not entirely sure where all the setting verifications should go. Having them done by master when starting up is nice because it can give error messages immediately and write them to screen, instead of having to look them up from the log. Or when reloading configuration it can cancel it if the new configuration isn't ok. Maybe doveconf could do the checks. Maybe the verifications could go to all the different *settings.c files where they logically belong to, and then the build scripts would copy those functions to doveconf code where it could check all of them when the config is being read. The only annoying thing is that this then required doveconf to be run as root so that it can do all the access() etc. checks. But maybe that's not too bad.

2 3

[Dovecot] custom imap flags in maildir don't saved after upgrade to 1.1.10
by Anton Yuzhaninov 02 Feb '09

02 Feb '09

Custom imap flags (like $label1, $label2 in mozilla TB) don't saved in maildir after upgrade to 1.1.10. In logs no errors obout this. With mailbox custom flags works OK. -- Anton Yuzhaninov

2 2

[Dovecot] mbox to maildir batch conversion
by Mike Hobbs 02 Feb '09

02 Feb '09

Hello, I'm upgrading my mail server from UW to Dovecot and I'd like to convert from mbox to maildir. I've successfully convert myself and a few other users with the mb2md script. All is well. My question is, I have somewhere around 500 users and about 122gb of mail folders to convert (this does not include the inbox at /var/mail). mb2md needs to be run as each user to convert. Are there any programs or scripts out there that will allow me to convert everyone at the same time? I know there is a Dovecot plugin to convert mail, but we didn't want to use this option. I'm sure someone on this list was in the same situation as me, how did you handle a massive conversion? Any help or suggestions is much appreciated!

3 3

[Dovecot] Dovecot changes username
by Frederick Alexander Thomssen 02 Feb '09

02 Feb '09

Hi, when I updated Dovecot from 1.1.8 to 1.1.10, it changed the username from account(a)domain.tld to account@account@domain.tld thus not authenticating. From logs: #### (Before update) Feb 1 09:45:51 count-bubba dovecot: auth(default): client in: AUTH 1 PLAIN service=imap secured lip=78.47.39.122 rip=85.177.168.174 lport=143 rport=38118 resp=<hidden> Feb 1 09:45:51 count-bubba dovecot: auth-worker(default): sql(mail(a)fathomssen.de,85.177.168.174): query: SELECT id AS user, mbox_host AS domain, passwd AS password FROM pop_access WHERE ( (id = 'mail' AND mbox_host = 'fathomssen.de') OR (id = SUBSTRING_INDEX('mail', '@', 1) AND mbox_host = SUBSTRING_INDEX('mail', '@', -1)) ) AND active = '1' Feb 1 09:45:51 count-bubba dovecot: auth-worker(default): auth(mail(a)fathomssen.de,85.177.168.174): username changed mail(a)fathomssen.de - > mail Feb 1 09:45:51 count-bubba dovecot: auth-worker(default): auth(mail,85.177.168.174): username changed mail -> mail(a)fathomssen.de Feb 1 09:45:51 count-bubba dovecot: auth(default): client out: OK 1 user=mail(a)fathomssen.de Feb 1 09:45:51 count-bubba dovecot: auth(default): master in: REQUEST 505 27174 1 Feb 1 09:45:51 count-bubba dovecot: auth-worker(default): sql(mail(a)fathomssen.de,85.177.168.174): SELECT uid, gid, home FROM pop_access WHERE ( (id = 'mail' AND mbox_host = 'fathomssen.de') OR (id = SUBSTRING_INDEX('mail', '@', 1) AND mbox_host = SUBSTRING_INDEX('mail', '@', -1)) ) AND active = '1' Feb 1 09:45:51 count-bubba dovecot: auth(default): master out: USER 505 mail(a)fathomssen.de uid=500 gid=500 home=/var/www/sites/fathomssen/fathomssen.de/Mailboxs/mail Feb 1 09:45:51 count-bubba dovecot: imap-login: Login: user=<mail(a)fathomssen.de>, method=PLAIN, rip=85.177.168.174, lip=78.47.39.122, TLS Feb 1 09:45:51 count-bubba dovecot: auth(default): new auth connection: pid=9277 #### #### (After update) Feb 1 15:23:13 count-bubba dovecot: auth(default): client in: AUTH 1 PLAIN service=imap secured lip=78.47.39.122 rip=85.177.168.174 lport=143 rport=54903 resp=<hidden> Feb 1 15:23:13 count-bubba dovecot: auth-worker(default): sql(mail(a)fathomssen.de,85.177.168.174): query: SELECT id AS user, mbox_host AS domain, passwd AS password FROM pop_access WHERE ( (id = 'mail' AND mbox_host = 'fathomssen.de') OR (id = SUBSTRING_INDEX('mail', '@', 1) AND mbox_host = SUBSTRING_INDEX('mail', '@', -1)) ) AND active = '1' Feb 1 15:23:13 count-bubba dovecot: auth-worker(default): auth(mail(a)fathomssen.de,85.177.168.174): username changed mail(a)fathomssen.de - > mail Feb 1 15:23:13 count-bubba dovecot: auth-worker(default): auth(mail,85.177.168.174): username changed mail -> mail(a)fathomssen.de Feb 1 15:23:13 count-bubba dovecot: auth(default): auth(mail(a)fathomssen.de,85.177.168.174): username changed mail(a)fathomssen.de - > mail Feb 1 15:23:13 count-bubba dovecot: auth(default): auth(mail,85.177.168.174): username changed mail -> mail@mail@fathomssen.de Feb 1 15:23:13 count-bubba dovecot: auth(default): client out: OK 1 user=mail@mail@fathomssen.de Feb 1 15:23:13 count-bubba dovecot: auth(default): master in: REQUEST 2 15962 1 Feb 1 15:23:13 count-bubba dovecot: auth-worker(default): sql(mail@mail@fathomssen.de,85.177.168.174): SELECT uid, gid, home FROM pop_access WHERE ( (id = 'mail' AND mbox_host = 'mail(a)fathomssen.de') OR (id = SUBSTRING_INDEX('mail', '@', 1) AND mbox_host = SUBSTRING_INDEX('mail', '@', -1)) ) AND active = '1' Feb 1 15:23:13 count-bubba dovecot: auth-worker(default): sql(mail@mail@fathomssen.de,85.177.168.174): Unknown user Feb 1 15:23:13 count-bubba dovecot: auth(default): userdb(mail@mail@fathomssen.de,85.177.168.174): user not found from userdb sql Feb 1 15:23:13 count-bubba dovecot: auth(default): master out: NOTFOUND 2 Feb 1 15:23:13 count-bubba dovecot: imap-login: Internal login failure (auth failed, 1 attempts): user=<mail@mail@fathomssen.de>, method=PLAIN, rip=85.177.168.174, lip=78.47.39.122, TLS #### As you see, mail(a)fathomssen.de (the correct login name) was changed to mail@mail@fathomssen.de and could not be authenticated. #### count-bubba ~ # dovecot -n # 1.1.8: /etc/dovecot/dovecot.conf # OS: Linux 2.6.28 x86_64 Gentoo Base System release 1.12.12 protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/dovecot/server.pem ssl_key_file: /etc/ssl/dovecot/server.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_location: maildir:~/Maildir mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 auth default: passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: dtc #### #### count-bubba ~ # grep -v '^ *$#.*$\?$' /etc/dovecot/dovecot-sql.conf driver = mysql connect = host=localhost port=3306 dbname=you user=get password=the_idea default_pass_scheme = PLAIN-MD5 password_query = SELECT id AS user, mbox_host AS domain, passwd AS password FROM pop_access WHERE ( (id = '%n' AND mbox_host = '%d') OR (id = SUBSTRING_INDEX('%n', '@', 1) AND mbox_host = SUBSTRING_INDEX('%n', '@', -1)) ) AND active = '1' user_query = SELECT uid, gid, home FROM pop_access WHERE ( (id = '%n' AND mbox_host = '%d') OR (id = SUBSTRING_INDEX('%n', '@', 1) AND mbox_host = SUBSTRING_INDEX('%n', '@', -1)) ) AND active = '1' #### Best regards, Freddy Thomssen -- Frederick Alexander Thomssen http://fathomssen.de mail(a)fathomssen.de

2 1

[Dovecot] v1.1.10 released
by Timo Sirainen 02 Feb '09

02 Feb '09

http://dovecot.org/releases/1.1/dovecot-1.1.10.tar.gz http://dovecot.org/releases/1.1/dovecot-1.1.10.tar.gz.sig v1.1.9 wasn't such a great release. Once again: Would be great if someone started a proper testing suite so releases could be tested.. - Maildir: Keyword handling was somewhat broken in v1.1.9 - userdb prefetch was broken with blocking passdbs in v1.1.9 - dict process didn't always die with the rest of Dovecot - dict quota was somewhat broken with pgsql

9 13

[Dovecot] cyrus's smartcieve with dovecot usable
by Michael Nausch 02 Feb '09

02 Feb '09

HI, one of my users asked me, wether smartcieve is still available after migration from cyrus to dovecot, or not. Is this possible, because smartsieve is designed for cyrus-Imapd? Or is there something similar available for maintaining the custom user rulsets by the users? ttyl, Django

2 1