- dovecot - dovecot.org

[Dovecot] Dovecot Quota + LDAP
by Venilton Junior 22 Feb '07

22 Feb '07

Hie Folks, I'm having a little problem with quota + ldap. I want to use per user quota settings. So I configured quota on my /etc/dovecot.conf like this site http://wiki.dovecot.org/Quota examples. Here follows my /etc/dovecot.conf: protocols = imap imaps pop3 pop3s ssl_disable = no ssl_cert_file = /usr/share/ssl/certs/cert.pem ssl_key_file = /usr/share/ssl/private/pkey.pem mail_extra_groups = mail valid_chroot_dirs = /var/lib/imap/vmail/domains default_mail_env = maildir:/var/lib/imap/vmail/domains/%d/%n/mail::INDEX=/var/run/dovecot/i ndexes/%n lock_method = dotlock mmap_disable = yes auth_debug = yes auth_debug_passwords = yes first_valid_uid = 202 last_valid_uid = 202 first_valid_gid = 202 last_valid_gid = 202 maildir_copy_with_hardlinks = no login_greeting = Sercomtel Internet ready. disable_plaintext_auth = no protocol imap { mail_plugins = quota imap_quota } protocol lda { postmaster_address = postmaster(a)domain.com mail_plugins = quota } protocol pop3 { pop3_uidl_format = %08Xu%08Xv mail_plugins = quota } auth default_with_listener { mechanisms = plain login userdb ldap { args = /etc/dovecot-ldap.conf } passdb ldap { args = /etc/dovecot-ldap.conf } socket listen { master { path = /var/run/dovecot/auth-master mode = 0660 user = vmail group = mail } } } plugin { # quota = maildir:/var/lib/imap/vmail/%d/%u/mail:storage=102400 # convert_mail = maildir:/var/lib/imap/vmail/%d/%u/mail #quota = maildir:storage=102400 } And here is my user attributes in my dovecot-ldap.conf: user_attrs = mail,homeDirectory,,,,quotaStorage=quota=dirsize:storage user_filter = (&(objectClass=VirtualMailAccount)(mail=%u)(accountActive=TRUE)(delete=F ALSE)) As you can see above in my dovecot.conf, I made a comment at plugin section to ensure that there's no quota usage for all system. I'd like to have per user quota stored in my ldap base. Here is a value off my quota attribute: quota = 122880 Making tests, the user already have 138 Mb. Does anyone have any idea how to set up quota with ldap and get it working? Tnx for any reply. Best regards, Venilton C. Junior

1 0

[Dovecot] login and plain-md5 in sql query
by Adrian Stoica 22 Feb '07

22 Feb '07

i use last dovecot rc23 with users/passwords in mysql 1) How can i define a sql query for each auth mechanism ? 2)Why i can't set "default_pass_scheme = login" in my dovecot-sql.conf? : dovecot: Feb 21 09:46:22 Info: auth(default): client in: AUTH 1 PLAIN service=IMAP secured lip=127.0.0.1 rip=127.0.0.1 resp=AGFkaUBhZHJpYW4uZXUAcGFyb2xh dovecot: Feb 21 09:46:22 Info: auth-worker(default): sql(adi(a)adrian.eu,127.0.0.1): query: SELECT IF('adrian.eu'='',clear,crypt) AS password , user FROM mailbox WHERE user = 'adi' AND domain = 'adrian.eu' AND status = '1' LIMIT 1 dovecot: Feb 21 09:46:22 Info: auth-worker(default): auth(adi(a)adrian.eu,127.0.0.1): username changed adi(a)adrian.eu -> adi dovecot: Feb 21 09:46:22 Error: auth-worker(default): sql(adi,127.0.0.1): Unknown password scheme login dovecot: Feb 21 09:46:23 Info: auth(default): client out: FAIL 1 user=adi(a)adrian.eu dovecot: Feb 21 09:46:23 Info: imap-login: Disconnected: user=<adi(a)adrian.eu>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured 3)Whi i can't use plain-md5 in dovecot.conf : auth default { mechanisms = login plain <- plain-md5 passdb sql { args=/etc/dovecot-sql.conf } userdb sql { args=/etc/dovecot-sql.conf } } dovecot: Feb 21 09:43:48 Error: auth(default): Unknown authentication mechanism 'plain-md5'

2 1

[Dovecot] pop3_lock_session
by Rene Luria 22 Feb '07

22 Feb '07

Hi guys, How can I modify the timeout value for the pop3_lock_session ? I'd like it to be much bigger.

2 4

[Dovecot] crash in mail_cache_transaction_reset on rc22
by Dan Price 22 Feb '07

22 Feb '07

I've not been able to roll out rc23 yet (tonight, I hope) but I just saw a crash which I'm not sure I've seen reported before, following a server outage (that is to say, the server came back up and one of the users had a dovecot core). #0 0x0005d720 in mail_cache_transaction_reset (ctx=0xcf928) at mail-cache-transaction.c:71 No locals. #1 0x0005e8bc in mail_cache_add (ctx=0xcf928, seq=233, field=4294967295, data=0xb7600, data_size=1063) at mail-cache-transaction.c:752 file_field = 19 data_size32 = 1063 fixed_size = 4294967295 full_size = 831272 __PRETTY_FUNCTION__ = "mail_cache_add" #2 0x00057160 in index_mail_parse_header (part=0xe9, hdr=0x14, mail=0xd33e8) at index-mail-headers.c:125 data = (struct index_mail_data *) 0xd3450 cache_field_name = 0xe9 <Address 0xe9 out of bounds> field_idx = 0 count = 21 match = (uint8_t *) 0xcf928 "" __PRETTY_FUNCTION__ = "index_mail_parse_header" #3 0x00079848 in _read (stream=0xe2aa0) at istream-header-filter.c:173 ret = 0 pos = 854336 #4 0x00085818 in i_stream_read (stream=0xe2ac8) at istream.c:58 _stream = (struct _istream *) 0xcaf28 #5 0x00085ca4 in i_stream_read_data (stream=0xe2ac8, data=0xffbff5ec, size=0xffbff5e8, threshold=1) at istream.c:250 ret = 0 read_more = false #6 0x0007e8c4 in message_get_body_size (input=0xe2ac8, body=0xffbff660, has_nuls=0x0) at message-size.c:105 msg = ( const unsigned char *) 0xe2cf7 "\ndary_(ID_/CFD74Co3EWCZqYkdHlE8A)\"\r\nt>\r\nSS(a)cox.net>,\r\nil.com>,\r\n\r\n" i = 0 ---Type <return> to continue, or q <return> to quit--- size = 1 missing_cr_count = 0 __PRETTY_FUNCTION__ = "message_get_body_size" #7 0x0002e5e4 in fetch_body_header_fields (ctx=0xc6a08, mail=0xffbff660, context=0xc6c98) at imap-fetch-body.c:448 size = {physical_size = 1357, virtual_size = 0, lines = 26} old_offset = Unhandled dwarf expression opcode 0x93 -- Daniel Price - Solaris Kernel Engineering - dp(a)eng.sun.com - blogs.sun.com/dp

2 1

[Dovecot] Understanding fcntl() error messages
by Dean Manners 22 Feb '07

22 Feb '07

Hey guys, After many trials and tribulations I have now got some fairly stable NFS clients serving dovecot-lda and pop3/imap. Over a 9 hour postal/rabid stress test only saw 5 errors for the 4 servers. Wondering if anyone can shed a bit more light on what they mean exactly. I have tried to find "Resource temporarily unavailable" and "No locks available" in the src to get some understanding - however it appears these messages are from a lower level. With pop3: ------------------ Feb 22 03:36:32 mailget01 dovecot: POP3(test992(a)mailtest06.com): fcntl() failed with file /mnt/mailstore/mailtest06.com/8/test992/dovecot.index.log: Resource temporarily unavailable Feb 22 03:36:32 mailget01 dovecot: POP3(test992(a)mailtest06.com): mail_index_wait_lock_fd() failed with file /mnt/mailstore/mailtest06.com/8/test992/dovecot.index.log: Resource temporarily unavailable Feb 22 04:16:45 mailget01 dovecot: POP3(test445(a)mailtest03.com): fcntl() failed with file /mnt/mailstore/mailtest03.com/4/test445/dovecot.index.log: Resource temporarily unavailable Feb 22 04:16:45 mailget01 dovecot: POP3(test445(a)mailtest03.com): mail_index_wait_lock_fd() failed with file /mnt/mailstore/mailtest03.com/4/test445/dovecot.index.log: Resource temporarily unavailable ------------------ ------------------ Feb 22 13:07:27 mailget01 dovecot: POP3(test999(a)mailtest06.com): fcntl() failed with file /mnt/mailstore/mailtest06.com/8/test999/dovecot.index: Resource temporarily unavailable Feb 22 13:07:27 mailget01 dovecot: POP3(test999(a)mailtest06.com): fcntl() failed with file /mnt/mailstore/mailtest06.com/8/test999/dovecot.index: Resource temporarily unavailable Feb 22 13:07:27 mailget01 dovecot: POP3(test999(a)mailtest06.com): Couldn't open INBOX: Internal error occurred. Refer to server log for more information. [2007-02-22 13:07:27] Feb 22 13:07:27 mailget01 dovecot: POP3(test999(a)mailtest06.com): No INBOX for user top=0/0, retr=0/0, del=0/0, size=0 ------------------ Does this mean that pop3 was waiting for a lock, but timed out ? What are the likely affects of this on a client POPing - session times out and they need to reconnect? The "No INBOX" error is little more odd, the same user had successful login 90 minutes earlier. With deliver: ------------------ Feb 22 01:42:03 mailfilter01 deliver(test680(a)mailtest04.com): fcntl() failed with file /mnt/mailstore/mailtest04.com/10/test680/dovecot.index: No locks available Feb 22 01:42:06 mailfilter01 deliver(test265(a)mailtest03.com): fcntl() failed with file /mnt/mailstore/mailtest03.com/1/test265/dovecot.index: No locks available Feb 22 03:25:42 mailfilter02 deliver(test454(a)mailtest03.com): fcntl() failed with file /mnt/mailstore/mailtest03.com/2/test454/dovecot.index: No locks available Feb 22 03:25:45 mailfilter02 deliver(test397(a)mailtest03.com): fcntl() failed with file /mnt/mailstore/mailtest03.com/7/test397/dovecot.index: No locks available ------------------ I assume this means deliver tried to obtain a lock on the index file (probably many times) but failed. Are the likely affects that the message still gets saved to the maildir but the index doesn't get updated? Regards __________________________________________ Dean Manners

2 2

[Dovecot] critical performance problem
by Rene Luria 22 Feb '07

22 Feb '07

I have been using dovecot 1.0alpha4 + deliver/sieve in production for a few accounts (400'000). After testing 1.0.rc22 I decided to upgrade one of the imap servers... And... what a mess ! The server just gets unusable. I don't know why but with new release, it just overloads the system with I/O. It turns that with 1.0.rc22 I get 15Mo/s read on disk average, without any reason. What did really change ? How come a system (with a few thousand accounts) works perfectly and then with 1.0.rc22 gets unusable with a load approaching 300 ? If you have any ideas...

5 18

[Dovecot] 1.0.rc23 tomorrow
by Timo Sirainen 22 Feb '07

22 Feb '07

http://dovecot.org/nightly/dovecot-latest.tar.gz Would be nice to get some testing before the actual release. I've now finally gone through all the "TODO" mails in this list and my INBOX and fixed pretty much every problem I know of. There are still some mbox bugs, but I can't really get them fixed unless someone figures out how to reproduce them (http://wiki.dovecot.org/MboxProblems) I think documentation is the last thing that should be done before v1.0. I'm happy enough with the code as it is now, unless some new bugs again appear. The notable changes since rc22: * deliver doesn't ever exit with Dovecot's internal exit codes anymore. All its internal exit codes are changed to EX_TEMPFAIL. + PAM: blocking=yes in args uses an alternative way to do PAM checks. Try it if you're having problems with PAM. + userdb passwd: blocking=yes in args makes the userdb lookups be done in auth worker processes. Set it if you're doing remote NSS lookups (eg. nss_ldap problems are fixed by this). + If PAM child process hasn't responded in two minutes, send KILL signal to it (only with blocking=no) - IMAP: APPEND ate all CPU while waiting for more data from the client (broken in rc22) - mbox: When saving a message to an empty mbox file it got one UID which immediately was incremented. - mbox: Fixed some wrong "uid-last unexpectedly lost" errors. - auth cache: In some situations we crashed if passdb had extra_fields. - auth cache: Special extra_fields weren't saved to auth cache. For example allow_nets restrictions were ignored for cached entries. - A lot of initial login processes could cause auth socket errors in log file at startup, if dovecot-auth started slowly. Now the login processes are started only after dovecot-auth has finished initializing itself. - imap/pop3 proxy: Don't crash if the remote server disconnects before we're logged in. - deliver: Don't bother trying to save the mail twice into the default mailbox (eg. if it's over quota). - mmap_disable=yes + non-Linux was really slow with large dovecot.index.cache files - MySQL couldn't be used as a masterdb - Trash plugin was more or less broken - imap/pop3 couldn't load plugins if they chrooted - imap/pop3-login process could crash in some conditions - checkpassword-reply crashed if USER/HOME wasn't set

6 19

[Dovecot] --log-error and the mysterious "not starting" problem
by Marshal Newrock 22 Feb '07

22 Feb '07

I've finally upgraded to 1.0.rc21. If I run "dovecot --log-error", then dovecot fails to start. The following appears in the log: Feb 5 10:54:00 taurus1 dovecot: Dovecot v1.0.rc21 starting up Feb 5 10:54:00 taurus1 dovecot: This is Dovecot's error log Without --log-error, it will start up fine from command-line. Dovecot still fails to start, as near as I can tell, in the specific condition that it is being started from a non-interactive shell and there is a mail_plugin set in "protocol imap". mail plugins set for pop or lda do not cause this problem. The failure to start appears in only two instances that I can see: on boot, or by a monitoring script if dovecot crashes, or, since I haven't seen dovecot die, when I manually stop it to see if the monitoring program will restart it. With the above problem, if the init script has --log-error when I try to make the monitoring program restart dovecot, then nothing still gets logged. -- Marshal Newrock, Ideal Solution LLC http://www.idealso.com

2 8

[Dovecot] False "new mail" warning from Thunderbird, using RC23
by Stephen Warren 21 Feb '07

21 Feb '07

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I am continually getting false "New Mail" warning from Thunderbird. I'm running Thunderbird 1.5.0.9 on Windows, and it's talking to two different Dovecot 1.0.RC23 servers (one home server, one work server). This was happening in older Dovecot versions too, so it's not new in RC23. Very often, Thunderbird will pop up the "new mail" notification window, and put a "new mail" icon in the Windows icon bar. However, when I view the main Thunderbird window, there will be no folders with new mail. Simply changing the currently selected folder in Thunderbird will clear the tray icon. Sometimes the notification window will say something small like "7 new messages", but right now, it's showing huge numbers like "587 new messages", which could be the total message count in one of my folders... Sometimes restarting Thunderbird will stop this happening for a short while. Is this a Thunderbird bug? Am I the only one seeing this? Does it have to do with having two separate IMAP servers configured? Perhaps it's because Thunderbird is configured to cache 5 connections to the server (although I think that's the default?) Should I delete all my accounts in Thunderbird, delete the (Thunderbird) cache files etc. on disk, and re-create it all? I do notice that whenever Thunderbird starts, it displays a whole load of folders that don't exist (e.g. got renamed/deleted) and/or multiple copies (e.g. Sent, Sent-1, Sent-2), which disappear very quickly. Is this related? -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFF2+eJhk3bo0lNTrURAh9uAKCWYrcNByF+wE2e1FPvL6x8N48/uACgtwxR 07fYmnaG9P/JCBOkKscCZIA= =XWXG -----END PGP SIGNATURE-----

2 1

[Dovecot] auth_user setting?
by Joseba Torre 21 Feb '07

21 Feb '07

Hi all, I've installed rc23 in a new testing machine, and i've had some permission problems related to dovecot-master.conf. As I have my master passwords in that file, I don't want it to be world readable. dovecot -n shows that auth_user is nobody, so setting the permissions to nobody.whatever 640 solves the problem. Anyway, I've tried to change the auth_user setting with no effect. Is it configurable? Aaaaaaaaaagur. -- Joseba Torre. CIDIR Bizkaia.

1 1

[Dovecot] Wrong configure.in entry in CVS branch_1_0
by Luca Corti 21 Feb '07

21 Feb '07

This line in configure.in src/plugins/mail-log/Makefile refers to a non existing direcory in the branch_1_0 tree, which breaks build. ciao Luca

3 2

[Dovecot] Possible Bug in quota-fs.c
by Martin Konopka 20 Feb '07

20 Feb '07

Hi, I'm using filesystem quotas with dovecot 1.0rc22 on my Linux 2.4.27 box. The quota limit gets correctly reported in kilobytes to the client but the amount of used space is reported in megabytes. In quota-fs.c I noticed that only the currently used space is divided by 1024: Line 241: *value_r = dqblk.dqb_curblocks / 1024; *limit_r = dqblk.dqb_bsoftlimit; After removing /1024 everything works fine. regards, Martin

3 4

[Dovecot] Convert plugin
by Jay Chandler 20 Feb '07

20 Feb '07

convert_mail = mbox:%h/mail Convert plugin. If set, specifies the source storage path which is converted to destination storage (mail_location) when the user logs in. The existing mail directory is renamed to <dir>-converted. I'm not entirely clear on what this does. If someone can clarify for me, I'll update the Wiki. I'm hoping it'll allow me to convert from mbox to Maildir-- otherwise I'm looking at a weekend of downtime when that project comes due... -- Jay Chandler Network Administrator, Chapman University 714.628.7249 / chandler(a)chapman.edu Today's Excuse: high pressure system failure

2 1

[Dovecot] Reading mail for Virtual and Real LDAP Users
by Aaron Luchko 20 Feb '07

20 Feb '07

I'm trying to setup a system with ldap+postfix+dovecot. Everyone who gets an email is stored in LDAP, some of these users also have a local unix account, regardless I want all users to be dealt with as virtual users. All the mail is stored by postfix in /var/spool/mail in Maildir format with permissions 600 vmail:vmail. Everything works fine when dovecot tries to read the mail of a completely virtual user, the problem is when dovecot tries to read mail for a user who has an account on the machine, dovecot finds the user's local account, then it tries to read the mail as that user. Even if first_valid_{u,g}id is low enough to allow login the user still doesn't have sufficient permissions to read the mail. I can't figure out why this is happening and was hoping someone could help me out. thanks, Aaron /etc/dovecot-ldap.conf: hosts = server.example.com base = dc=example,dc=com dn = cn=Directory Manager dnpass = password uris = ldap://127.0.0.1 user_attrs = mail user_filter = uid=%u user_global_uid = 5001 user_global_gid = 5001 pass_filter = uid=%u /etc/dovecot.conf: mail_location = maildir:/var/spool/mail/%u/ protocols = imap pop3 mail_log_prefix = "%Us(%u):%i:%h " first_valid_uid = 5001 first_valid_gid = 5001 protocol imap { } protocol pop3 { } protocol lda { postmaster_address = postmaster(a)example.com } auth_verbose = yes auth_debug = yes auth default { mechanisms = plain passdb pam { } userdb passwd { } userdb ldap { args = /etc/dovecot-ldap.conf } passdb ldap { args = /etc/dovecot-ldap.conf } user = root } dict { } plugin { }

2 2

[Dovecot] NTLM oddities
by Cassidy B. Larson 20 Feb '07

20 Feb '07

Started implementing the MasterUser changes to my config files so I can finally offer SPA for pop3/imap. Things are working fine with the MasterUser (horray!), however one of my guys started using SPA with Outlook Express and started getting another users mailbox. Turns out to be related to NTLM. His Outlook express is configured for the username of 'johnsmith'. However, you'll see the NTLM took the username from his XP machine login, it appears, which is just "John". However, what is really weird, is the "failed" on the "client out" line, but then the proxy went ahead and proxied to the storage server. Here's some output from debuggage: dovecot: Feb 19 16:15:56 Info: auth(mail.infowest.com): client in: AUTH 1 NTLM service=POP3 lip=204.17.177.60 rip=209.33.215.142 resp= dovecot: Feb 19 16:15:56 Info: auth(mail.infowest.com): client out: CONT 1 dovecot: Feb 19 16:15:56 Info: auth-worker(mail.infowest.com): sql(John, 209.33.215.142): query: SELECT a.clearpasswd AS password, v.storeIP AS host, CONCAT(IF('John' LIKE '%(a)%.%',CONCAT(LCASE('John'),''),CONCAT(LCASE('John'),'@',p.host)),'*masteruser') AS destuser, 'Y' AS nologin, 'Y' AS nodelay, 'Y' AS proxy, 'masterpass' AS pass FROM iwmailsystem.virtmailbox AS v INNER JOIN iwmailsystem.popserversAS p ON ( p.storeIP = '204.17.177.60') INNER JOIN authenticate.users AS a ON (a.userID= IF('John' LIKE '%(a)%.%',CONCAT(LCASE('John'),''),CONCAT(LCASE('John'),'@', p.host))) WHERE v.userID = IF('John' LIKE '%(a)%.%',CONCAT(LCASE('John'),''),CONCAT(LCASE('John'),'@',p.host)) AND v.client_active=1; dovecot: Feb 19 16:15:56 Info: auth(mail.infowest.com): password(John, 209.33.215.142): Credentials: 8447128CC04AD05D1CD15F0C2F17F136 dovecot: Feb 19 16:15:57 Info: auth(mail.infowest.com): client out: FAIL 1 user=John host=204.17.177.76 destuser= john(a)host.com*masteruser nologin proxy pass=masterpass dovecot: Feb 19 16:15:57 Info: pop3-login: proxy(John): started proxying to 204.17.177.76:110: user=<John>, method=NTLM, rip=209.33.215.142, lip= 204.17.177.60 Questions: 1) So is it possible to use OE for SPA authentication without it sending the "XP username", but the actual account username OE is configured for ? 2) Why, when it "FAIL"ed did it still proxy? This seems bad :) Thanks, Cassidy

3 3

[Dovecot] rc22 segv when over quota
by Steffen Kaiser 20 Feb '07

20 Feb '07

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, I just pulled and built version 1.0.rc22 root@ux-2s11-9:/mnt/mailcache/dvtest/MailDir# dovecot -n # /usr/local/etc/dovecot.conf log_path: /var/tmp/dovecot.log info_log_path: /var/tmp/dovecot.info ssl_disable: yes disable_plaintext_auth: no verbose_ssl: yes login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login verbose_proctitle: yes mail_location: maildir:/mnt/mailcache/%u/MailDir:CONTROL=/var/cache/dovecot/%i/control:INDEX=/var/cache/dovecot/%i/index mail_debug: yes mail_plugins: quota imap_quota auth default: mechanisms: plain login cache_size: 10 verbose: yes debug: yes debug_passwords: yes passdb: driver: pam args: cache_key=%u dovecot userdb: driver: passwd On Linux Debian Etch on Debian kernel v2.6.18; tested with XFS and Extended3. repquota /mnt/mailcache *** Report for user quotas on device /dev/mapper/mailstaff-mailcache Block grace time: 7days; Inode grace time: 7days Block limits File limits User used soft hard grace used soft hard grace - ---------------------------------------------------------------------- dvtest -- 560 600 1024 17 0 0 Then I copy messages in a directory via Thunderbird, the log shows: dovecot: Feb 20 12:12:27 Error: IMAP(dvtest): o_stream_send_istream(/mnt/mailcache/dvtest/MailDir/.test/tmp/1171969947.P22138Q3.ux-2s11-9) failed: Resource temporarily unavailable dovecot: Feb 20 12:12:27 Error: child 22138 (imap) killed with signal 11 - -or- dovecot: Feb 20 12:09:42 Error: IMAP(dvtest): o_stream_send_istream(/mnt/mailcache/dvtest/MailDir/.test/tmp/1171969782.P22134Q6.ux-2 s11-9) failed: Disk quota exceeded dovecot: Feb 20 12:09:42 Error: child 22134 (imap) killed with signal 11 and repquota /mnt/mailcache dvtest +- 616 600 1024 6days 20 0 0 The Thunderbird continues to copy other messages believing everthing is OK. There is also this message on the screen (started via dovecot -F): dm-1: write failed, user block limit reached. Bye, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iQEVAwUBRdr0Vy9SORjhbDpvAQIKfwgA0vONUFwD5nZ1iOb0z+bRf2Kxz9/9r6QE yqZ/iL6FylJMDQwNi9hY3EbzIbu+pEs3SJrz3VVKuWO7bVyhVTFpxQaSS8vBokXo 6cnLuG5V+n3jtyqy26lM1VQWDCifEY/++YAs/KmJ5NQHm0mk5bUEc6fhDeL4D6MJ UcKUBrQ8S2B6vJMBQfcabgnC8KR9kh+xvvUtvlnsfpoaInAKx8x4r1S+9mMjbAEv lIjHt+yavW6Hlq+HmVCirTddesy1rQDFiDSrrV9F8Sp43GpxHyjun9iK6CGrQkJf AO4o2DsBIbBrhvyUrzUks1dR8ZHasyBQDuMVG02/s1bM3UIkJVX3RA== =/MmG -----END PGP SIGNATURE-----

2 2

[Dovecot] Apple Mail/Tiger Bug came up on the pf mailing list. . .
by Sean Kamath 20 Feb '07

20 Feb '07

Hi all, Just FYI, this post showed up on the pf mailing list a couple of days ago: Cc: pf(a)benzedrine.cx From: Axel Rau <Axel.Rau(a)Chaos1.DE> Subject: Re: mismatch on route through packet/byte counts Date: Sun, 18 Feb 2007 14:37:56 +0100 To: Daniel Hartmeier <daniel(a)benzedrine.cx> X-Mailer: Apple Mail (2.752.2) Content-Transfer-Encoding: 8bit X-MIME-Autoconverted: from quoted-printable to 8bit by insomnia.benzedrine.cx id l1IDc2fg029064 Sender: owner-pf(a)benzedrine.cx Thank you, Daniel, for taking the time to analyze my traces and to explain the problem so perfect, that even non-net-developers, like I, can understand it. (-;) > > This looks like a bug in the client's TCP/IP stack, and how to fix it > depends on the client's OS. IMO, the RST is invalid, and pf is > right in > blocking it. The OS is Darwin 8.8 / Mac OS X 10.4.8, a 4.4BSD descendant and the relevant source may be in netinet/tcp_output.c, found here http://www.opensource.apple.com/darwinsource/10.4.8.ppc/xnu-792.12.6 Good news is that your diagnosis could bring us forward to resolve a long running painful bug filed against Mail.app, the Apple email client. If you agree, I would like to add your diagnosis to my open bug report and cross-post the mail on the Darwin Developers list, before filing a new bug against Darwin. Axel --------------------------------------------------------------------- Axel Rau, â˜€Frankfurt , Germany +49 69 9514 18 0

1 0

[Dovecot] relocating indexes.
by Rob Shepherd 20 Feb '07

20 Feb '07

Dear Dovecot users, I'd like to relocate indexes from NFS to local storage. I plan to replace... default_mail_env = maildir:~/.maildir with mail_location = maildir:~/.maildir:INDEX=/usr/local/var/dovecot/index/%u However, to minimise disruption, by avoiding dovecot rebuilding indexes for many user's large and numerous folders, I'd like to copy the existing indexes to the new location. Here is a list of _my_ indexes (in and under ~/.maildir) ./.Drafts/dovecot-uidlist ./.Drafts/dovecot.index ./.Drafts/dovecot.index.cache ./.Drafts/dovecot.index.log ./.OpenLDAP/dovecot-keywords ./.OpenLDAP/dovecot-uidlist ./.OpenLDAP/dovecot.index ./.OpenLDAP/dovecot.index.cache ./.OpenLDAP/dovecot.index.log ./.OpenLDAP/dovecot.index.log.2 ./.Sent/dovecot-keywords ./.Sent/dovecot-uidlist ./.Sent/dovecot.index ./.Sent/dovecot.index.cache ./.Sent/dovecot.index.log ./.Trash/dovecot-keywords ./.Trash/dovecot-uidlist ./.Trash/dovecot.index ./.Trash/dovecot.index.cache ./.Trash/dovecot.index.log ./.mailscanner/dovecot-keywords ./.mailscanner/dovecot-uidlist ./.mailscanner/dovecot.index ./.mailscanner/dovecot.index.cache ./.mailscanner/dovecot.index.log ./.mailscanner/dovecot.index.log.2 ./.nagios/dovecot-keywords ./.nagios/dovecot-uidlist ./.nagios/dovecot.index ./.nagios/dovecot.index.cache ./.nagios/dovecot.index.log ./.samba/dovecot-keywords ./.samba/dovecot-uidlist ./.samba/dovecot.index ./.samba/dovecot.index.cache ./.samba/dovecot.index.log ./.samba/dovecot.index.log.2 ./.sw-announce/dovecot.index ./.sw-announce/dovecot.index.cache ./.sw-announce/dovecot.index.log ./dovecot-keywords ./dovecot-uidlist ./dovecot.index ./dovecot.index.cache ./dovecot.index.log ./dovecot.index.log.2 Would I be correct in copying these to /usr/local/var/dovecot/index/rob/ (_my_ new index loc) whilst preserving the structure of the folders etc. Thanks Rob -- Rob

4 3

[Dovecot] startup script under FreeBSD 6.2 / dovecot-1.0rc22
by Alexis Susset 20 Feb '07

20 Feb '07

Hi all, I recently installed Dovecot rc22 from the FreeBSD ports and I have some problem with the dovecot startup: - If I start dovecot manually, it works fine, it starts and I get messages in /var/log/maillog - If I reboot the machine, that's where the problem appears, dovecot doesn't seem to start and I get nothing, no errors in /var/log/maillog Any idea if this is a known problem and how to fix it ? Thanks in advance, Regards, -- Alexis

4 5

[Dovecot] Run fetchmail after login?
by Brett B. 20 Feb '07

20 Feb '07

Hello all, I was wondering if it is possible to run fetchmail after a user logs into dovecot? So far I have tried to make a small script that contains the command for fetchmail. Then I told the dovecot mail_executable to look at that script. However this ends up leaving the server hanging and does not seem to work. Thanks

2 1

[Dovecot] Dovecot losing .mailboxlist files
by Lauri Jesmin 20 Feb '07

20 Feb '07

Hello! I am running a site that has two servers, 10 000 users in both, Solaris 9 and home directories with mbox mailboxes shared with NFS. Indexes are kept separately in both server, on local disks, both servers are serving imap (from NFS mboxes). We are trying to convert from uw-imap to dovecot. Servers are currently running on their limits and now i have mysterious problems with .mailboxlist file: i patched dovecot to use .mailboxlist file instead of .subscriptions, but sometimes the .mailboxlist file disappears on some users. Instead there are appearing .nfsXXXXXX files, where XXXXXX is combination of numbers and capital letters. Also some users have problems with subscribing to folders, others do not have this problem. It seems to be that users who do not have .mailboxlist have also problems with subscribing to folders. Dovecot is version 1.0rc22. I have not discovered error messages in logs. -- Lauri Jesmin <lauri.jesmin(a)ut.ee> Tartu Ülikool

2 1

[Dovecot] mbox assert crashes finally fixed?
by Timo Sirainen 20 Feb '07

20 Feb '07

Patch: http://dovecot.org/list/dovecot-cvs/2007-February/007760.html Nightly snapshot should be ready in a few minutes. I'll release rc23 tomorrow. Night.

1 0

[Dovecot] Weird Issues with latest nightly (pre-rc23)
by Cassidy B. Larson 20 Feb '07

20 Feb '07

Just updated one of my proxy boxes to the latest nightly (20070217), restarted the dovecot process and got a bit of errors showing up for each pop3/imap connection. Feb 19 11:14:00 marbella dovecot: pop3-login: Login: user=<user1(a)host.com>, method=PLAIN, rip=209.33.217.218, lip=204.17.177.60 Feb 19 11:14:00 marbella dovecot: POP3(user1(a)host.com): Set pop3_uidl_format in config file Feb 19 11:14:00 marbella dovecot: child 33684 (pop3) returned error 89 Feb 19 11:14:04 marbella dovecot: imap-login: Login: user=<user2(a)host.com>, method=PLAIN, rip=204.17.177.50, lip=204.17.177.60 Feb 19 11:14:04 marbella dovecot: IMAP(user2(a)host.com): mbox: Can't create root mail directory /dev/null/mail: Not a directory Feb 19 11:14:04 marbella dovecot: IMAP(user2(a)host.com): MAIL environment missing and autodetection failed (home /dev/null) Feb 19 11:14:04 marbella dovecot: child 33753 (imap) returned error 89 On the pop3 errors above. Why should I have a pop3_uidl_format in the config file for the proxy? This was working fine on rc19. I do have a pop3_uidl_format on my storage boxes. Same with the imap section. It should just proxy over (and is on rc19), the proxy shouldnt have to know about the mail directory. Am I the only one seeing this? Or have I missed a config change that is required? thanks, Cassidy

2 2

[Dovecot] Dovecot authentication problem
by Marion Keith 20 Feb '07

20 Feb '07

Hi all, New SUSE 10.2 install, Sendmail, dovecot 1.0.rc14-7 SUSE rpm. Was using PAM for authentication. Worked like a champ since Feb 7th. No changes to system. Yesterday authentication failed. I can't even authenticate locally with "telnet localhost" options to test pop3 or imap. It appears that my pam authentication has somehow gotten changed. Can anyone direct me to some PAM debugging help? Thanks, Marion

1 0

[Dovecot] LDAP auth load? (looking for advice)
by Troy Engel 19 Feb '07

19 Feb '07

One of the changes my beta testers are testing is switching from NIS to LDAP for login/auth/homedir lookups; all is working perfectly, Dovecot + PAM/nss_ldap is A-OK. No issues here, we've been using LDAP lookups on other servers for years. I'm wondering about load, specifically if when I switch the entire company over, will the new authentication load stress my LDAP server to the point of breaking. A) Does anyone here have some numbers or experience in this switch that could lend some real-world advice? We're talking maybe... 50 people with large (numerically, not gig-age) mailboxes, and ThunderBird seems to open 4-5 connections per client based on the logs. B) Would anyone advise that I run a slapd slave directly on the main Dovecot server to alleviate load? Is this overkill and I shouldn't worry about it? Mainly what has me concerned is that on the Dovecot machine, I'm getting a number of entries in the messages that look like: dovecot-auth: nss_ldap: reconnecting to LDAP server... dovecot-auth: nss_ldap: reconnected to LDAP server after 1 attempt(s) No failures ever, it all just works. But still this tickles my brain that maybe it'll need more robustness come production time. Thanks for your feedback, -te -- Troy Engel | Systems Engineer Fluid Inc. | http://www.fluid.com

5 5

[Dovecot] repeat downloads of message headers in 1.0rc19
by Brian G. Peterson 19 Feb '07

19 Feb '07

I upgraded one server to 1.0rc19 (from rc15) over the weekend, and have since received several reports of dovecot erroneously retrieving older messages as new mail. I've seen this myself intermittently on KMail, and users have reported it on Thunderbird, Squirrelmail, and Outlook. I see some things in the archives that suggest that this was a problem in older 1.0 release candidates, but hadn't experienced the problem myself until just now. Has anyone else seen this problem? Regards, - Brian

5 14

[Dovecot] wrong dovecot GID while upgrading
by Zbigniew Szalbot 18 Feb '07

18 Feb '07

Hello, I tried to upgrade dovecot from 1.0.rc7 to rc22 but I got this error at the end of the upgrade process: Dovecot has reserved the groupname 'dovecot' and gid '143': ERROR: groupname 'dovecot' already in use by gid '1003' Please resolve these issues and try again: Either remove the conflicting group or if you wish to continue using a legacy gr oup override DOVECOT_GID. *** Error code 1 Stop in /usr/ports/mail/dovecot. So I went to /usr/ports/mail/dovecot and edited the Makefile to change the GID into: DOVECOT_UID?= 1003 DOVECOT_GID?= 1003 SCRIPT_ENV+= DOVECOT_UID=${DOVECOT_UID} \ DOVECOT_GID=${DOVECOT_GID} I saved the makefile and ran portupgrade again but I got stopped by exactly the same error. I'd appreciate suggestions how to resolve this. Thank you! -- Zbigniew Szalbot

3 2

[Dovecot] Reproducible duplicate messages bug with Mail.app+Dovecot
by Andrew Moran 18 Feb '07

18 Feb '07

Hey guys, I am not sure if this is a Mail.app bug or a dovecot bug. I can reproduce it 100% of the time using dovecot and Mail.app. I cannot reproduce it with other imap clients, which at first made me think it was Mail.app, but then I tried Mail.app with other imap servers and couldn't reproduce it either, so it's definitely the combination of the two. So I thought I'd try you guys first before submitting a bug to Apple. The problem: If I move multiple messages (set "A") from one imap folder to another, then delete those messages, and then move another set into that same folder (set "B"), then all the messages in set B show up as duplicates until I relaunch Mail.app. My configuration: Server: Dovecot 1.0rc22 using Maildir on FreeBSD 6.1 Client: Mail.app 2.1 on OS X 10.4.8 Steps to reproduce: (these steps involve trashing messages, so it's best to test this on email you are going to toss anyway) 1) Create a new imap folder (let's say "bar") 2) Drag more than one message (let's say 3 or 4) from existing imap folder "foo" to new folder "bar". 3) Click on new folder "bar" and see messages in there. 4) Select messages and delete them (Delete key). Messages are gone as expected. 5) Go back to original folder "foo" and drag a few more messages into new folder "bar" 6) Click on bar. 7) You will notice that all the second set of messages show up twice. Relaunching Mail.app at this point makes the problem disappear. I'm guessing this has something to do with the deleted messages from Set A being purged until the close of imap connection. Any help narrowing this down would be appreciated. Thank you, --Andy

3 4

[Dovecot] Problem moving emails with attachments or HTML links
by J. Wren Hunt 18 Feb '07

18 Feb '07

I recently switched from UW-IMAP to Dovecot (1.0.rc15 on Ubuntu) and am experiencing a weird problem that I haven't been able to figure out yet: If I try to move a message from one IMAP folder to another, all works fine if the message is plain text. However, *sometimes* the message will not be transferred if it contains either an attachment and/or an HTML link (operation times-out). Not all the time, but just enough to be annoying. I've looked through the logs and for settings in the .conf file and can't find anything obvious that I've overlooked. Can anyone help me with any parameters that might be causing this type of problem? Thanks so much! Wren Hunt Cambridge, MA

3 6

[Dovecot] MySQL question
by spammy 18 Feb '07

18 Feb '07

Hi all, Trying to migrate my actual mailserver postfix Cyrus-IMAP with virtual users to dovecot. done some tests and seems to work quite well except for; I would like to integrate my virtual configuration to share SQL information throw various daemons, like postfix, amavis and so on. By default, Dovecot sets the database users table to "users" but I would like to change it to "mailboxes". this is because I don't want to change all my configiuration files already setup, only for dovecot. is this possible? best regards, xtura Fedora Core 6 Dovecot 1.0 rc22

2 1

[Dovecot] LDA plugins mail_plugin_dir
by Dick Middleton 18 Feb '07

18 Feb '07

The LDA option mail_plugin_dir isn't by any chance like PATH i.e. can have more than one directory? I want to pick up some plugins from /usr/lib and some from elsewhere. Thanks Dick

2 3

[Dovecot] master request not found
by Marshal Newrock 18 Feb '07

18 Feb '07

I am setting up dovecot 1.0-rc15 as a proxy. When I try to log in, I get errors such as the following: Dec 4 17:39:23 vega dovecot: Dovecot v1.0.rc15 starting up Dec 4 17:39:24 vega dovecot: auth-worker(default): mysql: Connected to localhost (ad_mail) Dec 4 17:39:31 vega dovecot: auth(default): client in: AUTH 1 PLAINservice=POP3 lip=xx.xx.xx.xx rip=xx.xx.xx.xx resp=<hidden> Dec 4 17:39:31 vega dovecot: auth(default): client out: CONT 1 Dec 4 17:39:31 vega dovecot: auth(default): client in: CONT<hidden> Dec 4 17:39:31 vega dovecot: auth-worker(default): sql(XXXX,xx.xx.xx.xx: query: SELECT NULL AS password, host, destuser, 'Y' AS proxy FROM exchange_proxy WHERE user='XXXX' Dec 4 17:39:31 vega dovecot: auth(default): client out: OK 1 user=XXXX host=XXXX destuser=newrock.marshal(a)acd.net proxy pass=<hidden> Dec 4 17:39:31 vega dovecot: auth(default): master in: REQUEST 1 171931 Dec 4 17:39:31 vega dovecot: auth(default): Master request 17193.1 not found Dec 4 17:39:31 vega dovecot: auth(default): master out: NOTFOUND 1 Dec 4 17:39:31 vega dovecot: pop3-login: Internal login failure: user=<XXXX>, method=PLAIN, rip=xx.xx.xx.xx, lip=xx.xx.xx.xx dovecot.conf contains: auth default { mechanisms = plain login passdb sql { args = /etc/dovecot/dovecot-sql.conf } userdb static { args = uid=0 gid=0 } user = nobody } In dovecot-sql.conf: password_query = SELECT NULL AS password, host, destuser, 'Y' AS proxy FROM exchange_proxy WHERE user='%u' I have verified that I can log into the remote server from the proxy via pop3. Unfortunately, there isn't currently imap access to the remote server. I am connecting to the proxy using pop3 (with "telnet localhost 110"). Any suggestions what the problem could be? -- Marshal Newrock, Ideal Solution LLC http://www.idealso.com

2 4

[Dovecot] master password 'username contains disallowed character: 0x2a'
by Dale Bewley 18 Feb '07

18 Feb '07

v1.0.rc22 FC6 x86_64 So, here is my config: protocol imap { } protocol pop3 { } protocol lda { postmaster_address = postmaster(a)example.com } auth_master_user_separator = * auth_verbose = yes auth_debug = yes auth_debug_passwords = yes auth default { mechanisms = plain passdb passwd-file { args = /etc/dovecot.masterusers master = yes } passdb pam { } userdb passwd { } user = root } dict { } plugin { } But here is what happens when I try to login as dlbewley*zimbra using the password I put in dovecot.masterusers. Feb 16 23:37:30 tofu dovecot: Dovecot v1.0.rc22 starting up Feb 16 23:37:31 tofu dovecot: auth(default): passwd-file /etc/dovecot.masterusers: Read 1 users Feb 16 23:37:49 tofu dovecot: auth(default): client in: AUTH 1 PLAIN service=IMAP secured lip=::ffff:169.237.1.109 rip=::ffff:169.237.2.160 Feb 16 23:37:49 tofu dovecot: auth(default): client out: CONT 1 Feb 16 23:37:49 tofu dovecot: auth(default): client in: CONT 1 ZGxiZXdsZXkqemltYnJhAGRsYmV3bGV5KnppbWJyYQBjb2tlc2hpdDc= Feb 16 23:37:49 tofu dovecot: auth(default): plain(zimbra,::ffff:169.237.2.160): login user: Username contains disallowed character: 0x2a Feb 16 23:37:49 tofu dovecot: auth(default): client out: FAIL 1 user=zimbra Feb 16 23:37:49 tofu dovecot: imap-login: Disconnected: user=<zimbra>, method=PLAIN, rip=::ffff:169.237.2.160, lip=::ffff:169.237.1.109, TLS If I try setting this: auth_username_chars = I get this: Feb 16 23:45:15 tofu dovecot: Dovecot v1.0.rc22 starting up Feb 16 23:45:16 tofu dovecot: auth(default): passwd-file /etc/dovecot.masterusers: Read 1 users Feb 16 23:45:22 tofu dovecot: auth(default): client in: AUTH 1 PLAIN service=IMAP secured lip=::ffff:169.237.1.109 rip=::ffff:169.237.2.160 Feb 16 23:45:22 tofu dovecot: auth(default): client out: CONT 1 Feb 16 23:45:22 tofu dovecot: auth(default): client in: CONT 1 ZGxiZXdsZXkqemltYnJhAGRsYmV3bGV5KnppbWJyYQBjb2tlc2hpdDc= Feb 16 23:45:22 tofu dovecot: auth(default): passdb(zimbra,::ffff:169.237.2.160,master): Master user logging in as dlbewley*zimbra Feb 16 23:45:22 tofu dovecot: auth(default): client out: OK 1 user=dlbewley*zimbra Feb 16 23:45:22 tofu dovecot: auth(default): master in: REQUEST 1 7537 1 Feb 16 23:45:22 tofu dovecot: auth(default): passwd(dlbewley*zimbra,::ffff:169.237.2.160): unknown user Feb 16 23:45:22 tofu dovecot: auth(default): userdb(dlbewley*zimbra,::ffff:169.237.2.160): user not found from userdb Feb 16 23:45:22 tofu dovecot: auth(default): master out: NOTFOUND 1 Feb 16 23:45:22 tofu dovecot: imap-login: Internal login failure: user=<dlbewley*zimbra>, method=PLAIN, rip=::ffff:169.237.2.160, lip=::ffff:169.237.1.109, TLS

2 2

Re: [Dovecot] 1.0.rc23 tomorrow
by Bill Boebel 18 Feb '07

18 Feb '07

On Sat, February 17, 2007 8:09 am, Timo Sirainen <tss(a)iki.fi> said: > http://dovecot.org/nightly/dovecot-latest.tar.gz > > Would be nice to get some testing before the actual release. > Haven't tested this version yet, but we pulled a copy from CVS around mid-day Friday and it has been running fine for the past 30 hours. Bill

1 0

Re: [Dovecot] I keep getting password mismatches
by Mark 18 Feb '07

18 Feb '07

i have that: #%PAM-1.0auth required pam_nologin.soauth include system-authaccount include system-authsession include system-auth[root@School-Mail ~]# and i`m still not able to login with a webmail ldap client ot with thunderbird (also ldap) the error messages are still the same. > Date: Thu, 15 Feb 2007 10:10:13 -0800> From: tengel(a)fluid.com> To: dovecot(a)dovecot.org> Subject: Re: [Dovecot] I keep getting password mismatches> > Mark wrote:> > > > auth(default): passwd(mark,127.0.0.1): password mismatch> > > > The strange thing is that i can login with ssh using my username and > > password but i can`t do anything related to dovecot..> > Do you have a PAM stack installed to allow your dovecot process access > to authentication? (/etc/pam.d/dovecot e.g.)> > http://wiki.dovecot.org/PasswordDatabase/PAM> > -te> > -- > Troy Engel | Systems Engineer> Fluid, Inc | http://www.fluid.com _________________________________________________________________ Probeer Live.com: je eigen persoonlijke opstartpagina met alleen de dingen die jij belangrijk vindt op één plek. http://www.live.com/getstarted

1 0

[Dovecot] [Fwd: wrong dovecot GID while upgrading]
by Zbigniew Szalbot 17 Feb '07

17 Feb '07

Sorry to have bothered - just read the updating file...! I should have let the upgrading process remove the dovecot user... Warm regards, ZS ---------------------------- Original Message ---------------------------- Subject: wrong dovecot GID while upgrading From: "Zbigniew Szalbot" <zbyszek(a)szalbot.homedns.org> Date: Sat, February 17, 2007 21:10 To: dovecot(a)dovecot.org -------------------------------------------------------------------------- Hello, I tried to upgrade dovecot from 1.0.rc7 to rc22 but I got this error at the end of the upgrade process: Dovecot has reserved the groupname 'dovecot' and gid '143': ERROR: groupname 'dovecot' already in use by gid '1003' Please resolve these issues and try again: Either remove the conflicting group or if you wish to continue using a legacy gr oup override DOVECOT_GID. *** Error code 1 Stop in /usr/ports/mail/dovecot. So I went to /usr/ports/mail/dovecot and edited the Makefile to change the GID into: DOVECOT_UID?= 1003 DOVECOT_GID?= 1003 SCRIPT_ENV+= DOVECOT_UID=${DOVECOT_UID} \ DOVECOT_GID=${DOVECOT_GID} I saved the makefile and ran portupgrade again but I got stopped by exactly the same error. I'd appreciate suggestions how to resolve this. Thank you! -- Zbigniew Szalbot -- Zbigniew Szalbot

1 0

[Dovecot] Dovecot "open files" (again?)
by falz 17 Feb '07

17 Feb '07

I'm a new dovecot user, just began using it last week. I switched from courier because my research showed that Dovecot did indexes, and allows me to store them anywhere I chose. I did this, and it fixed some severe disk IO issues that my server had. (25k horde only webmail install using imap proxy). I'm using quotas, and by default had it set to 'dirsize'. my postfix is already creating 'maildirsize' files, so I opted to change dovecot to use this instead. However, when I do, I run into the "too many open files" issue that's been reported many times on the list. I've seen a lot of mention of too many open files, but I haven't seen it related to the quota type used. It's possible that simply my using 'dirsize' as the quota type slows things down enough to not have the issue? I don't really know. Anyhow. I doubled my max open files in FreeBSD's /boot/loader.conf to: kern.maxfiles="24656", but to no avail. When I have it set to maildirsize, the open files on the system grows uncontrollably. Under normal use, it's somewhere below 5k: sysctl -a | grep openfiles kern.openfiles: 4415 I looked into the patch mentioned here: - http://www.dovecot.org/list/dovecot/2006-November/017536.html - http://dovecot.org/list/dovecot-cvs/2006-November/006776.html Those patches already appear to be in rc15, which I'm already running (Via FreeBSD's ports). I also applied the patch mentioned here awhile back: - http://www.dovecot.org/list/dovecot/2005-June/007647.html and rebuilt, but it didn't help out either. There are also freebsd specific notes on forcing a limit on dovecot itsself using login.conf, but that wouldnt really fix anything, it would just cause dovecot to not interfere with other running daemons. - http://www.mail-archive.com/ports@openbsd.org/msg08646.html Any thoughts? TSS, you mention a few times in these notes that you're unable to reproduce this. Perhaps try with the maildir as quota? More details about my setup: - FreeBSD 4.8 (yea, I know) - Imapproxy (http://www.imapproxy.org/) - Postfix to create maildir++ maildirsize folders - MySQL backend The work of this is spread out between several servers, dovecot is running on the server that's the final SMTP delivery location, and has local disks with the maildirs. --falz

2 5

[Dovecot] upgrade from 1.0rc7
by Zbigniew Szalbot 17 Feb '07

17 Feb '07

Hello, Have been to dovecot website but could not find information on what I need to check before I upgrade from the current 1.0rc7 which I am using on a FreeBSD 6.2 system. Will the old conf (virtual users, no ssl) file work with upgraded dovecot? Many thanks! -- Zbigniew Szalbot

2 1

Re: [Dovecot] Reply-To header
by Kenny Dail 17 Feb '07

17 Feb '07

> On Saturday 17 February 2007 00:13, Mark E. Mallett wrote: > > On Sat, Feb 17, 2007 at 12:33:40AM +0200, Timo Sirainen wrote: > > > On Fri, 2007-02-16 at 15:16 -0600, Richard Laager wrote: > > > > I see you've added a Reply-To header later. The canonical response in > > > > this case is for someone to reference: > > > > http://www.unicom.com/pw/reply-to-harmful.html > > > > A canonical response to that is > > > > http://www.metasystema.net/essays/reply-to.mhtml > > My mind was not changed, sorry. First, RFC 822 is obsolete, and RFC 2822 does > not contain the quoted paragraph. Instead it says that '[w]hen > the "Reply-To:" field is present, it indicates the mailbox(es) to which the > author of the message suggests that replies be sent.' - the author, not the > mailing list software. There are other fields for that. Fortunately Dovecot's set-up, does make it the author's choice. -- Kenny Dail <kend(a)amigo.net>

2 1

[Dovecot] Problem/workaround with X-Keywords and Apple's Mail.app
by Joey Coleman 17 Feb '07

17 Feb '07

Hello, I've just switched from UW-IMAP to Dovecot, and for the most part, things are good. However, I encountered the problem with the X-Keywords header not being written back into individual messages in an mbox file (originally described in [1], and Timo gave a clue as to maybe why in [2]). What was happening for me is that Apple's Mail.app would flag a message as spam, which happily sets a couple keywords in the message, but those weren't being written back (at least, I didn't see them in the file on the server). The "DO NOT DELETE..." message had a perfectly fine X-IMAP header, and up until I switched things were working great. The user visible symptom of this happened every time new spam arrived in my Junk folder [3] --- the new spam would arrive, be flagged as spam by Mail.app, and the earlier pieces of mail would promptly be unflagged! Anyway, Timo's clue in [2] prompted me to turn off both mbox_lazy_writes and mbox_dirty_syncs (the latter just on the off- chance... it's a low-volume server, so I can deal with the inefficiency). Lo and behold, Mail.app started acting sane again *and* the X-Keywords header appeared immediately. Oddly, during all of this, the Status and X-UID keywords would appear in the messages just fine; no clue as to why those and not X- Keywords. Version details are: - Dovecot 1.0rc13 [4] - FreeBSD 5.3-RELEASE - Apple Mail.app 2.1 (752/752.2) cheers, --joey [1] http://dovecot.org/list/dovecot/2006-March/011872.html [2] http://dovecot.org/list/dovecot/2006-June/014126.html [3] And it felt really strange while troubleshooting this as I found myself *hoping* for another piece of spam to arrive. Bleh. [4] Yes, two versions behind current, but in my defense, I did check the announcements and they didn't seem to mention the problem.

2 1

[Dovecot] DON'T DELETE THIS MESSAGE -- FOLDER INTERNAL DATA
by Gerhard Wiesinger 17 Feb '07

17 Feb '07

Hello! I see the internal message from pine with the following subject (mbox format, dovecot 1.0rc22): DON'T DELETE THIS MESSAGE -- FOLDER INTERNAL DATA As far as I know this message should be filtered. I never saw this before in previous 1.0 betas and 1.0rc (nearly every version tested). Any ideas Timo? Ciao, Gerhard -- http://www.wiesinger.com/

3 3

[Dovecot] Going nuts
by Mário Gamito 17 Feb '07

17 Feb '07

Hi, The subject says it all. For two days i've been trying to get IMAP and IMAPS working and nothing. I'm running CentOS 4.4 with qmail-ldap I just can't login in dovecot. Following my signature is some info. You can find my dovecot.conf at http://www.gamito.org/dovecot.conf I'm about to give up :( Any help would be appreciated. Warm Regards, Mário Gamito --------------------------------------------------------------------- [root@mail login]# telnet mail.sincity.lan 143 Trying 192.168.5.129... Connected to mail.sincity.lan (192.168.5.129). Escape character is '^]'. * OK Dovecot ready. O LOGIN gamito(a)mail.sincity.lan 143 O NO Temporary authentication failure. O LOGOUT * BYE Logging out O OK Logout completed. Connection closed by foreign host. -------------------------------------------------- [root@mail login]# tail /var/log/dovecot/dovecot.log dovecot: Feb 17 00:01:02 Info: auth(default): client in: AUTH 1 PLAIN service=IMAP secured lip=192.168.5.129 rip=192.168.5.129 resp=<hidden> dovecot: Feb 17 00:01:02 Info: auth(default): checkpassword(gamito(a)mail.sincity.lan,192.168.5.129): Executed: /usr/local/bin/auth_imap /usr/local/libexec/dovecot/checkpassword-reply dovecot: Feb 17 00:01:02 Info: auth(default): checkpassword(gamito(a)mail.sincity.lan,192.168.5.129): Received no input dovecot: Feb 17 00:01:02 Error: auth(default): checkpassword: Child 31122 died with signal 11 dovecot: Feb 17 00:01:04 Info: auth(default): client out: FAIL 1 user=gamito(a)mail.sincity.lan temp dovecot: Feb 17 00:01:10 Info: imap-login: Aborted login: user=<gamito(a)mail.sincity.lan>, method=PLAIN, rip=192.168.5.129, lip=192.168.5.129, secured -------------------------------------------------------------------------

3 10

[Dovecot] again... cross compiling
by Martin Höfling 17 Feb '07

17 Feb '07

> Create a cache file with the right values, or call configure with those > values set in the environment. OK, i ran configure with -C one time without cross compiler env set, to obtain the variables another time with -C to use the config.cache . I could not find anything related to the check whether size_t is signed. I found a variable which i set that way: ignored_signed_size=${ignore_signed_size=1} What's wrong with that? Cheers Martin P.S.: Is there a way to obtain all variables in an easy way, or to obtain the variable that has to be set by hand? -- Frag' nicht - Du könntest eine Antwort erhalten. (Markus Mehring in d.a.arnooo)

3 2

Re: [Dovecot] Reply-To header
by Kenny Dail 17 Feb '07

17 Feb '07

> On Fri, 2007-02-16 at 15:16 -0600, Richard Laager wrote: > > I see you've added a Reply-To header later. The canonical response in > > this case is for someone to reference: > > http://www.unicom.com/pw/reply-to-harmful.html > > Yes, I've read that page. It says basically that it makes replying > privately to the sender difficult. I'm sure it does, but in this list I > don't think pretty much anyone ever wants to reply to someone only > privately. Since deliberate choice is required to go in and set the maillist option, this is no different than if I configure my MUA to set the reply-to header on messages I send to the list. So the way it has been implemented for this list is not a problem at all. If people feel the need to reply to me off list, I feel that should be a deliberate choice on their part. -- Kenny Dail <kend(a)amigo.net>

1 0

Re: [Dovecot] Bug tracking system
by Kenny Dail 17 Feb '07

17 Feb '07

> > > I don't think I want an anonymous user to be able to create bugs. Maybe > > > what I'm after is an automatic user creation based on the given email > > > address, but the user won't be able to log in before verifying the > > > email. If a user already exists for the given email address, that bug > > > also belongs to that existing user even though no password was asked > > > (but it could mention that it was created anonymously and log the IP). > > > > But that's how most othe rregstration systems work too. All > > bugzilla/mailman etc. typically want is to verify the autheticity of > > the given email address. > > But why? If all you're doing is just adding a new bug, what's the point > of verifying the email address? It's just annoying to the user. Especially if someone like myself is already registered to the mailing list, I don't feel the need to go and register into a bugtracking system and have my email verified yet again. > I just made a simple mockup of what I'd like the "Enter new bug" page to > be like: http://dovecot.org/tmp/bug.html Nice and simple is good. I'd include a couple of other fields to make it easy to get useful info, like dovecot version and OS. But I'd really prefer to just email reports in to the list. > The log in page would then allow logging in with email/password, or > allow "registering" the user by sending a new password to the email. Perhaps it can just be integrated with the maillist login page? -- Kenny Dail <kend(a)amigo.net>

1 0

[Dovecot] filtering out LIST cruft?
by Dan Price 17 Feb '07

17 Feb '07

In planning our migration, I've noticed that lots of users have bits of lint in their ~/mail and/or ~/Mail. For example-- for an mbox called "blah" we may see: blah blah.msf (from Thunderbird) .blah.summary (from... I'm not sure, dtmail maybe) .blah_SIMS_index0003 (from our old IMAP server). When the user goes to "subscribe" they are often overloaded with too many items to choose from-- because all of these files are selectable in the UI-- LIST happily returns them. Is there a way to get dovecot to skip over these, by regex? Could it optionally "taste" files to see if they look like mboxes? I looked at the wiki and the source but didn't find anything. In the absence of this feature, I wonder how other sites have handled this? Obviously I can do some cleanup during migration, but I find that those pesky msf files like to come back. -dp -- Daniel Price - Solaris Kernel Engineering - dp(a)eng.sun.com - blogs.sun.com/dp

2 1

[Dovecot] imap core dump with rc18
by Nicolas STRANSKY 17 Feb '07

17 Feb '07

Hi, I had a core dump while using rc18. Here are the backtraces: Jan 23 01:01:44 rouge dovecot: IMAP(user): file mail-index-view.c: line 386 (_view_lookup_uid_range): assertion failed: (*last_seq_r >= *first_seq_r) Jan 23 01:01:44 rouge dovecot: IMAP(user): Raw backtrace: [0x47f25b00000000] Jan 23 01:01:44 rouge dovecot: child 24319 (imap) killed with signal 6 Core was generated by `imap'. Program terminated with signal 6, Aborted. Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done. Loaded symbols for /lib/libdl.so.2 Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /lib/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 #0 0x00002b3448083545 in raise () from /lib/libc.so.6 (gdb) bt full #0 0x00002b3448083545 in raise () from /lib/libc.so.6 No symbol table info available. #1 0x00002b3448084cce in abort () from /lib/libc.so.6 No symbol table info available. #2 0x0000000000465fd5 in i_set_failure_file () No symbol table info available. #3 0x000000000046585c in i_panic () No symbol table info available. #4 0x000000000044fff3 in mail_index_view_unref_maps () No symbol table info available. #5 0x00000000004505c7 in mail_index_lookup_uid_range () No symbol table info available. #6 0x000000000043be90 in index_storage_get_uids () No symbol table info available. #7 0x0000000000458d37 in mailbox_get_uids () No symbol table info available. #8 0x0000000000419eef in imap_messageset_parse () No symbol table info available. #9 0x000000000041aaae in imap_search_get_arg () No symbol table info available. #10 0x0000000000412e45 in cmd_fetch () No symbol table info available. #11 0x0000000000415910 in cmd_uid () No symbol table info available. #12 0x00000000004164a1 in _client_reset_command () No symbol table info available. #13 0x0000000000416430 in _client_reset_command () No symbol table info available. #14 0x0000000000416591 in _client_input () No symbol table info available. #15 0x000000000046b5bb in io_loop_handler_run () No symbol table info available. #16 0x000000000046ab4c in io_loop_run () No symbol table info available. ---Type <return> to continue, or q <return> to quit--- #17 0x000000000041dd1b in main () No symbol table info available. Regards, -- Nico Ce n'est pas en continuant de faire ce que l'on connaît que l'on pourra faire ce que l'on ne connaît pas

2 3

[Dovecot] severe performance problem (mail cache related?)
by Dan Price 17 Feb '07

17 Feb '07

Hi all, we're having a bad day with email :) I have a user who was complaining of poor performance today when opening mailboxes. Total time to open the box was about 1 minute. Upon truss'ing the imap process during an open, I saw the trace quoted below at the end of the email. As you can see, for each "FETCH" line of response, we were seeing dovecot do a ton of work-- mmaping anon, lots of munmaps(), etc. -- mmap() and munmap() are not free. The stack trace of at least one of the munmaps is captured below, as well-- deep inside of the mail caching code. Then, I moved aside the user's .imap directory, assuming that forcing dovecot to rebuild its indices and caches could help-- and sure enough the user reported that mailbox open times had dropped to 18 seconds. I truss'd that open, briefly, and it was just a ton of preads at high speed. So I don't know why this user was fine for a week, then suddenly hit this. This is a grave concern if I'm going to roll this out from 15 test users to 250 production users. Thanks for your help. PS: Raw logs are also attached below. -dp write(1, " * 1 0 7 9 5 F E T C".., 2050) = 2050 mmap64(0x00000000, 7356416, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANON, -1, 0) = 0xFD800000 munmap(0xFE602000, 1048576) = 0 munmap(0xFE502000, 1048576) = 0 munmap(0xFE402000, 1048576) = 0 munmap(0xFE302000, 1048576) = 0 munmap(0xFE202000, 1048576) = 0 munmap(0xFE102000, 1048576) = 0 munmap(0xFE002000, 1048576) = 0 munmap(0xFE000000, 8192) = 0 pread64(9, " n c o m @ o s s 1 >\n\0".., 8192, 7340032) = 8192 mmap64(0x00000000, 7364608, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANON, -1, 0) = 0xFE800000 munmap(0xFDE04000, 1048576) = 0 munmap(0xFDD04000, 1048576) = 0 munmap(0xFDC04000, 1048576) = 0 munmap(0xFDB04000, 1048576) = 0 munmap(0xFDA04000, 1048576) = 0 munmap(0xFD904000, 1048576) = 0 munmap(0xFD804000, 1048576) = 0 munmap(0xFD802000, 8192) = 0 munmap(0xFD800000, 8192) = 0 pread64(9, " l @ p l a t i n u m >\n".., 8192, 7348224) = 8192 mmap64(0x00000000, 7372800, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANON, -1, 0) = 0xFE000000 munmap(0xFEE06000, 1048576) = 0 munmap(0xFED06000, 1048576) = 0 munmap(0xFEC06000, 1048576) = 0 munmap(0xFEB06000, 1048576) = 0 munmap(0xFEA06000, 1048576) = 0 munmap(0xFE906000, 1048576) = 0 munmap(0xFE806000, 1048576) = 0 munmap(0xFE802000, 16384) = 0 munmap(0xFE800000, 8192) = 0 pread64(9, "\0\0\0 0\0\0\0\0 C c : ".., 8192, 7356416) = 8192 ---------- ---------- ---------- ---------- ---------- ---------- ---------- ff1c3e14 munmap (100000, bdc000, fe6de000, 2dc000, 0, 1ef0) + 8 00080bb4 file_cache_set_size (c03a0, 0, bdc110, 408, 0, 110) + e0 00080cec file_cache_read (0, bdbd08, bdbd08, 408, 0, 684a8) + a4 000594a0 mail_cache_map (191268, bdbd08, 408, ffbff274, 3, fffffffc) + ec 0005ae20 mail_cache_get_record (0, bdbd08, ffbff274, ffbff274, 0, 0) + 20 0005b00c mail_cache_foreach_rec (1959c8, ffbff2ec, 5b3d8, 0, b5760, 7ed8) + 10 0005b2bc mail_cache_foreach (1, 47ae, 5b3d8, 0, 0, 0) + b4 0005b47c mail_cache_field_exists (0, 47ae, 0, c0000000, b4f10, 88184) + 84 0005b64c mail_cache_lookup_field (1959c8, b5898, 47ae, 0, 191d48, 195560) + c 000531ac index_mail_get_fixed_field (195dd8, 0, 195ea0, 4, ffffffff, ffffffff) + 4c 000545e8 index_mail_set_seq (195dd8, 47ae, 19a1c8, b4b4f, 0, 47ae) + bc 00070dac mail_set_seq (195dd8, 47ae, 1, c2ce8, 0, 39c) + c 0005770c index_storage_search_next (1, 195dd8, 1, bd778, 5769c, c8ae0) + 70 00072024 mailbox_search_next (19a1c8, 195dd8, 3, 2, 0, c2b50) + 14 0002b3bc imap_fetch (c4e20, c4de8, ffbff748, 5, c2eb0, 80000000) + 6c 00026210 cmd_fetch (1, c2e88, 0, 75696400, 26054, 80000000) + 1bc 00029000 cmd_uid (0, c22f8, 0, 8, 2a134, c22f8) + 8c 00029b58 client_handle_input (c2b94, c2e80, b5760, bd778, 7ef8, 2000000) + 138 00029ad0 client_handle_input (0, 2f05e860, b5760, bd778, 45d3834d, b5000) + b0 00029cb0 _client_input (c2b50, c2b50, 26ee, 0, 1, 0) + 68 00086338 io_loop_handler_run (c0348, 0, 0, ffbffa14, 4c, 80000000) + 140 00085c14 io_loop_run (c0348, ff212cb0, 1, b573c, bae80, ff215dbc) + 34 00032064 main (ffbffc18, b4400, b5000, b573c, c1314, ff3a0180) + 3f8 00024b18 _start (0, 0, 0, 0, 0, 0) + 5c ------ ------ ------ ------ ------ ------ ------ ------ ------ ------ [in] 3 select "Mail/OpenSolaris/discuss" 4 UID fetch 1:* (FLAGS) 5 IDLE DONE 6 close 7 logout ------ ------ ------ ------ ------ ------ ------ ------ ------ ------ [out, taking 1+ minutes] * OK [RAWLOG TIMESTAMP] 2007-02-14 14:05:35 * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk $Forwarded Junk) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk $Forwarded Junk \*)] Flags permitted. * 20462 EXISTS * 0 RECENT * OK [UIDVALIDITY 1159980013] UIDs valid * OK [UIDNEXT 20487] Predicted next UID 3 OK [READ-WRITE] Select completed. * 1 FETCH (FLAGS (\Seen) UID 1) * 2 FETCH (FLAGS (\Seen) UID 2) * 3 FETCH (FLAGS (\Seen) UID 3) * 4 FETCH (FLAGS (\Seen) UID 4) * 5 FETCH (FLAGS (\Seen) UID 5) * 6 FETCH (FLAGS (\Seen) UID 6) * 7 FETCH (FLAGS (\Seen) UID 7) * 8 FETCH (FLAGS (\Seen) UID 8) * 9 FETCH (FLAGS (\Seen) UID 9) * 10 FETCH (FLAGS (\Seen) UID 10) * 11 FETCH (FLAGS (\Seen) UID 11) * 12 FETCH (FLAGS (\Seen) UID 12) * 13 FETCH (FLAGS (\Seen) UID 13) * 14 FETCH (FLAGS (\Seen) UID 14) * 15 FETCH (FLAGS (\Seen) UID 15) * 16 FETCH (FLAGS (\Seen) UID 16) * 17 FETCH (FLAGS (\Seen) UID 17) * 18 FETCH (FLAGS (\Seen) UID 18) * 19 FETCH (FLAGS (\Seen) UID 19) * 20 FETCH (FLAGS (\Seen) UID 20) * 21 FETCH (FLAGS (\Seen) UID 21) * 22 FETCH (FLAGS (\Seen) UID 22) * 23 FETCH (FLAGS (\Seen) UID 23) [-----elided-----] * 20459 FETCH (FLAGS (\Seen) UID 20483) * 20460 FETCH (FLAGS (\Seen) UID 20484) * 20461 FETCH (FLAGS (\Seen) UID 20485) * 20462 FETCH (FLAGS (\Seen) UID 20486) 4 OK Fetch completed. + idling 5 OK Idle completed. 6 OK Close completed. * BYE Logging out 7 OK Logout completed. -- Daniel Price - Solaris Kernel Engineering - dp(a)eng.sun.com - blogs.sun.com/dp

3 12

[Dovecot] trash plugin sql
by Robert Schetterer 16 Feb '07

16 Feb '07

Hi @ll, with dovecot latest following http://wiki.dovecot.org/DovecotLDAPostfixAdminMySQL i have defined plugin { quota = maildir acl = vfile:/etc/dovecot/acls trash = /etc/dovecot/dovecot-trash.conf } Example dovecot-trash.conf file 1 Spam 2 Trash 3 Sent from wiki The Trash plugin. When saving a message would make user go over quota, this plugin automatically deletes the oldest mails from configured mailboxes until the message can be saved within quota limits. this dont work at my setup where quota is coming out of sql is there any trick to solve this? or did i missunderstand something -- Mit freundlichen Gruessen Best Regards Robert Schetterer https://www.schetterer.org Munich/Bavaria/Germany

3 6

Re: [Dovecot] repeat downloads of message headers in 1.0rc19
by Jim Garrison 16 Feb '07

16 Feb '07

I reported this against rc7 and rc8, and still see it occasionally. (I'm running the rc8 that comes with Fedora 5). It is always associated with this message in dovecot.log: dovecot: Oct 23 19:26:17 Error: POP3(user(a)domain.tld): mbox sync: UID inserted in the middle of mailbox /var/mail/vhosts/domain.tld/user (12 > 4, seq=2, idx_msgs=5) Once this happens, dovecot will refuse to clear out the mbox file when the user retrieves email via POP. Each time the user logs in to retrieve mail s/he gets everything in the mbox, which continues to grow. The only fix I've been able to find is to manually delete the mbox file. I'm using postfix as the MTA.

5 6