August 2007 - dovecot

[Dovecot] How do I configure sendmail to accept emails for dovecot when dovecot has sql auth/user db.
by Yossie Silverman 06 Aug '07

06 Aug '07

Included below are my config files: sendmail.mc, dovecot.m4, dovecot.conf, dovecot-sql.conf. Whenever I try to send email into this system, it rejects it with user does not exist, however, the user does exist as far as dovecot (imap) is concerned, it is in the database. THANKS - Yossie # for i in /etc/dovecot/dovecot.conf /etc/dovecot/dovecot-sql.conf / usr/share/sendmail-cf/mailer/dovecot.m4 /etc/mail/sendmail.mc; do echo "FILE: $i"; echo ===; echo ""; egrep -v '^ *(#|$)' $i; echo ""; echo ""; done FILE: /etc/dovecot/dovecot.conf === listen = [::] disable_plaintext_auth = no ssl_disable = yes ssl_cert_file = /etc/ssl/dovecot/server.pem ssl_key_file = /etc/ssl/dovecot/server.key mail_location = maildir:~/.maildir namespace private { separator = . inbox = yes hidden = no } namespace private { separator = . prefix = INBOX. inbox = no hidden = yes } first_valid_uid = 0 protocol imap { } protocol pop3 { } protocol lda { postmaster_address = postmaster(a)example.com main_plugin_dir = /usr/lib/dovecot/lda mail_plugins = cmusieve quota } auth default { mechanisms = plain passdb sql { args = /etc/dovecot/dovecot-sql.conf } userdb sql { args = /etc/dovecot/dovecot-sql.conf } user = root socket listen { master { path = /var/run/dovecot/auth-master mode = 0666 } client { path = /var/run/dovecot/auth-client mode = 0666 } } } dict { } plugin { } FILE: /etc/dovecot/dovecot-sql.conf === driver = mysql connect = host=localhost dbname=dovecot user=root default_pass_scheme = PLAIN password_query = SELECT userPassword as password, user, concat("/var/ spool/dovecot/",substr(user,1,1),"/user/",user) as userdb_home, 97 as userdb_uid, 97 as userdb_gid FROM authdb WHERE user = '%n' and userPassword = '%w' user_query = SELECT concat("/var/spool/imap/",substr(user,1,1),"/ user/",user) as home, 97 as uid, 97 as gid FROM authdb WHERE user = '%n' FILE: /usr/share/sendmail-cf/mailer/dovecot.m4 === Mdovecot, P=/usr/libexec/dovecot/deliver, F=DFMPhnu9, S=EnvFromSMTP/HdrFromSMTP, R=EnvToSMTP/HdrFromSMTP, T=DNS/RFC822/X-Unix, A=deliver -d $u FILE: /etc/mail/sendmail.mc === divert(-1) dnl This is the macro config file used to generate the /etc/sendmail.cf dnl file. If you modify the file you will have to regenerate the dnl /etc/sendmail.cf by running this macro config through the m4 dnl preprocessor: dnl dnl m4 /etc/mail/sendmail.mc > /etc/mail/sendmail.cf dnl dnl You will need to have the sendmail-cf package installed for this to dnl work. include(`/usr/share/sendmail-cf/m4/cf.m4')dnl define(`confDEF_USER_ID',``mail:mail'')dnl OSTYPE(`linux')dnl undefine(`UUCP_RELAY')dnl undefine(`BITNET_RELAY')dnl define(`confALIAS_WAIT', `30')dnl define(`confTO_CONNECT', `1m')dnl define(`confTRY_NULL_MX_LIST',true)dnl define(`confDONT_PROBE_INTERFACES',true)dnl define(`PROCMAIL_MAILER_PATH',`/usr/bin/procmail')dnl dnl define delivery mode: interactive, background, or queued dnl define(`confDELIVERY_MODE', `i') MASQUERADE_AS(`ford.qa.laszlosystems.com')dnl FEATURE(`limited_masquerade')dnl FEATURE(`masquerade_envelope')dnl FEATURE(`smrsh',`/usr/sbin/smrsh')dnl FEATURE(mailertable)dnl dnl virtusertable: redirect incoming mail to virtual domain to particular user or domain FEATURE(`virtusertable',`hash -o /etc/mail/virtusertable')dnl dnl genericstable: rewrite sender address for outgoing mail FEATURE(genericstable)dnl FEATURE(always_add_domain)dnl FEATURE(redirect)dnl FEATURE(use_cw_file)dnl FEATURE(local_procmail)dnl FEATURE(`access_db')dnl FEATURE(`blacklist_recipients')dnl FEATURE(`relay_based_on_MX')dnl dnl FEATURE(dnsbl, `blackholes.mail-abuse.org', `Rejected - see http://www.mail-abuse.org/rbl/')dnl dnl FEATURE(dnsbl, `dialups.mail-abuse.org', `Dialup - see http:// www.mail-abuse.org/dul/')dnl dnl FEATURE(dnsbl, `relays.mail-abuse.org', `Open spam relay - see http://www.mail-abuse.org/rss/')dnl FEATURE(`delay_checks')dnl FEATURE(`stickyhost')dnl dnl SASL Configuration dnl extract from http://www.sendmail.org/~ca/email/auth.html dnl dnl Next two lines are for SMTP Authentication TRUST_AUTH_MECH(`LOGIN PLAIN')dnl define(`confAUTH_MECHANISMS', `LOGIN PLAIN')dnl dnl dnl Next line stops sendmail from allowing auth without encryption define(`confAUTH_OPTIONS', `Apy')dnl dnl dnl STARTTLS configuration dnl extract from http://www.sendmail.org/~ca/email/starttls.html dnl define(`CERT_DIR', `/etc/ssl/sendmail')dnl define(`confCACERT_PATH', `CERT_DIR')dnl define(`confCACERT', `CERT_DIR/CAcert.pem')dnl define(`confSERVER_CERT', `CERT_DIR/MYcert.pem')dnl define(`confSERVER_KEY', `CERT_DIR/MYkey.pem')dnl define(`confCLIENT_CERT', `CERT_DIR/MYcert.pem')dnl define(`confCLIENT_KEY', `CERT_DIR/MYkey.pem')dnl dnl dnl Uncomment next lines to hide identity of mail serve define(`confPRIVACY_FLAGS',`goaway,restrictqrun,restrictmailq')dnl dnl define(`confSMTP_LOGIN_MSG', `$j server ready at $b')dnl MAILER(smtp)dnl MAILER(procmail)dnl MAILER(dovecot)dnl ford dovecot #

2 1

[Dovecot] Benchmark: Appending 250k messages
by Timo Sirainen 06 Aug '07

06 Aug '07

I just changed Dovecot v1.1 code to work much more nicely when appending new messages to large mailboxes. Dovecot hg (cydir format, fsync_disable=yes): ./imaptest secs=1 ./imaptest - append=100,0 logout=0 msgs=10000000 clients=1 seed=1 secs=300 Logi Sele Appe 100% 100% 100% 1 1 2322 1/ 1 0 0 1998 1/ 1 0 0 2293 1/ 1 0 0 2009 1/ 1 0 0 1789 1/ 1 0 0 1245 1/ 1 0 0 43 1/ 1 0 0 32 1/ 1 0 0 881 1/ 1 0 0 2137 1/ 1 .. 0 0 704 1/ 1 0 0 771 1/ 1 0 0 388 1/ 1 0 0 831 1/ 1 0 0 572 1/ 1 0 0 766 1/ 1 Totals: 1 1 251397 Averaging 837/sec. The append speed jumps around quite a lot. Typically it's around 800-1000/sec, but it jumps between 0-500/sec also quite often. I'm not sure why that is. Cyrus v2.3.8 (fsync and fdatasync calls disabled from code): ./imaptest - append=100,0 logout=0 msgs=10000000 clients=1 seed=1 secs=300 Logi Sele Appe 100% 100% 100% 1 1 2587 1/ 1 0 0 1907 1/ 1 0 0 1597 1/ 1 0 0 1260 1/ 1 0 0 1220 1/ 1 0 0 1151 1/ 1 0 0 1068 1/ 1 .. 0 0 121 1/ 1 0 0 127 1/ 1 0 0 128 1/ 1 0 0 126 1/ 1 Totals: 1 1 79613 Averaging 265/sec. The speed slows down pretty consistently, there's no jumping like with Dovecot.

1 0

[Dovecot] Disable IMAP for certain users, but not Webmailer
by FORMER 03 | Baltasar Cevc 06 Aug '07

06 Aug '07

Hi everybody, I'm planning to set up our new mail system using the Dovecot mailbox server. It mostly works fine yet (it's quite straigt forward to set up, I'd say), but there's a thing I haven't been able to find out yet. We provide POP3 access for all users, but want to restrict IMAP access to some of them (because IMAP users tend to leave more messages on the server, thus increasing storage needs). I used to do it by providing two services. One provided the public imap and checked a database flag during authentication, the other just provided IMAP on localhost and did not check the "allowed to use IMAP" flag. What I've found for Dovecot is http://wiki.dovecot.org/Authentication/RestrictAccess While this allows me to provide full POP3 to everybody and in the same time restricting IMAP, I don't see a possibility Is there any possibility to achieve what I need without having two completely separated instances of Dovecot running? I'd appreciate any hints, pointers to documents etc. Thanx, Baltasar -- _____ FORMER 03 GmbH _____ infanteriestra§e 19 haus 6 eg _____ 80797 muenchen _____ baltasar.cevc(a)former03.de _____ www.former03.de _____ fon 089.322112.29 _____ fax 089.322112.11 _____ mobil 0178.691.2233 _____ geschftsfhrer _____ sebastian fiedler _____ gert zellentin _____ handelsregister _____ HRB Mnchen 148468 _____ steuer _____ ust.-id DE 2291076876

6 12

[Dovecot] dovecot.index.cache weirdness
by Tan Shao Yi 06 Aug '07

06 Aug '07

Hi Timo, Just a quick check, may I know if the following output of idxview is normal? (see bottom of e-mail) I am running dovecot-1.0.3 on a Solaris 10 SPARC box. Deleting dovecot.index.cache does not seem to help for this user; it keeps getting regenerated with these same lines. I seems that I have to set mmap_disable=yes on this box to have a "clean-looking" dovecot.index.cache. Is it mmap related? Or it just happens to be a coincidence? Cheers, Tan Shao Yi /usr/local/libexec/dovecot/idxview dovecot.index dovecot.index.cache (... normal looking stuff ...) RECORD: offset=408, seq=22, uid=126, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=420, seq=23, uid=127, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=432, seq=24, uid=128, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=444, seq=25, uid=129, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=456, seq=26, uid=130, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=468, seq=27, uid=131, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=480, seq=28, uid=132, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=492, seq=29, uid=133, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=504, seq=30, uid=134, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=516, seq=31, uid=135, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=528, seq=32, uid=136, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=540, seq=33, uid=137, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=552, seq=34, uid=138, flags=0 - ext cache(0): 0 (00000000) RECORD: offset=564, seq=35, uid=139, flags=0 - ext cache(0): 0 (00000000)

2 1

[Dovecot] FETCH for mailbox XXX UID XXX got too little data.
by Tan Shao Yi 06 Aug '07

06 Aug '07

Hi Timo, I am receiving the above error in dovecot's logs, here's how it looks like: dovecot: Aug 05 19:52:19 Info: imap-login: Login: user=<XXXXXXXXXXXX>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured dovecot: Aug 05 19:53:36 Error: IMAP(XXXXXXXXXXXX): FETCH for mailbox Bulk Mails UID 32 got too little data: 9199 vs 39532 dovecot: Aug 05 19:53:36 Info: IMAP(XXXXXXXXXXXX): Disconnected: Disconnected When I attempted a telnet to the IMAP port, a fetch body[text] of the message begins with a partial portion of the Received headers: dsl-146-173-81.clt.bellsouth.net (72.146.173.81) by mx6.pacific.net.sg with SMTP; 1 Aug 2007 01:48:14 -0000 and I get abruptly disconnected: Connection to localhost closed by foreign host. May I know what could have gone wrong? To protect the user's privacy, I will be e-mailing you the actual bad e-mail in a separate e-mail. Thanking in advance. Cheers. Following this is a partial transcript of the IMAP transaction: a1 fetch 32 full * 32 FETCH (FLAGS (\Seen) INTERNALDATE "26-Jul-2007 00:35:20 +0800" RFC822.SIZE 40598 ENVELOPE ("Thu, 26 Jul 2007 00:22:09 +0800" "ADV: Empowering Your Presentation Skills" (("Personal Development Workshops" NIL "enews" "JuzEvents2.com")) (("Personal Development Workshops" NIL "enews" "JuzEvents2.com")) (("Personal Development Workshops" NIL "enews" "JuzEvents2.com")) ((NIL NIL "XXXXXXXXXXXX" "pacific.net.sg")) NIL NIL NIL "<004e4411357e78a1b6eec83d00114028(a)juzevents2.com>") BODY ("text" "html" ("charset" "gb2312") NIL NIL "base64" 39532 508)) a1 OK Fetch completed. a1 fetch 32 body[text] * 32 FETCH (BODY[TEXT] {39532} dsl-146-173-81.clt.bellsouth.net (72.146.173.81) by mx6.pacific.net.sg with SMTP; 1 Aug 2007 01:48:14 -0000 Received: from NHGF ([10.161.42.56]) by adsl-146-173-81.clt.bellsouth.net (8.13.4/8.13.4) with SMTP id i154842195219s7Ho019018 for <XXXXXXXXXXXX(a)pacific.net.sg>; Tue, 31 Jul 2007 21:48:10 -0500 (CDT) (envelope-from espainolax_6666(a)yahoo.es) Message-ID: <005801c7d3de$046dbe90$51ad9248@NHGF> From: "espainolax_6666" <espainolax_6666(a)yahoo.es> To: <XXXXXXXXXXXX(a)pacific.net.sg> Subject: soggy fighter pilot Date: Wed, 01 Aug 2007 10:45:38 +0800 MIME-Version: 1.0 Content-Type: multipart/related; boundary="----=_NextPart_000_0055_01C7D3BC.7D1C7D80"; type="multipart/alternative" X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.3138 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3138 *** blah *** Connection to localhost closed by foreign host.

2 2

[Dovecot] Some of my IMAP Folders vanished in some MUAs
by Dominik Schulz 05 Aug '07

05 Aug '07

Hi, I'm using dovecot for some time now. Previously I was using Courier and I've migrated this setup to dovecot which went pretty fine. Now I'm experiencing some strange behaviour when using some newer mail clients. Some of my Folders, like "spam", are vanished. The strange point is that it only happens in some clients, like Thunderbird 2.x+ or KMail 3.5.x. In others, like Thunderbird < 2, Mutt or my Webmailer (Horde) they still show up. These folders are still there, i.e. in the filesystem, and the permissions seem to match those of the other folders which can be seem in all MUAs. I don't know if this is even related to dovecot but I think this is where I should start looking for an solution. I'm using dovecot 1.0.rc15 from Debian (stable/etch). It'd be great if anyone was able to help me. Thanks in advance. Best Regrads Dominik Schulz

6 10

[Dovecot] Password Encryption
by Dave Morrow 05 Aug '07

05 Aug '07

Hi all. I hope this is not a RTFM-type question, but I've been unable to find a searchable archive of this mailing list....... I recently began investigating using Dovecot/Postfix/MySQL solution. I've been following the documentation http://wiki.dovecot.org/HowTo/DovecotLDAPostfixAdminMySQL?highlight=%28m ysql%29 While everything seems to have gone right, I have been unable to successfully login to the IMAP server using Outlook Express. It seems that the problem may relate to PostfixAdmin storing passwords in the mysql database md5 encrypted, and Dovecot is not able to read them, but I am not certain. The error when a client logs in is something like dovecot: auth-worker(default): plain_md5_verify(testuser1(a)mydomain.com): Invalid password encoding David Morrow Technical Systems Lead Autodata Solutions Company David.Morrow(a)Autodata.net <mailto:David.Morrow@Autodata.net> http://www.autodatasolutions.com <http://www.autodatasolutions.com/> Tel: (519) 963-3020 Fax: (519) 451-6615 Think slowly. Act quickly. This message has originated from Autodata Solutions. The attached material is the Confidential and Proprietary Information of Autodata Solutions. This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please delete this message and notify the Autodata system administrator at Administrator(a)autodata.net <mailto:Administrator@autodata.net <mailto:Administrator@autodata.net> >

3 3

[Dovecot] modify header in deliver
by Reinhard Hainz 05 Aug '07

05 Aug '07

hi, is it possible to modify the mail-header (subject) within the deliver process (maybe by a lda-plugin)? I have tried to write a simple plugin for this, but I cannot find a way to modify the mail befor writing it to the mailbox. Reinhard ------------------------------------------- Versendet durch aonWebmail (webmail.aon.at) Hier spielt die Musik! Über zwei Millionen Songs zum Downloaden. http://www.aon.at/musikdownload

2 1

[Dovecot] IMAP-Proxy and LDAP?
by Patrick Ben Koetter 05 Aug '07

05 Aug '07

I am doing some research on Dovecots IMAP-Proxy features mentioned in <http://wiki.dovecot.org/HowTo/ImapProxy> and <http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy>. The docs only mention SQL as backend to hold required data. Is it also possible to use LDAP? TIA, p@rick -- state of mind Agentur für Kommunikation, Design und Softwareentwicklung Patrick Koetter Tel: 089 45227227 Echinger Strasse 3 Fax: 089 45227226 85386 Eching Web: http://www.state-of-mind.de Amtsgericht München Partnerschaftsregister PR 563

2 2

[Dovecot] sendfile on Solaris 10 SPARC?
by Tan Shao Yi 04 Aug '07

04 Aug '07

Hi, I am using dovecot-1.0.2 and am observing occassions where the imap process for the user goes into an infinite loop. A truss of the process gives: pollsys(0x000B0308, 4, 0xFFBFF898, 0x00000000) = 1 fstat64(10, 0x000BC130) = 0 sendfilev64(1, 1, 0xFFBFF4B0, 1, 0xFFBFF4A4) Err#11 EAGAIN pollsys(0x000B0308, 4, 0xFFBFF898, 0x00000000) = 1 fstat64(10, 0x000BC130) = 0 sendfilev64(1, 1, 0xFFBFF4B0, 1, 0xFFBFF4A4) Err#11 EAGAIN pollsys(0x000B0308, 4, 0xFFBFF898, 0x00000000) = 1 fstat64(10, 0x000BC130) = 0 (... repeatedly ...) When I searched the maillog for the user, the last actions taken were: dovecot: Aug 04 10:50:42 Info: imap-login: Login: user=<XXX>, method=PLAI N, rip=203.120.90.32, lip=203.120.90.85 dovecot: Aug 04 10:50:42 Info: IMAP(XXX): copy -> Trash: uid=25, msgid=<d 05001c7d51a$0a18c550$958f3011@burgaldceo> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): copy -> Trash: uid=26, msgid=<4 14901c7d5bd$55a80b40$26227a4d@Mitchell> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): copy -> Trash: uid=27, msgid=<9 31601908.49031521463794(a)lanecompany.com> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): deleted: uid=25, msgid=<d05001c 7d51a$0a18c550$958f3011@burgaldceo> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): deleted: uid=26, msgid=<414901c 7d5bd$55a80b40$26227a4d@Mitchell> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): deleted: uid=27, msgid=<9316019 08.49031521463794(a)lanecompany.com> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): expunged: uid=25, msgid=<d05001 c7d51a$0a18c550$958f3011@burgaldceo> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): expunged: uid=26, msgid=<414901 c7d5bd$55a80b40$26227a4d@Mitchell> dovecot: Aug 04 10:50:42 Info: IMAP(XXX): expunged: uid=27, msgid=<931601 908.49031521463794(a)lanecompany.com> dovecot: Aug 04 10:50:43 Info: IMAP(XXX): Disconnected: Logged out May I know what could have caused the problem or is there any other information I can provide? Thanking in advance. Cheers, Tan Shao Yi

1 0