- dovecot - dovecot.org

[Dovecot] User database ldap lookups and sasl
by Olivier Castan 09 Oct '07

09 Oct '07

Hello I'm currently trying to use Active Directory with Unix extensions to store UID, GID and homedir and retrieve them with ldap. I don't want to allow anonymous bindings and I would rather not use TLS and manage a PKI. So I'm trying to use SASL to do a Kerberos authentication for Dovecot against AD LDAP. I'm currently getting GSSAPI errors about the lack of "credentials cache". Looking at similar cases where services act as clients, like using nss_ldap for unix host accounts, I understand the credentials cache should be initiated by an external program (cron and startup script), at least with the TGT and maybe the TGS for ldap. Since usually kerberosv5 cache is based on the user id ( /tmp/krb5cc_0 for root) there's an option in ldap.conf (krb5_ccname) to set the filename (/etc/.ldapcache in nss_ldap tutorials) for this cache. Is there any way to do this with dovecot-ldap.conf or should I try to use "auth user" default cache filename ? Thanks in advance

1 0

[Dovecot] SpamAssassin and Public Namespace
by James 09 Oct '07

09 Oct '07

Hi I know i might get flamed for asking this in the dovecot mailing list instead of the spamassassin one but i thought someone might be kind enough to help anyway. TIA I'm trying to do site-wide spam filtering with a public namespace but it's not reading the folder i have in the public namespace This is the public namespace set in my dovecot.conf #public spam folder namespace public { separator = / prefix = Filter/ location = maildir:/home/vmail/domains/Spam/Maildir/ hidden = no } There's also a .Spam and .Non-spam folder created in that directory server:/home/vmail/domains/Spam/Maildir# ls -al total 32 drwxrwxrwx 7 vmail vmail 4096 2007-10-09 10:35 . drwxrwxrwx 3 vmail vmail 4096 2007-10-05 13:23 .. drwx------ 2 vmail vmail 4096 2007-10-09 10:35 cur drwx------ 2 vmail vmail 4096 2007-10-09 10:35 new drwxrwxrwx 5 vmail vmail 4096 2007-10-09 11:20 .Non-Spam drwxrwxrwx 5 vmail vmail 4096 2007-10-09 11:19 .Spam -rw------- 1 vmail vmail 14 2007-10-08 11:58 subscriptions drwx------ 2 vmail vmail 4096 2007-10-09 10:35 tmp I'm trying to use this script to login and get the spam from the public spam folders and send it to spamassassin to learn I've highlighted the important parts There are 13 messages in Spam There are 5 messages in Non-Spam Here's the script: ######################################################################################### #!/usr/bin/perl # # Process mail from imap server shared folder 'spam' & 'not-spam' through spamassassin sa-learn # dmz(a)dmzs.com - March 19, 2004 # http://www.dmzs.com/tools/files/spam.phtml # LGPL # # Things to try if it doesn't work # 1) Turn debug onto 1 and see if you connect to imap server ad get messages (yes i could have made a command line flag, just didn't see the need once I got it working :) # 2) Check your local.cf for spamassassin (in debian it's /etc/spamassassin/local.cf) bayes_path settings. # # Also be sure to check that your spamassassin is truely using the bayes files (-D manual startup of spamd to debug there) # use Mail::IMAPClient; use IO::Socket::SSL; my $debug=1; my $salearn; my $username = 'user'; my $password = 'password'; my $server = 'server.example.com'; my $ssl=new IO::Socket::SSL("$server:imaps"); die ("Error connecting - $@") unless defined $ssl; $ssl->autoflush(1); my $imap = Mail::IMAPClient->new( #Server=> 'imapmailhost:143', Socket => $ssl, User => $username, Password => $password, Debug => $debug ); if (!defined($imap)) { die "IMAP Login Failed"; } # If debugging, print out the total counts for each mailbox if ($debug) { foreach my $foldername ($imap->folders) { my $number_of_messages = $imap->message_count( $foldername ); print $foldername, " is imap folder\n"; }* my $spamcount = $imap->message_count('Filter/Spam');* print $spamcount, " Spam to process\n"; * my $nonspamcount = $imap->message_count('Filter/Non-Spam');* print $nonspamcount, " Notspam to process\n" if $debug; } # Process the spam mailbox *$imap->select('Filter/Spam');* my @msgs = $imap->search("ALL"); for (my $i=0;$i <= $#msgs; $i++) { # I put it into a file for processing, doing it into a perl var & piping through sa-learn just didn't seem to work $imap->message_to_file("/tmp/salearn",$msgs[$i]); # execute sa-learn w/data # if ($debug) { $salearn = `/usr/bin/sa-learn -D --no-sync --showdots --spam /tmp/salearn`; } # else { $salearn = `/usr/bin/sa-learn --no-sync --showdots --spam /tmp/salearn`; } print "-------\nSpam: ",$salearn,"\n-------\n" if $debug; # delete processed message $imap->delete_message($msgs[$i]); unlink("/tmp/salearn"); } $imap->expunge(); $imap->close(); # Process the not-spam mailbox *$imap->select('Filter/Non-spam');* my @msgs = $imap->search("ALL"); for (my $i=0;$i <= $#msgs; $i++) { $imap->message_to_file("/tmp/salearn",$msgs[$i]); # execute sa-learn w/data # if ($debug) { $salearn = `/usr/bin/sa-learn -D --no-sync --showdots --ham /tmp/salearn`; } # else { $salearn = `/usr/bin/sa-learn --no-sync --showdots --ham /tmp/salearn`; } print "-------\nNotSpam: ",$salearn,"\n-------\n" if $debug; # delete processed message $imap->delete_message($msgs[$i]); unlink("/tmp/salearn"); } $imap->expunge(); $imap->close(); $imap->logout(); # integrate learned stuff my $sarebuild = `/usr/bin/sa-learn --sync`; print "-------\nRebuild: ",$sarebuild,"\n-------\n" if $debug; ######################################################################################### Results: server:/home/james# ./DMZS-sa-learn.pl Using Mail::IMAPClient version 2.2.9 and perl version 5.8.8 (5.008008) Spam to process Notspam to process . ------- Spam: Learned tokens from 0 message(s) (1 message(s) examined) ------- Autoloading: UID store +FLAGS.SILENT (\Deleted) . ------- NotSpam: Learned tokens from 1 message(s) (1 message(s) examined) ------- Autoloading: UID store +FLAGS.SILENT (\Deleted) ------- Rebuild: bayes: synced databases from journal in 0 seconds: 4 unique entries (4 total entries) -------

1 1

[Dovecot] Dovecot hanging up with many defunct processes
by Mayank Joshi 09 Oct '07

09 Oct '07

Hi, I am in a very awkward situation and need some kind of immediate fix up. I had installed dovecot in my organization as part of migration of email server. The setup involves sendmail, dovecot (imaps+pop3s) and webmail (squirrelmail) running on apache webserver. All was working fine until one day I found a lot of defunct processes on system related to dovecot. dovecot-auth, imap-login and imap were all defunct. The system is using pam_ldap and nss_ldap to authenticate users to a Windows 2003 Active Directory. Immediate restart of dovecot solved the problem for me that day, however since then it's been about 3 times that I've faced this problem. After visiting various forums I came to know one thing, that it has something to do with pam_ldap and nss_ldap. However with UW-IMAP we were using the same setup and we didn't find any problems there. It would be very kind of you, if you can help me out on this front as apart from these mishaps the mail server is running perfectly fine and we wish to continue using Dovecot for our setup in future as well. Following is the system details: 1) OS: RHEL4 (Kernel - 2.6.9-5.ELsmp) 2) Dovecot: Dovecot (Version - 1.0.3) 3) Following is dovecot configuration: log_path: /var/log/dovecot.log protocols: imaps pop3s ssl_cert_file: /usr/share/ssl/certs/imapd.pem ssl_key_file: /usr/share/ssl/private/imapd.pem login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login max_mail_processes: 10240 mail_location: mbox:~/mail:INBOX=/var/mail/%u mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: passdb: driver: pam userdb: driver: passwd 4) Dovecot's PAM file (/etc/pam.d/dovecot) #%PAM-1.0 auth required pam_ldap.so account required pam_ldap.so session required pam_mkhomedir.so skel=/etc/skel umask=0077 session required pam_ldap.so As far as I feel it's problem with pam_ldap not able to authenticate against Windows 2003 Active Directory due to some reason or the other. However I'm not sure why is this happening. Regards, Mayank Joshi.

3 2

[Dovecot] undelete messages?
by Cory Coager 08 Oct '07

08 Oct '07

I'm using the lazy expunge plugin as configured in: http://wiki.dovecot.org/Plugins/Lazyexpunge The page claims users can undelete messages without assistance from a sysadmin. How is this accomplished? When I try to subscribe to the folders under the EXPUNGED namespace, nothing happens. ~Cory Coager

2 4

[Dovecot] global sieve script
by Jorge Salamero Sanz 08 Oct '07

08 Oct '07

hi all, i'm moving from a maildrop+courier setup to lda(sieve)+dovecot setup. with maildrop i had a global filter for all the users, so i could filter and archive into the spam folder spam tagged emails for users without custom filters, including them if they exist: LOGNAME=tolower($LOGNAME) `test -e $LOGNAME` if ( $RETURNCODE != 0 ) { `maildirmake $LOGNAME` `maildirmake $LOGNAME/._spam` } `test -f $LOGNAME/mailfilter` if ( $RETURNCODE == 0 ) { include "$LOGNAME/mailfilter" } if ( /^X-Spam-Status: YES */) { to "$LOGNAME/._spam" } else { to "$LOGNAME/" } how could i get this behaviour with dovecot lda and sieve ? thanks !

3 2

Re: [Dovecot] Moving email from a folder to another using IMAP isvery slow (sometimes)
by Stefano Scalise 08 Oct '07

08 Oct '07

Hi to all, I can confirm that if I downgrade to 1.0.5 version I have no more the slowness problem. Then I think it is a bug introduced in th 1.1.x releases. Stefano. ----- Original Message ----- From: "Stefano Scalise" <s.scalise(a)tno.it> To: "Stefano Scalise" <s.scalise(a)tno.it>; "Timo Sirainen" <tss(a)iki.fi> Cc: <dovecot(a)dovecot.org> Sent: Tuesday, October 02, 2007 12:04 PM Subject: Re: [Dovecot] Moving email from a folder to another using IMAP isvery slow (sometimes) > Hi to all, > > very strange! I tried to debug why imap process takes 100% CPu and it is > very slow when I move an email from an imap folder to another imap folder > and then I typed: > > strace -tt -o /log-imap.txt -p <process number> > > well, during the trace the imap process doesn't crash and it is very fast. > If I stop the tracing, I have again the problem and sometimes the crash of > the process. > > Any help? > Thank you, > Stefano. > > ----- Original Message ----- > From: "Stefano Scalise" <s.scalise(a)tno.it> > To: "Timo Sirainen" <tss(a)iki.fi> > Cc: <dovecot(a)dovecot.org> > Sent: Monday, October 01, 2007 4:21 PM > Subject: Re: [Dovecot] Moving email from a folder to another using IMAP > isvery slow (sometimes) > > >> Sorry, but with the new version (1.1.beta2), I still have the same >> problem of very slowness during moving email between two imap folders. >> What can I do for debugging it? >> Stefano. >> >> ----- Original Message ----- >> From: "Timo Sirainen" <tss(a)iki.fi> >> To: "Stefano Scalise" <s.scalise(a)tno.it> >> Cc: <dovecot(a)dovecot.org> >> Sent: Sunday, September 30, 2007 1:52 PM >> Subject: Re: [Dovecot] Moving email from a folder to another using IMAP >> isvery slow (sometimes) >> >> On Wed, 2007-09-26 at 12:05 +0200, Stefano Scalise wrote: >>> Update to the problem: >>> >>> I tried to stress the server with many moving and I received: >>> >>> Sep 26 10:56:40 sirio3 dovecot: IMAP(<email_address>): Trying to >>> allocate 0 >>> bytes >> >> This should fix it: http://hg.dovecot.org/dovecot/rev/c6b85cf1e63a >> >> I'll probably make a beta2 release today after fixing several other >> things. >> >> >

1 0

[Dovecot] User database ldap lookups and sasl
by olivier castan 08 Oct '07

08 Oct '07

Hello I'm currently trying to use Active Directory with Unix extensions to store UID, GID and homedir and retrieve them with ldap I don't want to allow anonymous bindings and I would rather not use TLS and manage a PKI. So I'm trying to use SASL to do a Kerberos authentication for Dovecot against AD LDAP. I'm currently getting GSSAPI errors about the lack of "credentials cache". Looking at similar cases where services act as clients, like using nss_ldap for unix host accounts, I understand the credentials cache should be initiated by an external program (cron and startup script), at least with the TGT and maybe the TGS for ldap. Since usually kerberosv5 cache is based on the user id ( /tmp/krb5cc_0 for root) there's an option in ldap.conf (krb5_ccname) to set the filename (/etc/.ldapcache in nss_ldap tutorials) for this cache. Is there any way to do this with dovecot-ldap.conf or should I try to use "auth user" default cache filename ? Thanks in advance

1 0

[Dovecot] quota exceeded not showing email address
by JC 07 Oct '07

07 Oct '07

Hi everyone, I have a mail server with postfix 2.3.8-2, dovecot 1.0.0 and mysql with virtual users and domains. Everything is working but when a mail bounces it doesn't show me what is the email address with overquota. I'm using Dovecot Delivery Agent to send a mail when an email bounces. This is the message that shows me: Your message was automatically rejected by Dovecot Mail Delivery Agent. The following reason was given: Quota exceeded It doesn't show me what is the email address. In my /etc/postfix/master.cf I added this: dovecot unix - n n - - pipe flags=DRhu user=xyz:xyz argv=/usr/lib/dovecot/deliver -d ${recipient} In my /etc/postfix/main.cf I added this: dovecot_destination_recipient_limit = 1 virtual_transport = dovecot In my /etc/dovecot/dovecot.conf : protocol lda { postmaster_address = <postmaster-address> auth_socket_path = /var/run/dovecot/auth-master } ... user = xyz socket listen { master { path = /var/run/dovecot/auth-master mode = 0660 user = xyz group = xyz } } What should i have to show the email address?

1 0

Re: [Dovecot] Postfix with Deliver (LDA) - user unknown
by Branislav Baca 06 Oct '07

06 Oct '07

Glenn wrote: > Howdy BB! Hopefully this helps to answer your questions... > > /etc/mail/postfix/vmailboxes contains: > > test(a)geekinetdev.com test/ > > /etc/passwd contains: > > test:*:5000:5000:test account for email:/var/mailboxes/test:/nonexistent probably you need here to have a full user@domain name. i.e: test@geekinetdev.com:*:5000:5000:test account for email:/var/mailboxes/test:/nonexistent > > The reason for the virtual_* stuff is that I am testing each program > configuration as I set up a new SMTP server. The goal is to move all > the virtual_* settings to MySQL. However, I want to walk before I run. > Not sure if that is part of my problem.?. Of course, you can leave it there, I've just said it is not necessary for dovecot to work. Also try to avoid using mysql, except you have dedicated mysql server or playing on small site with a lot of RAM. This is by my own experiences. LDAP is probably better solution but more complex to setup. > > Thanks for your assistance! > > glenn > > > Branislav Baca wrote: >> You have set in the main.cf: >> virtual_mailbox_maps = hash:/etc/mail/postfix/vmailboxes >> but dovecot deliver is using userdb for this purpose, which you have >> set to >> passwd. Have you equivalent data in both places? Similary nearly all >> configuration parameters in the main.cf of the postfix starting with >> virtual_??? are not required, but should be provided by userdb for >> dovecot >> deliver. >> >> BB >> >> On 1:26 04/10/07 "Karin Gregorec" <karinnv1(a)gmail.com> wrote: >>> Good Day All! I am attempting to configure deliver as our LDA. I am >>> also configuring the server to use Postfix instead of Sendmail. I >>> have followed the all the documentation and examples I could find. >>> >>> Below are my Dovecot and Postfix configs. Can someone please smack me >>> upside the head and tell me why I am getting "user unknown" errors? >>> If i don't use deliver as the LDA, all works perfectly. Help... >>> >>> TIA, >>> glenn >>> >>> ========== >>> >>> >>> *** Dovecot Config *** >>> >>> dovecot -n >>> # 1.0.5: /usr/local/etc/dovecot.conf >>> base_dir: /var/run/dovecot/ >>> log_path: /var/log/maillogs/dovecot.log >>> protocols: imap imaps pop3 pop3s >>> ssl_cipher_list: ALL:!LOW >>> disable_plaintext_auth: no >>> verbose_ssl: yes >>> login_dir: /var/run/dovecot/login >>> login_executable(default): /usr/local/libexec/dovecot/imap-login >>> login_executable(imap): /usr/local/libexec/dovecot/imap-login >>> login_executable(pop3): /usr/local/libexec/dovecot/pop3-login >>> login_greeting: GID Ready >>> login_log_format_elements: user=<%u> service=%s authMethod=%m rIP=%r >>> lIP=%l encryption=%c >>> login_max_processes_count: 256 >>> verbose_proctitle: yes >>> first_valid_uid: 5000 >>> last_valid_uid: 10000 >>> first_valid_gid: 0 >>> mail_extra_groups: mail >>> mail_location: maildir:~/Maildir >>> dotlock_use_excl: yes >>> fsync_disable: yes >>> maildir_copy_with_hardlinks: yes >>> mail_executable(default): /usr/local/libexec/dovecot/imap >>> mail_executable(imap): /usr/local/libexec/dovecot/imap >>> mail_executable(pop3): /usr/local/libexec/dovecot/pop3 >>> mail_process_size: 1024 >>> mail_plugins(default): quota imap_quota >>> mail_plugins(imap): quota imap_quota >>> mail_plugins(pop3): >>> mail_plugin_dir(default): /usr/local/lib/dovecot/imap >>> mail_plugin_dir(imap): /usr/local/lib/dovecot/imap >>> mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 >>> imap_client_workarounds(default): delay-newmail outlook-idle >>> netscape-eoh tb-extra-mailbox-sep >>> imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh >>> tb-extra-mailbox-sep >>> imap_client_workarounds(pop3): outlook-idle >>> pop3_uidl_format(default): >>> pop3_uidl_format(imap): >>> pop3_uidl_format(pop3): %08Xu%08Xv >>> pop3_client_workarounds(default): >>> pop3_client_workarounds(imap): >>> pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh >>> pop3_logout_format(default): top=%t/%p, retr=%r/%b, del=%d/%m, size=%s >>> pop3_logout_format(imap): top=%t/%p, retr=%r/%b, del=%d/%m, size=%s >>> pop3_logout_format(pop3): top=%t/%T, retr=%r/%R, del=%d/%m, size=%s >>> auth default: >>> cache_size: 1024 >>> cache_ttl: 604800 >>> verbose: yes >>> passdb: >>> driver: pam >>> args: cache_key=%Lu >>> userdb: >>> driver: passwd >>> socket: >>> type: listen >>> master: >>> path: /var/run/dovecot/auth-master >>> mode: 384 >>> user: maildrop >>> plugin: >>> quota: maildir:storage=10000000:ignore=Trash >>> >>> >>> *** Postfix main.cf *** >>> >>> alias_database = hash:/etc/mail/postfix/aliases >>> alias_maps = hash:/etc/mail/postfix/aliases >>> biff = no >>> command_directory = /usr/local/sbin >>> daemon_directory = /usr/local/libexec/postfix >>> >>> debug_peer_level = 2 >>> debugger_command = >>> PATH=/bin:/usr/bin:/usr/local/bin; export PATH; (echo cont; >>> echo where) | gdb $daemon_directory/$process_name $process_id 2>&1 >>> > $config_directory/$process_name.$process_id.log & sleep 5 >>> >>> #### Dovecot LDA Service - http://wiki.dovecot.org/LDA/Postfix >>> dovecot_destination_recipient_limit = 1 >>> >>> home_mailbox = Maildir/ >>> html_directory = no >>> inet_interfaces = all >>> mail_owner = postfix >>> mail_spool_directory = /var/mail >>> mailq_path = /usr/local/bin/mailq >>> manpage_directory = /usr/local/man >>> message_size_limit = 12000000 >>> mydestination = $myhostname, localhost.$mydomain, localhost >>> mydomain = geekinternetdevelopment.com >>> myhostname = superman.geekinternetdevelopment.com >>> mynetworks = 72.18.193.0/24, 127.0.0.0/8 >>> newaliases_path = /usr/local/bin/newaliases >>> queue_directory = /var/spool/postfix >>> readme_directory = no >>> sample_directory = /usr/local/etc/postfix >>> sendmail_path = /usr/local/sbin/sendmail >>> setgid_group = maildrop >>> smtpd_banner = $myhostname NO WHAMMIES!!! >>> >>> virtual_gid_maps = static:5000 >>> virtual_mailbox_base = /var/mailboxes >>> virtual_mailbox_domains = hash:/etc/mail/postfix/vdomains >>> virtual_mailbox_maps = hash:/etc/mail/postfix/vmailboxes >>> virtual_minimum_uid = 1000 >>> virtual_transport = dovecot >>> virtual_uid_maps = static:5000 >>> unknown_local_recipient_reject_code = 550 >>> >>> *** Postfix master.cf *** >>> ...snip... >>> dovecot unix - n n - - pipe >>> flags=DRhu user=maildrop:maildrop >>> argv=/usr/local/libexec/dovecot/deliver -e -d ${recipient} > >

1 0

[Dovecot] dovecot cloning mails?
by Andreas Schneider 06 Oct '07

06 Oct '07

Hi, I have a strange issue here. I have a large message of a svn commit and the message is cloning itself more and more. I've deleted it several time completely but it doesn't go away. http://www.cynapses.org/tmp/dovecot.png How can I debug it? Thanks, -- andreas milliways:~ # dovecot -n # 1.0.5: /etc/dovecot/dovecot.conf base_dir: /var/run/dovecot/ log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve listen(default): * listen(imap): * listen(managesieve): *:2000 ssl_ca_file: /etc/ssl/certs/cacert.pem ssl_cert_file: /etc/ssl/certs/milliways.pem ssl_key_file: /etc/ssl/private/milliways.key login_dir(default): /var/run/dovecot//login login_dir(imap): /var/run/dovecot//login login_dir(managesieve): login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login first_valid_uid: 150 last_valid_uid: 150 mail_extra_groups: mail mail_location: maildir:/srv/mail/%u maildir_copy_with_hardlinks: yes mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): dspam mail_plugins(imap): dspam mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib64/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib64/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib64/dovecot/modules/managesieve auth default: passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: mail plugin: dspam_spamfolder: Junk -- http://www.cynapses.org/ - cybernetic synapses

2 2