- dovecot - dovecot.org

[Dovecot] can not receive email upgrading from ubuntu 11.4 to 11.10
by Nikolaos Petronikolos 21 Oct '11

21 Oct '11

Dear all, I have the following error when i am sending an email to my email server postfix + dovecot. #5.3.0 x-unix; /usr/lib/dovecot/deliver: invalid option -- 'n' Usage: dovecot-lda [-c <config file>] [-a <address>] [-d <username>] [-p <path>] [-f <envelope sender>] [-m <mailbox>] [-e] [-k]> #SMTP# The problem occurred after i upgraded my server from ubuntu 11.4 to 11.10. i kindly ask you if you can help me thank you in advance for your kind attention. -- View this message in context: http://old.nabble.com/can-not-receive-email-upgrading-from-ubuntu-11.4-to-1… Sent from the Dovecot mailing list archive at Nabble.com.

2 2

[Dovecot] Don't Know Where Emails Are Or What's Happening
by Jack Fredrikson 21 Oct '11

21 Oct '11

Hi; I'm new to Dovecot and Postfix. I'm trying to enable these with MySQL support and postfixadmin. I've got all those services up and running (finally!); however, I can't figure out if the emails are being received and/or stored. I'm pretty sure Postfix is receiving them because I dealt with certain errors and they're now gone. Here's some data: Dovecot ver. 0.91 [root@example postfix]# /sbin/service dovecot -n doveconf: Warning: NOTE: You can get a new clean config file with: doveconf -n > dovecot-new.conf doveconf: Warning: Obsolete setting in /usr/local/etc/dovecot/dovecot.conf:5: imap_client_workarounds=outlook-idle is no longer necessary doveconf: Warning: Obsolete setting in /usr/local/etc/dovecot/dovecot.conf:17: add auth_ prefix to all settings inside auth {} and remove the auth {} section completely doveconf: Warning: Obsolete setting in /usr/local/etc/dovecot/dovecot.conf:21: passdb sql {} has been replaced by passdb { driver=sql } doveconf: Warning: Obsolete setting in /usr/local/etc/dovecot/dovecot.conf:24: userdb sql {} has been replaced by userdb { driver=sql } doveconf: Warning: Obsolete setting in /usr/local/etc/dovecot/dovecot.conf:27: userdb prefetch {} has been replaced by userdb { driver=prefetch } doveconf: Warning: Obsolete setting in /usr/local/etc/dovecot/dovecot.conf:29: auth_user has been replaced by service auth { user } Usage: /etc/init.d/dovecot {start|stop|reload|restart|force-reload} tail /var/log/maillog Oct 20 10:13:59 example postfix/smtpd[28141]: warning: problem talking to service rewrite: Success Oct 20 10:13:59 example postfix/master[4000]: warning: process /usr/libexec/postfix/trivial-rewrite pid 30178 exit status 1 Oct 20 10:13:59 example postfix/master[4000]: warning: process /usr/libexec/postfix/trivial-rewrite pid 30179 exit status 1 Oct 20 10:13:59 example postfix/smtpd[28458]: warning: problem talking to service rewrite: Success Oct 20 10:13:59 example postfix/master[4000]: warning: process /usr/libexec/postfix/trivial-rewrite pid 30180 exit status 1 Oct 20 10:13:59 example postfix/master[4000]: warning: process /usr/libexec/postfix/trivial-rewrite pid 30181 exit status 1 Oct 20 10:13:59 example postfix/smtpd[28483]: warning: problem talking to service rewrite: Success Oct 20 10:13:59 example postfix/smtpd[28460]: warning: problem talking to service rewrite: Success Oct 20 10:13:59 example postfix/master[4000]: warning: process /usr/libexec/postfix/trivial-rewrite pid 30182 exit status 1 Oct 20 10:13:59 example postfix/smtpd[28455]: warning: problem talking to service rewrite: Success Oct 20 10:13:59 example postfix/master[4000]: warning: process /usr/libexec/postfix/trivial-rewrite pid 30183 exit status 1 Oct 20 10:13:59 example postfix/smtpd[28484]: warning: problem talking to service rewrite: Success Oct 20 10:13:59 example postfix/master[4000]: warning: process /usr/libexec/postfix/trivial-rewrite pid 30184 exit status 1 Oct 20 10:13:59 example postfix/smtpd[29917]: warning: problem talking to service rewrite: Success Oct 20 10:13:59 example postfix/master[4000]: warning: process /usr/libexec/postfix/trivial-rewrite pid 30185 exit status 1 Oct 20 10:13:59 example postfix/smtpd[29953]: warning: problem talking to service rewrite: Success Oct 20 10:13:59 example postfix/master[4000]: warning: process /usr/libexec/postfix/trivial-rewrite pid 30186 exit status 1 Oct 20 10:13:59 example postfix/smtpd[28485]: warning: problem talking to service rewrite: Success Oct 20 10:13:59 example postfix/master[4000]: warning: process /usr/libexec/postfix/trivial-rewrite pid 30187 exit status 1 Oct 20 10:14:15 example postfix/smtpd[30152]: connect from unknown[66.248.165.32] Oct 20 10:14:15 example postfix/smtpd[30152]: lost connection after EHLO from unknown[66.248.165.32] Oct 20 10:14:15 example postfix/smtpd[30152]: disconnect from unknown[66.248.165.32] I also get this in there: Oct 20 10:13:15 example postfix/smtpd[30152]: warning: dict_nis_init: NIS domain name not set - NIS lookups disabled Oct 20 10:13:15 example postfix/smtpd[30152]: cannot load Certificate Authority data: disabling TLS support Oct 20 10:13:15 example postfix/smtpd[30152]: warning: TLS library problem: 30152:error:02001002:system library:fopen:No such file or directory:bss_file.c:122:fopen('/etc/pki/tls/c erts/cert.pem','r'): Oct 20 10:13:15 example postfix/smtpd[30152]: warning: TLS library problem: 30152:error:2006D080:BIO routines:BIO_new_file:no such file:bss_file.c:125: Oct 20 10:13:15 example postfix/smtpd[30152]: warning: TLS library problem: 30152:error:0B084002:x509 certificate routines:X509_load_cert_crl_file:system lib:by_file.c:279: Oct 20 10:13:15 example postfix/smtpd[30152]: connect from unknown[66.248.165.32] Oct 20 10:13:15 example postfix/smtpd[30152]: lost connection after EHLO from unknown[66.248.165.32] Oct 20 10:13:15 example postfix/smtpd[30152]: disconnect from unknown[66.248.165.32] Oct 20 10:13:57 example postfix/proxymap[28446]: warning: mysql query failed: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version f or the right syntax to use near '??gifteatszone.com??? AND active = 1' at line 1 Oct 20 10:13:57 example postfix/trivial-rewrite[30154]: fatal: proxy:mysql:/etc/postfix/mysql_virtual_alias_maps.cf(0,lock|fold_fix): table lookup problem Oct 20 10:13:57 example postfix/trivial-rewrite[30155]: fatal: proxy:mysql:/etc/postfix/mysql_virtual_alias_maps.cf(0,lock|fold_fix): table lookup problem Oct 20 10:13:57 example postfix/proxymap[28444]: warning: mysql query failed: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version f or the right syntax to use near '??awakelunch.info??? AND active = 1' at line 1 I reckon the failing of mysql inquiries just has to do with hackers trying to hack me. The TLS problem isn't mission-critical since it's just getting disabled. [root@example jack]# ps wax|grep dovecot 20223 ? Ss 0:00 /usr/local/sbin/dovecot 20224 ? S 0:00 dovecot/anvil 20225 ? S 0:00 dovecot/log 31832 ? S 0:00 dovecot/config 31833 ? S 0:00 dovecot/auth 31836 pts/2 S+ 0:00 grep dovecot [root@example jack]# ps wax|grep postfix 4000 ? Ss 0:01 /usr/libexec/postfix/master 31839 pts/2 S+ 0:00 grep postfix [root@example jack]# ps wax|grep postfixadmin 31842 pts/2 S+ 0:00 grep postfixadmin [root@example jack]# ps wax|grep saslauthd 16337 ? Ss 0:00 /usr/sbin/saslauthd -m /var/run/saslauthd -a pam -n 2 16338 ? S 0:00 /usr/sbin/saslauthd -m /var/run/saslauthd -a pam -n 2 25718 ? S 0:00 /usr/sbin/saslauthd -d -a pam 25719 ? S 0:00 /usr/sbin/saslauthd -d -a pam 25720 ? S 0:00 /usr/sbin/saslauthd -d -a pam 25721 ? S 0:00 /usr/sbin/saslauthd -d -a pam 25722 ? S 0:00 /usr/sbin/saslauthd -d -a pam 32052 pts/2 S+ 0:00 grep saslauthd I also tried this: First send a test mail to yourself (as your own non-root user): echo "Hello me" | mail -s "Dovecot test" $USER Now, find where the mail went. Here's a simple script which checks the most common locations: for mbox in /var/mail/$USER /var/spool/mail/$USER ~/mbox ~/mail/* ~/*; do grep -q "Dovecot test" $mbox && echo "mbox: $mbox" done grep -q "Dovecot test" ~/Maildir/new/* 2>/dev/null && echo "Maildir: ~/Maildir" and the mail was not found. This from my dovecot.conf file: mail_location = maildir:/var/vmail/%d/%u #but there's nothing there. ... auth default { # Having "login" also as a mechanism make sure outlook can use the auth smtpd as well # http://wiki.dovecot.org/Authentication/Mechanisms mechanisms = plain login passdb sql { args = /usr/local/etc/dovecot/sql.conf } userdb sql { args = /usr/local/etc/dovecot/sql.conf } userdb prefetch { } user = nobody socket listen { master { path = /var/run/dovecot/auth-master mode = 0660 user = vmail group = mail } client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = mail } } } Telnetting to port 25 brings up Postfix, to port 110 brings up Dovecot TIA,Jack

2 6

[Dovecot] Quota
by nuno marques 21 Oct '11

21 Oct '11

hi, I'm having some difficulty understanding the connection between postfix, dovecot and quota. What is the best way to set up quotas? through the file system quota and maildir? Need the dovecot lda working? The postfix needs a patch? I was thinking about setting quotas on file system, then configure Postfix to connect to dovecot-lda. Any suggestion? The system as a whole is composed of:dovecot-2.0-0.10.beta6.20100630.el6.x86_64 -> 2.0.beta6 (3156315704ef)openldap-servers-2.4.19-15.el6_0.2.x86_64postfix-2.6.6-2.1.el6_0.x86_64mailscanner-4.84.3-1.noarchspamassassin-3.3.1-2.el6.x86_64centos 6 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011 x86_64 x86_64 x86_64 GNU/Linux

4 4

[Dovecot] Email filters
by Jos Chrispijn 21 Oct '11

21 Oct '11

Can someone tell me how I can configure Dovecot to use message filters on incoming email? When I now activate my mail account on my mobile phone and Thunderbird (or any other mail client with message filters) is not online, I get a huge pile of email in my INBOX that I have to go thru, while 90% is not that interesting to read as they belong to Spam messages, newsletters etc. Thanks in advance Jos Chrispijn

2 3

[Dovecot] Expire plugin not executing for sieve plugin?
by Dan Swartzendruber 20 Oct '11

20 Oct '11

Running dovecot 1.2.12 on ubuntu 10.10. Here is the problem: I have mysql backend for expire. I am using the dovecot-postfix package which creates /etc/dovecot/conf.d/01-mail-stack-delivery.conf which looks like this: # Some general options protocols = imap imaps managesieve disable_plaintext_auth = no ssl = yes ssl_cert_file = /etc/ssl/certs/ssl-mail.pem ssl_key_file = /etc/ssl/private/ssl-mail.key ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM mail_location = maildir:~/Maildir auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ # IMAP configuration protocol imap { mail_max_userip_connections = 10 imap_client_workarounds = outlook-idle delay-newmail mail_plugins = expire } # LDA configuration protocol lda { postmaster_address = postmaster mail_plugins = sieve expire quota_full_tempfail = yes deliver_log_format = msgid=%m: %$ rejection_reason = Your message to <%t> was automatically rejected:%n%r } # Plugins configuration plugin { sieve=~/.dovecot.sieve sieve_dir=~/sieve # If the user has no personal active script (i.e. if the file # indicated in sieve= does not exist), use this one: sieve_global_path = /var/lib/dovecot/sieve/default.sieve } The sieve is: require "fileinto"; require "imap4flags"; if header :contains "X-Spam-Flag" "YES" { setflag "\\Seen"; fileinto "SPAM"; stop; } Originally, this did not have the setflag or stop - I added them hoping to fix the problem, but no luck. The problem is this: when spam assassin has flagged a message as spam, the sieve runs and the message is in fact filed into the SPAM folder, but no expire entry is added to the database. If I move such a message from the SPAM folder to the Inbox and then back to SPAM, voila, I *do* get the entry created. Here is the mysql table before and after I did the move/move: mysql> select * from expires; +----------+---------------+--------------+ | username | mailbox | expire_stamp | +----------+---------------+--------------+ | dswartz | Deleted Items | 1319720163 | | dswartz | Sent | 1319120165 | | denise | Trash | 1319139920 | | samantha | Trash | 1319136146 | | denise | Sent | 1319655872 | | danielle | Sent | 1319192230 | | samantha | Sent | 1319268855 | | dswartz | Trash | 1319725884 | | samantha | SPAM | 1321504531 | +----------+---------------+--------------+ 9 rows in set (0.00 sec) mysql> select * from expires; +----------+---------------+--------------+ | username | mailbox | expire_stamp | +----------+---------------+--------------+ | dswartz | Deleted Items | 1319720163 | | dswartz | Sent | 1319120165 | | denise | Trash | 1319139920 | | samantha | Trash | 1319136146 | | denise | Sent | 1319655872 | | danielle | Sent | 1319192230 | | samantha | Sent | 1319268855 | | dswartz | Trash | 1319725884 | | samantha | SPAM | 1321504531 | | dswartz | SPAM | 1321714666 | +----------+---------------+--------------+ 10 rows in set (0.00 sec) It's almost like the fileinto stuff is not running the plugin code at all, or am I totally on drugs? If I can't get a fix for this, I at least now can think of a hack to "fix" it. e.g. every night, run a script that adds a "now" timestamp for everyone's SPAM folder to trick the periodic expire tool code into checking that folder, but obviously I'd rather have a real fix :) If this is just 'how it works', is it better in 2.0?

1 0

[Dovecot] too many open files and v1.2
by Michael Moritz 20 Oct '11

20 Oct '11

Hi I've found an older thread http://www.dovecot.org/list/dovecot/2010-March/047886.html which mentions that this is a bug in version 1. I'm on Debian squeeze (1:1.2.15-7) and got errors like these recently Oct 5 11:29:29 mail dovecot: dovecot: pipe() failed: Too many open files Oct 5 11:29:32 mail dovecot: dovecot: pipe() failed: Too many open files Oct 5 11:29:32 mail dovecot: dovecot: Temporary failure in creating login processes, slowing down for now As a work around I've increased login_max_processes_count from 256 to 512 and it seems to have helped (as I suspected stale opened files). My colleague thinks it's hitting the kernel open file limit ulimit -n (currently at 1024) but I don't see how that could happen if the number of process is nowhere near that. Any ideas? Thanks, Michael

2 2

[Dovecot] Is '*:bytes=" quota specification the quota 'Value', or 'Limit'?
by Rich 19 Oct '11

19 Oct '11

Docs for quota configuration http://wiki2.dovecot.org/Quota/Configuration#Limit_configuration state that the 'bytes=' specification defines the quota **LIMIT** "bytes: Quota limit in bytes, 0 means unlimited" as used in plugin { ... quota_rule = *:bytes=10000000 ... BUT, documentation for quota dict http://wiki2.dovecot.org/Quota/Dict states "MySQL uses the following queries to update the quota" and provides an SQL example of Dovecot decrementing the 'bytes' value, "UPDATE table SET bytes=bytes-14433,messages=messages-2 ..." I'm working on a current problem (http://dovecot.org/list/dovecot/2011-October/061538.html) with 'doveadm' reporting mixing up quote Value & Limit. Question: Is 'bytes' supposed to contain the Value, or the Limit? Rich

1 0

[Dovecot] 'doveadm quota get' dictionary SQL query ignores specified '@domain' part of username. bad config or bug?
by Rich 19 Oct '11

19 Oct '11

Hi, I'm setting up SQL quota usage in Dovecot2. I've created a MAILBOX parameter table, 'PARAMS', that contains unique <user>@<domain> pairs, with quota data. mysql> select * from PARAMS; +----+------------------------+------------+-------------+------------+ | ai | MAILBOX_user_domain | quota | quota_bytes | quota_msgs | +----+------------------------+------------+-------------+------------+ | 1 | myuser(a)domain1.com | 1073741824 | 0 | 0 | | 2 | myuser(a)domain2.com | 1000000000 | 0 | 0 | +----+------------------------+------------+-------------+------------+ 2 rows in set (0.00 sec) I've specified dict usage for quota, /etc/dovecot/dovecot.conf !include conf.d/*.conf protocols = imap lmtp dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } created the maps, /etc/dovecot/dovecot-dict-sql.conf.ext connect = host=/var/run/mysql/mysql.sock dbname=my_db user=my_user password=my_pass map { pattern = priv/quota/storage table = PARAMS username_field = MAILBOX_user_domain value_field = quota_bytes } map { pattern = priv/quota/messages table = PARAMS username_field = MAILBOX_user_domain value_field = quota_msgs } assigned the global values and backend, /etc/dovecot/conf.d/90-quota.conf plugin { quota = dict:User Quota::proxy::quota quota_rule = *:storage=1GB:messages=10000 quota_rule2 = Trash:storage=+10%% } and specified the user iteration query /etc/dovecot/sql/virtmail-userdb-sql.cf driver = mysql connect = host=/var/run/mysql/mysql.sock dbname=my_db user=my_user password=my_pass user_query = CALL UserDBQuery('%n','%d'); iterate_query = SELECT `MAILBOX_user_domain` AS user FROM `PARAMS`; Verifying operation with with `doveadm`, I get a result from a !error query, doveadm quota get -u myuser(a)domain1.com Quota name Type Value Limit % User quota STORAGE 0 1048576 0 User quota MESSAGE 0 10000 0 doveadm quota get -u myuser(a)domain2.com Quota name Type Value Limit % User quota STORAGE 0 1048576 0 User quota MESSAGE 0 10000 0 But notice that there's no specificity by *domain*. Despite being provided the full <user>@<domain>, matched to the map, username_field = MAILBOX_user_domain the Dovecot dict query seems to ignore the <domain> part, and simply matches on the first of the tow identical <user> parts. Specifying "-A" doesn't help, doveadm quota get -A Username Quota name Type Value Limit % myuser(a)domain1.com User quota STORAGE 0 1048576 0 myuser(a)domain1.com User quota MESSAGE 0 10000 0 myuser(a)domain2.com User quota STORAGE 0 1048576 0 myuser(a)domain2.com User quota MESSAGE 0 10000 0 What needs to be done to get domain-specificity in the 'doveadm quota get' query? Is my configuration off, or incomplete, or is this a bug? Thanks, Rich

1 1

Re: [Dovecot] "doveadm log reopen" don't reopen separate lmtp log
by Henrik Larsson 18 Oct '11

18 Oct '11

I still see the issue below. Is there anyone running separate LMTP logging that could check if they experience the same issue? Best regards Henrik Larsson -------- Original Message -------- Subject: "doveadm log reopen" don't reopen separate lmtp log Date: Sun, 25 Sep 2011 00:23:49 +0200 From: Henrik Larsson <dovecot-user(a)spambox.dk> To: dovecot(a)dovecot.org Dear all I have setup separate pop3/imap log "/var/log/dovecot" and lmtp delivery log "/var/log/dovecot-deliver". After rotating logfiles, i run "doveadm log reopen". I see that my pop3/imap log "/var/log/dovecot" is used straight away, but my lmpt log "/var/log/dovecot-deliver" isn't used at first. After some time, usually a few minutes, logs are being written to this file anyway. But if I compare this to my maillog, it misses some deliveries just after the log rotation. Is there any problems with this configuration that should be corrected? --cut-- # doveconf -n # 2.0.15: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.2-STABLE amd64 auth_mechanisms = plain login digest-md5 cram-md5 first_valid_uid = 125 hostname = mail.larsson.it listen = * log_path = /var/log/dovecot mail_plugins = fts fts_squat zlib mail_privileged_group = postfix mail_temp_dir = /var/db/dovecot managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace { inbox = yes location = prefix = separator = . type = private } namespace { hidden = yes inbox = no list = no location = prefix = INBOX. separator = . type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { fts = squat fts_squat = partial=4 full=10 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { unix_listener /home/mail/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service lmtp { executable = lmtp -L unix_listener /home/mail/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/mail-chained.crt ssl_key = </etc/ssl/mail.key userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { log_path = /var/log/dovecot-deliver mail_plugins = fts fts_squat zlib sieve } protocol lda { mail_plugins = fts fts_squat zlib sieve } protocol imap { mail_plugins = fts fts_squat zlib imap_zlib } --cut-- Best regards Henrik Larsson

2 3

[Dovecot] mail_location in LDAP and variables
by Joseba Torre 18 Oct '11

18 Oct '11

Hi, Is it posible to use variables in mail_location when taken from ldap? How? I've tried mdbox:/buzones2/'%n'/mdbox mdbox:/buzones2/"%n"/mdbox mdbox:/buzones2/%n/mdbox but %n is never replaced by its value. Thanks! -- Joseba Torre. Vicegerencia de TICs, área de Explotación

2 2

[Dovecot] LDA/Postfix with quotas and without LMTP
by Steve Fatula 18 Oct '11

18 Oct '11

Reading the wiki page for dovecot2 and LDA/Postfix, the system users section (all mail delivery goes to system users)... It shows you can simply use postfix mailbox_command. There is this additional comment: "This command doesn't do a userdb lookup. If you want that (e.g. for per-user quota lookups) you need to add -d "$USER" parameter." So, i added that. Once adding it, I find I get an error: dovecot: lda: Error: userdb lookup: connect(/var/run/dovecot/auth-userdb) failed: Permission denied Using mailbox_command in Postfix means that dovecot-lda is running as the system user getting the mail. Which means it can't access the socket file. Of course, one can simply use mode 666 on it, but, then people can use it to find out information according to the doc, which I do not want. So, I am not sure why the doc says to add -d for per user quotas, without also mentioning the problem with doing that. I don't see how it can work? Assuming I need per user quotas, and I don't want to use LMTP, is there a good way around this without the security issue? Steve

2 2

[Dovecot] Syntax to specify sdbox: mail_location path?
by mephistopheles＠operamail.com 18 Oct '11

18 Oct '11

I'm implementing sdbox. In conf.d/10-mail.conf, with "maildir:" mail_location = maildir:/my_mailbox_path/%d/%n mail gets stored in /my_mailbox_path/%d/%n/new/ With "sdbox:" mail_location = sdbox:/my_mailbox_path/%d/%n mail gets stored in /my_mailbox_path/%d/%n/mailboxes/INBOX/dbox-Mails. How do I get rid of the '/mailboxes/' and '/dbox-Mails/' path components so sdbox stores in: /my_mailbox_path/%d/%n/INBOX @ wiki2.dovecot.org/MailboxFormat/dbox#Alternate_storage points out that 'ALT=' can change the *lookup* location, and messages can be *moved* to ALT storage using 'doveadm altmove'. Unclear what TAGS are available/used for 'sdbox'.

2 1

[Dovecot] Rare error with concurrent users searching with fts-solr
by Antonio Perez-Aranda 18 Oct '11

18 Oct '11

Hi all, If I start two o more connections with diferent users that make a search text to solr I get this message many times: Error: fts_solr: Query didn't return uid If I repeat the test about 2000 times, with only one user concurrent, with 60 diferent users, without concurrent, I get between 0. If I repeat the test about 2000 times, with 2 users concurrent, I get between 3 or 10 errors. If I repeat the test about 2000 times, with 4 users concurrent, I get between 10-20 errors. After see this error, I set a tcpdump to try to watch the SOLR XML and GET, I can watch that Solr send a xml like this: <response></response> with 200 as http status When the normal response is like this <response> <lst name="responseHeader"> <int name="status">0</int> <int name="QTime">1</int> <lst name="params"> <str name="fl">uid,score</str> <str name="sort">uid asc</str> <str name="q">BLABLABLA</str> <str name="fq">+user:"ANYUSER" +uidv:1208469916 +box:"ANYFOLDER" -ns:[* TO *]</str> <str name="rows">1</str> </lst> </lst> <result name="response" numFound="0" start="0" maxScore="0.0"/> </response> At first, I think that the problems it's in Solr, but after get all GET from tcpdump, I make a python script with urllib2 and send it all to Solr with the same concurrency and I can't get any error or "empty response" Have someone made a intensive concurrency tests over Dovecot + Solr ? -- Antonio Pérez-Aranda Alcaide aperezaranda(a)yaco.es Yaco Sistemas S.L. http://www.yaco.es/ C/ Rioja 5, 41001 Sevilla Teléfono +34 954 50 00 57 Fax +34 954 50 09 29

2 1

[Dovecot] 2.1 Plans
by Steve Fatula 18 Oct '11

18 Oct '11

Back in early 2010, Timo posted about a potential 2.1 feature to in essence reduce the number of imap/pop3 processes using various techniques since the code already supports multiple connections. It even went as far as moving all idle connections. I don't see this on the 2.1 roadmap. Is it still planned perhaps for 2.1? Thousands of imap processes going away is a great thing for me! So, just curious. Reference: http://dovecot.org/list/dovecot/2010-January/046148.html Steve

2 1

[Dovecot] Convert-tool maildir > mbox
by Bertrand Jacquin 18 Oct '11

18 Oct '11

Timo, Is seems that this commit broke convertion from Maildir to Mbox using dovecot 1.2 convert-tool binary : 2009-07-09 Timo Sirainen <tss(a)iki.fi> * src/plugins/convert/convert-storage.c: convert plugin: Fixed changing hierarchy separators in mailbox names when alt_hierarchy_char isn't set. [a9f719f9a509] <HEAD> Since, I get the following : $ convert-tool user1 /var/mail/example.com/user1 Maildir:/var/mail/example.com/user1 mbox:/var/mail/example.com/user1-mbox alt_hierarchy_char=_ Error: Mailbox conversion: Couldn't create mailbox Sent/test: Mailbox doesn't allow inferior mailboxes Error: Internal failure Strace give show me a failure after : access("/var/mail/example.com/user1/.Sent.test/cur", W_OK) = 0 stat("/var/mail/example.com/user1-mbox/Sent/test", 0x7fff843e73b0) = -1 ENOTDIR (Not a directory) write(2, "Error: Mailbox conversion: Couldn"..., 103Error: Mailbox conversion: Couldn't create mailbox Sent/test: Mailbox doesn't allow inferior mailboxes ) = 103 lstat("/var/mail/example.com/user1/.dovecot.convert.lock", {st_mode=S_IFREG|0644, st_size=12, ...}) = 0 unlink("/var/mail/example.com/user1/.dovecot.convert.lock") = 0 Is that somethinh known ? Didn't find anything interesting in archives. Maybe that kind of conversion have evolved since 2.0 ? Thanks, Beber

2 1

[Dovecot] doveadm mailbox list shows file system directories as mailboxes
by Jürgen Obermann 18 Oct '11

18 Oct '11

Hello. In our dovecvot we use mbox format with the default filesystem layout. Therefore it is not possible to have mailboxes which are subfolders of other mailboxes containing messages. The command "doveadm mailbox list" includes the file system directories, that contain only subfolders, as normal mailboxes in the output: archiv archiv/daemon archiv/dovecot Did I miss something in the dovecot configuration or is there a bug in the command "doveadm mailbox list"? # 2.0.13: /opt/local/etc/dovecot/dovecot.conf # OS: SunOS 5.10 sun4v auth_verbose = yes disable_plaintext_auth = no listen = imap.hrz.uni-giessen.de localhost mail_fsync = always mail_location = mbox:~/Mail:INBOX=/var/mail/%u mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = mail_log notify managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mmap_disable = yes namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes list = no location = prefix = Mail/ separator = / subscriptions = yes type = private } Thanks, Jürgen -- Hochschulrechenzentrum der | Mail: Juergen.Obermann(a)hrz.uni-giessen.de Justus-Liebig-Universitaet | WWW: http://www.uni-giessen.de/obermann/ Heinrich-Buff-Ring 44 | Tel: 0641-99-13054 (0641-99-13001) D-35392 Giessen, Germany | Fax: 0641-99-13009

3 2

Re: [Dovecot] Spammers attempting SASL Auth
by Tom Pawlowski 17 Oct '11

17 Oct '11

Take a look at: http://hg.dovecot.org/dovecot-2.0/file/962df5d9413a/src/auth/auth-request.c on line 536. That's the auth service catching illegal characters and rejecting the attempt. It'll happen with or without a valid user. So, working as it should. As for spammers trying to brute force valid logins, yep, pretty common. Higher rate of success if they can mail from a known good server and account. * Simon Brereton <simon.brereton(a)buongiorno.com> [2011-10-17 11:51:15 -0400]: > On 17 October 2011 11:31, Robert Schetterer <robert(a)schetterer.org> wrote: > > Am 17.10.2011 17:16, schrieb Simon Brereton: > >> Hi > >> > >> This is a new one on me - I've never seen spammers attempt to use to SASL Auth to inject spam. None of the users they are trying (newsletter, dummy, test, etc.) exist, but what worries me is the illegal chars error - is this a known vulnerability in dovecot they are trying to exploit? I'm running 1:1.2.15-7 installed from apt-get.. > >> > >> Oct 17 15:07:16 mail postfix/smtpd[14422]: connect from unknown[208.86.147.92] > >> Oct 17 15:07:16 mail dovecot: auth(default): passdb(newsletter(a)mydomain.net,208.86.147.92): Attempted login with password having illegal chars > >> Oct 17 15:07:17 mail dovecot: pop3-login: Disconnected (auth failed, 1 attempts): user=<test(a)mydomain.net>, method=PLAIN, rip=208.86.147.92, lip=83.170.64.84 > >> Oct 17 15:07:18 mail postfix/smtpd[14403]: warning: 208.86.147.92: hostname default-208-86-147-92.nsihosting.net verification failed: Name or service not known > >> > >> > >> Simon > >> > > > > this maybe a brute force attack,or more easy someone missconfigured his > > client , you may use fail2ban etc to block it > > not directly related to dovecot > > 17 queries in 30 seconds is not a misconfigured client :) > > And I'm already using Fail2Ban - but as someone on this list pointed > out recently, that doesn't apply if they try X attempts on the same > connection. Although, I don't think that was case here - maybe I > should update my dovecot jail with that illegal chars line. But, be > that as it may - all these attempts failed because the user didn't > exist. What if the user exists though? Does this illegal chars make > a hole for them to enter through? > > Simon > -- Tom Pawlowski OIT-CSS System Administrator office: Hill 147 email: tompru(a)jla.rutgers.edu phone: (732) 445-2634

2 1

Re: [Dovecot] Spammers attempting SASL Auth
by Robert Schetterer 17 Oct '11

17 Oct '11

Am 17.10.2011 17:51, schrieb Simon Brereton: > On 17 October 2011 11:31, Robert Schetterer <robert(a)schetterer.org> wrote: >> Am 17.10.2011 17:16, schrieb Simon Brereton: >>> Hi >>> >>> This is a new one on me - I've never seen spammers attempt to use to SASL Auth to inject spam. None of the users they are trying (newsletter, dummy, test, etc.) exist, but what worries me is the illegal chars error - is this a known vulnerability in dovecot they are trying to exploit? I'm running 1:1.2.15-7 installed from apt-get.. >>> >>> Oct 17 15:07:16 mail postfix/smtpd[14422]: connect from unknown[208.86.147.92] >>> Oct 17 15:07:16 mail dovecot: auth(default): passdb(newsletter(a)mydomain.net,208.86.147.92): Attempted login with password having illegal chars >>> Oct 17 15:07:17 mail dovecot: pop3-login: Disconnected (auth failed, 1 attempts): user=<test(a)mydomain.net>, method=PLAIN, rip=208.86.147.92, lip=83.170.64.84 >>> Oct 17 15:07:18 mail postfix/smtpd[14403]: warning: 208.86.147.92: hostname default-208-86-147-92.nsihosting.net verification failed: Name or service not known >>> >>> >>> Simon >>> >> >> this maybe a brute force attack,or more easy someone missconfigured his >> client , you may use fail2ban etc to block it >> not directly related to dovecot > > 17 queries in 30 seconds is not a misconfigured client :) > > And I'm already using Fail2Ban - but as someone on this list pointed > out recently, that doesn't apply if they try X attempts on the same > connection. Although, I don't think that was case here - maybe I > should update my dovecot jail with that illegal chars line. But, be > that as it may - all these attempts failed because the user didn't > exist. What if the user exists though? Does this illegal chars make > a hole for them to enter through? > > Simon > as i posted you offlist, this is a smtp attack, look at your i.e fail2ban postfix rules, fail2ban dovecot ruel is for banning pop3/imap brute force -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

1 0

Re: [Dovecot] Spammers attempting SASL Auth
by Robert Schetterer 17 Oct '11

17 Oct '11

Am 17.10.2011 17:16, schrieb Simon Brereton: > Hi > > This is a new one on me - I've never seen spammers attempt to use to SASL Auth to inject spam. None of the users they are trying (newsletter, dummy, test, etc.) exist, but what worries me is the illegal chars error - is this a known vulnerability in dovecot they are trying to exploit? I'm running 1:1.2.15-7 installed from apt-get.. > > Oct 17 15:07:16 mail postfix/smtpd[14422]: connect from unknown[208.86.147.92] > Oct 17 15:07:16 mail dovecot: auth(default): passdb(newsletter(a)mydomain.net,208.86.147.92): Attempted login with password having illegal chars > Oct 17 15:07:17 mail dovecot: pop3-login: Disconnected (auth failed, 1 attempts): user=<test(a)mydomain.net>, method=PLAIN, rip=208.86.147.92, lip=83.170.64.84 > Oct 17 15:07:18 mail postfix/smtpd[14403]: warning: 208.86.147.92: hostname default-208-86-147-92.nsihosting.net verification failed: Name or service not known > > > Simon > this maybe a brute force attack,or more easy someone missconfigured his client , you may use fail2ban etc to block it not directly related to dovecot -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 1

[Dovecot] Spammers attempting SASL Auth
by Simon Brereton 17 Oct '11

17 Oct '11

Hi This is a new one on me - I've never seen spammers attempt to use to SASL Auth to inject spam. None of the users they are trying (newsletter, dummy, test, etc.) exist, but what worries me is the illegal chars error - is this a known vulnerability in dovecot they are trying to exploit? I'm running 1:1.2.15-7 installed from apt-get.. Oct 17 15:07:16 mail postfix/smtpd[14422]: connect from unknown[208.86.147.92] Oct 17 15:07:16 mail dovecot: auth(default): passdb(newsletter(a)mydomain.net,208.86.147.92): Attempted login with password having illegal chars Oct 17 15:07:17 mail dovecot: pop3-login: Disconnected (auth failed, 1 attempts): user=<test(a)mydomain.net>, method=PLAIN, rip=208.86.147.92, lip=83.170.64.84 Oct 17 15:07:18 mail postfix/smtpd[14403]: warning: 208.86.147.92: hostname default-208-86-147-92.nsihosting.net verification failed: Name or service not known Simon

1 0

[Dovecot] dovecot-antispam – Debian package
by Philipp Haselwarter 17 Oct '11

17 Oct '11

Dovecot2 has been around for a bit now but Eugene Paskevich's antispam plugin unfortunately still doesn't seem to have a tagged release. Has anyone by any chance rolled a .deb for the plugin that works on current Debian sid? -- Philipp Haselwarter

1 0

[Dovecot] lmtp performance
by Juan Carlos Sanchez 17 Oct '11

17 Oct '11

Hello: In the process of migration from version 1.2 to 2.0 have tried to use lmtp instead of lda as delivery agent. But unfortunately througput we get is poor with lmtp compared to lda. In peak times with lda we are able to deliver over 1800 messages/minute (high I/O but not affecting service) but if we switch to lmtp cannot deliver more than 300 mess/minute (very low I/O). This is enough for normal work but low under heavy load (distribution lists messages sometimes stay queued for 4 hours before deliver). We have arround 50000 boxes and use postfix as MTA How to increase lmtp performance? dovecot config for lda and lmtp: protocol lda { auth_socket_path = /usr/local/var/run/dovecot/auth-master info_log_path = /var/log/mail/dovecot_deliver.log log_path = /var/log/mail/dovecot_deliver.log mail_plugins = quota sieve zlib postmaster_address = postmaster(a)upm.es sendmail_path = /usr/lib/sendmail } protocol lmtp { info_log_path = /var/log/mail/dovecot_deliver.log log_path = /var/log/mail/dovecot_deliver.log mail_plugins = quota sieve zlib postmaster_address = postmaster(a)upm.es sendmail_path = /usr/lib/sendmail } In postfix I have: mailbox_transport = lmtp:unix:private/dovecot-lmtp Thanks in advance. -- ------------------------------------------------------ Juan Carlos Sanchez Hernandez Universidad Politecnica de Madrid ------------------------------------------------------

1 0

[Dovecot] Problems Configuring Pigeonhole/Seve
by Ian Barton 17 Oct '11

17 Oct '11

I am moving my email server from Ubuntu Lucid to Arch. The Arch server is running Dovecot V2.0.15. Email is working fine, but I can't get Pigeonhiole/sieve to work. My dovecot.conf is: protocols = imap sieve ssl = yes ssl_cert = </etc/ssl/certs/mail2.wilkesley.net.crt ssl_key = </etc/ssl/private/mail2.wilkesley.net.key first_valid_uid = 5000 first_valid_gid = 5000 auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ namespace { location = maildir:/home/vmail/%d/%n/Maildir type = private prefix = INBOX. inbox = yes hidden = yes } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep } protocol lda { postmaster_address = ian(a)wilkesley.net hostname = wilkesley.org sendmail_path = /usr/sbin/sendmail mail_plugins = $mail_plugins sieve } protocol sieve { # Nothing to do here as defaults are OK } plugin { sieve = ~/.dovecot.sieve sieve_global_path = /home/vmail/globalsieverc sieve_dir = ~/ } passdb { driver = sql args = /etc/dovecot/dovecot-sql.conf } userdb { driver = sql args = /etc/dovecot/dovecot-sql.conf } I have created the sieve dir in the virtual users folder. However sieve doesn't appear to be working. I have tried logging in manually to see if sieve is running, but get the following error: ian:~/ $ gnutls-cli --starttls -p 143 mail2.wilkesley.net [8:32:22] Resolving 'mail2.wilkesley.net'... Connecting to '127.0.0.1:143'... - Simple Client Mode: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] Dovecot ready. STARTTLS STARTTLS BAD Error in IMAP command received by server. According to the Dovecot wiki this should reply with the capabilities of my server, Note the server sends and receives mail OK using starttls. So what am I doing wrong?

2 1

[Dovecot] Question about ionice & dovecot-deliver
by Maria Arrea 16 Oct '11

16 Oct '11

Hello We are running dovecot 2.0.13 with mdbox on RHEL 5.7 x64, ext4 filesystem. Sometimes we have a big load increase because a mailing list server send 16.000 32k messages in less than 3 minutes. We want to "slow down" delivery, we prefer slow delivery instead of logging out webmail users. I have the following line en /etc/postfix/master.cf: flags=DRhu user=userid argv=/usr/libexec/dovecot/deliver -d ${user} And in /etc/postfix/main.cf mailbox_command = /usr/libexec/dovecot/deliver I would like to add ionice to the equation, prefixing /usr/bin/ionice -c2 -n6 before the deliver lines in postfix config. Is there any other way of slowing down delivery speed vs imap access? Regards Maria

3 2

[Dovecot] Issue after upgrading to Ubuntu Server 11.10
by Chris Vanden Berghe 14 Oct '11

14 Oct '11

Hi all, After upgrading to Ubuntu Server 11.10 my mail setup stopped working. The error message I get is: lda: Error: userdb lookup: connect(/var/run/dovecot/auth-userdb) failed: Permission denied (euid=5000(vmail) egid=5000(vmail) missing +r perm: /var/run/dovecot/auth-userdb, euid is not dir owner) Does anybody have an idea how to solve this? Thanks, Chris. --- # 2.0.13: /etc/dovecot/dovecot.conf # OS: Linux 3.0.0-12-generic x86_64 Ubuntu 11.10 ext3 auth_verbose = yes log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:/var/vmail/%u mail_privileged_group = mail maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { fts = squat fts_squat = partial=4 full=10 } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth-client { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { address = localhost port = 143 } inet_listener imaps { address = * port = 993 } } ssl_cert = </etc/ssl/private/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = uid=5000 gid=5000 home=/var/vmail/%u driver = static } protocol imap { mail_max_userip_connections = 50 mail_plugins = fts fts_squat } protocol lda { mail_plugins = sieve }

1 1