- dovecot - dovecot.org

[Dovecot] status of antispam plugin for DC 2.x ?
by interfaSys sàrl 31 Aug '10

31 Aug '10

Hello, I saw that there is now an antispam plugin repository for the V2.x version. It doesn't compile and it seems it cannot be configured like the old one. Any ETA? Cheers, Olivier

5 7

[Dovecot] Running auth as root
by Egbert Jan van den Bussche 31 Aug '10

31 Aug '10

Hi, I seem to be forced to run the auth proces as root because I want to use pam for local users. My gut feeling says that this is Not Good. Is there another way? For the virtual users 'vmail' is good enough because that user may access the MySQL database. This is on Ubuntu server 10.04.1 and Dovecot 1.2.9. TIA, Egbert Jan

2 4

[Dovecot] Size limit for a single mail in the IMAP store?
by Ralf Hildebrandt 31 Aug '10

31 Aug '10

Postfix has "message_size_limit = 26214400", but that doesn't keep my users from sending huge messages which canot be sent, but can be stored in the IMAP "Sent" folder. Is it possible to set a size limit for the size of a single mail? -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

2 2

[Dovecot] doveadm expunge -A mailbox Trash savedbefore 30d
by Jerrale G 31 Aug '10

31 Aug '10

In the shell: ,doveadm(root): Error: User listing returned failure,doveadm: Error: Failed to iterate through some users In the log: dovecot: auth: Error: sql: Iterate query failed: Table 'mail.users' doesn't exist (using built-in default iterate_query: SELECT username, domain FROM users) Why is dovecot trying to "select username, domain from users" when the "service auth" is setup to "select homedir, maildir, sieve_dir, from MAILBOXES.... the same with the password query except for selecting password from mail.mailboxes. The expire dictionary is EXACTLY like the example you posted in the wiki2. I can't remember whether I posted this thread before or not; I remember writing it two days ago but I'm not sure if I sent it as I can't find it in this "mailing lists" folder. Jerrale G. SC Senior Admin

3 5

[Dovecot] Is there a way to catch mailbox and message flag changes?
by John O'Brien 31 Aug '10

31 Aug '10

Guys, We have been trying to establish if there is a way to get some type of notification from Dovecot when a message is appended to a mailbox or when a message has its flags updated. These are the 2 use cases: A message is appended to the mailbox "/Watch", we want to trigger "processing" of the message immediately it arrives. A message in the "Inbox" has its status changed from Unseen to Seen, we want to trigger some code to indicate the message has been "processed". Regards, John

2 1

Re: [Dovecot] LDAP & static userdb
by spamvoll＠googlemail.com 31 Aug '10

31 Aug '10

ive added args = uid=vmail gid=vmail home=/home/MAILBOXES/%u/ mail=/home/MAILBOXES/%u/mail and it work. Im not really sure about the hole LDAP thing :) my conf: uris = ldaps://ldap.example.org:636 dn = cn=dovecot server,ou=people,ou=Server,dc=example,dc=org dnpass = hiddenpw auth_bind = yes ldap_version = 3 base = dc=example,dc=org scope = subtree user_attrs = homeDirectory=home,uid=mail=maildir:/home/%$/mail user_filter = (&(objectClass=gosaMailAccount)(|(mail=%u)(gosaMailAlternateAddress=%u)(uid=%u))) pass_attrs = uid=user,userPassword=password pass_filter = (&(objectClass=gosaMailAccount)(uid=%u)) (yea on 1.2 my home was /home/%uid but that suxx and i want to move it to /home/MAILBOXES/%uid) 1) I have a user that can read the PW so i dont need "auth_bind = yes", right? 2) user_* and pass_* i dont need them anymore cause its always: home=/home/MAILBOXES/%u/ mail=/home/MAILBOXES/%u/mail 2010/8/27 Mihajlin Evgenij <skyworker(a)ooobadm.dp.ua>: > В сообщении от 27 августа 2010 17:32:04 автор spamvoll(a)googlemail.com написал: > >> > log say: >> > dovecot: imap(hpeter): Error: user hpeter: Initialization failed: >> > mail_location not set and autodetection failed: Mail storage >> > autodetection failed with home=/home/MAILBOXES/hpeter/mail > > may be try to set into 10-mail.conf or in namespace private (if you have such) > mail_localtion = ~/Maildir > >

2 1

[Dovecot] MainConfig for dovecot 2.0
by Sascha Peters 31 Aug '10

31 Aug '10

Hey, for dovecot 1.2 there is a very good reference page for all options. http://wiki.dovecot.org/MainConfig is there a reference for dovecot 2.0 in the new wiki? If not, when will be this page online? Thanks a lot. -- Gruß Sascha

2 1

[Dovecot] NTLM authentication does not work
by Alexander Cherniak 31 Aug '10

31 Aug '10

Dear Experts, I configured Samba, Kerberos, etc., can login to my CentOS using ADS account, but missing something in my Dovecot config. Windbind seems to work: [root@aCentOs2 dovecot]# wbinfo -a wAlex%pass plaintext password authentication succeeded challenge/response password authentication succeeded Same is true for ntlm_auth helper: [root@aCentOs2 dovecot]# /usr/bin/ntlm_auth --username=wAlex --password=pass NT_STATUS_OK: Success (0x0) But I couldn't get into Dovecot (with or without auth_use_winbind option): . login wAlex pass . NO [ALERT] Unsupported authentication mechanism. Despite very verbose logging, there no clues there. Bellow's my dovecot -n output: # 2.0.0: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-194.11.1.el5 i686 CentOS release 5.5 (Final) auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_mechanisms = ntlm auth_use_winbind = yes auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/Dovecot/dovecot_debug.log disable_plaintext_auth = no info_log_path = /var/log/Dovecot/dovecot_info.log log_path = /var/log/Dovecot/dovecot.log mail_location = maildir:~/Maildir protocols = imap ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = uid=vmail gid=vmail home=/home/vmail/%u allow_all_users=yes driver = static } It might be irrelevant, but although the lines "auth_use_winbind = yes" and "auth_winbind_helper_path = /usr/bin/ntlm_auth" are close together in the config file, I cannot see the latter when run dovecot -n. I am quite new to Dovecot and will appreciate any help. Thanks, Alex.

2 2

[Dovecot] Possible erroneous "aborted login attempts"
by Jerrale G 31 Aug '10

31 Aug '10

Aug 29 22:51:27 server1 dovecot: imap-login: Aborted login (no auth attempts): rip=(obfuscated), lip=173.50.101.12, TLS Aug 29 22:51:27 server1 dovecot: imap-login: Login: user=........... before most every successful login, the same second of time, dovecot has the above message. This is not a huge problem but our firewall is looking for aborted login attempts, for imap/pop3 (relevant to dovecot) dos attempts and, if many people start having problems of their packets being dropped, we will have to stop looking for the statement or lower security slightly, more attempts over a period of time before filtering. However, thanks to your idle feature, there is less of these messages; so, I don't think we will have a problem. The only client that doesn't have a problem is our php webmail but we don't look in dovecot's log for failed attempts from here; as, it is from the same ip, to dovecot from php, constantly without reference to the user. This has been happening since 1.2.11 with us. We don't use any imap relay but was looking into imapproxy for cacheing speed and preventing advanced ddos attempts, those from users with access. Jerrale G. errale G. SC Senior Admin

2 1

[Dovecot] dovecot lda issue
by Joy 31 Aug '10

31 Aug '10

I am using dovecot lda and everything is working fine for me except the sieve rule which is built for rejecting mail from a specific sender. message is being rejected but from address is not correct in rejection mail which looks like the following :- <<>@mail.xyz.net> sieve rule :- require ["fileinto","envelope","reject","vacation","imap4flags","relational","comparator-i;ascii-numeric","regex","body","date"]; if address :contains "From" "xyz(a)gmail.com" { reject text: Please do not send mail to me piyush .... . ; } Please let me know where is the issue with sieve rule or with lda setting :- lda has been configured with the following parameter :- postmaster_address = postmaster(a)xyz.net

2 1

[Dovecot] dovecot - mac firewall problem
by Patrick Fay 31 Aug '10

31 Aug '10

> >>>> Hi, >>>> I am running dovecot 1.2.11 on mac osx 1.5.8. Everything works >>>> perfectly with the application-level firewall off, but enabling the >>>> application firewall prevents dovecot connections. I have tried >>>> explicitly authorizing dovecot in the firewall, but it does not work. I >>>> have searched everywhere I can think of to look, and haven't found a >>>> solution, but have seen a couple other reports of what seems to be the >>>> same problem. The firewall logs the activity with what looks like a >>>> corrupt process name: a typical appfirewall.log entry looks like: >>>> >>>> Aug 26 20:43:45 hostname Firewall[55]: Deny ^L connecting from >>>> XX.XX.XX.XX:37310 uid = 0 proto=6 >>>> Aug 26 20:43:53 hostname Firewall[55]: Deny ^H?^U???^Z connecting from >>>> XX.XX.XX.XX:37310 uid = 0 proto=6 >>>> Aug 26 20:44:09 hostname Firewall[55]: Deny ^L connecting from >>>> XX.XX.XX.XX:37310 uid = 0 proto=6 >>>> Aug 26 20:44:34 hostname Firewall[55]: Deny ^L connecting from >>>> XX.XX.XX.XX:37312 uid = 0 proto=6 >>>> Aug 26 20:44:45: --- last message repeated 6 times --- >>>> >>>> where "hostname" is my server name and the XX's are my client's IP >>>> address. For all of the other services I've used, the process name >>>> (e.g. dovecot) should appear after "Deny" when blocking traffic, instead >>>> of the funny characters. Any advice on how I could resolve this issue >>>> would be greatly appreciated. Thanks! >>> >>> >> >> I was hoping to use the application firewall because this machine gets used both as a server as well as a client machine for more general use. I haven't been able to find any specific documentation for it, but I have found that the firewall works fine with postfix and several file services I use (enabling/disabling works as expected, process names get logged as expected, etc). Thanks! >> >> Patrick > > So, you're running Dovecot and Postfix on a laptop? WTF? > > -- > Stan Hi, Sorry for the confusion--no laptop involved. Postfix, dovecot, etc, all running on intel-based desktop mac (a mac pro). Patrick

5 5

[Dovecot] mixing 1.2 and 2.0?
by Cor Bosman 31 Aug '10

31 Aug '10

Hi all, anyone know if it's safe to mix a 1.2 environment with 2.0 servers? Im planning on adding some 2.0 servers for test purposes, but now im wondering if thats going to mess up index files or other files for users selecting the test server and then switching back to our normal servers. Regards, Cor

2 1

Re: [Dovecot] dovecot - mac firewall problem
by Patrick Fay 31 Aug '10

31 Aug '10

Hi, Thanks everyone for your help and input. I think perhaps my attempt to be brief and focused in posing my question has led to some confusion about my needs and configuration. I do not have the luxury of being able to segregate the server (postfix and dovecot) from client (GUI, etc) on different machines. I am, as Charles' surmised, using this to aggregate disparate mail streams into a single location, and using dovecot to serve it. Since I must run client-ish applications on this machine, the application firewall is desirable. The anticipated load on this system from the server side is quite light, so the throughput overhead incurred by the application firewall is negligible. The problem appears to be that--for some reason--dovecot identifies itself incorrectly to the application firewall, resulting in the garbage shown in the logs and failure to permit this connection (the firewall is configured to explicitly permit connections for dovecot). I note that other daemons (e.g. postfix, sshd, etc) do not exhibit this defect; the firewall works as expected for every other service I've tried except dovecot. The logs for the firewall appear as: Aug 26 20:43:45 hostname Firewall[55]: Deny ^L connecting from XX.XX.XX.XX:37310 uid = 0 proto=6 Aug 26 20:43:53 hostname Firewall[55]: Deny ^H?^U???^Z connecting from XX.XX.XX.XX:37310 uid = 0 proto=6 Both of these are dovecot hits--but the name is different each time. Also the ?'s aren't really "?" marks; they're trans-ascii characters with high bits set that my mailer doesn't like very much. It really looks like a misdirected pointer or something somewhere, but I'm not familiar enough with the codebase to know where to start looking, or if in fact it is something else that is misconfigured. Any thoughts on how to resolve this? Patrick

3 2

[Dovecot] getdents() with 4KB buffer - seems slow (Maildir, large inbox)
by Marinos Yannikos 31 Aug '10

31 Aug '10

Hi, I have a very large inbox (~146K mails) in Maildir format and dovecot seems to spend a lot of time rescanning the directory, especially when the server is loaded. I'm not sure whether this is triggered by Thunderbird or done regularly, but it takes longer when the server is loaded, so sometimes it seems that it is scanning continuously. Since it takes around 2000 getdents64() syscalls to scan my inbox, I'm wondering whether the buffer size is a bit small with 4KB and might benefit from being configurable: ... getdents64(8, /* 73 entries */, 4096) = 4088 getdents64(8, /* 73 entries */, 4096) = 4088 getdents64(8, /* 73 entries */, 4096) = 4088 getdents64(8, /* 73 entries */, 4096) = 4088 getdents64(8, /* 73 entries */, 4096) = 4088 ... (strace output of an imap process belonging to me) The behaviour is identical on 1.0.15 and 1.2.13 (I just upgraded). Regards, Marinos PS. I know that the main reason for slowness is my large inbox and the server being loaded (disk I/O), but still, so many syscalls just to rescan the inbox seems wasteful. # dovecot -n # 1.2.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-6-xen-686 i686 Debian 4.0 log_timestamp: %Y-%m-%d %H:%M:%S ssl_listen: * ssl_cert_file: XXXXX (censored) ssl_key_file: XXXXX login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_process_size: 32 login_processes_count: 8 verbose_proctitle: yes mail_privileged_group: mail mail_location: maildir:~/Maildir mbox_write_locks: fcntl dotlock mail_process_size: 2048 imap_client_workarounds: outlook-idle auth default: passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix

2 1

[Dovecot] Mail error in log
by Ian macdonald 31 Aug '10

31 Aug '10

Hi All, I am getting the following in the mail error log deliver(julie): safe_mkstemp(/home/julie/.temp.geomail.10443.) failed: Permission denied This is correct julie does not have access to write to her home directory Julie is a system user who is chrooted so her home is owned by root, this is for when she logs in via sftp to retrieve files she can only access folders below her home. I am using Maildir and julie does have access to ~Maildir, is there any reason why deliver is attempting to use her user directory and not her Maildir? Cheers Ian

3 3

[Dovecot] istream_read like zlib, but without zlib
by Alex Baule 31 Aug '10

31 Aug '10

Hy Timo ! I Made some modification in stream_read in zlib. I remove all zlib part, because i don't need this, but i need to read a istream to change it. Well, i create a size_t called supersize, with is a substitute for stream->zs.avail_in. The trouble is, my debug file have a lot of "READ Plugin\n", and i think it's because my read becomes a loop, i think it's because i don't know to identify the EOF from the istream. you can help me to identify the EOF and set it ? Tks .!!! static ssize_t i_stream_emx_read(struct istream_private *stream) { struct emx_istream *emxstream = (struct emx_istream *)stream; const unsigned char *data; uoff_t high_offset; size_t size; int ret; fprintf(emxstream->debug,"READ Plugin\n"); fflush(emxstream->debug); high_offset = stream->istream.v_offset + (stream->pos - stream->skip); if (emxstream->eof_offset == high_offset) { i_assert(emxstream->high_pos == 0); stream->istream.eof = TRUE; return -1; } if (stream->pos < emxstream->high_pos) { /* we're here because we seeked back within the read buffer. */ ret = emxstream->high_pos - stream->pos; stream->pos = emxstream->high_pos; emxstream->high_pos = 0; return ret; } emxstream->high_pos = 0; if (stream->pos + CHUNK_SIZE > stream->buffer_size) { /* try to keep at least CHUNK_SIZE available */ if (!emxstream->marked && stream->skip > 0) { /* don't try to keep anything cached if we don't have a seek mark. */ i_stream_compress(stream); } if (stream->max_buffer_size == 0 || stream->buffer_size < stream->max_buffer_size) i_stream_grow_buffer(stream, CHUNK_SIZE); if (stream->pos == stream->buffer_size) { if (stream->skip > 0) { /* lose our buffer cache */ i_stream_compress(stream); } if (stream->pos == stream->buffer_size) return -2; /* buffer full */ } } if(emxstream->supersize == 0){ /* need to read more data. try to read a full CHUNK_SIZE */ i_stream_skip(stream->parent, emxstream->prev_size); if (i_stream_read_data(stream->parent, &data, &size, CHUNK_SIZE-1) == -1 && size == 0) { if (stream->parent->stream_errno != 0) { stream->istream.stream_errno = stream->parent->stream_errno; } else { i_assert(stream->parent->eof); stream->istream.stream_errno = EPIPE; } return -1; } emxstream->prev_size = size; if (size == 0) { /* no more input */ stream->istream.eof = TRUE; i_assert(!stream->istream.blocking); return 0; } fprintf(emxstream->debug,"READ =|%s|= Plugin\n",data); fflush(emxstream->debug); memcpy(stream->w_buffer + stream->pos, data,size); emxstream->supersize = size; } size = stream->buffer_size - stream->pos; stream->pos += size; if(stream->istream.eof == TRUE){ emxstream->eof_offset = stream->istream.v_offset + stream->pos; i_stream_skip(stream->parent, emxstream->prev_size - emxstream->supersize); emxstream->supersize = 0; emxstream->prev_size = 0; } if (size == 0) { /* read more input */ return i_stream_emx_read(stream); } return size; }

1 0

Re: [Dovecot] fetchmail wakeup
by Amon Ott 31 Aug '10

31 Aug '10

On Tuesday 31 August 2010 wrote Peter Dungel: > Does someone know, if in the new release of dovecot 2.x.x there is a > feature implemented, that wakes fetchmail or any other program on a client > request, or is the "fetchmail wakeup" plugin still the only way to do this > (at least I've not found any other, and that plugin never worked for me),.. You could replace the imap or pop3 helper program with a wrapper that first sends the fetchmail daemon a wakeup signal, waits a few secs and then calls the original. Amon Ott -- Dr. Amon Ott - m-privacy GmbH Am Köllnischen Park 1, 10179 Berlin Tel: +49 30 24342334 Fax: +49 30 24342336 Web: http://www.m-privacy.de Handelsregister: Amtsgericht Charlottenburg HRB 84946 Geschäftsführer: Dipl.-Kfm. Holger Maczkowsky, Roman Maczkowsky GnuPG-Key-ID: EA898571

1 0

[Dovecot] fetchmail wakeup
by Peter Dungel 31 Aug '10

31 Aug '10

Does someone know, if in the new release of dovecot 2.x.x there is a feature implemented, that wakes fetchmail or any other program on a client request, or is the "fetchmail wakeup" plugin still the only way to do this (at least I've not found any other, and that plugin never worked for me),.. Yours Peter

1 0

[Dovecot] Wrong MySQL sintax, I can't login
by Pablo 31 Aug '10

31 Aug '10

Hi guys: I can't login as a user: The output of mail.log: Aug 31 08:39:45 socrates dovecot: auth(default): client in: AUTH^I1^IPLAIN^Iservice=imap^Ilip=178.63.82.247^Irip=81.39.27.227^Ilport=143^Irport=33715^Iresp=AHBhYmxvLnJvZHJpZ3VlekBlc2N1ZWxhc3VwZXJpb3JkZWNvYWNoaW5nLmNvbQBwZXJpa2l0YS4= Aug 31 08:39:45 socrates dovecot: auth-worker(default): sql(pablo.rodriguez(a)escuelasuperiordecoaching.com,81.39.27.227): query: SELECT password FROM mailbox WHERE username = 'pablo.rodriguez(a)escuelasuperiordecoaching.com' Aug 31 08:39:45 socrates dovecot: auth(default): client out: OK^I1^Iuser=pablo.rodriguez(a)escuelasuperiordecoaching.com Aug 31 08:39:45 socrates dovecot: auth(default): master in: REQUEST^I65^I16796^I1 Aug 31 08:39:45 socrates dovecot: auth-worker(default): sql(pablo.rodriguez(a)escuelasuperiordecoaching.com,81.39.27.227): SELECT maildir, 1001 AS uid, 1001 AS gid FROM mailbox WHERE username = 'pablo.rodriguez(a)escuelasuperiordecoaching.com Aug 31 08:39:45 socrates dovecot: auth-worker(default): sql(pablo.rodriguez(a)escuelasuperiordecoaching.com,81.39.27.227): User query failed: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ''pablo.rodriguez(a)escuelasuperiordecoaching.com' at line 1 Aug 31 08:39:45 socrates dovecot: auth(default): master out: FAIL^I65 Aug 31 08:39:45 socrates dovecot: imap-login: Internal login failure (auth failed, 1 attempts): user=<pablo.rodriguez(a)escuelasuperiordecoaching.com>, method=PLAIN, rip=81.39.27.227, lip=178.63.82.247 My Dovecot version: 1.2.9 My Dovecot configuration: # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-23-server x86_64 Ubuntu 10.04.1 LTS reiserfs log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/mail/dovecot.crt ssl_key_file: /etc/ssl/mail/dovecot.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_location: maildir:/home/vmail/%u/ mail_debug: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 auth default: mechanisms: plain login verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail My Dovecot MySQL configuration: driver=mysql connect = host=localhost dbname=postfix user=postfix password=xxxxxx default_pass_scheme = CRYPT password_query = SELECT password FROM mailbox WHERE username = '%u' user_query = SELECT maildir, 1001 AS uid, 1001 AS gid FROM mailbox WHERE username = '%u Can anyone help me? I've seen that log told me "wrong syntax", but I think upper query is right, isn't it? Any hint? Thanks in advance :-)

2 2

[Dovecot] Combining ManageSieve with hand-written scripts
by Jason Bleazard 30 Aug '10

30 Aug '10

Hi, new to Dovecot, forgive me if I'm missing something basic... I'm trying to figure out if there's a way to use a couple of custom rules alongside ManageSieve. Most of the time I like the ManageSieve interface in Roundcube, but there's one rule that I can't get it to do the way I want (it's a notify rule, and I don't like the way Roundcube constructs the notify). I figured out how to write it by hand, but of course I can't put my own rules in Roundcube's file or it gets really confused. I tried adding an include to the generated file, but Roundcube politely removes it for me the next time I use the rule editor. (Squirrelmail doesn't seem to be any better in this regard.) I thought I could do something like sieve_before = ~/sieve/custom.sieve but that doesn't seem to work. I couldn't even see any evidence in the log that it attempted to look at that file. Apparently sieve_before isn't meant to work on a per-user basis. If I do a global sieve_before, can I have it "include :personal"? If so, what's going to happen with the script compilation? From what I understand, it can't be compiled globally, since each user has a different custom rule set. Am I trying to do the impossible here? Thanks for any ideas, Jason Bleazard

2 2

[Dovecot] Different IPs should use different ssl-certs/keys
by Peer Heinlein 30 Aug '10

30 Aug '10

I don't understand how to use multiple keys/certs on different IPs without SNI. http://wiki2.dovecot.org/SSL/DovecotConfiguration explains how to use different keys for different protocols like POP3 and IMAP. But how to bind those keys/ on IPs/Ports? Looks like it is not possible to use ssl_cert inside service { inet_listener {} } Is it still necessary to run multiple instances like it was in Dovecot 1.2.x? Peer -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030 / 40 50 51 - 0 Fax: 030 / 40 50 51 - 19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

[Dovecot] Dovecot dict process privileges
by Mike Mimic 30 Aug '10

30 Aug '10

Hi! Is it possible to configure Dovecot so that it drops privileges for dict process? Currently this process is running as root. (At least on my system with Dovecot 1.2.) Best regards Mike

3 8

Re: [Dovecot] dovecot - mac firewall problem
by Patrick Fay 30 Aug '10

30 Aug '10

> On 8/29/2010 8:51 PM, Patrick Fay wrote: >> Aug 26 20:43:45 hostname Firewall[55]: Deny ^L connecting from XX.XX.XX.XX:37310 uid = 0 proto=6 >> Aug 26 20:43:53 hostname Firewall[55]: Deny ^H?^U???^Z connecting from XX.XX.XX.XX:37310 uid = 0 proto=6 >> >> Both of these are dovecot hits--but the name is different each time. >> Also the ?'s aren't really "?" marks; they're trans-ascii characters >> with high bits set that my mailer doesn't like very much. It really >> looks like a misdirected pointer or something somewhere, but I'm not >> familiar enough with the codebase to know where to start looking, or >> if in fact it is something else that is misconfigured. Any thoughts >> on how to resolve this? > > Dovecot version? > > -- > > Best regards, > > Charles > My apologies-- dovecot version 1.2.11. Patrick

2 1

Re: [Dovecot] doveadm expunge -A mailbox Trash savedbefore 30d
by Jerrale G 30 Aug '10

30 Aug '10

Could you explain the iterate_query in any kind of sql. I'm guessing to just use the query, correctly, that's failing as iterate_query= and put it in the service auth file which includes password_query and user_query. then, I'm guessing to add something like: iteratedb { driver = sql args = /path/to/sql.conf } The wiki2 only says: "When the SQL userdb module is used make sure that the iterate_query setting in /etc/dovecot/dovecot-sql.conf.ext matches your database layout." it should give an example query. I don't know if its wanting to list the fields or the contents of a field. Thanks, Jerrale G Jerrale G. SC Senior Admin

1 0

[Dovecot] Can't get dovecot to see email folders
by Blaster 30 Aug '10

30 Aug '10

So I'm very frustrated, I've spent the better part of a day trying to get dovecot 2.0.1 working...Most of the documentation on the Wiki seems to think you are running an older version and therefore very little of it applies. I'm running 2.0.1 on OpenSolaris. I seem to have 2 remaining issues: 1) Dovecot is not able to determine the home directory 2) IMAP clients can not get to the mail folder directory. One client is reporting that it can't open it in read only mode. 3) I tried to get raw logging working, but apparently I couldn't because of #1. The architecture of Dovecot makes it difficult to transition from another IMAP server. If I force the MBOX to be /home/%u/mail, all of my clients think the folders are in /home/%u/mail/mail. If I set mbox location to /home/%u, then dovecot tries to create .subscription and .imap files/directories in the users home dir which it doesn't have permission to do. It would be nice if you could configure Dovecot in such a way as to make transition easier, such as the ability to strip off a duplicate trailing path, ie /home/%u/mail/mail becomes /home/%u/mail....Otherwise this necessitates visiting countless IMAP clients for reconfiguration... Here is my config file: /opt/sbin/dovecot -n # 2.0.1: /opt/etc/dovecot/dovecot.conf # OS: SunOS 5.11 i86pc base_dir = /var/run/dovecot/ mail_debug = yes mail_gid = mail mail_location = mbox:/home/%u/mail:INBOX=/var/mail/%u mail_privileged_group = mail mail_uid = dovecot passdb { driver = pam } plugin { home = /home/%u } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { address = * port = 993 } } service pop3-login { inet_listener pop3 { address = * port = 0 } inet_listener pop3s { address = * port = 0 } } ssl_cert = </usr/local/ssl/certs/dovecot.pem ssl_key = </usr/local/ssl/private/dovecot.pem gremlin [/opt/bin] # gremlin [/opt/bin] #

4 9

[Dovecot] PAM authentication fails
by Egbert Jan van den Bussche 29 Aug '10

29 Aug '10

Hi, I'm fighting all weekend on with auth and pam to authenticate local system users. testuser is such local user and is in passwd and shadow. I want to have local system users (testuser is one of them) and virtual users. The virtual part works fine but I cannot get the local user to connect. Still pam fails finding the user. The suggested password mismatch at the end is, in my eyes, because there is no user in the first place. I verified the password by interactive login to the account. The pam module (dovecot) is just the default file with three @includes in it. Syslog: Aug 29 20:18:02 mail-dev dovecot: auth(default): client in: AUTH#0112#011LOGIN#011service=imap#011lip=2a02:968:1:2:212:72:224:16#011rip=2001:888:1740:10:250:daff:fe41:4d1c#011lport=143#011rport=1093 Aug 29 20:18:02 mail-dev dovecot: auth(default): client out: CONT#0112#011VXNlcm5hbWU6 Aug 29 20:18:02 mail-dev dovecot: auth(default): client in: CONT#0112#011dGVzdHVzZXI= Aug 29 20:18:02 mail-dev dovecot: auth(default): client out: CONT#0112#011UGFzc3dvcmQ6 Aug 29 20:18:02 mail-dev dovecot: auth(default): client in: CONT#0112#011dmF4dm1z Aug 29 20:18:02 mail-dev dovecot: auth-worker(default): pam(testuser,2001:888:1740:10:250:daff:fe41:4d1c): lookup service=dovecot Aug 29 20:18:02 mail-dev dovecot: auth-worker(default): pam(testuser,2001:888:1740:10:250:daff:fe41:4d1c): #1/1 style=1 msg=Password: Aug 29 20:18:02 mail-dev dovecot: auth(default): cache(testuser,2001:888:1740:10:250:daff:fe41:4d1c): miss Aug 29 20:18:04 mail-dev dovecot: auth(default): cache(testuser,2001:888:1740:10:250:daff:fe41:4d1c): hit: Aug 29 20:18:04 mail-dev dovecot: auth(default): cache(testuser,2001:888:1740:10:250:daff:fe41:4d1c): User unknown Aug 29 20:18:04 mail-dev dovecot: auth-worker(default): pam(testuser,2001:888:1740:10:250:daff:fe41:4d1c): pam_authenticate() failed: Authentication failure (password mismatch?) (given password: xxxxxxxx) Aug 29 20:18:06 mail-dev dovecot: auth(default): client out: FAIL#0112#011user=testuser Relevant settings in dovecot: root@mail-dev:/etc/dovecot# dovecot -n # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-24-server x86_64 Ubuntu 10.04.1 LTS ext4 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap pop3 imaps pop3s managesieve listen: *, [::] ssl_cert_file: /etc/ssl/certs/ssl-mail.pem ssl_key_file: /etc/ssl/private/ssl-mail.key ssl_cipher_list: ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_max_userip_connections(default): 10 mail_max_userip_connections(imap): 10 mail_max_userip_connections(pop3): 3 mail_max_userip_connections(managesieve): 10 mail_privileged_group: mail mail_location: maildir:/home/vmail/%d/%n:INDEX=/home/vmail/%d/%n mail_debug: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): lda: postmaster_address: postmaster deliver_log_format: msgid=%m: %$ rejection_reason: Your message to <%t> was automatically rejected:%n%r auth_socket_path: /var/run/dovecot/auth-master auth default: mechanisms: plain login realms: kader.hcc.nl hobby.nl cache_size: 1024 user: vmail verbose: yes debug: yes debug_passwords: yes passdb: driver: pam args: setcred=yes failure_show_msg=yes cache_key=%u dovecot passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/dovecot-auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail Where should I look further for this dovecot pam problem? Is there such a thing as pam debugging? TIA Egbert Jan

1 1

[Dovecot] Sent mail issue
by Piyush Joshi 29 Aug '10

29 Aug '10

Dear All, I have few question regarding dovecot configuration for specific need which are as follows:- 1. I have IMAP folder with the name Sent Mail and i want whenever client uses any MUA to send mail from my server his mail must be kept in server's IMAP folder which is Sent Mail instead of local Sent folder. 2. Whenever user configures account in MUA, MUA automatically create some new folder like Junk Mail etc. while i am already using Spam folder to keep spam message in that folder so let me know how can i save myself from this. 3. Is there any thing which can also put deleted message in my server's Trash folder. Thanks

4 3

[Dovecot] "Multiple Commands in Progress" support
by Mike Cardwell 29 Aug '10

29 Aug '10

Section 5.5 of RFC3501 discusses the ability of IMAP servers to receive and execute multiple commands asynchronously on a single IMAP connection, not necessarily responding in the same order the commands were received: http://tools.ietf.org/html/rfc3501#section-5.5 Does Dovecot take advantage of this ability, or does it simply queue up the commands and execute them synchronously in order? -- Mike Cardwell - Perl/Java/Web developer, Linux admin, Email admin Read my tech Blog - https://secure.grepular.com/ Follow me on Twitter - http://twitter.com/mickeyc Hire me - http://cardwellit.com/ http://uk.linkedin.com/in/mikecardwell

1 0

Re: [Dovecot] dovecot - mac firewall problem
by Patrick Fay 28 Aug '10

28 Aug '10

>> Hi, >> I am running dovecot 1.2.11 on mac osx 1.5.8. Everything works >> perfectly with the application-level firewall off, but enabling the >> application firewall prevents dovecot connections. I have tried >> explicitly authorizing dovecot in the firewall, but it does not work. I >> have searched everywhere I can think of to look, and haven't found a >> solution, but have seen a couple other reports of what seems to be the >> same problem. The firewall logs the activity with what looks like a >> corrupt process name: a typical appfirewall.log entry looks like: >> >> Aug 26 20:43:45 hostname Firewall[55]: Deny ^L connecting from >> XX.XX.XX.XX:37310 uid = 0 proto=6 >> Aug 26 20:43:53 hostname Firewall[55]: Deny ^H?^U???^Z connecting from >> XX.XX.XX.XX:37310 uid = 0 proto=6 >> Aug 26 20:44:09 hostname Firewall[55]: Deny ^L connecting from >> XX.XX.XX.XX:37310 uid = 0 proto=6 >> Aug 26 20:44:34 hostname Firewall[55]: Deny ^L connecting from >> XX.XX.XX.XX:37312 uid = 0 proto=6 >> Aug 26 20:44:45: --- last message repeated 6 times --- >> >> where "hostname" is my server name and the XX's are my client's IP >> address. For all of the other services I've used, the process name >> (e.g. dovecot) should appear after "Deny" when blocking traffic, instead >> of the funny characters. Any advice on how I could resolve this issue >> would be greatly appreciated. Thanks! > > The application level firewall in OSX is aimed at _client_ use, not > server use. It's similar to Novell's AppArmor, etc. Leave it turned off. > > Simply because a piece of software (in this case an OS) offers any given > option does not mean every system needs it. Can you offer a compelling > reason why you _need_ the OSX application level firewall enabled? > Please point us to documentation that advises using it for any of your > services/daemons. > > -- > Stan > Hi was hoping to use the application firewall because this machine gets used both as a server as well as a client machine for more general use. I haven't been able to find any specific documentation for it, but I have found that the firewall works fine with postfix and several file services I use (enabling/disabling works as expected, process names get logged as expected, etc). Thanks! Patrick

2 1

[Dovecot] When should dictionary entries for the expire plugin be added/updated?
by Ralph Seichter 28 Aug '10

28 Aug '10

I've set up Dovecot 2.0 with the expire plugin using an SQLite DB, and when mail is delivered via dovecto-lda, the DB gets updated as expected. However, when I use Thunderbird 3.1.2 for Mac OS X to move a message to any of the folders known to the expire plugin (e.g. the 'tmp' folder), the SQLite DB is not updated. Here is an excerpt of my current configuration: # /etc/dovecot/dovecot.conf dict { expire = sqlite:/etc/dovecot/dict-expire.conf } plugin { expire = Junk expire2 = Trash expire3 = tmp expire4 = *.News expire5 = *.Reports expire_dict = proxy::expire sieve = /etc/dovecot/sieve/%u.sieve } service dict { unix_listener dict { # Ensure that there is no permission-related problem mode = 0666 } } protocol lda { mail_plugins = expire sieve postmaster_address = postmaster(a)domain.tld sendmail_path = /usr/sbin/sendmail } # /etc/dovecot/dict-expire.conf connect = /var/lib/dovecot/expires.sqlite map { pattern = shared/expire/$user/$mailbox table = expires value_field = expire fields { username = $user mailbox = $mailbox } } # Schema dump of /var/lib/dovecot/expires.sqlite PRAGMA foreign_keys=OFF; BEGIN TRANSACTION; CREATE TABLE expires ( username VARCHAR(75) NOT NULL, mailbox VARCHAR(255) NOT NULL, expire integer NOT NULL, PRIMARY KEY (username, mailbox) ); CREATE TRIGGER mergeexpire BEFORE INSERT ON expires FOR EACH ROW BEGIN UPDATE expires SET expire=NEW.expire WHERE username=NEW.username AND mailbox=NEW.mailbox; SELECT RAISE(IGNORE) WHERE (SELECT 1 FROM expires WHERE username=NEW.username AND mailbox=NEW.mailbox) IS NOT NULL; END; COMMIT; With these settings, rows will be inserted to (or updated within) expires.sqlite when dovecot-lda stores messages to any of my "Reports" folders using sieve rules. When I manually move messages to "tmp" or "Junk", the database remains unchanged. Also, when I delete messages in Thunderbird, I'd expect database additions for the folder "Trash", but this does not happen either. What am I doing wrong here? -Ralph

5 27

[Dovecot] Error: service(auth): child 2212 killed with signal 11
by Toorop 28 Aug '10

28 Aug '10

Hi, Auth always crash (segfault) using vpopmail backend. Any idea ? vpopmail 5.5.0 os: ubuntu 10.04 on rackspace cloud # dovecot -n dovecot -n # 2.0.1: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.35.1-rscloud x86_64 Ubuntu 10.04.1 LTS auth_debug = yes auth_mechanisms = plain login cram-md5 auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no first_valid_uid = 89 log_path = /var/log/dovecot/dovecot.log mail_debug = yes passdb { driver = vpopmail } protocols = imap pop3 service auth { unix_listener auth-userdb { group = vchkpw mode = 0600 user = vpopmail } user = root } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = vpopmail } Log: Aug 28 10:59:48 auth: Debug: Loading modules from directory: /usr/local/lib/dovecot/auth Aug 28 10:59:48 auth: Debug: auth client connected (pid=2211) Aug 28 10:59:49 auth: Debug: client in: AUTH 1 CRAM-MD5 service=imap secured lip=184.106.217.69 rip=178.32.33.247 lport=143 rport=49099 Aug 28 10:59:49 auth: Debug: client out: CONT 1 PDM3MjI0MzQ4NjQzNTI3NjUuMTI4Mjk5MzE4OUByYWNrc3BhY2UuZGVkaW1haWwuZXU+ Aug 28 10:59:49 auth: Debug: client in: CONT<hidden> Aug 28 10:59:49 auth: Debug: vpopmail(toorop(a)respublica.fr,178.32.33.247): lookup user=toorop domain=respublica.fr Aug 28 10:59:49 auth: Debug: client out: OK 1 user=toorop(a)respublica.fr Aug 28 10:59:49 auth: Debug: master in: REQUEST 1 2211 1 e4920e51f96ae453663098df19c5b374 Aug 28 10:59:49 auth: Debug: vpopmail(toorop(a)respublica.fr,178.32.33.247): lookup user=toorop domain=respublica.fr Aug 28 10:59:49 imap-login: Info: Internal login failure (auth failed, 1 attempts): user=<toorop(a)respublica.fr>, method=CRAM-MD5, rip=178.32.33.247, lip=184.106.217.69, mpid=2214, TLS Aug 28 10:59:49 master: Error: service(auth): child 2212 killed with signal 11 (core dumps disabled) strace : http://pastebin.com/kYsWHP5J Thanks, -- Toorop «Ils ne savaient pas que c'était impossible, alors ils l'ont fait.» Mark Twain

2 3

[Dovecot] Roff typo in sievec.1.in
by Mike Abbott 27 Aug '10

27 Aug '10

There is a roff typo in pigeonhole's sievec.1.in. Roff treats the leading apostrophe on line 54 as an invalid command and produces bad output: dump to be written to stdout. The out-file argument may also be omitted, which has the same effect as for a com- piled Sieve binary file. Note that this option is not The output should be: dump to be written to stdout. The out-file argument may also be omitted, which has the same effect as '-'. The output is identical to what the sieve-dump(1) command pro- duces for a compiled Sieve binary file. Note that this Here is a patch: --- a/doc/man/sievec.1.in +++ b/doc/man/sievec.1.in @@ -50,8 +50,9 @@ Don\(aqt write the binary to \fIout\-file\fP, but write a textual dump of the binary instead. In this context, the \fIout\-file\fP value '\-' has special meaning: it causes the the textual dump to be written to \fBstdout\fP. -The \fIout\-file\fP argument may also be omitted, which has the same effect as -'\-'. The output is identical to what the \fBsieve\-dump\fP(1) command produces +The \fIout\-file\fP argument may also be omitted, which has the same effect +as '\-'. +The output is identical to what the \fBsieve\-dump\fP(1) command produces for a compiled Sieve binary file. Note that this option is not allowed when the \fIout\-file\fP argument is a directory. .TP

2 1

[Dovecot] pigeonhole needs to ship doc/man/{reporting-bugs.inc, sed.sh}
by Paul Howarth 27 Aug '10

27 Aug '10

A tarball created from current pigeonhole hg using "make dist" doesn't include the files doc/man/{reporting-bugs.inc,sed.sh} and fails to build as a result. Attached patch works for me. Paul

2 1

[Dovecot] dovecot - mac firewall problem
by Patrick Fay 27 Aug '10

27 Aug '10

Hi, I am running dovecot 1.2.11 on mac osx 1.5.8. Everything works perfectly with the application-level firewall off, but enabling the application firewall prevents dovecot connections. I have tried explicitly authorizing dovecot in the firewall, but it does not work. I have searched everywhere I can think of to look, and haven't found a solution, but have seen a couple other reports of what seems to be the same problem. The firewall logs the activity with what looks like a corrupt process name: a typical appfirewall.log entry looks like: Aug 26 20:43:45 hostname Firewall[55]: Deny ^L connecting from XX.XX.XX.XX:37310 uid = 0 proto=6 Aug 26 20:43:53 hostname Firewall[55]: Deny ^H�^U��^Z connecting from XX.XX.XX.XX:37310 uid = 0 proto=6 Aug 26 20:44:09 hostname Firewall[55]: Deny ^L connecting from XX.XX.XX.XX:37310 uid = 0 proto=6 Aug 26 20:44:34 hostname Firewall[55]: Deny ^L connecting from XX.XX.XX.XX:37312 uid = 0 proto=6 Aug 26 20:44:45: --- last message repeated 6 times --- where "hostname" is my server name and the XX's are my client's IP address. For all of the other services I've used, the process name (e.g. dovecot) should appear after "Deny" when blocking traffic, instead of the funny characters. Any advice on how I could resolve this issue would be greatly appreciated. Thanks!

2 1

[Dovecot] LDAP & static userdb
by spamvoll＠googlemail.com 27 Aug '10

27 Aug '10

hi.. im just testing 2.0 before upgrading to v1.2 :) in auth-ldap.conf.ext i found # If you don't have any user-specific settings, you can avoid the userdb LDAP # lookup by using userdb static instead of userdb ldap, for example: # <doc/wiki/UserDatabase.Static.txt> #userdb { #driver = static #args = uid=vmail gid=vmail home=/var/vmail/%u #} On 1.2 im using LDAP lookup and everthing works like a charm. user_attrs = homeDirectory=home,uid=mail=maildir:/home/MAILBOXES/%$/mail On 2.0 is now tried to use this option cause all my mail are stored in /home/MAILBOXES/%uid/mail userdb { driver = static args = uid=vmail gid=vmail home=/home/MAILBOXES/%u/mail } and that doesnt work log say: dovecot: imap(hpeter): Error: user hpeter: Initialization failed: mail_location not set and autodetection failed: Mail storage autodetection failed with home=/home/MAILBOXES/hpeter/mail Hans

1 1

Re: [Dovecot] (Single instance) attachment storage
by Damon Atkins 27 Aug '10

27 Aug '10

Some interesting reading on SHA256 checksum http://blogs.sun.com/bonwick/entry/zfs_dedup http://blogs.sun.com/darren/entry/improving_zfs_dedup_performance_via

1 0

[Dovecot] Single instance storage - testing please
by Timo Sirainen 27 Aug '10

27 Aug '10

http://hg.dovecot.org/dovecot-2.0-sis contains the code for it. Otherwise it's the latest (as of writing this) dovecot-2.0 hg tree. Please test if you're interested in SIS. :) Once there's at least some testing, I'll probably add this to v2.0.x since very little of this new code is used when SIS is disabled (which is the default of course). SIS works pretty much like explained in http://dovecot.org/list/dovecot/2010-July/050832.html and http://dovecot.org/list/dovecot/2010-July/050992.html Two things I'm not yet entirely sure about: 1. What hash algorithm to use? Currently it's hard coded to SHA1. Besides more CPU usage, the other potential problem with larger hashes is that they also generate larger filenames. The filenames are currently hex-encoded, but to save space they could be changed to some kind of modified-base64 (base64 uses '/' chars, so it can't be regular base64). Example filename lengths: hex modified-base64 SHA1 73 50 SHA256 97 66 SHA512 161 109 Yet another possibility would be to use SHA256/SHA512 and just truncate the hash length to less number of bits. 2. Should I add support for trusting hash uniqueness and to avoid disk I/O generated by the byte-by-byte comparison? It could still first check that the file sizes match. Usage ----- You can enable SIS for sdbox and mdbox: mail_attachment_dir = /var/attachments Just setting the above enables "instant SIS", where byte-by-byte comparison is done immediately during saving mails. Alternative is to leave the comparing later by setting: mail_attachment_fs = sis-queue /var/attachments/queue:posix This does no deduplication itself yet. To do that you'll need a nighty (or whatever) run, which calls: doveadm sis deduplicate /var/attachments /var/attachments/queue There's also a feature to easily find all attachments based on a hash. For example: % sha1sum foo 351641b73feb7cf7e87e5a8c3ca9a37d7b21e525 foo % doveadm sis find /var/attachments 351641b73feb7cf7e87e5a8c3ca9a37d7b21e525 /var/attachments/35/16/351641b73feb7cf7e87e5a8c3ca9a37d7b21e525-e13a841f28ba764c123b00008c4a11c1 /var/attachments/35/16/351641b73feb7cf7e87e5a8c3ca9a37d7b21e525-1d3b940628ba764c0b3b00008c4a11c1 If you want to save attachments to a separate files without SIS (e.g. you want to use your filesystems deduplication), set: mail_attachment_fs = posix By default only attachments larger than 128 kB are written to attachment storage. You can change it from: mail_attachment_min_size = 128k It's also possible to create a plugin that adds further restrictions to when the attachment is saved separately. This might be useful to reduce disk seeks for attachments that are typically shown inline by clients/webmail. You can do this by overriding mailbox.save_is_attachment() method. If you want to distribute attachments to multiple filesystems, just create /var/attachments/[0-9a-f][0-9a-f] as symlinks pointing to whatever mount paths you want.

3 8

[Dovecot] Panic, rawtrace, log, etc
by Brandon Lamb 27 Aug '10

27 Aug '10

While running some doveadm expunge -A mailbox Spam savedbefore 30d and doveadm purge -A after 2010-08-26 16:20:51 auth: Error: net_accept() failed: Too many open files 2010-08-26 16:20:51 master: Warning: service(auth): process_limit reached, client connections are being dropped 2010-08-26 16:21:21 auth: Panic: file auth-request-handler.c: line 85 (auth_request_handler_unref): assertion failed: (hash_table_count(handler->requests) == 0) 2010-08-26 16:21:21 auth: Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x39c1a) [0x7fe41f5f5c1a] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x39c6a) [0x7fe41f5f5c6a] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7fe41f5d3026] -> dovecot/auth [8 wait, 0 passdb, 0 userdb]() [0x412153] -> dovecot/auth [8 wait, 0 passdb, 0 userdb]() [0x40c3ad] -> dovecot/auth [8 wait, 0 passdb, 0 userdb](auth_client_connections_deinit+0x41) [0x40c461] -> dovecot/auth [8 wait, 0 passdb, 0 userdb](main+0x2ea) [0x4168ca] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7fe41e60ac4d] -> dovecot/auth [8 wait, 0 passdb, 0 userdb]() [0x40b1f9] 2010-08-26 16:21:21 master: Error: service(auth): child 14880 killed with signal 6 (core dumps disabled) 2010-08-26 16:21:21 auth: Error: Master requested auth for nonexistent client 14875 2010-08-26 16:21:21 auth: Error: Master requested auth for nonexistent client 14873 2010-08-26 16:21:21 auth: Error: Master requested auth for nonexistent client 14873 2010-08-26 16:21:21 auth: Error: Master requested auth for client 14874 with invalid cookie 2010-08-26 16:21:21 auth: Error: Master requested auth for client 14874 with invalid cookie 2010-08-26 16:21:21 auth: Error: Master requested auth for client 14875 with invalid cookie 2010-08-26 16:21:21 auth: Error: Master requested auth for client 14876 with invalid cookie 2010-08-26 16:21:21 auth: Error: Master requested auth for client 14875 with invalid cookie

2 3

[Dovecot] Configuration Update From v1.x To v2.0.1-2
by Carlos Mennens 26 Aug '10

26 Aug '10

I just upgraded my Dovecot IMAP package on my mail server and when I restarted the service, I got the following warnings... doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:12: add auth_ prefix to all settings inside auth {} and remove the auth {} section completely doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:14: passdb pam {} has been replaced by passdb { driver=pam } doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:16: userdb passwd {} has been replaced by userdb { driver=passwd } doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:18: auth_user has been replaced by service auth { user } The list was much longer but I was able to self resolve them. I was wondering if someone here can assist me in converting my 'dovecot.conf' file? Below is how my dovecot.conf file appears: protocols = imap disable_plaintext_auth = yes log_timestamp = "%b %d %H:%M:%S " mail_location = maildir:~/mail auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep } auth default { mechanisms = plain login passdb pam { } userdb passwd { } user = root socket listen { client { path = /var/run/dovecot/auth-client user = postfix group = postfix mode = 0660 } } } ***doveconf -n*** [root@mail /]# doveconf -n # 2.0.1: /etc/dovecot/dovecot.conf doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:12: add auth_ prefix to all settings inside auth {} and remove the auth {} section completely doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:14: passdb pam {} has been replaced by passdb { driver=pam } doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:16: userdb passwd {} has been replaced by userdb { driver=passwd } doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:18: auth_user has been replaced by service auth { user } # OS: Linux 2.6.35 x86_64 auth_mechanisms = plain login mail_location = maildir:~/mail passdb { driver = pam } protocols = imap service auth { unix_listener auth-client { group = postfix mode = 0660 user = postfix } user = root } userdb { driver = passwd } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep }

4 7

[Dovecot] How to pipe to external program
by Egbert 26 Aug '10

26 Aug '10

Hi, Second try... I have mailsystem with virtual users only (/home/vmail/domain/user). I need to integrate RT3.x (a ticketing system). I have installed the RT-client but I need to send the mail to an extrnal program. Rt wants me to insert: |/usr/bin/rt-mailgate --queue bla --action bla --url http://bla.bal/ In /etc/postfix/aliases. That does not work for me becase my local delivery agent is dovecot. The Sieve plugin seems not capable to forward to a external program. What is the right way to achieve that mail to rt@mydomain is sent to the pipe? TIA Egbert Jan

2 1

Re: [Dovecot] Investigating suspected cache corruption
by Maria Elinger 26 Aug '10

26 Aug '10

Hi David and all, I´ve read the mail you posted in the Dovecot list. We´re are having this same problem in a site which is very similar to yours. We also migrated from Courier to Dovecot nearly 9 months ago, and every now and then users complain about slowness in the imap connection. We fix it by removing the index files in the user's maildir. We use Horde as webmail, but the problem appears with any imap or pop connection, so we feel that the problem is in Dovecot. Did you find any solution or workaround at your site?, it would be very useful if you gave us a hint on this. Thanks in advance, María Elinger [Dovecot] Investigating suspected cache corruption David Warden Wed, 14 Oct 2009 13:18:17 Hi All, I'm running Dovecot 1.1.11 for a site of about 7000 active users with a Squirrelmail frontend. We migrated from Courier (big shout to everyone who worked on the wonderful part of the Dovecot wiki that deals with Courier migration) and I have been extremely happy with the performance gains Dovecot has given us. Not only is the IMAP part of Squirrelmail faster, but our same hardware is under far less stress than it was before the migration. To date, the only problem we have experienced is a seemingly random but significant slowdown in Squirrelmail's loading of the messages in a user's Inbox. Each time, I have been able to fix the problem by deleting the user's dovecot.index, dovecot.index.cache and dovecot.index.log files in the user's INDEX directory for their dovecot Inbox. I tried having users experiencing this problem log in to a test Squirrelmail box with mail_debug on, but I didn't see anything out of the ordinary and they report the same slowness on the test server. I don't see anything but normal login/logout IMAP lines in the production dovecot logs. I have hesitated a bit in posting to the list since this seems to be happening to a small percentage of users and it technically may be a problem with Squirrelmail, but the fact that I'm able to fix the problem by nuking Dovecot's index files has me concerned - does anyone have any suggestions for troubleshooting? My first idea when I get another one of these is to do a telnet IMAP session to Dovecot on one of the Squirrelmail boxes and see if I can get it to slow down when retrieving messages from the Inbox. We are using Maildir over NFS with the control/index files stored on NFS as well. We're doing FS quota over NFS using rquotad to query the NFS server for each user's quota. Here's the output of dovecot -n: # 1.1.11: /etc/dovecot.conf Warning: fd limit 1024 is lower than what Dovecot can use under full load (more than 1536). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: Linux 2.6.18-128.1.1.0.1.el5 x86_64 Red Hat Enterprise Linux Server release 5.3 (Tikanga) login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_process_per_connection: no login_processes_count: 10 login_max_processes_count: 512 verbose_proctitle: yes first_valid_uid: 0 mail_location: maildir:~/Maildir:CONTROL=/Mail/mailhome/ %u/.dovecot:INDEX=/Mail/mailhome/%u/.dovecot mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_drop_priv_before_exec: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): imap_logout_format(default): bytes(in/out)=%i/%o imap_logout_format(imap): bytes(in/out)=%i/%o imap_logout_format(pop3): bytes=%i/%o pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): UID%u-%v pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_logout_format(default): top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_logout_format(imap): top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_logout_format(pop3): top(count/bytes)=%t/%p, retr(count/bytes)=%r/ %b, del(deleted/pre-deleted)=%d/%m, mailbox-size(bytes)=%s namespace: type: private prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd plugin: quota: fs:Mail Quota:user Many thanks, David Warden

2 2

[Dovecot] 1.2.13 QRESYNC crash.
by David Woodhouse 26 Aug '10

26 Aug '10

Aug 18 22:07:31 twosheds IMAP(dwmw2): : Panic: file mail-index-transaction.c: line 637 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in as dwmw2 0 enable condstore qresync * ENABLED CONDSTORE QRESYNC 0 OK Enabled. A00131 SELECT lists.bluez (QRESYNC (1154090296 1861 1:* (1,120,1578,2064,2226,2280,2298 1,120,12037,12523,12685,12739,12757))) Program received signal SIGABRT, Aborted. 0x00000034ace326c5 in raise () from /lib64/libc.so.6 Missing separate debuginfos, use: debuginfo-install cyrus-sasl-lib-2.1.23-9.fc12.x86_64 glibc-2.11.2-1.x86_64 keyutils-libs-1.2-6.fc12.x86_64 krb5-libs-1.7.1-9.fc12.x86_64 libcom_err-1.41.9-8.fc12.x86_64 libgcc-4.4.4-10.fc12.x86_64 libselinux-2.0.90-5.fc12.x86_64 nss-softokn-freebl-3.12.6-2.fc12.1.x86_64 openldap-2.4.19-4.fc12.x86_64 openssl-1.0.0a-1.fc12.x86_64 zlib-1.2.3-23.fc12.x86_64 (gdb) bt #0 0x00000034ace326c5 in raise () from /lib64/libc.so.6 #1 0x00000034ace33ea5 in abort () from /lib64/libc.so.6 #2 0x00000000004a2698 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:160 #3 0x00000000004a273b in i_syslog_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=<value optimized out>, args=<value optimized out>) at failures.c:315 #4 0x00000000004a1d86 in i_panic (format=0x6 <Address 0x6 out of bounds>) at failures.c:207 #5 0x00000000004787f0 in mail_index_transaction_lookup ( t=<value optimized out>, seq=<value optimized out>) at mail-index-transaction.c:637 #6 0x000000000047be45 in tview_lookup_uid (view=<value optimized out>, seq=<value optimized out>, uid_r=<value optimized out>) at mail-index-transaction-view.c:162 #7 0x00000000004580fb in index_mail_set_seq (_mail=0x7282b8, seq=1578) at index-mail.c:1229 #8 0x0000000000423eb4 in expunges_drop_known (ctx=0x70a628) at imap-fetch.c:178 #9 get_expunges_fallback (ctx=0x70a628) at imap-fetch.c:269 #10 imap_fetch_send_vanished (ctx=0x70a628) at imap-fetch.c:291 #11 imap_fetch_begin (ctx=0x70a628) at imap-fetch.c:314 #12 0x000000000041e8e2 in select_qresync (cmd=<value optimized out>, ---Type <return> to continue, or q <return> to quit--- readonly=<value optimized out>) at cmd-select.c:243 #13 select_open (cmd=<value optimized out>, readonly=<value optimized out>) at cmd-select.c:320 #14 cmd_select_full (cmd=<value optimized out>, readonly=<value optimized out>) at cmd-select.c:382 #15 0x0000000000420ead in client_command_input (cmd=0x70a458) at client.c:612 #16 0x0000000000420f8d in client_command_input (cmd=0x70a458) at client.c:661 #17 0x00000000004211b5 in client_handle_next_command (client=0x709ff0) at client.c:702 #18 client_handle_input (client=0x709ff0) at client.c:714 #19 0x0000000000421a5c in client_input (client=0x709ff0) at client.c:753 #20 0x00000000004aa7cd in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:208 #21 0x00000000004a9c38 in io_loop_run (ioloop=0x707cc0) at ioloop.c:335 #22 0x0000000000429726 in main (argc=<value optimized out>, argv=<value optimized out>, envp=<value optimized out>) at main.c:327 It's a public mailing list folder, so I've uploaded it to http://david.woodhou.se/bluez-maildir.tar.gz Filed as Red Hat bug #625907: https://bugzilla.redhat.com/show_bug.cgi?id=625207 -- dwmw2

3 10

[Dovecot] New problem with migration to 2.0
by Carsten Laun-De Lellis 26 Aug '10

26 Aug '10

Hi guys After fixing my master_auth problem i have one error message left and i don't know what to do. The message from dovecot -n is: service auth { unix_listener /var/spool/postfix/private/auth { group = vmail mode = 0666 user = vmail } unix_listener auth-master { mode = 0666 } } My conf file looks like userdb { driver=static args = uid=10000 gid=10000 home=/mail/%d/%n allow_all_users=yes } As you can see pretty simple, but for me it looks like that the driver=static won't be accepted. Does anyone know which driver to use here ? Mit freundlichem Gruß Carsten Laun-De Lellis Dipl.-Ing. Elektrotechnik Certified Information Systems Auditor (CISA) Hauptstrasse 13 D-67705 Trippstadt Phone: +49 (6306) 992140 Mobile: +49 (151) 27530865 email: carsten.laun-delellis(a)delellis.net

2 4

[Dovecot] migration to dovecot 2.0
by Carsten Laun-De Lellis 26 Aug '10

26 Aug '10

Hi everyone I am not the dovecot guru and i would appreciate if anyone could help me on my problems. I am running a mail server on dovecot 1.2 and want to migrate to dovecot 2. I have edited the conf file and now using the new keywords and got everything fixed but the following error message still exists, when i try to start dovecot. doveconf: Fatal: Error in configuration file /usr/local/etc/dovecot/dovecot.conf line 1036: Unknown setting: auth_socket doveconf: Error: managesieve-login: dump-capability process returned 89 doveconf: Fatal: Error in configuration file ./dovecot.conf line 1036: Unknown setting: auth_socket My conf file looks like auth_socket listen { master { # Master socket provides access to userdb information. It's typically # used to give Dovecot's local delivery agent access to userdb so it # can find mailbox locations. path = /var/run/dovecot/auth-master mode = 0600 # Default user/group is the one who started dovecot-auth (root) user = vmail #group = } client { # The client socket is generally safe to export to everyone. Typical use # is to export it to your SMTP server so it can do SMTP AUTH lookups # using it. path = /var/spool/postfix/private/auth # path = /var/run/dovecot/auth-client mode = 0660 user = postfix group = postfix } } I would appreciate any hints and help. Mit freundlichem Gruß Carsten Laun-De Lellis Dipl.-Ing. Elektrotechnik Certified Information Systems Auditor (CISA) Hauptstrasse 13 D-67705 Trippstadt Phone: +49 (6306) 992140 Mobile: +49 (151) 27530865 email: carsten.laun-delellis(a)delellis.net

2 2

[Dovecot] Does Dovecot support the use of the INDEX directive for mdbox?
by William Blunn 26 Aug '10

26 Aug '10

Does Dovecot support the use of the INDEX directive for mdbox? e.g. mail_location = mdbox:~/mdbox:INDEX=/var/indexes/%u Bill

2 1

[Dovecot] Table mail.users doesn't exist (using built-in default iterate_query: SELECT username, domain FROM users)
by Jerrale G 26 Aug '10

26 Aug '10

connect = host=127.0.0.1 user=mail password=thecorrectpass dbname=mail map { pattern = shared/expire/$user/$mailbox table = mail.expires value_field = expire_stamp fields { username = $user mailbox = $mailbox } } dovecot: auth: Error: mysql: Query failed, retrying: Table 'mail.users' doesn't exist Aug 26 05:16:24 server1 dovecot: auth: Error: sql: Iterate query failed: Table 'mail.users' doesn't exist (using built-in default iterate_query: SELECT username, domain FROM users) Why isn't the expire dict trying to use the defined working mysql auth instead of using the built-in default? The howto doesn't say how to override this, at wiki2.dovecot.org, and I didn't know the expire dict wanted to lookup the mailbox table; I thought it only wanted to lookup the expire table and use that soley for deleting messages as all info needed was stored, in the expire table, by the expire plugin on message delivery or copy. Jerrale G rrale G. SC Senior Admin

1 0

[Dovecot] best way something thinks to upgrade dovecot to 1.2.* 2.0.*
by fakessh 26 Aug '10

26 Aug '10

hello all hello dovecot network hello timo What are your tips for successful migration for dovecot (atrpms , atrpms-testing depot for centos ) the page of wiki http://wiki2.dovecot.org/Upgrading/2.0 explains the method to upgrade I tried on my personal machine and the command cites wiki returns errors on the terminal what to do with errors: correct the error in the configuration file ? the question may seem simple but it is not pointless many returns are welcome something thinks are welcome thanks

2 10

[Dovecot] dovecot 1 to 2 migration FreeBSD
by Frank Bonnet 26 Aug '10

26 Aug '10

Hello is there some specials recommentations to migrate from dovecot 1.1.x to 2.0.1 with FreeBSD boxes ? Thanks

5 11

[Dovecot] Home directories
by Timo Sirainen 26 Aug '10

26 Aug '10

I've noticed that a lot of people are using e.g.: mail_location = maildir:/var/vmail/%d/%n Then either they don't have home directory set, or their home directory is the same as the maildir. http://wiki.dovecot.org/VirtualUsers/Home explains all the problems of not separate home and mail directories. Also whenever I try to suggest using a separate home and mail directory, the answer is way too often: "But I'm using virtual users. (They don't have home directories.)" So I started wondering. Maybe simply renaming the "home" to something else would help here at least some. Make all of the documentation use only the new word, and add alias for userdb so that the new name and the "home" both work (I guess docs would need to keep using the "home" as field name for some more years). So far I've only come up with "vhome" as the replacement name. Other ideas?

12 19

[Dovecot] DSYNC needs a lot more documentation
by Marc Perkel 26 Aug '10

26 Aug '10

Started looking into the dsync utility and the doc are seriously incomplete. I can of course scour the internet looking for the missing information but that doesn't fix the problem with the docs. I might try to rewrite the docs myself once I figure it out.

9 15