January 2013 - dovecot

[Dovecot] Reviewing end-user ham/spam submissions before feeding them to sa-learn via Dovecot Antispam plug-in
by Ben Johnson 01 Feb '13

01 Feb '13

Currently, I'm using the Dovecot Antispam plug-in with great success. Everything works as expected. However, I would like to change the plug-in's behavior such that it simply sends a copy of a message that is moved from Inbox -> Junk (or Junk -> Inbox) to an administrator, instead of calling sa-learn (I'm using SpamAssassin) automatically. Basically, I would like to be able to review messages that end-users submit for training before they are actually fed to sa-learn. Has anyone had a similar need? If the Antispam plug-in already supports this, if the necessary commands can simply be added to the shell script that Antispam calls, or if there is a better method altogether, any help is greatly appreciated. Thank you! -Ben

2 4

[Dovecot] Dovecot Director Doveadm fails when there are a lot of output information
by Ramon Frontera 31 Jan '13

31 Jan '13

Hi, we are running dovecot 2.1.13 We have 2 proxies with director and 4 mail servers. we use LDAP when we execute doveadm-quota -A and doveadm with few output lines, its works fine. When we use doveadm-search or doveadm-mailbox with a lot of output information the command stops the execution and the command no ends. The connection to one of the 4 mailserver has finished at this moment. I have made some tests and i have found that if we use only one mailserver the commands works fine. I put the gdm bt output hope it help you. (the proxy thats executes the command) (gdb) bt full #0 0x0000003872ee86f3 in __epoll_wait_nocancel () from /lib64/libc.so.6 No symbol table info available. #1 0x0000003873a534b8 in io_loop_handler_run (ioloop=0x2364120) at ioloop-epoll.c:181 ctx = 0x236b080 events = <value optimized out> event = <value optimized out> list = <value optimized out> io = <value optimized out> tv = {tv_sec = 59, tv_usec = 389208} msecs = 59390 ret = <value optimized out> i = <value optimized out> call = <value optimized out> #2 0x0000003873a52488 in io_loop_run (ioloop=0x2364120) at ioloop.c:398 No locals. #3 0x0000003873a3de43 in master_service_run (service=0x2363fd0, callback=<value optimized out>) at master-service.c:544 No locals. #4 0x0000000000413d6e in doveadm_server_flush_one () No symbol table info available. #5 0x0000000000414741 in doveadm_mail_server_user () No symbol table info available. ---Type <return> to continue, or q <return> to quit--- #6 0x000000000040e6bc in doveadm_mail_next_user () No symbol table info available. #7 0x000000000040ed7c in doveadm_mail_cmd () No symbol table info available. #8 0x000000000040f00c in doveadm_mail_try_run () No symbol table info available. #9 0x00000000004162b1 in main () No symbol table info available. Thanks in advance! -- ------------------------------------------ Ramon Frontera Universitat de les Illes Balears

1 0

[Dovecot] Dovecot 2.2.beta1 errors
by Andreas Kasenides 31 Jan '13

31 Jan '13

From the command >doveadm log errors we get > Jan 31 15:41:12 imap(xxxx): Panic: Buffer full (8221 > 8192, pool > <none>) Jan 31 15:41:12 imap(xxxx): Error: Raw backtrace: > /usr/local/lib/dovecot/libdovecot.so.0(+0x5b83a) [0x7ffbaa3a783a] -> > /usr/local/lib/dovecot/libdovecot.so.0(+0x5b886) [0x7ffbaa3a7886] -> > /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7ffbaa36adaf] -> > /usr/local/lib/dovecot/libdovecot.so.0(+0x57cfc) [0x7ffbaa3a3cfc] -> > /usr/local/lib/dovecot/libdovecot.so.0(+0x5134f) [0x7ffbaa39d34f] -> > /usr/local/lib/dovecot/libdovecot.so.0(+0x4a02d) [0x7ffbaa39602d] -> > /usr/local/lib/dovecot/libdovecot.so.0(+0x4a0ca) [0x7ffbaa3960ca] -> > /usr/local/lib/dovecot/libdovecot.so.0(i_stream_read+0x64) > [0x7ffbaa3af924] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x6844c) > [0x7ffbaa3b444c] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x685f1) > [0x7ffbaa3b45f1] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x686d0) > [0x7ffbaa3b46d0] -> > /usr/local/lib/dovecot/libdovecot.so.0(i_stream_read+0x64) > [0x7ffbaa3af924] -> > /usr/local/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x52) > [0x7ffbaa3afc32] -> > /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x987ba) > [0x7ffbaa69a7ba] -> > /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_binary_stream+0x135) > [0x7ffbaa69ac45] -> > /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_get_binary_stream+0x61) > [0x7ffbaa674481] -> > /usr/local/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0xb0) > [0x7ffbaa6cf980] -> dovecot/imap() [0x418619] -> dovecot/imap() > [0x4166e2] -> dovecot/imap(imap_fetch_more+0x31) [0x416911] -> > dovecot/imap(cmd_fetch+0x41f) [0x40cd9f] -> > dovecot/imap(command_exec+0x3d) [0x414e2d] -> dovecot/imap() > [0x41402e] -> dovecot/imap(client_handle_input+0x11d) [0x41431d] -> > dovecot/imap(client_input+0x6f) [0x41468f] -> > /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) > [0x7ffbaa3b5fe6] -> > /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) > [0x7ffbaa3b7027] -> > /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) > [0x7ffbaa3b5f88] Jan 31 15:41:12 imap(xxxx): Fatal: master: > service(imap): child 2236 killed with signal 6 (core dumped) where xxxx is the offending user name. The error repeats at random intervals, I guess related to the activity. Since we are using Horde 5 on the front end we get the following errors from it: > Jan 31 15:02:59 thalia HORDE: [imp] Mail server closed the connection > unexpectedly. [pid 6402 on line 390 of > "/sys-data/WebData/horde/imp/lib/Imap.php"] Jan 31 15:02:59 thalia > HORDE: [imp] Operation failed due to a lack of a secure connection. > [pid 6402 on line 390 of "/sys-data/WebData/horde/imp/lib/Imap.php"] > Jan 31 15:02:59 thalia HORDE: [imp] Operation failed due to a lack of > a secure connection. [pid 6402 on line 390 of > "/sys-data/WebData/horde/imp/lib/Imap.php"] Jan 31 15:02:59 thalia > HORDE: [imp] Operation failed due to a lack of a secure connection. > [pid 6402 on line 94 of > "/sys-data/WebData/horde/imp/lib/Imap/Exception.php"] We believe these are related to the above Dovecot error since they happens together. Is this a Dovecot problem? Config attached. Thanx -- Andreas Kasenides Senior IT Officer Dept. of Computer Science, University of Cyprus Tel: 22892714, Fax: 22892701

2 1

[Dovecot] sieve_max_redirects=0 not working as documented
by Arnaud Abélard 31 Jan '13

31 Jan '13

Hello I'm trying to keep my users from using the "redirect" action with pigeonhole from dovecot 2.0.21. As documented in http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration I configured sieve like this: plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_max_redirects = 0 } (and doveconf indeed shows the new setting for sieve_max_redirects) Unfortunately I can still use the redirect action: lda(dummy(a)univ-nantes.fr): Debug: sieve: executing script from /vmail/d/u/dummy/.dovecot.svbin lda(dummy(a)univ-nantes.fr): sieve: msgid=<510A758D.1030305(a)univ-nantes.fr>: forwarded to <xxxx(a)xxxxx.com> what could I have missed? Thanks, Arnaud -- Arnaud Abélard (jabber: arnaud.abelard(a)univ-nantes.fr) Administrateur Système - Responsable Services Web Direction des Systèmes d'Informations Université de Nantes - ne pas utiliser: trapemail(a)univ-nantes.fr

2 1

[Dovecot] Cleanups in HG f11ae64365b5 break Authentication
by Thomas Leuxner 31 Jan '13

31 Jan '13

==> /var/log/dovecot/dovecot.log <== Jan 30 19:57:51 spectre dovecot: master: Warning: SIGHUP received - reloading configuration Jan 30 19:58:48 spectre dovecot: imap-login: Login: user=<tlx(a)leuxner.net>, method=PLAIN, rip=1.2.3.4, lip=5.6.7.8, mpid=15572, TLS, session=<o4WxGYbUsQBeT5Qc> Jan 30 19:58:48 spectre dovecot: imap(tlx(a)leuxner.netuid=5000): Error: user tlx(a)leuxner.netuid=5000: Couldn't drop privileges: User is missing UID (see mail_uid setting) Jan 30 19:58:48 spectre dovecot: imap(tlx(a)leuxner.netuid=5000): Error: Internal error occurred. Refer to server log for more information.

2 2

[Dovecot] v2.1.14 released
by Timo Sirainen 30 Jan '13

30 Jan '13

http://dovecot.org/releases/2.1/dovecot-2.1.14.tar.gz http://dovecot.org/releases/2.1/dovecot-2.1.14.tar.gz.sig If you've been waiting for a fully stable release after the recent cache file troubles in v2.1.11+, this release should be the one. Hopefully there won't be v2.1.15 anytime in near future. (v2.2.rc1 does look close though.) BTW. I know there are quite a lot of mails I haven't replied to in dovecot list. Too busy for now.. + doveadm acl recalc command added - v2.1.11+ had a race condition where it sometimes overwrote data in dovecot.index.cache file. This could have caused Dovecot to return the same cached data to two different messages. - mdbox: Fixes to handling duplicate GUIDs during index rebuild

1 0

[Dovecot] decode2text.sh
by bhs692-dove＠yahoo.com 30 Jan '13

30 Jan '13

Dovecot version: 2.1.13 OS: Centos 6.3 CPU: 64bit x86 There appear to be two related errors in the decode2text.sh file (which can be used for indexing/ searching attachments). - The layout of "$formats" has repeated values for pdf, ppt, etc, so you should only match the pattern once by adding -m1 - The layout of "$formats" has the file extension in the second "column", so the "start of line"(^) match doesn't work as is. Original problem line (from ./src/plugins/fts/decode2texh.sh): fmt=`echo "$formats" | grep -w "^$content_type" | cut -d ' ' -f 2` Here are two options that appear to solve the problem. The first option is probably preferred, since it matches exactly the extension to the second "column". 1) switch the order of commands (cut & grep) and add -m1. for example: fmt=`echo "$formats" | cut -d ' ' -f 2 | grep -w -m1 "^$content_type"` -OR- 2) add "m1" and remove "^". for example: fmt=`echo "$formats" | grep -w -m1 "$content_type" | cut -d ' ' -f 2`

2 1

[Dovecot] passdb to add extra fields?
by Timo Sirainen 30 Jan '13

30 Jan '13

Some passdbs like PAM can't really return any extra fields. Also some people have wanted to combine users' data from different passdb/userdbs so that for example you'd have userdb passwd give the uid/gid/home, but then you'd also have some other userdb give quota limits. So I was thinking something like this: passdb { driver = pam } passdb { driver = sql include = yes } or: userdb { driver = passwd } userdb { driver = passwd-file include = yes } I'm not sure about two things: 1) Should there be a way to replace all of the existing fields instead of just adding new ones? 2) Any thoughts of a better name than "include"? With passdb it would mean that it's included only when the authentication failed for some other passdb. With userdb it means it's included only if a previous userdb lookup succeeded. Also there are already "deny" and "pass" settings. Interaction with them can be somewhat confusing.. Maybe all of these should be replaced with: type=deny: Same as old deny=yes (deny auth if user is in list) type=precondition(?): Same as pass=yes (require another passdb to match) type=postcondition(?): Require user to exist in this passdb/userdb as well, adding any extra fields in it. type=add: Add any extra fields, if the user exists at all. (Better ideas for the names here? Is even "type" a good name?) Then maybe a new setting to delete existing extra fields .. or perhaps just extend passdb { override_fields } so that having "-field" would delete the field if it already existed..

3 6

[Dovecot] A lot of dovecot/imap processes
by Juan Cifo Servera 30 Jan '13

30 Jan '13

Hello! I have a dovecot installed and many users could login via IMAP over SSL (40 users at same time aprox). Users could have "Check mail every X time" enabled in their client (Thunderbird or K-9 mail) - Is this required feature? I noted that if I disable it I still getting news mails without having to check for new mails manually - . I noted that dovecot is creating a lot of process (dovecot/imap and dovecot/imap-login) and is requiring more and more RAM. I think that every login starts a process but never is endend. The output of /*ps aux | grep dovecot | wc*/ is increasing until 250 lines aprox. I think that is limited by process_limit = 256. But if I put process_limit = 100, in the log appers a message that dovecot is aborting logins (and I noted that new connections sometimes couldn't login). Anyway the mailserver is working well, but I'm afraid of the consumtion of RAM. Is that normal? Details: # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-36-generic-pae i686 Ubuntu 12.04.1 LTS nfs auth_mechanisms = plain login dotlock_use_excl = no log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = always mail_location = maildir:/mnt/vmail/%d/%n/Maildir mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vacation-seconds mmap_disable = yes namespace { inbox = yes location = prefix = separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { autocreate = Trash autocreate2 = Sent autocreate3 = Drafts autosubscribe = Trash autosubscribe2 = Sent autosubscribe3 = Drafts sieve = /mnt/vmail/%d/%n/Maildir/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +vacation-seconds sieve_global_dir = /etc/dovecot/sieve_global_dir sieve_global_path = /etc/dovecot/default.sieve sieve_vacation_default_period = 2s sieve_vacation_max_period = 3s sieve_vacation_min_period = 1s } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } user = root } service imap-login { inet_listener imap { port = 0 } process_limit = 256 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 10 } service pop3-login { process_limit = 256 } ssl = required ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } userdb { args = uid=5000 gid=5000 home=/mnt/vmail/%d/%n allow_all_users=yes driver = static } protocol imap { imap_capability = IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDP LUS LIST-EXTENDED I18NLEVEL=1 ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS mail_plugins = autocreate } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master log_path = /var/log/dovecot-deliver.log mail_plugins = " sieve" postmaster_address = ###(a)###.### } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " sieve" } Thank-you very much.

3 2

[Dovecot] Storage plugin documentation
by James Devine 30 Jan '13

30 Jan '13

Is there any documentation anywhere on creating a new storage plugin besides looking through the existing storage code? It's a pretty extensive task and any documentation would help. Thanks

2 1