- dovecot - dovecot.org

Multiple user attributes in LDAP userdb query strings
by BINOTTO Luis SIDOR 21 Oct '14

21 Oct '14

Hello list, I have an issue with dovecot and Ldap... Any help will be grateful... I have my virtual users stored in an Active Directory database. I am using 2 attributes in AD to locate the user account: mail (their primary email address) and proxyAddresses (a multivalue attribute containing their mail aliases). I also control the mount point in which the mail is located with another attribute in AD, in this case I used "pager". I have dovecot 1.2.15 and there are no immediate plans to upgrade it. I configured Dovecot's deliver process in order to integrate sieve capability. I have configured userdb ldap and passdb ldap in Dovecot and have set up master and client sockets. I am using maildir format for directory layout. The problem is to set the variables home and mail that will define the mail location. The format must be like this: home: /Mailboxes/<mount point>/<user login>/ mail: /Mailboxes/<mount point>/<user login>/Maildir So, for a particular user (Login: user1, smtp: user1(a)domain1.com, alias smtp: user1_alias(a)domain1.com) the variables will be: home: /Mailboxes/AdmUsers/user1/ mail: /Mailboxes/AdmUsers/user1/Maildir Active Directory has the values in: mail:(user1@domain1.com), proxyAddresses:(user1_alias@domain1.com), sAMAaccountName(user1). I have defined home and mail in dovecot-ldap.conf. # User attributes are given in LDAP-name=dovecot-internal-name list. The # internal names are: # uid - System UID # gid - System GID # home - Home directory # mail - Mail location # # There are also other special fields which can be returned, see # http://wiki.dovecot.org/UserDatabase/ExtraFields user_attrs = pager=home=/mailboxes/%$/%u,mobile=quota_rule=*:storage=%$M If the mail is sent to the Principal SMTP (user1(a)domain1.com) in which the user part (%u) is the same as sAMAccountName, it works. The variable home is set correctly (home: /Mailboxes/AdmUsers/user1/). The problem is when the mail is sent to the smtp alias, in which the variable home is set incorrectly (home: /Mailboxes/AdmUsers/user1_alias/). There is a way to set two values to user_attrs?, in this case I would need to set pager and sAMAccountName (instead of %u), to it. Thanking you in anticipation... Attached is the out of dovecot -n # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-686 i686 Debian 6.0.7 log_path: /var/log/dovecot.log protocols: imap imaps pop3 pop3s disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_uid: 16343 mail_gid: 16343 mail_location: maildir:~/Maildir mail_debug: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): autocreate deleted_to_trash quota imap_quota expire mail_plugins(imap): autocreate deleted_to_trash quota imap_quota expire mail_plugins(pop3): quota expire mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh lda: postmaster_address: postmaster(a)domain1.com mail_plugins: quota expire log_path: /var/log/dovecot.log auth default: mechanisms: gssapi gss-spnego login ntlm plain username_format: %Ln use_winbind: yes passdb: driver: pam userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: autocreate: Deleted Items autocreate: Sent Items autosubscribe: Deleted Items autosubscribe: Sent Items deleted_to_trash_folder: Sent Items quota: maildir:User quota quota_rule: *:storage=100M quota_rule2: Deleted Items:ignore quota_warning: storage=80%% /etc/dovecot/scripts/quota-warning.sh 80 quota_warning2: storage=90%% /etc/dovecot/scripts/quota-warning.sh 90 quota_warning3: storage=99%% /etc/dovecot/scripts/quota-exceeded.sh 100 expire: "Deleted Items" 1 "Deleted Items/*" 1 expire_dict: proxy::expire dict: expire: pgsql:/etc/dovecot/dovecot-dict-expire.conf " Notificacion Automatica: Este mensaje y cualquier archivo que se adjunte contiene informacion privilegiada y confidencial. Es para uso exclusivo del destinatario. Si usted ha recibido esta comunicacion por error, por favor avisenos inmediatamente. Automatic notification: This e-mail and any file transmitted with it are confidential and may be legally privileged. It is intended solely for the addressee and may not be disclosed to or used by anyone other than the addressee. If you have received this e-mail by mistake , please advise the sender immediately"

1 0

Proxy problem: "imap-login: Error: proxy(USERNAME): connect(10.x.x.178, 993) failed: Cannot assign requested address (after 0 secs, local=10.x.x.104)"
by Ralf Hildebrandt 21 Oct '14

21 Oct '14

After fixing the "duplicate compression" problem, we're now encountering "imap-login: Error: proxy(USERNAME): connect(10.x.x.178, 993) failed: Cannot assign requested address (after 0 secs, local=10.x.x.100)" in the logs. We already tried raising the ulimit, the max number of open files. Once we reach about 25k connections, we're getting the error above... for all local addresses. It seems as if the system cannot create any more outgoing connections. We already optimized: ---- snip ---- net.ipv4.tcp_fin_timeout=5 # down from 30s net.ipv4.tcp_tw_reuse=1 net.ipv4.tcp_tw_recycle=1 # http://redis4you.com/articles.php?id=012&name=Redis+high+traffic+connection… net.ipv4.ip_local_port_range=10000 65000 # http://www.fromdual.com/huge-amount-of-time-wait-connections net.ipv4.netfilter.ip_conntrack_max=524288 ---- snip ---- But still we get (once the load is rising beyond some point): # fgrep "Cannot assign requested address" /var/log/dovecot/dovecot.log |awk '{print $NF}' | sort | uniq -c | sort -n 142 local=10.x.x.100) 147 local=10.x.x.107) 148 local=10.x.x.106) 151 local=10.x.x.104) 151 local=10.x.x.109) 152 local=10.x.x.105) 156 local=10.x.x.110) 162 local=10.x.x.102) 165 local=10.x.x.101) 178 local=10.x.x.103) 189 local=10.x.x.108) We're using multiple local addresses when proxying to the backends -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

4 7

only inbox folder after courier-imap migration
by Luciano Gabriel Andino 21 Oct '14

21 Oct '14

Hello, after courier-dovecot-migrate.pl, the only folder appears in webmail menu is "Inbox". The others still are in Maildir "Maildir/.myfolder" and contains its "dovecot-uidlist" and "dovecot-keywords" files. May I need to edit some file? -- Saludos!! Luciano Andino GNU/Linux user #185103 Santa Fe - Argentina -----------------------------------------------

1 0

Dovecot Auth Issue
by Austin Einter 21 Oct '14

21 Oct '14

Dear All I have been able to setup postfix and dovecot. Through command line, I can send mail out. Now I have installed roundcube in mail server side, and I am able to access like https://mydomain/webmail.com Login was failing. Then I debugged and modified settings in dovecot and using PAM for authentication. Now I trying to login to email server. I am not sure if authentication by dovecot and pam is successful. I enabled logging for dovecot. The below logs I get when a user "try" logs in. Oct 21 07:44:55 auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Oct 21 07:44:55 auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Oct 21 07:44:55 auth: Debug: auth client connected (pid=15357) Oct 21 07:44:55 auth: Debug: client in: AUTH 1 PLAIN service=imap secured lip=128.199.214.27 rip=128.199.214.27 lport=993 rport=43323 resp=AHRyeUBsb2FkbXVsdGlwbGllci5jb20AdHJ5MTIz Oct 21 07:44:55 auth-worker: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Oct 21 07:44:55 auth-worker: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Oct 21 07:44:55 auth-worker: Debug: pam(try,128.199.214.27): lookup service=dovecot Oct 21 07:44:55 auth-worker: Debug: pam(try,128.199.214.27): #1/1 style=1 msg=Password: Oct 21 07:44:55 auth: Debug: client out: OK 1 user=try Oct 21 07:44:55 auth: Debug: master in: REQUEST 1571291137 15357 1 b3cc155dfd3bb2fd576bfeeceaf1ce3d Oct 21 07:44:55 auth: Debug: passwd(try,128.199.214.27): lookup *Oct 21 07:44:55 auth: Debug: master out: USER 1571291137 try home=/var/mail/ mail=maildir:/var/mail/try system_groups_user=try uid=5001 gid=5001*Oct 21 07:44:55 imap-login: Info: Login: user=<try>, method=PLAIN, rip=128.199.214.27, lip=128.199.214.27, mpid=15361, TLS *Oct 21 07:44:55 imap(try): Info: Disconnected: Logged out bytes=29/399* >From the logs above (in bold), I hope auth is successful, then in last line why it is logging out.., I am confused , not sure if auth is completely successful or not. Kindly experts please help. Best Regards, Austin

1 0

SMTP authentication setup
by Brian 21 Oct '14

21 Oct '14

At my company we've had a longstanding problem of not being able to send email from devices outside of our internal network and any specific IP address that we open the relay to. As it turns out, SASL has never been set up. I need to set up SASL ASAP but none of the guides I've found seem to work. This is the latest guide I tried: http://wiki2.dovecot.org/HowTo/PostfixAndDovecotSASL I did everything on here minus the last part because it's on the same server. Also, instead of submission inet n - - - - smtpd I did: 127.0.0.1:1025 inet n - - - - smtpd After all is done, however, I'm unable to send any mail. Thunderbird just says sending message but doesn't send and I don't even get an error. I end up having to disable SASL again before I can send mail. Dovecot version 2.0.9 Postfix version 2.6.6 CentOS 6 I have Postfix, Dovecot, and ASSP on the same server. Thanks everyone. -- This email was Virus checked by Astaro Security Gateway. http://www.sophos.com

4 5

90-sieve.conf syntax - moving from v2.0.x to v2.2.x
by deoren 21 Oct '14

21 Oct '14

Hi, I'm currently running version v2.0.x in production (using Maildir storage) and it's been working well. I'm interested in moving to version 2.2.x and am preparing a test server to do so. As I have been merging the conf file changes between the two versions I noticed syntax changes for the 90-sieve.conf file. There are now 'locations' and presumably to keep referring to local content I'll need to use the 'file:' location type. On my production box (v2.0.x) I have 90-sieve.conf configured like so: sieve = /var/vmail/sieve/%d/%n/.dovecot.sieve sieve_default = /var/vmail/sieve/global.sieve sieve_dir = /var/vmail/sieve/%d/%n/sieve_dir Inside of the /var/vmail/sieve/%d/%n/ directory (i.e., /var/vmail/sieve/example.com/testuser/) I find: drwxr-xr-x 3 vmail vmail 64 Oct 19 12:07 . drwxr-xr-x 9 vmail vmail 101 Jun 21 10:47 .. lrwxrwxrwx 1 vmail vmail 25 Jun 21 11:10 .dovecot.sieve -> sieve_dir/roundcube.sieve -rw------- 1 vmail vmail 3694 Oct 19 12:07 .dovecot.svbin drwx------ 3 vmail vmail 38 Oct 19 11:58 sieve_dir and that works well. I look at the current wiki documentation: http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration and I find that the 'seive_dir' conf option is still listed, but the comments for it appear very similar to the comments that precede the 'sieve' conf option in the stock 90-sieve.conf file: # The location of the user's main Sieve script or script storage. The LDA # Sieve plugin uses this to find the active script for Sieve filtering at # delivery. The "include" extension uses this location for retrieving # :personal" scripts. This is also where the ManageSieve service will store # the user's scripts, if supported. Assuming that the 'sieve' and 'sieve_dir' conf settings have not been merged into just 'sieve' (and that I need to use the 'file:' location specifier), is this how I would configure the two settings for Dovecot 2.2.x? sieve = file:/var/vmail/sieve/%d/%n;active=~/.dovecot.sieve sieve_dir = file:/var/vmail/sieve/%d/%n/sieve_dir If the two have been merged, how would I go about configuring the 90-sieve.conf file to get the same results? Thanks for your help.

1 1

Re: last_login plugin with MySQL
by Joseph Tam 21 Oct '14

21 Oct '14

Michael Cramer <michael(a)bigmichi1.de> writes: > anybody knows how this can be achieved with postgresql, because 'ON > DUPLICATE KEY UPDATE' syntax is mysql specific A clear, concise explanation of consistency problems with SQL update-or-insert ("upsert") operation, including a PostgreSQL implementation: http://www.depesz.com/2012/06/10/why-is-upsert-so-complicated/ Joseph Tam <jtam.home(a)gmail.com>

1 0

replication sieve settings
by Martin Schmidt 20 Oct '14

20 Oct '14

Hello, can someone give me a hint, where to find an info, how to setup dovecote replication with sieve? On my active.active setup, it replicates the user mdboxes and sieve works also, on the active destination fileserver. Client changes the sieve, tests work fine. But the sieve file won't get replicated to the replica server. As i've researched, it was introduced in dovecot v2.2.rc3 Is it default, that doveadm replicator replicate '*' includes the sieve and i made a config error? Or is there an option to set for the replication service? On dovecot director server, i've set director in conf.d/20-managesieve.conf service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 4190 } } and added sieve to plugins in conf.d/20-lmtp.conf protocol lmtp { mail_plugins = $mail_plugins sieve } doveconf -n ... director_mail_servers = 192.168.200.10 192.168.200.11 director_servers = 192.168.200.1:9090 192.168.200.2:9090 disable_plaintext_auth = no doveadm_port = 24245 lmtp_proxy = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = " imap lmtp sieve pop3" ... service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 4190 } } ... protocol lmtp { auth_socket_path = director-userdb mail_plugins = " sieve" } ... Thank you Martin Schmidt Germany

1 0

fixes for quota support on NetBSD
by Thomas Klausner 20 Oct '14

20 Oct '14

Hi! dovecot-2.2.13 already has quota support for NetBSD, but it's buggy. The attached patches by Manuel Bouyer <bouyer(a)NetBSD.org> fix the issues. There is one thing that's not nice in them: one include is now for "/usr/include/quota.h" since dovecot comes with its own file "quota.h" which is earlier in the search path. Perhaps dovecot's copy can be renamed to dovecot-quota.h or to some other non-conflicting name? Cheers, Thomas

1 1

2.2.14 Panic in imap_fetch_more()
by Hans Morten Kind 20 Oct '14

20 Oct '14

This panic happens with different users, and it also occured in 2.2.13 Panic: file imap-fetch.c: line 556 (imap_fetch_more): assertion failed: (ctx->client->output_cmd_lock == NULL || ctx->client->output_cmd_lock == cmd) hmk GNU gdb 6.8 Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i386-pc-solaris2.10"... Reading symbols from /datapool/local/dovecot-2.2.14/lib/dovecot/libdovecot-storage.so.0...done. Loaded symbols for /local/dovecot-2.2.14/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /datapool/local/dovecot-2.2.14/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /local/dovecot-2.2.14/lib/dovecot/libdovecot.so.0 Reading symbols from /datapool/local/program/lib/libssl.so.1.0.0...done. Loaded symbols for /local/program/lib/libssl.so.1.0.0 Reading symbols from /datapool/local/program/lib/libcrypto.so.1.0.0...done. Loaded symbols for /local/program/lib/libcrypto.so.1.0.0 Reading symbols from /datapool/local/program/lib/libz.so...done. Loaded symbols for /local/program/lib/libz.so Reading symbols from /lib/libm.so.2...done. Loaded symbols for /lib/libm.so.2 Reading symbols from /datapool/local/program/lib/libiconv.so.2...done. Loaded symbols for /local/program/lib/libiconv.so.2 Reading symbols from /lib/librt.so.1...done. Loaded symbols for /lib/librt.so.1 Reading symbols from /lib/libnsl.so.1...done. Loaded symbols for /lib/libnsl.so.1 Reading symbols from /lib/libsocket.so.1...done. Loaded symbols for /lib/libsocket.so.1 Reading symbols from /lib/libsendfile.so.1...done. Loaded symbols for /lib/libsendfile.so.1 Reading symbols from /lib/libc.so.1...done. Loaded symbols for /lib/libc.so.1 Reading symbols from /lib/libdl.so.1...done. Loaded symbols for /lib/libdl.so.1 Reading symbols from /usr/lib/libz.so...done. Loaded symbols for /usr/lib/libz.so Reading symbols from /lib/libaio.so.1...done. Loaded symbols for /lib/libaio.so.1 Reading symbols from /lib/libmd.so.1...done. Loaded symbols for /lib/libmd.so.1 Reading symbols from /lib/ld.so.1...done. Loaded symbols for /lib/ld.so.1 Core was generated by `dovecot/imap imap-postlogin'. Program terminated with signal 6, Aborted. [New process 79111 ] #0 0xfe7fc8e5 in _lwp_kill () from /lib/libc.so.1 #0 0xfe7fc8e5 in _lwp_kill () from /lib/libc.so.1 No symbol table info available. #1 0xfe7f7765 in thr_kill () from /lib/libc.so.1 No symbol table info available. #2 0xfe7a376f in raise () from /lib/libc.so.1 No symbol table info available. #3 0xfe7829e1 in abort () from /lib/libc.so.1 No symbol table info available. #4 0xfeda13ba in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:152 backtrace = 0x8093560 "0xfeda22d7 -> 0xfeda15d3 -> 0x806d60b -> 0x805d326 -> 0x806aa61 -> 0x80699d2 -> 0x8069cb7 -> 0x8069d15 -> 0x8069e57 -> 0x8069fe0 -> 0xfedba96d -> 0xfedbc0cc -> 0xfedbab06 -> 0xfedbaa5d -> 0xfed41db1 -"... #5 0xfeda22d7 in i_internal_fatal_handler (ctx=0x80479e0, format=0x807f310 "file %s: line %d (%s): assertion failed: (%s)", args=0x8047a04 "\236ó\a\b,\002") at failures.c:152 status = 0 #6 0xfeda15d3 in i_panic (format=0x807f310 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:152 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = 0x8047a04 "\236ó\a\b,\002" #7 0x0806d60b in imap_fetch_more (ctx=0x80c20e0, cmd=0x80c2018) at ../../src/lib/array.h:158 ret = 135365712 __FUNCTION__ = "imap_fetch_more" #8 0x0805d326 in cmd_fetch (cmd=0x80c2018) at cmd-fetch.c:37 client = (struct client *) 0x80b17b8 ctx = (struct imap_fetch_context *) 0x80c20e0 args = (const struct imap_arg *) 0x80c99f0 next_arg = (const struct imap_arg *) 0x80c9a20 list_arg = (const struct imap_arg *) 0x8047a98 search_args = (struct mail_search_args *) 0x0 qresync_args = {qresync_sample_seqset = 0x80c20a8, qresync_sample_uidset = 0x807ee7e} messageset = 0x80c9ab8 "1899" send_vanished = false ret = 1 #9 0x0806aa61 in command_exec (cmd=0x80c2018) at imap-commands.c:101 hook = (const struct command_hook *) 0x809bfd8 ret = 8 #10 0x080699d2 in client_command_input (cmd=0x80c2018) at imap-client.c:130 client = (struct client *) 0x80b17b8 command = (struct command *) 0x3 __FUNCTION__ = "client_command_input" #11 0x08069cb7 in client_command_input (cmd=0x80c2018) at imap-client.c:130 client = (struct client *) 0x80b17b8 command = (struct command *) 0x809d41c __FUNCTION__ = "client_command_input" #12 0x08069d15 in client_handle_next_command (client=0x80b17b8, remove_io_r=0x8047b9d) at imap-client.c:130 No locals. #13 0x08069e57 in client_handle_input (client=0x80b17b8) at imap-client.c:130 _data_stack_cur_id = 3 ret = 10 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #14 0x08069fe0 in client_input (client=0x80b17b8) at imap-client.c:130 cmd = (struct client_command_context *) 0x80aa9ac output = (struct ostream *) 0x80abe10 bytes = 1143 __FUNCTION__ = "client_input" #15 0xfedba96d in io_loop_call_io (io=0x80b7fc8) at ioloop.c:28 ioloop = (struct ioloop *) 0x809bf20 t_id = 2 __FUNCTION__ = "io_loop_call_io" #16 0xfedbc0cc in io_loop_handler_run_internal (ioloop=0x809bf20) at ioloop-poll.c:96 ctx = (struct ioloop_handler_context *) 0x809ca10 pollfd = (struct pollfd *) 0x809e0a8 tv = {tv_sec = 299, tv_usec = 996793} io = (struct io_file *) 0x80b7fc8 msecs = 299997 ret = 0 call = true #17 0xfedbab06 in io_loop_handler_run (ioloop=0x809bf20) at ioloop.c:28 No locals. #18 0xfedbaa5d in io_loop_run (ioloop=0x809bf20) at ioloop.c:28 __FUNCTION__ = "io_loop_run" #19 0xfed41db1 in master_service_run (service=0x809be68, callback=0x80771da <client_connected>) at master-service.c:75 No locals. #20 0x08077577 in main (argc=2, argv=0x809bc78) at main.c:72 set_roots = {0x8092fe0, 0x0} login_set = {auth_socket_path = 0x80930e8 "\2201\t\b\200", postlogin_socket_path = 0x8093120 "UID FETCH UID FETCH UID FETCH", postlogin_timeout_secs = 60, callback = 0x8076f4e <login_client_connected>, failure_callback = 0x807715d <login_client_failed>, request_auth_token = 1} service_flags = MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = -1

1 0