October 2014 - dovecot

Re: last_login plugin with MySQL
by Joseph Tam 21 Oct '14

21 Oct '14

Michael Cramer <michael(a)bigmichi1.de> writes: > anybody knows how this can be achieved with postgresql, because 'ON > DUPLICATE KEY UPDATE' syntax is mysql specific A clear, concise explanation of consistency problems with SQL update-or-insert ("upsert") operation, including a PostgreSQL implementation: http://www.depesz.com/2012/06/10/why-is-upsert-so-complicated/ Joseph Tam <jtam.home(a)gmail.com>

1 0

replication sieve settings
by Martin Schmidt 20 Oct '14

20 Oct '14

Hello, can someone give me a hint, where to find an info, how to setup dovecote replication with sieve? On my active.active setup, it replicates the user mdboxes and sieve works also, on the active destination fileserver. Client changes the sieve, tests work fine. But the sieve file won't get replicated to the replica server. As i've researched, it was introduced in dovecot v2.2.rc3 Is it default, that doveadm replicator replicate '*' includes the sieve and i made a config error? Or is there an option to set for the replication service? On dovecot director server, i've set director in conf.d/20-managesieve.conf service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 4190 } } and added sieve to plugins in conf.d/20-lmtp.conf protocol lmtp { mail_plugins = $mail_plugins sieve } doveconf -n ... director_mail_servers = 192.168.200.10 192.168.200.11 director_servers = 192.168.200.1:9090 192.168.200.2:9090 disable_plaintext_auth = no doveadm_port = 24245 lmtp_proxy = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = " imap lmtp sieve pop3" ... service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 4190 } } ... protocol lmtp { auth_socket_path = director-userdb mail_plugins = " sieve" } ... Thank you Martin Schmidt Germany

1 0

fixes for quota support on NetBSD
by Thomas Klausner 20 Oct '14

20 Oct '14

Hi! dovecot-2.2.13 already has quota support for NetBSD, but it's buggy. The attached patches by Manuel Bouyer <bouyer(a)NetBSD.org> fix the issues. There is one thing that's not nice in them: one include is now for "/usr/include/quota.h" since dovecot comes with its own file "quota.h" which is earlier in the search path. Perhaps dovecot's copy can be renamed to dovecot-quota.h or to some other non-conflicting name? Cheers, Thomas

1 1

2.2.14 Panic in imap_fetch_more()
by Hans Morten Kind 20 Oct '14

20 Oct '14

This panic happens with different users, and it also occured in 2.2.13 Panic: file imap-fetch.c: line 556 (imap_fetch_more): assertion failed: (ctx->client->output_cmd_lock == NULL || ctx->client->output_cmd_lock == cmd) hmk GNU gdb 6.8 Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i386-pc-solaris2.10"... Reading symbols from /datapool/local/dovecot-2.2.14/lib/dovecot/libdovecot-storage.so.0...done. Loaded symbols for /local/dovecot-2.2.14/lib/dovecot/libdovecot-storage.so.0 Reading symbols from /datapool/local/dovecot-2.2.14/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /local/dovecot-2.2.14/lib/dovecot/libdovecot.so.0 Reading symbols from /datapool/local/program/lib/libssl.so.1.0.0...done. Loaded symbols for /local/program/lib/libssl.so.1.0.0 Reading symbols from /datapool/local/program/lib/libcrypto.so.1.0.0...done. Loaded symbols for /local/program/lib/libcrypto.so.1.0.0 Reading symbols from /datapool/local/program/lib/libz.so...done. Loaded symbols for /local/program/lib/libz.so Reading symbols from /lib/libm.so.2...done. Loaded symbols for /lib/libm.so.2 Reading symbols from /datapool/local/program/lib/libiconv.so.2...done. Loaded symbols for /local/program/lib/libiconv.so.2 Reading symbols from /lib/librt.so.1...done. Loaded symbols for /lib/librt.so.1 Reading symbols from /lib/libnsl.so.1...done. Loaded symbols for /lib/libnsl.so.1 Reading symbols from /lib/libsocket.so.1...done. Loaded symbols for /lib/libsocket.so.1 Reading symbols from /lib/libsendfile.so.1...done. Loaded symbols for /lib/libsendfile.so.1 Reading symbols from /lib/libc.so.1...done. Loaded symbols for /lib/libc.so.1 Reading symbols from /lib/libdl.so.1...done. Loaded symbols for /lib/libdl.so.1 Reading symbols from /usr/lib/libz.so...done. Loaded symbols for /usr/lib/libz.so Reading symbols from /lib/libaio.so.1...done. Loaded symbols for /lib/libaio.so.1 Reading symbols from /lib/libmd.so.1...done. Loaded symbols for /lib/libmd.so.1 Reading symbols from /lib/ld.so.1...done. Loaded symbols for /lib/ld.so.1 Core was generated by `dovecot/imap imap-postlogin'. Program terminated with signal 6, Aborted. [New process 79111 ] #0 0xfe7fc8e5 in _lwp_kill () from /lib/libc.so.1 #0 0xfe7fc8e5 in _lwp_kill () from /lib/libc.so.1 No symbol table info available. #1 0xfe7f7765 in thr_kill () from /lib/libc.so.1 No symbol table info available. #2 0xfe7a376f in raise () from /lib/libc.so.1 No symbol table info available. #3 0xfe7829e1 in abort () from /lib/libc.so.1 No symbol table info available. #4 0xfeda13ba in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:152 backtrace = 0x8093560 "0xfeda22d7 -> 0xfeda15d3 -> 0x806d60b -> 0x805d326 -> 0x806aa61 -> 0x80699d2 -> 0x8069cb7 -> 0x8069d15 -> 0x8069e57 -> 0x8069fe0 -> 0xfedba96d -> 0xfedbc0cc -> 0xfedbab06 -> 0xfedbaa5d -> 0xfed41db1 -"... #5 0xfeda22d7 in i_internal_fatal_handler (ctx=0x80479e0, format=0x807f310 "file %s: line %d (%s): assertion failed: (%s)", args=0x8047a04 "\236ó\a\b,\002") at failures.c:152 status = 0 #6 0xfeda15d3 in i_panic (format=0x807f310 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:152 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = 0x8047a04 "\236ó\a\b,\002" #7 0x0806d60b in imap_fetch_more (ctx=0x80c20e0, cmd=0x80c2018) at ../../src/lib/array.h:158 ret = 135365712 __FUNCTION__ = "imap_fetch_more" #8 0x0805d326 in cmd_fetch (cmd=0x80c2018) at cmd-fetch.c:37 client = (struct client *) 0x80b17b8 ctx = (struct imap_fetch_context *) 0x80c20e0 args = (const struct imap_arg *) 0x80c99f0 next_arg = (const struct imap_arg *) 0x80c9a20 list_arg = (const struct imap_arg *) 0x8047a98 search_args = (struct mail_search_args *) 0x0 qresync_args = {qresync_sample_seqset = 0x80c20a8, qresync_sample_uidset = 0x807ee7e} messageset = 0x80c9ab8 "1899" send_vanished = false ret = 1 #9 0x0806aa61 in command_exec (cmd=0x80c2018) at imap-commands.c:101 hook = (const struct command_hook *) 0x809bfd8 ret = 8 #10 0x080699d2 in client_command_input (cmd=0x80c2018) at imap-client.c:130 client = (struct client *) 0x80b17b8 command = (struct command *) 0x3 __FUNCTION__ = "client_command_input" #11 0x08069cb7 in client_command_input (cmd=0x80c2018) at imap-client.c:130 client = (struct client *) 0x80b17b8 command = (struct command *) 0x809d41c __FUNCTION__ = "client_command_input" #12 0x08069d15 in client_handle_next_command (client=0x80b17b8, remove_io_r=0x8047b9d) at imap-client.c:130 No locals. #13 0x08069e57 in client_handle_input (client=0x80b17b8) at imap-client.c:130 _data_stack_cur_id = 3 ret = 10 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #14 0x08069fe0 in client_input (client=0x80b17b8) at imap-client.c:130 cmd = (struct client_command_context *) 0x80aa9ac output = (struct ostream *) 0x80abe10 bytes = 1143 __FUNCTION__ = "client_input" #15 0xfedba96d in io_loop_call_io (io=0x80b7fc8) at ioloop.c:28 ioloop = (struct ioloop *) 0x809bf20 t_id = 2 __FUNCTION__ = "io_loop_call_io" #16 0xfedbc0cc in io_loop_handler_run_internal (ioloop=0x809bf20) at ioloop-poll.c:96 ctx = (struct ioloop_handler_context *) 0x809ca10 pollfd = (struct pollfd *) 0x809e0a8 tv = {tv_sec = 299, tv_usec = 996793} io = (struct io_file *) 0x80b7fc8 msecs = 299997 ret = 0 call = true #17 0xfedbab06 in io_loop_handler_run (ioloop=0x809bf20) at ioloop.c:28 No locals. #18 0xfedbaa5d in io_loop_run (ioloop=0x809bf20) at ioloop.c:28 __FUNCTION__ = "io_loop_run" #19 0xfed41db1 in master_service_run (service=0x809be68, callback=0x80771da <client_connected>) at master-service.c:75 No locals. #20 0x08077577 in main (argc=2, argv=0x809bc78) at main.c:72 set_roots = {0x8092fe0, 0x0} login_set = {auth_socket_path = 0x80930e8 "\2201\t\b\200", postlogin_socket_path = 0x8093120 "UID FETCH UID FETCH UID FETCH", postlogin_timeout_secs = 60, callback = 0x8076f4e <login_client_connected>, failure_callback = 0x807715d <login_client_failed>, request_auth_token = 1} service_flags = MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = -1

1 0

last_login plugin with MySQL
by Luigi Rosa 20 Oct '14

20 Oct '14

Hi, I have a Dovecot test installation with MySQL userbase and authentication where I am trying to setup last_login plugin with SQL dictionary I read http://wiki2.dovecot.org/Plugins/LastLogin and I addes this to my configuration plugin { last_login_dict = sql:/etc/dovecot/dovecot-sql.conf.ext } mail_plugins = $mail_plugins stats protocol imap { mail_plugins = $mail_plugins imap_stats last_login } When I log in with IMAP I get this error: Error: last_login_dict: dict_init(sql:/etc/dovecot/dovecot-sql.conf.ext) failed: Unknown dict module: sql /etc/dovecot/dovecot-sql.conf.ext is the file taht contains the SQL configuration. If I put mysql instead of sql the result is the same: Error: last_login_dict: dict_init(mysql:/etc/dovecot/dovecot-sql.conf.ext) failed: Unknown dict module: mysql The output of doveconf -n follows. Do you have any idea on how to use MySQL for last_login? Ciao, luigi # 2.2.14: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.29.2.el6.x86_64 x86_64 CentOS release 6.5 (Final) auth_cache_negative_ttl = 0 auth_cache_size = 100 k auth_cache_ttl = 8 hours auth_mechanisms = plain login digest-md5 cram-md5 auth_verbose = yes base_dir = /var/run/dovecot/ listen = 127.0.0.1, 10.19.67.253 login_greeting = Ready. login_trusted_networks = 10.xx.xx.0/24, 2001:xxxx:xxxx:xxxx::/64 mail_plugins = " stats" mailbox_list_index = yes maildir_stat_dirs = yes passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { last_login_dict = mysql:/etc/dovecot/dovecot-sql.conf.ext sieve = ~/.dovecot.sieve sieve_dir = ~/sieve stats_refresh = 10s stats_track_cmds = yes } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service stats { fifo_listener stats-mail { mode = 0666 } } ssl_cert = </etc/xxxxx/xxxxxx.luigirosa.com.crt ssl_dh_parameters_length = 2048 ssl_key = </etc/xxxxx/xxxxx.luigirosa.com.key ssl_parameters_regenerate = 202 hours ssl_protocols = !SSLv2 !SSLv3 syslog_facility = local5 userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = sieve } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = " stats imap_stats last_login" } protocol pop3 { pop3_client_workarounds = outlook-no-nuls pop3_uidl_format = %08Xu%08Xv } -- / +--[Luigi Rosa]-- \ Microsoft launches site to help those with H1N1. No help for those with Windows 7 --fark.com

5 16

Re: doveadm-move(1)
by Joseph Tam 19 Oct '14

19 Oct '14

Pascal Volk writes: >> Cut&pasted off the terminal man page output. Looking into >> man1/doveadm-move.1, I see >> >> .B doveadm move \-u jane Archive/2011/09 mailbox INBOX BEFORE \(rs >> .B 2011-10-01 SINCE 01-Sep-2011 >> >> so it's a problem with my nroff, not dovecot's man pages. (Hmm, it >> happens with groff too -- it appears to be some sort of line length bug.) > > Well, there was a problem with non-escaped dashes. But that was fixed 10 > months ago: > http://hg.dovecot.org/dovecot-2.2/diff/8a3d0426f514/doc/man/doveadm-move.1.… Nope, that didn't fix it. > I'm not sure, if that is the reason for the problem. > > Which OS, *roff are you using? Maybe I'm able to reproduce the problem. :-) It's Solaris10 nroff, and GNU groff 1.19.1. Ancient stuff so I wouldn't spend too much time looking at it. It's weird that two independent software implementations would do the same thing. Joseph Tam <jtam.home(a)gmail.com>

2 1

Fwd: Re: Wiki advice on running getmail on INBOX access - how does that work?
by c128 mail 19 Oct '14

19 Oct '14

Just re-tried this, and it doesn't seem to fire getmail on access for me. My incrontab is as follows: /home/user/Maildir/cur/ IN_ALL_EVENTS,IN_ONESHOT /home/user/bin/mvmail.sh The incrontab rule does work, but only if I make a physical change in /home/user/Maildir/cur/ e.g. by moving a mail from another folder in there. Just accessing the particular inbox doesn't seem to trigger anything. On 18/10/14 19:54, c128 mail wrote: > Yeah, I see what you mean - it should trigger by IN_ACCESS (from > IN_ALL_EVENTS) shouldn't it. I hadn't previously scanned over the full > set of events: > http://manpages.ubuntu.com/manpages/intrepid/man5/incrontab.5.html > > I'll set this up again and report back one way or another. > > Thanks. > > On 18/10/14 19:50, Gedalya wrote: >> On 10/18/2014 02:38 PM, c128 mail wrote: >>> > What exactly did happen? >>> >>> Oh, yeah, didn't make that clear ;-) >>> >>> Nothing happened...not without coaxing. >>> >>> If I forced a change to the directory, then it worked - but there >>> wouldn't be a change to the directory in normal operation, other than >>> by mail population? >> It's not supposed to require changes. Note the IN_ALL_EVENTS definition. >> This would include any attempt to open the directory and take a peek. >> If you configured it according to the wiki and it's not working then we >> have troubleshooting to do, but that's the theory. >> I'm not familiar with incron but I've worked with Linux's inotify. >> >>> >>> On 18/10/14 19:28, Gedalya wrote: >>>> On 10/18/2014 01:24 PM, c128 mail wrote: >>>>> Hi, >>>>> >>>>> I'm currently running getmail in a cron job every 2 minutes, so I was >>>>> quite intrigued by this on the wiki: >>>>> >>>>> http://wiki2.dovecot.org/HowTo/TriggerGetmailOnIMAPAccess >>>>> >>>>> Thing is - I couldn't see how it would work and, when I tried it, it >>>>> didn't work (at least not for me). >>>> What exactly did happen? >>>> >>>>> >>>>> It details using incrontab to monitor /home/username/.maildir/cur in >>>>> order to trigger getmail. >>>>> >>>>> However, "cur" won't change unless populated with mail...as an initial >>>>> result of actually running getmail? Seems like a chicken and egg >>>>> situation. >>>> access != change >>>> >>>>> >>>>> I reckon I'm missing something fundamental :-), but what is it? >>>>> >>>>> Ta. >>>> >>

3 7

sieve folder separator
by Thomas Koch 19 Oct '14

19 Oct '14

Hi, I'm moving from one email provider (me) to another (mailbox.org) and observed that the new provider uses "/" instead of "." as a folder separator. Now I need to adapt my sieve script. It's not too much work and I can even just define a variable at the beginning of my script: set "SEP" "/" But it would be great, if SIEVE would come with a predefined constant for the folder separator. Or does this already exists and I didn't find it? Thank you, Thomas Koch

2 1

Wiki advice on running getmail on INBOX access - how does that work?
by c128 mail 18 Oct '14

18 Oct '14

Hi, I'm currently running getmail in a cron job every 2 minutes, so I was quite intrigued by this on the wiki: http://wiki2.dovecot.org/HowTo/TriggerGetmailOnIMAPAccess Thing is - I couldn't see how it would work and, when I tried it, it didn't work (at least not for me). It details using incrontab to monitor /home/username/.maildir/cur in order to trigger getmail. However, "cur" won't change unless populated with mail...as an initial result of actually running getmail? Seems like a chicken and egg situation. I reckon I'm missing something fundamental :-), but what is it? Ta.

2 4

Recap: last_login plugin with MySQL
by Luigi Rosa 18 Oct '14

18 Oct '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 With many thanks to Gedalya and Sven Hartge Situation: Dovecot installation with userbase in a MySQL table with the same structure described in Postfix.Admin installation; filesystem permission is flat with a single user (vmail) who owns maildir mailbox files and directories. Procedure to implement last-login plugin to update mailbox table. The lastlogin value is an integer in time() format Alter mailbox SQL table to add a `lastlogin` unsigned int field Add this to 10-master.conf service dict { unix_listener dict { mode = 0660 user = vmail } } In 90-plugin.conf add this: plugin { last_login_dict = proxy::lastlogin last_login_key = last-login/%u # default } dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } Enable last login for IMAP and POP3: protocol imap { mail_plugins = $mail_plugins last_login } protocol pop3 { mail_plugins = $mail_plugins last_login } Finally edit dovecot-dict-sql.conf.ext and add this lines: connect = {same values as dovecot-sql.conf.ext} map { pattern = shared/last-login/$user table = mailbox username_field = username value_field = lastlogin fields { username = $user } } Ciao, luigi - -- / +--[Luigi Rosa]-- \ After things have gone from bad to worse, the cycle will repeat itself. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJUQp/PAAoJEO5WT/qgw4yKLscP/1ysmNOP23fQeqN2I7gxfhKp 4TF0Buf0rxKjxzjE5jcw4T/vDKhdjj2uaYtpUkE188l+tmGdeQ55ENyXEml/Svvw eEs9Kc2UJTlSQpQFpspUezvOtPwgb0L3720rCqs61BshGFgpZsiUEpPW8mHeVoo1 j5zmo9TVdrSPr8XqLzoR+fdIamZRzZH2pLA9x9cgzsVMmqSlMm4Xv3f/JMloNs98 fwWo13Ji5uFCRbbMmNUDCDOpd4wPYZ7ASS64Jf9nR4DZ75fnQmRgvsbl3EWicrqT 94Z4hlSEkOYWxDzooFta37+Sp61IjQWkWFiM+0260Q5u8IArpatW+tT2eD3jzaxP Gu0HB8jg+bT9cXXtfo1HyA+JYswEtwKiUvUKa/09j6oDGgBD2KR1yhDJNsZsJXkB bEKsACdSztEvfe9j91AzW8S/W3Uk5c7l9RH1CXVNTCbQXaeagScAguh94KKP0oiW P43mBkuFg2mM+5+bXz0U8EYfswt/zYkp/pKFajEwyXIWdeUICPmFJA+GKpBXeJPn CL8nJCnUpKNsy85+Z6MXYXIv6a0D0utocdsQzR8gjG2whNnv7EFeHa2hyagKfG5g ydOSG6tKlWHCOSFaTogmUVZVXEGsE1gUmJZMeoyZVI5jEl3b3KJSTxB7QHtMsm5q NOyZ+PdNJtyDC8n4T48t =MJj6 -----END PGP SIGNATURE-----

1 0