- dovecot - dovecot.org

Re: Dovecot, JavaMail, UIDs and Message Numbers
by Filippo Carletti 31 Oct '15

31 Oct '15

We're using dovecot-2.1.16 on CentOS (rpm package from epel repo). Maildir format on ext4. > What exactly do you mean by "Dovecot started reindexing"? Selecting thread sort on the javamail client, the imap process opens all files in the folder and updates the following files on disk: dovecot.index dovecot.index.cache dovecot.index.log dovecot.index.log.2 dovecot.index.thread The folder has around 5000 mails and the operation takes some minutes (hw is not the bottleneck). Selecting thread view on Thunderbird or Roundcube takes less than a second, I can't see the imap process doing anything. > Dovecot's normal indexes or full text search indexes? Normal indexes. > How have you configured everything? What do you need to know in particular? doveconf output? Maildir infos: # time cat cur/* >/dev/null real 0m4.651s user 0m0.045s sys 0m0.141s # ls -f cur/ | wc -l 4170 # du -sh cur 49M cur Things go worse with a bigger maildir. > Does Dovecot log anything (especially any errors/warnings about anything)? No errors or warnings at all. I've enabled the mail_log plugin, but I think it can't log indexing operations. Thank you. -- Ciao, Filippo

1 0

Re: Webmail accessive Dovecot logins
by Joseph Tam 30 Oct '15

30 Oct '15

"A. Schulze" writes: > David Mehler: > >> Second question, in the doveconf -n there's reference to my ssl_cipher >> am I using current tls ciphers that support pfs? > >> ssl_cipher_list = ALL:!LOW:!SSLv3:!SSLv2:!EXP:!aNULL > > some non pfs cipher would be still active. check yourself: > # openssl ciphers -v 'ALL:!LOW:!SSLv3:!SSLv2:!EXP:!aNULL' | grep -v DH You'll want the 'E' variation (ephemeral) of the DH algorithms, and preferably, the ECDHE variety as they are faster and supported on more browsers. The pattern to search for (or exclude) is "DHE" openssl ciphers -v {cipher-specs} | grep DHE If the OP wants preferentially use PFS ciphers (but keep the other ciphers around for very old browsers), maybe something like ssl_cipher_list = ECDH:ALL:!LOW:!SSLv2:!EXP:!aNULL ssl_prefer_server_ciphers = yes > finally you could use the service provided by ssllabs.com to scan your host. I second this recommendation, if you can work out the port issue. Maybe using a ncat | ncat pipe. Joseph Tam <jtam.home(a)gmail.com>

1 0

updating and wsitching repo to yum.dovecot.fi - Unknown protocol: sieve
by Götz Reinicke - IT Koordinator 30 Oct '15

30 Oct '15

Hi, winter is coming and so I start to clean up some left overs of the year. One thing is to use the yum.dovecot.fi repository. After installing the current availabel dovecot and dovecot-ee-pigeonhole package and restarting dovecot I do get the error: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: protocols: Unknown protocol: sieve Is the sieve protocol an extra package? I thought in the 2.2. tree I dont have to do bigger config changes. We run already 2.2.something from city-fan.org and the switch was also the idea of going to the most recent release. Thanks for hints and feedback . Götz -- Götz Reinicke IT-Koordinator Tel. +49 7141 969 82420 E-Mail goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Jürgen Walter MdL Staatssekretär im Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg Geschäftsführer: Prof. Thomas Schadt

3 5

Webmail accessive Dovecot logins
by David Mehler 30 Oct '15

30 Oct '15

Hello, I've seen this issue before, running a imap/smtp/database server on localhost and adding in a webmail interface, in this case Roundcube. In my maillog I'm seeing accessive Dovecot connections and logouts just from my own transaction of logging in, going to compose a message, sending, and logging out. I'm using Mysql as database backend and was wondering if there was something I could do to cut down on the amount of connections needed? I'm running 2.2.19 on a FreeBSD 10.2 system. I'm not sure what other information to provide, here's the relevant log and a doveconf -n. Second question, in the doveconf -n there's reference to my ssl_cipher am I using current tls ciphers that support pfs? Thanks. Dave. Oct 29 20:51:21 server dovecot: imap-login: Login: user=<xxx>, method=PLAIN, rip=::1, lip=::1, mpid=71405, secured, session=<6Px600cja6cAAAAAAAAAAAAAAAAAAAAB> Oct 29 20:51:21 server dovecot: imap(xxx): Disconnected: Logged out in=82 out=763 Oct 29 20:51:22 server dovecot: imap-login: Login: user=<xxx>, method=PLAIN, rip=::1, lip=::1, mpid=72189, secured, session=<c8eL00cjxXYAAAAAAAAAAAAAAAAAAAAB> Oct 29 20:51:22 server dovecot: imap(xxx): Disconnected: Logged out in=70 out=932 Oct 29 20:51:29 server dovecot: imap-login: Login: user=<xxx>, method=PLAIN, rip=::1, lip=::1, mpid=74281, secured, session=<AQz100cj378AAAAAAAAAAAAAAAAAAAAB> Oct 29 20:51:29 server dovecot: imap-login: Login: user=<xxx>, method=PLAIN, rip=::1, lip=::1, mpid=74927, secured, session=<fH3100cjQ5AAAAAAAAAAAAAAAAAAAAAB> Oct 29 20:51:29 server dovecot: imap(xxx): Disconnected: Logged out in=439 out=1702 Oct 29 20:51:29 server dovecot: imap(xxx): Disconnected: Logged out in=326 out=24327 Oct 29 20:51:45 server dovecot: imap-login: Login: user=<xxx>, method=PLAIN, rip=::1, lip=::1, mpid=75557, secured, session=<3tjm1EcjsjUAAAAAAAAAAAAAAAAAAAAB> Oct 29 20:51:45 server dovecot: imap(xxx): Disconnected: Logged out in=32 out=521 Oct 29 20:51:46 server dovecot: imap-login: Login: user=<xxx>, method=PLAIN, rip=::1, lip=::1, mpid=77051, secured, session=<N6311EcjlbQAAAAAAAAAAAAAAAAAAAAB> Oct 29 20:51:46 server dovecot: imap(xxx): Disconnected: Logged out in=44 out=799 doveconf -n # 2.2.19: /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.9 (357ac0a0e68b+) # OS: FreeBSD 10.2-RELEASE amd64 ufs auth_default_realm = domain.com auth_mechanisms = plain login dict { sqlquota = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_gid = 999 first_valid_uid = 999 hostname = xxx(a)domain.com imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags last_valid_gid = 999 last_valid_uid = 999 lmtp_rcpt_check_quota = yes mail_gid = vmail mail_home = /home/vmail/%d/%n/home mail_location = maildir:/home/vmail/%d/%n:LAYOUT=fs mail_plugins = acl quota zlib mail_server_admin = mailto:postmaster@domain.com mail_uid = vmail mailbox_list_index = yes maildir_broken_filename_sizes = yes maildir_empty_new = yes maildir_stat_dirs = yes maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate namespace { list = yes location = maildir:/home/vmail/public:LAYOUT=fs prefix = public/ separator = / subscriptions = yes type = public } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::sqlquota quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve_default = /home/vmail/conf.d/domain.com/sieve/default.sieve } postmaster_address = postmaster(a)domain.com protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imap { address = } inet_listener imaps { ssl = yes } } service lmtp { unix_listener dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { address = 127.0.0.1 port = 12345 } } ssl = required ssl_cert = </etc/ssl/certs/server.crt ssl_cipher_list = ALL:!LOW:!SSLv3:!SSLv2:!EXP:!aNULL ssl_dh_parameters_length = 4096 ssl_key = </etc/ssl/private/server.key ssl_protocols = TLSv1 !SSLv3 !SSLv2 userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = acl quota zlib sieve } protocol lda { mail_plugins = acl quota zlib quota sieve } protocol imap { mail_plugins = acl quota zlib imap_acl imap_quota imap_zlib }

3 2

Dovecot frequently full-text reindexes the whole maildir
by vitalif＠yourcmc.ru 30 Oct '15

30 Oct '15

Hi! I'm using Dovecot 2.2.13 (Debian Jessie package 1:2.2.13-12~deb8u1) on my personal mail server (the address I'm writing from is on this server). I use Maildirs, I have fts + fts_squat enabled, and I have a problem with it for a long time - dovecot seems to not update the index always "incrementally". Yesterday I've finally made a test by telneting to imap port and issuing a search request. Dovecot started to reindex the mailbox. Full reindexing has taken around 15-20 minutes. After reindexing the fulltext searches were fast, just as they should be. And they were fast yesterday even after some new emails arrived. But I've tried to do a new search today and Dovecot started to reindex the whole maildir again! Why is it reindexing the whole maildir again? Could it be related to my anti-spam scripts removing messages from SPAM imap folder? And if yes, how to remove them correctly? -- With best regards, Vitaliy Filippov

2 2

2.2.19 crash
by Toni Mattila 29 Oct '15

29 Oct '15

Hi, I have one user constantly crashing with: Core was generated by `dovecot/imap'. Program terminated with signal 11, Segmentation fault. #0 0x007e5b7c in mailbox_list_notify_next (notify=0x0, rec_r=0xbfee8f00) at mailbox-list-notify.c:28 28 return notify->list->v.notify_next(notify, rec_r); (gdb) bt #0 0x007e5b7c in mailbox_list_notify_next (notify=0x0, rec_r=0xbfee8f00) at mailbox-list-notify.c:28 #1 0x080641f2 in imap_client_notify_ns (notify_ns=0x8859478) at imap-notify.c:248 #2 0x0806476a in imap_client_notify_more (client=<value optimized out>) at imap-notify.c:297 #3 0x080648df in imap_client_notify_newmails (client=0x88555c0) at imap-notify.c:339 #4 0x080699fe in imap_sync_notify_more (ctx=0x8858d70) at imap-sync.c:356 #5 imap_sync_more (ctx=0x8858d70) at imap-sync.c:526 #6 0x08069db2 in cmd_sync_continue (sync_cmd=0x8856008) at imap-sync.c:658 #7 0x0806a206 in cmd_sync_delayed_real (client=0x88555c0) at imap-sync.c:748 #8 cmd_sync_delayed (client=0x88555c0) at imap-sync.c:886 #9 0x007e7c25 in notify_delay_callback (box=0x8864cd0) at mailbox-watch.c:26 #10 0x00caec60 in io_loop_handle_timeouts_real (ioloop=0x883d4a0) at ioloop.c:527 #11 io_loop_handle_timeouts (ioloop=0x883d4a0) at ioloop.c:540 #12 0x00cb0299 in io_loop_handler_run_internal (ioloop=0x883d4a0) at ioloop-epoll.c:193 #13 0x00caea8b in io_loop_handler_run (ioloop=0x883d4a0) at ioloop.c:607 #14 0x00caee08 in io_loop_run (ioloop=0x883d4a0) at ioloop.c:583 #15 0x00c4216d in master_service_run (service=0x883d3d0, callback=0x806a700 <client_connected>) at master-service.c:640 #16 0x0806af22 in main (argc=Cannot access memory at address 0x0 (gdb) f 6 #6 0x08069db2 in cmd_sync_continue (sync_cmd=0x8856008) at imap-sync.c:658 658 if ((ret = imap_sync_more(ctx)) == 0) Best Regards, Toni Mattila

2 3

Acl sql dict error, dict crashes
by Christian Kivalo 29 Oct '15

29 Oct '15

Hi, I configured shared mailboxes and get an error when i use SQL as the acl_shared_dict. It works when i use a file instead. With SQL as the shared_dict, dict crashes. I have enabled sql query logs on the mariadb server, the table user_shares and anyone_shares are queried but there is no insert to the empty tables. The dovecot-acl files are created in the mailbox when i add an acl with doveadm acl add ... doveadm acl debug shows an error: doveadm acl debug -u my(a)example.net shared/other(a)example.net/INBOX doveadm(my(a)example.net): Info: Mailbox 'INBOX' is in namespace 'shared/other(a)example.net/' doveadm(my(a)example.net): Info: Mailbox path: /srv/mail/other(a)example.net/Maildir doveadm(my(a)example.net): Info: Per-user private flags in mailbox: \Seen doveadm(my(a)example.net): Info: User my(a)example.net has rights: lookup read doveadm(my(a)example.net): Info: Mailbox found from dovecot-acl-list doveadm(my(a)example.net): Error: User other(a)example.net not found from ACL shared dict, rebuilding doveadm(my(a)example.net): Error: read(/var/run/dovecot/dict) failed: Connection reset by peer doveadm(my(a)example.net): Error: acl: dict commit failed doveadm(my(a)example.net): Fatal: ACL lookup dict rebuild failed then the dict crashes Oct 29 10:12:13 uschi dovecot: auth: Debug: master in: USER#0111#011my(a)example.net#011service=doveadm Oct 29 10:12:13 uschi dovecot: auth-worker(27393): Debug: sql(my(a)example.net): SELECT CONCAT("/srv/mail/", dir) AS home, CONCAT("maildir:/srv/mail/", dir, "/Maildir:LAYOUT=fs") AS mail, 5000 AS uid, 5000 AS gid FROM virtual_users WHERE email = 'my(a)example.net'; Oct 29 10:12:13 uschi dovecot: auth: Debug: userdb out: USER#0111#011my@example.net#011home=/srv/mail/my@example.net#011mail=maildir:/srv/mail/my@example.net/Maildir:LAYOUT=fs#011uid=5000#011gid=5000 Oct 29 10:12:13 uschi dovecot: auth: Debug: master in: USER#0112#011other(a)example.net#011service=doveadm Oct 29 10:12:13 uschi dovecot: auth-worker(27393): Debug: sql(other(a)example.net): SELECT CONCAT("/srv/mail/", dir) AS home, CONCAT("maildir:/srv/mail/", dir, "/Maildir:LAYOUT=fs") AS mail, 5000 AS uid, 5000 AS gid FROM virtual_users WHERE email = 'other(a)example.net'; Oct 29 10:12:13 uschi dovecot: auth: Debug: userdb out: USER#0112#011other@example.net#011home=/srv/mail/other@example.net#011mail=maildir:/srv/mail/other@example.net/Maildir:LAYOUT=fs#011uid=5000#011gid=5000 Oct 29 10:12:13 uschi dovecot: dict(27421): Panic: file dict-sql.c: line 670 (sql_dict_iterate): assertion failed: ((ctx->flags & DICT_ITERATE_FLAG_ASYNC) != 0) Oct 29 10:12:13 uschi dovecot: dict(27421): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x7e290) [0x7f823f032290] -> /usr/lib/dovecot/libdovecot.so.0(+0x7e37c) [0x7f823f03237c] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f823efdd65d] -> dovecot/dict() [0x407e84] -> dovecot/dict() [0x405890] -> dovecot/dict() [0x405b01] -> dovecot/dict(dict_command_input+0xa1) [0x405bd1] -> dovecot/dict() [0x404d96] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7f823f044f7c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xe1) [0x7f823f046231] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7f823f045005] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f823f0451a8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f823efe2c23] -> dovecot/dict(main+0x149) [0x404809] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f823e4cdb45] -> dovecot/dict() [0x40488d] Oct 29 10:12:13 uschi dovecot: dict(27421): Fatal: master: service(dict): child 27421 killed with signal 6 (core dumps disabled) The SQL query log from mariadb shows 151029 10:18:06 5318 Connect readuser(a)10.1.1.50 as anonymous on mailserver 5318 Query SELECT CONCAT("/srv/mail/", dir) AS home, CONCAT("maildir:/srv/mail/", dir, "/Maildir:LAYOUT=fs") AS mail, 5000 AS uid, 5000 AS gid FROM virtual_users WHERE email = 'my(a)example.net' 5318 Query SELECT CONCAT("/srv/mail/", dir) AS home, CONCAT("maildir:/srv/mail/", dir, "/Maildir:LAYOUT=fs") AS mail, 5000 AS uid, 5000 AS gid FROM virtual_users WHERE email = 'other(a)example.net' 5319 Connect writeuser(a)10.1.1.50 as anonymous on mailserver 5319 Query SELECT dummy,from_user FROM anyone_shares 5319 Query SELECT dummy,from_user FROM user_shares WHERE to_user = 'my(a)example.net' 5319 Query SELECT dummy,to_user,from_user FROM user_shares 5319 Query SELECT dummy,from_user FROM anyone_shares There is no insert. As far as i can tell everything works as it should with shared folders except that die sql based acl_shared_dict is not updated. The expire dict is properly updated. Is there something i can test? My Thunderbird shows me that the server does not support shareing of mailboxes so i can't share parts of my mailbox to other users. Is this a separate issue or related? doveconf -n # 2.2.19: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.9 (357ac0a0e68b+) # OS: Linux 4.2.1 x86_64 Debian 8.2 ext4 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes default_vsz_limit = 512 M deliver_log_format = msgid=%m, from=%f, envelope from=%{from_envelope}, envelope to=%{to_envelope}, delivery time=%{delivery_time}ms, lmtp session time=%{session_time}ms, status=%$ dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_gid = 5000 first_valid_uid = 5000 imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags last_valid_gid = 5000 last_valid_uid = 5000 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k session=<%{session}> mail_access_groups = vmail mail_debug = yes mail_gid = vmail mail_location = maildir:/srv/mail/%u/Maildir:LAYOUT=fs mail_plugins = fts fts_solr virtual stats expire acl mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate namespace { list = children location = maildir:%%h/Maildir:INDEXPVT=%h/shared/%%u:LAYOUT=fs prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Archives { auto = subscribe special_use = \Archive } mailbox "Deleted Items" { special_use = \Trash } mailbox Draft { special_use = \Drafts } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox "Gel&APY-schte Objekte" { special_use = \Trash } mailbox "Gesendete Objekte" { special_use = \Sent } mailbox Junk-E-Mail { special_use = \Junk } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } namespace virtual { hidden = no inbox = no list = children location = virtual:/srv/mail/%u/virtual mailbox All { special_use = \All } prefix = virtual/ separator = / subscriptions = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl antispam_backend = dspam antispam_debug_target = syslog antispam_dspam_args = --client;--user;%u;--source=error;--signature=%%s antispam_dspam_binary = /usr/bin/dspam antispam_dspam_notspam = --class=innocent antispam_dspam_spam = --class=spam antispam_signature = X-DSPAM-Signature antispam_signature_missing = error antispam_spam_pattern_ignorecase = Junk;SPAM antispam_trash_pattern_ignorecase = trash;Deleted *;Gel&APY-schte *;GelÃ¶schte * expire = Trash expire2 = Spam expire_dict = proxy::expire fts = solr fts_autoindex = yes fts_solr = break-imap-search url=http://10.1.1.50:8983/solr/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename append mail_log_fields = uid box msgid size from vsize flags mailbox_alias_new = Sent Messages mailbox_alias_new10 = Draft mailbox_alias_new11 = Entw&APw-rfe mailbox_alias_new2 = Sent Items mailbox_alias_new3 = Gesendete Objekte mailbox_alias_new4 = Sent Messages mailbox_alias_new5 = Junk mailbox_alias_new6 = Junk-E-Mail mailbox_alias_new7 = Deleted Items mailbox_alias_new8 = Deleted Messages mailbox_alias_new9 = Gel&APY-schte Objekte mailbox_alias_old = Sent mailbox_alias_old10 = Drafts mailbox_alias_old11 = Drafts mailbox_alias_old2 = Sent mailbox_alias_old3 = Sent mailbox_alias_old4 = Sent mailbox_alias_old5 = Spam mailbox_alias_old6 = Spam mailbox_alias_old7 = Trash mailbox_alias_old8 = Trash mailbox_alias_old9 = Trash sieve = file:/srv/sieve/%u/;active=/srv/sieve/%u/.dovecot.sieve sieve_before = /srv/sieve/before stats_refresh = 30 secs stats_track_cmds = yes } postmaster_address = postmaster(a)sec-svcs.eu protocols = imap pop3 lmtp sieve service auth-worker { user = doveauth } service auth { inet_listener { address = 10.1.1.10 port = 12987 } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = doveauth mode = 0666 user = doveauth } } service dict { unix_listener dict { group = vmail mode = 0660 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 2 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl = required ssl_cert = </srv/cert/public/uschi.sec-svcs.eu_20141030_comodo_ca_intermediate.crt ssl_key = </srv/cert/private/uschi.sec-svcs.eu_20141030_comodo.key ssl_options = no_compression ssl_protocols = !SSLv2,!SSLv3 syslog_facility = local5 userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = fts fts_solr virtual stats expire acl sieve } protocol lda { mail_plugins = fts fts_solr virtual stats expire acl sieve } protocol imap { mail_plugins = fts fts_solr virtual stats expire acl antispam mailbox_alias imap_stats imap_acl } Thanks in advance Christian

2 2

Dovecot, JavaMail, UIDs and Message Numbers
by Gabriele Bulfon 29 Oct '15

29 Oct '15

Hi, new to this list, so a little prelude to my issue with Dovecot. We have been using JavaMail against Cyrus for ages, and developed Webtop, a huge Java web collaboration application running on them in production in various installations for all this time. Recently we had to run the same software against Dovecot pre-existing accounts running on Nethesis NethServer solution. After some time of testing, we started having an intermittent problem, where Dovecot started reindexing when Webtop was trying to issue sort or search commands. The same accounts previously worked with Thunderbird clients and/or RoundCube interface, never facing this problem. Digging into the issue, we compared the imap protocol produced by Thunderbird, RoundCube and Webtop, discovering that JavaMail is internally all based on message numbers, so any sort/search/fetch is a normal SORT/SEARCH/FETCH, while RC and TB always use UID SORT/UID SEARCH/UID FETCH. We tried to convert our code to use UIDs instead of msgnums, but turned out to be a huge rewrite of JavaMail, because of how JavaMail imap implementation is tied to msgnums. So my questions are: - is it a known fact that Dovecot prefers and performs better with UIDs than with msgnums? - is there any tweak we can do on Dovecot to work better on msgnums? - anybody already faced this issue with JavaMail/Dovecot? Thanks for any suggestion, Gabriele.

2 2

Re: My dovecot works fine against Active Directory 2003, but not against AD2008
by Mark Foley 29 Oct '15

29 Oct '15

Fran - thanks for your reply. I'm cc'ing you directly on this as well as posting to the list as I'm not sure how often you check the list and I'm down to hanging by my last fingernail on this project. I have some preliminary questions interspersed below. Thanks, --Mark -----Original Message----- > Subject: Re: My dovecot works fine against Active Directory 2003, but not > against AD2008 > To: dovecot(a)dovecot.org > From: Fran <cumc-4361-2(a)chguadalquivir.es> > Date: Thu, 10 Sep 2015 13:26:21 +0200 > > Hi Mark, > > when I say AD 2003/8 I mean Active Directory 2003/8. Hmmm, I've not heard of "Active Directory 2003" or 2008. The year numbers indicated to me you might be talking about Windows Small Business Server 2003 or 2008. Is your AD Server Windows? Linux? Something else? I'm using Samba4 AD/DC on Linux. > > My configuration is attached. Thank you very much for that. If I make some headway, I'll likely have more questions on specifics. > > I based my installation (dovecot+postfix) in the guides of this site: > http://www.linuxmail.info > > The LDAP part is this: > http://www.linuxmail.info/postfix-dovecot-ldap-centos-5/ If you were able to make sense out of these sites' tiny screen-shots and one-line descriptions my hat's off to you. "Your a better man that I am Gunga-Din!" If there was more detailed narrative somewhere I couldn't find it. Also, I don't have jXplorer on my system, so probably I couldn't get too far anyway. BIG QUESTIONS: 1. Are you using MS Outlook IMAP clients in your environment? If so, how are you making them connect with LDAP? By checking the SPA checkbox? 2. The mail_gid/mail_uid as vmail confuses me. I see that setting a lot, including in your config. http://wiki2.dovecot.org/VirtualUsers says, "You can create, for example, one vmail user which owns all the mails, or you can assign a separate UID for each user." I have assigned a separte UID for each based on the UID returned by `wbinfo -u <username>`. Does assigning separate UIDs mess up my ability to adapt your configuration? little questions: 3. I'm not planning on using quotas. Can I safely omit your mail_plugins = " quota" setting and all your plugin { quota_...} settings? I want to be as simple as possible to start. 4. Likewise, dovecot seems to be able to find users' mailboxes just fine. Can I omit the namespace inbox {} setting? These may seem like amaturish questions, but little details have foiled me a lot on this Dovecot project. If I feel confident with the answers you provide here, I'll move on to trying some things. Thanks a lot for your help!!! --Mark > > You can also use PAM to connect to AD > (http://www.linuxmail.info/active-directory-dovecot-pam-authentication/) > but that way doesn't allow to retrieve custom fields from the AD (ex. a > field to set quota per user), so I'm using the standard LDAP method. > > Regards > > El 10/09/2015 a las 4:51, Mark Foley escribió: > > Fran and/or Matthias, > > > > Could you publish your doveconf -n? I can't get dovecot to authenticate with my > > AD. Maybe you have a solution I could try. > > > > What mail client(s) are you using? I assume by "AD 2003/8" You mean SBS2003/8 > > and are therefore using Outlook? > > > > --Mark > > > > -----Original Message----- [deleted]

3 3

Proxy with director accept only plain login
by Andrey Fesenko 29 Oct '15

29 Oct '15

Hello, i'm test system dovecot (proxy with director) and backend storage, auth LDAP server (user plain passwords) If i use plain auth, work fine. If connect DIGEST-MD5 or CRAM-MD5 proxy not redirect connection (Requested DIGEST-MD5 scheme, but we have a NULL password) ### Frontend proxy+director # dovecot -n # 2.2.19: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.2-RELEASE amd64 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login digest-md5 cram-md5 auth_username_format = %Ln auth_verbose = yes base_dir = /var/run/dovecot-proxy/ director_doveadm_port = 12347 director_mail_servers = 192.168.1.3 director_servers = 192.168.1.2 disable_plaintext_auth = no doveadm_port = 12347 first_valid_gid = 0 first_valid_uid = 1000 instance_name = proxy last_valid_gid = 6000 last_valid_uid = 6000 listen = 192.168.1.2 lmtp_proxy = yes mail_location = mbox:~/:INBOX=/var/mail/%u passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = scheme=SSHA /etc/dovecot/passwd.masterusers driver = passwd-file master = yes pass = yes } passdb { driver = pam } protocols = imap lmtp service director { fifo_listener login/proxy-notify { mode = 0600 } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 12347 } } service imap-login { executable = imap-login director } service ipc { unix_listener ipc { user = dovecot } } service lmtp { client_limit = 5 executable = lmtp idle_kill = 0 inet_listener lmtp { address = 192.168.1.2 port = 2003 } process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 } ssl_cert = </etc/ssl/certs/cyrus_imapd.pem ssl_key = </etc/ssl/certs/cyrus_imapd.pem userdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf driver = ldap } userdb { driver = passwd } userdb { driver = passwd } verbose_proctitle = yes protocol lmtp { auth_socket_path = director-userdb } protocol doveadm { auth_socket_path = director-userdb } local 192.168.1.2/24 { doveadm_password = # hidden, use -P to show it } # cat /usr/local/etc/dovecot/dovecot-ldap.conf uris = ldaps://192.168.1.2:636 # allow self-sign sert (not skip connect if sert not valid) tls_ca_cert_dir = /home/user/openldap/ tls_ca_cert_file = /home/user/openldap/ca-slapd-serv.crt tls_require_cert = allow dn = cn=dovecot,ou=accounts,dc=host,dc=ru dnpass = CycsonfeavaidOr ldap_version = 3 #auth_bind = no base = ou=accounts,dc=host,dc=ru deref = never scope = subtree user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid,mailDirectory=mail,description=proxy,ipHostNumber=host,=nopassword=y,=starttls=any-cert user_filter = (&(objectClass=posixAccount)(uid=%u)) pass_attrs = uid=user,=password=,description=proxy,ipHostNumber=host,=nopassword=y,=starttls=any-cert pass_filter = (&(objectClass=posixAccount)(uid=%u)) # need for work chap-MD5 default_pass_scheme = CLEARTEXT #### Backend # dovecot -n # 2.2.19: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 9.3-RELEASE-p24 amd64 auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_mechanisms = plain login digest-md5 cram-md5 auth_username_format = %Ln auth_verbose = yes base_dir = /var/run/dovecot/ director_servers = 1192.168.1.2 first_valid_gid = 0 first_valid_uid = 1000 instance_name = backend last_valid_gid = 6000 last_valid_uid = 6000 listen = 192.168.1.3 mail_location = mbox:~/:INBOX=/var/mail/%u passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = scheme=SSHA /etc/dovecot/passwd.masterusers driver = passwd-file master = yes pass = yes } passdb { driver = pam } protocols = imap lmtp service doveadm { inet_listener { port = 12347 } } service lmtp { client_limit = 1 executable = lmtp -L idle_kill = 0 inet_listener lmtp { address = 192.168.1.3 port = 2003 } process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 } ssl_cert = </etc/ssl/certs/cyrus_imapd.pem ssl_key = </etc/ssl/certs/cyrus_imapd.pem userdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf driver = ldap } userdb { driver = passwd } userdb { driver = passwd } valid_chroot_dirs = /var/dovecot verbose_proctitle = yes local 192.168.1.2/24 { doveadm_password = # hidden, use -P to show it } # cat /usr/local/etc/dovecot/dovecot-ldap.conf uris = ldaps://192.168.1.2:636 # allow self-sign sert (not skip connect if sert not valid) tls_ca_cert_dir = /home/user/openldap/ tls_ca_cert_file = /home/user/openldap/ca-slapd-serv.crt tls_require_cert = allow ldaprc_path = /usr/local/etc/openldap/ldap.conf dn = cn=dovecot,ou=accounts,dc=host,dc=ru dnpass = CycsonfeavaidOr ldap_version = 3 base = ou=accounts,dc=host,dc=ru deref = never scope = subtree user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid,mailDirectory=mail user_filter = (&(objectClass=posixAccount)(uid=%u)) pass_attrs = uid=user,clearPassword=password pass_filter = (&(objectClass=posixAccount)(uid=%u)) default_pass_scheme = CLEARTEXT ### Oct 27 18:15:40 imtest -v -u usertest -a usertest 192.168.1.2 (success) Oct 27 18:16:30 imtest -m DIGEST-MD5 -v -u usertest -a usertest 192.168.1.2 (fail) ### Logs Oct 27 18:15:26 fbsd10 dovecot: master: Warning: Killed with signal 15 (by pid=67306 uid=0 code=kill) Oct 27 18:15:27 fbsd10 dovecot: master: Dovecot v2.2.19 starting up for imap, lmtp Oct 27 18:15:40 fbsd10 dovecot: imap-login: proxy(usertest): started proxying to 192.168.1.3:143: user=<usertest>, method=PLAIN, rip=192.168.1.3, lip=192.168.1.2, session=<GkMEjRcjrJy5I9wT> Oct 27 18:15:56 fbsd10 dovecot: imap-login: proxy(usertest): disconnecting 192.168.1.3 (Disconnected by server): user=<usertest>, method=PLAIN, rip=192.168.1.3, lip=192.168.1.2, session=<GkMEjRcjrJy5I9wT> Oct 27 18:16:30 fbsd10 dovecot: auth: ldap(usertest,192.168.1.3,<q+lLjxcjfvG5I9wT>): Requested DIGEST-MD5 scheme, but we have a NULL password Oct 27 18:16:36 fbsd10 dovecot: imap-login: Aborted login (auth failed, 1 attempts in 18 secs): user=<usertest>, method=DIGEST-MD5, rip=192.168.1.3, lip=192.168.1.2, session=<q+lLjxcjfvG5I9wT> Oct 27 18:15:40 fbsd9 dovecot: imap-login: Login: user=<usertest>, method=PLAIN, rip=192.168.1.2, lip=192.168.1.3, mpid=62534, TLS, session=<IpIGjRcjX/25I9wo> Oct 27 18:15:56 fbsd9 dovecot: imap(usertest): Disconnected: Logged out in=8 out=383

2 1