- dovecot - dovecot.org

Optimizing search performance for mobile devices / web mailer / general - solr plugin config
by Götz Reinicke 23 Feb '18

23 Feb '18

Hi all, we run dovecot for a long time now with no complains from the users … until this week. Some users say, the search in mailfolders from iPhone (which only stores a few mails and search most on the server as I know) or our web mailer (SOGo, which I currently search also on the imap server) is „slow“. As this is sort of individual experience, I was thinking of ways to speed up the search and came across the fts_solr plugin. My question is, can I „just“ configure the its_solg plugin as described at the dovecot wiki? https://wiki.dovecot.org/Plugins/FTS/Solr <https://wiki.dovecot.org/Plugins/FTS/Solr> How difficult is is to set up a solr server for that purpose? As our current mail hardware is not busy at all, is it ok to install Solr on the same hardware/server? May be someone using that setup can give me some hints? And: How hard is it to switch back to the „build in“ default search if we don’t see any benefit from hosting a solr server too. Thanks for feedback and suggestions . Regards . Götz

3 2

Multiple SSL-Certificates/Domains setup not working
by Gabriel Kaufmann 23 Feb '18

23 Feb '18

I've tried setting up multiple SSL-Certificates (using letsencrypt) for dovecot on my ubuntu machine. Used dovecot version is 2.2.18. Regarding to official docs this should be working. My test-client (Thunderbird on linux) has been mentioned to be working fine with SNI here: https://wiki.dovecot.org/SSL/SNIClientSupport https://wiki.dovecot.org/SSL/DovecotConfiguration#line-89 > local_name imap.example.org { > ssl_cert = </etc/ssl/certs/imap.example.org.crt > ssl_key = </etc/ssl/private/imap.example.org.key > } > local_name imap.example2.org { > ssl_cert = </etc/ssl/certs/imap.example2.org.crt > ssl_key = </etc/ssl/private/imap.example2.org.key > } Did anyone have success on this (without using multiple IP per Domain)? -- Best regards Gabriel Kaufmann

4 5

preferred way to move an imap folder
by himbeere＠shinymail.de 23 Feb '18

23 Feb '18

Hello list. What is the preferred way to move an imap folder. Lets say an User has. .maildir/.INBOX.Junk I want to move this imap folder to: .maildir/.Junk Can i just use: mv .maildir/.INBOX.Junk .maildir/.Junk and be done with that? thanks and cheers t.

3 3

Auth SEGV on sparc64, alignment problem?
by Chris Ross 23 Feb '18

23 Feb '18

Apologies first for using two addresses, but I can’t currently read my email at distal.com. :-) I was previously running dovecot2-2.2.29.1_2 on FreeBSD 11 on sparc64. Trying to debug a problem I was having with one of my clients, I upgraded to dovecot-2.2.33.2_4 on that same server. However, I cannot connect now, log shows: Feb 20 16:55:00 westeros dovecot: master: Dovecot v2.2.33.2 (d6601f4ec) starting up for imap, pop3, lmtp Feb 20 16:55:31 westeros dovecot: auth: Fatal: master: service(auth): child 25395 killed with signal 11 (core dumped) Feb 20 16:55:31 westeros dovecot: master: Error: service(auth): command startup failed, throttling for 2 secs Feb 20 16:55:31 westeros dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=2001::xxx, lip=2001:470:e24c:200::ae25, TLS handshaking, session=<ASDFSAFSADFSAD> Feb 20 16:55:33 westeros dovecot: auth: Fatal: master: service(auth): child 25398 killed with signal 11 (core dumped) Feb 20 16:55:33 westeros dovecot: master: Error: service(auth): command startup failed, throttling for 4 secs Feb 20 16:55:33 westeros dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 2 secs): user=<>, rip=2001::xxx, lip=2001:470:e24c:200::ae25, session=<d46tyesdy5dsyd> Feb 20 16:55:37 westeros dovecot: master: Error: service(auth): command startup failed, throttling for 8 secs Feb 20 16:55:37 westeros dovecot: auth: Fatal: master: service(auth): child 25400 killed with signal 11 (core dumped) Loading the core file, as described https://www.dovecot.org/bugreport.html , shows the error in libc somewhere: (gdb) bt full #0 __unaligned_load ( p=0x617070656e640e6d <Address 0x617070656e640e6d out of bounds>, size=4) at /usr/src/release-11.1.0/lib/libc/sparc64/sys/__sparc_utrap_align.c:45 val = 0 i = 0 #1 0x00000000109f9f6c in __unaligned_fixup (uf=0x7fdffffee40) at /usr/src/release-11.1.0/lib/libc/sparc64/sys/__sparc_utrap_align.c:78 addr = <value optimized out> val = <value optimized out> insn = 3254807616 sig = <value optimized out> #2 0x00000000109f9d50 in __sparc_utrap (uf=0x7fdffffee40) at /usr/src/release-11.1.0/lib/libc/sparc64/sys/__sparc_utrap.c:100 sig = 272013984 #3 0x000000001094a10c in __sparc_utrap_gen () from /lib/libc.so.7 No symbol table info available. #4 0x000000001094a10c in __sparc_utrap_gen () from /lib/libc.so.7 No symbol table info available. Previous frame identical to this frame (corrupt stack?) (gdb) As this is a sparc64, with 8-byte alignment requirements, I’m guessing that’s the issue. Many a piece of software has failed to respect that and crashed. But, I’m not sure. Does anyone have any suggestions? I’ve built it locally (via ports), so if there are compiler options I can/should try, I certainly can try. Thanks… - Chris

4 9

Constant IMAP timeouts/dropouts
by H.E. 23 Feb '18

23 Feb '18

Hello, I've searched and searched for a solution to this problem but continue to come up empty. I have a very generic setup. CentOS Linux 7.3.1611 running on AWS. I installed the QMail toaster from here: http://www.qmailtoaster.com/ ( I had been using Bill Shupp's Qmail Toaster for years and years, but he stopped supporting it.) As such, I did have to convert my Courier mailboxes to Dovecot (no real problem there). I'm using Thunderbird client on Windows and Mac. I have one user (me) using two vpopmail domains with a total of three mailboxes. Each mailbox has about 20 folders which I tag in Thunderbird as "When getting new messages for this account, always check this folder". I might have two or three client machines (at different locations) running at once (desktop and two notebooks) all trying to get mail. The problem is I can't go 5 minutes without Dovecot timing out on me, returning an error in Thunderbird: "Login to server failed" and asks to "enter new password, cancel, or retry" options, or just hanging. The only way to get Dovecot back is to bounce both dovecot and the network via: /bin/systemctl restart dovecot.service ; /bin/systemctl restart network Then I can resume normal activities for a while. It got so bad that I put the above restarts into a cron job running every 5 minutes. But even then the problem persists after a couple of minutes. There's nothing else running on this box. I've already increased both mail_max_userip_connections = 8000 and: protocol imap { mail_max_userip_connections = 8000 mail_plugins = " quota imap_quota" } By the way, the the identical mailbox and client setup, I never had this problem with Courier IMAP. My dovecot -n is pasted below. So I'm at a loss on how to fix this. I have tried adjusting the number of cached Thunderbird connections, and that doesn't change anything. Any help or pointers in the right direction to keep Dovecot connected would be most helpful. Thanks, -hank Here is my dovecot -n # 2.2.24 (a82c823): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.26.2.el7.x86_64 x86_64 CentOS Linux release 7.3.1611 (Core) auth_cache_size = 64 M auth_debug_passwords = yes auth_mechanisms = plain login digest-md5 cram-md5 first_valid_gid = 89 first_valid_uid = 89 log_path = /var/log/dovecot.log login_greeting = Dovecot toaster ready. mail_max_userip_connections = 8000 mail_plugins = " quota" namespace { inbox = yes location = prefix = separator = . type = private } passdb { args = cache_key=%u webmail=127.0.0.1 driver = vpopmail } plugin { quota = maildir:ignore=Trash quota_rule = ?:storage=0 } protocols = imap ssl_cert = </var/qmail/control/servercert.pem ssl_dh_parameters_length = 2048 ssl_key = </var/qmail/control/servercert.pem userdb { args = cache_key=%u quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol imap { mail_max_userip_connections = 8000 mail_plugins = " quota imap_quota" } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes pop3_lock_session = yes }

1 0

Panic: data stack: Out of memory when allocating bytes
by Thomas Robers 22 Feb '18

22 Feb '18

Hello, I'm using Dovecot 2.3 and sometimes i get this: --- snip --- Jan 23 14:23:13 mail dovecot: imap(bob(a)tutech.de)<4880><PDqibHFjMvrAqG1n>: Panic: data stack: Out of memory when allocating 134217768 bytes Jan 23 14:23:13 mail dovecot: imap(bob(a)tutech.de)<4880><PDqibHFjMvrAqG1n>: Fatal: master: service(imap): child 4880 killed with signal 6 (core dumped) --- snip --- The gdb backtrace is: --- snip --- GNU gdb (GDB) Red Hat Enterprise Linux (7.2-92.el6) Copyright (C) 2010 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/libexec/dovecot/imap...(no debugging symbols found)...done. Attaching to program: /usr/libexec/dovecot/imap, process 4880 ptrace: Kein passender Prozess gefunden. [New Thread 4880] Reading symbols from /usr/lib64/dovecot/libdovecot-storage.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/libdovecot-storage.so.0 Reading symbols from /usr/lib64/dovecot/libdovecot.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/libdovecot.so.0 Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libc.so.6 Reading symbols from /lib64/librt.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/librt.so.1 Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libdl.so.2 Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done. [Thread debugging using libthread_db enabled] Loaded symbols for /lib64/libpthread.so.0 Reading symbols from /usr/lib64/dovecot/lib01_acl_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/lib01_acl_plugin.so Reading symbols from /usr/lib64/dovecot/lib02_imap_acl_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/lib02_imap_acl_plugin.so Reading symbols from /usr/lib64/dovecot/lib15_notify_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/lib15_notify_plugin.so Reading symbols from /usr/lib64/dovecot/lib20_mail_log_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/lib20_mail_log_plugin.so Reading symbols from /usr/lib64/dovecot/lib20_zlib_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/lib20_zlib_plugin.so Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libz.so.1 Reading symbols from /lib64/libbz2.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libbz2.so.1 Reading symbols from /usr/lib64/dovecot/lib30_imap_zlib_plugin.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/dovecot/lib30_imap_zlib_plugin.so Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. #0 0x00007f73f1386495 in raise () from /lib64/libc.so.6 --- snip --- I searched for that error message but only found some entries regarding older dovecot versions and setting "mail_process_size" but i couldn't find anything regarding Dovecot Version 2.3. Maybe it's something that is fixed already but if so i can't find it. Or is this a configuration issue or a bug? Here my Dovecot configuration: --- snip --- # 2.3.0 (c8b89eb): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.1 (d33dca20) # OS: Linux 2.6.32-696.3.1.el6.x86_64 x86_64 CentOS release 6.9 (Final) ext4 auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it doveadm_port = 12345 imap_max_line_length = 2 M mail_debug = yes mail_location = maildir:/export/home/imap/%Lu/Maildir mail_plugins = acl zlib mail_log notify mailbox_idle_check_interval = 10 secs managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { hidden = no ignore_on_failure = no inbox = no list = children location = maildir:%%h/Maildir:INDEXPVT=%h/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX/ separator = / type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/export/home/shared-db/shared-mailboxes mail_log_events = append delete undelete expunge copy mailbox_delete mailbox_rename flag_change mail_log_fields = uid box msgid size from flags mail_replica = tcp:mail2.tutech.de sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global = /var/lib/dovecot/sieve/global/ sieve_user_log = ~/.dovecot.sieve.log zlib_save = gz zlib_save_level = 6 } protocols = imap pop3 lmtp sieve sieve service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service config { unix_listener config { user = vmail } } service doveadm { inet_listener { port = 12345 } user = vmail } service imap-login { inet_listener imaps { port = 993 ssl = yes } process_limit = 500 process_min_avail = 20 } service imap { executable = imap } service lmtp { inet_listener lmtp { address = 127.0.0.1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service pop3 { executable = pop3 } service replicator { unix_listener replicator-doveadm { mode = 0666 } } ssl = required ssl_cert = </etc/pki/dovecot/certs/mail.tutech.de.crt_chain ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!EXPORT ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it syslog_facility = local6 userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap } protocol lmtp { mail_plugins = acl zlib mail_log notify sieve } protocol imap { mail_max_userip_connections = 100 mail_plugins = acl zlib mail_log notify imap_zlib imap_acl rawlog_dir = /tmp/rawlog/%u } --- snip --- Thanks for the help! Kind regards Thomas

2 7

lmtp: Couldn't parse DH parameters
by jordan.h＠startmail.com 22 Feb '18

22 Feb '18

I'm using SSL for dovecot, and dovecot kindly warned me on startup that I needed the ssl_dh parameter, which I specified: # grep -P '^ssl_dh' /etc/dovecot/conf.d/10-ssl.conf ssl_dh = </etc/dovecot/dh.pem And I generated the file, as specified in the comment: # openssl dhparam -out /etc/dovecot/dh.pem 4096 The file contains the appropriate headers: # grep -P '^\-' /etc/dovecot/dh.pem -----BEGIN DH PARAMETERS----- -----END DH PARAMETERS----- However, when I restart dovecot (`systemctl restart dovecot`) I get the following error: lmtp(8221): Error: SSL context initialization failed, disabling SSL: Couldn't parse DH parameters: error:0906D06C:PEM routines:PEM_read_bio:no start line: Expecting: DH PARAMETERS This message repeats 5 times (presumably for each dovecot service?). In /var/log/dovecot/imap.log, I see the same error. I even gave permission to the `dh.pem` file for the *vmail* user and group, but that didn't seem to change anything. Any ideas? Thanks.

3 3

Authenticating pam and and sql
by ＠lbutlr 22 Feb '18

22 Feb '18

When a sql user logs in, dovecot always tries pam first (used for the local users with home directories) which generates a login failure in the log, before trying sql (virtual users) and allowing the user to login. Since all the pam users login as 'user' and all the sql users login as 'user(a)example.com' is it possible to tell dovecot which method to check based on the username pattern? It's not a big deal, but these errors show up when I am checking my maillog for problems, and I can't really exclude them since I do want to see actual login failures.

2 2

"Stale mailbox lock file detected, will override in 0 seconds"
by Raffaele Gambelli 22 Feb '18

22 Feb '18

Hi all dovecot members, I've received this notice from a dovecot server: "Stale mailbox lock file detected, will override in 0 seconds" I would like to know what it means. I've implemented a "Mail Proxy Server" in java, which connects to many accounts and folders, listening for incoming messages or deleted one, it uses the IMAP protocol. I received that message only 5 times in 60 days of logs, last time, in the same time lapse my server has not received three messages, saying differently, the listener (I'm using Javamail which works fine) has not be notified about those new threee messages. So, I would like to find a link between the above dovecot message and the "black-out" which I had, could you help me please? Thanks, bye Raffaele Gambelli WebRainbow® Software Analyst & Developer

1 0

exim dovecot sieve
by himbeere＠shinymail.de 22 Feb '18

22 Feb '18

Hello list. I have just a generic question. Exim delivers fine to dovecot-lda. My problems are the logfiles. Whenever I recieve a message Exim writes to dovecot.log as the user who recieves the mail. This forces me to have that logfile world writeable. I don't really like that. How do you guys deal with that? Here my transport: dovecot_delivery: driver = pipe # You may or may not want to add -d $local_part@$domain depending on if you need a userdb lookup done. command = /usr/libexec/dovecot/dovecot-lda -f $sender_address message_prefix = message_suffix = log_output delivery_date_add envelope_to_add return_path_add #group = mail #mode = 0660 temp_errors = 64 : 69 : 70: 71 : 72 : 73 : 74 : 75 : 78 thanks and best regards t.

2 2