- dovecot - dovecot.org

[Dovecot] Trying to get DSpam+Dovecot working with Postfix and local/virtual domains
by Jeremy Doran 21 Apr '14

21 Apr '14

Hi, I'm hoping that someone might be able to help, as I've been going in circles with trying to get the right configuration done here. I'm also not sure whether this is more of a Dovecot or DSpam question, so I'm posting the same to both mailing lists. My goal is to have a mail setup that is as follows: [Incoming email] --> [Postfix] --> [Amavis] --> [DSpam] --> [Dovecot LDA] -+---(local domain)---> /var/mail/${user} | +---(virtual)---> /home/vmail/${domain}/${user}@{domain} As of right now, I have Postfix successfully feeding into Amavis, re-injecting into Postfix with a final delivery for the local domain via procmail, and final delivery for virtual domains via the virtual transport into maildir (but /home/vmail/${user}@${domain}) Virtual domains are being managed by PostfixAdmin. Dovecot is running as the IMAP server. Everything (Postfix, PostfixAdmin, Dovecot) is using a Postgres database as backend for the dynamic maps/authentication. The problem I've been stumbling over is trying to get DSpam to work nicely with both a local domain and virtual domains/mailboxes, and the same for Dovecot, as I would rather like to make use of the Sieve functionality going forward instead of Procmail. I did have DSpam working, but was unable to get the Dovecot antispam plugin working to re-train based on moving mails into/out of a defined 'SPAM' folder, due to permissions relating to how the antispam plugin was calling DSpam. I'm really not wanting to make the local domain into a virtual mailbox domain, because there are users on the system (for that local domain) that already use the password in /etc/passwd for accessing the server for other uses. While there are also people who do that who have virtual mailbox domains, it's a far lower number. Here's what I have so far. Postfix 2.11.0 main.cf (via 'postconf -nf'): alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases, hash:/usr/local/mailman/data/aliases command_directory = /usr/local/sbin config_directory = /usr/local/etc/postfix content_filter = amavisfeed:[127.0.0.1]:10024 daemon_directory = /usr/local/libexec/postfix data_directory = /var/db/postfix debug_peer_level = 2 debugger_command = PATH=/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin ddd $daemon_directory/$process_name $process_id & sleep 5 html_directory = /usr/local/share/doc/postfix inet_interfaces = all inet_protocols = ipv4 ipv6 local_recipient_maps = $transport_maps unix:passwd.byname $alias_maps mail_owner = postfix mailbox_command = /usr/local/bin/procmail -a "$EXTENSION" mailq_path = /usr/local/bin/mailq manpage_directory = /usr/local/man mydestination = $myhostname, localhost.$mydomain, $mydomain mydomain = critter.net myhostname = cornix.critter.net mynetworks = 127.0.0.0/8, 46.4.24.15/32, [::1]/128, [2a01:4f8:131:4263::]/64, 184.73.168.110/32, [2001:470:7:12ba::]/64 mynetworks_style = host myorigin = $mydomain newaliases_path = /usr/local/bin/newaliases queue_directory = /var/spool/postfix readme_directory = /usr/local/share/doc/postfix receive_override_options = no_address_mappings recipient_delimiter = - relay_domains = pgsql:$config_directory/Maps/pgsql_relay_domains_maps.cf sample_directory = /usr/local/etc/postfix sendmail_path = /usr/local/sbin/sendmail setgid_group = maildrop smtp_tls_CAfile = /etc/ssl/certs/Critter.Net_Certificate_Authority.pem smtp_tls_cert_file = /etc/ssl/certs/smtp.critter.net.pem smtp_tls_key_file = /etc/ssl/private/smtp.critter.net.pem smtp_tls_session_cache_database = /var/db/postfix/smtp_scache smtp_use_tls = yes smtpd_banner = $myhostname ESMTP $mail_name smtpd_recipient_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_non_fqdn_hostname, reject_non_fqdn_sender, reject_non_fqdn_recipient, reject_unauth_destination, reject_unauth_pipelining, reject_invalid_hostname, reject_rbl_client zen.spamhaus.org, check_policy_service inet:127.0.0.1:10023 smtpd_relay_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination smtpd_sasl_auth_enable = yes smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot smtpd_tls_CAfile = /etc/ssl/certs/Critter.Net_Certificate_Authority.pem smtpd_tls_ask_ccert = yes smtpd_tls_cert_file = /etc/ssl/certs/smtp.critter.net.pem smtpd_tls_key_file = /etc/ssl/private/smtp.critter.net.pem smtpd_tls_loglevel = 1 smtpd_tls_received_header = yes smtpd_tls_session_cache_database = btree:/var/db/postfix/smtpd_scache smtpd_use_tls = yes soft_bounce = yes tls_random_source = dev:/dev/urandom transport_maps = pgsql:$config_directory/Maps/pgsql_transport_maps.cf unknown_local_recipient_reject_code = 450 virtual_alias_maps = pgsql:$config_directory/Maps/pgsql_virtual_alias_maps.cf virtual_gid_maps = static:400 virtual_mailbox_base = /home/vmail virtual_mailbox_domains = pgsql:$config_directory/Maps/pgsql_virtual_domain_maps.cf virtual_mailbox_limit = 51200000 virtual_mailbox_maps = pgsql:$config_directory/Maps/pgsql_virtual_mailbox_maps.cf virtual_minimum_uid = 400 virtual_transport = virtual virtual_uid_maps = static:400 master.cf (via 'postconf -Mf'): smtp inet n - n - - smtpd 24 inet n - n - - smtpd submission inet n - n - - smtpd -o syslog_name=postfix/submission -o smtpd_tls_security_level=encrypt -o smtpd_sasl_type=dovecot -o smtpd_sasl_path=private/auth -o smtpd_sasl_auth_enable=yes -o smtpd_client_restrictions=permit_sasl_authenticated,permit_mynetworks,reject -o milter_macro_daemon_name=ORIGINATING smtps inet n - n - - smtpd -o syslog_name=postfix/smtps -o smtpd_tls_wrappermode=yes -o smtpd_tls_security_level=encrypt -o smtpd_sasl_type=dovecot -o smtpd_sasl_path=private/auth -o smtpd_sasl_auth_enable=yes -o smtpd_client_restrictions=permit_sasl_authenticated,permit_mynetworks,reject -o milter_macro_daemon_name=ORIGINATING pickup unix n - n 60 1 pickup cleanup unix n - n - 0 cleanup qmgr unix n - n 300 1 qmgr tlsmgr unix - - n 1000? 1 tlsmgr rewrite unix - - n - - trivial-rewrite bounce unix - - n - 0 bounce defer unix - - n - 0 bounce trace unix - - n - 0 bounce verify unix - - n - 1 verify flush unix n - n 1000? 0 flush proxymap unix - - n - - proxymap proxywrite unix - - n - 1 proxymap smtp unix - - n - - smtp relay unix - - n - - smtp showq unix n - n - - showq error unix - - n - - error retry unix - - n - - error discard unix - - n - - discard local unix - n n - - local virtual unix - n n - - virtual lmtp unix - - n - - lmtp anvil unix - - n - 1 anvil scache unix - - n - 1 scache amavisfeed unix - - - - 2 smtp -o syslog_name=postfix/amavisfeed -o smtp_data_done_timeout=1200 -o smtp_send_xforward_command=yes 127.0.0.1:10025 inet n - n - - smtpd -o syslog_name=postfix/amavis-reinject -o content_filter= -o smtpd_delay_reject=no -o smtpd_client_restrictions=permit_mynetworks,reject -o smtpd_helo_restrictions= -o smtpd_sender_restrictions= -o smtpd_recipient_restrictions=permit_mynetworks,reject -o smtpd_data_restrictions=reject_unauth_pipelining -o smtpd_end_of_data_restrictions= -o smtpd_restriction_classes= -o mynetworks=127.0.0.0/8,[::1]/128 -o smtpd_error_sleep_time=0 -o smtpd_soft_error_limit=1001 -o smtpd_hard_error_limit=1000 -o smtpd_client_connection_count_limit=0 -o smtpd_client_connection_rate_limit=0 -o receive_override_options=no_header_body_checks,no_unknown_recipient_checks,no_milters -o local_header_rewrite_clients= -o smtpd_milters= -o local_recipient_maps= -o relay_recipient_maps= dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/local/libexec/dovecot/deliver -f ${sender} -d ${user}@${nexthop} Dovecot 2.2.10 config (via 'dovecot -n'): # 2.2.10: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.0-RELEASE-p1 amd64 auth_debug = yes auth_verbose = yes debug_log_path = /var/log/dovecot-debug.log first_valid_uid = 400 mail_location = mbox:~/Mail:INBOX=/var/mail/%u mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { driver = pam } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { driver = passwd } DSpam 3.9.0 dspam.conf: Home /var/db/dspam StorageDriver /usr/local/lib/dspam/libpgsql_drv.so TrustedDeliveryAgent "/usr/local/bin/procmail" UntrustedDeliveryAgent "/usr/bin/procmail -d %u" OnFail error Trust root Trust dspam Trust apache Trust mail Trust mailnull Trust smmsp Trust daemon TrainingMode teft TestConditionalTraining on Feature whitelist Algorithm graham burton Tokenizer chain PValue bcr WebStats on Preference "trainingMode=TEFT" # { TOE | TUM | TEFT | NOTRAIN } -> default:teft Preference "spamAction=quarantine" # { quarantine | tag | deliver } -> default:quarantine Preference "spamSubject=[SPAM]" # { string } -> default:[SPAM] Preference "statisticalSedation=5" # { 0 - 10 } -> default:0 Preference "enableBNR=on" # { on | off } -> default:off Preference "enableWhitelist=on" # { on | off } -> default:on Preference "signatureLocation=message" # { message | headers } -> default:message Preference "tagSpam=off" # { on | off } Preference "tagNonspam=off" # { on | off } Preference "showFactors=off" # { on | off } -> default:off Preference "optIn=off" # { on | off } Preference "optOut=off" # { on | off } Preference "whitelistThreshold=10" # { Integer } -> default:10 Preference "makeCorpus=off" # { on | off } -> default:off Preference "storeFragments=off" # { on | off } -> default:off Preference "localStore=" # { on | off } -> default:username Preference "processorBias=on" # { on | off } -> default:on Preference "fallbackDomain=off" # { on | off } -> default:off Preference "trainPristine=off" # { on | off } -> default:off Preference "optOutClamAV=off" # { on | off } -> default:off Preference "ignoreRBLLookups=off" # { on | off } -> default:off Preference "RBLInoculate=off" # { on | off } -> default:off AllowOverride enableBNR AllowOverride enableWhitelist AllowOverride fallbackDomain AllowOverride ignoreGroups AllowOverride ignoreRBLLookups AllowOverride localStore AllowOverride makeCorpus AllowOverride optIn AllowOverride optOut AllowOverride optOutClamAV AllowOverride processorBias AllowOverride RBLInoculate AllowOverride showFactors AllowOverride signatureLocation AllowOverride spamAction AllowOverride spamSubject AllowOverride statisticalSedation AllowOverride storeFragments AllowOverride tagNonspam AllowOverride tagSpam AllowOverride trainPristine AllowOverride trainingMode AllowOverride whitelistThreshold AllowOverride dailyQuarantineSummary MySQLUIDInSignature on PgSQLServer /tmp/ PgSQLUser dspam PgSQLPass xxxxxx PgSQLDb dspam HashRecMax 98317 HashAutoExtend on HashMaxExtents 0 HashExtentSize 49157 HashPctIncrease 10 HashMaxSeek 10 HashConnectionCache 10 Notifications off PurgeSignatures 14 # Stale signatures PurgeNeutral 90 # Tokens with neutralish probabilities PurgeUnused 90 # Unused tokens PurgeHapaxes 30 # Tokens with less than 5 hits (hapaxes) PurgeHits1S 15 # Tokens with only 1 spam hit PurgeHits1I 15 # Tokens with only 1 innocent hit LocalMX 127.0.0.1 SystemLog on UserLog on Opt out ParseToHeaders on ServerPID /var/run/dspam.pid ServerDomainSocketPath "/var/run/dspam.sock" ClientHost /var/run/dspam.sock ProcessorURLContext on ProcessorBias on StripRcptDomain off All of this is running on a FreeBSD 10-p1 server. I hope that someone has successfully implemented a similar setup to what I'm aiming for, and might be able to help. Thanks.

1 0

[Dovecot] Quick win... command to remove all attachments from an Inbox
by IT geek 31 19 Apr '14

19 Apr '14

Good evening all, Does anyone know of a doveadm command I can use to remove (delete) all attachments from an mdbox Inbox? I prefer to save my attachments and have a sleek Inbox... but sometimes I forget. A command I can feed into a cron job would be ideal. Many thanks, -Mark

3 4

[Dovecot] dkim test
by Benny Pedersen 19 Apr '14

19 Apr '14

just testing, if it tempfails on dovecot mail me private from the admins of dovecot maillist only

1 0

[Dovecot] Changing SSL certificates - switching from self-signed to RapidSSL
by Charles Marcus 19 Apr '14

19 Apr '14

Hi all, Ok, been wanting to do this for a while, and I after the Heartbleed fiasco, the boss finally agreed to let me buy some real certs... Until now, we've been using self-signed certs with the following dovecot config: ssl = required ssl_cert = </etc/ssl/ourCerts/imap.pem ssl_key = </etc/ssl/ourCerts/imap_key.pem Now, I've created new keys/certs and the CSR, got the new certs from RapidSSL (and also downloaded their Intermediate bundle), saved everything per their instructions, which say to reference them as follows: ssl = required ssl_cert_file = /etc/ssl/ourNewCerts/mail.ourdomain.com.crt ssl_key_file = /etc/ssl/ourNewCerts/mail.ourdomain.com.key ssl_ca_file = /etc/ssl/ourNewCerts/RapidSSL_Intermediate.crt But my current config doesn't have the _file for the variable names, and the wiki doesn't use them, so I'm planning on setting these to: ssl = required ssl_cert = /etc/ssl/ourNewCerts/mail.ourdomain.com.crt ssl_key = /etc/ssl/ourNewCerts/mail.ourdomain.com.key ssl_ca = /etc/ssl/ourNewCerts/RapidSSL_Intermediate.crt Anyone else ever used RapidSSL certs? Does this look correct? Thanks, Charles

6 20

Re: [Dovecot] Changing SSL certificates - switching from self-signed to RapidSSL
by Joseph Tam 19 Apr '14

19 Apr '14

Charles Marcus <CMarcus(a)Media-Brokers.com> wrote: > 2014-04-18T15:54:07-04:00 dinkumthinkum dovecot: imap-login: > Disconnected (no auth attempts in 0 secs): user=<>, TLS handshaking: > SSL_accept() failed: error:14094412:SSL routines:SSL3_READ_BYTES:sslv3 > alert bad certificate: SSL alert number 42, rip=99.14.24.224, lport=143 > > Not a huge number, but enough to be concerning... > > Could this just be from cached junk from some clients, and they will > resolve themselves over time? Short answer: maybe. I got these errors when I switched from a self-signed to CA signed cert, and the client had an open mail session: Feb 22 02:10:32 imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=x.x.x.x, lip=y.y.y.y, TLS: SSL_read() failed: error:14094418:SSL routines:SSL3_READ_BYTES:tlsv1 alert unknown ca: SSL alert number 48, session=<w4Lm8vvypgCJUgmg> Not quite the same as your's, but if you call the client up and ask them to restart their mail client, I'm fairly confident these will go away, as for my user. You might get some weirdness if for some reason the client does not have the intermediate CAs cached. I ran into this problem with our certs -- some RH distributions did have the intermediate CA certs in its store. Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] Hash Verification with doveadm
by Andreas Krischer - AKbyte 19 Apr '14

19 Apr '14

Hello! I have a problem with the doveadm tool. I’m trying to verify a hash from my MySQL-Db with the following command: doveadm pw -p '123' -t '{SHA512-CRYPT}$6$e3TLkiahfHFv29/J$8etBEtmbh06B72kc1TpetT/k8aHkQrJAPQVpTGDYuzyHZX4MwU2PeL2cIupNEoUUGt6SLB0N7xNqbbqp/5OZo.' I'm expecting that it says verified or not, but it prompts for a password, so the „-p“ parameter does not work. I need this, because I want to use the verification in a shell script and for that it have to work without a prompt. I hope you guess what my problem is :) My configuration: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.41-042stab078.27 i686 Debian 7.4 reiserfs auth_mechanisms = plain login mail_location = maildir:/var/vmail/%d/%n/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/ssl/certs/mailserver.pem ssl_key = </etc/ssl/private/mailserver.pem userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/%n driver = static } protocol lda { mail_plugins = " sieve“ } Regards, Andi PS: Sorry for my bad English, I’m just a 16 year old guy from Germany ...

2 1

[Dovecot] Dovecot Replication setup
by Nikolaos Milas 18 Apr '14

18 Apr '14

Hi, I am trying to setup a master/master replication with dsync (according to the first part of: http://wiki2.dovecot.org/Replication) Sorry if this question sounds foolish, but I would like to ask/confirm whether the indicated setup is required on *both* servers participating in the master/master replication. It seems to me that both need it, but I would like to confirm, just in case. Both servers are running 2.2.12 on CentOS x86_64 (5.10 and 6.5 respectively) and users are virtual over ldap. I might have more questions in the near future, but this is a starting point. Please clarify. Best regards, Nick

3 5

[Dovecot] How to disable Director service?
by Wesley Huang 17 Apr '14

17 Apr '14

Hi All, Does anyone know how to disable the Director service. In our current running Dovecot 2.2.4, if the director configuration is commented out and Dovecot has no errors nor warnings. But the version 2.2.12 I'm testing with gives out fatal errors. We have dedicated Dovecot Director servers that serve the public frontend and separate dedicated imap/pop3 servers on the backend internal network. With the new version, Dovecot is always trying to start Director service and I couldn't find a way to stop Dovecot from giving out errors. 1. When the entire Director configuration block is commented out, there errors: dovecot: director: Fatal: No inet_listeners defined for director service (for standalone keep director_servers empty) dovecot: master: Error: service(director): command startup failed, throttling for 2 secs 2. When the director_servers line is configured as "*director_servers = *", there errors: dovecot: director: Error: Empty server list dovecot: director: Fatal: Invalid value for director_mail_servers setting master: Error: service(director): command startup failed, throttling for 2 secs 3. If the director_servers and direcotr_mail_servers are configured the same as our Director servers, there errors: dovecot: director: Fatal: director_servers doesn't list ourself dovecot: master: Error: service(director): command startup failed, throttling for 2 secs Does any one know how to disable this director service? We don't need the director service on the backend. Cheers, Wesley

2 2

[Dovecot] Move of mail folders to other mail account on same server
by Jan Valvekens 16 Apr '14

16 Apr '14

Hi, I'd like to move mail folders from one mail account to another mail account on the same server. Moving the folders via my mail client (Thunderbird) takes a long time. Therefore I wondered whether it's not possible to simply move the files on the server itself. If I unsubscribe to the folders in my source account, then move the folder and subscribe to the folders in my target account: will that work? I run dovecot version 2.1.15 Thanks a lot, Jan

2 1

[Dovecot] Segmentation fault running doveadm index (lucene) on a big mailbox
by Florian Klink 16 Apr '14

16 Apr '14

Hi, on a server running dovecot 2.2.12 I have a user with a quite big mailbox (~37000 Mails in the INBOX). I tried to enable full text search using the fts_lucene backend (dovecot 2.2.12). However, the `doveadm -v index -u <username> INBOX` always runs into a segmentation fault after mail number 24200: I tried to get a backtrace using gdb: doveadm(<username>): Info: INBOX: Caching mails seq=1..37578 24200/37578 Program received signal SIGSEGV, Segmentation fault. 0x00007ffff6612151 in lucene_index_build_more () from /usr/lib64/dovecot/lib21_fts_lucene_plugin.so (gdb) bt #0 0x00007ffff6612151 in lucene_index_build_more () from /usr/lib64/dovecot/lib21_fts_lucene_plugin.so #1 0x00007ffff6610b01 in ?? () from /usr/lib64/dovecot/lib21_fts_lucene_plugin.so #2 0x00007ffff6820d5b in fts_build_mail () from /usr/lib64/dovecot/lib20_fts_plugin.so #3 0x00007ffff6825b90 in ?? () from /usr/lib64/dovecot/lib20_fts_plugin.so #4 0x000000000041650a in ?? () #5 0x00000000004123a7 in _start () `ulimit` reports "unlimited", so ulimits shouldn't be the culprit. Is there another limit in dovecot? Unfortunately, I can't "resume" the process, the indexing always starts again from the beginning. Florian doveconf -n: # 2.2.12: /etc/dovecot/dovecot.conf # OS: Linux 3.14.0-gentoo x86_64 Gentoo Base System release 2.2 ext4 auth_mechanisms = plain login cram-md5 ntlm mail_gid = 900 mail_location = maildir:/home/vmail/%u mail_plugins = acl quota fts fts_lucene mail_uid = 900 maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { hidden = no list = children location = maildir:/home/vmail/%%u/:INDEX=/home/vmail/%%u/ prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = file:/home/vmail/shared-mailboxes fts = lucene fts_lucene = whitespace_chars=@. quota = maildir quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = /home/vmail/%u/.dovecot.sieve sieve_dir = /home/vmail/%u/sieve } postmaster_address = postmaster@<domain> protocols = imap pop3 lmtp sieve sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } } service imap-postlogin { executable = script-login /usr/local/bin/imap-postlogin.sh user = $default_internal_user } service imap { executable = imap imap-postlogin } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl = required ssl_cert = </etc/ssl/<domain>/chain.crt ssl_key = </etc/ssl/<domain>/server.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = quota sieve acl } protocol imap { mail_plugins = acl quota quota imap_quota imap_acl }

3 6

[Dovecot] migration advice
by Raphael Bauduin 15 Apr '14

15 Apr '14

Hi, I am preparing a migration from courier-imap to dovecot. The maildir is in each user's home directory, and /home is mounted by NFS. All this running in a kvm virtual machine. My plan would be to create a new virtual machine (with another IP) with dovecot, mounting the same /home, and switching a couple of users to dovecot for testing purpose. If the tests go well, I would then migrate the other users and assign the IP address of the courier imap kvm to the dovecote kvm. Does that make sense? Or can it be problematic to have some users switched to dovecot while their maildir directory is still accessible to courier-imap? Looking forward to reading your feedback, thanks in advance! Raph

1 0

Re: [Dovecot] integration of old mails into new dovecot Maildir
by K. C. Mohan - Personal 15 Apr '14

15 Apr '14

Thank you for your prompt reply and timely help. I will try to be very explanative in describing my situation. I will begin first with answering the questions you asked; 1) how are the messages storred on the old server, which storage backend do you use, maybe Maildir? Yes, Maildir. Dovecot version is 2.1.7. Virtual users are authenticated by mysql backend. Login is plain login. 2) the storage backend on the new server? Maildir. Dovecot Version 2.2.9. Mysql virtual users authentication. Plain login 3) do you care about the message UIDs? I Would like to preserve the UIDs as much as possible. However, the most important thing is for the users to have access to their old emails. 4) How many users do you have (approx.) and can you access the user's mailboxes via IMAP, e.g. using a master user or do you know their password or can you switch to a known password during migration of one particular user? I have about 50 total users. I can access their mailboxes via imap but I don't have their password handy. Mysql database with the userdata and passwords was imported into the new new server so, the users can get authenticated into the new server with the old server password. 5) Did you've changed namespaces? No. I did not change namespaces. - From your first post I figure that the basic mail server functionality of the new server is working, most importantly login, message delivery and retrieval. Yes, the new server is functional and all the users are able to log in, view delivered messages and retrieve the messages into their mail clients. However, they cannot view any old messages or retrieve any old messages. Here is the dovecot.conf of the old mail server; protocols = imap pop3 log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:/var/vmail/%d/%n mail_privileged_group = mail first_valid_uid = 6060 ssl_cert= </etc/ssl/certs/dovecot.pem ssl_key =< /etc/ssl/private/dovecot.pem #ssl_ca = </etc/ssl/certs/gd_bundle.crt ssl = yes #ssl_cert = </etc/postfix/ssl/smtpd.crt #ssl_key = </etc/postfix/ssl/smtpd.key protocol imap { mail_plugins = autocreate quota imap_quota } protocol pop3 { pop3_uidl_format = %08Xu%08Xv mail_plugins = quota } protocol lda { mail_plugins = quota sieve quota_full_tempfail = yes rejection_reason = Your message to <%t> was automatically rejected:%n%r%n%nThe Subject of your message was: %s auth_socket_path = /var/run/dovecot/auth-master log_path = /var/log/dovecot-deliver.log postmaster_address = postmaster(a)sbm1.motherindia.com # sieve_path = /var/sieve/global.sieve } auth_mechanisms = plain login cram-md5 auth_debug = no auth_debug_passwords = yes auth_verbose = no auth_verbose_passwords = no disable_plaintext_auth = no instance_name = dovecot login_greeting = Dovecot ready. mail_debug = no passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } -----Original Message----- From: Steffen Kaiser [mailto:skdovecot@smail.inf.fh-brs.de] Sent: Monday, April 14, 2014 2:18 AM To: K. C. Mohan Cc: dovecot(a)dovecot.org Subject: Re: [Dovecot] integration of old mails into new dovecot Maildir -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sun, 13 Apr 2014, K. C. Mohan wrote: Please, do not top post. > Thank you Steffen, for addressing my problem of migrating old mails > into new mail server. I went through the article you pointed to but > could not succueed. I will appreciate if you could guide me to step by > step process to migrate the mails. My old mail server used 2.x dovecot version. you post very little information: 1) how are the messages storred on the old server, which storage backend do you use, maybe Maildir? 2) the storage backend on the new server? 3) do you care about the message UIDs? 4) How many users do you have (approx.) and can you access the user's mailboxes via IMAP, e.g. using a master user or do you know their password or can you switch to a known password during migration of one particular user? 5) Did you've changed namespaces? - From your first post I figure that the basic mail server functionality of the new server is working, most importantly login, message delivery and retrieval. I have attached both the old and new servers configuration files as .txt attachments. > -----Original Message----- From: Steffen Kaiser > Sent: Thursday, April 10, 2014 6:14 AM > To: K. C. Mohan - Personal s > Cc: <mailto:dovecot@dovecot.org> dovecot(a)dovecot.org > Subject: Re: [Dovecot] integration of old mails into new dovecot > Maildir > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Tue, 8 Apr 2014, K. C. Mohan - Personal wrote: > >> I just installed dovecot 2.2.9 on to a new server and want to >> transfer all the old mails into the email accounts I imported from >> the previous server into MySQL database. I am not able to view the >> subfolders and or old mails that I copied into their respective >> maildir folders. I was very much appreciate if anyone could let me >> know how to import old mails into the new server. All I see, is the >> new mails that have come into the account since I started dovecot service in the new server. > > Check out <http://wiki2.dovecot.org/Migration> http://wiki2.dovecot.org/Migration . Read esp. about > "preserving messages' UIDs". > > If the old server uses Maildir, too, and you don't care about the > UIDs, copy the files over and you are done. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBU0t9r3D1/YhP6VMHAQL21wgAx1GgDwQDWwDMPxbMQ+1vR3i7dsyUk5jm PNmRigoV8qylbn2AuZ1YMxGN2wEZfSl2zi/j2CtSEUX+d9LOf+lvI9V8zXkvSHT6 jYEHwuIQACjPUxWmh7x8XelvQvZHB9PEH56z8eJhkgyVxpae8Rbb1EHurvmxckef O0fdmCIglXJdJJ+B9WZ7JZVsB3M6PFFsllizS17+Hus6O2NeVaszLa7o7bk5XInD m+Co4e4sCVphVlssHRCIRa8Lj6nDC+D6g3RjCR+n0rVREXRbvEcSQPerEAqrZhf8 HB46x3V3n6C2fEu7RNWLB0+DzglHLBI5p9ZqAjJRMr3D9Xy9L5SKlQ== =IH25 -----END PGP SIGNATURE----- --- This email is free from viruses and malware because avast! Antivirus protection is active. <http://www.avast.com> http://www.avast.com --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com

3 2

[Dovecot] About the "nologin" extra field
by Axel Luttgens 14 Apr '14

14 Apr '14

Hello, While experimenting with the "nologin" extra field, I met a possibly overlooked behavior. Let's suppose the user database has those two columns: enabled: the user may/may not login (account active/not active) nologin: NULL if the mailbox is available, '!' if it is currently suspended (for maintenance reasons) The password_query: password_query = SELECT password, nologin, 'Maintenance' || nologin AS reason, [...] FROM [...] WHERE [...] AND enabled [...] Let's then experiment with pop connections. With: enabled set to false, nologin set to '!' the right password provided, following reply is emitted after an authentication failure delay: -ERR [AUTH] Authentication failed. So, as expected, the nologin value behaves as a "don't care" one. With: enabled set to true, nologin set to '!', the right password provided, following output is immediately emitted: -ERR [AUTH] Maintenance! Again, this is the kind of behavior I was expecting. With: enabled set to true, nologin set to '!', an incorrect password provided, there's the failure delay but the output still is: -ERR [AUTH] Maintenance! Here, I'm a bit dubitative... ;-) The delay seems to make the code's intent clear: to act as in the case of an authentication failure. But, notwithstanding the somewhat misleading explanation provided to a legitimate user with such a reply, isn't one unduly disclosing information about an account existence? Is this supposed to behave that way? If yes, what's the rationale? TIA, Axel

1 0

[Dovecot] POP3: Panic: Trying to allocate 0 bytes
by Urban Loesch 14 Apr '14

14 Apr '14

Hi, today I upgraded one of our dovecot servers from 2.117 to version 2.2.12 under Debian Squeeze. After the upgrade I got many of the following errors for pop3 users. My logfile shows: ... Apr 14 09:28:05 mailstore dovecot: pop3(user(a)domain.net pid:39688 session:<o1DTn/v2IABPNmv7>): Panic: Trying to allocate 0 bytes Apr 14 09:28:05 mailstore dovecot: pop3(user(a)domain.net pid:39688 session:<o1DTn/v2IABPNmv7>): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x6bb0a) [0x7f1ae9a18b0a] -> /usr/lib/dovecot/libdovecot. so.0(+0x6bb86) [0x7f1ae9a18b86] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f1ae99d1e8f] -> /usr/lib/dovecot/libdovecot.so.0(+0x8148b) [0x7f1ae9a2e48b] -> dovecot/pop3() [0x4077f0] -> dovecot/pop3(client_command_execute+0x9d) [0x4 07d0d] -> dovecot/pop3(client_handle_input+0x80) [0x405810] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4e) [0x7f1ae9a28d2e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xaf) [0x7f1ae9a29e9f] -> /usr/lib/do vecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f1ae9a28db9] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f1ae9a28e38] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f1ae99d6c43] -> dovecot/pop3(main+0x2 57) [0x404a67] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f1ae9669c8d] -> dovecot/pop3() [0x4045b9] Apr 14 09:28:05 mailstore dovecot: pop3(user(a)domain.net pid:39688 session:<o1DTn/v2IABPNmv7>): Fatal: master: service(pop3): child 39688 killed with signal 6 (core dumps disabled) .... Have you any idea what the error could be? As this is a production server I switched back to version 2.1.17. Many thanks Urban Loesch doveconf -n: # 2.2.12 (978871ca81e7): /etc/dovecot/dovecot.conf # OS: Linux 3.4.67-vs2.3.3.9-rol-em64t-efigpt x86_64 Debian 6.0.9 ext4 auth_cache_negative_ttl = 0 auth_cache_size = 40 M auth_cache_ttl = 1 weeks auth_mechanisms = plain login auth_verbose = yes deliver_log_format = msgid=%m: %$ %p %w disable_plaintext_auth = no login_trusted_networks = $INTERNAL_IPS mail_gid = mailstore mail_location = mdbox:/home/vmail/%d/%n:INDEX=/home/dovecotindex/%d/%n mail_log_prefix = "%s(%u pid:%p session:<%{session}>): " mail_plugins = " quota mail_log notify zlib" mail_uid = mailstore managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify mdbox_rotate_size = 10 M namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Items" { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql-account.conf driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size from mail_log_group_events = no quota = dict:Storage used::file:%h/dovecot-quota quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_max_redirects = 10 zlib_save = gz zlib_save_level = 9 } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = mailstore mode = 0660 user = root } } service imap-login { inet_listener imap { port = 143 } process_limit = 256 process_min_avail = 25 service_count = 1 } service imap { process_limit = 256 process_min_avail = 25 service_count = 1 } service lmtp { inet_listener lmtp { address = * port = 24 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service pop3-login { inet_listener pop3 { port = 110 } process_limit = 256 process_min_avail = 25 service_count = 1 } service pop3 { process_limit = 256 process_min_avail = 25 service_count = 1 } service quota-warning { executable = script /usr/local/rol/dovecot/quota-warning.sh unix_listener quota-warning { user = mailstore } user = mailstore } ssl = no ssl_cert = </etc/dovecot/certs/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql-account.conf driver = sql } protocol lmtp { mail_fsync = optimized mail_plugins = " quota mail_log notify zlib sieve zlib" } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep imap_id_log = * imap_logout_format = bytes=%i/%o session=<%{session}> mail_max_userip_connections = 40 mail_plugins = " quota mail_log notify zlib imap_quota imap_zlib" } protocol pop3 { mail_plugins = " quota mail_log notify zlib" pop3_logout_format = bytes_sent=%o top=%t/%p, retr=%r/%b, del=%d/%m, size=%s uidl_hash=%u session=<%{session}> pop3_reuse_xuidl = yes }

1 0

[Dovecot] Feature Request: handle mail connections of the same user from a same IP using just one mail process
by morrison 14 Apr '14

14 Apr '14

Hi, Dovecot Wiki states that mail process (IMAP/POP3) is able to handle multiple client connections as the same time to save CPU and memory resources (client_limit > 1). Although this approach is not recommended due to latency and probably security issues, it does help increase the overall capacity of a mail server. Is it possible (or planned) to add a feature such that mail client connections of the same user from a same IP are directed to a same mail process? In most cases, such connections come from a same mail client (e.g. in Thunderbird, each mailbox is a connection). The end user (human being) can work on one mailbox at a time, the latency will be non-obvious. And since all data being processed belong to the same user, security is a non-issue. Thanks,

3 2

Re: [Dovecot] integration of old mails into new dovecot Maildir
by K. C. Mohan 14 Apr '14

14 Apr '14

Thank you Steffen, for addressing my problem of migrating old mails into new mail server. I went through the article you pointed to but could not succueed. I will appreciate if you could guide me to step by step process to migrate the mails. My old mail server used 2.x dovecot version. K. C. Mohan -----Original Message----- From: Steffen Kaiser Sent: Thursday, April 10, 2014 6:14 AM To: K. C. Mohan - Personal s Cc: dovecot(a)dovecot.org Subject: Re: [Dovecot] integration of old mails into new dovecot Maildir -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 8 Apr 2014, K. C. Mohan - Personal wrote: > I just installed dovecot 2.2.9 on to a new server and want to transfer all > the old mails into the email accounts I imported from the previous server > into MySQL database. I am not able to view the subfolders and or old mails > that I copied into their respective maildir folders. I was very much > appreciate if anyone could let me know how to import old mails into the > new > server. All I see, is the new mails that have come into the account since > I > started dovecot service in the new server. Check out http://wiki2.dovecot.org/Migration . Read esp. about "preserving messages' UIDs". If the old server uses Maildir, too, and you don't care about the UIDs, copy the files over and you are done. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBU0Zu/3D1/YhP6VMHAQKO0QgA7v5CowgoagbvEC3S0XI3k3QUHlsUczLE 38MedNzPw8cc69OHwzWxfxDiuCU2g2Q+Bv1vKMp+7aY2e9nCwUKcT0tOZGf7Nxrw IDG5dJbRtQSwTSOOvHSj1/SLY/tbYB71NkAPZl3XunFKcbkGl2BYKDfj+BuZ+WMZ pDj6B9S8GuV7BJNWlP4fRaHyrGDwfYuUmj1bTEoNuAFFPW11HfAwxRUQgnOKU9GJ zxERX2Tg7+Xj/RM49InQd8qqczYjsNte6M58a+6dwStGkPK4y0XD8nwsH8r4skvN utKKG+dRln+94oVnSG8WNNKpVmZt8K9oNHWq1CxVRIoqu2tUmppr0g== =qQnO -----END PGP SIGNATURE-----

2 1

[Dovecot] FTS autoindex username problem
by 李耀宗 13 Apr '14

13 Apr '14

I tried to set up Solr search server according to http://wiki2.dovecot.org/Plugins/FTS/Solr, and turned on autoindexing according to http://wiki2.dovecot.org/Plugins/FTS, but I found a strange behaviour that cause server search missing some emails. Here is the login information of my mail server: login name: user1 email: user1(a)example.com Now, when I turned on autoindexing, all autoindexed email are indexed using user1(a)example.com as username key, as shown in maillog: dovecot: [ID 12345 mail.info] indexer-worker(user1(a)example.com): Indexed 1 messages in INBOX But when I triggered on-demand indexing using IMAP server search, the emails are indexed using user1 as username key instead, as shown in maillog: dovecot: [ID 12345 mail.info] indexer-worker(user1): Indexed 1799 messages in INBOX Only the emails indexed using user1 can be searched, emails indexed using user1(a)example.com cannot be found. How can I configure autoindex to index email using user1 as username key? --- (Below is a follow-up question) In my mail server config, there are a few virtual mailbox users are using the following login information instead (different auth/password backend): login name: user2(a)virtmail.example.com email: user2(a)virtmail.example.com In this case, how can I distinguish user1(a)example.com and user2(a)virtmail.example.com, so that emails for user1(a)example.com can be indexed using user1 as username key, while user2(a)virtmail.example.com can be indexed using user2(a)virtmail.example.com as username key? .

2 2

[Dovecot] Still no messages from dovecot
by Steve Campbell 12 Apr '14

12 Apr '14

I'm still not seeing emails from the list. With help from others, I thought I had the IPs cleared since the change back in February, but apparently not. Can someone PM me and let me know what outgoing IP addresses the list is using please? steve campbell

2 1

[Dovecot] Will upgrade from from db4 to libdb break anything?
by A M 11 Apr '14

11 Apr '14

Hello, I just have a minor question. (Using Fedora 16) My current dovecot (2.2.10) was compiled with db4 (4.8.30). I am thinking of recompiling same dovecot (2.2.10) with libdb (5.2.36). I will be trying on live server so just wanted to know if this will this break any indexing or anything else? (Recompiling for Heartbleed, so might as well switch db version) AM.

1 0

[Dovecot] FTS autoindex username problem
by lee_yiu_chung＠yahoo.com 11 Apr '14

11 Apr '14

I tried to set up Solr search server according to http://wiki2.dovecot.org/Plugins/FTS/Solr, and turned on autoindexing according to http://wiki2.dovecot.org/Plugins/FTS, but I found a strange behaviour that cause server search missing some emails. Here is the login information of my mail server: version: 2.2.12 login name: user1 email: user1(a)example.com Now, when I turned on autoindexing, all autoindexed email are indexed using user1(a)example.com as username key, as shown in maillog: dovecot: [ID 12345 mail.info] indexer-worker(user1(a)example.com): Indexed 1 messages in INBOX But when I triggered on-demand indexing using IMAP server search, the emails are indexed using user1 as username key instead, as shown in maillog: dovecot: [ID 12345 mail.info] indexer-worker(user1): Indexed 1799 messages in INBOX Only the emails indexed using user1 can be searched, emails indexed using user1(a)example.com cannot be found. How can I configure autoindex to index email using user1 as username key? --- (Below is a follow-up question) In my mail server config, there are a few virtual mailbox users are using the following login information instead (different auth/password backend): login name: user2(a)virtmail.example.com email: user2(a)virtmail.example.com In this case, how can I distinguish user1(a)example.com and user2(a)virtmail.example.com, so that emails for user1(a)example.com can be indexed using user1 as username key, while user2(a)virtmail.example.com can be indexed using user2(a)virtmail.example.com as username key?

1 0

[Dovecot] FTS autoindex username problem
by lee_yiu_chung＠yahoo.com 11 Apr '14

11 Apr '14

I tried to set up Solr search server according to http://wiki2.dovecot.org/Plugins/FTS/Solr, and turned on autoindexing according to http://wiki2.dovecot.org/Plugins/FTS, but I found a strange behaviour that cause server search missing some emails. Here is the login information of my mail server: login name: user1 email: user1(a)example.com Now, when I turned on autoindexing, all autoindexed email are indexed using user1(a)example.com as username key, as shown in maillog: dovecot: [ID 12345 mail.info] indexer-worker(user1(a)example.com): Indexed 1 messages in INBOX But when I triggered on-demand indexing using IMAP server search, the emails are indexed using user1 as username key instead, as shown in maillog: dovecot: [ID 12345 mail.info] indexer-worker(user1): Indexed 1799 messages in INBOX Only the emails indexed using user1 can be searched, emails indexed using user1(a)example.com cannot be found. How can I configure autoindex to index email using user1 as username key? --- (Below is a follow-up question) In my mail server config, there are a few virtual mailbox users are using the following login information instead (different auth/password backend): login name: user2(a)virtmail.example.com email: user2(a)virtmail.example.com In this case, how can I distinguish user1(a)example.com and user2(a)virtmail.example.com, so that emails for user1(a)example.com can be indexed using user1 as username key, while user2(a)virtmail.example.com can be indexed using user2(a)virtmail.example.com as username key?

1 0

[Dovecot] FTS autoindex username problem
by lee_yiu_chung＠yahoo.com 11 Apr '14

11 Apr '14

I tried to set up Solr search server according to http://wiki2.dovecot.org/Plugins/FTS/Solr, and turned on autoindexing according to http://wiki2.dovecot.org/Plugins/FTS, but I found a strange behaviour that cause server search missing some emails. Here is the login information of my mail server: login name: user1 email: user1(a)example.com Now, when I turned on autoindexing, all autoindexed email are indexed using user1(a)example.com as username key, as shown in maillog: dovecot: [ID 12345 mail.info] indexer-worker(user1(a)example.com): Indexed 1 messages in INBOX But when I triggered on-demand indexing using IMAP server search, the emails are indexed using user1 as username key instead, as shown in maillog: dovecot: [ID 12345 mail.info] indexer-worker(user1): Indexed 1799 messages in INBOX Only the emails indexed using user1 can be searched, emails indexed using user1(a)example.com cannot be found. How can I configure autoindex to index email using user1 as username key? --- (Below is a follow-up question) In my mail server config, there are a few virtual mailbox users are using the following login information instead (different auth/password backend): login name: user2(a)virtmail.example.com email: user2(a)virtmail.example.com In this case, how can I distinguish user1(a)example.com and user2(a)virtmail.example.com, so that emails for user1(a)example.com can be indexed using user1 as username key, while user2(a)virtmail.example.com can be indexed using user2(a)virtmail.example.com as username key?

1 0

Re: [Dovecot] replication + attachment sis + zlib bug ? (HEAD version from xi.rename-it.nl)
by Pavel Stano 11 Apr '14

11 Apr '14

Yes, exactly. I look at the code and find out there is functionality for that. Dovecot store attachments in base64 format without decoding if there are longer lines with more base64 blocks (4chars). So these attachments get deduplicated but are not decoded. But it don't work if last line is buggy. I think i fixed it. It looks like it works, but i test only one mailbox. Patch attached On Fri, 11 Apr 2014 09:29:53 +0200 Gilles Chauvin <gilles.chauvin(a)univ-rouen.fr> wrote: > On 10/04/2014 18:21, Pavel Stano wrote: > > Hi, > > > > yes its the same problem. > > I can confirm that it is caused by last line in base64 > > attachment which is longer than 72 chars in original message. > > > > > > Hi, > > I don't know what is the current status for this issue since Timo > never responded to my two mails. A safe way to workaround this > problem could be Dovecot skipping deduplication when it encounters a > malformed base64 attachment ? > > > > Regards, > Gilles. -- [ Ohodnotte kvalitu mailu: http://nicereply.com/websupport/Stano/ ] Pavel Stano | Troubleshooter http://WebSupport.sk *** BERTE A VYCHUTNAVAJTE ***

1 0

[Dovecot] FTS autoindex problem
by lee_yiu_chung＠yahoo.com 11 Apr '14

11 Apr '14

I tried to implement a solr search server, but I found some unexpected behaviour when I turn on autoindex according to http://wiki2.dovecot.org/Plugins/FTS. I found that all autoindexed email are using "user1(a)example.com" as username, as shown in maillog: indexer-worker(user1(a)example.com): Indexed 1 messages in INBOX However, all manually indexed email (triggered by IMAP server search) are using "user1" as username, as shown in maillog: indexer-worker(user1): Indexed 2927 messages in INBOX. I am using "user1" as login name, so all autoindexed mails don't appear in search result. How can I use "user" as the username in autoindex? BTW, I do have a few mailboxes in the format user2(a)virtualmail.example.com, which requires full email address as the login name. How can I autoindex emails that automatically distinguishes user1(a)example.com (using "user1" as username) and user2(a)virtualmail.example.com (using "user2(a)virtualmail.example.com" as username) given that the previous question is solved?

1 0

[Dovecot] FTS autoindex problem
by lee_yiu_chung＠yahoo.com 11 Apr '14

11 Apr '14

I tried to implement a solr search server, but I found some unexpected behaviour when I turn on autoindex according to http://wiki2.dovecot.org/Plugins/FTS. I found that all autoindexed email are using "user1(a)example.com" as username, as shown in maillog: indexer-worker(user1(a)example.com): Indexed 1 messages in INBOX However, all manually indexed email (triggered by IMAP server search) are using "user1" as username, as shown in maillog: indexer-worker(user1): Indexed 2927 messages in INBOX. I am using "user1" as login name, so all autoindexed mails don't appear in search result. How can I use "user" as the username in autoindex? BTW, I do have a few mailboxes in the format user2(a)virtualmail.example.com, which requires full email address as the login name. How can I autoindex emails that automatically distinguishes user1(a)example.com (using "user1" as username) and user2(a)virtualmail.example.com (using "user2(a)virtualmail.example.com" as username) given that the previous question is solved?

1 0

[Dovecot] Dovecot XAPPLEPUSHSERVICE Apple
by Volker Schwaberow 10 Apr '14

10 Apr '14

Hello list. Anybody having experience with the Apple Extensions for Dovecot at http://www.opensource.apple.com/source/dovecot/dovecot-239.8/dovecot/src/im… ? Is it possible to patch the Dovecot source with them and get them to work on a Non-Apple System? Cheers, Volker —— Volker Schwaberow Email: volker(a)schwaberow.de

3 2

[Dovecot] replication + attachment sis + zlib bug ? (HEAD version from xi.rename-it.nl)
by Pavel Stano 10 Apr '14

10 Apr '14

Hi, i have setup with mail_attachment single instance store + replication + zlib and got this bug when i try to replicate one test mailbox: On master1 in mail.log: Apr 10 13:25:22 master1 dovecot: dsync-local(zzz(a)blabla666.sk): Error: read(/nfsmnt/mailnfs1/attachments1/6b/57/6b57ad34cf6c414662233d833a7801fde4e1cdcb-92b5052558774653a728000013e2b982[base64:18 b/l]) failed: Stream is larger than expected (97824 > 97823, eof=1) Apr 10 13:25:22 master1 dovecot: dsync-local(zzz(a)blabla666.sk): Error: dsync(master2): read(attachments-connector(zlib(/nfsmnt/mailnfs1/b/l/blabla666.sk/zzz(a)blabla666.sk/mdbox/storage/m.9))) failed: read(/nfsmnt/mailnfs1/attachments1/6b/57/6b57ad34cf6c414662233d833a7801fde4e1cdcb-92b5052558774653a728000013e2b982[base64:18 b/l]) failed: Stream is larger than expected (97824 > 97823, eof=1) This is on master2 in mail.log Apr 10 13:32:21 master2 dovecot: dsync-server(zzz(a)blabla666.sk): Error: dsync(master1): read() failed: read(10.10.30.2) failed: dot-input stream ends without '.' line I tried to rm -Rf mailbox on master2 and run on master1 doveadm replicator remove zzz(a)blabla666.sk doveadm replicator replicate zzz(a)blabla666.sk but same problem happen. Thanks -- [ Ohodnotte kvalitu mailu: http://nicereply.com/websupport/Stano/ ] Pavel Stano | Troubleshooter http://WebSupport.sk *** BERTE A VYCHUTNAVAJTE ***

2 2

[Dovecot] dsync deleted my mailbox - what did I do wrong?
by Benjamin Podszun 10 Apr '14

10 Apr '14

Hi. Mostly annoying: I migrated from one machine to another, made sure the target host worked as expected, updated mx records and - after a couple of days - signed it off as good. This is just my private machine, no big deal if something goes wrong.. Everything's fine? Good, let's migrate my inbox from the old machine. There's no direct connectivity between those servers, so what I did was: (old server) sudo -u vmail dsync -u dar(a)darklajid.de backup maildir:/tmp/mail_backup/ Works fine, got my maildir. Tar'd it up, moved it to the new server. Now how do I import those mails? Ah, let's use the same command, with -R? (new server) sudo -u vmail dsync -u dar(a)darklajid.de -R backup maildir:/tmp/mail_backup Error: Mailbox INBOX sync: mailbox_delete failed: INBOX can't be deleted. Wait. What? Sure enough, the last couple of days are gone, the target mailbox is completely empty. I read the man page over and over again, but failed to see the problem. I even thought for a moment that _maybe_ dsync backup is one-way only (even if that failed as well) and tried the same command with mirror. Exactly the same output, same result, empty target mailbox. In the end I succeeded to import the mails with doveadm import, completely lost a number of days of mails. My fault, sloppy not to back the up again, but I still don't think that this should happen. Ever. My question now is: - where did I fail (ignoring the backups, please. That's .. something I know) - Can I use dsync ... for backups? I don't think that this is a good idea after yesterday night? - Should dsync EVER try to delete mailboxes? Even 'special' mailboxes? Should it warn about that, asking for a --force switch or something? Any insights would be appreciated. At this point the damage is done, but I'd like to learn how to do better. Ben

4 9

[Dovecot] integration of old mails into new dovecot Maildir
by K. C. Mohan - Personal 10 Apr '14

10 Apr '14

I just installed dovecot 2.2.9 on to a new server and want to transfer all the old mails into the email accounts I imported from the previous server into MySQL database. I am not able to view the subfolders and or old mails that I copied into their respective maildir folders. I was very much appreciate if anyone could let me know how to import old mails into the new server. All I see, is the new mails that have come into the account since I started dovecot service in the new server. --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com

2 1

[Dovecot] IMAP, POP, LMTP response time
by adarshvs 10 Apr '14

10 Apr '14

Hi, How do I retrieve the /response time/ metrics for imap, pop, lmtp and smtp. Any suggestions will be very helpful. Thank you. -- View this message in context: http://dovecot.2317879.n4.nabble.com/IMAP-POP-LMTP-response-time-tp47500.ht… Sent from the Dovecot mailing list archive at Nabble.com.

2 1

[Dovecot] Heartbleed openssl vulnerability?
by John Rowe 10 Apr '14

10 Apr '14

Do we know if dovecot is vulnerable to the heartbleed SSL problem? I'm running dovecot-2.0.9 and openssl-1.01, the latter being intrinsically vulnerable. An on-line tool says that my machine is not affected on port 993 but it would be nice to know for sure if we were vulnerable for a while. (Naturally I've blocked it anyway!). Thanks John

9 20

[Dovecot] Director NFS backups
by Murray Trainer 10 Apr '14

10 Apr '14

Hi All, What is the recommended method of taking backups of user mailboxes when using the Director setup with NFS backend mail storage? Is there any way to avoid the likely NFS locking issues by backing up the filesystem directly or do I have to do some sort of dsync method. If I have to use dsync can I dsync the mailboxes to compressed copies of the mailboxes without requiring another dovecot server to do the dsync. Thanks for you responses. Murray

1 0

Re: [Dovecot] POP3 sessions
by Joseph Tam 10 Apr '14

10 Apr '14

<doctor(a)doctor.nl2k.ab.ca> writes: > Is their a way in the config file to not lock > POP3 sessions in dovecot for only 1 user? That ought to be the default: http://wiki2.dovecot.org/POP3Server (Section Session locking) Did you set pop3_lock_session=yes somewhere? Locking is good if the client connection is stable: if you disable locking, you could end up with a scrambled mailbox as two or more users access it at the same time. Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] Error: broken sync positions in index file
by Alejandro Angelico 10 Apr '14

10 Apr '14

Hi everybody, I'm runing dovecot 2.2.12 and a user mailbox got the "broken sync positions in index file" error twice in the last 20 days. this is an extract from the maillog maillog First Error -------------------- Mar 23 16:13:25 andromeda dovecot: pop3-login: Login: user=<myuser(a)mydomain.com>, method=PLAIN, rip=187.237.107.24, lip=207.7.90.83, mpid=3983, session=<5KSEbU310wC77WsY> Mar 23 16:13:27 andromeda dovecot: pop3(myuser(a)mydomain.com): Error: broken sync positions in index file /home/myuser/mail/mydomain.com/myuser/dovecot.index Mar 23 16:13:27 andromeda dovecot: pop3(myuser(a)mydomain.com): Warning: fscking index file /home/myuser/mail/mydomain.com/myuser/dovecot.index Mar 23 16:13:27 andromeda dovecot: pop3(myuser(a)mydomain.com): Error: Fixed index file /home/myuser/mail/mydomain.com/myuser/dovecot.index: log_file_tail_offset 164 -> 144 Mar 23 16:13:27 andromeda dovecot: pop3(myuser(a)mydomain.com): Panic: file mail-transaction-log.c: line 350 (mail_transaction_log_set_mailbox_sync_pos): assertion failed: (file_offset >= log->head->saved_tail_offset) Mar 23 16:13:27 andromeda dovecot: pop3(myuser(a)mydomain.com): Fatal: master: service(pop3): child 3983 killed with signal 6 (core dumps disabled) Mar 23 16:13:27 andromeda dovecot: pop3: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0xb7e59350] -> /usr/lib/dovecot/libdovecot.so.0 [0xb7e593cd] -> /usr/lib/dovecot/libdovecot.so.0 [0xb7e58c64] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_set_mailbox_sync_pos+0x9a) [0xb7f8c1aa] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_commit+0x9c) [0xb7f82a5c] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0xb7f00f2b] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0xb7f0034a] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0xb7f006ba] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_storage_sync_init+0xc1) [0xb7f00851] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x39) [0xb7f33b79] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x3d) [0xb7f365ad] -> dovecot/pop3(client_create+0x2e2) [0x804c5e2] -> dovecot/pop3 [0x804afec] -> dovecot/pop3 [0x804b607] -> /usr/lib/dovecot/libdovecot.so.0 [0xb7e1033a] -> /usr/lib/dovecot/libdovecot.so.0 [0xb7e10622] -> /usr/li maillog Second Error -------------------- Apr 9 17:22:00 andromeda dovecot: imap-login: Login: user=<myuser(a)mydomain.com>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=29811, secured, session=<ZteFh6P2uAB/AAAB> Apr 9 17:22:00 andromeda dovecot: imap(myuser(a)mydomain.com): Error: Transaction log file /home/myuser/mail/mydomain.com/myuser/dovecot.index.log seq 4: log_file_tail_offset update shrank it (284 vs 420 sync_offset=268) Apr 9 17:22:00 andromeda dovecot: imap(myuser(a)mydomain.com): Error: broken sync positions in index file /home/myuser/mail/mydomain.com/myuser/dovecot.index Apr 9 17:22:00 andromeda dovecot: imap(myuser(a)mydomain.com): Warning: fscking index file /home/myuser/mail/mydomain.com/myuser/dovecot.index Apr 9 17:22:00 andromeda dovecot: imap(myuser(a)mydomain.com): Error: Fixed index file /home/myuser/mail/mydomain.com/myuser/dovecot.index: log_file_tail_offset 420 -> 284 Apr 9 17:22:00 andromeda dovecot: imap(myuser(a)mydomain.com): Panic: file mail-transaction-log.c: line 350 (mail_transaction_log_set_mailbox_sync_pos): assertion failed: (file_offset >= log->head->saved_tail_offset) Apr 9 17:22:00 andromeda dovecot: imap(myuser(a)mydomain.com): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0xb7d9ae4f] -> /usr/lib/dovecot/libdovecot.so.0 [0xb7d9aecd] -> /usr/lib/dovecot/libdovecot.so.0 [0xb7d9a744] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_set_mailbox_sync_pos+0x9a) [0xb7ecf60a] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_commit+0x9c) [0xb7ec5e5c] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0xb7e43f8b] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0xb7e433aa] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0xb7e4371a] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_storage_sync_init+0xc1) [0xb7e438b1] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x39) [0xb7e76d19] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x3d) [0xb7e7974d] -> dovecot/imap(cmd_select_full+0x23e) [0x805721e] -> dovecot/imap(cmd_select+0x19) [0x8057bf9] -> dovecot/imap(command_exec+0x33) [0x805c9a3] -> dovecot/imap [0x805b6df] -> dove Apr 9 17:22:00 andromeda dovecot: imap(myuser(a)mydomain.com): Fatal: master: service(imap): child 29811 killed with signal 6 (core dumps disabled) Deleting dovecot.index.* files solved the problem both times, but I'm wondering if something is wrong because it's always the same mailbox. Before deleting dovecot.index I run doveadm with this oputput: root@myserver [/home/myuser/mail/.myuser@mydomain_com]# doveadm index -u myuser INBOX doveadm(myuser): Fatal: User doesn't exist root@myserver [/home/myuser/mail/.myuser@mydomain_com]# doveadm index -u myuser(a)mydomain.com INBOX doveadm(myuser(a)mydomain.com): Error: Transaction log file /home/myuser/mail/mydomain.com/myuser/dovecot.index.log seq 4: log_file_tail_offset update shrank it (284 vs 420 sync_offset=268) doveadm(myuser(a)mydomain.com): Error: broken sync positions in index file /home/myuser/mail/mydomain.com/myuser/dovecot.index doveadm(myuser(a)mydomain.com): Warning: fscking index file /home/myuser/mail/mydomain.com/myuser/dovecot.index doveadm(myuser(a)mydomain.com): Error: Fixed index file /home/myuser/mail/mydomain.com/myuser/dovecot.index: log_file_tail_offset 420 -> 284 doveadm(myuser(a)mydomain.com): Panic: file mail-transaction-log.c: line 350 (mail_transaction_log_set_mailbox_sync_pos): assertion failed: (file_offset >= log->head->saved_tail_offset) doveadm(myuser(a)mydomain.com): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0xb7d35e4f] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x43) [0xb7d35f63] -> /usr/lib/dovecot/libdovecot.so.0 [0xb7d35744] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_set_mailbox_sync_pos+0x9a) [0xb7e6a60a] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_commit+0x9c) [0xb7e60e5c] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0xb7ddef8b] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0xb7dde3aa] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0xb7dde71a] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_storage_sync_init+0xc1) [0xb7dde8b1] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x39) [0xb7e11d19] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x3d) [0xb7e1474d] -> doveadm [0x80595db] -> doveadm [0x80558de] -> doveadm(doveadm_mail_try_run+0x293) [0x8055d03] -> doveadm(main+0x3bd) [0x805eb5d] -> /lib/libc.so.6(__libc_start_main+0xdc) [0xb7b89ebc] -> doveadm [0x8055061] Aborted Is there anything else I should try? or just wait to see if this happens again? the mailbox is not very big, around 38Mb in 84 mails. Thanks! Alex

1 0

[Dovecot] Override maildir for just a few users
by Charles Marcus 10 Apr '14

10 Apr '14

Hi all, Currently, I have mail_location = maildir:~/Maildir set and all passdb and userdb lookups are SQL based (doveconf -n pasted below). However, I want to override the users maildir location - and *only* the maildir location - for just a few users. I was thinking the easiest way would be to add a simple flat file based userdb that is checked before the SQL based one, where I can define a different maildir for these users. So, basically, dovecot checks the flat file first, and if the user isn't found, falls back to SQL. I still want all AUTH to go through SQL... It seems like this should be fairly simple, but after reading the wiki for a few days, I'm just not sure... This is on a production box, so I have to be careful (note to self - MUST set up testing box for things like this)... Is anyone else doing anything like this, and if so would you be willing to share sanitized configs? Thx, -- Best regards, Charles

3 2

[Dovecot] Sieve (randomly?) flagging messages as \\Seen \\Deleted
by Emanuele Balla (aka Skull) 09 Apr '14

09 Apr '14

Hi, I'm trying to debug (without great results, so far) a very weird behaviour in my environment. Sorry if this came out in another form before, but I've not been able to find out anything resembling what I'm experiencing, so far... OS is a debian wheezy and dovecot is the version provided by the OS: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 The system uses postfix with virtual users, credentials and maildir locations stored on mysql, local delivery through LMTP and sieve+managesieve available to users (although managesieve only listens on localhost and is only usable through the webmail interface). FWIW, I've been running 10-20 systems just like this one (mostly with earlier dovecot versions and using LDA when LMTP wasn't available yet) for many years, and this is the very first time I'm so puzzled I end up searching for help here :-| Even though the system has been working for months (more or less 1 year now) without big changes, a strange behaviour appeared (or became evident enough to be noticed) in the last few days, apparently involving sieve and some sort of "default/hidden" action triggered by something. Or at least that's what I ended up supposing. The problem in short: Messages I expected to find in certain folders were simply not there, although sieve logs reported them as delivered in those same folders. By manually inspecting the maildir, I actually found the messages, but they were all flagged as \\Seen + \\Deleted and therefore not displayed by the MUA (ThunderBird in my case). I initially supposed this to be a TB issue, 'cause nothing in my sieve script ever flags messages that way, but I could not find anything on my client explaining that. Then I received a notification from one of my users saying he was experiencing exactly the same, except he's using mutt as IMAP client; that restricted the issue to server-side interactions only, but nothing useful could be found in logfiles... This is the "relevant" portion of a "dovecot -n" output: [...] plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +vacation-seconds +editheader sieve_vacation_default_period = 2d sieve_vacation_dont_check_recipient = yes sieve_vacation_max_period = 30d sieve_vacation_min_period = 2s sieve_vacation_use_original_recipient = no } [...] protocol lmtp { mail_plugins = sieve hostname = alternativename.bofhland.org } There is no sieve_(before|after) script in addition to what users create for themselves. The mailboxes are relatively low-traffic; most of the traffic is caused by a single role address translated into multiple-recipients alias going to many of the users (100-300 messages per day). Almost all the users using sieve rely on it to store traffic for that role-address in a dedicated folder, including the mutt user and myself. Not that's all that important, but means that most of the misbehaviours observed (but not all) are observed in these folders. I enabled mail_debug, but there's nothing unusual in there AFAICT: it just says: - using the following location for user's Sieve script: /blabla/.dovecot.sieve - opening script /blabla/.dovecot.sieve - script binary /blabla/.dovecot.svbin successfully loaded - not saving binary /blabla/.dovecot.svbin, because it is already stored - executing script from /blabla/.dovecot.svbin - stored mail into mailbox 'DedicatedFolder' And it does, except the message happens to be flagged as seen and deleted... In order to try restricting what may be causing the issue, I added... removeflag "\\Deleted"; removeflag "\\Seen"; ...to the rule sending messages to the dedicated folder cited above for my mailbox. The problem apparently disappeared for me as long as I kept those in place. This should mean (I suppose) that the decision of flagging messages that way is taken before the users' sieve scripts are applied (sort of "hidden sieve_before"). The problem is hard to replicate as it's apparently not deterministic: the same message is being flagged for one user but not for the other, different messages between the same people and with the same thread are sometimes flagged and sometimes not. Something is surely triggering whatever is causing this, but it's not evident enough for me to point a finger and say "ha ha!" (https://www.youtube.com/watch?v=rX7wtNOkuHo) So, a question for people knowing pigeonhole's internals: does it ever choose to mark messages as described above for any reason? If yes, I may be triggering this behavior with something I recently added/modified, and at least I'll have something to focus my investigation on. :-| Any other suggestion is obviously welcome...

3 6

[Dovecot] sieve pigeonhole vacation filter responding when recipient is not explicitly listed
by Milan Cvetkovic 09 Apr '14

09 Apr '14

Hi dovecot.org, When I set up vacation filter for a mailbox, the vacation response is generated even though none of the addresses in the email are same as the mailbox address itself. I have example email sent to "aliastouser(a)mpathix.com" which gets delivered to "user(a)my.domain.com" by dovecot-lda. The invocation command is: # /usr/lib/dovecot/dovecot-lda \ -d user \ -f john.doe(a)somewhere.com \ -a aliastouser(a)mpathix.com \ -p /tmp/test.email # cat /tmp/test.email Message-ID: <test3> From: John Doe <john(a)somewhere.com> To: aliastouser(a)mpathix.com Subject: test3 vacation response as aliastouser This is the only line in test.email. Here is the vacation filter: if true { vacation :days 1 :addresses ["user(a)my.domain.com"] text: Please ignore this message, I am only testing vacation filter . ; } /var/log/mail.log shows that sieve vacation sends vacation, (and after succeeding attempts, discards due to already sent address) Apr 9 13:37:21 mx01 dovecot: lda(user): sieve: <test3>: sent vacation response to <john(a)somewhere.com> Apr 9 13:37:21 mx01 dovecot: lda(user): sieve: msgid=<test3>: stored mail into mailbox 'INBOX' ... Apr 9 13:40:15 mx01 dovecot: lda(user): sieve: msgid=<test3>: discarded duplicate vacation response to <john(a)somewhere.com> Apr 9 13:40:15 mx01 dovecot: lda(user): sieve: msgid=<test3>: stored mail into mailbox 'INBOX' Attached is the doveconf -n output. Any help is appreciated. Milan.

2 2

[Dovecot] Prevent sieve redirects to external domains
by adarshvs 09 Apr '14

09 Apr '14

Hi, Is there any way to disable sieve forwards to all domains except one. Users should be able to forward their mails to only one specific domain. If not then any idea on how this feature can be implemented ??. -- View this message in context: http://dovecot.2317879.n4.nabble.com/Prevent-sieve-redirects-to-external-do… Sent from the Dovecot mailing list archive at Nabble.com.

2 1

Re: [Dovecot] Heartbleed openssl vulnerability?
by Jake Alley 09 Apr '14

09 Apr '14

It's an interesting issue. In my experience "stale" passwords are rarely used to compromise systems. However, passwords tend to end up on sticky notes and even worse, in email databases regardless. As far as compromised email passwords, they seem to mostly come from infected clients and insecure public logins as far as I can tell. A server can control the later, but not the former. I know of a major accounting software that forces Admin users to change their passwords every few months under certain circumstances. Those passwords always end up in emails to fellow users, so in that case forcing people to change seems to be definitely counterproductive. IMV the moral of the story is that you can't crypt your way into a 100% secure world. You need other forms of checks & reconciliations that are disjoint from purely cryptographic infrastructure. For instance ask Mt. Gox and Bitcoin if they agree in hindsight, and Heartbleed is a very good example of this concept. Thanks, Jake On 4/9/2014 10:27 AM, Reindl Harald wrote: "change passwords from time to time is always clever" is a strawmans argument with no context to the issue, forcing people to change their passwords all the time for no good reasons leads mostly to completly insecured passwords to remember them easier or have them on a sticky on the screen or under the keyboard the word "counterproductive" describes that policies perfectly

1 0

[Dovecot] Migration to Dovecot 2.2.12 - How to trigger full site indexing
by kadafax＠gmail.com 09 Apr '14

09 Apr '14

Hi list, We are in the process of migrating our old (dovecot 1.2.4 based) mail system to the new one: - Centos 6 x86_64 - Dovecot 2.2.12 - Users in an openldap directory - clucene FTS I'm trying to trigger a full indexing for all the user and all their mailboxes (avoiding them to individually trigger it using a search within their MUA). I'm trying to use the "doveadm index" command. First question, is there some sort of 'wildcard' option for the name of the mailbox to index, as I dont know all the mailboxes's names the users have created (beside the regular Sent Inbox Trash and Drafts ? Second question I've tried: # doveadm -D index -A Sent which gave me: doveadm(root): Error: User listing returned failure doveadm: Error: Failed to iterate through some users Can the '-A' option work with ldap backend ? Thanks a lot and have a nice day, kfx --------------------------------------------- # 2.2.12: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.11.2.el6.x86_64 x86_64 CentOS release 6.5 (Final) ext4 auth_cache_size = 10 M auth_debug = yes auth_socket_path = /var/run/dovecot/auth-userdb auth_verbose = yes auth_verbose_passwords = sha1 base_dir = /var/run/dovecot/ debug_log_path = /var/log/dovecot-debug.log default_vsz_limit = 2 G hostname = mydomain.com info_log_path = /var/log/dovecot.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * log_path = /var/log/dovecot-error.log login_greeting = Welcome login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_debug = yes mail_gid = vmail mail_location = maildir:/var/vmail/%Ln mail_plugins = fts fts_lucene quota stats mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = maildir:/var/vmail/%Ln mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = type = private } passdb { args = /usr/local/etc/dovecot/deny-users deny = yes driver = passwd-file } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { fts = lucene fts_autoindex = yes fts_autoindex_max_recent = 1000 fts_lucene = whitespace_chars=@ quota = maildir:User quota quota_rule = *:storage=20GB quota_rule2 = Trash:storage=+200M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = /var/sieve-scripts/%Ln.sieve sieve_dir = /var/vmail/%Ln/home/sieve stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 16 M stats_refresh = 30 secs stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours } postmaster_address = postmaster(a)mydomain.com protocols = imap pop3 sieve sieve service auth-worker { user = root } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0777 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = nobody } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_cert = </etc/pki/tls/certs/mail.mydomain.com.pem ssl_key = </etc/pki/tls/private/mail.mydomain.com.key userdb { args = uid=12347 gid=12347 home=/var/vmail/%Ln/home allow_all_users=yes driver = static } verbose_proctitle = yes protocol lda { mail_plugins = fts fts_lucene quota stats sieve virtual } protocol imap { mail_plugins = fts fts_lucene quota stats imap_quota virtual imap_stats }

2 2

[Dovecot] POP3 sessions
by The Doctor 09 Apr '14

09 Apr '14

Is their a way in the config file to not lock POP3 sessions in dovecot for only 1 user? -- Member - Liberal International This is doctor(a)nl2k.ab.ca Ici doctor(a)nl2k.ab.ca God,Queen and country!Never Satan President Republic!Beware AntiChrist rising! http://www.fullyfollow.me/rootnl2k Look at Psalms 14 and 53 on Atheism C'est temps pour le Quebec de voter aujourd'hui.

2 1

[Dovecot] Dovecot LDAP issue
by Deeztek Support 08 Apr '14

08 Apr '14

Dovecot version: 2.0.19 ------------------------------------------------------- grep -v '^ *$#.*$\?$' /etc/dovecot/dovecot-ldap.conf hosts = server.domain.tld:389 ldap_version = 3 auth_bind = yes dn = vmail(a)domain.tld dnpass = somepassword base = ou=testou,dc=domain,dc=tld scope = subtree deref = never user_filter = (&(userPrincipalName=%u)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) pass_filter = (&(userPrincipalName=%u)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) pass_attrs = userPassword=password default_pass_scheme = CRYPT user_attrs = =home=/var/vmail/vmail1/%Ld/%Ln/Maildir/,=mail=maildir:/var/vmail/vmail1/%Ld/%Ln/Maildir ----------------------------------------------------- I'm authenticating users through AD and it seems to work with no problems. Unfortunately, when I try to send e-mail from a user who's not in the testou container I get the following error: Sender address rejected: User unknown in virtual mailbox table> #SMTP#. I'm assuming this happens because dovecot is not able to to lookup up that user since that user is outside the testou container. A lot of the AD users are in different places inside the AD structure and I need to be able to configure dovecot to look from the root of the AD structure down. I changed the base to this: base = dc=domain,dc=tld but it simply fails to lookup any users at that point. How would I go about getting dovecot to start at the top of the domain and look at every nested OU within AD? thanks a lot D

6 12

[Dovecot] Debugging doveadm expunge
by Andy Hawkins 08 Apr '14

08 Apr '14

Hi, I'm a recent convert to dovecot, and in general it is all working fine. However, I have a number of cron jobs set up to purge old messages from mailboxes. These don't seem to be doing what I would expect. Is there any way of debugging this process? Some way of seeing what messages it's checking, and why each one matches or fails to match? For example, I'm running this: doveadm expunge -u andy mailbox "News Reports" savedbefore 90d from the crontab of user 'andy'. I'd expect the specified folder to only contain 90 messages (I get one 'News Report' per day) but in actual fact there are 1428 in there! Any advice would be appreciated. Thanks Andy

2 2

Re: [Dovecot] Connection refused userdb lookup ..dovecot/auth-userdb
by Simon 08 Apr '14

08 Apr '14

On Tue, Apr 1, 2014 at 11:29 PM, Steffen Kaiser < skdovecot(a)smail.inf.fh-brs.de> wrote: > >>>>>>>>> >>>>>>>>> > What's the output of: >>> >>> lsof -c dovecot|grep auth-userdb >>> >>> [root@vmail1 ~]# lsof -c dovecot|grep auth-userdb >> dovecot 3147 root 38u unix 0xffff88004fce0680 0t0 24739 >> /var/run/dovecot/auth-userdb >> > > Dovecot is configured to use /var/run/dovecot/auth-userdb whereas your LDA > uses /usr/local/dovecot/var/run/dovecot/auth-userdb . You do not have > symlinks to merge both locations, do you? > > Check, why the Dovecot LDA is using another config file. Found it!!!!!!! Thank youm thank you, thank you... this was delivery config in postfix that was using /usr/local/dovecot/var/run/dovecot/auth-userdb. DUH! Simon

1 0

[Dovecot] dsync replication questions
by Nikolaos Milas 07 Apr '14

07 Apr '14

I am running two servers with Dovecot v2.2.12 on CentOS x86_64 (5.10 and 6.5 respectively) and users are virtual over ldap. I have setup our main internal server (vmail.example.com) with dsync replication according to the first part of http://wiki2.dovecot.org/Replication. The second one (vmail1.example.com) will be the failover server which we want to be a real-time mirror (but can be manipulated directly and it should propagate changes back to vmail.example.com) When I started the server (vmail.example.com) mirroring started and completed fine (after a few hours). However, since then, I am not seeing a continued mirroring between the two. I would expect changes to one of the masters to be propagated in real time to the other - which does not happen. If I manually run (on vmail.example.com) dsync -u imaptester mirror ssh -l root vmail1.example.com dsync -u imaptester then these two accounts are synced. Question 1: Shouldn't mirroring continue automatically in real time (having configured it as in the first part of http://wiki2.dovecot.org/Replication)? If not, what should I do to enable such a real-time (or near-real-time) sync? Note that I have not configured "replication_dsync_parameters" as noted at the above page. Question 2: Where can I find documentation about "replication_dsync_parameters" and about "the doveadm sync command" (referred to at the same page)? I have not been able to locate such a documentation/wiki page. Question 2a: What do options "-d -N -l 30 -U" signify in "replication_dsync_parameters = -d -N -l 30 -U"? Thanks, Nick

4 11

[Dovecot] Regarding SSHA512 Password Scheme
by Joy 07 Apr '14

07 Apr '14

Dear Expert, I am having issue with using SSHA512 Password Schemes with my openldap server. I have used doveadm utility to create password and able to verify the same but trying to login to IMAP is failing tried debug the auth part but no success so far. I am using the latest version of dovecot. Please share your views .. Thanks

2 1

[Dovecot] Dovecot IMAP Authentication issue with Vpopmail
by Arup 07 Apr '14

07 Apr '14

Hello All, i've configured a qmail server (for office) under Ubuntu 12.04 server following this guide- http://www.connor.net.au/tutorials/qmail/qmaillite/ everything working just fine except dovecot IMAP. i've followed this section for dovecot- http://www.connor.net.au/tutorials/q...te/dovecot.php<http://www.connor.net.au/tutorials/qmail/qmaillite/dovecot.php> but when i go to telnet 143 and try to login with username/password, it failed and showing error: ** BYE Internal error occurred. Refer to server log for more information.Connection closed by foreign host.* i think there may be some authentication issue with vpopmail and dovecot. POP and SMTP both working. but why not IMAP? i can't also use webmail (i.e. squirrelmail) as it don't working with IMAP. it's showing- *connection dropped by IMAP server *error while trying to login. i'm looking forward to a solution here. any qmail+vpopmail expert here? plz help. Thanks in advance. B/R

1 0

[Dovecot] Unknown setting: plugin after fresh install
by Patrik Karisch 04 Apr '14

04 Apr '14

Hi guys, I've installed dovecot 2.1.7 on a Debian Wheezy, tweaked some parameters little bit, but I can't restart it (dovecot -n also fails) and get this error: doveconf: Fatal: Error in configuration file /etc/dovecot/conf.d/90-acl.conf line 11: Unknown setting: plugin doveconf: Error: managesieve-login: dump-capability process returned 89 Wether I uncomment this plugin line, I get the error on another file (example 90-quote.conf). Seems a little bit weird. What have I done false? Thanks Patrik -- PRIVACY IS NOT A CRIME! So please encrypt your emails using PGP/GnuPG. My PGP Key-ID: 0x42D6DEA0 / 0x28B8F6E242D6DEA0 PGP Fingerprint: 4C1F ED51 047A D0E2 6C20 F3F7 28B8 F6E2 42D6 DEA0

2 2

[Dovecot] mdbox with mail_attachment_dir per user in 2.2.12
by Pavel Stano 04 Apr '14

04 Apr '14

Hello, we have 2 netapp arrays with 2 volumes and we need to store our mail data in one or other volume for every user. We want keep data for one user in one volume only. So we would like to have 2 separate mail_attachment_dir, one on every volume. But in latest version 2.2.12 it look like it is only possible to set one global mail_attachment_dir. I have an idea with 2 separate dovecot instances per machine with different mail_attachment_dir. Or it is possible to somehow specify it per user ? Thanks -- [ Ohodnotte kvalitu mailu: http://nicereply.com/websupport/Stano/ ] Pavel Stano | Troubleshooter http://WebSupport.sk *** BERTE A VYCHUTNAVAJTE ***

2 2

[Dovecot] imap / IPv6 problems?
by Egbert 04 Apr '14

04 Apr '14

Hi, I have this intermittant problem. When sending an email it *sometimes* takes ages before the process finishes. The process seems to hang in moving the message to the sent items" folder". When I disable the IPv6 stack in the network config (this is MS Windows 7), the hanging process immedialetely completes! This makens me think that is has to do with the IP stacks. Another observed effect is a long "rotating wheel" when just klicking on an imap folder before the listing in the right pane updates. Here the same trick solves the problem. I use Thunderbird on W7 as client and have my mail (3 accounts) on a remote mailserver. I have full control over that server which can become handy... Th emailserver is Ubuntu 12.04 LTS with postfix and Dovecot (2.0.19) from the standard repo's. My IPv6 connections is a native IPv6 from my ISP (xs4all.nl). I have no reason to think that the IPv 6 connecition itself is the problem. Any advise to investigate this problem is welcome. Egbert Jan, NL

2 1