- dovecot - dovecot.org

: Re: Corrupted dbox file/index
by Raymond Sellars 16 Oct '18

16 Oct '18

>On Mon, Oct 15, 2018 at 08:50:21AM +0000, Raymond Sellars wrote: > > Hi > > Looking for some insight into mdbox index file management and recovery from corruptions. > What version of dovecot and what OS are you running? Is NFS linux/bsd/netapp/etc? [Raymond] Linux 2.6.32-279.19.1.el6.x86_64 Red Hat Enterprise Linux Server release 6.7 (Santiago) - its selectively patched a little higher than this. nfs-utils-1.2.3-64.el6.x86_64 nfs-utils-lib-1.1.5-11.el6.x86_64 NFS is provided by SAN array. Either Isilon SAN or VNX SAN. I believe the older Isilon with NFS. [Raymond Sellars] fstab: <ip removed>:/ mailshare-isi /mailshare nfs _netdev,noatime,vers=3,rsize=32768,wsize=32768,bg,intr,tcp 0 0 Thanks Raymond

1 0

Corrupted dbox file/index
by Raymond Sellars 15 Oct '18

15 Oct '18

Hi Looking for some insight into mdbox index file management and recovery from corruptions. I have a two node cluster on NFS with proxy director in front for user stickness. One node (a nominated master) bidirectionally replicates to a 3rd node on a DR site. We periodically get index file corruptions resulting in rebuilds. However the user experience is poor as messages read/deleted from months/years ago all reappear as unread again. We've seen corruption because of NFS NTP time sync problems, proxy not being stick, but also the DR node being off line for a while and then tripping corruption within production when it comes back on. Error message example (1 of): Error: Corrupted dbox file /mailshare/.. (removed) ../home/mail/storage/m.4 (around offset=993548): EOF reading msg header (got 0/30 bytes) https://wiki2.dovecot.org/MailboxFormat/dbox- i've read up on all the documentation I can find and understand " you must not lose the dbox index files, they can't be regenerated without data loss." Questions: #1 Any additional tips for avoiding mdbox index corruptions with dsync? Or should I revert to maildir format? I like the performance premise of the mdbox but these index corruptions are a reliability issue. #2 I'm guessing read status is one of the meta data items lost. But its seems it can't recover it from dovecot.index.backup files either. Any technique to preserve that item as its key to the user experience? #3 If index/transaction logs are so critical is there some kind of check point backups I can take? Native dovecot feature or do I need to script something. #4 I've noticed that rebuilding the index does not work if the dovecot.index.log file is lost (deleted as a hard test). The dovecot.index.cache can be but once the log file i gone messages are not automatically (or manually that i can find) recovered from the storage directory. I've not seen any dovecot.index.log file corruptions but that file seems very high risk. If rebuilding the index only from the log file or a combination process from storage directory? Is there perhaps an option to just use the transaction log and not the index? Although that doesn't sound wise for performance. #5 In additional to status UNREAD we also notice files moved to the trash reappear. Is that expected behavior? Thanks Raymond

2 1

Problems with qouta_clone plugin
by Christian Ejlertsen 15 Oct '18

15 Oct '18

Hello I'm having troubles getting the quota_clone plugin to work for me. iø, trying to put the quota values into to to fields, messages and usage_in_bytes, in the mysql database. The quotas are getting written to the maildirsize file and can be updated with the doveadm quota recalc -A or -u "*" command But i can't seem to get it to trigger the quota_clone plugin, not even an error or a warning.. At this point a crash would be preferred since it might yield some information :) It is probably something simple but apparantly i'm failing to see it :) Hope someone can help. ------------- dovecot --version 2.3.2.1 (0719df592) cat dovecot-quota-clone-sql.conf.ext connect = **** map { pattern = priv/quota/storage table = virtual_users value_field = usage_in_bytes username_field = email } map { pattern = priv/quota/messages table = virtual_users value_field = messages username_field = email } # 2.3.2.1 (0719df592): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-862.11.6.el7.x86_64 x86_64 CentOS Linux release 7.5.1804 (Core) nfs4 # Hostname: imap01.ltmail.dk auth_debug = yes dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext quotaclone = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } doveadm_password = # hidden, use -P to show it lock_method = dotlock login_trusted_networks = 192.168.100.11/32 192.168.100.16/32 mail_fsync = always mail_location = maildir:/storage/vmail/%d/%n mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " quota notify replication" mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { last_login_dict = proxy::lastlogin last_login_key = last-login/%u mail_replica = tcp:imapb01.litmail.dk:12345 quota = maildir:User quota quota_clone_dict = proxy::quotaclone quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO } protocols = imap replication_max_conns = 100 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } user = $default_internal_user } service config { unix_listener config { user = vmail } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service doveadm { group = vmail inet_listener { port = 12345 } user = vmail } service imap-login { inet_listener imap { port = 143 } process_min_avail = 10 service_count = 0 } service quota-status { client_limit = 1 executable = /usr/libexec/dovecot/quota-status -p postfix inet_listener { port = 12340 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } service stats { unix_listener stats-writer { mode = 0600 user = vmail } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { mail_max_userip_connections = 1000 mail_plugins = " quota notify replication imap_quota last_login quota_clone" } protocol submission { mail_max_userip_connections = 1000 } -- Christian Ejlertsen

2 5

Sieve scripts not replicated
by Pascal 13 Oct '18

13 Oct '18

Hello, I use dovecot replication and the sieve scripts are not replicated. Mail replication is working fine. Log when sieve script (with Rainloop webmail) is created: Oct 12 12:57:57 srv1 dovecot: managesieve-login: Login: user=<hativ(a)example.com>, method=PLAIN, rip=91.67.174.186, lip=195.201.251.57, mpid=5360, TLS, session=<OXvK9QV4fOBbQ666> Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Loading modules from directory: /usr/local/lib/dovecot Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Module loaded: /usr/local/lib/dovecot/lib01_acl_plugin.so Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Module loaded: /usr/local/lib/dovecot/lib10_mail_crypt_plugin.so Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Module loaded: /usr/local/lib/dovecot/lib10_quota_plugin.so Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Module loaded: /usr/local/lib/dovecot/lib15_notify_plugin.so Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Module loaded: /usr/local/lib/dovecot/lib20_mail_log_plugin.so Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Module loaded: /usr/local/lib/dovecot/lib20_quota_clone_plugin.so Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Module loaded: /usr/local/lib/dovecot/lib20_replication_plugin.so Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Added userdb setting: plugin/mail_crypt_private_password=<hidden> Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Added userdb setting: plugin/mail_crypt_save_version=0 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Added userdb setting: plugin/quota_rule=*:bytes=0 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Effective uid=998, gid=998, home=/srv/mail/example.com/hativ Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Quota root: name= backend=count args= Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Quota rule: root= mailbox=* bytes=0 messages=0 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Quota grace: root= bytes=0 (10%) Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Namespace INBOX: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:~/ Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: fs: root=/srv/mail/example.com/hativ, index=, indexpvt=, control=, inbox=, alt= Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl: initializing backend with data: vfile Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl: acl username = hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl: owner = 1 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl vfile: Global ACLs disabled Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: Namespace Shared: type=shared, prefix=Shared/%u/, sep=, inbox=no, hidden=no, list=children, subscriptions=yes location=sdbox:%h/:INDEXPVT=~/shares/%u Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: shared: root=/usr/local/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl: initializing backend with data: vfile Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl: acl username = hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl: owner = 0 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: acl vfile: Global ACLs disabled Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: quota: quota_over_flag check: quota_over_script unset - skipping Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: Pigeonhole version 0.5.3 (f018bbab) initializing Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.3 (f018bbab) loaded Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.3 (f018bbab) loaded Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file storage: Using active Sieve script path: /srv/mail/example.com/hativ/.dovecot.sieve Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file storage: Using script storage path: /srv/mail/example.com/hativ/sieve Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file storage: Using permissions from /srv/mail/example.com/hativ/sieve: mode=0700 gid=-1 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file storage: sync: Synchronization active Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file storage: Using Sieve script path: /srv/mail/example.com/hativ/sieve/tmp/rainloop.user_1539341877.M470670P5360.srv1.sieve Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file script: Opened script `rainloop.user' from `/srv/mail/example.com/hativ/sieve/tmp/rainloop.user_1539341877.M470670P5360.srv1.sieve' Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: replication: Replication requested by 'sieve_storage_sync_transaction_begin', priority=1 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: sieve: file script: Opened script `rainloop.user' from `/srv/mail/example.com/hativ/sieve/rainloop.user.sieve' Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Debug: replication: Replication requested by 'sieve_storage_sync_transaction_begin', priority=1 Oct 12 12:57:57 srv1 dovecot: managesieve(hativ(a)example.com)<5360><OXvK9QV4fOBbQ666>: Disconnected: Logged out bytes=865/124 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: auth PASS input: user=hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com)<5361><>: Debug: auth USER input: hativ(a)example.com mail_crypt_private_password mail_crypt_save_version=0 quota_rule=*:bytes=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com)<5361><>: Debug: Added userdb setting: plugin/mail_crypt_private_password=<hidden> Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com)<5361><>: Debug: Added userdb setting: plugin/mail_crypt_save_version=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com)<5361><>: Debug: Added userdb setting: plugin/quota_rule=*:bytes=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): auth PASS input: user=hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): auth USER input: hativ(a)example.com mail_crypt_private_password mail_crypt_save_version=0 quota_rule=*:bytes=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Added userdb setting: plugin/mail_crypt_private_password=<hidden> Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Added userdb setting: plugin/mail_crypt_save_version=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Added userdb setting: plugin/quota_rule=*:bytes=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Effective uid=998, gid=998, home=/srv/mail/example.com/hativ Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Quota root: name= backend=count args= Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Quota rule: root= mailbox=* bytes=0 messages=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Quota grace: root= bytes=0 (10%) Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Namespace INBOX: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:~/ Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): fs: root=/srv/mail/example.com/hativ, index=, indexpvt=, control=, inbox=, alt= Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: initializing backend with data: vfile Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: acl username = hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: owner = 1 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl vfile: Global ACLs disabled Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Namespace Shared: type=shared, prefix=Shared/%u/, sep=, inbox=no, hidden=no, list=children, subscriptions=yes location=sdbox:%h/:INDEXPVT=~/shares/%u Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): shared: root=/usr/local/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: initializing backend with data: vfile Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: acl username = hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: owner = 0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl vfile: Global ACLs disabled Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): quota: quota_over_flag check: quota_over_script unset - skipping Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Effective uid=998, gid=998, home=/srv/mail/example.com/hativ Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Quota root: name= backend=count args= Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Quota rule: root= mailbox=* bytes=0 messages=0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Quota grace: root= bytes=0 (10%) Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace INBOX: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:~/ Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: fs: root=/srv/mail/example.com/hativ, index=, indexpvt=, control=, inbox=, alt= Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: initializing backend with data: vfile Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: acl username = hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: owner = 1 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: Global ACLs disabled Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace Shared: type=shared, prefix=Shared/%u/, sep=, inbox=no, hidden=no, list=children, subscriptions=yes location=sdbox:%h/:INDEXPVT=~/shares/%u Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: shared: root=/usr/local/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: initializing backend with data: vfile Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: acl username = hativ(a)example.com Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: owner = 0 Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: Global ACLs disabled Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: quota: quota_over_flag check: quota_over_script unset - skipping Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Archiv/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Templates/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Offen/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Trash/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Junk/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Sent/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Drafts/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/INBOX/dbox-Mails/dovecot-acl not found Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace : Using permissions from /srv/mail/example.com/hativ: mode=0700 gid=default Oct 12 12:57:57 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace Shared/: Using permissions from : mode=0700 gid=default Oct 12 12:57:57 srv1 dovecot: dsync-local(hativ(a)example.com)<gHffIzV+wFvxFAAA69eCHA>: Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/INBOX/dbox-Mails/dovecot-acl not found According to the two lines "Debug: replication: Replication requested by 'sieve_storage_sync_transaction_begin', priority=1" it should work, but the sieve script doesn't show up on the second server. Then I try to change the script (disabling it), here the log: Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: auth PASS input: user=hativ(a)example.com Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com)<5509><>: Debug: auth USER input: hativ(a)example.com mail_crypt_private_password mail_crypt_save_version=0 quota_rule=*:bytes=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com)<5509><>: Debug: Added userdb setting: plugin/mail_crypt_private_password=<hidden> Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com)<5509><>: Debug: Added userdb setting: plugin/mail_crypt_save_version=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com)<5509><>: Debug: Added userdb setting: plugin/quota_rule=*:bytes=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): auth PASS input: user=hativ(a)example.com Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): auth USER input: hativ(a)example.com mail_crypt_private_password mail_crypt_save_version=0 quota_rule=*:bytes=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Added userdb setting: plugin/mail_crypt_private_password=<hidden> Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Added userdb setting: plugin/mail_crypt_save_version=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Added userdb setting: plugin/quota_rule=*:bytes=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Effective uid=998, gid=998, home=/srv/mail/example.com/hativ Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Quota root: name= backend=count args= Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Quota rule: root= mailbox=* bytes=0 messages=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Quota grace: root= bytes=0 (10%) Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Namespace INBOX: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:~/ Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): fs: root=/srv/mail/example.com/hativ, index=, indexpvt=, control=, inbox=, alt= Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: initializing backend with data: vfile Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: acl username = hativ(a)example.com Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: owner = 1 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl vfile: Global ACLs disabled Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): Namespace Shared: type=shared, prefix=Shared/%u/, sep=, inbox=no, hidden=no, list=children, subscriptions=yes location=sdbox:%h/:INDEXPVT=~/shares/%u Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): shared: root=/usr/local/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: initializing backend with data: vfile Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: acl username = hativ(a)example.com Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl: owner = 0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): acl vfile: Global ACLs disabled Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: remote(mail2.example.com): quota: quota_over_flag check: quota_over_script unset - skipping Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Effective uid=998, gid=998, home=/srv/mail/example.com/hativ Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Quota root: name= backend=count args= Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Quota rule: root= mailbox=* bytes=0 messages=0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Quota grace: root= bytes=0 (10%) Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace INBOX: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:~/ Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: fs: root=/srv/mail/example.com/hativ, index=, indexpvt=, control=, inbox=, alt= Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: initializing backend with data: vfile Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: acl username = hativ(a)example.com Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: owner = 1 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: Global ACLs disabled Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace Shared: type=shared, prefix=Shared/%u/, sep=, inbox=no, hidden=no, list=children, subscriptions=yes location=sdbox:%h/:INDEXPVT=~/shares/%u Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: shared: root=/usr/local/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: initializing backend with data: vfile Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: acl username = hativ(a)example.com Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl: owner = 0 Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: Global ACLs disabled Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: quota: quota_over_flag check: quota_over_script unset - skipping Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Archiv/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Templates/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Offen/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Trash/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Junk/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Sent/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/Drafts/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/INBOX/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace : Using permissions from /srv/mail/example.com/hativ: mode=0700 gid=default Oct 12 13:03:59 srv1 dovecot: doveadm(hativ(a)example.com): Debug: Namespace Shared/: Using permissions from : mode=0700 gid=default Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: acl vfile: file /srv/mail/example.com/hativ/mailboxes/INBOX/dbox-Mails/dovecot-acl not found Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: Pigeonhole version 0.5.3 (f018bbab) initializing Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: Sieve Extprograms plugin for Pigeonhole version 0.5.3 (f018bbab) loaded Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: Sieve imapsieve plugin for Pigeonhole version 0.5.3 (f018bbab) loaded Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: file storage: Using active Sieve script path: /srv/mail/example.com/hativ/.dovecot.sieve Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: file storage: Using script storage path: /srv/mail/example.com/hativ/sieve Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: file storage: Using permissions from /srv/mail/example.com/hativ/sieve: mode=0700 gid=-1 Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: sieve: file storage: sync: Synchronization active Oct 12 13:03:59 srv1 dovecot: dsync-local(hativ(a)example.com)<aS7nDJ9/wFuFFQAA69eCHA>: Debug: doveadm-sieve: Value missing for key `vendor/vendor.dovecot/pvt/server/sieve/default' (last change: 2018-10-12 13:03:59) Maybe the line "Debug: doveadm-sieve: Value missing for key `vendor/vendor.dovecot/pvt/server/sieve/default' (last change: 2018-10-12 13:03:59)" gives an hint? root@srv1 ~ # doveadm replicator dsync-status username type status root@srv2 ~ # doveadm replicator dsync-status username type status root@srv1 ~ # doveadm replicator status Queued 'sync' requests 0 Queued 'high' requests 0 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 0 Waiting 'failed' requests 0 Total number of known users 5 root@srv2 ~ # doveadm replicator status Queued 'sync' requests 0 Queued 'high' requests 0 Queued 'low' requests 0 Queued 'failed' requests 0 Queued 'full resync' requests 0 Waiting 'failed' requests 0 Total number of known users 5 root@srv1 ~ # doveadm sieve list -u hativ(a)example.com rainloop.user root@srv2 ~ # doveadm sieve list -u hativ(a)example.com Relevant configuration: service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = $mail_uid } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = $mail_uid } } plugin { # Replication mail_replica = tcps:mail2.example.com # Sieve imapsieve_mailbox1_name = Junk imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_before = file:/etc/dovecot/sieve/report-spam.sieve imapsieve_mailbox2_name = * imapsieve_mailbox2_from = Junk imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_before = file:/etc/dovecot/sieve/report-ham.sieve sieve = file:~/sieve;active=~/.dovecot.sieve sieve_after = /etc/dovecot/sieve-after sieve_before = /etc/dovecot/sieve-before sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /usr/bin/ sieve_plugins = sieve_extprograms sieve_imapsieve } Greetings Pascal

3 2

Ask for little change :)
by kjonca＠o2.pl 12 Oct '18

12 Oct '18

Is it possible, that dovecot-lmtp, has in inserted "Received:" header something about its version ie. instead: --8<---------------cut here---------------start------------->8--- Received: from alfa.kjonca by alfa.kjonca with LMTP id n1O7D5Q3v1toSQAApvcrCQ (envelope-from <envelope@from>) for <kjonca@localhost>; Thu, 11 Oct 2018 13:44:20 +0200 --8<---------------cut here---------------end--------------->8--- would be: --8<---------------cut here---------------start------------->8--- Received: from alfa.kjonca (Dovecot version) by alfa.kjonca with LMTP id n1O7D5Q3v1toSQAApvcrCQ (envelope-from <envelope@from>) for <kjonca@localhost>; Thu, 11 Oct 2018 13:44:20 +0200 --8<---------------cut here---------------end--------------->8--- KJ -- http://stopstopnop.pl/stop_stopnop.pl_o_nas.html można nie mieć nawet żadnego sensownego argumentu, a dzięki odpowiedniej gestykulacji stworzyć poczucie wiarygodności. Puls Biznesu

2 1

Struggling to get dovecot working with postfix auth
by Laura Smith 11 Oct '18

11 Oct '18

Hi, I am trying to create an authenticated relay server using Postfix and Dovecot. However I am having two problems : (a) If I create a dovecot config entry as follows : unix_listener /var/spool/postfix-authrelay/private/dovecot-auth { group = postfix mode = 0666 user = postfix } Dovecot is unable to create the socket ? I thought surely if dovecot is started as root it should create the socket before dropping privileges ? (b) The alternative method of TCP SASL is not working either: 250 DSN ehlo localhost 250-foobar.example.com 250-PIPELINING 250-SIZE 20480000 250-ETRN 250-AUTH PLAIN 250-ENHANCEDSTATUSCODES 250-8BITMIME 250 DSN AUTH PLAIN <none_of_your_business> 535 5.7.8 Error: authentication failed: and in the logs... 2018-10-11T10:17:40.491483+01:00 X postfix-authrelay/smtpd[18312]: warning: X[X]: SASL PLAIN authentication failed: #### #### postconf #### >postconf -a cyrus dovecot > postconf -c /etc/postfix-authrelay | fgrep sasl broken_sasl_auth_clients = no cyrus_sasl_config_path = lmtp_sasl_auth_cache_name = lmtp_sasl_auth_cache_time = 90d lmtp_sasl_auth_enable = no lmtp_sasl_auth_soft_bounce = yes lmtp_sasl_mechanism_filter = lmtp_sasl_password_maps = lmtp_sasl_path = lmtp_sasl_security_options = noplaintext, noanonymous lmtp_sasl_tls_security_options = $lmtp_sasl_security_options lmtp_sasl_tls_verified_security_options = $lmtp_sasl_tls_security_options lmtp_sasl_type = cyrus proxy_read_maps = $local_recipient_maps $mydestination $virtual_alias_maps $virtual_alias_domains $virtual_mailbox_maps $virtual_mailbox_domains $relay_recipient_maps $relay_domains $canonical_maps $sender_canonical_maps $recipient_canonical_maps $relocated_maps $transport_maps $mynetworks $smtpd_sender_login_maps $sender_bcc_maps $recipient_bcc_maps $smtp_generic_maps $lmtp_generic_maps $alias_maps $smtpd_client_restrictions $smtpd_helo_restrictions $smtpd_sender_restrictions $smtpd_relay_restrictions $smtpd_recipient_restrictions $address_verify_sender_dependent_default_transport_maps $address_verify_sender_dependent_relayhost_maps $address_verify_transport_maps $fallback_transport_maps $lmtp_discard_lhlo_keyword_address_maps $lmtp_pix_workaround_maps $lmtp_sasl_password_maps $lmtp_tls_policy_maps $mailbox_command_maps $mailbox_transport_maps $postscreen_discard_ehlo_keyword_address_maps $rbl_reply_maps $sender_dependent_default_transport_maps $sender_dependent_relayhost_maps $smtp_discard_ehlo_keyword_address_maps $smtp_pix_workaround_maps $smtp_sasl_password_maps $smtp_tls_policy_maps $smtpd_discard_ehlo_keyword_address_maps $smtpd_milter_maps $virtual_gid_maps $virtual_uid_maps proxy_write_maps = $smtp_sasl_auth_cache_name $lmtp_sasl_auth_cache_name $address_verify_map $postscreen_cache_map send_cyrus_sasl_authzid = no smtp_sasl_auth_cache_name = smtp_sasl_auth_cache_time = 90d smtp_sasl_auth_enable = no smtp_sasl_auth_soft_bounce = yes smtp_sasl_mechanism_filter = smtp_sasl_password_maps = smtp_sasl_path = smtp_sasl_security_options = noplaintext, noanonymous smtp_sasl_tls_security_options = $smtp_sasl_security_options smtp_sasl_tls_verified_security_options = $smtp_sasl_tls_security_options smtp_sasl_type = cyrus smtpd_recipient_restrictions = permit_mynetworks,permit_sasl_authenticated,reject_unauth_destination smtpd_relay_restrictions = permit_mynetworks,permit_sasl_authenticated,reject_unauth_destination smtpd_sasl_auth_enable = yes smtpd_sasl_authenticated_header = no smtpd_sasl_exceptions_networks = smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = inet:localhost:7425 smtpd_sasl_security_options = noanonymous smtpd_sasl_service = smtp smtpd_sasl_tls_security_options = $smtpd_sasl_security_options smtpd_sasl_type = dovecot #### #### DOVECONF #### > doveconf -n # 2.3.1 (8e2f634): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.1 (d9bc6dfe) # OS: Linux 4.12.14-lp150.12.19-default x86_64 # Hostname: test.example.com managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } service auth { inet_listener { address = 127.0.0.1 port = 7425 } inet_listener { address = ::1 port = 7425 } # If I disable this, dovecot loads fine, but the tcp auth is unusable ? # If I enable this, dovecot is unable to create the socket ? # unix_listener /var/spool/postfix-authrelay/private/dovecot-auth { # group = postfix # mode = 0666 # user = postfix # } } ssl = no ssl_cipher_list = ALL:!aNULL:!eNULL:!EXPORT:!DES:!3DES:!MD5:!PSK:!RC4:!ADH:!LOW@STRENGTH ssl_options = no_compression ssl_prefer_server_ciphers = yes userdb { driver = passwd }

5 11

Renewal of Let's Encrypt Certificates in Dovecot
by Ignacio Garcia 11 Oct '18

11 Oct '18

Hi there. I've been using Dovecot for quite some time now but I just started using Let's Encrypt certs. Since LE certs are renewed automatically without user intervention I'm wondering if I will need to restart dovecot after that renewal... Has anybody had any experience with that? Thanks so much for your help! Ignacio

5 5

index corruption weirdness
by William Taylor 10 Oct '18

10 Oct '18

We have started seeing index corruption ever since we upgraded (we believe) our imap servers from SL6 to Centos 7. Mail/Indexes are stored on Netapps mounted via NFS. We have 2 lvs servers running surealived in dr/wlc, 2 directors and 6 backend imap/pop servers. Most of the core dumps I've looked at for different users are like "Backtrace 2" with some variations on folder path. This latest crash (Backtrace 1) is different from others I've seen. It is also leaving 0byte files in the users .Drafts/tmp folder. # ls -s /var/spool/mail/15/00/user1/.Drafts/tmp | awk '{print $1}' |sort | uniq -c 9692 0 1 218600 I believe the number of cores here is different from the number of tmp files because this is when we moved the user to our debug server so we could get the core dumps. # ls -la /home/u/user1/core.* |wc -l 8437 Any help/insight would be greatly appreciated. Thanks, William OS Info: CentOS Linux release 7.5.1804 (Core) 3.10.0-862.14.4.el7.x86_64 NFS: # mount -t nfs |grep mail/15 172.16.255.14:/vol/vol1/mail/15 on /var/spool/mail/15 type nfs (rw,nosuid,nodev,relatime,vers=3,rsize=32768,wsize=32768,namlen=255,hard,nordirplus,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=172.16.255.14,mountvers=3,mountport=4046,mountproto=udp,local_lock=none,addr=172.16.255.14) Dovecot Info: dovecot -n # 2.1.17: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-862.14.4.el7.x86_64 x86_64 CentOS Linux release 7.5.1804 (Core) auth_failure_delay = 0 auth_master_user_separator = * auth_username_format = %Ln auth_verbose = yes auth_verbose_passwords = sha1 auth_worker_max_count = 64 login_log_format_elements = user=<%u> session=%{session} method=%m rip=%r lip=%l mpid=%e %c login_trusted_networks = 172.16.0/24 mail_debug = yes mail_fsync = always mail_log_prefix = "%s(%u): session=%{session} " mail_plugins = zlib maildir_very_dirty_syncs = yes mmap_disable = yes passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = imap driver = pam } plugin { lazy_expunge = DELETED_MESSAGES. mail_log_events = delete expunge flag_change mail_log_fields = uid box msgid from flags size quota = fs:User quota stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap pop3 service anvil { client_limit = 10000 } service auth { client_limit = 10000 vsz_limit = 1 G } service doveadm { inet_listener { port = 1842 } unix_listener doveadm-server { mode = 0666 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 7000 process_min_avail = 32 vsz_limit = 256 M } service imap-postlogin { executable = script-login -d /etc/dovecot/bin/foo-imap-postlogin user = $default_internal_user } service imap { executable = imap imap-postlogin process_limit = 7000 vsz_limit = 1492 M } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_limit = 2000 process_min_avail = 32 vsz_limit = 256 M } service pop3-postlogin { executable = script-login -d /etc/dovecot/bin/foo-pop3-postlogin user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin process_limit = 2000 } shutdown_clients = no ssl = required ssl_ca = </etc/dovecot/ssl/imap.foo.com.ca-bundle ssl_cert = </etc/dovecot/ssl/imap.foo.com.crt ssl_key = </etc/dovecot/ssl/imap.foo.com.key ssl_parameters_regenerate = 1 days ssl_protocols = !SSLv2 !SSLv3 syslog_facility = local0 userdb { driver = passwd } verbose_proctitle = yes protocol imap { imap_id_send = support-url support-email imap_max_line_length = 128 k mail_max_userip_connections = 20 mail_plugins = zlib mail_log notify imap_zlib ssl_ca = </etc/dovecot/ssl/imap.foo.com.ca-bundle ssl_cert = </etc/dovecot/ssl/imap.foo.com.crt ssl_key = </etc/dovecot/ssl/imap.foo.com.key } protocol pop3 { mail_plugins = zlib lazy_expunge pop3_fast_size_lookups = yes pop3_uidl_format = %f ssl_ca = </etc/dovecot/ssl/pop.foo.com.ca-bundle ssl_cert = </etc/dovecot/ssl/pop.foo.com.crt ssl_key = </etc/dovecot/ssl/pop.foo.com.key } Backtrace 1: Reading symbols from /usr/libexec/dovecot/imap...Reading symbols from /usr/lib/debug/usr/libexec/dovecot/imap.debug...done. Program terminated with signal 6, Aborted. #0 0x00007fbee47e0277 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 56 return INLINE_SYSCALL (tgkill, 3, pid, selftid, sig); Thread 1 (Thread 0x7fbee532f840 (LWP 9449)): #0 0x00007fbee47e0277 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 resultvar = 0 pid = 9449 selftid = 9449 #1 0x00007fbee47e1968 in __GI_abort () at abort.c:90 save_stage = 2 act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {0 <repeats 11 times>, 31683224, 140725444114256, 31908720, 140457858143945, 31683224}}, sa_flags = -457466710, sa_restorer = 0x0} sigs = {__val = {32, 0 <repeats 15 times>}} #2 0x00007fbee4bbdb65 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:191 backtrace = 0x1e372d0 "/usr/lib64/dovecot/libdovecot.so.0(+0x46b55) [0x7fbee4bbdb55] -> /usr/lib64/dovecot/libdovecot.so.0(+0x46c1e) [0x7fbee4bbdc1e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbee4b90dda] -> /usr"... #3 0x00007fbee4bbdc1e in i_internal_fatal_handler (ctx=0x7ffd321b77a0, format=<optimized out>, args=<optimized out>) at failures.c:649 status = 0 #4 0x00007fbee4b90dda in i_panic (format=format@entry=0x7fbee4ee0588 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffd321b7890, reg_save_area = 0x7ffd321b77d0}} #5 0x00007fbee4ea96ad in index_mail_parse_body_finish (mail=0x1e69570, field=field@entry=MAIL_CACHE_FLAGS) at index-mail.c:769 parser_input = 0x1e6e370 ret = 1 __FUNCTION__ = "index_mail_parse_body_finish" #6 0x00007fbee4eaaa2b in index_mail_cache_parse_deinit (_mail=<optimized out>, received_date=<optimized out>, success=<optimized out>) at index-mail.c:1624 mail = <optimized out> #7 0x00007fbee4e5dce3 in maildir_save_finish_real (_ctx=0x1e68560) at maildir-save.c:551 ctx = 0x1e68560 e = 0x1e574d0 output_errno = <optimized out> path = 0x1e37218 "/var/spool/mail/15/00/user1/.Drafts/tmp/1539107164.M157986P9449.debug.imapd.foo.com" real_size = <optimized out> size = 1539107194 #8 maildir_save_finish (ctx=0x1e68560) at maildir-save.c:630 _data_stack_cur_id = 3 #9 0x00007fbee4e90ce6 in mailbox_save_cancel (_ctx=_ctx@entry=0x1e58d58) at mail-storage.c:1697 ctx = 0x1e68560 keywords = 0x1e65860 mail = <optimized out> #10 0x0000000000409459 in cmd_append_continue_message (cmd=0x1e58c10) at cmd-append.c:420 client = 0x1e58070 ctx = 0x1e58d10 size = 31819840 ret = 3920 #11 0x000000000041186c in command_exec (cmd=0x1e58c10) at imap-commands.c:148 hook = 0x1e40d00 ret = <optimized out> #12 0x0000000000408d21 in client_input_append (cmd=0x1e58c10) at cmd-append.c:101 ctx = 0x1e58d10 client = 0x1e58070 finished = <optimized out> __FUNCTION__ = "client_input_append" #13 0x00007fbee4bcaaa7 in io_loop_call_io (io=0x1e58b10) at ioloop.c:379 ioloop = 0x1e3f6a0 t_id = 2 #14 0x00007fbee4bcb857 in io_loop_handler_run (ioloop=ioloop@entry=0x1e3f6a0) at ioloop-epoll.c:213 ctx = 0x1e3fa10 events = <optimized out> list = 0x1e58b60 io = <optimized out> tv = {tv_sec = 1799, tv_usec = 999445} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 call = <optimized out> #15 0x00007fbee4bca628 in io_loop_run (ioloop=0x1e3f6a0) at ioloop.c:398 No locals. #16 0x00007fbee4bb6213 in master_service_run (service=0x1e3f550, callback=callback@entry=0x418fb0 <client_connected>) at master-service.c:544 No locals. #17 0x0000000000408933 in main (argc=2, argv=0x1e3f390) at main.c:389 set_roots = {0x41c320 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0x1e37090 "/run/dovecot/auth-master", postlogin_socket_path = 0x1e370c0 "/run/dovecot/imap-postlogin", postlogin_timeout_secs = 60, callback = 0x419440 <login_client_connected>, failure_callback = 0x419150 <login_client_failed>} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> Backtrace 2: Reading symbols from /usr/libexec/dovecot/imap...Reading symbols from /usr/lib/debug/usr/libexec/dovecot/imap.debug...done. Program terminated with signal 6, Aborted. #0 0x00007f437288c277 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 56 return INLINE_SYSCALL (tgkill, 3, pid, selftid, sig); Thread 1 (Thread 0x7f43733d3840 (LWP 6725)): #0 0x00007f437288c277 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 resultvar = 0 pid = 6725 selftid = 6725 #1 0x00007f437288d968 in __GI_abort () at abort.c:90 save_stage = 2 act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {0 <repeats 11 times>, 19630744, 140729812750864, 1, 139927665268057, 19630744}}, sa_flags = 1925602218, sa_restorer = 0x0} sigs = {__val = {32, 0 <repeats 15 times>}} #2 0x00007f4372c69a25 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:191 backtrace = 0x12b8ad0 "/usr/lib64/dovecot/libdovecot.so.0(+0x46a15) [0x7f4372c69a15] -> /usr/lib64/dovecot/libdovecot.so.0(+0x46ade) [0x7f4372c69ade] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4372c3cdaa] -> /usr"... #3 0x00007f4372c69ade in i_internal_fatal_handler (ctx=0x7ffe367f9260, format=<optimized out>, args=<optimized out>) at failures.c:649 status = 0 #4 0x00007f4372c3cdaa in i_panic (format=format@entry=0x7f4372f83cc8 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffe367f9350, reg_save_area = 0x7ffe367f9290}} #5 0x00007f4372f77eb8 in keywords_update_records (ext=0x13827e8, ext=0x13827e8, uid2=<optimized out>, uid1=<optimized out>, type=MODIFY_ADD, keyword_idx=0, ctx=0x7ffe367f94e0) at mail-index-sync-keywords.c:228 data = <optimized out> data_mask = 1 '\001' seq1 = 346 view = 0x134c110 rec = <optimized out> data_offset = <optimized out> seq2 = 346 #6 mail_index_sync_keywords (ctx=ctx@entry=0x7ffe367f94e0, hdr=hdr@entry=0x1345bb8, rec=rec@entry=0x13a54e4) at mail-index-sync-keywords.c:304 view = <optimized out> keyword_name = <optimized out> ext = 0x13827e8 uid = <optimized out> end = 0x13a54fc seqset_offset = <optimized out> ext_map_idx = 2 keyword_idx = 0 __FUNCTION__ = "mail_index_sync_keywords" #7 0x00007f4372f78822 in mail_index_sync_record_real (data=0x13a54e4, hdr=0x1345bb8, ctx=0x7ffe367f94e0) at mail-index-sync-update.c:779 rec = 0x13a54e4 ret = 0 #8 mail_index_sync_record (ctx=ctx@entry=0x7ffe367f94e0, hdr=0x1345bb8, data=0x13a54e4) at mail-index-sync-update.c:824 _data_stack_cur_id = 7 ret = 0 #9 0x00007f4372f79866 in mail_index_sync_map (_map=_map@entry=0x1346498, type=type@entry=MAIL_INDEX_SYNC_HANDLER_HEAD, force=force@entry=true) at mail-index-sync-update.c:1036 map = <optimized out> index = 0x1346410 view = 0x134c110 sync_map_ctx = {view = 0x134c110, modseq_ctx = 0x138d330, cur_ext_map_idx = 0, ext_intro_seq = 105, ext_intro_offset = 13792, ext_intro_end_offset = 13820, expunge_handlers = {arr = {buffer = 0x0, element_size = 0}, v = 0x0, v_modifiable = 0x0}, extra_contexts = { arr = {buffer = 0x134d8c0, element_size = 8}, v = 0x134d8c0, v_modifiable = 0x134d8c0}, unknown_extensions = 0x0, type = MAIL_INDEX_SYNC_HANDLER_HEAD, sync_handlers_initialized = 0, expunge_handlers_set = 0, expunge_handlers_used = 0, cur_ext_ignore = 0, internal_update = 0, errors = 0} thdr = 0x1345bb8 tdata = 0x13a54e4 prev_seq = 105 start_offset = <optimized out> prev_offset = 14084 ret = <optimized out> had_dirty = <optimized out> reset = false __FUNCTION__ = "mail_index_sync_map" #10 0x00007f4372f6a6e4 in mail_index_map (index=index@entry=0x1346410, type=type@entry=MAIL_INDEX_SYNC_HANDLER_HEAD) at mail-index-map-read.c:433 ret = <optimized out> __FUNCTION__ = "mail_index_map" #11 0x00007f4372f65a90 in mail_index_try_open (index=index@entry=0x1346410) at mail-index.c:426 ret = <optimized out> __FUNCTION__ = "mail_index_try_open" #12 0x00007f4372f66130 in mail_index_open_files (index=index@entry=0x1346410, flags=flags@entry=(MAIL_INDEX_OPEN_FLAG_CREATE | MAIL_INDEX_OPEN_FLAG_MMAP_DISABLE | MAIL_INDEX_OPEN_FLAG_DOTLOCK_USE_EXCL)) at mail-index.c:504 ret = <optimized out> created = false #13 0x00007f4372f66230 in mail_index_open (index=0x1346410, flags=flags@entry=(MAIL_INDEX_OPEN_FLAG_CREATE | MAIL_INDEX_OPEN_FLAG_MMAP_DISABLE | MAIL_INDEX_OPEN_FLAG_DOTLOCK_USE_EXCL)) at mail-index.c:594 ret = <optimized out> __FUNCTION__ = "mail_index_open" #14 0x00007f4372f57a17 in index_storage_mailbox_open (box=box@entry=0x1388750, move_to_memory=move_to_memory@entry=false) at index-storage.c:231 ibox = 0x1388b48 index_flags = (MAIL_INDEX_OPEN_FLAG_CREATE | MAIL_INDEX_OPEN_FLAG_MMAP_DISABLE | MAIL_INDEX_OPEN_FLAG_DOTLOCK_USE_EXCL) ret = <optimized out> __FUNCTION__ = "index_storage_mailbox_open" #15 0x00007f4372f03212 in maildir_mailbox_open_existing (box=box@entry=0x1388750) at maildir-storage.c:305 mbox = 0x1388750 #16 0x00007f4372f03960 in maildir_mailbox_open (box=0x1388750) at maildir-storage.c:365 box_path = 0x1388f68 "/var/spool/mail/16/47/user2/DELETED_MESSAGES/.INBOX" root_dir = <optimized out> st = {st_dev = 140729812752383, st_ino = 140729812752416, st_nlink = 19629048, st_mode = 914331680, st_uid = 32766, st_gid = 4300439, __pad0 = 0, st_rdev = 140729812752896, st_size = 1, st_blksize = 133, st_blocks = 19629048, st_atim = {tv_sec = 139927662018357, tv_nsec = 4222451713}, st_mtim = {tv_sec = 139927664838496, tv_nsec = 139927664838496}, st_ctim = {tv_sec = 344592, tv_nsec = -140729812752575}, __unused = {129, 32, 4}} ret = <optimized out> #17 0x00007f436fd13942 in zlib_mailbox_open (box=0x1388750) at zlib-plugin.c:346 zbox = 0x1388e30 #18 0x00007f4372f34cc7 in mailbox_open_full (box=0x1388750, input=0x0) at mail-storage.c:907 _data_stack_cur_id = 6 ret = <optimized out> input = 0x0 box = 0x1388750 #19 0x00007f4372f35070 in mailbox_open (box=box@entry=0x1388750) at mail-storage.c:942 No locals. #20 0x00007f4372f56b2b in index_storage_get_status (box=0x1388750, items=STATUS_UNSEEN, status_r=0x7ffe367f9b40) at index-status.c:41 hdr = <optimized out> __FUNCTION__ = "index_storage_get_status" #21 0x00000000004175f5 in imap_status_get (cmd=0x12d99b0, ns=0x12d8590, mailbox=mailbox@entry=0x13883e0 "DELETED_MESSAGES.INBOX", items=items@entry=0x12d9aec, result_r=result_r@entry=0x7ffe367f9b40, error_r=error_r@entry=0x7ffe367f9b38) at imap-status.c:84 client = 0x12d8e60 box = 0x1388750 error = MAIL_ERROR_NONE ret = 0 #22 0x000000000040bee7 in list_send_status (flags=<optimized out>, mutf7_name=0x12b8548 "DELETED_MESSAGES.INBOX", name=0x13883e0 "DELETED_MESSAGES.INBOX", ctx=0x12d9ad0) at cmd-list.c:466 result = {status = {messages = 0, recent = 0, unseen = 0, uidvalidity = 0, uidnext = 0, first_unseen_seq = 0, first_recent_uid = 0, last_cached_seq = 0, highest_modseq = 0, keywords = 0x0, permanent_flags = 0, nonpermanent_modseqs = 0, permanent_keywords = 0, allow_new_keywords = 0}, metadata = {guid = '\000' <repeats 15 times>, virtual_size = 0, cache_fields = 0x0, precache_fields = (MAIL_FETCH_DATE | MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE | MAIL_FETCH_VIRTUAL_SIZE | MAIL_FETCH_NUL_STATE | MAIL_FETCH_IMAP_BODY | MAIL_FETCH_FROM_ENVELOPE | MAIL_FETCH_HEADER_MD5 | MAIL_FETCH_UIDL_BACKEND | MAIL_FETCH_MAILBOX_NAME | MAIL_FETCH_GUID | unknown: 16779264)}} ns = <optimized out> error = 0x12b8360 "*" #23 list_namespace_mailboxes (ctx=0x12d9ad0) at cmd-list.c:566 _data_stack_cur_id = 5 info = <optimized out> flags = <optimized out> str = 0x12b83c0 ret = 1 ns = 0x0 mutf7_name = 0x12b8510 name = 0x13883e0 "DELETED_MESSAGES.INBOX" #24 cmd_list_continue (cmd=cmd@entry=0x12d99b0) at cmd-list.c:912 _data_stack_cur_id = 4 ctx = 0x12d9ad0 #25 0x000000000040cb27 in cmd_list_full (cmd=0x12d99b0, lsub=<optimized out>) at cmd-list.c:1092 client = 0x12d8e60 args = 0x12c3968 list_args = 0x12c3a40 arg_count = 0 ctx = 0x12d9ad0 patterns = {arr = {buffer = <optimized out>, element_size = 8}, v = <optimized out>, v_modifiable = <optimized out>} pattern = 0x12b8360 "*" patterns_strarr = <optimized out> str = <optimized out> #26 0x00000000004117fc in command_exec (cmd=cmd@entry=0x12d99b0) at imap-commands.c:148 hook = 0x12c1d00 ret = <optimized out> #27 0x000000000041079b in client_command_input (cmd=cmd@entry=0x12d99b0) at imap-client.c:682 client = 0x12d8e60 command = <optimized out> __FUNCTION__ = "client_command_input" #28 0x0000000000410885 in client_command_input (cmd=0x12d99b0) at imap-client.c:733 client = 0x12d8e60 command = <optimized out> __FUNCTION__ = "client_command_input" #29 0x0000000000410aed in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x12d8e60) at imap-client.c:774 size = 52 #30 client_handle_input (client=client@entry=0x12d8e60) at imap-client.c:786 _data_stack_cur_id = 3 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #31 0x0000000000411302 in client_input (client=0x12d8e60) at imap-client.c:825 cmd = 0x7f4372c69eae <i_set_failure_prefix+46> output = 0x12dde18 bytes = 52 __FUNCTION__ = "client_input" #32 0x00007f4372c76937 in io_loop_call_io (io=0x12d1150) at ioloop.c:379 ioloop = 0x12c06a0 t_id = 2 #33 0x00007f4372c776e7 in io_loop_handler_run (ioloop=ioloop@entry=0x12c06a0) at ioloop-epoll.c:213 ctx = 0x12c0a10 events = <optimized out> list = 0x12d9900 io = <optimized out> tv = {tv_sec = 1799, tv_usec = 999765} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 call = <optimized out> #34 0x00007f4372c764b8 in io_loop_run (ioloop=0x12c06a0) at ioloop.c:398 No locals. #35 0x00007f4372c62113 in master_service_run (service=0x12c0550, callback=callback@entry=0x418f40 <client_connected>) at master-service.c:544 No locals. #36 0x00000000004088e3 in main (argc=2, argv=0x12c0390) at main.c:389 set_roots = {0x41c2a0 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0x12b8090 "/run/dovecot/auth-master", postlogin_socket_path = 0x12b80c0 "/run/dovecot/imap-postlogin", postlogin_timeout_secs = 60, callback = 0x4193d0 <login_client_connected>, failure_callback = 0x4190e0 <login_client_failed>} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out>

5 6

Problem getting quota-warning script to function.
by Ted 10 Oct '18

10 Oct '18

Hello, I'm trying to implement quota enforcement in our mailservers, and it is all working properly except that the quota warnings are not firing when the quota levels are passed. the server stops accepting email when the quota is reached, and you can see tyhe quota usage through the email client connected through, but as the quota passes the set levels the /usr/local/bin/quota-warning.sh script is not called. I checked from the appropriate user and the script executes from the command line with no problem, but dovecot does not invoke it when the quota levels are crossed. The relevant configs are below, any ideas about what the problem may be or how I should approach this? /etc/dovecot/dovecot.conf ## Dovecot configuration file # Protocols we want to be serving. protocols = imap pop3 lmtp sieve mailbox_list_index = yes # Avoid spending excessive time waiting for the quota calculation to finish when # mails' vsizes aren't already cached. If this many mails are opened, finish the # quota calculation on background in indexer-worker process. Mail deliveries will # be assumed to succeed, and explicit quota lookups will return internal error. # (v2.2.28+) # mail_vsize_bg_after_count = 100 plugin { quota_grace = 10%% # 10% is the default # quota_status_success = DUNNO # quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is full" quota_vsizes = yes } service quota-status { executable = quota-status -p postfix inet_listener { port = 10070 # You can choose any port you want } client_limit = 1 } mail_plugins = $mail_plugins quota mail_log notify protocol imap { # Space separated list of plugins to load (default is global mail_plugins). mail_plugins = $mail_plugins imap_quota } # Greeting message for clients. login_greeting = Welcome to easyMail. # Show more verbose process titles (in ps). Currently shows user name and # IP address. Useful for seeing who are actually using the IMAP processes # (eg. shared mailboxes or if same uid is used for multiple accounts). verbose_proctitle = yes # Should all processes be killed when Dovecot master process shuts down. # Setting this to "no" means that Dovecot can be upgraded without # forcing existing client connections to close (although that could also be # a problem if the upgrade is e.g. because of a security fix). shutdown_clients = yes # A config file can also tried to be included without giving an error if # it's not found: !include_try local.conf service auth { unix_listener auth-master { mode = 0600 user = vmail } } /etc/dovecot/dovecot-sql.conf.ext # Database driver: mysql, pgsql, sqlite driver = mysql connect = host=redacted dbname=redacted user=redacted password=reallyredacted # Default password scheme. # # List of supported schemes is in # http://wiki2.dovecot.org/Authentication/PasswordSchemes # default_pass_scheme = CRYPT password_query = select email as user, crypt_password as password, CONCAT('/',volume,'/',SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1)) AS home, 5000 AS uid, 5000 AS gid, concat('*:storage=', volume_limit ,'G') AS quota_rule from easymail_users where email = '%u' and banned = '0' and active = '1' user_query = SELECT CONCAT('maildir:/',volume,'/',SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1),'/Maildir') AS mail, CONCAT('/',volume,'/',SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1)) AS home, 5000 AS uid, 5000 AS gid, concat('*:storage=', volume_limit ,'G') AS quota_rule from easymail_users where email = '%u' and banned = '0' and active = '1' /etc/dovecot/conf.d/90-quota.conf ## ## Quota configuration. ## ## ## Quota warnings ## # You can execute a given command when user exceeds a specified quota limit. # Each quota root has separate limits. Only the command for the first # exceeded limit is excecuted, so put the highest limit first. # The commands are executed via script service by connecting to the named # UNIX socket (quota-warning below). # Note that % needs to be escaped as %%, otherwise "% " expands to empty. plugin { quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=90%% quota-warning 90 %u quota_warning3 = storage=80%% quota-warning 80 %u } # Example quota-warning service. The unix listener's permissions should be # set in a way that mail processes can connect to it. Below example assumes # that mail processes run as vmail user. If you use mode=0666, all system users # can generate quota warnings to anyone. service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = dovecot unix_listener quota-warning { user = dovecot mode = 0666 } } ## ## Quota backends ## # Multiple backends are supported: # dirsize: Find and sum all the files found from mail directory. # Extremely SLOW with Maildir. It'll eat your CPU and disk I/O. # dict: Keep quota stored in dictionary (eg. SQL) # maildir: Maildir++ quota # fs: Read-only support for filesystem quota plugin { #quota = dirsize:User quota #quota = maildir:User quota #quota = dict:User quota::proxy::quota quota = count:User quota #quota = fs:User quota } /usr/local/bin/quota-warning.sh #!/bin/sh # warning email for approaching their quota usage=$1 email=$2 /usr/bin/mailx -r "support(a)easydns.com" -s "Quota Usager Notification" "${email:?}" < /home/vmail/quota"${usage:?}".txt echo "$(date) ${usage} : ${email}" >> /var/log/quotatest.log Thank you Ted easyDNS Technologies

3 9

immediate delete of mails
by tselmeci＠486.hu 10 Oct '18

10 Oct '18

Hello all! I've got a home server running on an ARM Cortex-A7 with my custom Linux distribution. It's also responsible for handling incoming and outgoing mails. The SMTP server is OpenSMTPD-6.0.3p1. I'm using Dovecot-2.3.2.1 to export the mails (mailbox storage format) using IMAP. My old server used to have Dovecot-1.2.0 and honestly, it was absolutely sufficient for me. However, I've decided to use the latest Dovecot on my new system, since all other software components of my system are up-to-date. With my simple IMAP-configuration Dovecot is running fine, expect for one thing: when I press DEL in the mailer client, the mails don't get deleted. They simple reside in the mailbox file. It annoys me a lot, since the mailer client regularly makes them appear with a different (grey) color. The mailer client is Sylpheed and I'm not willing to use another one. I've already tried Thunderbird, Evolution, Claws-mail, Sylpheed, and Sylpheed suits best to my needs. The funny thing is that with the same Sylpheed the old Dovecot was willing to physically remove the mails from mailbox file, but the new Dovecot isn't willing to do so. I've tried to search for an appropriate configuration option, but didn't find what I exactly need. Auto expunge, command-line expunging are nice, but I do want immediate mail delete from mailbox file when I press DEL in the mailer client. I know this can be dangerous and degrades performance. Is there any option to configure Dovecot to behave like this? If it needs to recompile Dovecot I'm also in ;) Thanks a lot! ----------------------------------------------- dovecot -n output: # 2.3.2.1 (0719df592): /etc/dovecot.conf # OS: Linux 4.18.9 armv7l # Hostname: 486 auth_mechanisms = plain login base_dir = /var/run/dovecot/ default_client_limit = 30 default_process_limit = 10 disable_plaintext_auth = no listen = * log_path = /var/log/dovecot.txt mail_gid = 0 mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u mail_uid = 0 namespace { hidden = no inbox = yes list = yes location = mailbox { auto = create special_use = \Drafts name = Drafts } mailbox { auto = create special_use = \Sent name = Sent } mailbox { auto = create special_use = \Trash name = Trash } prefix = type = private name = inbox } passdb { driver = passwd } passdb { driver = shadow } protocols = imap service replication-notify-fifo { name = aggregator } service anvil-auth-penalty { name = anvil } service auth-worker { name = auth-worker } service auth-client { name = auth } service config { name = config } service dict-async { name = dict-async } service dict { name = dict } service login/proxy-notify { name = director } service dns-client { name = dns_client } service doveadm-server { name = doveadm } service imap-hibernate { name = imap-hibernate } service imap { name = imap-login } service imap-urlauth { name = imap-urlauth-login } service imap-urlauth-worker { name = imap-urlauth-worker } service token-login/imap-urlauth { name = imap-urlauth } service imap-master { name = imap } service indexer-worker { name = indexer-worker } service indexer { name = indexer } service ipc { name = ipc } service lmtp { name = lmtp } service log-errors { name = log } service old-stats-mail { name = old-stats } service pop3 { name = pop3-login } service login/pop3 { name = pop3 } service replicator-doveadm { name = replicator } service stats-reader { name = stats } service submission { name = submission-login } service login/submission { name = submission } ssl = no submission_max_mail_size = 0 userdb { driver = passwd } verbose_proctitle = yes -- Selmeci, Tamás http://www.486.hu/

9 16