[Dovecot] Missing Emails
I reported a problem with disappearing emails on my Apple Mountain Lion server. Not sure if it ever stopped but I do know it is happening again.
Help!!!! This is a company email server. They live and die by their emails.
Emails show up in inbox and then disappear.
Anyone know why our emails are disappearing?
I see a reference to it in the dovecot.index.cache file (last item)
^@^@^@Q^@^@^@0^@^@^@^@^@^@^@Message-ID: 1356660917.93498.YahooMailNeo@web163605.mail.gq1.yahoo.com ^@^@^@^M^@^@^@7^@^@^@4^@^@^@^@^@^@^@Subject: Funeral program for Eileen Zbignewich ^@^E^@^@^@^@^@^@^@^F^@^@^@Z^@^@^@7^@^@^@^@^@^@^@Content-Type: multipart/mixed; boundary="-1578497492-264297203-1356660917=:93498" ^@^@^G^@^@^@4^@^@^@1^@^@^@^@^@^@^@Date: Thu, 27 Dec 2012 18:15:17 -0800 (PST) ^@^@^@^@^@^@^@^K^@^@^@^@^@^@^@^L^@^@^@^@^@^@^@^N^@^@^@8^@^@^@5^@^@^@^@^@^@^@To: "info@mmpcrofton.com" info@mmpcrofton.com
I searched the filesystem and cannot find them.
bash-3.2# find . -exec grep Zbignewich {} \; -print
Dec 04 00:30:26 master: Info: Dovecot v2.0.19apple1 starting up (core dumps disabled)
I believe I turned on all debug and info messages.
Here is what I see in postfix log:
Dec 27 21:15:39 mini.mmpcrofton.com postfix/smtpd[20081]: 3CE164F4420: client=pascal.junkemailfilter.com[184.105.182.188] Dec 27 21:15:39 mini.mmpcrofton.com postfix/cleanup[20086]: 3CE164F4420: message-id=1356660917.93498.YahooMailNeo@web163605.mail.gq1.yahoo.com Dec 27 21:15:40 mini.mmpcrofton.com postfix/qmgr[95]: 3CE164F4420: from=hagermary@yahoo.com, size=307659, nrcpt=1 (queue active) Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20081]: disconnect from pascal.junkemailfilter.com[184.105.182.188] Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20106]: connect from localhost[127.0.0.1] Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20106]: 5168E4F4447: client=localhost[127.0.0.1] Dec 27 21:15:40 mini.mmpcrofton.com postfix/cleanup[20086]: 5168E4F4447: message-id=1356660917.93498.YahooMailNeo@web163605.mail.gq1.yahoo.com Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtpd[20106]: disconnect from localhost[127.0.0.1] Dec 27 21:15:40 mini.mmpcrofton.com postfix/qmgr[95]: 5168E4F4447: from=hagermary@yahoo.com, size=308299, nrcpt=1 (queue active) Dec 27 21:15:40 mini.mmpcrofton.com postfix/smtp[20102]: 3CE164F4420: to=info@mmpcrofton.com, relay=127.0.0.1[127.0.0.1]:10024, delay=1.1, delays=0.85/0.01/0/0.27, dsn=2.0.0, status=sent (250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as 5168E4F4447) Dec 27 21:15:40 mini.mmpcrofton.com postfix/qmgr[95]: 3CE164F4420: removed Dec 27 21:15:40 mini.mmpcrofton.com postfix/pipe[20110]: 5168E4F4447: to=graphicartist@mini.mmpcrofton.com, orig_to=info@mmpcrofton.com, relay=dovecot, delay=0.39, delays=0.03/0.01/0/0.35, dsn=2.0.0, status=sent (delivered via dovecot service) Dec 27 21:15:41 mini.mmpcrofton.com postfix/qmgr[95]: 5168E4F4447: removed
dovecot_info.log Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: msgid=1356660917.93498.YahooMailNeo@web163605.mail.gq1.yahoo.com: saved mail to INBOX Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: push-notify: push notification enabled Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: push-notify: notify: graphicartist Dec 27 21:15:40 lda(pid 20111 user graphicartist): Info: push-notify: data sent: 1680
dovecot_debug.log Dec 27 21:15:40 lda: Debug: Loading modules from directory: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib10_quota_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib20_fts_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib20_push_notify_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib20_zlib_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib21_fts_sk_plugin.so Dec 27 21:15:40 lda: Debug: Module loaded: /Applications/Server.app/Contents/ServerRoot/usr/lib/dovecot/lib90_sieve_plugin.so Dec 27 21:15:40 lda: Debug: auth input: graphicartist uid=214 gid=6 quota=maildir:User quota:noenforcing quota_rule=*:storage=0 mail=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 mail_location=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve sieve_dir=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve_storage=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/quota=maildir:User quota:noenforcing Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/quota_rule=*:storage=0 Dec 27 21:15:40 lda: Debug: Added userdb setting: mail=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: mail_location=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/sieve=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/sieve_dir=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda: Debug: Added userdb setting: plugin/sieve_storage=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Effective uid=214, gid=6, home= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota root: name=User quota backend=maildir args=noenforcing Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota rule: root=User quota mailbox=* bytes=0 messages=0 Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota warning: bytes=0 (100%) messages=0 reverse=no command=quota-exceeded graphicartist Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: maildir++: root=/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6, index=, control=, inbox=/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6, alt= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota root: name=User quota backend=maildir args= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Quota warning: bytes=0 (100%) messages=0 reverse=no command=quota-exceeded graphicartist Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: none: root=, index=, control=, inbox=, alt= Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: fts_sk: Disabled with in-memory indexes Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: fts: No backends enabled by the fts setting Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: Destination address: graphicartist@mini.mmpcrofton.com (source: user@hostname) Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: auth input: graphicartist uid=214 gid=6 quota=maildir:User quota:noenforcing quota_rule=*:storage=0 mail=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 mail_location=maildir:/Library/Server/Mail/Data/mail/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve sieve_dir=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 sieve_storage=/Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6 Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: user's script path /Library/Server/Mail/Data/rules/B5E3E436-DEA0-4D5A-A5DF-34D6AB56FED6/dovecot.sieve doesn't exist (using global script path in stead) Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: user has no valid personal script Dec 27 21:15:40 lda(pid 20111 user graphicartist): Debug: sieve: no scripts to execute: reverting to default delivery.
Anyone know why our emails are disappearing?
David Morsberger dave@morsberger.com wrote:
I reported a problem with disappearing emails on my Apple Mountain Lion server. Not sure if it ever stopped but I do know it is happening again.
Help!!!! This is a company email server. They live and die by their emails.
Emails show up in inbox and then disappear.
Anyone know why our emails are disappearing?
You should configure the mail_log plugin to log all actions clients do to your mails: http://wiki2.dovecot.org/Plugins/MailLog
I've had to debug similar problems in the past time (on a different IMAP server) and in _all_ cases it was something the user did, like having a client downloading the mails via POP3 (and forgetting about this) and complaining about missing mails from "the Webmailer Website". Or having configured a filter inside Thunderbird (and forgetting about this), instructing the client to delete mails matching a special rule.
I see a reference to it in the dovecot.index.cache file (last item)
If there is a reference in this file, the mail must have reached dovecot. So the next step would be to find out, _what exactly_ the client does with it. See mail_log again.
Grüße, Sven.
-- Sigmentation fault. Core dumped.
Sven,
Thanks for the response.
Nobody should be using pop3. The missing email appears to be random. I believe pop downloads would delete them all. I have now turned off pop3.
Would a mail rule place it in the 'Trash'? I did not find the email on the file system. I'm trying a wider search.
I followed the instructions on the wiki but it still doesn't appear to be logging everything.
conf.d/10-logging.conf
# Log file to use for informational messages. Defaults to log_path. #info_log_path = info_log_path = /Library/Logs/Mail/dovecot_info.log # Log file to use for debug messages. Defaults to info_log_path. debug_log_path = /Library/Logs/Mail/dovecot_debug.log
mail_plugins = $mail_plugins mail_log notify
plugin { # Events to log. Also available: flag_change append mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append # Available fields: uid, box, msgid, from, subject, size, vsize, flags # size and vsize are available only for expunge and copy events. mail_log_fields = uid box msgid size from subject size flags }
I am not seeing messages of the following form in the dovecot_debug.log or dovecot_info.log imap(user): copy -> Trash: uid=908, msgid=123.foo@bar imap(user): deleted: uid=908, msgid=123.foo@bar imap(user): expunged: uid=908, msgid=123.foo@bar
On Dec 27, 2012, at 10:54 PM, Sven Hartge sven@svenhartge.de wrote:
David Morsberger dave@morsberger.com wrote:
I reported a problem with disappearing emails on my Apple Mountain Lion server. Not sure if it ever stopped but I do know it is happening again.
Help!!!! This is a company email server. They live and die by their emails.
Emails show up in inbox and then disappear.
Anyone know why our emails are disappearing?
You should configure the mail_log plugin to log all actions clients do to your mails: http://wiki2.dovecot.org/Plugins/MailLog
I've had to debug similar problems in the past time (on a different IMAP server) and in _all_ cases it was something the user did, like having a client downloading the mails via POP3 (and forgetting about this) and complaining about missing mails from "the Webmailer Website". Or having configured a filter inside Thunderbird (and forgetting about this), instructing the client to delete mails matching a special rule.
I see a reference to it in the dovecot.index.cache file (last item)
If there is a reference in this file, the mail must have reached dovecot. So the next step would be to find out, _what exactly_ the client does with it. See mail_log again.
Grüße, Sven.
-- Sigmentation fault. Core dumped.
participants (2)
-
David Morsberger
-
Sven Hartge