Urgent - Help needed

Kishore Potnuru

5 May 2020 5 May '20

11:06 a.m.

Hi All,

I am having dovecot installed on my redhat 7. There was an email came to my "Maildir" directory as per the logs. There is an application reading the emails from the Maildir inbox.

I have the log stating the email has been delivered to maildir folder below. But the application team says that they didn't receive the email. The emails is also not there in the Maildir folder. Is there any way/log we can see, from Maildir folder, whether the application picked the email? or where that email went (to any server) from the Maildir folder? any such verification is possible?

============= [root@testserver log]# grep EB6A2206818 temp.log May 5 07:35:20 testserver postfix/smtpd[29839]: EB6A2206818: client=test-server May 5 07:35:20 testserver postfix/cleanup[29842]: EB6A2206818: message-id=<AM0PR01MB42257878E93ED4C6> May 5 07:35:21 testserver postfix/qmgr[29801]: EB6A2206818: from=< tester1@testing.com>, size=13614, nrcpt=1 (queue active) May 5 07:35:21 testserver postfix/virtual[29843]: EB6A2206818: to=< selfemail@testing2.com>, relay=virtual, delay=0.05, delays=0.05/0/0/0, dsn=2.0.0, status=sent (delivered to maildir) May 5 07:35:21 testserver postfix/qmgr[29801]: EB6A2206818: removed

Please help me...

Thanks & Regards, Kishore Potnuru

Attachments:

attachment.html (text/html — 1.6 KB)

Show replies by date

Benny Pedersen

5 May 5 May

11:33 a.m.

On 2020-05-05 10:06, Kishore Potnuru wrote:

...

Please help me...

with more sparse info ?

maillist would like to see

postconf -nf postconf -Mf doveconf -n

how is it setup to delivery virtual transport not using dovecot-lda or dovecot ltmp

do not make file system access to mails, use imap or pop3 protocols

as i read sparse info you are not using dovecot, so be it

Kishore Potnuru

12:02 p.m.

I am using pop3/imap, see the below file. We can't verify any logs? This is working fine from last one year. as part of testing we just stopped the services for 20minutes and restarted the dovecot and postfix server using "service stop/start". No issues so far...

I would like know, if the application is reading the emails from the server, do we have any log in our server to see the same? Because I see them when the email is coming to the folder. I see them that they are deleted , once they are reading by the application. But application is not taking all the emails. few are missing, application team says. I want to tell them and show the logs that these are read by your server/application. that is my idea....

[root@server new]# doveconf -n # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-693.17.1.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.4 (Maipo) xfs disable_plaintext_auth = no listen = * log_path = /var/log/dovecot.log

mail_location = maildir:/kw/home/pop/%d/%n/Maildir/ passdb { args = /etc/dovecot/passwd driver = passwd-file } pop3_uidl_format = %g protocols = imap pop3 ssl_cert =

On Tue, May 5, 2020 at 9:33 AM Benny Pedersen me@junc.eu wrote:

...

On 2020-05-05 10:06, Kishore Potnuru wrote:

...
Please help me...

with more sparse info ?

maillist would like to see

postconf -nf postconf -Mf doveconf -n

how is it setup to delivery virtual transport not using dovecot-lda or dovecot ltmp

do not make file system access to mails, use imap or pop3 protocols

as i read sparse info you are not using dovecot, so be it

Tamsy

12:54 p.m.

*From:* Kishore Potnuru [mailto:kishore.reachme@gmail.com] *Sent:* Tuesday, May 5, 2020, 4:02 PM *To:* Benny Pedersen; Dovecot Mailing List *Subject:* Urgent - Help needed

...

I am using pop3/imap, see the below file. We can't verify any logs? This is working fine from last one year. as part of testing we just stopped the services for 20minutes and restarted the dovecot and postfix server using "service stop/start". No issues so far...

I would like know, if the application is reading the emails from the server, do we have any log in our server to see the same? Because I see them when the email is coming to the folder. I see them that they are deleted , once they are reading by the application. But application is not taking all the emails. few are missing, application team says. I want to tell them and show the logs that these are read by your server/application. that is my idea....

[root@server new]# doveconf -n # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-693.17.1.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.4 (Maipo) xfs disable_plaintext_auth = no listen = * log_path = /var/log/dovecot.log

mail_location = maildir:/kw/home/pop/%d/%n/Maildir/ passdb { args = /etc/dovecot/passwd driver = passwd-file } pop3_uidl_format = %g protocols = imap pop3 ssl_cert =
On Tue, May 5, 2020 at 9:33 AM Benny Pedersen mailto:me@junc.eu> wrote:
On 2020-05-05 10:06, Kishore Potnuru wrote:

> Please help me...

with more sparse info ?

maillist would like to see

postconf -nf
postconf -Mf
doveconf -n

how is it setup to delivery virtual transport not using
dovecot-lda or
dovecot ltmp

do not make file system access to mails, use imap or pop3 protocols

as i read sparse info you are not using dovecot, so be it

As Huangbin and Benny already pointed it out and what is cleary shown by the log-snippet:

May 5 07:35:21 testserver postfix/virtual[29843]: EB6A2206818: to=selfemail@testing2.com, relay=virtual, delay=0.05, delays=0.05/0/0/0, dsn=2.0.0, status=sent (delivered to maildir)

It is *NOT* Dovecot which is doing the final delivery of messages into the users mailbox.

Furthermore if the mailist is asking you for the output of: postconf -nf postconf -Mf doveconf -n

but you only send some (very sparse) snippets out of it which nearly have no relevance to the problem you are describing you can not expect real support from the list.

Kishore Potnuru

2:25 p.m.

Hi All,

Please find the requested details:

[root@testserver new]# doveconf -n # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-693.17.1.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.4 (Maipo) xfs disable_plaintext_auth = no listen = * log_path = /var/log/dovecot.log mail_location = maildir:/kw/home/pop/%d/%n/Maildir/ passdb { args = /etc/dovecot/passwd driver = passwd-file } pop3_uidl_format = %g protocols = imap pop3 ssl_cert =

[root@testserver new]# postconf -nf alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases command_directory = /usr/sbin config_directory = /etc/postfix daemon_directory = /usr/libexec/postfix data_directory = /var/lib/postfix debug_peer_level = 2 debugger_command = PATH=/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin ddd $daemon_directory/$process_name $process_id & sleep 5 html_directory = no inet_interfaces = testserver.baplc.com inet_protocols = all mail_owner = postfix mailq_path = /usr/bin/mailq.postfix manpage_directory = /usr/share/man mydestination = $myhostname, localhost.$mydomain, localhost myhostname = localhost newaliases_path = /usr/bin/newaliases.postfix queue_directory = /var/spool/postfix readme_directory = /usr/share/doc/postfix-2.10.1/README_FILES sample_directory = /usr/share/doc/postfix-2.10.1/samples sendmail_path = /usr/sbin/sendmail.postfix setgid_group = postdrop unknown_local_recipient_reject_code = 550 virtual_alias_maps = hash:/etc/postfix/valias.txt virtual_gid_maps = static:500 virtual_mailbox_base = /kw/home/pop virtual_mailbox_domains = /etc/postfix/vhosts.txt virtual_mailbox_maps = hash:/etc/postfix/vmaps.txt virtual_uid_maps = static:500

[root@testserver new]# postconf -Mf smtp inet n - n - - smtpd pickup unix n - n 60 1 pickup cleanup unix n - n - 0 cleanup qmgr unix n - n 300 1 qmgr tlsmgr unix - - n 1000? 1 tlsmgr rewrite unix - - n - - trivial-rewrite bounce unix - - n - 0 bounce defer unix - - n - 0 bounce trace unix - - n - 0 bounce verify unix - - n - 1 verify flush unix n - n 1000? 0 flush proxymap unix - - n - - proxymap proxywrite unix - - n - 1 proxymap smtp unix - - n - - smtp relay unix - - n - - smtp showq unix n - n - - showq error unix - - n - - error retry unix - - n - - error discard unix - - n - - discard local unix - n n - - local virtual unix - n n - - virtual lmtp unix - - n - - lmtp anvil unix - - n - 1 anvil scache unix - - n - 1 scache

Thanks & Regards, Kishore Potnuru

On Tue, May 5, 2020 at 10:54 AM Tamsy dovecot-list@mohtex.net wrote:

...

*From:* Kishore Potnuru [mailto:kishore.reachme@gmail.com kishore.reachme@gmail.com] *Sent:* Tuesday, May 5, 2020, 4:02 PM *To:* Benny Pedersen; Dovecot Mailing List *Subject:* Urgent - Help needed

I am using pop3/imap, see the below file. We can't verify any logs? This is working fine from last one year. as part of testing we just stopped the services for 20minutes and restarted the dovecot and postfix server using "service stop/start". No issues so far...

I would like know, if the application is reading the emails from the server, do we have any log in our server to see the same? Because I see them when the email is coming to the folder. I see them that they are deleted , once they are reading by the application. But application is not taking all the emails. few are missing, application team says. I want to tell them and show the logs that these are read by your server/application. that is my idea....

[root@server new]# doveconf -n # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-693.17.1.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.4 (Maipo) xfs disable_plaintext_auth = no listen = * log_path = /var/log/dovecot.log

mail_location = maildir:/kw/home/pop/%d/%n/Maildir/ passdb { args = /etc/dovecot/passwd driver = passwd-file } pop3_uidl_format = %g protocols = imap pop3 ssl_cert =
On Tue, May 5, 2020 at 9:33 AM Benny Pedersen me@junc.eu wrote:

...
On 2020-05-05 10:06, Kishore Potnuru wrote:

...
Please help me...

with more sparse info ?

maillist would like to see

postconf -nf postconf -Mf doveconf -n

how is it setup to delivery virtual transport not using dovecot-lda or dovecot ltmp

do not make file system access to mails, use imap or pop3 protocols

as i read sparse info you are not using dovecot, so be it

As Huangbin and Benny already pointed it out and what is cleary shown by the log-snippet:

May 5 07:35:21 testserver postfix/virtual[29843]: EB6A2206818: to= selfemail@testing2.com selfemail@testing2.com, relay=virtual, delay=0.05, delays=0.05/0/0/0, dsn=2.0.0, status=sent (delivered to maildir)

It is *NOT* Dovecot which is doing the final delivery of messages into the users mailbox.

Furthermore if the mailist is asking you for the output of: postconf -nf postconf -Mf doveconf -n

but you only send some (very sparse) snippets out of it which nearly have no relevance to the problem you are describing you can not expect real support from the list.

Benny Pedersen

3:01 p.m.

On 2020-05-05 13:25, Kishore Potnuru wrote:

...

Hi All,

Please find the requested details:

here is help then

dovecot side:

https://doc.dovecot.org/configuration_manual/protocols/lmtp_server/

postfix side:

https://wiki.dovecot.org/HowTo/PostfixDovecotLMTP

after that joy

Kishore Potnuru

4:03 p.m.

Hi Benny and Dovecot,

Thanks for the reply.

Actually my question is, is it possible to verify anything now whether the email has been pulled by application/server from the "Maildir/new" or "Maildir/cur" folder in my POP3 server? at present I am not using lmtp yet.

When I configured the outlook to access the one of the email box in the server, I get the email. But do we have any log in POP3 server, stating the email has been to sent to Outlook?

Thanks & Regards, Kishore Potnuru

On Tue, May 5, 2020 at 1:02 PM Benny Pedersen me@junc.eu wrote:

...

On 2020-05-05 13:25, Kishore Potnuru wrote:

...
Hi All,

Please find the requested details:

here is help then

dovecot side:

https://doc.dovecot.org/configuration_manual/protocols/lmtp_server/

postfix side:

https://wiki.dovecot.org/HowTo/PostfixDovecotLMTP

after that joy

Sami Ketola

4:27 p.m.

Hi,

With dovecot 2.2 you can log some events with mail_log plugin.

https://doc.dovecot.org/configuration_manual/plugins/mail_event_logging/ https://doc.dovecot.org/configuration_manual/plugins/mail_event_logging/

Sami

...

On 5. May 2020, at 16.03, Kishore Potnuru kishore.reachme@gmail.com wrote:

Hi Benny and Dovecot,

Thanks for the reply.

Actually my question is, is it possible to verify anything now whether the email has been pulled by application/server from the "Maildir/new" or "Maildir/cur" folder in my POP3 server? at present I am not using lmtp yet.

When I configured the outlook to access the one of the email box in the server, I get the email. But do we have any log in POP3 server, stating the email has been to sent to Outlook?

Thanks & Regards, Kishore Potnuru

On Tue, May 5, 2020 at 1:02 PM Benny Pedersen mailto:me@junc.eu> wrote: On 2020-05-05 13:25, Kishore Potnuru wrote:

...
Hi All,

Please find the requested details:

here is help then

dovecot side:

https://doc.dovecot.org/configuration_manual/protocols/lmtp_server/ https://doc.dovecot.org/configuration_manual/protocols/lmtp_server/

postfix side:

https://wiki.dovecot.org/HowTo/PostfixDovecotLMTP https://wiki.dovecot.org/HowTo/PostfixDovecotLMTP

after that joy

Kishore Potnuru

7 May 7 May

12:45 p.m.

Hi All,

Thank you for your replies and Suggestions. But, I still not clear on my question. But It's live production server. At present I cannot make any changes to it. That will take a long process to make any on this server. At present my concern is,

To my server (dovecot, postfix, POP3/Imap protocol), I am getting the emails in my dovecot structured directory "Maildir/new". Once the person/application (example: Microsoft Outlook) read the email, they are moving to "Maildir/cur". If they are deleting the file from Outlook, that will be deleted from the "Maildir/cur" folder also. I have Outlook as an example here. few email boxes are accessed by Outlook and few more email boxes are accessed by an application, where they configure in their application/outlook, to point out my server to read/access the emails.

I am repeating the same question again, From our server (where postfix, dovecot with pop3/imap protocol installed) knowing any ways (logs, incidents,alerts or any) that Outlook or application read/accessed/deleted the email which is in "Maildir/new" or "Maildir/cur" folder? This is my current issue.

I am sorry for more concerning you guys asking the same question again and again. I am trying find the exact/correct answer on my current issue. I am new to this environment and new to dovecot/postfix also. working from last 3 to 6 months. This environment was designed by some other guy who left the company. I had to take this responsibility to support. I am kind of bit struggling. Please help.

Thanks, Kishore Potnuru

On Tue, May 5, 2020 at 2:27 PM Sami Ketola Sami.Ketola@open-xchange.com wrote:

...

Hi,

With dovecot 2.2 you can log some events with mail_log plugin.

https://doc.dovecot.org/configuration_manual/plugins/mail_event_logging/

Sami

On 5. May 2020, at 16.03, Kishore Potnuru kishore.reachme@gmail.com wrote:

Hi Benny and Dovecot,

Thanks for the reply.

Actually my question is, is it possible to verify anything now whether the email has been pulled by application/server from the "Maildir/new" or "Maildir/cur" folder in my POP3 server? at present I am not using lmtp yet.

When I configured the outlook to access the one of the email box in the server, I get the email. But do we have any log in POP3 server, stating the email has been to sent to Outlook?

Thanks & Regards, Kishore Potnuru

On Tue, May 5, 2020 at 1:02 PM Benny Pedersen me@junc.eu wrote:

...
On 2020-05-05 13:25, Kishore Potnuru wrote:

...
Hi All,

Please find the requested details:

here is help then

dovecot side:

https://doc.dovecot.org/configuration_manual/protocols/lmtp_server/

postfix side:

https://wiki.dovecot.org/HowTo/PostfixDovecotLMTP

after that joy

Sami Ketola

1 p.m.

New subject: [EXT] Urgent - Help needed

...

On 7. May 2020, at 12.45, Kishore Potnuru kishore.reachme@gmail.com wrote:

Hi All,

Thank you for your replies and Suggestions. But, I still not clear on my question. But It's live production server. At present I cannot make any changes to it. That will take a long process to make any on this server. At present my concern is,

To my server (dovecot, postfix, POP3/Imap protocol), I am getting the emails in my dovecot structured directory "Maildir/new". Once the person/application (example: Microsoft Outlook) read the email, they are moving to "Maildir/cur". If they are deleting the file from Outlook, that will be deleted from the "Maildir/cur" folder also. I have Outlook as an example here. few email boxes are accessed by Outlook and few more email boxes are accessed by an application, where they configure in their application/outlook, to point out my server to read/access the emails.

I am repeating the same question again, From our server (where postfix, dovecot with pop3/imap protocol installed) knowing any ways (logs, incidents,alerts or any) that Outlook or application read/accessed/deleted the email which is in "Maildir/new" or "Maildir/cur" folder? This is my current issue.

I am sorry for more concerning you guys asking the same question again and again. I am trying find the exact/correct answer on my current issue. I am new to this environment and new to dovecot/postfix also. working from last 3 to 6 months. This environment was designed by some other guy who left the company. I had to take this responsibility to support. I am kind of bit struggling. Please help.

And you have already been told the answer.

mail_log plugin is your friend here. Configure it to log at least "delete undelete expunge" events to log if that outlook deletes the mail. See https://doc.dovecot.org/configuration_manual/plugins/mail_event_logging/ https://doc.dovecot.org/configuration_manual/plugins/mail_event_logging/

also if you want to check if that outlook does read the mail (ie. mail gets moved from new to cur) you need to configure imap_logout_format and pop3_logout_format to show number of mails fetched. see: https://doc.dovecot.org/settings/core/ https://doc.dovecot.org/settings/core/

Sami

Benny Pedersen

5 May 5 May

4:30 p.m.

On 2020-05-05 15:03, Kishore Potnuru wrote:

...

Actually my question is, is it possible to verify anything now whether the email has been pulled by application/server from the "Maildir/new" or "Maildir/cur" folder in my POP3 server? at present I am not using lmtp yet.

https://doc.dovecot.org/admin_manual/logging/

are google your enemys ?

...

When I configured the outlook to access the one of the email box in the server, I get the email. But do we have any log in POP3 server, stating the email has been to sent to Outlook?

pop3 will remove emails on server

if that happens google aid4mail to recovery and resolve lost mails on server

Sami Ketola

4:36 p.m.

...

On 5. May 2020, at 16.30, Benny Pedersen me@junc.eu wrote:

On 2020-05-05 15:03, Kishore Potnuru wrote:

...
Actually my question is, is it possible to verify anything now whether the email has been pulled by application/server from the "Maildir/new" or "Maildir/cur" folder in my POP3 server? at present I am not using lmtp yet.

https://doc.dovecot.org/admin_manual/logging/

are google your enemys ?

...
When I configured the outlook to access the one of the email box in the server, I get the email. But do we have any log in POP3 server, stating the email has been to sent to Outlook?

pop3 will remove emails on server

It is a client setting to delete or leave mails on server with pop3.

Sami

Benny Pedersen

4:50 p.m.

On 2020-05-05 15:36, Sami Ketola wrote:

...

...
pop3 will remove emails on server It is a client setting to delete or leave mails on server with pop3.

users often ask where is my mail....

have pop3 still enabled in dovecot is not needed at all

Alexander Dalloz

8:55 p.m.

Am 05.05.2020 um 13:25 schrieb Kishore Potnuru:

...

# OS: Linux 3.10.0-693.17.1.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.4 (Maipo) xfs

Hell, update your system!

Current versions:

[root@ocp ~]# uname -a Linux ocp.sys5.org 3.10.0-1127.el7.x86_64 #1 SMP Tue Mar 31 23:36:51 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux [root@ocp ~]# cat /etc/redhat-release CentOS Linux release 7.8.2003 (Core)

Alexander

Benny Pedersen

9:05 p.m.

On 2020-05-05 19:55, Alexander Dalloz wrote:

...

Am 05.05.2020 um 13:25 schrieb Kishore Potnuru:

...
# OS: Linux 3.10.0-693.17.1.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.4 (Maipo) xfs

Hell, update your system!

enterprise

...

[root@ocp ~]# uname -a Linux ocp.sys5.org 3.10.0-1127.el7.x86_64 #1 SMP Tue Mar 31 23:36:51 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux [root@ocp ~]# cat /etc/redhat-release CentOS Linux release 7.8.2003 (Core)

not enterprise

nice try

Alexander Dalloz

9:15 p.m.

Am 05.05.2020 um 20:05 schrieb Benny Pedersen:

...

On 2020-05-05 19:55, Alexander Dalloz wrote:

...
Am 05.05.2020 um 13:25 schrieb Kishore Potnuru:

...
# OS: Linux 3.10.0-693.17.1.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.4 (Maipo) xfs

Hell, update your system!

enterprise

...
[root@ocp ~]# uname -a Linux ocp.sys5.org 3.10.0-1127.el7.x86_64 #1 SMP Tue Mar 31 23:36:51 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux [root@ocp ~]# cat /etc/redhat-release CentOS Linux release 7.8.2003 (Core)

not enterprise

nice try

Sorry, you are confused and your reply does not make any sense.

RHEL's current major release has minor version 8. It does not matter that my command outputs come from CentOS 7.8.

RHEL 7.4 is EOL, came out in 2017 and superseeded by plenty of important updates. Such a system is at high risk.

Please inform yourself before posting such snarks comments.

Alexander

Benny Pedersen

9:21 p.m.

On 2020-05-05 20:15, Alexander Dalloz wrote:

...

Please inform yourself before posting such snarks comments.

if i ever need precompiled problems i would use slackware

if i need opensource i would choice freebsd or gentoo

have a nice day

https://www.kernel.org/ have kernel 5.6.10 stable now

Marc Roos

9:34 p.m.

? It is a remark about that server software is dramatically outdated, and you turn it into distribution discussion? I can understand the choice for paid support by Kishore. Redhat has biggest professional workforce and now it is under the umbrella of ibm, I like them even more. In production I would not run anything other than rhel/centos.

-----Original Message----- To: dovecot@dovecot.org Subject: Re: Urgent - Help needed

On 2020-05-05 20:15, Alexander Dalloz wrote:

...

Please inform yourself before posting such snarks comments.

if i ever need precompiled problems i would use slackware

if i need opensource i would choice freebsd or gentoo

have a nice day

https://www.kernel.org/ have kernel 5.6.10 stable now

1656

Age (days ago)

1658

Last active (days ago)

List overview

17 comments

7 participants

participants (7)

Alexander Dalloz
Benny Pedersen
Kishore Potnuru
Marc Roos
Sami Ketola
Sami Ketola
Tamsy

Urgent - Help needed

Sami Ketola

Sami Ketola

Marc Roos

tags

participants (7)