[Dovecot] New messages notification - (IMAP PUSH?)
Hello all.
I have strange problem. As I understand IMAP use server2client command to tell what new email is arrived.
So - all was good, but few weeks ago I notice what my thunderbird not show new messages. I think it was local problem(I switch distro what day) but soon my email clients what uses mostly Outlook-2007-SP1 start to confirm this problem.
What can it be and how can I fix it? I use Dovecot on FreeBSD-7.1
#pkg_info | grep dovecot dovecot-1.1.11 dovecot-managesieve-0.10.5 dovecot-sieve-1.1.6
#dovecot -n # 1.1.11: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.1-RELEASE-p3 i386 ufs base_dir: /var/run/dovecot/ log_path: /var/log/dovecot/dovecot.log info_log_path: /var/log/dovecot/dovecot-debug.log protocols: imap imaps pop3 pop3s managesieve listen(default): * listen(imap): * listen(pop3): * listen(managesieve): *:2000 ssl_ca_file: /usr/local/etc/certs/GlobalSignCA.crt ssl_cert_file: /usr/local/etc/certs/fxclub_org.crt ssl_key_file: /usr/local/etc/certs/fxclub_org.key ssl_cipher_list: ALL:!LOW:!SSLv2 login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_executable(managesieve): /usr/local/libexec/dovecot/managesieve-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_greeting_capability(managesieve): no login_process_size: 128 login_processes_count: 20 login_max_processes_count: 512 mail_max_userip_connections(default): 256 mail_max_userip_connections(imap): 256 mail_max_userip_connections(pop3): 20 mail_max_userip_connections(managesieve): 10 verbose_proctitle: yes first_valid_gid: 0 mail_privileged_group: mail mail_uid: dmail mail_gid: dmail mail_location(default): maildir:/var/spool/dovecot/domains/%d/%n/ mail_location(imap): maildir:/var/spool/dovecot/domains/%d/%n/ mail_location(pop3): maildir:/var/spool/dovecot/domains/%d/%n/ mail_location(managesieve): mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_executable(managesieve): /usr/local/libexec/dovecot/managesieve mail_process_size: 512 mail_plugins(default): quota imap_quota autocreate mail_plugins(imap): quota imap_quota autocreate mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 mail_plugin_dir(managesieve): /usr/local/lib/dovecot/managesieve imap_client_workarounds(default): delay-newmail tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail tb-extra-mailbox-sep imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): sieve_storage(default): sieve_storage(imap): sieve_storage(pop3): sieve_storage(managesieve): % sieve(default): sieve(imap): sieve(pop3): sieve(managesieve): ~/.dovecot.sieve auth default: mechanisms: plain login user: dovecot-auth username_format: %Lu verbose: yes worker_max_count: 100 passdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf userdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 user: exim master: path: /var/run/dovecot/auth-master mode: 384 user: dmail plugin: quota: maildir quota_rule: *:storage=1024M quota_rule2: Trash:storage=1256M quota_rule3: SPAM:ignore quota_warning: storage=80%% /usr/local/bin/quota-warning.sh 80 quota_warning2: storage=95%% /usr/local/bin/quota-warning.sh 95 autocreate: Trash autocreate2: Sent autocreate3: Spam autosubscribe: Trash autosubscribe2: Sent autosubscribe3: Spam
-- Best regards, Proskurin Kirill
Proskurin Kirill wrote:
Hello all.
I have strange problem. As I understand IMAP use server2client command to tell what new email is arrived.
So - all was good, but few weeks ago I notice what my thunderbird not show new messages. I think it was local problem(I switch distro what day) but soon my email clients what uses mostly Outlook-2007-SP1 start to confirm this problem.
What can it be and how can I fix it?
Do the messages not show up at all? Or do they not show as new?
If you have two mail clients running at the same time, one will miss out on the 'new message' notices.
-- Curtis Maloney cmaloney@cardgate.net
Curtis Maloney wrote:
Proskurin Kirill wrote:
Hello all.
I have strange problem. As I understand IMAP use server2client command to tell what new email is arrived.
So - all was good, but few weeks ago I notice what my thunderbird not show new messages. I think it was local problem(I switch distro what day) but soon my email clients what uses mostly Outlook-2007-SP1
start to confirm this problem.What can it be and how can I fix it?
Do the messages not show up at all? Or do they not show as new?
If you have two mail clients running at the same time, one will miss out on the 'new message' notices.
They not show at all. Then I click at IMAP folder - they start to show at that folder. I have about 40 IMAP folders - and it is hard to push at every folder minute after minute. ;-)
I not change anything at config and really dont know why this problem appears. And I dont know how to test it by IMAP commands.
-- Best regards, Proskurin Kirill
On May 5, 2009, at 2:05 AM, Proskurin Kirill wrote:
What can it be and how can I fix it? Do the messages not show up at all? Or do they not show as new? If you have two mail clients running at the same time, one will
miss out on the 'new message' notices.They not show at all. Then I click at IMAP folder - they start to
show at that folder. I have about 40 IMAP folders - and it is hard
to push at every folder minute after minute. ;-)I not change anything at config and really don
t know why this problem appears. And I dont know how to test it by IMAP commands.
The only way this might be Dovecot's fault is if STATUS commands don't
see the new mail. For example:
a STATUS mailboxname (MESSAGES UNSEEN)
If running that command sees updated values, the problem is with
Thunderbird which probably doesn't even try to send that command then.
I don't really know if TB normally does that or not, most other
clients do anyway.
See also http://wiki.dovecot.org/TestInstallation for how to login/etc.
Timo Sirainen wrote:
The only way this might be Dovecot's fault is if STATUS commands don't see the new mail. For example:
a STATUS mailboxname (MESSAGES UNSEEN)
If running that command sees updated values, the problem is with Thunderbird which probably doesn't even try to send that command then. I don't really know if TB normally does that or not, most other clients do anyway.
See also http://wiki.dovecot.org/TestInstallation for how to login/etc.
b STATUS Inbox (MESSAGES UNSEEN)
- STATUS "Inbox" (MESSAGES 1267 UNSEEN 15) b OK Status completed.
I notice what time after time in _some_ mailboxes all seems good. I use TB 2.0.0.21 and my clients use Outlook 2007 SP1. Problem appears seems to at one day and client independent.
I running out of ideas.
-- Best regards, Proskurin Kirill
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
On Wed, 6 May 2009, Proskurin Kirill wrote:
b STATUS Inbox (MESSAGES UNSEEN)
- STATUS "Inbox" (MESSAGES 1267 UNSEEN 15) b OK Status completed.
I notice what time after time in _some_ mailboxes all seems good. I use TB 2.0.0.21 and my clients use Outlook 2007 SP1. Problem appears seems to at one day and client independent.
In response to Curtis Maloney you've wrote:
If you have two mail clients running at the same time, one will miss out on the 'new message' notices.
They not show at all. Then I click at IMAP folder - they start to show at that folder. I have about 40 IMAP folders - and it is hard to push at every folder minute after minute. ;-)
TB gets the messages, but it does not get the new-messages notice, because another client has the same mailbox selected. Once you click in TB on the folder, TB's view of the mailbox is sync'ed with the content of the mailbox on the server.
In my mind, you have two solutions:
a) use shared mailboxes with per-user "SEEN" flag
b) force TB to sync all the folders now and then. I do this with the "offline" settings. Dunno if you can automate this feature.
Bye,
Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux)
iQEVAwUBSgFQ+3WSIuGy1ktrAQJtPwf+Nt9C0wbm++61H3JEo+I/f3e5V7H6kKUI nHI3x8uVgtGhc30gmR3+hMIyEzsPy/VahbClNLwoEa96uWhY8kOo9garoLNl7cuW dYKbJTldTzJPbhKBZu8elsjXkdEHH1hshU8Yh2GZJw4FVfwoVNZ+16MSFOdI0gYj NCntIEJkxG1BR0MTeoH/vnArDDqLIuV5u64Wkojshp4LPbwYfUyo3Ov0CzqbcVA5 aNc/54NbsksDCa7NbZB3OYUHng/OjDSKRLruYJ4gV1tjDw9kMljpyfX4vRkOSYCp 3FeZXJ+MLJmzFVe3WXpQMKsA9bQXvRGcLPBO2bXEFiz133caf1w8tA== =w0iD -----END PGP SIGNATURE-----
Steffen Kaiser wrote:
TB gets the messages, but it does not get the new-messages notice, because another client has the same mailbox selected. Once you click in TB on the folder, TB's view of the mailbox is sync'ed with the content of the mailbox on the server.
Hm. But I only one who use this mailbox. I check it. :-) But - I heavy use managesieve and local TB filtering rules. May be this is a clue?
-- Best regards, Proskurin Kirill
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
On Wed, 6 May 2009, Proskurin Kirill wrote:
Hm. But I only one who use this mailbox. I check it. :-)
You didn't denied this assumption earlier :)
But - I heavy use managesieve and local TB filtering rules. May be this is a clue?
I guess not. Did you double checked that you enabled "Check for new mail ..." in both the server configuration and each of the mailboxes?
If so, I would drop SSL/TLS and sniff the connection, whether or not Thunderbird checks the mailboxes at all.
Bye,
Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux)
iQEVAwUBSgFeE3WSIuGy1ktrAQKRAwf+KnOfqUs4XbWJJtkIy+v/hVBD2Rgt5fog xqRD1UoH1N4I+MX/PVExWS+MLWTPH87L0jzKpZ5FpO7d6efA39pTkZk1Njb3joi+ oE0sqamydOtgWXhB67wBwsMINN/hzW+QNNs6YwIcHjMQoaUB5YUPASbU7PvYwgvG R+7e+6O/U12QHNJb6OJPwRnHyh0Xhwc49jkdskI0pQtQYBtOvBPaEM7b8sgek/Ag P/zY3+BgfCtAvxD669+5PuBSB0trgb+EnIm48SECABNCUKYzh1DL3EwvzFdvurcJ dWKvccj9d5Pnd+TYuf9HAzoetP3A716mfTO5Vh2MOEwPAD8ki40IZg== =6z0q -----END PGP SIGNATURE-----
Steffen Kaiser wrote:
You didn't denied this assumption earlier :)
Sorry. :-)
But - I heavy use managesieve and local TB filtering rules. May be this is a clue? I guess not. Did you double checked that you enabled "Check for new mail ..." in both the server configuration and each of the mailboxes?
Yes I check it.
If so, I would drop SSL/TLS and sniff the connection, whether or not Thunderbird checks the mailboxes at all.
Seems to it is not possible in near future. It is heavy used production server. :-(
-- Best regards, Proskurin Kirill
Hi Proskurin,
Seems to it is not possible in near future. It is heavy used production server. :-( I think you should still be able to pull this off with rawlog. It relies on the mail_executable setting, which you should be able to set for some specific user only using some userdb magic. Alternatively, you can create a simple shellscript that either executes rawlog imap or imap directly, depending on the username.
Gr.
Matthijs
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
On Wed, 6 May 2009, Matthijs Kooijman wrote:
Seems to it is not possible in near future. It is heavy used production server. :-( I think you should still be able to pull this off with rawlog. It relies on the mail_executable setting, which you should be able to set for some specific user only using some userdb magic. Alternatively, you can create a simple shellscript that either executes rawlog imap or imap directly, depending on the username.
Matthijs, "rawlog" is all correct and is the correct way in Dovecot.
But if you are not prepared to alter mail_execute on the fly, you are lost. The change to the "postexec" scripting requires a reload as well, if I remember correctly; and you get the performance penalty. Proskurin would risk the stability of his server.
Bye,
Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux)
iQEVAwUBSgGceXWSIuGy1ktrAQIHcAf/btzMQ1Jl4lZ+rMRIBR33kNy4/t9ezxN4 Qt7xhuaBf3D+JyZmKk2nWVg4SpUuxF+fOcqRFi6iNd1f2W2+7714zFD+Riu5HzL0 9pBIlOvZGFq44dB3VQillhkbfK/E4VJSJ5m6LjrWdTo5/m3D486Tj4muppxY9176 aIungFXfV13rvyPCzeNrLEj9taS6QZJzlA0SKJLyUTG0FcAEDXC/VfRftYEQfABM 58CcADXyPr3jN9mB7sf/mw6WdvDo3MB6PdxRGwFd5noWdrfGH9CSxIRI1b+5nwEu orHjtIVtunqdzcweAhKE+VMYYeyNo73LRs5DF/btfJGjqsjPzXcxfQ== =X23d -----END PGP SIGNATURE-----
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
On Wed, 6 May 2009, Proskurin Kirill wrote:
If so, I would drop SSL/TLS and sniff the connection, whether or not Thunderbird checks the mailboxes at all.
Seems to it is not possible in near future. It is heavy used production server. :-(
Therefore I prefer this solution over "rawlog", no need to touch the server or sever-side user settings.
I mean to disable the SSL/TLS on _client_ side. So you can read the sniffed connection, also on the client. If you are located in an insecure environment, you could forward a port on 127.0.0.1 to the server via sslwrap or stunnel, but still sniff the unencrypted client connection to the local port.
Bye,
Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux)
iQEVAwUBSgGagnWSIuGy1ktrAQKGuAf/WpzejsWQrNleRf8tWXw47Jqo5UaMqut6 HonnZcrDF0eb0v/vxzerV/Pb0KQ/FHkkBwTt4jdHD2IMkmg5aUYEqxh4Lx+5w5YN wjL/uIAPWegI2jFKvx7sjNbuRK5abM9SCOz6Zo/nCgcMNlae+u17gv4QJPy41XB/ zfRoMtCaKXgWyaMs6g5Lbz3f3r6mdMghzEkwYJ6gphUUhzQumY13hZAxEA0kx0If z7jsmr21+wfRiqERItjwv+g4PAb0hLtLaTW67hkKVmCGZONhmZaqU8PRLONRhByb NqZXR+doOFGCTKboBXYSSAADQedmQm0C5/H0QCiElWQwxRU23LyrKg== =ec62 -----END PGP SIGNATURE-----
On 5/4/2009 4:21 AM, Proskurin Kirill wrote:
Hello all.
I have strange problem. As I understand IMAP use server2client command to tell what new email is arrived.
So - all was good, but few weeks ago I notice what my thunderbird not show new messages. I think it was local problem(I switch distro what day) but soon my email clients what uses mostly Outlook-2007-SP1 start to confirm this problem.
Is mail.check_all_imap_folders_for_new set in your Thunderbird configuration? It's an advanced setting Tools->Options->Advanced->General->Config Editor
If that value is not True Thunderbird only checks the currently selected folder and the inbox for new messages.
A similar issue was brought up in the recent thread titled "Imap notifications in IDLE"
Jonathan
Jonathan пишет:
I have strange problem. As I understand IMAP use server2client command to tell what new email is arrived.
So - all was good, but few weeks ago I notice what my thunderbird not show new messages. I think it was local problem(I switch distro what day) but soon my email clients what uses mostly Outlook-2007-SP1 start to confirm this problem.
Is mail.check_all_imap_folders_for_new set in your Thunderbird configuration? It's an advanced setting Tools->Options->Advanced->General->Config Editor
If that value is not True Thunderbird only checks the currently selected folder and the inbox for new messages.
Wow! It is works! Thank you!
But I still can`t understand one thing - this option is never was enabled but few weeks ago all works well.
And one more bad thing - how to make such thing in Outlook 2007?...
-- Best regards, Proskuirin Kirill
Hello all!
Well after some testing I got this:
It is managesieve related problem. I message put in some folder via sieve - TB & Outlook don`t see this message.
TB have a workaround described by Jonathan: mail.check_all_imap_folders_for_new must be set "true" in your Thunderbird configuration. It's an advanced setting Tools->Options->Advanced->General->Config Editor
I don`t have a clue how fix it for a Outlook.
Any hints?
-- Best regards, Proskurin Kirill
participants (6)
-
Curtis Maloney
-
Jonathan
-
Matthijs Kooijman
-
Proskurin Kirill
-
Steffen Kaiser
-
Timo Sirainen